airflow.timetables.base
¶
Module Contents¶
Classes¶
A data interval for a DagRun to operate over. |
|
Restriction on when a DAG can be scheduled for a run. |
|
Information to schedule a DagRun. |
|
Protocol that all Timetable classes are expected to implement. |
- class airflow.timetables.base.DataInterval[source]¶
Bases:
NamedTuple
A data interval for a DagRun to operate over.
Both
start
andend
MUST be "aware", i.e. contain timezone information.
- class airflow.timetables.base.TimeRestriction[source]¶
Bases:
NamedTuple
Restriction on when a DAG can be scheduled for a run.
Specifically, the run must not be earlier than
earliest
, nor later thanlatest
. Ifcatchup
is False, the run must also not be earlier than the current time, i.e. "missed" schedules are not backfilled.These values are generally set on the DAG or task's
start_date
,end_date
, andcatchup
arguments.Both
earliest
andlatest
, if not None, are inclusive; a DAG run can happen exactly at either point of time. They are guaranteed to be aware (i.e. contain timezone information) forTimeRestriction
instances created by Airflow.
- class airflow.timetables.base.DagRunInfo[source]¶
Bases:
NamedTuple
Information to schedule a DagRun.
Instances of this will be returned by timetables when they are asked to schedule a DagRun creation.
- run_after :pendulum.DateTime[source]¶
The earliest time this DagRun is created and its tasks scheduled.
This MUST be "aware", i.e. contain timezone information.
- class airflow.timetables.base.Timetable[source]¶
Bases:
airflow.typing_compat.Protocol
Protocol that all Timetable classes are expected to implement.
- description :str =[source]¶
Human-readable description of the timetable.
For example, this can produce something like
'At 21:30, only on Friday'
from the cron expression'30 21 * * 5'
. This is used in the webserver UI.
- periodic :bool = True[source]¶
Whether this timetable runs periodically.
This defaults to and should generally be True, but some special setups like
schedule_interval=None
and"@once"
set it to False.
- can_run :bool = True[source]¶
Whether this timetable can actually schedule runs.
This defaults to and should generally be True, but
NullTimetable
sets this to False.
- classmethod deserialize(cls, data)[source]¶
Deserialize a timetable from data.
This is called when a serialized DAG is deserialized.
data
will be whatever was returned byserialize
during DAG serialization. The default implementation constructs the timetable without any arguments.
- serialize(self)[source]¶
Serialize the timetable for JSON encoding.
This is called during DAG serialization to store timetable information in the database. This should return a JSON-serializable dict that will be fed into
deserialize
when the DAG is deserialized. The default implementation returns an empty dict.
- validate(self)[source]¶
Validate the timetable is correctly specified.
Override this method to provide run-time validation raised when a DAG is put into a dagbag. The default implementation does nothing.
- Raises
AirflowTimetableInvalid on validation failure.
- property summary(self)[source]¶
A short summary for the timetable.
This is used to display the timetable in the web UI. A cron expression timetable, for example, can use this to display the expression. The default implementation returns the timetable's type name.
- abstract infer_manual_data_interval(self, *, run_after)[source]¶
When a DAG run is manually triggered, infer a data interval for it.
This is used for e.g. manually-triggered runs, where
run_after
would be when the user triggers the run. The default implementation raisesNotImplementedError
.
- abstract next_dagrun_info(self, *, last_automated_data_interval, restriction)[source]¶
Provide information to schedule the next DagRun.
The default implementation raises
NotImplementedError
.- Parameters
last_automated_data_interval (Optional[DataInterval]) -- The data interval of the associated DAG's last scheduled or backfilled run (manual runs not considered).
restriction (TimeRestriction) -- Restriction to apply when scheduling the DAG run. See documentation of
TimeRestriction
for details.
- Returns
Information on when the next DagRun can be scheduled. None means a DagRun will not happen. This does not mean no more runs will be scheduled even again for this DAG; the timetable can return a DagRunInfo object when asked at another time.
- Return type
Optional[DagRunInfo]