airflow.models.taskmixin

Module Contents

Classes

DependencyMixin

Mixing implementing common dependency setting methods methods like >> and <<.

TaskMixin

meta private

DAGNode

A base class for a node in the graph of a workflow -- an Operator or a Task Group, either mapped or
class airflow.models.taskmixin.DependencyMixin[source]

Mixing implementing common dependency setting methods methods like >> and <<.

property roots[source]

List of root nodes – ones with no upstream dependencies.

a.k.a. the “start” of this sub-graph

property leaves[source]

List of leaf nodes – ones with only upstream dependencies.

a.k.a. the “end” of this sub-graph

abstract set_upstream(other)[source]

Set a task or a task list to be directly upstream from the current task.

abstract set_downstream(other)[source]

Set a task or a task list to be directly downstream from the current task.

update_relative(other, upstream=True)[source]

Update relationship information about another TaskMixin. Default is no-op. Override if necessary.

__lshift__(other)[source]

Implements Task << Task

__rshift__(other)[source]

Implements Task >> Task

__rrshift__(other)[source]

Called for Task >> [Task] because list don’t have __rshift__ operators.

__rlshift__(other)[source]

Called for Task << [Task] because list don’t have __lshift__ operators.

class airflow.models.taskmixin.TaskMixin[source]

Bases: DependencyMixin

classmethod __init_subclass__()[source]
class airflow.models.taskmixin.DAGNode[source]

Bases: DependencyMixin

A base class for a node in the graph of a workflow – an Operator or a Task Group, either mapped or unmapped.

dag :Optional[airflow.models.dag.DAG][source]
task_group :Optional[airflow.utils.task_group.TaskGroup][source]

The task_group that contains this node

start_date :Optional[pendulum.DateTime][source]
end_date :Optional[pendulum.DateTime][source]
upstream_task_ids :Set[str][source]
downstream_task_ids :Set[str][source]
property node_id[source]
property label[source]
has_dag()[source]
property dag_id[source]

Returns dag id if it has one or an adhoc/meaningless ID

property log[source]
property roots[source]

List of root nodes – ones with no upstream dependencies.

a.k.a. the “start” of this sub-graph

property leaves[source]

List of leaf nodes – ones with only upstream dependencies.

a.k.a. the “end” of this sub-graph

set_downstream(task_or_task_list, edge_modifier=None)[source]

Set a node (or nodes) to be directly downstream from the current node.

set_upstream(task_or_task_list, edge_modifier=None)[source]

Set a node (or nodes) to be directly upstream from the current node.

property downstream_list[source]

List of nodes directly downstream

property upstream_list[source]

List of nodes directly upstream

get_direct_relative_ids(upstream=False)[source]

Get set of the direct relative ids to the current task, upstream or downstream.

get_direct_relatives(upstream=False)[source]

Get list of the direct relatives to the current task, upstream or downstream.

abstract serialize_for_task_group()[source]

This is used by SerializedTaskGroup to serialize a task group’s content.

iter_mapped_dependants()[source]

Return mapped nodes that depend on the current task the expansion.

For now, this walks the entire DAG to find mapped nodes that has this current task as an upstream. We cannot use downstream_list since it only contains operators, not task groups. In the future, we should provide a way to record an DAG node’s all downstream nodes instead.

Was this entry helpful?