Authoring and Scheduling¶
Here you can find detailed documentation about advanced authoring and scheduling airflow DAGs. It’s recommended that you first review the pages in core concepts
Authoring
- Plugins
- Deferrable Operators & Triggers
- DAG File Processing
- Serialization
- Connections & Hooks
- Dynamic Task Mapping
- Simple mapping
- Mapping with non-TaskFlow operators
- Assigning multiple parameters to a non-TaskFlow operator
- Mapping over a task group
- Filtering items from a mapped task
- Transforming expanding data
- Combining upstream data (aka “zipping”)
- What data types can be expanded?
- How do templated fields and mapped arguments interact?
- Placing limits on mapped tasks
- Automatically skipping zero-length maps
Scheduling