airflow.executors.dask_executor
¶
DaskExecutor
See also
For more information on how the DaskExecutor works, take a look at the guide: Dask Executor
Module Contents¶
Classes¶
DaskExecutor submits tasks to a Dask Distributed cluster. |
- class airflow.executors.dask_executor.DaskExecutor(cluster_address=None)[source]¶
Bases:
airflow.executors.base_executor.BaseExecutor
DaskExecutor submits tasks to a Dask Distributed cluster.
- execute_async(key, command, queue=None, executor_config=None)[source]¶
This method will execute the command asynchronously.
- Parameters
key (airflow.models.taskinstance.TaskInstanceKey) – Unique key for the task instance
command (airflow.executors.base_executor.CommandType) – Command to run
queue (str | None) – name of the queue
executor_config (Any | None) – Configuration passed to the executor.
- sync()[source]¶
Sync will get called periodically by the heartbeat method. Executors should override this to perform gather statuses.