airflow.providers.databricks.operators.warehouse¶
Operators for managing Databricks SQL warehouse lifecycle state.
Classes¶
Start a Databricks SQL warehouse and optionally wait for it to run. |
|
Stop a Databricks SQL warehouse and optionally wait for it to stop. |
Module Contents¶
- class airflow.providers.databricks.operators.warehouse.DatabricksStartWarehouseOperator(warehouse_id, *, databricks_conn_id='databricks_default', wait_for_termination=True, polling_period_seconds=30, timeout=3600, databricks_retry_limit=3, databricks_retry_delay=1, databricks_retry_args=None, **kwargs)[source]¶
Bases:
_DatabricksWarehouseBaseOperatorStart a Databricks SQL warehouse and optionally wait for it to run.
- Parameters:
warehouse_id (str) – ID of the Databricks SQL warehouse. (templated)
databricks_conn_id (str) – Reference to the Databricks connection. (templated)
wait_for_termination (bool) – Wait until the warehouse reaches
RUNNING.polling_period_seconds (int) – Number of seconds between state checks.
timeout (float) – Maximum number of seconds to wait for the target state.
databricks_retry_limit (int) – Number of times to retry unavailable Databricks requests.
databricks_retry_delay (int) – Number of seconds between Databricks request retries.
databricks_retry_args (dict[Any, Any] | None) – Additional arguments for
tenacity.Retrying.
- class airflow.providers.databricks.operators.warehouse.DatabricksStopWarehouseOperator(warehouse_id, *, databricks_conn_id='databricks_default', wait_for_termination=True, polling_period_seconds=30, timeout=3600, databricks_retry_limit=3, databricks_retry_delay=1, databricks_retry_args=None, **kwargs)[source]¶
Bases:
_DatabricksWarehouseBaseOperatorStop a Databricks SQL warehouse and optionally wait for it to stop.
- Parameters:
warehouse_id (str) – ID of the Databricks SQL warehouse. (templated)
databricks_conn_id (str) – Reference to the Databricks connection. (templated)
wait_for_termination (bool) – Wait until the warehouse reaches
STOPPED.polling_period_seconds (int) – Number of seconds between state checks.
timeout (float) – Maximum number of seconds to wait for the target state.
databricks_retry_limit (int) – Number of times to retry unavailable Databricks requests.
databricks_retry_delay (int) – Number of seconds between Databricks request retries.
databricks_retry_args (dict[Any, Any] | None) – Additional arguments for
tenacity.Retrying.