Airflow Summit 2026 is coming August 31 - September 2 in Austin, TX. Register now to secure your spot!

airflow.providers.databricks.operators.warehouse

Operators for managing Databricks SQL warehouse lifecycle state.

Classes

DatabricksStartWarehouseOperator

Start a Databricks SQL warehouse and optionally wait for it to run.

DatabricksStopWarehouseOperator

Stop a Databricks SQL warehouse and optionally wait for it to stop.

Module Contents

class airflow.providers.databricks.operators.warehouse.DatabricksStartWarehouseOperator(warehouse_id, *, databricks_conn_id='databricks_default', wait_for_termination=True, polling_period_seconds=30, timeout=3600, databricks_retry_limit=3, databricks_retry_delay=1, databricks_retry_args=None, **kwargs)[source]

Bases: _DatabricksWarehouseBaseOperator

Start a Databricks SQL warehouse and optionally wait for it to run.

Parameters:
  • warehouse_id (str) – ID of the Databricks SQL warehouse. (templated)

  • databricks_conn_id (str) – Reference to the Databricks connection. (templated)

  • wait_for_termination (bool) – Wait until the warehouse reaches RUNNING.

  • polling_period_seconds (int) – Number of seconds between state checks.

  • timeout (float) – Maximum number of seconds to wait for the target state.

  • databricks_retry_limit (int) – Number of times to retry unavailable Databricks requests.

  • databricks_retry_delay (int) – Number of seconds between Databricks request retries.

  • databricks_retry_args (dict[Any, Any] | None) – Additional arguments for tenacity.Retrying.

execute(context)[source]

Derive when creating an operator.

The main method to execute the task. Context is the same dictionary used as when rendering jinja templates.

Refer to get_template_context for more context.

class airflow.providers.databricks.operators.warehouse.DatabricksStopWarehouseOperator(warehouse_id, *, databricks_conn_id='databricks_default', wait_for_termination=True, polling_period_seconds=30, timeout=3600, databricks_retry_limit=3, databricks_retry_delay=1, databricks_retry_args=None, **kwargs)[source]

Bases: _DatabricksWarehouseBaseOperator

Stop a Databricks SQL warehouse and optionally wait for it to stop.

Parameters:
  • warehouse_id (str) – ID of the Databricks SQL warehouse. (templated)

  • databricks_conn_id (str) – Reference to the Databricks connection. (templated)

  • wait_for_termination (bool) – Wait until the warehouse reaches STOPPED.

  • polling_period_seconds (int) – Number of seconds between state checks.

  • timeout (float) – Maximum number of seconds to wait for the target state.

  • databricks_retry_limit (int) – Number of times to retry unavailable Databricks requests.

  • databricks_retry_delay (int) – Number of seconds between Databricks request retries.

  • databricks_retry_args (dict[Any, Any] | None) – Additional arguments for tenacity.Retrying.

execute(context)[source]

Derive when creating an operator.

The main method to execute the task. Context is the same dictionary used as when rendering jinja templates.

Refer to get_template_context for more context.

Was this entry helpful?