Durable and Deferrable Operators

Durable 17: On retry, reconnects to the job it already started, or replays the progress it saved, instead of starting over. Controlled by the operator's durable flag: on by default for most, opt-in for the AI agent operators. Several only reconnect on Airflow 3.3+.
Deferrable 248: Frees the worker slot while waiting: a Triggerer does the waiting, and if it dies another Triggerer restarts the wait. Off by default: pass deferrable=True (or set [operators] default_deferrable) where the operator exposes it; some always defer.

251 modules

Airbyte 2

S

AirbyteJobSensor Deferrable

Check for the state of a previously submitted Airbyte job.
O

AirbyteTriggerSyncOperator Deferrable

Submits a job to an Airbyte server to run a integration process between your source and destination.

Amazon 106

O

EksPodOperator Durable Deferrable

Executes a task in a Kubernetes pod on the specified Amazon EKS Cluster.
O

GlueJobOperator Durable Deferrable

Create an AWS Glue Job.
O

RedshiftDataOperator Durable Deferrable

Executes SQL Statements against an Amazon Redshift cluster using Redshift Data.
O

AthenaOperator Deferrable

An operator that submits a Trino/Presto query to Amazon Athena.
O

BatchCreateComputeEnvironmentOperator Deferrable

Create an AWS Batch compute environment.
O

BatchOperator Deferrable

Execute a job on AWS Batch.
S

BatchSensor Deferrable

Poll the state of the Batch Job until it reaches a terminal state; fails if the job fails.
O

BedrockBatchInferenceOperator Deferrable

Create a batch inference job to invoke a model on multiple prompts.
S

BedrockBatchInferenceSensor Deferrable

Poll the batch inference job status until it reaches a terminal state; fails if creation fails.
O

BedrockCreateAgentRuntimeOperator Deferrable

Create an Amazon Bedrock AgentCore Runtime.
O

BedrockCreateKnowledgeBaseOperator Deferrable

Create a knowledge base that contains data sources used by Amazon Bedrock LLMs and Agents.
O

BedrockCreateProvisionedModelThroughputOperator Deferrable

Create a fine-tuning job to customize a base model.
S

BedrockCustomizeModelCompletedSensor Deferrable

Poll the state of the model customization job until it reaches a terminal state; fails if the job fails.
O

BedrockCustomizeModelOperator Deferrable

Create a fine-tuning job to customize a base model.
O

BedrockDeleteAgentRuntimeOperator Deferrable

Delete an Amazon Bedrock AgentCore Runtime.
O

BedrockIngestDataOperator Deferrable

Begin an ingestion job, in which an Amazon Bedrock data source is added to an Amazon Bedrock knowledge base.
S

BedrockIngestionJobSensor Deferrable

Poll the ingestion job status until it reaches a terminal state; fails if creation fails.
S

BedrockKnowledgeBaseActiveSensor Deferrable

Poll the Knowledge Base status until it reaches a terminal state; fails if creation fails.
S

BedrockProvisionModelThroughputCompletedSensor Deferrable

Poll the provisioned model throughput job until it reaches a terminal state; fails if the job fails.
S

ComprehendCreateDocumentClassifierCompletedSensor Deferrable

Poll the state of the document classifier until it reaches a completed state; fails if the job fails.
O

ComprehendCreateDocumentClassifierOperator Deferrable

Create a comprehend document classifier that can categorize documents.
S

ComprehendStartPiiEntitiesDetectionJobCompletedSensor Deferrable

Poll the state of the pii entities detection job until it reaches a completed state; fails if the job fails.
O

ComprehendStartPiiEntitiesDetectionJobOperator Deferrable

Create a comprehend pii entities detection job for a collection of documents.
O

DmsDeleteReplicationConfigOperator Deferrable

Deletes an AWS DMS Serverless replication configuration.
O

DmsModifyTaskOperator Deferrable

Modifies an existing AWS DMS replication task.
O

DmsReloadTablesOperator Deferrable

Reload target tables for a running AWS DMS replication task.
O

DmsStartReplicationOperator Deferrable

Starts an AWS DMS Serverless replication.
O

DmsStopReplicationOperator Deferrable

Stops an AWS DMS Serverless replication.
S

DynamoDBValueSensor Deferrable

Waits for an attribute value to be present for an item in a DynamoDB table.
S

EC2InstanceStateSensor Deferrable

Poll the state of the AWS EC2 instance until the instance reaches the target state.
O

EcsCreateClusterOperator Deferrable

Creates an AWS ECS cluster.
O

EcsDeleteClusterOperator Deferrable

Deletes an AWS ECS cluster.
O

EcsRunTaskOperator Deferrable

Execute a task on AWS ECS (Elastic Container Service).
O

EksCreateClusterOperator Deferrable

Creates an Amazon EKS Cluster control plane.
O

EksCreateFargateProfileOperator Deferrable

Creates an AWS Fargate profile for an Amazon EKS cluster.
O

EksCreateNodegroupOperator Deferrable

Creates an Amazon EKS managed node group for an existing Amazon EKS Cluster.
O

EksDeleteClusterOperator Deferrable

Deletes the Amazon EKS Cluster control plane and all nodegroups attached to it.
O

EksDeleteFargateProfileOperator Deferrable

Deletes an AWS Fargate profile from an Amazon EKS Cluster.
O

EksDeleteNodegroupOperator Deferrable

Deletes an Amazon EKS managed node group from an Amazon EKS Cluster.
O

EmrAddStepsOperator Deferrable

An operator that adds steps to an existing EMR job_flow.
O

EmrContainerOperator Deferrable

An operator that submits jobs to EMR on EKS virtual clusters.
S

EmrContainerSensor Deferrable

Poll the state of the job run until it reaches a terminal state; fail if the job run fails.
O

EmrCreateJobFlowOperator Deferrable

Creates an EMR JobFlow, reading the config from the EMR connection.
S

EmrJobFlowSensor Deferrable

Poll the EMR JobFlow Cluster until it reaches any of the target states; raise AirflowException on failure.
O

EmrServerlessCreateApplicationOperator Deferrable

Operator to create Serverless EMR Application.
O

EmrServerlessDeleteApplicationOperator Deferrable

Operator to delete EMR Serverless application.
S

EmrServerlessJobSensor Deferrable

Poll the state of the job run until it reaches one of the target states; fails if the job run fails.
O

EmrServerlessStartJobOperator Deferrable

Operator to start EMR Serverless job.
O

EmrServerlessStartSessionOperator Deferrable

Start an EMR Serverless interactive session and wait until it is ready.
O

EmrServerlessStopApplicationOperator Deferrable

Operator to stop an EMR Serverless application.
S

EmrStepSensor Deferrable

Poll the state of the step until it reaches any of the target states; raise AirflowException on failure.
O

EmrTerminateJobFlowOperator Deferrable

Operator to terminate EMR JobFlows.
S

GlueCatalogPartitionSensor Deferrable

Waits for a partition to show up in AWS Glue Catalog.
O

GlueCrawlerOperator Deferrable

Create, update and run an AWS Glue crawler.
O

GlueCrawlerRunOperator Deferrable

Run an existing AWS Glue crawler.
O

GlueDataBrewStartJobOperator Deferrable

Start an AWS Glue DataBrew job.
O

GlueDataQualityRuleRecommendationRunOperator Deferrable

Starts a recommendation run that is used to generate rules, Glue Data Quality analyzes the data and comes up with recommendations for a potential ruleset.
S

GlueDataQualityRuleRecommendationRunSensor Deferrable

Waits for an AWS Glue data quality recommendation run to reach any of the status below.
O

GlueDataQualityRuleSetEvaluationRunOperator Deferrable

Evaluate a ruleset against a data source (Glue table).
S

GlueDataQualityRuleSetEvaluationRunSensor Deferrable

Waits for an AWS Glue data quality ruleset evaluation run to reach any of the status below.
S

GlueJobSensor Deferrable

Waits for an AWS Glue Job to reach any of the status below.
S

KinesisAnalyticsV2StartApplicationCompletedSensor Deferrable

Waits for AWS Managed Service for Apache Flink application to start.
O

KinesisAnalyticsV2StartApplicationOperator Deferrable

Starts an AWS Managed Service for Apache Flink application.
S

KinesisAnalyticsV2StopApplicationCompletedSensor Deferrable

Waits for AWS Managed Service for Apache Flink application to stop.
O

KinesisAnalyticsV2StopApplicationOperator Deferrable

Stop an AWS Managed Service for Apache Flink application.
O

LambdaCreateFunctionOperator Deferrable

Creates an AWS Lambda function.
S

MwaaDagRunSensor Deferrable

Waits for a Dag Run in an MWAA Environment to complete.
S

MwaaTaskSensor Deferrable

Waits for a task in an MWAA Environment to complete.
O

MwaaTriggerDagRunOperator Deferrable

Trigger a Dag Run for a Dag in an Amazon MWAA environment.
O

NeptuneCancelImportTaskOperator Deferrable

Cancels an active Neptune Graph import task.
O

NeptuneCreateGraphOperator Deferrable

Creates an empty Amazon Neptune Graph database.
O

NeptuneCreateGraphWithImportOperator Deferrable

Creates a Neptune Graph and imports data into it.
O

NeptuneCreatePrivateGraphEndpointOperator Deferrable

Creates a Neptune Graph private endpoint.
O

NeptuneDeleteGraphOperator Deferrable

Deletes an Amazon Neptune Graph database.
O

NeptuneDeletePrivateGraphEndpointOperator Deferrable

Deletes a Neptune Graph private endpoint.
O

NeptuneStartDbClusterOperator Deferrable

Starts an Amazon Neptune DB cluster.
O

NeptuneStartImportTaskOperator Deferrable

Starts a bulk data import task to load data into an empty Neptune graph.
O

NeptuneStopDbClusterOperator Deferrable

Stops an Amazon Neptune DB cluster.
S

OpenSearchServerlessCollectionActiveSensor Deferrable

Poll the state of the Collection until it reaches a terminal state; fails if the query fails.
O

QuickSightCreateIngestionOperator Deferrable

Creates and starts a new SPICE ingestion for a dataset; also helps to Refresh existing SPICE datasets.
S

QuickSightSensor Deferrable

Watches for the status of an Amazon QuickSight Ingestion.
O

RdsCreateDbInstanceOperator Deferrable

Creates an RDS DB instance.
O

RdsDeleteDbInstanceOperator Deferrable

Deletes an RDS DB Instance.
O

RdsStartDbOperator Deferrable

Starts an RDS DB instance / cluster.
O

RdsStopDbOperator Deferrable

Stops an RDS DB instance / cluster.
S

RedshiftClusterSensor Deferrable

Waits for a Redshift cluster to reach a specific status.
O

RedshiftCreateClusterOperator Deferrable

Creates a new cluster with the specified parameters.
O

RedshiftCreateClusterSnapshotOperator Deferrable

Creates a manual snapshot of the specified cluster. The cluster must be in the available state.
O

RedshiftDeleteClusterOperator Deferrable

Delete an AWS Redshift cluster.
O

RedshiftPauseClusterOperator Deferrable

Pause an AWS Redshift Cluster if it has status `available`.
O

RedshiftResumeClusterOperator Deferrable

Resume a paused AWS Redshift Cluster.
S

S3KeySensor Deferrable

Waits for one or multiple keys (a file-like instance on S3) to be present in a S3 bucket.
S

S3KeysUnchangedSensor Deferrable

Return True if inactivity_period has passed with no increase in the number of objects matching prefix.
O

SageMakerEndpointOperator Deferrable

When you create a serverless endpoint, SageMaker provisions and manages the compute resources for you.
O

SageMakerNotebookOperator Deferrable

Provides Jupyter notebook artifact execution functionality for Sagemaker Unified Studio Workflows.
O

SageMakerProcessingOperator Deferrable

Use Amazon SageMaker Processing to analyze data and evaluate machine learning models on Amazon SageMaker.
O

SageMakerStartPipelineOperator Deferrable

Starts a SageMaker pipeline execution.
O

SageMakerStopPipelineOperator Deferrable

Stops a SageMaker pipeline execution.
O

SageMakerTrainingOperator Deferrable

Starts a model training job.
O

SageMakerTransformOperator Deferrable

Starts a transform job.
O

SageMakerTuningOperator Deferrable

Starts a hyperparameter tuning job.
O

SageMakerUnifiedStudioNotebookOperator Deferrable

Execute a notebook in SageMaker Unified Studio.
S

SqsSensor Deferrable

Get messages from an Amazon SQS queue and then delete the messages from the queue.
S

SsmRunCommandCompletedSensor Deferrable

Poll the state of an AWS SSM Run Command until completion.
O

SsmRunCommandOperator Deferrable

Executes the SSM Run Command to perform actions on managed instances.
O

StepFunctionStartExecutionOperator Deferrable

An Operator that begins execution of an AWS Step Function State Machine.

Anthropic 3

O

AnthropicAgentSessionOperator Deferrable

Run a Managed Agents session against a pre-created agent and environment.
O

AnthropicBatchOperator Deferrable

Submit an Anthropic Message Batch and wait for it to complete.
S

AnthropicBatchSensor Deferrable

Wait for an already-submitted Anthropic Message Batch to reach a terminal status.

Apache Beam 2

O

BeamRunJavaPipelineOperator Deferrable

Launching Apache Beam pipelines written in Java.
O

BeamRunPythonPipelineOperator Deferrable

Launch Apache Beam pipelines written in Python.

Apache Kafka 2

S

AwaitMessageSensor Deferrable

An Airflow sensor that defers until a specific message is published to Kafka.
S

AwaitMessageTriggerFunctionSensor Deferrable

Defer until a specific message is published to Kafka, trigger a registered function, then resume waiting.

Apache Livy 1

O

LivyOperator Durable Deferrable

Wraps the Apache Livy batch REST API, allowing to submit a Spark application to the underlying cluster.

Apache Spark 1

O

SparkSubmitOperator Durable

Wrap the spark-submit binary to kick off a spark-submit job; requires "spark-submit" binary in the PATH.

Common AI 4

@

@task.agent Durable

Wrap a function that returns a prompt into an agentic LLM task.
O

AgentOperator Durable

Run a pydantic-ai Agent with tools and multi-turn reasoning.
@

@task.llm_batch Deferrable

Wrap a function that returns a batch's inputs into an ``@task.llm_batch`` task.
O

LLMBatchOperator Deferrable

Submit prompts as a provider batch job and land results on object storage.

Common SQL 1

O

GenericTransfer Deferrable

Moves data from a connection to another.

Databricks 9

O

DatabricksRunNowOperator Durable Deferrable

Runs an existing Spark job run to Databricks using the api/2.2/jobs/run-now API endpoint.
O

DatabricksSubmitRunOperator Durable Deferrable

Submits a Spark job run to Databricks using the api/2.2/jobs/runs/submit API endpoint.
O

DatabricksNotebookOperator Deferrable

Runs a notebook on Databricks using an Airflow operator.
O

DatabricksSQLStatementsOperator Deferrable

Submits a Databricks SQL Statement to Databricks using the api/2.0/sql/statements/ API endpoint.
S

DatabricksSQLStatementsSensor Deferrable

DatabricksSQLStatementsSensor.
O

DatabricksStartWarehouseOperator Deferrable

Start a Databricks SQL warehouse and optionally wait for it to run.
O

DatabricksStopWarehouseOperator Deferrable

Stop a Databricks SQL warehouse and optionally wait for it to stop.
O

DatabricksTaskBaseOperator Deferrable

Base class for operators that are run as Databricks job tasks or tasks within a Databricks workflow.
O

DatabricksTaskOperator Deferrable

Runs a task on Databricks using an Airflow operator.

dbt Cloud 2

S

DbtCloudJobRunSensor Deferrable

Checks the status of a dbt Cloud job run.
O

DbtCloudRunJobOperator Deferrable

Executes a dbt Cloud job.

Google 68

O

BigQueryInsertJobOperator Durable Deferrable

Execute a BigQuery job.
O

GKEStartPodOperator Durable Deferrable

Executes a task in a Kubernetes pod in the specified Google Kubernetes Engine cluster.
O

BigQueryCheckOperator Deferrable

Performs checks against BigQuery.
O

BigQueryDataTransferServiceStartTransferRunsOperator Deferrable

Start manual transfer runs to be executed now with schedule_time equal to current time.
O

BigQueryGetDataOperator Deferrable

Fetch data and return it, either from a BigQuery table, or results of a query job.
O

BigQueryIntervalCheckOperator Deferrable

Check that the values of metrics given as SQL expressions are within a tolerance of the older ones.
S

BigQueryStreamingBufferEmptySensor Deferrable

Wait for the streaming buffer of a BigQuery table to be empty.
S

BigQueryTableExistenceSensor Deferrable

Checks for the existence of a table in Google Bigquery.
S

BigQueryTablePartitionExistenceSensor Deferrable

Checks for the existence of a partition within a table in Google Bigquery.
X

BigQueryToGCSOperator Deferrable

Transfers a BigQuery table to a Google Cloud Storage bucket.
O

BigQueryValueCheckOperator Deferrable

Perform a simple value check using sql code.
O

CloudBatchSubmitJobOperator Deferrable

Submit a job and wait for its completion.
O

CloudBuildCreateBuildOperator Deferrable

Starts a build with the specified configuration.
O

CloudComposerCreateEnvironmentOperator Deferrable

Create a new environment.
S

CloudComposerDAGRunSensor Deferrable

Check if a DAG run has completed.
O

CloudComposerDeleteEnvironmentOperator Deferrable

Delete an environment.
S

CloudComposerExternalTaskSensor Deferrable

Waits for a different Dag, task group, or task to complete for a specific composer environment.
O

CloudComposerRunAirflowCLICommandOperator Deferrable

Run Airflow command for provided Composer environment.
O

CloudComposerUpdateEnvironmentOperator Deferrable

Update an environment.
O

CloudDataFusionStartPipelineOperator Deferrable

Starts a Cloud Data Fusion pipeline. Works for both batch and stream pipelines.
O

CloudDataTransferServiceGCSToGCSOperator Deferrable

Copies objects from a bucket to another using the Google Cloud Storage Transfer Service.
S

CloudDataTransferServiceJobStatusSensor Deferrable

Waits for at least one operation belonging to the job to have the expected status.
O

CloudDataTransferServiceRunJobOperator Deferrable

Runs a transfer job.
O

CloudDataTransferServiceS3ToGCSOperator Deferrable

Sync an S3 bucket with a Google Cloud Storage bucket using the Google Cloud Storage Transfer Service.
O

CloudRunExecuteJobOperator Deferrable

Executes a job and waits for the operation to be completed. Pushes the executed job to xcom.
O

CloudSQLExportInstanceOperator Deferrable

Export data from a Cloud SQL instance to a Cloud Storage bucket.
S

CloudSQLNoOperationInProgressSensor Deferrable

Wait until a Cloud SQL instance has no administrative operation in progress.
O

CreateBatchPredictionJobOperator Deferrable

Creates a BatchPredictionJob. A BatchPredictionJob once created will right away be attempted to start.
O

CreateCustomContainerTrainingJobOperator Deferrable

Create Custom Container Training job.
O

CreateCustomJobOperator Deferrable

Create a CustomJob. A created CustomJob right away will be attempted to be run.
O

CreateCustomPythonPackageTrainingJobOperator Deferrable

Create Custom Python Package Training job.
O

CreateCustomTrainingJobOperator Deferrable

Create a Custom Training Job pipeline.
O

CreateHyperparameterTuningJobOperator Deferrable

Create Hyperparameter Tuning job.
S

DataflowJobAutoScalingEventsSensor Deferrable

Checks for autoscaling events associated with a single job in Google Cloud Dataflow.
S

DataflowJobMessagesSensor Deferrable

Checks for job messages associated with a single job in Google Cloud Dataflow.
S

DataflowJobMetricsSensor Deferrable

Checks for metrics associated with a single job in Google Cloud Dataflow.
S

DataflowJobStatusSensor Deferrable

Checks for the status of a job in Google Cloud Dataflow.
O

DataflowStartFlexTemplateOperator Deferrable

Starts a Dataflow Job with a Flex Template.
O

DataflowStartYamlJobOperator Deferrable

Launch a Dataflow YAML job and return the result.
O

DataflowTemplatedJobStartOperator Deferrable

Start a Dataflow job with a classic template; the parameters of the operation will be passed to the job.
O

DataplexGetDataQualityScanResultOperator Deferrable

Gets a Data Scan Job resource.
O

DataplexRunDataProfileScanOperator Deferrable

Runs an on-demand execution of a DataScan Data Profile Scan.
O

DataplexRunDataQualityScanOperator Deferrable

Runs an on-demand execution of a DataScan.
O

DataprocCreateBatchOperator Deferrable

Create a batch workload.
O

DataprocCreateClusterOperator Deferrable

Create a new cluster on Google Cloud Dataproc.
O

DataprocDeleteClusterOperator Deferrable

Delete a cluster in a project.
O

DataprocDiagnoseClusterOperator Deferrable

Diagnose a cluster in a project.
O

DataprocInstantiateInlineWorkflowTemplateOperator Deferrable

Instantiate a WorkflowTemplate Inline on Google Cloud Dataproc.
O

DataprocInstantiateWorkflowTemplateOperator Deferrable

Instantiate a WorkflowTemplate on Google Cloud Dataproc.
O

DataprocJobBaseOperator Deferrable

Base class for operators that launch job on DataProc.
O

DataprocSubmitJobOperator Deferrable

Submit a job to a cluster.
O

DataprocUpdateClusterOperator Deferrable

Update a cluster in a project.
S

GCSObjectExistenceSensor Deferrable

Checks for the existence of a file in Google Cloud Storage.
S

GCSObjectsWithPrefixExistenceSensor Deferrable

Checks for the existence of GCS objects at a given prefix, passing matches via XCom.
S

GCSObjectUpdateSensor Deferrable

Checks if an object is updated in Google Cloud Storage.
X

GCSToBigQueryOperator Deferrable

Loads files from Google Cloud Storage into BigQuery.
S

GCSUploadSessionCompleteSensor Deferrable

Return True if the inactivity period has passed with no increase in the number of objects in the bucket.
O

GenAIGeminiCreateBatchJobOperator Deferrable

Create Batch job using Gemini Batch API. Use to generate model response for several requests.
O

GenAIGeminiCreateEmbeddingsBatchJobOperator Deferrable

Create embeddings Batch job using Gemini Batch API.
O

GKECreateClusterOperator Deferrable

Create a Google Kubernetes Engine Cluster of specified dimensions and wait until the cluster is created.
O

GKEDeleteClusterOperator Deferrable

Deletes the cluster, including the Kubernetes endpoint and all worker nodes.
O

GKEStartJobOperator Deferrable

Executes a Kubernetes job in the specified Google Kubernetes Engine cluster.
O

GKEStartKueueJobOperator Deferrable

Executes a Kubernetes Job in Kueue in the specified Google Kubernetes Engine cluster.
O

PubSubPullOperator Deferrable

Pulls messages from a PubSub subscription and passes them through XCom.
S

PubSubPullSensor Deferrable

Pulls messages from a PubSub subscription and passes them through XCom.
O

RunPipelineJobOperator Deferrable

Create and run a Pipeline job.
O

RunQueryJobOperator Deferrable

Run a query job on a Vertex AI Agent Engine.
X

S3ToGCSOperator Deferrable

Synchronizes an S3 key, possibly a prefix, with a Google Cloud Storage destination path.

Hypertext Transfer Protocol (HTTP) 2

O

HttpOperator Deferrable

Calls an endpoint on an HTTP system to execute an action.
S

HttpSensor Deferrable

Execute HTTP GET statement; return False on failure 404 Not Found or `response_check` returning False.

Influxdb 2

O

InfluxDB3Operator Deferrable

Execute SQL query in InfluxDB 3.x database.
S

InfluxDB3Sensor Deferrable

Wait until an InfluxDB 3.x SQL query returns a truthy first cell.

Kubernetes 6

@

@task.kubernetes Durable Deferrable

Kubernetes operator decorator.
@

@task.kubernetes_cmd Durable Deferrable

Kubernetes cmd operator decorator.
O

KubernetesPodOperator Durable Deferrable

Execute a task in a Kubernetes Pod.
O

SparkKubernetesOperator Durable Deferrable

Creates sparkApplication object in kubernetes cluster.
O

KubernetesJobOperator Deferrable

Executes a Kubernetes Job.
O

KubernetesStartKueueJobOperator Deferrable

Executes a Kubernetes Job in Kueue.

Microsoft Azure 17

O

AzureAnalysisServicesRefreshOperator Deferrable

Trigger an Azure Analysis Services model refresh and optionally wait for completion.
S

AzureAnalysisServicesSensor Deferrable

Wait for an Azure Analysis Services model refresh to finish.
O

AzureBatchOperator Deferrable

Executes a job on Azure Batch Service.
O

AzureContainerInstancesOperator Deferrable

Start a container on Azure Container Instances.
S

AzureDataFactoryPipelineRunStatusSensor Deferrable

Checks the status of a pipeline run.
O

AzureDataFactoryRunPipelineOperator Deferrable

Execute a data factory pipeline.
O

AzureSynapseRunPipelineOperator Deferrable

Execute a Synapse Pipeline.
S

AzureVirtualMachineStateSensor Deferrable

Poll an Azure Virtual Machine until it reaches a target power state.
O

CreateAzureAIAgentOperator Deferrable

Create an Azure AI Hosted agent version from a container image definition.
O

MSGraphAsyncOperator Deferrable

A Microsoft Graph API operator which allows you to execute REST call to the Microsoft Graph API.
S

MSGraphSensor Deferrable

A Microsoft Graph API sensor which allows you to poll an async REST call to the Microsoft Graph API.
O

PowerBIDatasetListOperator Deferrable

Gets a list of datasets where the service principal from the connection is assigned as admin.
O

PowerBIDatasetRefreshOperator Deferrable

Refreshes a Power BI dataset.
O

PowerBIWorkspaceListOperator Deferrable

Gets a list of workspaces where the service principal from the connection is assigned as admin.
O

UpdateAzureAIAgentOperator Deferrable

Create a new version of an existing Azure AI Hosted agent.
S

WasbBlobSensor Deferrable

Waits for a blob to arrive on Azure Blob Storage.
S

WasbPrefixSensor Deferrable

Wait for blobs matching a prefix to arrive on Azure Blob Storage.

OpenAI 2

O

OpenAIAgentSessionOperator Deferrable

Run one turn in a fresh OpenAI Managed Agents session and return its session ID.
O

OpenAITriggerBatchOperator Deferrable

Operator that triggers an OpenAI Batch API endpoint and waits for the batch to complete.

SFTP 3

@

@task.sftp_sensor Deferrable

Wrap a function into an Airflow operator.
O

SFTPOperator Deferrable

SFTPOperator for transferring files from remote host to local or vice a versa.
S

SFTPSensor Deferrable

Waits for a file or directory to be present on SFTP.

Snowflake 3

O

SnowflakeNotebookOperator Durable Deferrable

Execute a Snowflake Notebook via the Snowflake SQL API.
O

SnowflakeSqlApiOperator Durable Deferrable

Implemented Snowflake SQL API Operator to support multiple SQL statements sequentially.
O

SnowparkContainerJobOperator Deferrable

Execute a job on Snowpark Container Services.

SSH 1

O

SSHRemoteJobOperator Deferrable

Execute a command on a remote host via SSH with deferrable monitoring.

Standard 9

S

DateTimeSensorAsync Deferrable

Wait until the specified datetime occurs.
S

ExternalTaskSensor Deferrable

Waits for a different DAG, task group, or task to complete for a specific logical date.
S

FileSensor Deferrable

Waits for a file or folder to land in a filesystem.
S

TimeDeltaSensor Deferrable

Waits for a timedelta.
S

TimeDeltaSensorAsync Deferrable

Deprecated. Use TimeDeltaSensor with deferrable=True instead.
S

TimeSensor Deferrable

Waits until the specified time of the day.
S

TimeSensorAsync Deferrable

Deprecated. Use TimeSensor with deferrable=True instead.
O

TriggerDagRunOperator Deferrable

Triggers a DAG run for a specified DAG ID.
S

WaitSensor Deferrable

A sensor that waits a specified period of time before completing.

Teradata 3

O

TeradataComputeClusterProvisionOperator Deferrable

Creates the new Computer Cluster with specified Compute Group Name and Compute Profile Name.
O

TeradataComputeClusterResumeOperator Deferrable

Teradata Compute Cluster Operator to Resume the specified Teradata Vantage Cloud Lake Compute Cluster.
O

TeradataComputeClusterSuspendOperator Deferrable

Teradata Compute Cluster Operator to suspend the specified Teradata Vantage Cloud Lake Compute Cluster.

Vespa 1

O

VespaIngestOperator Deferrable

Defer a Vespa feed, update, or delete operation to a trigger.

Windows Remote Management (WinRM) 1

O

WinRMOperator Deferrable

WinRMOperator to execute commands on given remote host using the winrm_hook.

Airbyte 2

AirbyteJobSensor Deferrable

AirbyteTriggerSyncOperator Deferrable

Amazon 106

EksPodOperator Durable Deferrable

GlueJobOperator Durable Deferrable

RedshiftDataOperator Durable Deferrable

AthenaOperator Deferrable

BatchCreateComputeEnvironmentOperator Deferrable

BatchOperator Deferrable

BatchSensor Deferrable

BedrockBatchInferenceOperator Deferrable

BedrockBatchInferenceSensor Deferrable

BedrockCreateAgentRuntimeOperator Deferrable

BedrockCreateKnowledgeBaseOperator Deferrable

BedrockCreateProvisionedModelThroughputOperator Deferrable

BedrockCustomizeModelCompletedSensor Deferrable

BedrockCustomizeModelOperator Deferrable

BedrockDeleteAgentRuntimeOperator Deferrable

BedrockIngestDataOperator Deferrable

BedrockIngestionJobSensor Deferrable

BedrockKnowledgeBaseActiveSensor Deferrable

BedrockProvisionModelThroughputCompletedSensor Deferrable

ComprehendCreateDocumentClassifierCompletedSensor Deferrable

ComprehendCreateDocumentClassifierOperator Deferrable

ComprehendStartPiiEntitiesDetectionJobCompletedSensor Deferrable

ComprehendStartPiiEntitiesDetectionJobOperator Deferrable

DmsDeleteReplicationConfigOperator Deferrable

DmsModifyTaskOperator Deferrable

DmsReloadTablesOperator Deferrable

DmsStartReplicationOperator Deferrable

DmsStopReplicationOperator Deferrable

DynamoDBValueSensor Deferrable

EC2InstanceStateSensor Deferrable

EcsCreateClusterOperator Deferrable

EcsDeleteClusterOperator Deferrable

EcsRunTaskOperator Deferrable

EksCreateClusterOperator Deferrable

EksCreateFargateProfileOperator Deferrable

EksCreateNodegroupOperator Deferrable

EksDeleteClusterOperator Deferrable

EksDeleteFargateProfileOperator Deferrable

EksDeleteNodegroupOperator Deferrable

EmrAddStepsOperator Deferrable

EmrContainerOperator Deferrable

EmrContainerSensor Deferrable

EmrCreateJobFlowOperator Deferrable

EmrJobFlowSensor Deferrable

EmrServerlessCreateApplicationOperator Deferrable

EmrServerlessDeleteApplicationOperator Deferrable

EmrServerlessJobSensor Deferrable

EmrServerlessStartJobOperator Deferrable

EmrServerlessStartSessionOperator Deferrable

EmrServerlessStopApplicationOperator Deferrable

EmrStepSensor Deferrable

EmrTerminateJobFlowOperator Deferrable

GlueCatalogPartitionSensor Deferrable

GlueCrawlerOperator Deferrable

GlueCrawlerRunOperator Deferrable

GlueDataBrewStartJobOperator Deferrable

GlueDataQualityRuleRecommendationRunOperator Deferrable

GlueDataQualityRuleRecommendationRunSensor Deferrable

GlueDataQualityRuleSetEvaluationRunOperator Deferrable

GlueDataQualityRuleSetEvaluationRunSensor Deferrable

GlueJobSensor Deferrable

KinesisAnalyticsV2StartApplicationCompletedSensor Deferrable

KinesisAnalyticsV2StartApplicationOperator Deferrable

KinesisAnalyticsV2StopApplicationCompletedSensor Deferrable

KinesisAnalyticsV2StopApplicationOperator Deferrable

LambdaCreateFunctionOperator Deferrable

MwaaDagRunSensor Deferrable

MwaaTaskSensor Deferrable

MwaaTriggerDagRunOperator Deferrable

NeptuneCancelImportTaskOperator Deferrable

NeptuneCreateGraphOperator Deferrable

NeptuneCreateGraphWithImportOperator Deferrable

NeptuneCreatePrivateGraphEndpointOperator Deferrable

NeptuneDeleteGraphOperator Deferrable

NeptuneDeletePrivateGraphEndpointOperator Deferrable

NeptuneStartDbClusterOperator Deferrable