Amazon

apache-airflow-providers-amazon

Amazon integration (including Amazon Web Services (AWS)).

Works with Airflow 2.11+
Install:
pip install apache-airflow-providers-amazon==9.23.0

Airflow

2.11+

Python

>=3.10

Dependencies (17)

Show all Hide apache-airflow>=2.11.0 apache-airflow-providers-common-compat>=1.13.0 apache-airflow-providers-common-sql>=1.32.0 apache-airflow-providers-http boto3>=1.41.0 botocore>=1.41.0 inflection>=0.5.1 watchtower>=3.3.1,<4 jsonpath_ng>=1.5.3 redshift_connector>=2.1.3 asgiref>=2.3.0 PyAthena>=3.10.0 jmespath>=0.7.0 sagemaker-studio>=1.0.9 pydynamodb>=0.7.5; python_version >= '3.13' sqlean.py>=3.47.0; python_version >= '3.13' marshmallow>=3

Connections (5)

Modules

O

AthenaOperator

An operator that submits a Trino/Presto query to Amazon Athena.

airflow.providers.amazon.aws.operators.athena.AthenaOperator
O

AwsBaseOperator

Base AWS (Amazon) Operator Class to build operators on top of AWS Hooks.

airflow.providers.amazon.aws.operators.base_aws.AwsBaseOperator
O

BatchCreateComputeEnvironmentOperator

Create an AWS Batch compute environment.

airflow.providers.amazon.aws.operators.batch.BatchCreateComputeEnvironmentOperator
O

BatchOperator

Execute a job on AWS Batch.

airflow.providers.amazon.aws.operators.batch.BatchOperator
O

BedrockBatchInferenceOperator

Create a batch inference job to invoke a model on multiple prompts.

airflow.providers.amazon.aws.operators.bedrock.BedrockBatchInferenceOperator
O

BedrockCreateDataSourceOperator

Set up an Amazon Bedrock Data Source to be added to an Amazon Bedrock Knowledge Base.

airflow.providers.amazon.aws.operators.bedrock.BedrockCreateDataSourceOperator
O

BedrockCreateKnowledgeBaseOperator

Create a knowledge base that contains data sources used by Amazon Bedrock LLMs and Agents.

airflow.providers.amazon.aws.operators.bedrock.BedrockCreateKnowledgeBaseOperator
O

BedrockCreateProvisionedModelThroughputOperator

Create a fine-tuning job to customize a base model.

airflow.providers.amazon.aws.operators.bedrock.BedrockCreateProvisionedModelThroughputOperator
O

BedrockCustomizeModelOperator

Create a fine-tuning job to customize a base model.

airflow.providers.amazon.aws.operators.bedrock.BedrockCustomizeModelOperator
O

BedrockIngestDataOperator

Begin an ingestion job, in which an Amazon Bedrock data source is added to an Amazon Bedrock knowledge base.

airflow.providers.amazon.aws.operators.bedrock.BedrockIngestDataOperator
O

BedrockInvokeModelOperator

Invoke the specified Bedrock model to run inference using the input provided.

airflow.providers.amazon.aws.operators.bedrock.BedrockInvokeModelOperator
O

BedrockRaGOperator

Query a knowledge base and generate responses based on the retrieved results with sources citations.

airflow.providers.amazon.aws.operators.bedrock.BedrockRaGOperator
O

BedrockRetrieveOperator

Query a knowledge base and retrieve results with source citations.

airflow.providers.amazon.aws.operators.bedrock.BedrockRetrieveOperator
O

CloudFormationCreateStackOperator

An operator that creates an AWS CloudFormation stack.

airflow.providers.amazon.aws.operators.cloud_formation.CloudFormationCreateStackOperator
O

CloudFormationDeleteStackOperator

An operator that deletes an AWS CloudFormation stack.

airflow.providers.amazon.aws.operators.cloud_formation.CloudFormationDeleteStackOperator
O

ComprehendBaseOperator

This is the base operator for Comprehend Service operators (not supposed to be used directly in DAGs).

airflow.providers.amazon.aws.operators.comprehend.ComprehendBaseOperator
O

ComprehendCreateDocumentClassifierOperator

Create a comprehend document classifier that can categorize documents.

airflow.providers.amazon.aws.operators.comprehend.ComprehendCreateDocumentClassifierOperator
O

ComprehendStartPiiEntitiesDetectionJobOperator

Create a comprehend pii entities detection job for a collection of documents.

airflow.providers.amazon.aws.operators.comprehend.ComprehendStartPiiEntitiesDetectionJobOperator
O

DataSyncOperator

Find, Create, Update, Execute and Delete AWS DataSync Tasks.

airflow.providers.amazon.aws.operators.datasync.DataSyncOperator
O

DmsCreateReplicationConfigOperator

Creates an AWS DMS Serverless replication configuration.

airflow.providers.amazon.aws.operators.dms.DmsCreateReplicationConfigOperator
O

DmsCreateTaskOperator

Creates AWS DMS replication task.

airflow.providers.amazon.aws.operators.dms.DmsCreateTaskOperator
O

DmsDeleteReplicationConfigOperator

Deletes an AWS DMS Serverless replication configuration.

airflow.providers.amazon.aws.operators.dms.DmsDeleteReplicationConfigOperator
O

DmsDeleteTaskOperator

Deletes AWS DMS replication task.

airflow.providers.amazon.aws.operators.dms.DmsDeleteTaskOperator
O

DmsDescribeReplicationConfigsOperator

Describes AWS DMS Serverless replication configurations.

airflow.providers.amazon.aws.operators.dms.DmsDescribeReplicationConfigsOperator
O

DmsDescribeReplicationsOperator

Describes AWS DMS Serverless replications.

airflow.providers.amazon.aws.operators.dms.DmsDescribeReplicationsOperator
O

DmsDescribeTasksOperator

Describes AWS DMS replication tasks.

airflow.providers.amazon.aws.operators.dms.DmsDescribeTasksOperator
O

DmsStartReplicationOperator

Starts an AWS DMS Serverless replication.

airflow.providers.amazon.aws.operators.dms.DmsStartReplicationOperator
O

DmsStartTaskOperator

Starts AWS DMS replication task.

airflow.providers.amazon.aws.operators.dms.DmsStartTaskOperator
O

DmsStopReplicationOperator

Stops an AWS DMS Serverless replication.

airflow.providers.amazon.aws.operators.dms.DmsStopReplicationOperator
O

DmsStopTaskOperator

Stops AWS DMS replication task.

airflow.providers.amazon.aws.operators.dms.DmsStopTaskOperator
O

EC2CreateInstanceOperator

Create and start a specified number of EC2 Instances using boto3.

airflow.providers.amazon.aws.operators.ec2.EC2CreateInstanceOperator
O

EC2HibernateInstanceOperator

Hibernate Amazon EC2 instances.

airflow.providers.amazon.aws.operators.ec2.EC2HibernateInstanceOperator
O

EC2RebootInstanceOperator

Reboot Amazon EC2 instances.

airflow.providers.amazon.aws.operators.ec2.EC2RebootInstanceOperator
O

EC2StartInstanceOperator

Start AWS EC2 instance using boto3.

airflow.providers.amazon.aws.operators.ec2.EC2StartInstanceOperator
O

EC2StopInstanceOperator

Stop AWS EC2 instance using boto3.

airflow.providers.amazon.aws.operators.ec2.EC2StopInstanceOperator
O

EC2TerminateInstanceOperator

Terminate EC2 Instances using boto3.

airflow.providers.amazon.aws.operators.ec2.EC2TerminateInstanceOperator
O

EcsBaseOperator

This is the base operator for all Elastic Container Service operators.

airflow.providers.amazon.aws.operators.ecs.EcsBaseOperator
O

EcsCreateClusterOperator

Creates an AWS ECS cluster.

airflow.providers.amazon.aws.operators.ecs.EcsCreateClusterOperator
O

EcsDeleteClusterOperator

Deletes an AWS ECS cluster.

airflow.providers.amazon.aws.operators.ecs.EcsDeleteClusterOperator
O

EcsDeregisterTaskDefinitionOperator

Deregister a task definition on AWS ECS.

airflow.providers.amazon.aws.operators.ecs.EcsDeregisterTaskDefinitionOperator
O

EcsRegisterTaskDefinitionOperator

Register a task definition on AWS ECS.

airflow.providers.amazon.aws.operators.ecs.EcsRegisterTaskDefinitionOperator
O

EcsRunTaskOperator

Execute a task on AWS ECS (Elastic Container Service).

airflow.providers.amazon.aws.operators.ecs.EcsRunTaskOperator
O

EksCreateClusterOperator

Creates an Amazon EKS Cluster control plane.

airflow.providers.amazon.aws.operators.eks.EksCreateClusterOperator
O

EksCreateFargateProfileOperator

Creates an AWS Fargate profile for an Amazon EKS cluster.

airflow.providers.amazon.aws.operators.eks.EksCreateFargateProfileOperator
O

EksCreateNodegroupOperator

Creates an Amazon EKS managed node group for an existing Amazon EKS Cluster.

airflow.providers.amazon.aws.operators.eks.EksCreateNodegroupOperator
O

EksDeleteClusterOperator

Deletes the Amazon EKS Cluster control plane and all nodegroups attached to it.

airflow.providers.amazon.aws.operators.eks.EksDeleteClusterOperator
O

EksDeleteFargateProfileOperator

Deletes an AWS Fargate profile from an Amazon EKS Cluster.

airflow.providers.amazon.aws.operators.eks.EksDeleteFargateProfileOperator
O

EksDeleteNodegroupOperator

Deletes an Amazon EKS managed node group from an Amazon EKS Cluster.

airflow.providers.amazon.aws.operators.eks.EksDeleteNodegroupOperator
O

EksPodOperator

Executes a task in a Kubernetes pod on the specified Amazon EKS Cluster.

airflow.providers.amazon.aws.operators.eks.EksPodOperator
O

EmrAddStepsOperator

An operator that adds steps to an existing EMR job_flow.

airflow.providers.amazon.aws.operators.emr.EmrAddStepsOperator
O

EmrContainerOperator

An operator that submits jobs to EMR on EKS virtual clusters.

airflow.providers.amazon.aws.operators.emr.EmrContainerOperator
O

EmrCreateJobFlowOperator

Creates an EMR JobFlow, reading the config from the EMR connection.

airflow.providers.amazon.aws.operators.emr.EmrCreateJobFlowOperator
O

EmrEksCreateClusterOperator

An operator that creates EMR on EKS virtual clusters.

airflow.providers.amazon.aws.operators.emr.EmrEksCreateClusterOperator
O

EmrModifyClusterOperator

An operator that modifies an existing EMR cluster.

airflow.providers.amazon.aws.operators.emr.EmrModifyClusterOperator
O

EmrServerlessCreateApplicationOperator

Operator to create Serverless EMR Application.

airflow.providers.amazon.aws.operators.emr.EmrServerlessCreateApplicationOperator
O

EmrServerlessDeleteApplicationOperator

Operator to delete EMR Serverless application.

airflow.providers.amazon.aws.operators.emr.EmrServerlessDeleteApplicationOperator
O

EmrServerlessStartJobOperator

Operator to start EMR Serverless job.

airflow.providers.amazon.aws.operators.emr.EmrServerlessStartJobOperator
O

EmrServerlessStopApplicationOperator

Operator to stop an EMR Serverless application.

airflow.providers.amazon.aws.operators.emr.EmrServerlessStopApplicationOperator
O

EmrStartNotebookExecutionOperator

An operator that starts an EMR notebook execution.

airflow.providers.amazon.aws.operators.emr.EmrStartNotebookExecutionOperator
O

EmrStopNotebookExecutionOperator

An operator that stops a running EMR notebook execution.

airflow.providers.amazon.aws.operators.emr.EmrStopNotebookExecutionOperator
O

EmrTerminateJobFlowOperator

Operator to terminate EMR JobFlows.

airflow.providers.amazon.aws.operators.emr.EmrTerminateJobFlowOperator
O

EventBridgeDisableRuleOperator

Disable an EventBridge Rule.

airflow.providers.amazon.aws.operators.eventbridge.EventBridgeDisableRuleOperator
O

EventBridgeEnableRuleOperator

Enable an EventBridge Rule.

airflow.providers.amazon.aws.operators.eventbridge.EventBridgeEnableRuleOperator
O

EventBridgePutEventsOperator

Put Events onto Amazon EventBridge.

airflow.providers.amazon.aws.operators.eventbridge.EventBridgePutEventsOperator
O

EventBridgePutRuleOperator

Create or update a specified EventBridge rule.

airflow.providers.amazon.aws.operators.eventbridge.EventBridgePutRuleOperator
O

GlacierCreateJobOperator

Initiate an Amazon Glacier inventory-retrieval job.

airflow.providers.amazon.aws.operators.glacier.GlacierCreateJobOperator
O

GlacierUploadArchiveOperator

This operator add an archive to an Amazon S3 Glacier vault.

airflow.providers.amazon.aws.operators.glacier.GlacierUploadArchiveOperator
O

GlueDataQualityOperator

Creates a data quality ruleset with DQDL rules applied to a specified Glue table.

airflow.providers.amazon.aws.operators.glue.GlueDataQualityOperator
O

GlueDataQualityRuleRecommendationRunOperator

Starts a recommendation run that is used to generate rules, Glue Data Quality analyzes the data and comes up with recommendations for a potential ruleset.

airflow.providers.amazon.aws.operators.glue.GlueDataQualityRuleRecommendationRunOperator
O

GlueDataQualityRuleSetEvaluationRunOperator

Evaluate a ruleset against a data source (Glue table).

airflow.providers.amazon.aws.operators.glue.GlueDataQualityRuleSetEvaluationRunOperator
O

GlueJobOperator

Create an AWS Glue Job.

airflow.providers.amazon.aws.operators.glue.GlueJobOperator
O

GlueCrawlerOperator

Creates, updates and triggers an AWS Glue Crawler.

airflow.providers.amazon.aws.operators.glue_crawler.GlueCrawlerOperator
O

LambdaCreateFunctionOperator

Creates an AWS Lambda function.

airflow.providers.amazon.aws.operators.lambda_function.LambdaCreateFunctionOperator
O

LambdaInvokeFunctionOperator

Invokes an AWS Lambda function.

airflow.providers.amazon.aws.operators.lambda_function.LambdaInvokeFunctionOperator
O

KinesisAnalyticsV2CreateApplicationOperator

Creates an AWS Managed Service for Apache Flink application.

airflow.providers.amazon.aws.operators.kinesis_analytics.KinesisAnalyticsV2CreateApplicationOperator
O

KinesisAnalyticsV2StartApplicationOperator

Starts an AWS Managed Service for Apache Flink application.

airflow.providers.amazon.aws.operators.kinesis_analytics.KinesisAnalyticsV2StartApplicationOperator
O

KinesisAnalyticsV2StopApplicationOperator

Stop an AWS Managed Service for Apache Flink application.

airflow.providers.amazon.aws.operators.kinesis_analytics.KinesisAnalyticsV2StopApplicationOperator
O

MwaaTriggerDagRunOperator

Trigger a Dag Run for a Dag in an Amazon MWAA environment.

airflow.providers.amazon.aws.operators.mwaa.MwaaTriggerDagRunOperator
O

S3CopyObjectOperator

Creates a copy of an object that is already stored in S3.

airflow.providers.amazon.aws.operators.s3.S3CopyObjectOperator
O

S3CreateBucketOperator

This operator creates an S3 bucket.

airflow.providers.amazon.aws.operators.s3.S3CreateBucketOperator
O

S3CreateObjectOperator

Creates a new object from `data` as string or bytes.

airflow.providers.amazon.aws.operators.s3.S3CreateObjectOperator
O

S3DeleteBucketOperator

This operator deletes an S3 bucket.

airflow.providers.amazon.aws.operators.s3.S3DeleteBucketOperator
O

S3DeleteBucketTaggingOperator

This operator deletes tagging from an S3 bucket.

airflow.providers.amazon.aws.operators.s3.S3DeleteBucketTaggingOperator
O

S3DeleteObjectsOperator

To enable users to delete single object or multiple objects from a bucket using a single HTTP request.

airflow.providers.amazon.aws.operators.s3.S3DeleteObjectsOperator
O

S3FileTransformOperator

Copies data from a source S3 location to a temporary location on the local filesystem.

airflow.providers.amazon.aws.operators.s3.S3FileTransformOperator
O

S3GetBucketTaggingOperator

This operator gets tagging from an S3 bucket.

airflow.providers.amazon.aws.operators.s3.S3GetBucketTaggingOperator
O

S3ListOperator

List all objects from the bucket with the given string prefix in name.

airflow.providers.amazon.aws.operators.s3.S3ListOperator
O

S3ListPrefixesOperator

List all subfolders from the bucket with the given string prefix in name.

airflow.providers.amazon.aws.operators.s3.S3ListPrefixesOperator
O

S3PutBucketTaggingOperator

This operator puts tagging for an S3 bucket.

airflow.providers.amazon.aws.operators.s3.S3PutBucketTaggingOperator
O

SageMakerAutoMLOperator

Creates an auto ML job, learning to predict the given column from the data provided through S3.

airflow.providers.amazon.aws.operators.sagemaker.SageMakerAutoMLOperator
O

SageMakerBaseOperator

This is the base operator for all SageMaker operators.

airflow.providers.amazon.aws.operators.sagemaker.SageMakerBaseOperator
O

SageMakerCreateExperimentOperator

Creates a SageMaker experiment, to be then associated to jobs etc.

airflow.providers.amazon.aws.operators.sagemaker.SageMakerCreateExperimentOperator
O

SageMakerCreateNotebookOperator

Create a SageMaker notebook.

airflow.providers.amazon.aws.operators.sagemaker.SageMakerCreateNotebookOperator
O

SageMakerDeleteModelOperator

Deletes a SageMaker model.

airflow.providers.amazon.aws.operators.sagemaker.SageMakerDeleteModelOperator
O

SageMakerDeleteNotebookOperator

Delete a notebook instance.

airflow.providers.amazon.aws.operators.sagemaker.SageMakerDeleteNotebookOperator
O

SageMakerEndpointConfigOperator

Creates an endpoint configuration that Amazon SageMaker hosting services uses to deploy models.

airflow.providers.amazon.aws.operators.sagemaker.SageMakerEndpointConfigOperator
O

SageMakerEndpointOperator

When you create a serverless endpoint, SageMaker provisions and manages the compute resources for you.

airflow.providers.amazon.aws.operators.sagemaker.SageMakerEndpointOperator
O

SageMakerModelOperator

Creates a model in Amazon SageMaker.

airflow.providers.amazon.aws.operators.sagemaker.SageMakerModelOperator
O

SageMakerProcessingOperator

Use Amazon SageMaker Processing to analyze data and evaluate machine learning models on Amazon SageMaker.

airflow.providers.amazon.aws.operators.sagemaker.SageMakerProcessingOperator
O

SageMakerRegisterModelVersionOperator

Register a SageMaker model by creating a model version that specifies the model group to which it belongs.

airflow.providers.amazon.aws.operators.sagemaker.SageMakerRegisterModelVersionOperator
O

SageMakerStartNoteBookOperator

Start a notebook instance.

airflow.providers.amazon.aws.operators.sagemaker.SageMakerStartNoteBookOperator
O

SageMakerStartPipelineOperator

Starts a SageMaker pipeline execution.

airflow.providers.amazon.aws.operators.sagemaker.SageMakerStartPipelineOperator
O

SageMakerStopNotebookOperator

Stop a notebook instance.

airflow.providers.amazon.aws.operators.sagemaker.SageMakerStopNotebookOperator
O

SageMakerStopPipelineOperator

Stops a SageMaker pipeline execution.

airflow.providers.amazon.aws.operators.sagemaker.SageMakerStopPipelineOperator
O

SageMakerTrainingOperator

Starts a model training job.

airflow.providers.amazon.aws.operators.sagemaker.SageMakerTrainingOperator
O

SageMakerTransformOperator

Starts a transform job.

airflow.providers.amazon.aws.operators.sagemaker.SageMakerTransformOperator
O

SageMakerTuningOperator

Starts a hyperparameter tuning job.

airflow.providers.amazon.aws.operators.sagemaker.SageMakerTuningOperator
O

SageMakerNotebookOperator

Provides Artifact execution functionality for Sagemaker Unified Studio Workflows.

airflow.providers.amazon.aws.operators.sagemaker_unified_studio.SageMakerNotebookOperator
O

SesEmailOperator

Send an email using Amazon Simple Email Service (SES).

airflow.providers.amazon.aws.operators.ses.SesEmailOperator
O

SnsPublishOperator

Publish a message to Amazon SNS.

airflow.providers.amazon.aws.operators.sns.SnsPublishOperator
O

SqsPublishOperator

Publish a message to an Amazon SQS queue.

airflow.providers.amazon.aws.operators.sqs.SqsPublishOperator
O

StepFunctionGetExecutionOutputOperator

An Operator that returns the output of an AWS Step Function State Machine execution.

airflow.providers.amazon.aws.operators.step_function.StepFunctionGetExecutionOutputOperator
O

StepFunctionStartExecutionOperator

An Operator that begins execution of an AWS Step Function State Machine.

airflow.providers.amazon.aws.operators.step_function.StepFunctionStartExecutionOperator
O

SsmGetCommandInvocationOperator

Retrieves the output and execution details of an SSM command invocation.

airflow.providers.amazon.aws.operators.ssm.SsmGetCommandInvocationOperator
O

SsmRunCommandOperator

Executes the SSM Run Command to perform actions on managed instances.

airflow.providers.amazon.aws.operators.ssm.SsmRunCommandOperator
O

RdsBaseOperator

Base operator that implements common functions for all operators.

airflow.providers.amazon.aws.operators.rds.RdsBaseOperator
O

RdsCancelExportTaskOperator

Cancels an export task in progress that is exporting a snapshot to Amazon S3.

airflow.providers.amazon.aws.operators.rds.RdsCancelExportTaskOperator
O

RdsCopyDbSnapshotOperator

Copies the specified DB instance or DB cluster snapshot.

airflow.providers.amazon.aws.operators.rds.RdsCopyDbSnapshotOperator
O

RdsCreateDbInstanceOperator

Creates an RDS DB instance.

airflow.providers.amazon.aws.operators.rds.RdsCreateDbInstanceOperator
O

RdsCreateDbSnapshotOperator

Creates a snapshot of a DB instance or DB cluster.

airflow.providers.amazon.aws.operators.rds.RdsCreateDbSnapshotOperator
O

RdsCreateEventSubscriptionOperator

Creates an RDS event notification subscription.

airflow.providers.amazon.aws.operators.rds.RdsCreateEventSubscriptionOperator
O

RdsDeleteDbInstanceOperator

Deletes an RDS DB Instance.

airflow.providers.amazon.aws.operators.rds.RdsDeleteDbInstanceOperator
O

RdsDeleteDbSnapshotOperator

Deletes a DB instance or cluster snapshot or terminating the copy operation.

airflow.providers.amazon.aws.operators.rds.RdsDeleteDbSnapshotOperator
O

RdsDeleteEventSubscriptionOperator

Deletes an RDS event notification subscription.

airflow.providers.amazon.aws.operators.rds.RdsDeleteEventSubscriptionOperator
O

RdsStartDbOperator

Starts an RDS DB instance / cluster.

airflow.providers.amazon.aws.operators.rds.RdsStartDbOperator
O

RdsStartExportTaskOperator

Starts an export of a snapshot to Amazon S3. The provided IAM role must have access to the S3 bucket.

airflow.providers.amazon.aws.operators.rds.RdsStartExportTaskOperator
O

RdsStopDbOperator

Stops an RDS DB instance / cluster.

airflow.providers.amazon.aws.operators.rds.RdsStopDbOperator
O

RedshiftCreateClusterOperator

Creates a new cluster with the specified parameters.

airflow.providers.amazon.aws.operators.redshift_cluster.RedshiftCreateClusterOperator
O

RedshiftCreateClusterSnapshotOperator

Creates a manual snapshot of the specified cluster. The cluster must be in the available state.

airflow.providers.amazon.aws.operators.redshift_cluster.RedshiftCreateClusterSnapshotOperator
O

RedshiftDeleteClusterOperator

Delete an AWS Redshift cluster.

airflow.providers.amazon.aws.operators.redshift_cluster.RedshiftDeleteClusterOperator
O

RedshiftDeleteClusterSnapshotOperator

Deletes the specified manual snapshot.

airflow.providers.amazon.aws.operators.redshift_cluster.RedshiftDeleteClusterSnapshotOperator
O

RedshiftPauseClusterOperator

Pause an AWS Redshift Cluster if it has status `available`.

airflow.providers.amazon.aws.operators.redshift_cluster.RedshiftPauseClusterOperator
O

RedshiftResumeClusterOperator

Resume a paused AWS Redshift Cluster.

airflow.providers.amazon.aws.operators.redshift_cluster.RedshiftResumeClusterOperator
O

RedshiftDataOperator

Executes SQL Statements against an Amazon Redshift cluster using Redshift Data.

airflow.providers.amazon.aws.operators.redshift_data.RedshiftDataOperator
O

QuickSightCreateIngestionOperator

Creates and starts a new SPICE ingestion for a dataset; also helps to Refresh existing SPICE datasets.

airflow.providers.amazon.aws.operators.quicksight.QuickSightCreateIngestionOperator
O

AppflowBaseOperator

Amazon AppFlow Base Operator class (not supposed to be used directly in DAGs).

airflow.providers.amazon.aws.operators.appflow.AppflowBaseOperator
O

AppflowRecordsShortCircuitOperator

Short-circuit in case of an empty AppFlow's run.

airflow.providers.amazon.aws.operators.appflow.AppflowRecordsShortCircuitOperator
O

AppflowRunAfterOperator

Execute an AppFlow run after updating the filters to select only future data.

airflow.providers.amazon.aws.operators.appflow.AppflowRunAfterOperator
O

AppflowRunBeforeOperator

Execute an AppFlow run after updating the filters to select only previous data.

airflow.providers.amazon.aws.operators.appflow.AppflowRunBeforeOperator
O

AppflowRunDailyOperator

Execute an AppFlow run after updating the filters to select only a single day.

airflow.providers.amazon.aws.operators.appflow.AppflowRunDailyOperator
O

AppflowRunFullOperator

Execute an AppFlow full run removing any filter.

airflow.providers.amazon.aws.operators.appflow.AppflowRunFullOperator
O

AppflowRunOperator

Execute an AppFlow run as is.

airflow.providers.amazon.aws.operators.appflow.AppflowRunOperator
O

GlueDataBrewStartJobOperator

Start an AWS Glue DataBrew job.

airflow.providers.amazon.aws.operators.glue_databrew.GlueDataBrewStartJobOperator
O

NeptuneStartDbClusterOperator

Starts an Amazon Neptune DB cluster.

airflow.providers.amazon.aws.operators.neptune.NeptuneStartDbClusterOperator
O

NeptuneStopDbClusterOperator

Stops an Amazon Neptune DB cluster.

airflow.providers.amazon.aws.operators.neptune.NeptuneStopDbClusterOperator
H

AthenaHook

Interact with Amazon Athena.

airflow.providers.amazon.aws.hooks.athena.AthenaHook
H

AthenaSQLHook

Interact with Amazon Athena.

airflow.providers.amazon.aws.hooks.athena_sql.AthenaSQLHook
H

BedrockAgentHook

Interact with the Amazon Agents for Bedrock API.

airflow.providers.amazon.aws.hooks.bedrock.BedrockAgentHook
H

BedrockAgentRuntimeHook

Interact with the Amazon Agents for Bedrock API.

airflow.providers.amazon.aws.hooks.bedrock.BedrockAgentRuntimeHook
H

BedrockHook

Interact with Amazon Bedrock.

airflow.providers.amazon.aws.hooks.bedrock.BedrockHook
H

BedrockRuntimeHook

Interact with the Amazon Bedrock Runtime.

airflow.providers.amazon.aws.hooks.bedrock.BedrockRuntimeHook
H

ChimeWebhookHook

Interact with Amazon Chime Webhooks to create notifications.

airflow.providers.amazon.aws.hooks.chime.ChimeWebhookHook
H

ComprehendHook

Interact with AWS Comprehend.

airflow.providers.amazon.aws.hooks.comprehend.ComprehendHook
H

DynamoDBHook

Interact with Amazon DynamoDB.

airflow.providers.amazon.aws.hooks.dynamodb.DynamoDBHook
H

AwsBaseHook

Base class for interact with AWS.

airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook
H

AwsGenericHook

Generic class for interact with AWS.

airflow.providers.amazon.aws.hooks.base_aws.AwsGenericHook
H

BatchClientHook

Interact with AWS Batch.

airflow.providers.amazon.aws.hooks.batch_client.BatchClientHook
H

BatchWaitersHook

A utility to manage waiters for AWS Batch services.

airflow.providers.amazon.aws.hooks.batch_waiters.BatchWaitersHook
H

CloudFormationHook

Interact with AWS CloudFormation.

airflow.providers.amazon.aws.hooks.cloud_formation.CloudFormationHook
H

DataSyncHook

Interact with AWS DataSync.

airflow.providers.amazon.aws.hooks.datasync.DataSyncHook
H

DmsHook

Interact with AWS Database Migration Service (DMS).

airflow.providers.amazon.aws.hooks.dms.DmsHook
H

EC2Hook

Interact with Amazon Elastic Compute Cloud (EC2).

airflow.providers.amazon.aws.hooks.ec2.EC2Hook
H

EcrHook

Interact with Amazon Elastic Container Registry (ECR).

airflow.providers.amazon.aws.hooks.ecr.EcrHook
H

EcsHook

Interact with Amazon Elastic Container Service (ECS).

airflow.providers.amazon.aws.hooks.ecs.EcsHook
H

ElastiCacheReplicationGroupHook

Interact with Amazon ElastiCache.

airflow.providers.amazon.aws.hooks.elasticache_replication_group.ElastiCacheReplicationGroupHook
H

EksHook

Interact with Amazon Elastic Kubernetes Service (EKS).

airflow.providers.amazon.aws.hooks.eks.EksHook
H

EmrContainerHook

Interact with Amazon EMR Containers (Amazon EMR on EKS).

airflow.providers.amazon.aws.hooks.emr.EmrContainerHook
H

EmrHook

Interact with Amazon Elastic MapReduce Service (EMR).

airflow.providers.amazon.aws.hooks.emr.EmrHook
H

EmrServerlessHook

Interact with Amazon EMR Serverless.

airflow.providers.amazon.aws.hooks.emr.EmrServerlessHook
H

EventBridgeHook

Amazon EventBridge Hook.

airflow.providers.amazon.aws.hooks.eventbridge.EventBridgeHook
H

GlacierHook

Interact with Amazon Glacier.

airflow.providers.amazon.aws.hooks.glacier.GlacierHook
H

GlueDataQualityHook

Interact with AWS Glue Data Quality.

airflow.providers.amazon.aws.hooks.glue.GlueDataQualityHook
H

GlueJobHook

Interact with AWS Glue.

airflow.providers.amazon.aws.hooks.glue.GlueJobHook
H

GlueCrawlerHook

Interacts with AWS Glue Crawler.

airflow.providers.amazon.aws.hooks.glue_crawler.GlueCrawlerHook
H

GlueCatalogHook

Interact with AWS Glue Data Catalog.

airflow.providers.amazon.aws.hooks.glue_catalog.GlueCatalogHook
H

FirehoseHook

Interact with Amazon Kinesis Firehose.

airflow.providers.amazon.aws.hooks.kinesis.FirehoseHook
H

KinesisHook

Interact with Amazon Kinesis.

airflow.providers.amazon.aws.hooks.kinesis.KinesisHook
H

FirehoseHook

Interact with Amazon Kinesis Firehose.

airflow.providers.amazon.aws.hooks.firehose.FirehoseHook
H

LambdaHook

Interact with AWS Lambda.

airflow.providers.amazon.aws.hooks.lambda_function.LambdaHook
H

KinesisAnalyticsV2Hook

Interact with Amazon Kinesis Analytics V2.

airflow.providers.amazon.aws.hooks.kinesis_analytics.KinesisAnalyticsV2Hook
H

AwsLogsHook

Interact with Amazon CloudWatch Logs.

airflow.providers.amazon.aws.hooks.logs.AwsLogsHook
H

MwaaHook

Interact with AWS Managed Workflows for Apache Airflow.

airflow.providers.amazon.aws.hooks.mwaa.MwaaHook
H

OpenSearchServerlessHook

Interact with the Amazon OpenSearch Serverless API.

airflow.providers.amazon.aws.hooks.opensearch_serverless.OpenSearchServerlessHook
H

RdsHook

Interact with Amazon Relational Database Service (RDS).

airflow.providers.amazon.aws.hooks.rds.RdsHook
H

RedshiftSQLHook

Execute statements against Amazon Redshift.

airflow.providers.amazon.aws.hooks.redshift_sql.RedshiftSQLHook
H

RedshiftHook

Interact with Amazon Redshift.

airflow.providers.amazon.aws.hooks.redshift_cluster.RedshiftHook
H

RedshiftDataHook

Interact with Amazon Redshift Data API.

airflow.providers.amazon.aws.hooks.redshift_data.RedshiftDataHook
H

S3Hook

Interact with Amazon Simple Storage Service (S3).

airflow.providers.amazon.aws.hooks.s3.S3Hook
H

SageMakerHook

Interact with Amazon SageMaker.

airflow.providers.amazon.aws.hooks.sagemaker.SageMakerHook
H

SageMakerNotebookHook

Interact with Sagemaker Unified Studio Workflows.

airflow.providers.amazon.aws.hooks.sagemaker_unified_studio.SageMakerNotebookHook
H

SesHook

Interact with Amazon Simple Email Service.

airflow.providers.amazon.aws.hooks.ses.SesHook
H

SsmHook

Interact with Amazon Systems Manager (SSM).

airflow.providers.amazon.aws.hooks.ssm.SsmHook
H

SecretsManagerHook

Interact with Amazon SecretsManager Service.

airflow.providers.amazon.aws.hooks.secrets_manager.SecretsManagerHook
H

SnsHook

Interact with Amazon Simple Notification Service.

airflow.providers.amazon.aws.hooks.sns.SnsHook
H

SqsHook

Interact with Amazon Simple Queue Service.

airflow.providers.amazon.aws.hooks.sqs.SqsHook
H

StepFunctionHook

Interact with an AWS Step Functions State Machine.

airflow.providers.amazon.aws.hooks.step_function.StepFunctionHook
H

QuickSightHook

Interact with Amazon QuickSight.

airflow.providers.amazon.aws.hooks.quicksight.QuickSightHook
H

StsHook

Interact with AWS Security Token Service (STS).

airflow.providers.amazon.aws.hooks.sts.StsHook
H

AppflowHook

Interact with Amazon AppFlow.

airflow.providers.amazon.aws.hooks.appflow.AppflowHook
H

GlueDataBrewHook

Interact with AWS DataBrew.

airflow.providers.amazon.aws.hooks.glue_databrew.GlueDataBrewHook
H

VerifiedPermissionsHook

Interact with Amazon Verified Permissions.

airflow.providers.amazon.aws.hooks.verified_permissions.VerifiedPermissionsHook
H

NeptuneHook

Interact with Amazon Neptune.

airflow.providers.amazon.aws.hooks.neptune.NeptuneHook
S

AthenaSensor

Poll the state of the Query until it reaches a terminal state; fails if the query fails.

airflow.providers.amazon.aws.sensors.athena.AthenaSensor
S

AwsBaseSensor

Base AWS (Amazon) Sensor Class for build sensors in top of AWS Hooks.

airflow.providers.amazon.aws.sensors.base_aws.AwsBaseSensor
S

BatchComputeEnvironmentSensor

Poll the state of the Batch environment until it reaches a terminal state; fails if the environment fails.

airflow.providers.amazon.aws.sensors.batch.BatchComputeEnvironmentSensor
S

BatchJobQueueSensor

Poll the state of the Batch job queue until it reaches a terminal state; fails if the queue fails.

airflow.providers.amazon.aws.sensors.batch.BatchJobQueueSensor
S

BatchSensor

Poll the state of the Batch Job until it reaches a terminal state; fails if the job fails.

airflow.providers.amazon.aws.sensors.batch.BatchSensor
S

BedrockBaseSensor

General sensor behavior for Amazon Bedrock.

airflow.providers.amazon.aws.sensors.bedrock.BedrockBaseSensor
S

BedrockBatchInferenceSensor

Poll the batch inference job status until it reaches a terminal state; fails if creation fails.

airflow.providers.amazon.aws.sensors.bedrock.BedrockBatchInferenceSensor
S

BedrockCustomizeModelCompletedSensor

Poll the state of the model customization job until it reaches a terminal state; fails if the job fails.

airflow.providers.amazon.aws.sensors.bedrock.BedrockCustomizeModelCompletedSensor
S

BedrockIngestionJobSensor

Poll the ingestion job status until it reaches a terminal state; fails if creation fails.

airflow.providers.amazon.aws.sensors.bedrock.BedrockIngestionJobSensor
S

BedrockKnowledgeBaseActiveSensor

Poll the Knowledge Base status until it reaches a terminal state; fails if creation fails.

airflow.providers.amazon.aws.sensors.bedrock.BedrockKnowledgeBaseActiveSensor
S

BedrockProvisionModelThroughputCompletedSensor

Poll the provisioned model throughput job until it reaches a terminal state; fails if the job fails.

airflow.providers.amazon.aws.sensors.bedrock.BedrockProvisionModelThroughputCompletedSensor
S

CloudFormationCreateStackSensor

Waits for a stack to be created successfully on AWS CloudFormation.

airflow.providers.amazon.aws.sensors.cloud_formation.CloudFormationCreateStackSensor
S

CloudFormationDeleteStackSensor

Waits for a stack to be deleted successfully on AWS CloudFormation.

airflow.providers.amazon.aws.sensors.cloud_formation.CloudFormationDeleteStackSensor
S

ComprehendBaseSensor

General sensor behavior for Amazon Comprehend.

airflow.providers.amazon.aws.sensors.comprehend.ComprehendBaseSensor
S

ComprehendCreateDocumentClassifierCompletedSensor

Poll the state of the document classifier until it reaches a completed state; fails if the job fails.

airflow.providers.amazon.aws.sensors.comprehend.ComprehendCreateDocumentClassifierCompletedSensor
S

ComprehendStartPiiEntitiesDetectionJobCompletedSensor

Poll the state of the pii entities detection job until it reaches a completed state; fails if the job fails.

airflow.providers.amazon.aws.sensors.comprehend.ComprehendStartPiiEntitiesDetectionJobCompletedSensor
S

DmsTaskBaseSensor

Contains general sensor behavior for DMS task.

airflow.providers.amazon.aws.sensors.dms.DmsTaskBaseSensor
S

DmsTaskCompletedSensor

Pokes DMS task until it is completed.

airflow.providers.amazon.aws.sensors.dms.DmsTaskCompletedSensor
S

DynamoDBValueSensor

Waits for an attribute value to be present for an item in a DynamoDB table.

airflow.providers.amazon.aws.sensors.dynamodb.DynamoDBValueSensor
S

EC2InstanceStateSensor

Poll the state of the AWS EC2 instance until the instance reaches the target state.

airflow.providers.amazon.aws.sensors.ec2.EC2InstanceStateSensor
S

EcsBaseSensor

Contains general sensor behavior for Elastic Container Service.

airflow.providers.amazon.aws.sensors.ecs.EcsBaseSensor
S

EcsClusterStateSensor

Poll the cluster state until it reaches a terminal state; raises AirflowException with the failure reason.

airflow.providers.amazon.aws.sensors.ecs.EcsClusterStateSensor
S

EcsTaskDefinitionStateSensor

Poll task definition until it reaches a terminal state; raise AirflowException with the failure reason.

airflow.providers.amazon.aws.sensors.ecs.EcsTaskDefinitionStateSensor
S

EcsTaskStateSensor

Poll the task state until it reaches a terminal state; raises AirflowException with the failure reason.

airflow.providers.amazon.aws.sensors.ecs.EcsTaskStateSensor
S

EksBaseSensor

Base class to check various EKS states.

airflow.providers.amazon.aws.sensors.eks.EksBaseSensor
S

EksClusterStateSensor

Check the state of an Amazon EKS Cluster until it reaches the target state or another terminal state.

airflow.providers.amazon.aws.sensors.eks.EksClusterStateSensor
S

EksFargateProfileStateSensor

Check the state of an AWS Fargate profile until it reaches the target state or another terminal state.

airflow.providers.amazon.aws.sensors.eks.EksFargateProfileStateSensor
S

EksNodegroupStateSensor

Check the state of an EKS managed node group until it reaches the target state or another terminal state.

airflow.providers.amazon.aws.sensors.eks.EksNodegroupStateSensor
S

EmrBaseSensor

Contains general sensor behavior for EMR.

airflow.providers.amazon.aws.sensors.emr.EmrBaseSensor
S

EmrContainerSensor

Poll the state of the job run until it reaches a terminal state; fail if the job run fails.

airflow.providers.amazon.aws.sensors.emr.EmrContainerSensor
S

EmrJobFlowSensor

Poll the EMR JobFlow Cluster until it reaches any of the target states; raise AirflowException on failure.

airflow.providers.amazon.aws.sensors.emr.EmrJobFlowSensor
S

EmrNotebookExecutionSensor

Poll the EMR notebook until it reaches any of the target states; raise AirflowException on failure.

airflow.providers.amazon.aws.sensors.emr.EmrNotebookExecutionSensor
S

EmrServerlessApplicationSensor

Poll the state of the application until it reaches a terminal state; fails if the application fails.

airflow.providers.amazon.aws.sensors.emr.EmrServerlessApplicationSensor
S

EmrServerlessJobSensor

Poll the state of the job run until it reaches a terminal state; fails if the job run fails.

airflow.providers.amazon.aws.sensors.emr.EmrServerlessJobSensor
S

EmrStepSensor

Poll the state of the step until it reaches any of the target states; raise AirflowException on failure.

airflow.providers.amazon.aws.sensors.emr.EmrStepSensor
S

GlacierJobOperationSensor

Glacier sensor for checking job state. This operator runs only in reschedule mode.

airflow.providers.amazon.aws.sensors.glacier.GlacierJobOperationSensor
S

GlueDataQualityRuleRecommendationRunSensor

Waits for an AWS Glue data quality recommendation run to reach any of the status below.

airflow.providers.amazon.aws.sensors.glue.GlueDataQualityRuleRecommendationRunSensor
S

GlueDataQualityRuleSetEvaluationRunSensor

Waits for an AWS Glue data quality ruleset evaluation run to reach any of the status below.

airflow.providers.amazon.aws.sensors.glue.GlueDataQualityRuleSetEvaluationRunSensor
S

GlueJobSensor

Waits for an AWS Glue Job to reach any of the status below.

airflow.providers.amazon.aws.sensors.glue.GlueJobSensor
S

GlueCrawlerSensor

Waits for an AWS Glue crawler to reach any of the statuses below.

airflow.providers.amazon.aws.sensors.glue_crawler.GlueCrawlerSensor
S

GlueCatalogPartitionSensor

Waits for a partition to show up in AWS Glue Catalog.

airflow.providers.amazon.aws.sensors.glue_catalog_partition.GlueCatalogPartitionSensor
S

LambdaFunctionStateSensor

Poll the deployment state of the AWS Lambda function until it reaches a target state.

airflow.providers.amazon.aws.sensors.lambda_function.LambdaFunctionStateSensor
S

KinesisAnalyticsV2BaseSensor

General sensor behaviour for AWS Managed Service for Apache Flink.

airflow.providers.amazon.aws.sensors.kinesis_analytics.KinesisAnalyticsV2BaseSensor
S

KinesisAnalyticsV2StartApplicationCompletedSensor

Waits for AWS Managed Service for Apache Flink application to start.

airflow.providers.amazon.aws.sensors.kinesis_analytics.KinesisAnalyticsV2StartApplicationCompletedSensor
S

KinesisAnalyticsV2StopApplicationCompletedSensor

Waits for AWS Managed Service for Apache Flink application to stop.

airflow.providers.amazon.aws.sensors.kinesis_analytics.KinesisAnalyticsV2StopApplicationCompletedSensor
S

MwaaDagRunSensor

Waits for a DAG Run in an MWAA Environment to complete.

airflow.providers.amazon.aws.sensors.mwaa.MwaaDagRunSensor
S

MwaaTaskSensor

Waits for a task in an MWAA Environment to complete.

airflow.providers.amazon.aws.sensors.mwaa.MwaaTaskSensor
S

OpenSearchServerlessCollectionActiveSensor

Poll the state of the Collection until it reaches a terminal state; fails if the query fails.

airflow.providers.amazon.aws.sensors.opensearch_serverless.OpenSearchServerlessCollectionActiveSensor
S

RdsBaseSensor

Base operator that implements common functions for all sensors.

airflow.providers.amazon.aws.sensors.rds.RdsBaseSensor
S

RdsDbSensor

Waits for an RDS instance or cluster to enter one of a number of states.

airflow.providers.amazon.aws.sensors.rds.RdsDbSensor
S

RdsExportTaskExistenceSensor

Waits for RDS export task with a specific status.

airflow.providers.amazon.aws.sensors.rds.RdsExportTaskExistenceSensor
S

RdsSnapshotExistenceSensor

Waits for RDS snapshot with a specific status.

airflow.providers.amazon.aws.sensors.rds.RdsSnapshotExistenceSensor
S

RedshiftClusterSensor

Waits for a Redshift cluster to reach a specific status.

airflow.providers.amazon.aws.sensors.redshift_cluster.RedshiftClusterSensor
S

S3KeySensor

Waits for one or multiple keys (a file-like instance on S3) to be present in a S3 bucket.

airflow.providers.amazon.aws.sensors.s3.S3KeySensor
S

S3KeysUnchangedSensor

Return True if inactivity_period has passed with no increase in the number of objects matching prefix.

airflow.providers.amazon.aws.sensors.s3.S3KeysUnchangedSensor
S

SageMakerAutoMLSensor

Poll the auto ML job until it reaches a terminal state; raise AirflowException with the failure reason.

airflow.providers.amazon.aws.sensors.sagemaker.SageMakerAutoMLSensor
S

SageMakerBaseSensor

Contains general sensor behavior for SageMaker.

airflow.providers.amazon.aws.sensors.sagemaker.SageMakerBaseSensor
S

SageMakerEndpointSensor

Poll the endpoint state until it reaches a terminal state; raise AirflowException with the failure reason.

airflow.providers.amazon.aws.sensors.sagemaker.SageMakerEndpointSensor
S

SageMakerPipelineSensor

Poll the pipeline until it reaches a terminal state; raise AirflowException with the failure reason.

airflow.providers.amazon.aws.sensors.sagemaker.SageMakerPipelineSensor
S

SageMakerProcessingSensor

Poll the processing job until it reaches a terminal state; raise AirflowException with the failure reason.

airflow.providers.amazon.aws.sensors.sagemaker.SageMakerProcessingSensor
S

SageMakerTrainingSensor

Poll the training job until it reaches a terminal state; raise AirflowException with the failure reason.

airflow.providers.amazon.aws.sensors.sagemaker.SageMakerTrainingSensor
S

SageMakerTransformSensor

Poll the transform job until it reaches a terminal state; raise AirflowException with the failure reason.

airflow.providers.amazon.aws.sensors.sagemaker.SageMakerTransformSensor
S

SageMakerTuningSensor

Poll the tuning state until it reaches a terminal state; raise AirflowException with the failure reason.

airflow.providers.amazon.aws.sensors.sagemaker.SageMakerTuningSensor
S

SageMakerNotebookSensor

Waits for a Sagemaker Workflows Notebook execution to reach any of the status below.

airflow.providers.amazon.aws.sensors.sagemaker_unified_studio.SageMakerNotebookSensor
S

SqsSensor

Get messages from an Amazon SQS queue and then delete the messages from the queue.

airflow.providers.amazon.aws.sensors.sqs.SqsSensor
S

StepFunctionExecutionSensor

Poll the Step Function State Machine Execution until it reaches a terminal state; fails if the task fails.

airflow.providers.amazon.aws.sensors.step_function.StepFunctionExecutionSensor
S

SsmRunCommandCompletedSensor

Poll the state of an AWS SSM Run Command until completion.

airflow.providers.amazon.aws.sensors.ssm.SsmRunCommandCompletedSensor
S

QuickSightSensor

Watches for the status of an Amazon QuickSight Ingestion.

airflow.providers.amazon.aws.sensors.quicksight.QuickSightSensor
T

AwsBaseWaiterTrigger

Base class for all AWS Triggers that follow the "standard" model of just waiting on a waiter.

airflow.providers.amazon.aws.triggers.base.AwsBaseWaiterTrigger
T

AthenaTrigger

Trigger for AthenaOperator.

airflow.providers.amazon.aws.triggers.athena.AthenaTrigger
T

BatchCreateComputeEnvironmentTrigger

Asynchronously poll the boto3 API and wait for the compute environment to be ready.

airflow.providers.amazon.aws.triggers.batch.BatchCreateComputeEnvironmentTrigger
T

BatchJobTrigger

Checks for the status of a submitted job_id to AWS Batch until it reaches a failure or a success state.

airflow.providers.amazon.aws.triggers.batch.BatchJobTrigger
T

BedrockBaseBatchInferenceTrigger

Trigger when a batch inference job is complete.

airflow.providers.amazon.aws.triggers.bedrock.BedrockBaseBatchInferenceTrigger
T

BedrockBatchInferenceCompletedTrigger

Trigger when a batch inference job is complete.

airflow.providers.amazon.aws.triggers.bedrock.BedrockBatchInferenceCompletedTrigger
T

BedrockBatchInferenceScheduledTrigger

Trigger when a batch inference job is scheduled.

airflow.providers.amazon.aws.triggers.bedrock.BedrockBatchInferenceScheduledTrigger
T

BedrockCustomizeModelCompletedTrigger

Trigger when a Bedrock model customization job is complete.

airflow.providers.amazon.aws.triggers.bedrock.BedrockCustomizeModelCompletedTrigger
T

BedrockIngestionJobTrigger

Trigger when a Bedrock ingestion job reaches the COMPLETE state.

airflow.providers.amazon.aws.triggers.bedrock.BedrockIngestionJobTrigger
T

BedrockKnowledgeBaseActiveTrigger

Trigger when a Bedrock Knowledge Base reaches the ACTIVE state.

airflow.providers.amazon.aws.triggers.bedrock.BedrockKnowledgeBaseActiveTrigger
T

BedrockProvisionModelThroughputCompletedTrigger

Trigger when a provisioned throughput job is complete.

airflow.providers.amazon.aws.triggers.bedrock.BedrockProvisionModelThroughputCompletedTrigger
T

ComprehendCreateDocumentClassifierCompletedTrigger

Trigger when a Comprehend document classifier is complete.

airflow.providers.amazon.aws.triggers.comprehend.ComprehendCreateDocumentClassifierCompletedTrigger
T

ComprehendPiiEntitiesDetectionJobCompletedTrigger

Trigger when a Comprehend pii entities detection job is complete.

airflow.providers.amazon.aws.triggers.comprehend.ComprehendPiiEntitiesDetectionJobCompletedTrigger
T

EC2StateSensorTrigger

Poll the EC2 instance and yield a TriggerEvent once the state of the instance matches the target_state.

airflow.providers.amazon.aws.triggers.ec2.EC2StateSensorTrigger
T

LambdaCreateFunctionCompleteTrigger

Trigger to poll for the completion of a Lambda function creation.

airflow.providers.amazon.aws.triggers.lambda_function.LambdaCreateFunctionCompleteTrigger
T

MwaaDagRunCompletedTrigger

Trigger when an MWAA Dag Run is complete.

airflow.providers.amazon.aws.triggers.mwaa.MwaaDagRunCompletedTrigger
T

MwaaTaskCompletedTrigger

Trigger when an MWAA Task is complete.

airflow.providers.amazon.aws.triggers.mwaa.MwaaTaskCompletedTrigger
T

KinesisAnalyticsV2ApplicationOperationCompleteTrigger

Trigger when a Managed Service for Apache Flink application Start or Stop is complete.

airflow.providers.amazon.aws.triggers.kinesis_analytics.KinesisAnalyticsV2ApplicationOperationCompleteTrigger
T

OpenSearchServerlessCollectionActiveTrigger

Trigger when an Amazon OpenSearch Serverless Collection reaches the ACTIVE state.

airflow.providers.amazon.aws.triggers.opensearch_serverless.OpenSearchServerlessCollectionActiveTrigger
T

RedshiftClusterTrigger

RedshiftClusterTrigger is fired as deferred class with params to run the task in trigger worker.

airflow.providers.amazon.aws.triggers.redshift_cluster.RedshiftClusterTrigger
T

RedshiftCreateClusterSnapshotTrigger

Trigger for RedshiftCreateClusterSnapshotOperator.

airflow.providers.amazon.aws.triggers.redshift_cluster.RedshiftCreateClusterSnapshotTrigger
T

RedshiftCreateClusterTrigger

Trigger for RedshiftCreateClusterOperator.

airflow.providers.amazon.aws.triggers.redshift_cluster.RedshiftCreateClusterTrigger
T

RedshiftDeleteClusterTrigger

Trigger for RedshiftDeleteClusterOperator.

airflow.providers.amazon.aws.triggers.redshift_cluster.RedshiftDeleteClusterTrigger
T

RedshiftPauseClusterTrigger

Trigger for RedshiftPauseClusterOperator.

airflow.providers.amazon.aws.triggers.redshift_cluster.RedshiftPauseClusterTrigger
T

RedshiftResumeClusterTrigger

Trigger for RedshiftResumeClusterOperator.

airflow.providers.amazon.aws.triggers.redshift_cluster.RedshiftResumeClusterTrigger
T

RedshiftDataTrigger

RedshiftDataTrigger is fired as deferred class with params to run the task in triggerer.

airflow.providers.amazon.aws.triggers.redshift_data.RedshiftDataTrigger
T

SageMakerPipelineTrigger

Trigger to wait for a sagemaker pipeline execution to finish.

airflow.providers.amazon.aws.triggers.sagemaker.SageMakerPipelineTrigger
T

SageMakerTrigger

SageMakerTrigger is fired as deferred class with params to run the task in triggerer.

airflow.providers.amazon.aws.triggers.sagemaker.SageMakerTrigger
T

SageMakerNotebookJobTrigger

Watches for a notebook job, triggers when it finishes.

airflow.providers.amazon.aws.triggers.sagemaker_unified_studio.SageMakerNotebookJobTrigger
T

GlueCatalogPartitionTrigger

Asynchronously waits for a partition to show up in AWS Glue Catalog.

airflow.providers.amazon.aws.triggers.glue.GlueCatalogPartitionTrigger
T

GlueDataQualityRuleRecommendationRunCompleteTrigger

Trigger when a AWS Glue data quality recommendation run complete.

airflow.providers.amazon.aws.triggers.glue.GlueDataQualityRuleRecommendationRunCompleteTrigger
T

GlueDataQualityRuleSetEvaluationRunCompleteTrigger

Trigger when a AWS Glue data quality evaluation run complete.

airflow.providers.amazon.aws.triggers.glue.GlueDataQualityRuleSetEvaluationRunCompleteTrigger
T

GlueJobCompleteTrigger

Watches for a glue job, triggers when it finishes.

airflow.providers.amazon.aws.triggers.glue.GlueJobCompleteTrigger
T

GlueCrawlerCompleteTrigger

Watches for a glue crawl, triggers when it finishes.

airflow.providers.amazon.aws.triggers.glue_crawler.GlueCrawlerCompleteTrigger
T

S3KeyTrigger

S3KeyTrigger is fired as deferred class with params to run the task in trigger worker.

airflow.providers.amazon.aws.triggers.s3.S3KeyTrigger
T

S3KeysUnchangedTrigger

S3KeysUnchangedTrigger is fired as deferred class with params to run the task in trigger worker.

airflow.providers.amazon.aws.triggers.s3.S3KeysUnchangedTrigger
T

SsmRunCommandTrigger

Trigger when a SSM run command is complete.

airflow.providers.amazon.aws.triggers.ssm.SsmRunCommandTrigger
T

EmrAddStepsTrigger

Poll for the status of EMR steps until they reach terminal state.

airflow.providers.amazon.aws.triggers.emr.EmrAddStepsTrigger
T

EmrContainerTrigger

Poll for the status of EMR container until reaches terminal state.

airflow.providers.amazon.aws.triggers.emr.EmrContainerTrigger
T

EmrCreateJobFlowTrigger

Asynchronously poll the boto3 API and wait for the JobFlow to finish executing.

airflow.providers.amazon.aws.triggers.emr.EmrCreateJobFlowTrigger
T

EmrServerlessCancelJobsTrigger

Trigger for canceling a list of jobs in an EMR Serverless application.

airflow.providers.amazon.aws.triggers.emr.EmrServerlessCancelJobsTrigger
T

EmrServerlessCreateApplicationTrigger

Poll an Emr Serverless application and wait for it to be created.

airflow.providers.amazon.aws.triggers.emr.EmrServerlessCreateApplicationTrigger
T

EmrServerlessDeleteApplicationTrigger

Poll an Emr Serverless application and wait for it to be deleted.

airflow.providers.amazon.aws.triggers.emr.EmrServerlessDeleteApplicationTrigger
T

EmrServerlessStartApplicationTrigger

Poll an Emr Serverless application and wait for it to be started.

airflow.providers.amazon.aws.triggers.emr.EmrServerlessStartApplicationTrigger
T

EmrServerlessStartJobTrigger

Poll an Emr Serverless job run and wait for it to be completed.

airflow.providers.amazon.aws.triggers.emr.EmrServerlessStartJobTrigger
T

EmrServerlessStopApplicationTrigger

Poll an Emr Serverless application and wait for it to be stopped.

airflow.providers.amazon.aws.triggers.emr.EmrServerlessStopApplicationTrigger
T

EmrStepSensorTrigger

Poll for the status of EMR container until reaches terminal state.

airflow.providers.amazon.aws.triggers.emr.EmrStepSensorTrigger
T

EmrTerminateJobFlowTrigger

Asynchronously poll the boto3 API and wait for the JobFlow to finish terminating.

airflow.providers.amazon.aws.triggers.emr.EmrTerminateJobFlowTrigger
T

EksCreateClusterTrigger

Trigger for EksCreateClusterOperator.

airflow.providers.amazon.aws.triggers.eks.EksCreateClusterTrigger
T

EksCreateFargateProfileTrigger

Asynchronously wait for the fargate profile to be created.

airflow.providers.amazon.aws.triggers.eks.EksCreateFargateProfileTrigger
T

EksCreateNodegroupTrigger

Trigger for EksCreateNodegroupOperator.

airflow.providers.amazon.aws.triggers.eks.EksCreateNodegroupTrigger
T

EksDeleteClusterTrigger

Trigger for EksDeleteClusterOperator.

airflow.providers.amazon.aws.triggers.eks.EksDeleteClusterTrigger
T

EksDeleteFargateProfileTrigger

Asynchronously wait for the fargate profile to be deleted.

airflow.providers.amazon.aws.triggers.eks.EksDeleteFargateProfileTrigger
T

EksDeleteNodegroupTrigger

Trigger for EksDeleteNodegroupOperator.

airflow.providers.amazon.aws.triggers.eks.EksDeleteNodegroupTrigger
T

ClusterActiveTrigger

Polls the status of a cluster until it's active.

airflow.providers.amazon.aws.triggers.ecs.ClusterActiveTrigger
T

ClusterInactiveTrigger

Polls the status of a cluster until it's inactive.

airflow.providers.amazon.aws.triggers.ecs.ClusterInactiveTrigger
T

TaskDoneTrigger

Waits for an ECS task to be done, while eventually polling logs.

airflow.providers.amazon.aws.triggers.ecs.TaskDoneTrigger
T

RdsDbAvailableTrigger

Trigger to wait asynchronously for a DB instance or cluster to be available.

airflow.providers.amazon.aws.triggers.rds.RdsDbAvailableTrigger
T

RdsDbDeletedTrigger

Trigger to wait asynchronously for a DB instance or cluster to be deleted.

airflow.providers.amazon.aws.triggers.rds.RdsDbDeletedTrigger
T

RdsDbStoppedTrigger

Trigger to wait asynchronously for a DB instance or cluster to be stopped.

airflow.providers.amazon.aws.triggers.rds.RdsDbStoppedTrigger
T

StepFunctionsExecutionCompleteTrigger

Trigger to poll for the completion of a Step Functions execution.

airflow.providers.amazon.aws.triggers.step_function.StepFunctionsExecutionCompleteTrigger
T

SqsSensorTrigger

Asynchronously get messages from an Amazon SQS queue and then delete the messages from the queue.

airflow.providers.amazon.aws.triggers.sqs.SqsSensorTrigger
T

GlueDataBrewJobCompleteTrigger

Watches for a Glue DataBrew job, triggers when it finishes.

airflow.providers.amazon.aws.triggers.glue_databrew.GlueDataBrewJobCompleteTrigger
T

NeptuneClusterAvailableTrigger

Triggers when a Neptune Cluster is available.

airflow.providers.amazon.aws.triggers.neptune.NeptuneClusterAvailableTrigger
T

NeptuneClusterInstancesAvailableTrigger

Triggers when a Neptune Cluster Instance is available.

airflow.providers.amazon.aws.triggers.neptune.NeptuneClusterInstancesAvailableTrigger
T

NeptuneClusterStoppedTrigger

Triggers when a Neptune Cluster is stopped.

airflow.providers.amazon.aws.triggers.neptune.NeptuneClusterStoppedTrigger
T

DmsReplicationCompleteTrigger

Trigger when an AWS DMS Serverless replication completes.

airflow.providers.amazon.aws.triggers.dms.DmsReplicationCompleteTrigger
T

DmsReplicationConfigDeletedTrigger

Trigger when an AWS DMS Serverless replication config is deleted.

airflow.providers.amazon.aws.triggers.dms.DmsReplicationConfigDeletedTrigger
T

DmsReplicationDeprovisionedTrigger

Trigger when an AWS DMS Serverless replication is de-provisioned.

airflow.providers.amazon.aws.triggers.dms.DmsReplicationDeprovisionedTrigger
T

DmsReplicationStoppedTrigger

Trigger when an AWS DMS Serverless replication is stopped.

airflow.providers.amazon.aws.triggers.dms.DmsReplicationStoppedTrigger
T

DmsReplicationTerminalStatusTrigger

Trigger when an AWS DMS Serverless replication is in a terminal state.

airflow.providers.amazon.aws.triggers.dms.DmsReplicationTerminalStatusTrigger
B

S3DagBundle

S3 DAG bundle - exposes a directory in S3 as a DAG bundle.

airflow.providers.amazon.aws.bundles.s3.S3DagBundle
T

DynamoDBToS3Operator

Replicates records from a DynamoDB table to S3.

airflow.providers.amazon.aws.transfers.dynamodb_to_s3.DynamoDBToS3Operator
T

GCSToS3Operator

Synchronizes a Google Cloud Storage bucket with an S3 bucket.

airflow.providers.amazon.aws.transfers.gcs_to_s3.GCSToS3Operator
T

GlacierToGCSOperator

Transfers data from Amazon Glacier to Google Cloud Storage.

airflow.providers.amazon.aws.transfers.glacier_to_gcs.GlacierToGCSOperator
T

GoogleApiToS3Operator

Basic class for transferring data from a Google API endpoint into a S3 Bucket.

airflow.providers.amazon.aws.transfers.google_api_to_s3.GoogleApiToS3Operator
T

HiveToDynamoDBOperator

Moves data from Hive to DynamoDB.

airflow.providers.amazon.aws.transfers.hive_to_dynamodb.HiveToDynamoDBOperator
T

HttpToS3Operator

Calls an endpoint on an HTTP system to execute an action and store the result in S3.

airflow.providers.amazon.aws.transfers.http_to_s3.HttpToS3Operator
T

ImapAttachmentToS3Operator

Transfers a mail attachment from a mail server into s3 bucket.

airflow.providers.amazon.aws.transfers.imap_attachment_to_s3.ImapAttachmentToS3Operator
T

MongoToS3Operator

Move data from MongoDB to S3.

airflow.providers.amazon.aws.transfers.mongo_to_s3.MongoToS3Operator
T

RedshiftToS3Operator

Execute an UNLOAD command to s3 as a CSV with headers.

airflow.providers.amazon.aws.transfers.redshift_to_s3.RedshiftToS3Operator
T

S3ToRedshiftOperator

Executes an COPY command to load files from s3 to Redshift.

airflow.providers.amazon.aws.transfers.s3_to_redshift.S3ToRedshiftOperator
T

S3ToSFTPOperator

This operator enables the transferring of files from S3 to a SFTP server.

airflow.providers.amazon.aws.transfers.s3_to_sftp.S3ToSFTPOperator
T

SFTPToS3Operator

Transfer files from an SFTP server to Amazon S3.

airflow.providers.amazon.aws.transfers.sftp_to_s3.SFTPToS3Operator
T

S3ToFTPOperator

This operator enables the transferring of files from S3 to a FTP server.

airflow.providers.amazon.aws.transfers.s3_to_ftp.S3ToFTPOperator
T

ExasolToS3Operator

Export data from Exasol database to AWS S3 bucket.

airflow.providers.amazon.aws.transfers.exasol_to_s3.ExasolToS3Operator
T

FTPToS3Operator

Transfer of one or more files from an FTP server to S3.

airflow.providers.amazon.aws.transfers.ftp_to_s3.FTPToS3Operator
T

SalesforceToS3Operator

Submits a Salesforce query and uploads the results to AWS S3.

airflow.providers.amazon.aws.transfers.salesforce_to_s3.SalesforceToS3Operator
T

LocalFilesystemToS3Operator

Uploads a file from a local filesystem to Amazon S3.

airflow.providers.amazon.aws.transfers.local_to_s3.LocalFilesystemToS3Operator
T

SqlToS3Operator

Saves data from a specific SQL query into a file in S3.

airflow.providers.amazon.aws.transfers.sql_to_s3.SqlToS3Operator
T

S3ToSqlOperator

Load Data from S3 into a SQL Database.

airflow.providers.amazon.aws.transfers.s3_to_sql.S3ToSqlOperator
T

AwsToAwsBaseOperator

Base class for AWS to AWS transfer operators.

airflow.providers.amazon.aws.transfers.base.AwsToAwsBaseOperator
T

AzureBlobStorageToS3Operator

Operator transfers data from Azure Blob Storage to specified bucket in Amazon S3.

airflow.providers.amazon.aws.transfers.azure_blob_to_s3.AzureBlobStorageToS3Operator
T

S3ToDynamoDBOperator

Load Data from S3 into a DynamoDB.

airflow.providers.amazon.aws.transfers.s3_to_dynamodb.S3ToDynamoDBOperator
N

ChimeNotifier

Chime notifier to send messages to a chime room via callbacks.

airflow.providers.amazon.aws.notifications.chime.ChimeNotifier
N

SnsNotifier

Amazon SNS (Simple Notification Service) Notifier.

airflow.providers.amazon.aws.notifications.sns.SnsNotifier
N

SqsNotifier

Amazon SQS (Simple Queue Service) Notifier.

airflow.providers.amazon.aws.notifications.sqs.SqsNotifier
S

SecretsManagerBackend

Retrieves Connection or Variables from AWS Secrets Manager.

airflow.providers.amazon.aws.secrets.secrets_manager.SecretsManagerBackend
S

SystemsManagerParameterStoreBackend

Retrieves Connection or Variables from AWS SSM Parameter Store.

airflow.providers.amazon.aws.secrets.systems_manager.SystemsManagerParameterStoreBackend
L

S3TaskHandler

S3TaskHandler is a python log handler that handles and reads task instance logs.

airflow.providers.amazon.aws.log.s3_task_handler.S3TaskHandler
L

CloudwatchTaskHandler

CloudwatchTaskHandler is a python log handler that handles and reads task instance logs.

airflow.providers.amazon.aws.log.cloudwatch_task_handler.CloudwatchTaskHandler
E

AwsEcsExecutor

Executes the provided Airflow command on an ECS instance.

airflow.providers.amazon.aws.executors.ecs.ecs_executor.AwsEcsExecutor