`apache-airflow-providers-amazon`¶

Content¶

Guides

References

Python API

Resources

Commits

Detailed list of commits

Package apache-airflow-providers-amazon¶

Amazon integration (including Amazon Web Services (AWS)).

Release: 1.1.0

Provider package¶

This is a provider package for amazon provider. All classes for this provider package are in airflow.providers.amazon python package.

Installation¶

Note

On November 2020, new version of PIP (20.3) has been released with a new, 2020 resolver. This resolver does not yet work with Apache Airflow and might lead to errors in installation - depends on your choice of extras. In order to install Airflow you need to either downgrade pip to version 20.2.4 pip install --upgrade pip==20.2.4 or, in case you use Pip 20.3, you need to add option --use-deprecated legacy-resolver to your pip install command.

You can install this package on top of an existing airflow 2.* installation via pip install apache-airflow-providers-amazon

PIP requirements¶

PIP package	Version required
`boto3`	`>=1.15.0,<1.16.0`
`botocore`	`>=1.18.0,<1.19.0`
`watchtower`	`~=0.7.3`

Cross provider package dependencies¶

Those are dependencies that might be needed in order to use all the features of the package. You need to install the specified backport providers package in order to use them.

You can install such cross-provider dependencies when installing from PyPI. For example:

pip install apache-airflow-providers-amazon[apache.hive]

Dependent package	Extra
apache-airflow-providers-apache-hive	`apache.hive`
apache-airflow-providers-exasol	`exasol`
apache-airflow-providers-ftp	`ftp`
apache-airflow-providers-google	`google`
apache-airflow-providers-imap	`imap`
apache-airflow-providers-mongo	`mongo`
apache-airflow-providers-mysql	`mysql`
apache-airflow-providers-postgres	`postgres`
apache-airflow-providers-ssh	`ssh`

Changelog¶

1.1.0¶

Features¶

Add aws ses email backend for use with EmailOperator. (#13986)
Add bucket_name to template fileds in S3 operators (#13973)
Add ExasolToS3Operator (#13847)
AWS Glue Crawler Integration (#13072)
Add acl_policy to S3CopyObjectOperator (#13773)
AllowDiskUse parameter and docs in MongotoS3Operator (#12033)
Add S3ToFTPOperator (#11747)
add xcom push for ECSOperator (#12096)
[AIRFLOW-3723] Add Gzip capability to mongo_to_S3 operator (#13187)
Add S3KeySizeSensor (#13049)
Add 'mongo_collection' to template_fields in MongoToS3Operator (#13361)
Allow Tags on AWS Batch Job Submission (#13396)

Bug fixes¶

Fix bug in GCSToS3Operator (#13718)
Fix S3KeysUnchangedSensor so that template_fields work (#13490)

1.0.0¶

Initial version of the provider.