Package apache-airflow-providers-amazon

Amazon integration (including Amazon Web Services (AWS)).

This is detailed commit list of changes for versions provider package: amazon. For high-level changelog, see package information including changelog.

2.5.0

Latest change: 2021-11-26

Commit

Committed

Subject

83b51e5306

2021-11-26

Amazon provider remove deprecation, second try (#19815)

d58df468c8

2021-11-24

Revert "Adjust built-in base_aws methods to avoid Deprecation warnings (#19725)" (#19791)

4be04143a5

2021-11-24

Adjust built-in base_aws methods to avoid Deprecation warnings (#19725)

fe682ec3d3

2021-11-24

Fix duplicate changelog entries (#19759)

186513e24e

2021-11-15

Catch AccessDeniedException in AWS Secrets Manager Backend (#19324)

4c495ca94e

2021-11-15

Cleanup of start_date and default arg use for Amazon example DAGs (#19237)

eb16fd51e0

2021-11-12

Adding support for using ''client_type'' API for interacting with EC2 and support filters (#9011)

aa2cb5545f

2021-11-12

Remove remaining 'pylint: disable' comments (#19541)

9053de7718

2021-11-10

Do not check for S3 key before attempting download (#19504)

ebb7394005

2021-11-08

MySQLToS3Operator  actually allow writing parquet files to s3. (#19094)

2.4.0

Latest change: 2021-11-04

Commit

Committed

Subject

5a113f3027

2021-11-04

Add documentation for RC2 release of Amazon provider for October (#19413)

96dd70348a

2021-11-04

`` fix SagemakerProcessingOperator ThrottlingException (#19195)``

a3266ba2b9

2021-11-03

Doc: Fix typos in variable and comments (#19349)

6148ddd365

2021-11-03

Fix S3ToRedshiftOperator (#19358)

1600f1dfd7

2021-10-30

Remove duplicated entries in changelog (#19331)

d9567eb106

2021-10-29

Prepare documentation for October Provider's release (#19321)

1543dc28f4

2021-10-29

Fixing ses email backend (#18042)

3c08c025c5

2021-10-27

Move validation of templated input params to run after the context init (#19048)

f5ad26dcdd

2021-10-21

Fixup string concatenations (#19099)

86a2a19ad2

2021-10-17

More f-strings (#18855)

258451cfba

2021-10-15

MySQLToS3Operator add support for parquet format (#18755)

176165de3b

2021-10-11

Update S3PrefixSensor to support checking multiple prefixes within a bucket (#18807)

1d7cfdbcd9

2021-10-10

Remove extra postgres dependency from AWS Provider (#18844)

1df9a512c2

2021-10-08

Add RedshiftSQLHook, RedshiftSQLOperator (#18447)

22768ff61e

2021-10-08

Removed duplicated code on S3ToRedshiftOperator (#18671)

2.3.0

Latest change: 2021-10-08

Commit

Committed

Subject

a680e876b6

2021-10-08

Prepare documentation for RC2 Amazon Provider release for September (#18830)

ea8f478909

2021-10-08

Add AWS Fargate profile support (#18645)

9344c34522

2021-10-08

Enable AWS Secrets Manager backend to retrieve conns using different fields (#18764)

1a35644b5d

2021-10-08

Add emr cluster link (#18691)

e0af0b976c

2021-10-08

AwsGlueJobOperator: add wait_for_completion to Glue job run (#18814)

8e56ed234b

2021-10-07

Enable FTPToS3Operator to transfer several files (#17937)

28284a37b3

2021-10-07

Amazon Athena Example (#18785)

38c6cf9c27

2021-10-07

AwsGlueJobOperator: add run_job_kwargs to Glue job run (#16796)

72e49ad3a3

2021-10-06

Amazon SQS Example (#18760)

767a4f5207

2021-10-05

ECSOperator: airflow exception on edge case when cloudwatch log stream is not found (#18733)

760bf6e51c

2021-10-06

Adds an s3 list prefixes operator (#17145)

12763f125a

2021-10-05

Add additional dependency for postgres extra for amazon provider (#18737)

86bf2a29ba

2021-10-04

Simplify strings previously split across lines (#18679)

12133861ec

2021-10-01

Support all Unix wildcards in S3KeySensor (#18211)

840ea3efb9

2021-09-30

Update documentation for September providers release (#18613)

8a1437e55e

2021-09-29

Refresh credentials for long-running pods on EKS (#17951)

2fbd23878f

2021-09-28

Update s3_list.py (#18561)

a458fcc573

2021-09-27

Updating miscellaneous provider DAGs to use TaskFlow API where applicable (#18278)

e25eea052f

2021-09-19

Inclusive Language (#18349)

4cd190c9bc

2021-09-18

ECSOperator realtime logging (#17626)

27088c4533

2021-09-18

Add IAM Role Credentials to S3ToRedshiftTransfer and RedshiftToS3Transfer (#18156)

2d4f3cb644

2021-09-15

Adding missing 'replace' param in docstring (#18241)

81ebd78db4

2021-09-12

Added upsert method on S3ToRedshift operator (#18027)

02397761af

2021-09-12

Deprecate default pod name in EKSPodOperator (#18036)

e6cb2f7beb

2021-09-10

ECSOperator returns last logs when ECS task fails (#17209)

b8795501ea

2021-09-10

Aws secrets manager backend (#17448)

6e101317a2

2021-09-10

Simplify s3 ''unify_bucket_name_and_key'' (#17325)

3fe948a860

2021-09-08

sftp_to_s3 stream file option (#17609)

867e9305f0

2021-09-03

AwsBaseHook make 'client_type' & 'resource_type' optional params for 'get_client_type' & 'get_resource_type' (#17987)

bcd81f23af

2021-09-03

Add Spark to the EMR cluster for the job flow examples (#17563)

7c4d3173f2

2021-09-02

Delete unnecessary parameters in EKSPodOperator (#17960)

2.2.0

Latest change: 2021-08-30

Commit

Committed

Subject

0a68588479

2021-08-30

Add August 2021 Provider's documentation (#17890)

653c13ec0c

2021-08-30

Fix broken XCOM in EKSPodOperator (#17918)

42e13e1a5a

2021-08-30

Remove all deprecation warnings in providers (#17900)

890bd4310e

2021-08-28

Add an Amazon EMR on EKS provider package (#16766)

41632e03b8

2021-08-27

Fix provider.yaml errors due to exit(0) in test (#17858)

be75dcd39c

2021-08-23

Update description about the new ''connection-types'' provider meta-data

76ed2a49c6

2021-08-19

Import Hooks lazily individually in providers manager (#17682)

bee48f31f1

2021-08-19

Implemented Basic EKS Integration (#16571)

d26b862330

2021-08-19

Add optional SQL parameters in ''RedshiftToS3Operator'' (#17640)

29aab6434f

2021-08-17

Adds secrets backend/logging/auth information to provider yaml (#17625)

1632c9f519

2021-08-14

Add new LocalFilesystemToS3Operator under Amazon provider (#17168) (#17382)

e7eeaa6086

2021-08-12

Doc: Fix docstrings for ''MongoToS3Operator'' (#17588)

987575787d

2021-08-12

Add Mongo projections to hook and transfer (#17379)

77c4325fb0

2021-08-10

Fixing ParamValidationError when executing load_file in Glue hooks/operators (#16012)

d28efbfb77

2021-08-02

Improve AWS SQS Sensor (#16880) (#16904)

71088986f1

2021-08-02

make platform version as independent parameter of ECSOperator (#17281)

80fc80ace6

2021-08-02

Fixes #16972 - Slugify role session name in AWS base hook (#17210)

2.1.0

Latest change: 2021-07-26

Commit

Committed

Subject

87f408b1e7

2021-07-26

Prepares docs for Rc2 release of July providers (#17116)

569659db38

2021-07-26

Updating Amazon-AWS example DAGs to use XComArgs (#16868)

763919d415

2021-07-25

Adding custom Salesforce connection type + SalesforceToS3Operator updates (#17162)

8b100fcb42

2021-07-21

ECSOperator / pass context to self.xcom_pull as it was missing (when using reattach) (#17141)

f44d7bd9cf

2021-07-21

Made S3ToRedshiftOperator transaction safe (#17117)

32582b5bf1

2021-07-21

Adding SalesforceToS3Operator to Amazon Provider (#17094)

bb1d79cb81

2021-07-19

Fixed template_fields_renderers for Amazon provider (#17087)

8f77a54b53

2021-07-19

removing try-catch block (#17081)

cda78333b4

2021-07-18

Added docs & doc ref's for AWS transfer operators between SFTP & S3 (#16964)

d02ded65ea

2021-07-15

Fixed wrongly escaped characters in amazon's changelog (#17020)

b916b75079

2021-07-15

Prepare documentation for July release of providers. (#17015)

fc0250f1d5

2021-07-15

Allow attaching to previously launched task in ECSOperator (#16685)

d3f300fba8

2021-07-11

Fix wrong template_fields_renderers for AWS operators (#16820)

f0df184e4d

2021-07-07

Update AWS Base hook to use refreshable credentials (#16770) (#16771)

ffe8fab653

2021-07-03

Added select_query to the templated fields in RedshiftToS3Operator (#16767)

866a601b76

2021-06-28

Removes pylint from our toolchain (#16682)

0d80383bdd

2021-06-28

AWS Hook - allow IDP HTTP retry (#12639) (#16612)

3a57d9fc60

2021-06-26

Bump ''sphinxcontrib-spelling'' and minor improvements (#16675)

2543c74c19

2021-06-24

AWS DataSync cancel task on exception (#11011) (#16589)

2ab2cbf93d

2021-06-23

Update Boto3 API calls in ECSOperator (#16050)

2.0.0

Latest change: 2021-06-21

Commit

Committed

Subject

19ed074e9c

2021-06-21

Use safe get with AWS DMS describe replication tasks (#16540)

bbc627a3da

2021-06-18

Prepares documentation for rc2 release of Providers (#16501)

db10c6841b

2021-06-18

Add AWS DMS replication task operators (#15850)

1c82b4d015

2021-06-17

Fix S3ToFTPOperator (#13796)

36dc6a8100

2021-06-16

Make job name check optional in SageMakerTrainingOperator (#16327)

cbf8001d76

2021-06-16

Synchronizes updated changelog after buggfix release (#16464)

1fba5402bb

2021-06-15

More documentation update for June providers release (#16405)

9cd7930c34

2021-06-13

Update copy command for s3 to redshift (#16241)

643f3c35a6

2021-06-13

fix: AwsGlueJobOperator change order of args for load_file (#16216)

30708b5b25

2021-06-13

Add support of capacity provider strategy for ECSOperator (#15848)

9c94b72d44

2021-06-07

Updated documentation for June 2021 provider release (#16294)

9fcdf3d4de

2021-06-02

Fix S3 Select payload join (#16189)

8d16638285

2021-05-29

remove retry for now (#16150)

5fbc86f036

2021-05-27

Remove the 'not-allow-trailing-slash' rule on S3_hook (#15609)

904709d34f

2021-05-27

Check synctatic correctness for code-snippets (#16005)

476d0f6e3d

2021-05-22

Bump pyupgrade v2.13.0 to v2.18.1 (#15991)

821ea6fc18

2021-05-17

Fix spacing in ''AwsBatchWaitersHook'' docstring (#15839)

1467046058

2021-05-14

CloudwatchTaskHandler reads timestamp from Cloudwatch events (#15173)

dab10d9fae

2021-05-10

MongoToS3Operator failed when running with a single query (not aggregate pipeline) (#15680)

9c8391a13f

2021-05-10

Fix spelling (#15699)

37681bca00

2021-05-07

Auto-apply apply_default decorator (#15667)

9953a047c4

2021-05-07

Add Connection Documentation for the Hive Provider (#15704)

0f97a3970d

2021-05-04

Rename example bucket names to use INVALID BUCKET NAME by default (#15651)

db557a8c4a

2021-05-01

Docs: Replace 'airflow' to 'apache-airflow' to install extra (#15628)

1.4.0

Latest change: 2021-05-01

Commit

Committed

Subject

807ad32ce5

2021-05-01

Prepares provider release after PIP 21 compatibility (#15576)

814e471d13

2021-04-29

Update pre-commit checks (#15583)

bf2b48174a

2021-04-27

Add Connection Documentation for Providers (#15499)

4b031d39e1

2021-04-27

Make Airflow code Pylint 2.8 compatible (#15534)

657384615f

2021-04-27

Fix 'logging.exception' redundancy (#14823)

d598630cd7

2021-04-26

Fix AthenaSensor calling AthenaHook incorrectly (#15427)

71c673e427

2021-04-22

Update Docstrings of Modules with Missing Params (#15391)

a82de56b9d

2021-04-13

S3Hook.load_file should accept Path object in addition to str (#15232)

b4770725a3

2021-04-12

Add links to new modules for deprecated modules (#15316)

da780fc8b1

2021-04-12

Fixes doc for SQSSensor (#15323)

1.3.0

Latest change: 2021-04-06

Commit

Committed

Subject

042be2e4e0

2021-04-06

Updated documentation for provider packages before April release (#15236)

266384a63f

2021-04-05

Fix string concatenation using 'f-strings' (#15200)

eda538f56c

2021-04-02

AWS: Do not log info when SSM & SecretsManager secret not found (#15120)

9b76b94c94

2021-04-02

A bunch of template_fields_renderers additions (#15130)

6822665102

2021-04-01

Send region_name into parant class of AwsGlueJobHook (#14251)

5379698892

2021-03-27

Improve docstrings for various modules (#15047)

614be87b23

2021-03-26

Added retry to ECS Operator (#14263)

a7ca1b3b0b

2021-03-26

Fix Sphinx Issues with Docstrings (#14968)

0f327788b5

2021-03-24

doc: Fix typo in 'secrets_manager.py' docstring (#14943)

93982e3bb6

2021-03-22

Make script_args templated in AwsGlueJobOperator (#14925)

e172bd0e16

2021-03-22

Update docstrings to adhere to sphinx standards (#14918)

68e4c4dcb0

2021-03-20

Remove Backport Providers (#14886)

a3778127ed

2021-03-15

Add FTPToS3Operator (#13707)

b896aee8cc

2021-03-07

Cache Hook when initializing 'CloudFormationCreateStackSensor' (#14638)

e7bb17aeb8

2021-03-06

Use built-in 'cached_property' on Python 3.8 where possible (#14606)

697abf399d

2021-03-05

S3DataSource is not required (#14220)

8ced652ecf

2021-02-28

Implemented S3 Bucket Tagging (#14402)

1.2.0

Latest change: 2021-02-27

Commit

Committed

Subject

589d6dec92

2021-02-27

Prepare to release the next wave of providers: (#14487)

13854c32a3

2021-02-27

Adding support to put extra arguments for Glue Job. (#14027)

0d6cae4172

2021-02-24

Avoid using threads in S3 remote logging uplod (#14414)

ca35bd7f7f

2021-02-21

By default PIP will install all packages in .local folder (#14125)

1b14726307

2021-02-11

Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query (#14177)

9034f277ef

2021-02-10

Document configuration for email backend credentials. (#14006)

8c5594b02f

2021-02-08

includes the STS token if STS credentials are used (#11227)

cddbf9c11d

2021-02-06

Use MongoDB color for MongoToS3Operator (#14103)

10343ec29f

2021-02-05

Corrections in docs and tools after releasing provider RCs (#14082)

1.1.0

Latest change: 2021-02-04

Commit

Committed

Subject

88bdcfa0df

2021-02-04

Prepare to release a new wave of providers. (#14013)

ac2f72c98d

2021-02-01

Implement provider versioning tools (#13767)

01049ddce2

2021-01-31

Add aws ses email backend for use with EmailOperator. (#13986)

ecfdc60bb6

2021-01-29

Add bucket_name to template fileds in S3 operators (#13973)

d0ab7f6d3a

2021-01-25

Add ExasolToS3Operator (#13847)

6d55f329f9

2021-01-25

AWS Glue Crawler Integration (#13072)

f473ca7130

2021-01-24

Replace 'google_cloud_storage_conn_id' by 'gcp_conn_id' when using 'GCSHook' (#13851)

a9ac2b040b

2021-01-23

Switch to f-strings using flynt. (#13732)

3fd5ef3555

2021-01-21

Add missing logos for integrations (#13717)

29730d7200

2021-01-20

Add acl_policy to S3CopyObjectOperator (#13773)

c065d32189

2021-01-19

AllowDiskUse parameter and docs in MongotoS3Operator (#12033)

ab5fe56ac4

2021-01-16

Fix bug in GCSToS3Operator (#13718)

04d278f93f

2021-01-13

Add S3ToFTPOperator (#11747)

8d42d9ed69

2021-01-11

add xcom push for ECSOperator (#12096)

308f1d0666

2021-01-07

[AIRFLOW-3723] Add Gzip capability to mongo_to_S3 operator (#13187)

f69405fb0b

2021-01-07

Fix S3KeysUnchangedSensor so that template_fields work (#13490)

4e479e1e1b

2021-01-06

Add S3KeySizeSensor (#13049)

f7a1334abe

2021-01-02

Add 'mongo_collection' to template_fields in MongoToS3Operator (#13361)

bd74eb0ca0

2020-12-31

Allow Tags on AWS Batch Job Submission (#13396)

295d66f914

2020-12-30

Fix Grammar in PIP warning (#13380)

625576a3af

2020-12-18

Fix spelling (#13135)

6cf76d7ac0

2020-12-18

Fix typo in pip upgrade command :( (#13148)

5090fb0c89

2020-12-15

Add script to generate integrations.json (#13073)

1.0.0

Latest change: 2020-12-09

Commit

Committed

Subject

32971a1a2d

2020-12-09

Updates providers versions to 1.0.0 (#12955)

d5589673a9

2020-12-08

Move dummy_operator.py to dummy.py (#11178) (#11293)

b40dffa085

2020-12-08

Rename remaing modules to match AIP-21 (#12917)

9b39f24780

2020-12-08

Add support for dynamic connection form fields per provider (#12558)

bd90136aaf

2020-11-30

Move operator guides to provider documentation packages (#12681)

02d94349be

2020-11-29

Don't use time.time() or timezone.utcnow() for duration calculations (#12353)

de3b1e687b

2020-11-28

Move connection guides to provider documentation packages (#12653)

663259d4b5

2020-11-25

Fix AWS DataSync tests failing (#11020)

3fa51f94d7

2020-11-24

Add check for duplicates in provider.yaml files (#12578)

ed09915a02

2020-11-23

[AIRFLOW-5115] Bugfix for S3KeySensor failing to accept template_fields (#12389)

370e7d07d1

2020-11-21

Fix Python Docstring parameters (#12513)

c34ef853c8

2020-11-20

Separate out documentation building per provider  (#12444)

0080354502

2020-11-18

Update provider READMEs for 1.0.0b2 batch release (#12449)

7ca0b6f121

2020-11-18

Enable Markdownlint rule MD003/heading-style/header-style (#12427) (#12438)

ae7cb4a1e2

2020-11-17

Update wrong commit hash in backport provider changes (#12390)

6889a333cf

2020-11-15

Improvements for operators and hooks ref docs (#12366)

c94b1241a1

2020-11-13

Add extra error handling to S3 remote logging (#9908)

7825e8f590

2020-11-13

Docs installation improvements (#12304)

250436d962

2020-11-10

Fix spelling in Python files (#12230)

85a18e13d9

2020-11-09

Point at pypi project pages for cross-dependency of provider packages (#12212)

59eb5de78c

2020-11-09

Update provider READMEs for up-coming 1.0.0beta1 releases (#12206)

b2a28d1590

2020-11-09

Moves provider packages scripts to dev (#12082)

fcb6b00efe

2020-11-08

Add authentication to AWS with Google credentials (#12079)

fb6bddba0c

2020-11-07

In AWS Secrets backend, a lookup is optional (#12143)

cf9437d79f

2020-11-06

Simplify string expressions (#12123)

41bf172c1d

2020-11-04

Simplify string expressions (#12093)

4e8f9cc8d0

2020-11-03

Enable Black - Python Auto Formmatter (#9550)

8c42cf1b00

2020-11-03

Use PyUpgrade to use Python 3.6 features (#11447)

5e77a61543

2020-11-02

Docstring fix for S3DeleteBucketOperator (#12049)

8222851348

2020-10-29

Add Template Fields to RedshiftToS3Operator & S3ToRedshiftOperator (#11844)

db121f726b

2020-10-28

Add truncate table (before copy) option to S3ToRedshiftOperator (#9246)

5a439e84eb

2020-10-26

Prepare providers release 0.0.2a1 (#11855)

8afdb6ac6a

2020-10-26

Fix spellings (#11825)

872b1566a1

2020-10-25

Generated backport providers readmes/setup for 2020.10.29 (#11826)

6ce855af11

2020-10-24

Fix spelling (#11821)

3934ef2249

2020-10-24

Remove redundant builtins imports (#11809)

4c8e033c0e

2020-10-24

Fix spelling and grammar (#11814)

4830687453

2020-10-24

Use Python 3 style super classes (#11806)

0df60b7736

2020-10-23

Add reattach flag to ECSOperator (#10643)

b9d677cdd6

2020-10-22

Add type hints to  aws provider (#11531)

349b0811c3

2020-10-20

Add D200 pydocstyle check (#11688)

674368f66c

2020-10-19

Fixes MySQLToS3 float to int conversion (#10437)

0823d46a7f

2020-10-16

Add type annotations for AWS operators and hooks (#11434)

16e7129719

2020-10-13

Added support for provider packages for Airflow 2.0 (#11487)

d38a0a781e

2020-10-12

added type hints for aws cloud formation (#11470)

d305876bee

2020-10-12

Remove redundant None provided as default to dict.get() (#11448)

c3e340584b

2020-10-11

Change prefix of AwsDynamoDB hook module (#11209)

42a23d16fe

2020-10-11

Update MySQLToS3Operator's s3_bucket to template_fields (#10778)

422b61a9dd

2020-10-09

Adding ElastiCache Hook for creating, describing and deleting replication groups (#8701)

dd98b21494

2020-10-06

Add acl_policy parameter to GCSToS3Operator (#10804) (#10829)

32b3cfbcf0

2020-10-06

Strict type check for all hooks in amazon (#11250)

6d573e8abb

2020-10-03

Add s3 key to template fields for s3/redshift transfer operators (#10890)

0a0e1af800

2020-10-03

Fix Broken Markdown links in Providers README TOC (#11249)

ca4238eb4d

2020-10-02

Fixed month in backport packages to October (#11242)

5220e4c384

2020-10-02

Prepare Backport release 2020.09.07 (#11238)

00ffedb8c4

2020-09-30

Add amazon glacier to GCS transfer operator (#10947)

e3f96ce7a8

2020-09-24

Fix incorrect Usage of Optional[bool] (#11138)

f3e87c5030

2020-09-22

Add D202 pydocstyle check (#11032)

b61225a885

2020-09-21

Add D204 pydocstyle check (#11031)

2410f592a4

2020-09-19

Get Airflow configs with sensitive data from AWS Systems Manager (#11023)

2bf7b7cac7

2020-09-19

Add typing to amazon provider EMR (#10910)

9edfcb7ac4

2020-09-19

Support extra_args in S3Hook and GCSToS3Operator (#11001)

4e1f3a69db

2020-09-14

[AIRFLOW-10645] Add AWS Secrets Manager Hook (#10655)

e9add79160

2020-09-14

Fix Failing static tests on Master (#10927)

383a118d2d

2020-09-14

Add more type annotations to AWS hooks (#10671)

9549274d11

2020-09-09

Upgrade black to 20.8b1 (#10818)

2934220dc9

2020-09-08

Always return a list from S3Hook list methods (#10774)

f40ac9b151

2020-09-01

Add placement_strategy option (#9444)

e4878e6775

2020-08-31

fix type hints for s3 hook read_key method (#10653)

2ca615cffe

2020-08-29

Update Google Cloud branding (#10642)

8969b7185e

2020-08-28

Removed bad characters from AWS operator (#10590)

8349061f9c

2020-08-26

Improve Docstring for AWS Athena Hook/Operator (#10580)

fdd9b6f65b

2020-08-25

Enable Black on Providers Packages (#10543)

3696c34c28

2020-08-24

Fix typo in the word "release" (#10528)

3734876d98

2020-08-24

Implement impersonation in google operators (#10052)

ee7ca128a1

2020-08-22

Fix broken Markdown refernces in Providers README (#10483)

c6358045f9

2020-08-22

Fixes S3ToRedshift COPY query (#10436)

7c206a82a6

2020-08-22

Replace assigment with Augmented assignment (#10468)

27d08b76a2

2020-08-21

Amazon SES Hook (#10391)

dea345b05c

2020-08-17

Fix AwsGlueJobSensor to stop running after the Glue job finished (#9022)

f6734b3b85

2020-08-12

Enable Sphinx spellcheck for doc generation (#10280)

82f744b871

2020-08-11

Add type annotations to AwsGlueJobHook, RedshiftHook modules (#10286)

19bc97d0ce

2020-08-10

Revert "Add Amazon SES hook (#10004)" (#10276)

f06fe616e6

2020-08-10

Add Amazon SES hook (#10004)

0c77ea8a3c

2020-08-06

Add type annotations to S3 hook module (#10164)

24c8e4c2d6

2020-08-06

Changes to all the constructors to remove the args argument (#10163)

9667314b2f

2020-08-05

Add correct signatures for operators in amazon provider package (#10167)

000287753b

2020-08-03

Improve Typing coverage of amazon/aws/athena (#10025)

53ada6e791

2020-08-03

Add S3KeysUnchangedSensor (#9817)

aeea71274d

2020-08-02

Remove 'args' parameter from provider operator constructors (#10097)

2b8dea64e9

2020-08-01

Fix typo in Athena sensor retries (#10079)

1508c43ec9

2020-07-29

Adding new SageMaker operator for ProcessingJobs (#9594)

7d24b088cd

2020-07-25

Stop using start_date in default_args in example_dags (2) (#9985)

8b10a4b35e

2020-07-25

Stop using start_date in default_args in example_dags (#9982)

33f0cd2657

2020-07-22

apply_default keeps the function signature for mypy (#9784)

e7c87fe453

2020-07-20

Refactor AwsBaseHook._get_credentials (#9878)

2577f9334a

2020-07-16

Fix S3FileTransformOperator to support S3 Select transformation only (#8936)

52b6efe1ec

2020-07-15

Add option to delete by prefix to S3DeleteObjectsOperator (#9350)

553bb7af7c

2020-07-13

Keep functions signatures in decorators (#9786)

2f31b3060e

2020-07-08

Get Airflow configs with sensitive data from Secret Backends (#9645)

07b81029eb

2020-07-08

Allow AWSAthenaHook to get more than 1000/first page of results (#6075)

564192c162

2020-07-08

Add AWS StepFunctions integrations to the aws provider (#8749)

ecce1ace7a

2020-07-08

[AIRFLOW-XXXX] Remove unnecessary docstring in AWSAthenaOperator

a79e2d4c4a

2020-07-06

Move provider's log task handlers to the provider package (#9604)

ee20086b8c

2020-07-02

Move S3TaskHandler to the AWS provider package (#9602)

40add26d45

2020-06-29

Remove almost all references to airflow.contrib (#9559)

c858babddf

2020-06-26

Remove kwargs from Super calls in AWS Secrets Backends (#9523)

87fdbd0708

2020-06-25

Use literal syntax instead of function calls to create data structure (#9516)

c7a454aa32

2020-06-22

Add AWS ECS system test (#8888)

df8efd04f3

2020-06-21

Enable & Fix "Docstring Content Issues" PyDocStyle Check (#9460)

e13a14c873

2020-06-21

Enable & Fix Whitespace related PyDocStyle Checks (#9458)

d0e7db4024

2020-06-19

Fixed release number for fresh release (#9408)

12af6a0800

2020-06-19

Final cleanup for 2020.6.23rc1 release preparation (#9404)

992a18c84a

2020-06-19

Move MySqlToS3Operator to transfers (#9400)

a60f589aa2

2020-06-19

Add MySqlToS3Operator (#9054)

c7e5bce57f

2020-06-19

Prepare backport release candidate for 2020.6.23rc1 (#9370)

40bf8f28f9

2020-06-18

Detect automatically the lack of reference to the guide in the operator descriptions (#9290)

f6bd817a3a

2020-06-16

Introduce 'transfers' packages (#9320)

58a8ec0e46

2020-06-16

AWSBatchOperator <> ClientHook relation changed to composition (#9306)

a80cd25e8e

2020-06-15

Close/Flush byte stream in s3 hook load_string and load_bytes (#9211)

ffb8574037

2020-06-14

Decrypt secrets from SystemsManagerParameterStoreBackend (#9214)

a69b031f20

2020-06-10

Add S3ToRedshift example dag and system test (#8877)

17adcea835

2020-06-02

Fix handling of subprocess error handling in s3_file_transform and gcs (#9106)

357e11e0cf

2020-05-29

Add Delete/Create S3 bucket operators (#8895)

1ed171bfb2

2020-05-28

Add script_args for S3FileTransformOperator (#9019)

0b0e4f7a4c

2020-05-26

Preparing for RC3 relase of backports (#9026)

00642a46d0

2020-05-26

Fixed name of 20 remaining wrongly named operators. (#8994)

1d36b0303b

2020-05-23

Fix references in docs (#8984)

f946f96da4

2020-05-23

Old json boto compat removed from dynamodb_to_s3 operator (#8987)

375d1ca229

2020-05-19

Release candidate 2 for backport packages 2020.05.20 (#8898)

12c5e5d8ae

2020-05-17

Prepare release candidate for backport packages (#8891)

f3521fb0e3

2020-05-16

Regenerate readme files for backport package release (#8886)

f4edd90a94

2020-05-16

Speed up TestAwsLambdaHook by not actually running a function (#8882)

92585ca4cb

2020-05-15

Added automated release notes generation for backport operators (#8807)

85bbab27db

2020-05-15

Add EMR operators howto docs (#8863)

e61b9bb9bb

2020-05-13

Add AWS EMR System tests (#8618)

ed3f5131a2

2020-05-13

Correctly pass sleep time from AWSAthenaOperator down to the hook. (#8845)

7236862a1f

2020-05-12

[AIRFLOW-2310] Enable AWS Glue Job Integration (#6007)

d590e5e767

2020-05-11

Add option to propagate tags in ECSOperator (#8811)

0c3db84c3c

2020-05-11

[AIRFLOW-7068] Create EC2 Hook, Operator and Sensor (#7731)

cbebed2b4d

2020-05-10

Allow passing backend_kwargs to AWS SSM client (#8802)

c7788a6894

2020-05-10

Add imap_attachment_to_s3 example dag and system test (#8669)

ff5b70149b

2020-05-07

Add google_api_to_s3_transfer example dags and system tests (#8581)

4421f011ee

2020-05-01

Improve template capabilities of EMR job and step operators (#8572)

379a884d64

2020-04-28

fix: aws hook should work without conn id (#8534)

74bc316c56

2020-04-27

[AIRFLOW-4438] Add Gzip compression to S3_hook (#8571)

7ea66a1a95

2020-04-26

Add example DAG for ECSOperator (#8452)

b6434dedf9

2020-04-24

[AIRFLOW-7111] Add generate_presigned_url method to S3Hook (#8441)

becedd5af8

2020-04-19

Remove unrelated EC2 references in ECSOperator (#8451)

ab1290cb0c

2020-04-13

Make launch_type parameter optional (#8248)

87969a350d

2020-04-09

[AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170)

b46d6c0602

2020-04-08

Add support for AWS Secrets Manager as Secrets Backend (#8186)

68d1714f29

2020-04-04

[AIRFLOW-6822] AWS hooks should cache boto3 client (#7541)

8a02402576

2020-03-31

Rename CloudBaseHook to GoogleBaseHook and move it to google.common (#8011)

7239d9a82d

2020-03-28

Get Airflow Variables from AWS Systems Manager Parameter Store (#7945)

eb4af4f944

2020-03-28

Make BaseSecretsBackend.build_path generic (#7948)

438da7241e

2020-03-28

[AIRFLOW-5825] SageMakerEndpointOperator is not idempotent (#7891)

686d7d50bd

2020-03-25

Standardize SecretBackend class names (#7846)

eef87b9953

2020-03-23

[AIRFLOW-7105] Unify Secrets Backend method interfaces (#7830)

5648dfbc30

2020-03-23

Add missing call to Super class in 'amazon', 'cloudant & 'databricks' providers (#7827)

a360024123

2020-03-19

[AIRFLOW-5705] Make AwsSsmSecretsBackend consistent with VaultBackend (#7753)

2a54512d78

2020-03-17

[AIRFLOW-5705] Fix bugs in AWS SSM Secrets Backend (#7745)

a8b5fc74d0

2020-03-16

[AIRFLOW-4175] S3Hook load_file should support ACL policy paramete (#7733)

e31e9ddd23

2020-03-14

[AIRFLOW-5705] Add secrets backend and support for AWS SSM (#6376)

3bb60afc7b

2020-03-13

[AIRFLOW-6975] Base AWSHook AssumeRoleWithSAML (#7619)

c0c5f11ad1

2020-03-12

[AIRFLOW-6884] Make SageMakerTrainingOperator idempotent (#7598)

b7cdda1c64

2020-03-10

[AIRFLOW-4438] Add Gzip compression to S3_hook (#7680)

42eef38217

2020-03-07

[AIRFLOW-6877] Add cross-provider dependencies as extras (#7506)

9a94ab246d

2020-03-01

[AIRFLOW-6962] Fix compeleted to completed (#7600)

1b38f6d9b6

2020-02-29

[AIRFLOW-5908] Add download_file to S3 Hook (#6577)

3ea3e1a2b5

2020-02-26

[AIRFLOW-6824] EMRAddStepsOperator problem with multi-step XCom (#7443)

6eaa7e3b18

2020-02-25

[AIRFLOW-5924] Automatically unify bucket name and key in S3Hook (#6574)

3320e432a1

2020-02-24

[AIRFLOW-6817] Lazy-load 'airflow.DAG' to keep user-facing API untouched (#7517)

7d0e7122dd

2020-02-24

[AIRFLOW-6830] Add Subject/MessageAttributes to SNS hook and operator (#7451)

4d03e33c11

2020-02-22

[AIRFLOW-6817] remove imports from 'airflow/__init__.py', replaced implicit imports with explicit imports, added entry to 'UPDATING.MD' - squashed/rebased (#7456)

47a922b864

2020-02-21

[AIRFLOW-6854] Fix missing typing_extensions on python 3.8 (#7474)

9cbd7de6d1

2020-02-18

[AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412)

58c3542ed2

2020-02-12

[AIRFLOW-5231] Fix S3Hook.delete_objects method (#7375)

b7aa778b38

2020-02-10

[AIRFLOW-6767] Correct name for default Athena workgroup (#7394)

9282185e66

2020-02-09

[AIRFLOW-6761] Fix WorkGroup param in AWSAthenaHook (#7386)

94fccca970

2020-02-04

[AIRFLOW-XXXX] Add pre-commit check for utf-8 file encoding (#7347)

f3ad5cf618

2020-02-03

[AIRFLOW-4681] Make sensors module pylint compatible (#7309)

88e40c714d

2020-02-03

[AIRFLOW-6716] Fix AWS Datasync Example DAG (#7339)

a311d3d82e

2020-02-03

[AIRFLOW-6718] Fix more occurrences of utils.dates.days_ago (#7341)

cb766b05b1

2020-02-03

[AIRFLOW-XXXX] Fix Static Checks on CI (#7342)

97a429f9d0

2020-02-02

[AIRFLOW-6714] Remove magic comments about UTF-8 (#7338)

7527eddc5e

2020-02-02

[AIRFLOW-4364] Make all code in airflow/providers/amazon pylint compatible (#7336)

cf141506a2

2020-02-02

[AIRFLOW-6708] Set unique logger names (#7330)

63aa3db88f

2020-02-02

[AIRFLOW-6258] Add CloudFormation operators to AWS providers (#6824)

af4157fdef

2020-02-02

[AIRFLOW-6672] AWS DataSync - better logging of error message (#7288)

373c6aa4a2

2020-01-30

[AIRFLOW-6682] Move GCP classes to providers package (#7295)

83c037873f

2020-01-30

[AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287)

1988a97e8f

2020-01-28

[AIRFLOW-6659] Move AWS Transfer operators to providers package (#7274)

ab10443e96

2020-01-28

[AIRFLOW-6424] Added a operator to modify EMR cluster (#7213)

40246132a7

2020-01-28

[AIRFLOW-6654] AWS DataSync - bugfix when creating locations (#7270)

82c0e5aff6

2020-01-28

[AIRFLOW-6655] Move AWS classes to providers (#7271)

599e4791c9

2020-01-18

[AIRFLOW-6541] Use EmrJobFlowSensor for other states (#7146)

c319e81cae

2020-01-17

[AIRFLOW-6572] Move AWS classes to providers.amazon.aws package (#7178)

941a070578

2020-01-15

[AIRFLOW-6570] Add dag tag for all example dag (#7176)

78d8fe6944

2020-01-08

[AIRFLOW-6245] Add custom waiters for AWS batch jobs (#6811)

e0b0227257

2019-12-28

[AIRFLOW-6319] Add support for AWS Athena workgroups (#6871)

57da456854

2019-12-24

[AIRFLOW-6333] Bump Pylint to 2.4.4 & fix/disable new checks (#6888)

cf647c27e0

2019-12-18

[AIRFLOW-6038] AWS DataSync reworked (#6773)

7502cad284

2019-12-17

[AIRFLOW-6206] Move and rename AWS batch operator [AIP-21] (#6764)

c4c635df69

2019-12-17

[AIRFLOW-6083] Adding ability to pass custom configuration to lambda client. (#6678)

4fb498f87e

2019-12-09

[AIRFLOW-6072] aws_hook: Outbound http proxy setting and other enhancements (#6686)

a1e2f86352

2019-11-20

[AIRFLOW-6021] Replace list literal with list constructor (#6617)

baae140847

2019-11-19

[AIRFLOW-5781] AIP-21 Migrate AWS Kinesis to /providers/amazon/aws (#6588)

504cfbac1a

2019-11-18

[AIRFLOW-5783] AIP-21 Move aws redshift into providers structure (#6539)

992f0e3acf

2019-11-12

AIRFLOW-5824: AWS DataSync Hook and Operators added (#6512)

c015eb2f64

2019-11-10

[AIRFLOW-5786] Migrate AWS SNS to /providers/amazon/aws (#6502)

3d76fb4bf2

2019-11-09

[AIRFLOW-5782] Migrate AWS Lambda to /providers/amazon/aws [AIP-21] (#6518)

Was this entry helpful?