Package apache-airflow-providers-amazon

Amazon integration (including Amazon Web Services (AWS)).

This is detailed commit list of changes for versions provider package: amazon. For high-level changelog, see package information including changelog.

2.4.0

Latest change: 2021-11-04

Commit

Committed

Subject

96dd70348

2021-11-04

`` fix SagemakerProcessingOperator ThrottlingException (#19195)``

a3266ba2b

2021-11-03

Doc: Fix typos in variable and comments (#19349)

6148ddd36

2021-11-03

Fix S3ToRedshiftOperator (#19358)

1600f1dfd

2021-10-30

Remove duplicated entries in changelog (#19331)

d9567eb10

2021-10-29

Prepare documentation for October Provider's release (#19321)

1543dc28f

2021-10-29

Fixing ses email backend (#18042)

3c08c025c

2021-10-27

Move validation of templated input params to run after the context init (#19048)

f5ad26dcd

2021-10-21

Fixup string concatenations (#19099)

86a2a19ad

2021-10-17

More f-strings (#18855)

258451cfb

2021-10-15

MySQLToS3Operator add support for parquet format (#18755)

176165de3

2021-10-11

Update S3PrefixSensor to support checking multiple prefixes within a bucket (#18807)

1d7cfdbcd

2021-10-10

Remove extra postgres dependency from AWS Provider (#18844)

1df9a512c

2021-10-08

Add RedshiftSQLHook, RedshiftSQLOperator (#18447)

22768ff61

2021-10-08

Removed duplicated code on S3ToRedshiftOperator (#18671)

2.3.0

Latest change: 2021-10-08

Commit

Committed

Subject

a680e876b

2021-10-08

Prepare documentation for RC2 Amazon Provider release for September (#18830)

ea8f47890

2021-10-08

Add AWS Fargate profile support (#18645)

9344c3452

2021-10-08

Enable AWS Secrets Manager backend to retrieve conns using different fields (#18764)

1a35644b5

2021-10-08

Add emr cluster link (#18691)

e0af0b976

2021-10-08

AwsGlueJobOperator: add wait_for_completion to Glue job run (#18814)

8e56ed234

2021-10-07

Enable FTPToS3Operator to transfer several files (#17937)

28284a37b

2021-10-07

Amazon Athena Example (#18785)

38c6cf9c2

2021-10-07

AwsGlueJobOperator: add run_job_kwargs to Glue job run (#16796)

72e49ad3a

2021-10-06

Amazon SQS Example (#18760)

767a4f520

2021-10-05

ECSOperator: airflow exception on edge case when cloudwatch log stream is not found (#18733)

760bf6e51

2021-10-06

Adds an s3 list prefixes operator (#17145)

12763f125

2021-10-05

Add additional dependency for postgres extra for amazon provider (#18737)

86bf2a29b

2021-10-04

Simplify strings previously split across lines (#18679)

12133861e

2021-10-01

Support all Unix wildcards in S3KeySensor (#18211)

840ea3efb

2021-09-30

Update documentation for September providers release (#18613)

8a1437e55

2021-09-29

Refresh credentials for long-running pods on EKS (#17951)

2fbd23878

2021-09-28

Update s3_list.py (#18561)

a458fcc57

2021-09-27

Updating miscellaneous provider DAGs to use TaskFlow API where applicable (#18278)

e25eea052

2021-09-19

Inclusive Language (#18349)

4cd190c9b

2021-09-18

ECSOperator realtime logging (#17626)

27088c453

2021-09-18

Add IAM Role Credentials to S3ToRedshiftTransfer and RedshiftToS3Transfer (#18156)

2d4f3cb64

2021-09-15

Adding missing 'replace' param in docstring (#18241)

81ebd78db

2021-09-12

Added upsert method on S3ToRedshift operator (#18027)

02397761a

2021-09-12

Deprecate default pod name in EKSPodOperator (#18036)

e6cb2f7be

2021-09-10

ECSOperator returns last logs when ECS task fails (#17209)

b8795501e

2021-09-10

Aws secrets manager backend (#17448)

6e101317a

2021-09-10

Simplify s3 ''unify_bucket_name_and_key'' (#17325)

3fe948a86

2021-09-08

sftp_to_s3 stream file option (#17609)

867e9305f

2021-09-03

AwsBaseHook make 'client_type' & 'resource_type' optional params for 'get_client_type' & 'get_resource_type' (#17987)

bcd81f23a

2021-09-03

Add Spark to the EMR cluster for the job flow examples (#17563)

7c4d3173f

2021-09-02

Delete unnecessary parameters in EKSPodOperator (#17960)

2.2.0

Latest change: 2021-08-30

Commit

Committed

Subject

0a6858847

2021-08-30

Add August 2021 Provider's documentation (#17890)

653c13ec0

2021-08-30

Fix broken XCOM in EKSPodOperator (#17918)

42e13e1a5

2021-08-30

Remove all deprecation warnings in providers (#17900)

890bd4310

2021-08-28

Add an Amazon EMR on EKS provider package (#16766)

41632e03b

2021-08-27

Fix provider.yaml errors due to exit(0) in test (#17858)

be75dcd39

2021-08-23

Update description about the new ''connection-types'' provider meta-data

76ed2a49c

2021-08-19

Import Hooks lazily individually in providers manager (#17682)

bee48f31f

2021-08-19

Implemented Basic EKS Integration (#16571)

d26b86233

2021-08-19

Add optional SQL parameters in ''RedshiftToS3Operator'' (#17640)

29aab6434

2021-08-17

Adds secrets backend/logging/auth information to provider yaml (#17625)

1632c9f51

2021-08-14

Add new LocalFilesystemToS3Operator under Amazon provider (#17168) (#17382)

e7eeaa608

2021-08-12

Doc: Fix docstrings for ''MongoToS3Operator'' (#17588)

987575787

2021-08-12

Add Mongo projections to hook and transfer (#17379)

77c4325fb

2021-08-10

Fixing ParamValidationError when executing load_file in Glue hooks/operators (#16012)

d28efbfb7

2021-08-02

Improve AWS SQS Sensor (#16880) (#16904)

71088986f

2021-08-02

make platform version as independent parameter of ECSOperator (#17281)

80fc80ace

2021-08-02

Fixes #16972 - Slugify role session name in AWS base hook (#17210)

2.1.0

Latest change: 2021-07-26

Commit

Committed

Subject

87f408b1e

2021-07-26

Prepares docs for Rc2 release of July providers (#17116)

569659db3

2021-07-26

Updating Amazon-AWS example DAGs to use XComArgs (#16868)

763919d41

2021-07-25

Adding custom Salesforce connection type + SalesforceToS3Operator updates (#17162)

8b100fcb4

2021-07-21

ECSOperator / pass context to self.xcom_pull as it was missing (when using reattach) (#17141)

f44d7bd9c

2021-07-21

Made S3ToRedshiftOperator transaction safe (#17117)

32582b5bf

2021-07-21

Adding SalesforceToS3Operator to Amazon Provider (#17094)

bb1d79cb8

2021-07-19

Fixed template_fields_renderers for Amazon provider (#17087)

8f77a54b5

2021-07-19

removing try-catch block (#17081)

cda78333b

2021-07-18

Added docs & doc ref's for AWS transfer operators between SFTP & S3 (#16964)

d02ded65e

2021-07-15

Fixed wrongly escaped characters in amazon's changelog (#17020)

b916b7507

2021-07-15

Prepare documentation for July release of providers. (#17015)

fc0250f1d

2021-07-15

Allow attaching to previously launched task in ECSOperator (#16685)

d3f300fba

2021-07-11

Fix wrong template_fields_renderers for AWS operators (#16820)

f0df184e4

2021-07-07

Update AWS Base hook to use refreshable credentials (#16770) (#16771)

ffe8fab65

2021-07-03

Added select_query to the templated fields in RedshiftToS3Operator (#16767)

866a601b7

2021-06-28

Removes pylint from our toolchain (#16682)

0d80383bd

2021-06-28

AWS Hook - allow IDP HTTP retry (#12639) (#16612)

3a57d9fc6

2021-06-26

Bump ''sphinxcontrib-spelling'' and minor improvements (#16675)

2543c74c1

2021-06-24

AWS DataSync cancel task on exception (#11011) (#16589)

2ab2cbf93

2021-06-23

Update Boto3 API calls in ECSOperator (#16050)

2.0.0

Latest change: 2021-06-21

Commit

Committed

Subject

19ed074e9

2021-06-21

Use safe get with AWS DMS describe replication tasks (#16540)

bbc627a3d

2021-06-18

Prepares documentation for rc2 release of Providers (#16501)

db10c6841

2021-06-18

Add AWS DMS replication task operators (#15850)

1c82b4d01

2021-06-17

Fix S3ToFTPOperator (#13796)

36dc6a810

2021-06-16

Make job name check optional in SageMakerTrainingOperator (#16327)

cbf8001d7

2021-06-16

Synchronizes updated changelog after buggfix release (#16464)

1fba5402b

2021-06-15

More documentation update for June providers release (#16405)

9cd7930c3

2021-06-13

Update copy command for s3 to redshift (#16241)

643f3c35a

2021-06-13

fix: AwsGlueJobOperator change order of args for load_file (#16216)

30708b5b2

2021-06-13

Add support of capacity provider strategy for ECSOperator (#15848)

9c94b72d4

2021-06-07

Updated documentation for June 2021 provider release (#16294)

9fcdf3d4d

2021-06-02

Fix S3 Select payload join (#16189)

8d1663828

2021-05-29

remove retry for now (#16150)

5fbc86f03

2021-05-27

Remove the 'not-allow-trailing-slash' rule on S3_hook (#15609)

904709d34

2021-05-27

Check synctatic correctness for code-snippets (#16005)

476d0f6e3

2021-05-22

Bump pyupgrade v2.13.0 to v2.18.1 (#15991)

821ea6fc1

2021-05-17

Fix spacing in ''AwsBatchWaitersHook'' docstring (#15839)

146704605

2021-05-14

CloudwatchTaskHandler reads timestamp from Cloudwatch events (#15173)

dab10d9fa

2021-05-10

MongoToS3Operator failed when running with a single query (not aggregate pipeline) (#15680)

9c8391a13

2021-05-10

Fix spelling (#15699)

37681bca0

2021-05-07

Auto-apply apply_default decorator (#15667)

9953a047c

2021-05-07

Add Connection Documentation for the Hive Provider (#15704)

0f97a3970

2021-05-04

Rename example bucket names to use INVALID BUCKET NAME by default (#15651)

db557a8c4

2021-05-01

Docs: Replace 'airflow' to 'apache-airflow' to install extra (#15628)

1.4.0

Latest change: 2021-05-01

Commit

Committed

Subject

807ad32ce

2021-05-01

Prepares provider release after PIP 21 compatibility (#15576)

814e471d1

2021-04-29

Update pre-commit checks (#15583)

bf2b48174

2021-04-27

Add Connection Documentation for Providers (#15499)

4b031d39e

2021-04-27

Make Airflow code Pylint 2.8 compatible (#15534)

657384615

2021-04-27

Fix 'logging.exception' redundancy (#14823)

d598630cd

2021-04-26

Fix AthenaSensor calling AthenaHook incorrectly (#15427)

71c673e42

2021-04-22

Update Docstrings of Modules with Missing Params (#15391)

a82de56b9

2021-04-13

S3Hook.load_file should accept Path object in addition to str (#15232)

b4770725a

2021-04-12

Add links to new modules for deprecated modules (#15316)

da780fc8b

2021-04-12

Fixes doc for SQSSensor (#15323)

1.3.0

Latest change: 2021-04-06

Commit

Committed

Subject

042be2e4e

2021-04-06

Updated documentation for provider packages before April release (#15236)

266384a63

2021-04-05

Fix string concatenation using 'f-strings' (#15200)

eda538f56

2021-04-02

AWS: Do not log info when SSM & SecretsManager secret not found (#15120)

9b76b94c9

2021-04-02

A bunch of template_fields_renderers additions (#15130)

682266510

2021-04-01

Send region_name into parant class of AwsGlueJobHook (#14251)

537969889

2021-03-27

Improve docstrings for various modules (#15047)

614be87b2

2021-03-26

Added retry to ECS Operator (#14263)

a7ca1b3b0

2021-03-26

Fix Sphinx Issues with Docstrings (#14968)

0f327788b

2021-03-24

doc: Fix typo in 'secrets_manager.py' docstring (#14943)

93982e3bb

2021-03-22

Make script_args templated in AwsGlueJobOperator (#14925)

e172bd0e1

2021-03-22

Update docstrings to adhere to sphinx standards (#14918)

68e4c4dcb

2021-03-20

Remove Backport Providers (#14886)

a3778127e

2021-03-15

Add FTPToS3Operator (#13707)

b896aee8c

2021-03-07

Cache Hook when initializing 'CloudFormationCreateStackSensor' (#14638)

e7bb17aeb

2021-03-06

Use built-in 'cached_property' on Python 3.8 where possible (#14606)

697abf399

2021-03-05

S3DataSource is not required (#14220)

8ced652ec

2021-02-28

Implemented S3 Bucket Tagging (#14402)

1.2.0

Latest change: 2021-02-27

Commit

Committed

Subject

589d6dec9

2021-02-27

Prepare to release the next wave of providers: (#14487)

13854c32a

2021-02-27

Adding support to put extra arguments for Glue Job. (#14027)

0d6cae417

2021-02-24

Avoid using threads in S3 remote logging uplod (#14414)

ca35bd7f7

2021-02-21

By default PIP will install all packages in .local folder (#14125)

1b1472630

2021-02-11

Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query (#14177)

9034f277e

2021-02-10

Document configuration for email backend credentials. (#14006)

8c5594b02

2021-02-08

includes the STS token if STS credentials are used (#11227)

cddbf9c11

2021-02-06

Use MongoDB color for MongoToS3Operator (#14103)

10343ec29

2021-02-05

Corrections in docs and tools after releasing provider RCs (#14082)

1.1.0

Latest change: 2021-02-04

Commit

Committed

Subject

88bdcfa0d

2021-02-04

Prepare to release a new wave of providers. (#14013)

ac2f72c98

2021-02-01

Implement provider versioning tools (#13767)

01049ddce

2021-01-31

Add aws ses email backend for use with EmailOperator. (#13986)

ecfdc60bb

2021-01-29

Add bucket_name to template fileds in S3 operators (#13973)

d0ab7f6d3

2021-01-25

Add ExasolToS3Operator (#13847)

6d55f329f

2021-01-25

AWS Glue Crawler Integration (#13072)

f473ca713

2021-01-24

Replace 'google_cloud_storage_conn_id' by 'gcp_conn_id' when using 'GCSHook' (#13851)

a9ac2b040

2021-01-23

Switch to f-strings using flynt. (#13732)

3fd5ef355

2021-01-21

Add missing logos for integrations (#13717)

29730d720

2021-01-20

Add acl_policy to S3CopyObjectOperator (#13773)

c065d3218

2021-01-19

AllowDiskUse parameter and docs in MongotoS3Operator (#12033)

ab5fe56ac

2021-01-16

Fix bug in GCSToS3Operator (#13718)

04d278f93

2021-01-13

Add S3ToFTPOperator (#11747)

8d42d9ed6

2021-01-11

add xcom push for ECSOperator (#12096)

308f1d066

2021-01-07

[AIRFLOW-3723] Add Gzip capability to mongo_to_S3 operator (#13187)

f69405fb0

2021-01-07

Fix S3KeysUnchangedSensor so that template_fields work (#13490)

4e479e1e1

2021-01-06

Add S3KeySizeSensor (#13049)

f7a1334ab

2021-01-02

Add 'mongo_collection' to template_fields in MongoToS3Operator (#13361)

bd74eb0ca

2020-12-31

Allow Tags on AWS Batch Job Submission (#13396)

295d66f91

2020-12-30

Fix Grammar in PIP warning (#13380)

625576a3a

2020-12-18

Fix spelling (#13135)

6cf76d7ac

2020-12-18

Fix typo in pip upgrade command :( (#13148)

5090fb0c8

2020-12-15

Add script to generate integrations.json (#13073)

1.0.0

Latest change: 2020-12-09

Commit

Committed

Subject

32971a1a2

2020-12-09

Updates providers versions to 1.0.0 (#12955)

d5589673a

2020-12-08

Move dummy_operator.py to dummy.py (#11178) (#11293)

b40dffa08

2020-12-08

Rename remaing modules to match AIP-21 (#12917)

9b39f2478

2020-12-08

Add support for dynamic connection form fields per provider (#12558)

bd90136aa

2020-11-30

Move operator guides to provider documentation packages (#12681)

02d94349b

2020-11-29

Don't use time.time() or timezone.utcnow() for duration calculations (#12353)

de3b1e687

2020-11-28

Move connection guides to provider documentation packages (#12653)

663259d4b

2020-11-25

Fix AWS DataSync tests failing (#11020)

3fa51f94d

2020-11-24

Add check for duplicates in provider.yaml files (#12578)

ed09915a0

2020-11-23

[AIRFLOW-5115] Bugfix for S3KeySensor failing to accept template_fields (#12389)

370e7d07d

2020-11-21

Fix Python Docstring parameters (#12513)

c34ef853c

2020-11-20

Separate out documentation building per provider  (#12444)

008035450

2020-11-18

Update provider READMEs for 1.0.0b2 batch release (#12449)

7ca0b6f12

2020-11-18

Enable Markdownlint rule MD003/heading-style/header-style (#12427) (#12438)

ae7cb4a1e

2020-11-17

Update wrong commit hash in backport provider changes (#12390)

6889a333c

2020-11-15

Improvements for operators and hooks ref docs (#12366)

c94b1241a

2020-11-13

Add extra error handling to S3 remote logging (#9908)

7825e8f59

2020-11-13

Docs installation improvements (#12304)

250436d96

2020-11-10

Fix spelling in Python files (#12230)

85a18e13d

2020-11-09

Point at pypi project pages for cross-dependency of provider packages (#12212)

59eb5de78

2020-11-09

Update provider READMEs for up-coming 1.0.0beta1 releases (#12206)

b2a28d159

2020-11-09

Moves provider packages scripts to dev (#12082)

fcb6b00ef

2020-11-08

Add authentication to AWS with Google credentials (#12079)

fb6bddba0

2020-11-07

In AWS Secrets backend, a lookup is optional (#12143)

cf9437d79

2020-11-06

Simplify string expressions (#12123)

41bf172c1

2020-11-04

Simplify string expressions (#12093)

4e8f9cc8d

2020-11-03

Enable Black - Python Auto Formmatter (#9550)

8c42cf1b0

2020-11-03

Use PyUpgrade to use Python 3.6 features (#11447)

5e77a6154

2020-11-02

Docstring fix for S3DeleteBucketOperator (#12049)

822285134

2020-10-29

Add Template Fields to RedshiftToS3Operator & S3ToRedshiftOperator (#11844)

db121f726

2020-10-28

Add truncate table (before copy) option to S3ToRedshiftOperator (#9246)

5a439e84e

2020-10-26

Prepare providers release 0.0.2a1 (#11855)

8afdb6ac6

2020-10-26

Fix spellings (#11825)

872b1566a

2020-10-25

Generated backport providers readmes/setup for 2020.10.29 (#11826)

6ce855af1

2020-10-24

Fix spelling (#11821)

3934ef224

2020-10-24

Remove redundant builtins imports (#11809)

4c8e033c0

2020-10-24

Fix spelling and grammar (#11814)

483068745

2020-10-24

Use Python 3 style super classes (#11806)

0df60b773

2020-10-23

Add reattach flag to ECSOperator (#10643)

b9d677cdd

2020-10-22

Add type hints to  aws provider (#11531)

349b0811c

2020-10-20

Add D200 pydocstyle check (#11688)

674368f66

2020-10-19

Fixes MySQLToS3 float to int conversion (#10437)

0823d46a7

2020-10-16

Add type annotations for AWS operators and hooks (#11434)

16e712971

2020-10-13

Added support for provider packages for Airflow 2.0 (#11487)

d38a0a781

2020-10-12

added type hints for aws cloud formation (#11470)

d305876be

2020-10-12

Remove redundant None provided as default to dict.get() (#11448)

c3e340584

2020-10-11

Change prefix of AwsDynamoDB hook module (#11209)

42a23d16f

2020-10-11

Update MySQLToS3Operator's s3_bucket to template_fields (#10778)

422b61a9d

2020-10-09

Adding ElastiCache Hook for creating, describing and deleting replication groups (#8701)

dd98b2149

2020-10-06

Add acl_policy parameter to GCSToS3Operator (#10804) (#10829)

32b3cfbcf

2020-10-06

Strict type check for all hooks in amazon (#11250)

6d573e8ab

2020-10-03

Add s3 key to template fields for s3/redshift transfer operators (#10890)

0a0e1af80

2020-10-03

Fix Broken Markdown links in Providers README TOC (#11249)

ca4238eb4

2020-10-02

Fixed month in backport packages to October (#11242)

5220e4c38

2020-10-02

Prepare Backport release 2020.09.07 (#11238)

00ffedb8c

2020-09-30

Add amazon glacier to GCS transfer operator (#10947)

e3f96ce7a

2020-09-24

Fix incorrect Usage of Optional[bool] (#11138)

f3e87c503

2020-09-22

Add D202 pydocstyle check (#11032)

b61225a88

2020-09-21

Add D204 pydocstyle check (#11031)

2410f592a

2020-09-19

Get Airflow configs with sensitive data from AWS Systems Manager (#11023)

2bf7b7cac

2020-09-19

Add typing to amazon provider EMR (#10910)

9edfcb7ac

2020-09-19

Support extra_args in S3Hook and GCSToS3Operator (#11001)

4e1f3a69d

2020-09-14

[AIRFLOW-10645] Add AWS Secrets Manager Hook (#10655)

e9add7916

2020-09-14

Fix Failing static tests on Master (#10927)

383a118d2

2020-09-14

Add more type annotations to AWS hooks (#10671)

9549274d1

2020-09-09

Upgrade black to 20.8b1 (#10818)

2934220dc

2020-09-08

Always return a list from S3Hook list methods (#10774)

f40ac9b15

2020-09-01

Add placement_strategy option (#9444)

e4878e677

2020-08-31

fix type hints for s3 hook read_key method (#10653)

2ca615cff

2020-08-29

Update Google Cloud branding (#10642)

8969b7185

2020-08-28

Removed bad characters from AWS operator (#10590)

8349061f9

2020-08-26

Improve Docstring for AWS Athena Hook/Operator (#10580)

fdd9b6f65

2020-08-25

Enable Black on Providers Packages (#10543)

3696c34c2

2020-08-24

Fix typo in the word "release" (#10528)

3734876d9

2020-08-24

Implement impersonation in google operators (#10052)

ee7ca128a

2020-08-22

Fix broken Markdown refernces in Providers README (#10483)

c6358045f

2020-08-22

Fixes S3ToRedshift COPY query (#10436)

7c206a82a

2020-08-22

Replace assigment with Augmented assignment (#10468)

27d08b76a

2020-08-21

Amazon SES Hook (#10391)

dea345b05

2020-08-17

Fix AwsGlueJobSensor to stop running after the Glue job finished (#9022)

f6734b3b8

2020-08-12

Enable Sphinx spellcheck for doc generation (#10280)

82f744b87

2020-08-11

Add type annotations to AwsGlueJobHook, RedshiftHook modules (#10286)

19bc97d0c

2020-08-10

Revert "Add Amazon SES hook (#10004)" (#10276)

f06fe616e

2020-08-10

Add Amazon SES hook (#10004)

0c77ea8a3

2020-08-06

Add type annotations to S3 hook module (#10164)

24c8e4c2d

2020-08-06

Changes to all the constructors to remove the args argument (#10163)

9667314b2

2020-08-05

Add correct signatures for operators in amazon provider package (#10167)

000287753

2020-08-03

Improve Typing coverage of amazon/aws/athena (#10025)

53ada6e79

2020-08-03

Add S3KeysUnchangedSensor (#9817)

aeea71274

2020-08-02

Remove 'args' parameter from provider operator constructors (#10097)

2b8dea64e

2020-08-01

Fix typo in Athena sensor retries (#10079)

1508c43ec

2020-07-29

Adding new SageMaker operator for ProcessingJobs (#9594)

7d24b088c

2020-07-25

Stop using start_date in default_args in example_dags (2) (#9985)

8b10a4b35

2020-07-25

Stop using start_date in default_args in example_dags (#9982)

33f0cd265

2020-07-22

apply_default keeps the function signature for mypy (#9784)

e7c87fe45

2020-07-20

Refactor AwsBaseHook._get_credentials (#9878)

2577f9334

2020-07-16

Fix S3FileTransformOperator to support S3 Select transformation only (#8936)

52b6efe1e

2020-07-15

Add option to delete by prefix to S3DeleteObjectsOperator (#9350)

553bb7af7

2020-07-13

Keep functions signatures in decorators (#9786)

2f31b3060

2020-07-08

Get Airflow configs with sensitive data from Secret Backends (#9645)

07b81029e

2020-07-08

Allow AWSAthenaHook to get more than 1000/first page of results (#6075)

564192c16

2020-07-08

Add AWS StepFunctions integrations to the aws provider (#8749)

ecce1ace7

2020-07-08

[AIRFLOW-XXXX] Remove unnecessary docstring in AWSAthenaOperator

a79e2d4c4

2020-07-06

Move provider's log task handlers to the provider package (#9604)

ee20086b8

2020-07-02

Move S3TaskHandler to the AWS provider package (#9602)

40add26d4

2020-06-29

Remove almost all references to airflow.contrib (#9559)

c858babdd

2020-06-26

Remove kwargs from Super calls in AWS Secrets Backends (#9523)

87fdbd070

2020-06-25

Use literal syntax instead of function calls to create data structure (#9516)

c7a454aa3

2020-06-22

Add AWS ECS system test (#8888)

df8efd04f

2020-06-21

Enable & Fix "Docstring Content Issues" PyDocStyle Check (#9460)

e13a14c87

2020-06-21

Enable & Fix Whitespace related PyDocStyle Checks (#9458)

d0e7db402

2020-06-19

Fixed release number for fresh release (#9408)

12af6a080

2020-06-19

Final cleanup for 2020.6.23rc1 release preparation (#9404)

992a18c84

2020-06-19

Move MySqlToS3Operator to transfers (#9400)

a60f589aa

2020-06-19

Add MySqlToS3Operator (#9054)

c7e5bce57

2020-06-19

Prepare backport release candidate for 2020.6.23rc1 (#9370)

40bf8f28f

2020-06-18

Detect automatically the lack of reference to the guide in the operator descriptions (#9290)

f6bd817a3

2020-06-16

Introduce 'transfers' packages (#9320)

58a8ec0e4

2020-06-16

AWSBatchOperator <> ClientHook relation changed to composition (#9306)

a80cd25e8

2020-06-15

Close/Flush byte stream in s3 hook load_string and load_bytes (#9211)

ffb857403

2020-06-14

Decrypt secrets from SystemsManagerParameterStoreBackend (#9214)

a69b031f2

2020-06-10

Add S3ToRedshift example dag and system test (#8877)

17adcea83

2020-06-02

Fix handling of subprocess error handling in s3_file_transform and gcs (#9106)

357e11e0c

2020-05-29

Add Delete/Create S3 bucket operators (#8895)

1ed171bfb

2020-05-28

Add script_args for S3FileTransformOperator (#9019)

0b0e4f7a4

2020-05-26

Preparing for RC3 relase of backports (#9026)

00642a46d

2020-05-26

Fixed name of 20 remaining wrongly named operators. (#8994)

1d36b0303

2020-05-23

Fix references in docs (#8984)

f946f96da

2020-05-23

Old json boto compat removed from dynamodb_to_s3 operator (#8987)

375d1ca22

2020-05-19

Release candidate 2 for backport packages 2020.05.20 (#8898)

12c5e5d8a

2020-05-17

Prepare release candidate for backport packages (#8891)

f3521fb0e

2020-05-16

Regenerate readme files for backport package release (#8886)

f4edd90a9

2020-05-16

Speed up TestAwsLambdaHook by not actually running a function (#8882)

92585ca4c

2020-05-15

Added automated release notes generation for backport operators (#8807)

85bbab27d

2020-05-15

Add EMR operators howto docs (#8863)

e61b9bb9b

2020-05-13

Add AWS EMR System tests (#8618)

ed3f5131a

2020-05-13

Correctly pass sleep time from AWSAthenaOperator down to the hook. (#8845)

7236862a1

2020-05-12

[AIRFLOW-2310] Enable AWS Glue Job Integration (#6007)

d590e5e76

2020-05-11

Add option to propagate tags in ECSOperator (#8811)

0c3db84c3

2020-05-11

[AIRFLOW-7068] Create EC2 Hook, Operator and Sensor (#7731)

cbebed2b4

2020-05-10

Allow passing backend_kwargs to AWS SSM client (#8802)

c7788a689

2020-05-10

Add imap_attachment_to_s3 example dag and system test (#8669)

ff5b70149

2020-05-07

Add google_api_to_s3_transfer example dags and system tests (#8581)

4421f011e

2020-05-01

Improve template capabilities of EMR job and step operators (#8572)

379a884d6

2020-04-28

fix: aws hook should work without conn id (#8534)

74bc316c5

2020-04-27

[AIRFLOW-4438] Add Gzip compression to S3_hook (#8571)

7ea66a1a9

2020-04-26

Add example DAG for ECSOperator (#8452)

b6434dedf

2020-04-24

[AIRFLOW-7111] Add generate_presigned_url method to S3Hook (#8441)

becedd5af

2020-04-19

Remove unrelated EC2 references in ECSOperator (#8451)

ab1290cb0

2020-04-13

Make launch_type parameter optional (#8248)

87969a350

2020-04-09

[AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170)

b46d6c060

2020-04-08

Add support for AWS Secrets Manager as Secrets Backend (#8186)

68d1714f2

2020-04-04

[AIRFLOW-6822] AWS hooks should cache boto3 client (#7541)

8a0240257

2020-03-31

Rename CloudBaseHook to GoogleBaseHook and move it to google.common (#8011)

7239d9a82

2020-03-28

Get Airflow Variables from AWS Systems Manager Parameter Store (#7945)

eb4af4f94

2020-03-28

Make BaseSecretsBackend.build_path generic (#7948)

438da7241

2020-03-28

[AIRFLOW-5825] SageMakerEndpointOperator is not idempotent (#7891)

686d7d50b

2020-03-25

Standardize SecretBackend class names (#7846)

eef87b995

2020-03-23

[AIRFLOW-7105] Unify Secrets Backend method interfaces (#7830)

5648dfbc3

2020-03-23

Add missing call to Super class in 'amazon', 'cloudant & 'databricks' providers (#7827)

a36002412

2020-03-19

[AIRFLOW-5705] Make AwsSsmSecretsBackend consistent with VaultBackend (#7753)

2a54512d7

2020-03-17

[AIRFLOW-5705] Fix bugs in AWS SSM Secrets Backend (#7745)

a8b5fc74d

2020-03-16

[AIRFLOW-4175] S3Hook load_file should support ACL policy paramete (#7733)

e31e9ddd2

2020-03-14

[AIRFLOW-5705] Add secrets backend and support for AWS SSM (#6376)

3bb60afc7

2020-03-13

[AIRFLOW-6975] Base AWSHook AssumeRoleWithSAML (#7619)

c0c5f11ad

2020-03-12

[AIRFLOW-6884] Make SageMakerTrainingOperator idempotent (#7598)

b7cdda1c6

2020-03-10

[AIRFLOW-4438] Add Gzip compression to S3_hook (#7680)

42eef3821

2020-03-07

[AIRFLOW-6877] Add cross-provider dependencies as extras (#7506)

9a94ab246

2020-03-01

[AIRFLOW-6962] Fix compeleted to completed (#7600)

1b38f6d9b

2020-02-29

[AIRFLOW-5908] Add download_file to S3 Hook (#6577)

3ea3e1a2b

2020-02-26

[AIRFLOW-6824] EMRAddStepsOperator problem with multi-step XCom (#7443)

6eaa7e3b1

2020-02-25

[AIRFLOW-5924] Automatically unify bucket name and key in S3Hook (#6574)

3320e432a

2020-02-24

[AIRFLOW-6817] Lazy-load 'airflow.DAG' to keep user-facing API untouched (#7517)

7d0e7122d

2020-02-24

[AIRFLOW-6830] Add Subject/MessageAttributes to SNS hook and operator (#7451)

4d03e33c1

2020-02-22

[AIRFLOW-6817] remove imports from 'airflow/__init__.py', replaced implicit imports with explicit imports, added entry to 'UPDATING.MD' - squashed/rebased (#7456)

47a922b86

2020-02-21

[AIRFLOW-6854] Fix missing typing_extensions on python 3.8 (#7474)

9cbd7de6d

2020-02-18

[AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412)

58c3542ed

2020-02-12

[AIRFLOW-5231] Fix S3Hook.delete_objects method (#7375)

b7aa778b3

2020-02-10

[AIRFLOW-6767] Correct name for default Athena workgroup (#7394)

9282185e6

2020-02-09

[AIRFLOW-6761] Fix WorkGroup param in AWSAthenaHook (#7386)

94fccca97

2020-02-04

[AIRFLOW-XXXX] Add pre-commit check for utf-8 file encoding (#7347)

f3ad5cf61

2020-02-03

[AIRFLOW-4681] Make sensors module pylint compatible (#7309)

88e40c714

2020-02-03

[AIRFLOW-6716] Fix AWS Datasync Example DAG (#7339)

a311d3d82

2020-02-03

[AIRFLOW-6718] Fix more occurrences of utils.dates.days_ago (#7341)

cb766b05b

2020-02-03

[AIRFLOW-XXXX] Fix Static Checks on CI (#7342)

97a429f9d

2020-02-02

[AIRFLOW-6714] Remove magic comments about UTF-8 (#7338)

7527eddc5

2020-02-02

[AIRFLOW-4364] Make all code in airflow/providers/amazon pylint compatible (#7336)

cf141506a

2020-02-02

[AIRFLOW-6708] Set unique logger names (#7330)

63aa3db88

2020-02-02

[AIRFLOW-6258] Add CloudFormation operators to AWS providers (#6824)

af4157fde

2020-02-02

[AIRFLOW-6672] AWS DataSync - better logging of error message (#7288)

373c6aa4a

2020-01-30

[AIRFLOW-6682] Move GCP classes to providers package (#7295)

83c037873

2020-01-30

[AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287)

1988a97e8

2020-01-28

[AIRFLOW-6659] Move AWS Transfer operators to providers package (#7274)

ab10443e9

2020-01-28

[AIRFLOW-6424] Added a operator to modify EMR cluster (#7213)

40246132a

2020-01-28

[AIRFLOW-6654] AWS DataSync - bugfix when creating locations (#7270)

82c0e5aff

2020-01-28

[AIRFLOW-6655] Move AWS classes to providers (#7271)

599e4791c

2020-01-18

[AIRFLOW-6541] Use EmrJobFlowSensor for other states (#7146)

c319e81ca

2020-01-17

[AIRFLOW-6572] Move AWS classes to providers.amazon.aws package (#7178)

941a07057

2020-01-15

[AIRFLOW-6570] Add dag tag for all example dag (#7176)

78d8fe694

2020-01-08

[AIRFLOW-6245] Add custom waiters for AWS batch jobs (#6811)

e0b022725

2019-12-28

[AIRFLOW-6319] Add support for AWS Athena workgroups (#6871)

57da45685

2019-12-24

[AIRFLOW-6333] Bump Pylint to 2.4.4 & fix/disable new checks (#6888)

cf647c27e

2019-12-18

[AIRFLOW-6038] AWS DataSync reworked (#6773)

7502cad28

2019-12-17

[AIRFLOW-6206] Move and rename AWS batch operator [AIP-21] (#6764)

c4c635df6

2019-12-17

[AIRFLOW-6083] Adding ability to pass custom configuration to lambda client. (#6678)

4fb498f87

2019-12-09

[AIRFLOW-6072] aws_hook: Outbound http proxy setting and other enhancements (#6686)

a1e2f8635

2019-11-20

[AIRFLOW-6021] Replace list literal with list constructor (#6617)

baae14084

2019-11-19

[AIRFLOW-5781] AIP-21 Migrate AWS Kinesis to /providers/amazon/aws (#6588)

504cfbac1

2019-11-18

[AIRFLOW-5783] AIP-21 Move aws redshift into providers structure (#6539)

992f0e3ac

2019-11-12

AIRFLOW-5824: AWS DataSync Hook and Operators added (#6512)

c015eb2f6

2019-11-10

[AIRFLOW-5786] Migrate AWS SNS to /providers/amazon/aws (#6502)

3d76fb4bf

2019-11-09

[AIRFLOW-5782] Migrate AWS Lambda to /providers/amazon/aws [AIP-21] (#6518)

Was this entry helpful?