Package apache-airflow-providers-amazon

Amazon integration (including Amazon Web Services (AWS)).

This is detailed commit list of changes for versions provider package: amazon. For high-level changelog, see package information including changelog.

5.1.0

Latest change: 2022-08-31

Commit

Committed

Subject

6c57acc654

2022-08-31

Additional mask aws credentials (#26014)

6d703dd9e1

2022-08-31

Fix display aws connection info (#26025)

8acdc2a834

2022-08-30

Replace SQL with Common SQL in pre commit (#26058)

1d06374194

2022-08-30

Hook into Mypy to get rid of those cast() (#26023)

1ed014647e

2022-08-29

Add 'output' property to MappedOperator (#25604)

dbfa6487b8

2022-08-27

Fix 'EcsBaseOperator' and 'EcsBaseSensor' arguments (#25989)

c9c89e5c3b

2022-08-27

Add RedshiftDeleteClusterSnapshotOperator (#25975)

695e1a53f8

2022-08-27

Raise an error on create bucket if use regional endpoint for us-east-1 and region not set (#25945)

b75797e809

2022-08-27

Fix EMR serverless system test (#25969)

810f3847c2

2022-08-27

Update AWS system tests to use SystemTestContextBuilder (#25748)

626a54904a

2022-08-26

Convert Quicksight Sample DAG to System Test (#25696)

994f18872a

2022-08-25

Add redshift create cluster snapshot operator (#25857)

1a1f352479

2022-08-23

Add Airflow specific warning classes (#25799)

6b7a343b25

2022-08-22

Implement 'EmrEksCreateClusterOperator' (#25816)

e1ace8d018

2022-08-21

Fix RDS system test (#25839)

f1e0a48500

2022-08-19

Avoid circular import problems when instantiating AWS SM backend (#25810)

92fce4fe87

2022-08-19

Improve error handling/messaging around bucket exist check (#25805)

ca9229b6fe

2022-08-18

Add common-sql lower bound for common-sql (#25789)

b9b8841ef3

2022-08-16

Allow AWS Secrets Backends use AWS Connection capabilities (#25628)

762588dcf4

2022-08-15

fix bug construction of Connection object in version 5.0.0rc3 (#25716)

1b412c9cbe

2022-08-10

Consolidate to one 'schedule' param (#25410)

5.0.0

Latest change: 2022-08-10

Commit

Committed

Subject

5923788143

2022-08-10

Fix CHANGELOG for common.sql provider and add amazon commit (#25636)

358593c6b6

2022-08-10

Enable multiple query execution in RedshiftDataOperator (#25619)

e5ac6c7cfb

2022-08-10

Prepare docs for new providers release (August 2022) (#25618)

8a1b7d43e0

2022-08-10

Refactor monolithic ECS Operator into Operators, Sensors, and a Hook (#25413)

85137f3763

2022-08-09

Remove deprecated modules from Amazon provider package (#25609)

a0212a3593

2022-08-08

refactor: Deprecate parameter 'host' as an extra attribute for the connection. Depreciation is happening in favor of 'endpoint_url' in extra. (#25494)

ae7bf47410

2022-08-07

Avoid requirement that AWS Secret Manager JSON values be urlencoded. (#25432)

65ac62867e

2022-08-07

Get boto3.session.Session by appropriate method (#25569)

33fbe75dd5

2022-08-06

System test for EMR Serverless  (#25559)

029e3ae96f

2022-08-05

Remove deprecated modules (#25543)

d4f560b98e

2022-08-05

Fix S3Hook transfer config arguments validation (#25544)

8df84e99b7

2022-08-05

Add EMR Serverless Operators and Hooks (#25324)

4193558e80

2022-08-05

Resolve Amazon Hook's 'region_name' and 'config' in wrapper (#25336)

171aaf017a

2022-08-04

Hide unused fields for Amazon Web Services connection (#25416)

cd14f3f65a

2022-08-03

Convert Local to S3 example DAG to System Test (AIP-47) (#25345)

007b1920dd

2022-08-02

Enable Auto-incrementing Transform job name in SageMakerTransformOperator (#25263)

c6d3b48d5d

2022-07-28

Convert ECS Fargate Sample DAG to System Test (#25316)

432977be0c

2022-07-26

Resolve and validate AWS Connection parameters in wrapper (#25256)

ceb1658565

2022-07-22

Fix BatchOperator links on wait_for_completion = True (#25228)

df00436569

2022-07-22

Unify DbApiHook.run() method with the methods which override it (#23971)

d66e427c4d

2022-07-22

Sagemaker System Tests - Part 3 of 3 - example_sagemaker_endpoint.py (AIP-47) (#25134)

f6bda38e20

2022-07-21

Convert RDS Export Sample DAG to System Test (AIP-47) (#25205)

47b72056c4

2022-07-21

SQSPublishOperator should allow sending messages to a FIFO Queue (#25171)

6d41067cf7

2022-07-19

Standardize AwsLambda (#25100)

c6d9bccdb6

2022-07-19

AIP-47 - Migrate redshift DAGs to new design #22438 (#24239)

5a77c46bf0

2022-07-19

Glue Job Driver logging (#25142)

c48c185627

2022-07-18

Convert Glue Sample DAG to System Test (#25136)

693fe60de4

2022-07-18

Makes changes to SqlToS3Operator method _fix_int_dtypes (#25083)

b7f51b9156

2022-07-18

Convert the batch sample dag to system tests (AIP-47) (#24448)

e32e9c5880

2022-07-18

Bump typing-extensions and mypy for ParamSpec (#25088)

77f51dcf72

2022-07-16

Migrate datasync sample dag to system tests (AIP-47) (#24354)

d872edacfe

2022-07-16

Sagemaker System Tests - Part 2 of 3 - example_sagemaker.py (#25079)

f611b1feff

2022-07-15

Migrate lambda sample dag to system test (AIP-47) (#24355)

543161a1af

2022-07-15

SageMaker system tests - Part 1 of 3 - Prep Work (AIP-47) (#25078)

4.1.0

Latest change: 2022-07-13

Commit

Committed

Subject

d2459a241b

2022-07-13

Add documentation for July 2022 Provider's release (#25030)

109acc75c4

2022-07-08

Convert RDS Event and Snapshot Sample DAGs to System Tests (#24932)

60c2a3bf82

2022-07-08

Refactor and fix AWS secret manager invalid exception (#24898)

c1526a2888

2022-07-07

Convert Step Functions Example DAG to System Test (AIP-47) (#24643)

46bbfdade0

2022-07-07

Move all SQL classes to common-sql provider (#24836)

c61f86dde5

2022-07-05

Update AWS Connection docs and deprecate some extras (#24670)

210549c658

2022-07-04

Add test_connection method to AWS hook (#24662)

e2fd41f7b1

2022-07-04

Remove 'xcom_push' flag from providers (#24823)

46ac083f7e

2022-07-01

Align Black and blacken-docs configs (#24785)

49925be664

2022-07-01

Restore Optional value of script_location (#24754)

0de31bd73a

2022-06-29

Move provider dependencies to inside provider folders (#24672)

45b11d4ed1

2022-06-29

Use our yaml util in all providers (#24720)

bf727525e1

2022-06-28

Add AWS operators to create and delete RDS Database (#24099)

510a6bab45

2022-06-28

Remove 'hook-class-names' from provider.yaml (#24702)

9b4a053bc6

2022-06-28

Add batch option to 'SqsSensor' (#24554)

9c59831ee7

2022-06-21

Update providers to use functools compat for ''cached_property'' (#24582)

e477f4ba6c

2022-06-21

Amazon appflow (#24057)

7293e31f1c

2022-06-20

Make extra_args in S3Hook immutable between calls (#24527)

f48112ccff

2022-06-20

Convert SQS Sample DAG to System Test (#24513)

796e0a0b52

2022-06-19

fix: RedshiftDataHook and RdsHook not use cached connection (#24387)

cfbcd31b69

2022-06-14

Convert Cloudformation Sample DAG to System Test (#24447)

7d8a17b210

2022-06-14

Add AWS Batch & AWS CloudWatch Extra Links (#24406)

08b675cf66

2022-06-13

Fix links to sources for examples (#24386)

a1e417c4fe

2022-06-12

Convert SNS Sample DAG to System Test (#24384)

19dd9f5873

2022-06-12

Refactoring EmrClusterLink and add for other AWS EMR Operators (#24294)

7fed7f31c3

2022-06-11

Fix S3KeySensor. See #24321 (#24378)

99d9833631

2022-06-10

Fix: 'emr_conn_id' should be optional in 'EmrCreateJobFlowOperator' (#24306)

4.0.0

Latest change: 2022-06-09

Commit

Committed

Subject

dcdcf3a2b8

2022-06-09

Update release notes for RC2 release of Providers for May 2022 (#24307)

dc9c083a4b

2022-06-08

fix: patches #24215. Won't raise KeyError when 'create_job_kwargs' contains the 'Command' key. (#24308)

717a7588bc

2022-06-07

Update package description to remove double min-airflow specification (#24292)

b1ad017cee

2022-06-07

pydocstyle D202 added (#24221)

aeabe994b3

2022-06-07

Prepare docs for May 2022 provider's release (#24231)

b88ce95188

2022-06-07

Update doc and sample dag for EMR Containers (#24087)

c23826915d

2022-06-07

Apply per-run log templates to log handlers (#24153)

41898d8922

2022-06-06

Refactor GlueJobHook get_or_create_glue_job method. (#24215)

027b707d21

2022-06-05

Add explanatory note for contributors about updating Changelog (#24229)

daa138c8eb

2022-06-04

fix: StepFunctionHook ignores explicit set 'region_name' (#23976)

5b32966c35

2022-06-03

Remove old Athena Sample DAG (#24170)

595981c8ad

2022-05-31

Light Refactor and Clean-up AWS Provider (#23907)

94f2ce9342

2022-05-30

Add partition related methods to GlueCatalogHook: (#23857)

92ddcf4ac6

2022-05-27

Introduce 'flake8-implicit-str-concat' plugin to static checks (#23873)

47fc253ea4

2022-05-24

Move string arg evals to 'execute()' in 'EksCreateClusterOperator' (#23877)

ec6761a5c0

2022-05-23

Clean up f-strings in logging calls (#23597)

5d2296becb

2022-05-22

Fix Amazon EKS example DAG raises warning during Imports (#23849)

e54ca47262

2022-05-22

Add support for associating  custom tags to job runs submitted via EmrContainerOperator (#23769)

69f444f87a

2022-05-22

Add number of node params only for single-node cluster in RedshiftCreateClusterOperator (#23839)

509b277dce

2022-05-22

Update sample dag and doc for RDS (#23651)

4c9f756035

2022-05-20

Reformat the whole AWS documentation (#23810)

fb3b980b5d

2022-05-19

Update the DMS Sample DAG and Docs (#23681)

64d0d9cd92

2022-05-17

Add AWS project structure tests (re: AIP-47) (#23630)

ca25436108

2022-05-16

Add doc and sample dag for GCSToS3Operator (#23730)

1a8f1ee276

2022-05-12

Update doc and sample dag for Quicksight (#23653)

094e50eb43

2022-05-12

Replace "absolute()" with "resolve()" in pathlib objects (#23675)

3.4.0

Latest change: 2022-05-12

Commit

Committed

Subject

75c60923e0

2022-05-12

Prepare provider documentation 2022.05.11 (#23631)

3ed895bb7b

2022-05-11

Add 'RedshiftDeleteClusterOperator' support (#23563)

5c149c341e

2022-05-10

Add Quicksight create ingestion Hook and Operator (#21863)

d21e49dfda

2022-05-10

Add sample dag and doc for S3ListPrefixesOperator (#23448)

7354d2eac9

2022-05-09

Add sample dag and doc for S3ListOperator (#23449)

389676bb0d

2022-05-09

Add doc and sample dag for EC2 (#23547)

428a439953

2022-05-09

Clean up in-line f-string concatenation (#23591)

ec4dcce338

2022-05-09

Update sample dag and doc for Datasync (#23511)

5d1e6ff19a

2022-05-09

Add default 'aws_conn_id' to SageMaker Operators #21808 (#23515)

c3386c5fcf

2022-05-09

Fix conn close error on retrieving log events (#23470)

ad863ce510

2022-05-08

Amazon Sagemaker Sample DAG and docs update (#23256)

27a80511ec

2022-05-07

Fix LocalFilesystemToS3Operator and S3CreateObjectOperator to support full s3:// style keys (#23180)

46af5baba8

2022-05-07

Update the Athena Sample DAG and Docs (#23428)

6065d1203e

2022-05-06

Update docs Amazon Glacier Docs (#23372)

7f40fa0130

2022-05-04

Add doc and example dag for Amazon SQS Operators (#23312)

2d109401b3

2022-05-04

Bump pre-commit hook versions (#22887)

d6141c6594

2022-05-01

Fix attempting to reattach in 'ECSOperator' (#23370)

fa0d93418b

2022-04-30

Allow back script_location in Glue to be None (#23357)

9021c2b97d

2022-04-26

Fix doc build failure on main (#23240)

754e293c54

2022-04-26

Add RedshiftCreateClusterOperator

ff85c12f4a

2022-04-26

Fix "Chain not supported for different length Iterable"

444794446d

2022-04-26

Add sample dag and doc for S3KeysUnchangedSensor

692a089943

2022-04-25

Add doc and sample dag for S3FileTransformOperator

8cfb2be989

2022-04-25

Add doc and example dag for AWS Step Functions Operators

d91b6cd40f

2022-04-23

'S3Hook': fix 'load_bytes' docstring (#23182)

8b6b0848a3

2022-04-23

Use new Breese for building, pulling and verifying the images. (#23104)

9e1ac6e425

2022-04-20

Add 'S3CreateObjectOperator' (#22758)

ddb5d9b4a2

2022-04-14

Add doc and sample dag for S3CopyObjectOperator and S3DeleteObjectsOperator (#22959)

dffb0d27f2

2022-04-12

Deprecate 'S3PrefixSensor' and 'S3KeySizeSensor' in favor of 'S3KeySensor' (#22737)

6933022e94

2022-04-10

Fix new MyPy errors in main (#22884)

3.3.0

Latest change: 2022-04-07

Commit

Committed

Subject

56ab82ed7a

2022-04-07

Prepare mid-April provider documentation. (#22819)

de84eaf1b0

2022-04-06

Pass custom headers through in SES email backend (#22667)

e7650b85a3

2022-03-31

Add doc and sample dag for SqlToS3Operator (#22603)

898d31e9c2

2022-03-31

Adds HiveToDynamoDB Transfer Sample DAG and Docs (#22517)

616a5dd4d7

2022-03-31

Add doc and sample dag for MongoToS3Operator (#22575)

55ee62e28a

2022-03-31

Add doc for LocalFilesystemToS3Operator (#22574)

02526b3f64

2022-03-27

Add doc and example dag for AWS CloudFormation Operators (#22533)

df473d7e89

2022-03-27

GoogleApiToS3Operator: update sample dag and doc (#22507)

d91b8334f0

2022-03-27

SalesforceToS3Operator: update sample dag and doc (#22489)

8ade99f97d

2022-03-27

Add doc and sample dag for S3ToFTPOperator and FTPToS3Operator (#22534)

7ab45d41d6

2022-03-24

Update secrets backends to use get_conn_value instead of get_conn_uri (#22348)

3.2.0

Latest change: 2022-03-22

Commit

Committed

Subject

d7dbfb7e26

2022-03-22

Add documentation for bugfix release of Providers (#22383)

4de9d6622c

2022-03-22

ImapAttachmentToS3Operator: fix it, update sample dag and update doc (#22351)

e972b6a48d

2022-03-21

Add docs and example dag for AWS Glue (#22295)

dd0cbaad3f

2022-03-21

Update doc and sample dag for S3ToSFTPOperator and SFTPToS3Operator (#22313)

5eb6335742

2022-03-19

Update sample dag and doc for S3CreateBucketOperator, S3PutBucketTaggingOperator, S3GetBucketTaggingOperator, S3DeleteBucketTaggingOperator, S3DeleteBucketOperator (#22312)

926f6d1894

2022-03-15

Add arguments to filter list: start_after_key, from_datetime, to_datetime, object_filter callable (#22231)

3.1.1

Latest change: 2022-03-14

Commit

Committed

Subject

16adc035b1

2022-03-14

Add documentation for Classifier release for March 2022 (#22226)

46c61ed3e9

2022-03-14

EMR Sample DAG and Docs Update (#22189)

c1ab8e2d7b

2022-03-14

Protect against accidental misuse of XCom.get_value() (#22244)

4f6d24f865

2022-03-14

use different logger to avoid duplicate log entry (#22256)

6f8f535619

2022-03-14

Add sample dags and update doc for RedshiftClusterSensor, RedshiftPauseClusterOperator and RedshiftResumeClusterOperator (#22128)

a840561e1f

2022-03-13

AWS RDS integration fixes (#22125)

d08284ed25

2022-03-11

`` Add map_index to XCom model and interface (#22112)``

46a120dc5f

2022-03-11

Fix RedshiftDataOperator and update doc (#22157)

e63f6e36d1

2022-03-11

additional information in the ECSOperator around support of launch_type=EXTERNAL (#22093)

16ad03cae5

2022-03-11

Bugfix for retrying on provision failuers(#22137)

bd809bc83a

2022-03-09

If uploading task logs to S3 fails, retry once (#21981)

45162565db

2022-03-08

EMR on EKS Sample DAG and Docs Update (#22095)

c7286e5306

2022-03-08

Bug-fix GCSToS3Operator (#22071)

184a46fc93

2022-03-08

refactors polling logic for athena queries (#21488)

a150ee0bc1

2022-03-08

Add template fields to DynamoDBToS3Operator (#22080)

c8d49f63ca

2022-03-08

fixes query status polling logic (#21423)

374354dda7

2022-03-08

Dynamo to S3 Sample DAG and Docs (#21920)

c1faaf3745

2022-03-07

Add sample dag and doc for RedshiftToS3Operator (#22060)

f5b96315fe

2022-03-07

Add documentation for Feb Providers release (#22056)

0209a5c3f0

2022-03-07

Add docs and sample dags for AWS Batch (#22010)

01a1a263fd

2022-03-07

retry on very specific eni provision failures (#22002)

c22fb319ff

2022-03-07

Cleanup RedshiftSQLOperator documentation (#21976)

7724a5a2ec

2022-03-07

Move S3ToRedshiftOperator documentation to transfer dir (#21975)

80c52a1875

2022-03-06

Added AWS RDS sensors (#21231)

f968eba470

2022-03-06

Added AWS RDS operators (#20907)

a9b7dd6900

2022-03-06

Resolve mypy issue in athena example dag (#22020)

9ce45ff756

2022-03-04

Rename 'S3' hook name to 'Amazon S3' (#21988)

af79df69b2

2022-03-02

Add RedshiftDataHook (#19137)

3f9295a4f4

2022-03-02

Update ECS sample DAG and Docs to new standards (#21828)

08575ddd8a

2022-03-01

Change BaseOperatorLink interface to take a ti_key, not a datetime (#21798)

33edeb2cb1

2022-03-01

Feature: Add invoke lambda function operator (#21686)

3218cca14b

2022-03-01

Fix the Type Hints in ''RedshiftSQLOperator'' (#21885)

c819b4f8d0

2022-02-28

Configurable AWS Session Factory (#21778)

5276ef8ad9

2022-02-28

Add JSON output on SqlToS3Operator (#21779)

cb24ee9414

2022-02-27

Add SageMakerDeleteModelOperator (#21673)

f0b6398dd6

2022-02-26

Bug Fix - S3DeleteObjectsOperator will try and delete all keys (#21458)

037865970b

2022-02-26

Added Hook for Amazon RDS. Added 'boto3_stub' library for autocomplete. (#20642)

dec05fb6b2

2022-02-19

Update EKS sample DAGs and docs (#21523)

b28f4c578c

2022-02-19

Fix Amazon SES emailer signature (#21681)

fc44836504

2022-02-15

S3KeySensor to use S3Hook url parser (#21500)

69bf74f9a6

2022-02-15

Fix EcsOperatorError, so it can be loaded from a picklefile (#21441)

21a90c5b7e

2022-02-15

Get log events after sleep to get all logs (#21574)

8e81615edb

2022-02-11

[doc] Improve s3 operator example by adding task upload_keys (#21422)

2c5f636e5c

2022-02-11

Use temporary file in GCSToS3Operator (#21295)

598e836043

2022-02-09

Added SNS example DAG and rst (#21475)

0a3ff43d41

2022-02-08

Add pre-commit check for docstring param types (#21398)

3.0.0

Latest change: 2022-02-08

Commit

Committed

Subject

d94fa37830

2022-02-08

Fixed changelog for January 2022 (delayed) provider's release (#21439)

33ca0f2654

2022-02-08

eks_hook log level fatal -> FATAL  (#21427)

8f81b9a01c

2022-02-08

Add conditional 'template_fields_renderers' check for new SQL lexers (#21403)

d1150182cb

2022-02-06

Bug fix in AWS glue operator related to num_of_dpus #19787 (#21353)

0a6ea572fb

2022-02-06

Fix to check if values are integer or float and convert accordingly. (#21277)

6c3a67d4fc

2022-02-05

Add documentation for January 2021 providers release (#21257)

39e395f981

2022-02-04

Add more SQL template fields renderers (#21237)

ddb5246bd1

2022-02-03

Refactor operator links to not create ad hoc TaskInstances (#21285)

5185d6ab26

2022-01-29

Alleviate import warning for 'EmrClusterLink' in deprecated AWS module (#21195)

7ae156fd29

2022-01-29

[SQSSensor] Add opt-in to disable auto-delete messages (#21159)

ff4939f23c

2022-01-25

Remove ':type' directives from 'SqlToS3Operator' (#21079)

bad070f7f4

2022-01-24

Create a generic operator SqlToS3Operator and deprecate the MySqlToS3Operator.  (#20807)

c5ffe0c2da

2022-01-23

fix: cloudwatch logs fetch logic (#20814)

27b77d37a9

2022-01-21

Fix all Amazon Provider MyPy errors (#20935)

73c0d241d8

2022-01-21

Remove a few stray ':type's in docs (#21014)

a59a2be571

2022-01-21

Move some base_aws logging from info to debug level (#20858)

602abe8394

2022-01-20

Remove ':type' lines now sphinx-autoapi supports typehints (#20951)

34efb42ebe

2022-01-20

Rename params to cloudformation_parameter in CloudFormation operators. (#20989)

730db3fb77

2022-01-18

Remove all "fake" stub files (#20936)

307d356519

2022-01-14

AWS: Adds support for optional kwargs in the EKS Operators (#20819)

b15027410b

2022-01-14

Fix MyPy issues in AWS Sensors (#20863)

ce06e6b917

2022-01-13

AwsAthenaOperator: do not generate ''client_request_token'' if not provided (#20854)

f8fd0f7b4c

2022-01-13

Explain stub files are introduced for Mypy errors in examples (#20827)

341b461e4f

2022-01-09

Fix mypy in providers/aws/hooks (#20353)

6776586904

2022-01-09

Standardize AWS SQS classes names (#20732)

88e3f2ae5e

2022-01-08

Rename amazon EMR hook name (#20767)

0ebd55e0f8

2022-01-06

Standardize AWS Batch naming (#20369)

88ea157507

2022-01-06

Standardize AWS Redshift naming (#20374)

51dc4fd808

2022-01-06

Fix MyPy issues in AWS Sensors (#20717)

dd12cfcfe9

2022-01-06

Fix MyPy in Amazon provider for Sagemaker operator (#20715)

cf5c31137d

2022-01-06

Fix MyPy errors for Amazon DMS in hooks and operator (#20710)

6af2137ef0

2022-01-06

Fix MyPy issues in ''airflow/providers/amazon/aws/transfers'' (#20708)

1fc0fa5ea9

2022-01-06

Standardize DynamoDB naming (#20360)

9c0ba1b6ab

2022-01-04

Standardize AWS ECS naming (#20332)

2.6.0

Latest change: 2021-12-31

Commit

Committed

Subject

f77417eb0d

2021-12-31

Fix K8S changelog to be PyPI-compatible (#20614)

97496ba2b4

2021-12-31

Update documentation for provider December 2021 release (#20523)

83f8e178ba

2021-12-31

Even more typing in operators (template_fields/ext) (#20608)

746ee587da

2021-12-31

Delete pods by default in KubernetesPodOperator (#20575)

b164124bfe

2021-12-31

Fix mypy errors in amazon aws transfer (#20590)

d56e7b56bb

2021-12-30

Fix template_fields type to have MyPy friendly Sequence type (#20571)

6d25d63679

2021-12-30

Fixe static checks on few other not sorted stub files (#20572)

a3caea0903

2021-12-30

Fix mypy aws example dags (#20497)

a0821235fb

2021-12-30

Use typed Context EVERYWHERE (#20565)

051fac0776

2021-12-29

Add support to replace S3 file on MySqlToS3Operator (#20506)

2ab2ae8849

2021-12-22

Fix backwards compatibility issue in AWS provider's _get_credentials (#20463)

d557965bab

2021-12-21

Organize Sagemaker classes in Amazon provider (#20370)

1ce71f823f

2021-12-21

move emr_container hook (#20375)

4dd751d2fc

2021-12-20

Standardize AWS Athena naming (#20305)

ecbe160797

2021-12-20

Standardize AWS EKS naming (#20354)

463e3b2b25

2021-12-19

Fix mypy errors in aws/transfers (#20403)

404cd2eb69

2021-12-19

Fix mypy errors in aws/sensors (#20402)

1f4710f16a

2021-12-19

Fix mypy errors in providers/amazon/aws/operators (#20401)

1baa648e2a

2021-12-19

Standardize AWS Glue naming (#20372)

5769defb2a

2021-12-18

Add aws_conn_id to DynamoDBToS3Operator (#20363)

cef498efe9

2021-12-18

Standardize Amazon SES naming (#20367)

2a3db4d385

2021-12-17

Standardize AWS CloudFormation naming (#20357)

bb82cc0fbb

2021-12-17

Fix deprecation messages after splitting redshift modules (#20366)

ca492e1681

2021-12-17

Standardize AWS Lambda naming (#20365)

f6a41a036d

2021-12-17

Standardize AWS Kinesis/Firehose naming (#20362)

3d354084ef

2021-12-17

Standardize Amazon SNS naming (#20368)

bfcaf195a5

2021-12-16

Split redshift sql and cluster objects (#20276)

a3870611a7

2021-12-16

Organize EMR classes in Amazon provider (#20160)

206cce971d

2021-12-16

ECSOperator: fix KeyError on missing exitCode (#20264)

38fd65dcfe

2021-12-16

Rename DataSync Hook and Operator (#20328)

2fb5e1d0ec

2021-12-15

Fix cached_property MyPy declaration and related MyPy errors (#20226)

5712e2b587

2021-12-15

Deprecate passing execution_date to XCom methods (#19825)

60b72dd8f5

2021-12-14

Organize Dms classes in Amazon provider (#20156)

e77c05fa1b

2021-12-13

Add RedshiftResumeClusterOperator and RedshiftPauseClusterOperator (#19665)

a208463802

2021-12-13

Organize S3 Classes in Amazon Provider (#20167)

1d2f2d3dfe

2021-12-13

Organize Step Function classes in Amazon provider (#20158)

985bb06ba5

2021-12-09

Organize EC2 classes in Amazon provider (#20157)

0e2a0ccd30

2021-12-08

Added function in AWSAthenaHook to get s3 output query results file URI  (#20124)

6e15e3a65e

2021-12-06

Bug fix in AWS glue operator when specifying the WorkerType & NumberOfWorkers (#19787)

af28b41903

2021-12-05

Add sensor for AWS Batch (#19850) (#19885)

480c333c45

2021-12-03

Add state details to EMR container failure reason (#19579)

2539cb44b4

2021-12-01

Move to watchtower 2.0.1 (#19907)

2.5.0

Latest change: 2021-11-30

Commit

Committed

Subject

853576d901

2021-11-30

Update documentation for November 2021 provider's release (#19882)

83b51e5306

2021-11-26

Amazon provider remove deprecation, second try (#19815)

d58df468c8

2021-11-24

Revert "Adjust built-in base_aws methods to avoid Deprecation warnings (#19725)" (#19791)

4be04143a5

2021-11-24

Adjust built-in base_aws methods to avoid Deprecation warnings (#19725)

fe682ec3d3

2021-11-24

Fix duplicate changelog entries (#19759)

186513e24e

2021-11-15

Catch AccessDeniedException in AWS Secrets Manager Backend (#19324)

4c495ca94e

2021-11-15

Cleanup of start_date and default arg use for Amazon example DAGs (#19237)

eb16fd51e0

2021-11-12

Adding support for using ''client_type'' API for interacting with EC2 and support filters (#9011)

aa2cb5545f

2021-11-12

Remove remaining 'pylint: disable' comments (#19541)

9053de7718

2021-11-10

Do not check for S3 key before attempting download (#19504)

ebb7394005

2021-11-08

MySQLToS3Operator  actually allow writing parquet files to s3. (#19094)

2.4.0

Latest change: 2021-11-04

Commit

Committed

Subject

5a113f3027

2021-11-04

Add documentation for RC2 release of Amazon provider for October (#19413)

96dd70348a

2021-11-04

`` fix SagemakerProcessingOperator ThrottlingException (#19195)``

a3266ba2b9

2021-11-03

Doc: Fix typos in variable and comments (#19349)

6148ddd365

2021-11-03

Fix S3ToRedshiftOperator (#19358)

1600f1dfd7

2021-10-30

Remove duplicated entries in changelog (#19331)

d9567eb106

2021-10-29

Prepare documentation for October Provider's release (#19321)

1543dc28f4

2021-10-29

Fixing ses email backend (#18042)

3c08c025c5

2021-10-27

Move validation of templated input params to run after the context init (#19048)

f5ad26dcdd

2021-10-21

Fixup string concatenations (#19099)

86a2a19ad2

2021-10-17

More f-strings (#18855)

258451cfba

2021-10-15

MySQLToS3Operator add support for parquet format (#18755)

176165de3b

2021-10-11

Update S3PrefixSensor to support checking multiple prefixes within a bucket (#18807)

1d7cfdbcd9

2021-10-10

Remove extra postgres dependency from AWS Provider (#18844)

1df9a512c2

2021-10-08

Add RedshiftSQLHook, RedshiftSQLOperator (#18447)

22768ff61e

2021-10-08

Removed duplicated code on S3ToRedshiftOperator (#18671)

2.3.0

Latest change: 2021-10-08

Commit

Committed

Subject

a680e876b6

2021-10-08

Prepare documentation for RC2 Amazon Provider release for September (#18830)

ea8f478909

2021-10-08

Add AWS Fargate profile support (#18645)

9344c34522

2021-10-08

Enable AWS Secrets Manager backend to retrieve conns using different fields (#18764)

1a35644b5d

2021-10-08

Add emr cluster link (#18691)

e0af0b976c

2021-10-08

AwsGlueJobOperator: add wait_for_completion to Glue job run (#18814)

8e56ed234b

2021-10-07

Enable FTPToS3Operator to transfer several files (#17937)

28284a37b3

2021-10-07

Amazon Athena Example (#18785)

38c6cf9c27

2021-10-07

AwsGlueJobOperator: add run_job_kwargs to Glue job run (#16796)

72e49ad3a3

2021-10-06

Amazon SQS Example (#18760)

767a4f5207

2021-10-05

ECSOperator: airflow exception on edge case when cloudwatch log stream is not found (#18733)

760bf6e51c

2021-10-06

Adds an s3 list prefixes operator (#17145)

12763f125a

2021-10-05

Add additional dependency for postgres extra for amazon provider (#18737)

86bf2a29ba

2021-10-04

Simplify strings previously split across lines (#18679)

12133861ec

2021-10-01

Support all Unix wildcards in S3KeySensor (#18211)

840ea3efb9

2021-09-30

Update documentation for September providers release (#18613)

8a1437e55e

2021-09-29

Refresh credentials for long-running pods on EKS (#17951)

2fbd23878f

2021-09-28

Update s3_list.py (#18561)

a458fcc573

2021-09-27

Updating miscellaneous provider DAGs to use TaskFlow API where applicable (#18278)

e25eea052f

2021-09-19

Inclusive Language (#18349)

4cd190c9bc

2021-09-18

ECSOperator realtime logging (#17626)

27088c4533

2021-09-18

Add IAM Role Credentials to S3ToRedshiftTransfer and RedshiftToS3Transfer (#18156)

2d4f3cb644

2021-09-15

Adding missing 'replace' param in docstring (#18241)

81ebd78db4

2021-09-12

Added upsert method on S3ToRedshift operator (#18027)

02397761af

2021-09-12

Deprecate default pod name in EKSPodOperator (#18036)

e6cb2f7beb

2021-09-10

ECSOperator returns last logs when ECS task fails (#17209)

b8795501ea

2021-09-10

Aws secrets manager backend (#17448)

6e101317a2

2021-09-10

Simplify s3 ''unify_bucket_name_and_key'' (#17325)

3fe948a860

2021-09-08

sftp_to_s3 stream file option (#17609)

867e9305f0

2021-09-03

AwsBaseHook make 'client_type' & 'resource_type' optional params for 'get_client_type' & 'get_resource_type' (#17987)

bcd81f23af

2021-09-03

Add Spark to the EMR cluster for the job flow examples (#17563)

7c4d3173f2

2021-09-02

Delete unnecessary parameters in EKSPodOperator (#17960)

2.2.0

Latest change: 2021-08-30

Commit

Committed

Subject

0a68588479

2021-08-30

Add August 2021 Provider's documentation (#17890)

653c13ec0c

2021-08-30

Fix broken XCOM in EKSPodOperator (#17918)

42e13e1a5a

2021-08-30

Remove all deprecation warnings in providers (#17900)

890bd4310e

2021-08-28

Add an Amazon EMR on EKS provider package (#16766)

41632e03b8

2021-08-27

Fix provider.yaml errors due to exit(0) in test (#17858)

be75dcd39c

2021-08-23

Update description about the new ''connection-types'' provider meta-data

76ed2a49c6

2021-08-19

Import Hooks lazily individually in providers manager (#17682)

bee48f31f1

2021-08-19

Implemented Basic EKS Integration (#16571)

d26b862330

2021-08-19

Add optional SQL parameters in ''RedshiftToS3Operator'' (#17640)

29aab6434f

2021-08-17

Adds secrets backend/logging/auth information to provider yaml (#17625)

1632c9f519

2021-08-14

Add new LocalFilesystemToS3Operator under Amazon provider (#17168) (#17382)

e7eeaa6086

2021-08-12

Doc: Fix docstrings for ''MongoToS3Operator'' (#17588)

987575787d

2021-08-12

Add Mongo projections to hook and transfer (#17379)

77c4325fb0

2021-08-10

Fixing ParamValidationError when executing load_file in Glue hooks/operators (#16012)

d28efbfb77

2021-08-02

Improve AWS SQS Sensor (#16880) (#16904)

71088986f1

2021-08-02

make platform version as independent parameter of ECSOperator (#17281)

80fc80ace6

2021-08-02

Fixes #16972 - Slugify role session name in AWS base hook (#17210)

2.1.0

Latest change: 2021-07-26

Commit

Committed

Subject

87f408b1e7

2021-07-26

Prepares docs for Rc2 release of July providers (#17116)

569659db38

2021-07-26

Updating Amazon-AWS example DAGs to use XComArgs (#16868)

763919d415

2021-07-25

Adding custom Salesforce connection type + SalesforceToS3Operator updates (#17162)

8b100fcb42

2021-07-21

ECSOperator / pass context to self.xcom_pull as it was missing (when using reattach) (#17141)

f44d7bd9cf

2021-07-21

Made S3ToRedshiftOperator transaction safe (#17117)

32582b5bf1

2021-07-21

Adding SalesforceToS3Operator to Amazon Provider (#17094)

bb1d79cb81

2021-07-19

Fixed template_fields_renderers for Amazon provider (#17087)

8f77a54b53

2021-07-19

removing try-catch block (#17081)

cda78333b4

2021-07-18

Added docs & doc ref's for AWS transfer operators between SFTP & S3 (#16964)

d02ded65ea

2021-07-15

Fixed wrongly escaped characters in amazon's changelog (#17020)

b916b75079

2021-07-15

Prepare documentation for July release of providers. (#17015)

fc0250f1d5

2021-07-15

Allow attaching to previously launched task in ECSOperator (#16685)

d3f300fba8

2021-07-11

Fix wrong template_fields_renderers for AWS operators (#16820)

f0df184e4d

2021-07-07

Update AWS Base hook to use refreshable credentials (#16770) (#16771)

ffe8fab653

2021-07-03

Added select_query to the templated fields in RedshiftToS3Operator (#16767)

866a601b76

2021-06-28

Removes pylint from our toolchain (#16682)

0d80383bdd

2021-06-28

AWS Hook - allow IDP HTTP retry (#12639) (#16612)

3a57d9fc60

2021-06-26

Bump ''sphinxcontrib-spelling'' and minor improvements (#16675)

2543c74c19

2021-06-24

AWS DataSync cancel task on exception (#11011) (#16589)

2ab2cbf93d

2021-06-23

Update Boto3 API calls in ECSOperator (#16050)

2.0.0

Latest change: 2021-06-21

Commit

Committed

Subject

19ed074e9c

2021-06-21

Use safe get with AWS DMS describe replication tasks (#16540)

bbc627a3da

2021-06-18

Prepares documentation for rc2 release of Providers (#16501)

db10c6841b

2021-06-18

Add AWS DMS replication task operators (#15850)

1c82b4d015

2021-06-17

Fix S3ToFTPOperator (#13796)

36dc6a8100

2021-06-16

Make job name check optional in SageMakerTrainingOperator (#16327)

cbf8001d76

2021-06-16

Synchronizes updated changelog after buggfix release (#16464)

1fba5402bb

2021-06-15

More documentation update for June providers release (#16405)

9cd7930c34

2021-06-13

Update copy command for s3 to redshift (#16241)

643f3c35a6

2021-06-13

fix: AwsGlueJobOperator change order of args for load_file (#16216)

30708b5b25

2021-06-13

Add support of capacity provider strategy for ECSOperator (#15848)

9c94b72d44

2021-06-07

Updated documentation for June 2021 provider release (#16294)

9fcdf3d4de

2021-06-02

Fix S3 Select payload join (#16189)

8d16638285

2021-05-29

remove retry for now (#16150)

5fbc86f036

2021-05-27

Remove the 'not-allow-trailing-slash' rule on S3_hook (#15609)

904709d34f

2021-05-27

Check synctatic correctness for code-snippets (#16005)

476d0f6e3d

2021-05-22

Bump pyupgrade v2.13.0 to v2.18.1 (#15991)

821ea6fc18

2021-05-17

Fix spacing in ''AwsBatchWaitersHook'' docstring (#15839)

1467046058

2021-05-14

CloudwatchTaskHandler reads timestamp from Cloudwatch events (#15173)

dab10d9fae

2021-05-10

MongoToS3Operator failed when running with a single query (not aggregate pipeline) (#15680)

9c8391a13f

2021-05-10

Fix spelling (#15699)

37681bca00

2021-05-07

Auto-apply apply_default decorator (#15667)

9953a047c4

2021-05-07

Add Connection Documentation for the Hive Provider (#15704)

0f97a3970d

2021-05-04

Rename example bucket names to use INVALID BUCKET NAME by default (#15651)

db557a8c4a

2021-05-01

Docs: Replace 'airflow' to 'apache-airflow' to install extra (#15628)

1.4.0

Latest change: 2021-05-01

Commit

Committed

Subject

807ad32ce5

2021-05-01

Prepares provider release after PIP 21 compatibility (#15576)

814e471d13

2021-04-29

Update pre-commit checks (#15583)

bf2b48174a

2021-04-27

Add Connection Documentation for Providers (#15499)

4b031d39e1

2021-04-27

Make Airflow code Pylint 2.8 compatible (#15534)

657384615f

2021-04-27

Fix 'logging.exception' redundancy (#14823)

d598630cd7

2021-04-26

Fix AthenaSensor calling AthenaHook incorrectly (#15427)

71c673e427

2021-04-22

Update Docstrings of Modules with Missing Params (#15391)

a82de56b9d

2021-04-13

S3Hook.load_file should accept Path object in addition to str (#15232)

b4770725a3

2021-04-12

Add links to new modules for deprecated modules (#15316)

da780fc8b1

2021-04-12

Fixes doc for SQSSensor (#15323)

1.3.0

Latest change: 2021-04-06

Commit

Committed

Subject

042be2e4e0

2021-04-06

Updated documentation for provider packages before April release (#15236)

266384a63f

2021-04-05

Fix string concatenation using 'f-strings' (#15200)

eda538f56c

2021-04-02

AWS: Do not log info when SSM & SecretsManager secret not found (#15120)

9b76b94c94

2021-04-02

A bunch of template_fields_renderers additions (#15130)

6822665102

2021-04-01

Send region_name into parant class of AwsGlueJobHook (#14251)

5379698892

2021-03-27

Improve docstrings for various modules (#15047)

614be87b23

2021-03-26

Added retry to ECS Operator (#14263)

a7ca1b3b0b

2021-03-26

Fix Sphinx Issues with Docstrings (#14968)

0f327788b5

2021-03-24

doc: Fix typo in 'secrets_manager.py' docstring (#14943)

93982e3bb6

2021-03-22

Make script_args templated in AwsGlueJobOperator (#14925)

e172bd0e16

2021-03-22

Update docstrings to adhere to sphinx standards (#14918)

68e4c4dcb0

2021-03-20

Remove Backport Providers (#14886)

a3778127ed

2021-03-15

Add FTPToS3Operator (#13707)

b896aee8cc

2021-03-07

Cache Hook when initializing 'CloudFormationCreateStackSensor' (#14638)

e7bb17aeb8

2021-03-06

Use built-in 'cached_property' on Python 3.8 where possible (#14606)

697abf399d

2021-03-05

S3DataSource is not required (#14220)

8ced652ecf

2021-02-28

Implemented S3 Bucket Tagging (#14402)

1.2.0

Latest change: 2021-02-27

Commit

Committed

Subject

589d6dec92

2021-02-27

Prepare to release the next wave of providers: (#14487)

13854c32a3

2021-02-27

Adding support to put extra arguments for Glue Job. (#14027)

0d6cae4172

2021-02-24

Avoid using threads in S3 remote logging uplod (#14414)

ca35bd7f7f

2021-02-21

By default PIP will install all packages in .local folder (#14125)

1b14726307

2021-02-11

Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query (#14177)

9034f277ef

2021-02-10

Document configuration for email backend credentials. (#14006)

8c5594b02f

2021-02-08

includes the STS token if STS credentials are used (#11227)

cddbf9c11d

2021-02-06

Use MongoDB color for MongoToS3Operator (#14103)

10343ec29f

2021-02-05

Corrections in docs and tools after releasing provider RCs (#14082)

1.1.0

Latest change: 2021-02-04

Commit

Committed

Subject

88bdcfa0df

2021-02-04

Prepare to release a new wave of providers. (#14013)

ac2f72c98d

2021-02-01

Implement provider versioning tools (#13767)

01049ddce2

2021-01-31

Add aws ses email backend for use with EmailOperator. (#13986)

ecfdc60bb6

2021-01-29

Add bucket_name to template fileds in S3 operators (#13973)

d0ab7f6d3a

2021-01-25

Add ExasolToS3Operator (#13847)

6d55f329f9

2021-01-25

AWS Glue Crawler Integration (#13072)

f473ca7130

2021-01-24

Replace 'google_cloud_storage_conn_id' by 'gcp_conn_id' when using 'GCSHook' (#13851)

a9ac2b040b

2021-01-23

Switch to f-strings using flynt. (#13732)

3fd5ef3555

2021-01-21

Add missing logos for integrations (#13717)

29730d7200

2021-01-20

Add acl_policy to S3CopyObjectOperator (#13773)

c065d32189

2021-01-19

AllowDiskUse parameter and docs in MongotoS3Operator (#12033)

ab5fe56ac4

2021-01-16

Fix bug in GCSToS3Operator (#13718)

04d278f93f

2021-01-13

Add S3ToFTPOperator (#11747)

8d42d9ed69

2021-01-11

add xcom push for ECSOperator (#12096)

308f1d0666

2021-01-07

[AIRFLOW-3723] Add Gzip capability to mongo_to_S3 operator (#13187)

f69405fb0b

2021-01-07

Fix S3KeysUnchangedSensor so that template_fields work (#13490)

4e479e1e1b

2021-01-06

Add S3KeySizeSensor (#13049)

f7a1334abe

2021-01-02

Add 'mongo_collection' to template_fields in MongoToS3Operator (#13361)

bd74eb0ca0

2020-12-31

Allow Tags on AWS Batch Job Submission (#13396)

295d66f914

2020-12-30

Fix Grammar in PIP warning (#13380)

625576a3af

2020-12-18

Fix spelling (#13135)

6cf76d7ac0

2020-12-18

Fix typo in pip upgrade command :( (#13148)

5090fb0c89

2020-12-15

Add script to generate integrations.json (#13073)

1.0.0

Latest change: 2020-12-09

Commit

Committed

Subject

32971a1a2d

2020-12-09

Updates providers versions to 1.0.0 (#12955)

d5589673a9

2020-12-08

Move dummy_operator.py to dummy.py (#11178) (#11293)

b40dffa085

2020-12-08

Rename remaing modules to match AIP-21 (#12917)

9b39f24780

2020-12-08

Add support for dynamic connection form fields per provider (#12558)

bd90136aaf

2020-11-30

Move operator guides to provider documentation packages (#12681)

02d94349be

2020-11-29

Don't use time.time() or timezone.utcnow() for duration calculations (#12353)

de3b1e687b

2020-11-28

Move connection guides to provider documentation packages (#12653)

663259d4b5

2020-11-25

Fix AWS DataSync tests failing (#11020)

3fa51f94d7

2020-11-24

Add check for duplicates in provider.yaml files (#12578)

ed09915a02

2020-11-23

[AIRFLOW-5115] Bugfix for S3KeySensor failing to accept template_fields (#12389)

370e7d07d1

2020-11-21

Fix Python Docstring parameters (#12513)

c34ef853c8

2020-11-20

Separate out documentation building per provider  (#12444)

0080354502

2020-11-18

Update provider READMEs for 1.0.0b2 batch release (#12449)

7ca0b6f121

2020-11-18

Enable Markdownlint rule MD003/heading-style/header-style (#12427) (#12438)

ae7cb4a1e2

2020-11-17

Update wrong commit hash in backport provider changes (#12390)

6889a333cf

2020-11-15

Improvements for operators and hooks ref docs (#12366)

c94b1241a1

2020-11-13

Add extra error handling to S3 remote logging (#9908)

7825e8f590

2020-11-13

Docs installation improvements (#12304)

250436d962

2020-11-10

Fix spelling in Python files (#12230)

85a18e13d9

2020-11-09

Point at pypi project pages for cross-dependency of provider packages (#12212)

59eb5de78c

2020-11-09

Update provider READMEs for up-coming 1.0.0beta1 releases (#12206)

b2a28d1590

2020-11-09

Moves provider packages scripts to dev (#12082)

fcb6b00efe

2020-11-08

Add authentication to AWS with Google credentials (#12079)

fb6bddba0c

2020-11-07

In AWS Secrets backend, a lookup is optional (#12143)

cf9437d79f

2020-11-06

Simplify string expressions (#12123)

41bf172c1d

2020-11-04

Simplify string expressions (#12093)

4e8f9cc8d0

2020-11-03

Enable Black - Python Auto Formmatter (#9550)

8c42cf1b00

2020-11-03

Use PyUpgrade to use Python 3.6 features (#11447)

5e77a61543

2020-11-02

Docstring fix for S3DeleteBucketOperator (#12049)

8222851348

2020-10-29

Add Template Fields to RedshiftToS3Operator & S3ToRedshiftOperator (#11844)

db121f726b

2020-10-28

Add truncate table (before copy) option to S3ToRedshiftOperator (#9246)

5a439e84eb

2020-10-26

Prepare providers release 0.0.2a1 (#11855)

8afdb6ac6a

2020-10-26

Fix spellings (#11825)

872b1566a1

2020-10-25

Generated backport providers readmes/setup for 2020.10.29 (#11826)

6ce855af11

2020-10-24

Fix spelling (#11821)

3934ef2249

2020-10-24

Remove redundant builtins imports (#11809)

4c8e033c0e

2020-10-24

Fix spelling and grammar (#11814)

4830687453

2020-10-24

Use Python 3 style super classes (#11806)

0df60b7736

2020-10-23

Add reattach flag to ECSOperator (#10643)

b9d677cdd6

2020-10-22

Add type hints to  aws provider (#11531)

349b0811c3

2020-10-20

Add D200 pydocstyle check (#11688)

674368f66c

2020-10-19

Fixes MySQLToS3 float to int conversion (#10437)

0823d46a7f

2020-10-16

Add type annotations for AWS operators and hooks (#11434)

16e7129719

2020-10-13

Added support for provider packages for Airflow 2.0 (#11487)

d38a0a781e

2020-10-12

added type hints for aws cloud formation (#11470)

d305876bee

2020-10-12

Remove redundant None provided as default to dict.get() (#11448)

c3e340584b

2020-10-11

Change prefix of AwsDynamoDB hook module (#11209)

42a23d16fe

2020-10-11

Update MySQLToS3Operator's s3_bucket to template_fields (#10778)

422b61a9dd

2020-10-09

Adding ElastiCache Hook for creating, describing and deleting replication groups (#8701)

dd98b21494

2020-10-06

Add acl_policy parameter to GCSToS3Operator (#10804) (#10829)

32b3cfbcf0

2020-10-06

Strict type check for all hooks in amazon (#11250)

6d573e8abb

2020-10-03

Add s3 key to template fields for s3/redshift transfer operators (#10890)

0a0e1af800

2020-10-03

Fix Broken Markdown links in Providers README TOC (#11249)

ca4238eb4d

2020-10-02

Fixed month in backport packages to October (#11242)

5220e4c384

2020-10-02

Prepare Backport release 2020.09.07 (#11238)

00ffedb8c4

2020-09-30

Add amazon glacier to GCS transfer operator (#10947)

e3f96ce7a8

2020-09-24

Fix incorrect Usage of Optional[bool] (#11138)

f3e87c5030

2020-09-22

Add D202 pydocstyle check (#11032)

b61225a885

2020-09-21

Add D204 pydocstyle check (#11031)

2410f592a4

2020-09-19

Get Airflow configs with sensitive data from AWS Systems Manager (#11023)

2bf7b7cac7

2020-09-19

Add typing to amazon provider EMR (#10910)

9edfcb7ac4

2020-09-19

Support extra_args in S3Hook and GCSToS3Operator (#11001)

4e1f3a69db

2020-09-14

[AIRFLOW-10645] Add AWS Secrets Manager Hook (#10655)

e9add79160

2020-09-14

Fix Failing static tests on Master (#10927)

383a118d2d

2020-09-14

Add more type annotations to AWS hooks (#10671)

9549274d11

2020-09-09

Upgrade black to 20.8b1 (#10818)

2934220dc9

2020-09-08

Always return a list from S3Hook list methods (#10774)

f40ac9b151

2020-09-01

Add placement_strategy option (#9444)

e4878e6775

2020-08-31

fix type hints for s3 hook read_key method (#10653)

2ca615cffe

2020-08-29

Update Google Cloud branding (#10642)

8969b7185e

2020-08-28

Removed bad characters from AWS operator (#10590)

8349061f9c

2020-08-26

Improve Docstring for AWS Athena Hook/Operator (#10580)

fdd9b6f65b

2020-08-25

Enable Black on Providers Packages (#10543)

3696c34c28

2020-08-24

Fix typo in the word "release" (#10528)

3734876d98

2020-08-24

Implement impersonation in google operators (#10052)

ee7ca128a1

2020-08-22

Fix broken Markdown refernces in Providers README (#10483)

c6358045f9

2020-08-22

Fixes S3ToRedshift COPY query (#10436)

7c206a82a6

2020-08-22

Replace assigment with Augmented assignment (#10468)

27d08b76a2

2020-08-21

Amazon SES Hook (#10391)

dea345b05c

2020-08-17

Fix AwsGlueJobSensor to stop running after the Glue job finished (#9022)

f6734b3b85

2020-08-12

Enable Sphinx spellcheck for doc generation (#10280)

82f744b871

2020-08-11

Add type annotations to AwsGlueJobHook, RedshiftHook modules (#10286)

19bc97d0ce

2020-08-10

Revert "Add Amazon SES hook (#10004)" (#10276)

f06fe616e6

2020-08-10

Add Amazon SES hook (#10004)

0c77ea8a3c

2020-08-06

Add type annotations to S3 hook module (#10164)

24c8e4c2d6

2020-08-06

Changes to all the constructors to remove the args argument (#10163)

9667314b2f

2020-08-05

Add correct signatures for operators in amazon provider package (#10167)

000287753b

2020-08-03

Improve Typing coverage of amazon/aws/athena (#10025)

53ada6e791

2020-08-03

Add S3KeysUnchangedSensor (#9817)

aeea71274d

2020-08-02

Remove 'args' parameter from provider operator constructors (#10097)

2b8dea64e9

2020-08-01

Fix typo in Athena sensor retries (#10079)

1508c43ec9

2020-07-29

Adding new SageMaker operator for ProcessingJobs (#9594)

7d24b088cd

2020-07-25

Stop using start_date in default_args in example_dags (2) (#9985)

8b10a4b35e

2020-07-25

Stop using start_date in default_args in example_dags (#9982)

33f0cd2657

2020-07-22

apply_default keeps the function signature for mypy (#9784)

e7c87fe453

2020-07-20

Refactor AwsBaseHook._get_credentials (#9878)

2577f9334a

2020-07-16

Fix S3FileTransformOperator to support S3 Select transformation only (#8936)

52b6efe1ec

2020-07-15

Add option to delete by prefix to S3DeleteObjectsOperator (#9350)

553bb7af7c

2020-07-13

Keep functions signatures in decorators (#9786)

2f31b3060e

2020-07-08

Get Airflow configs with sensitive data from Secret Backends (#9645)

07b81029eb

2020-07-08

Allow AWSAthenaHook to get more than 1000/first page of results (#6075)

564192c162

2020-07-08

Add AWS StepFunctions integrations to the aws provider (#8749)

ecce1ace7a

2020-07-08

[AIRFLOW-XXXX] Remove unnecessary docstring in AWSAthenaOperator

a79e2d4c4a

2020-07-06

Move provider's log task handlers to the provider package (#9604)

ee20086b8c

2020-07-02

Move S3TaskHandler to the AWS provider package (#9602)

40add26d45

2020-06-29

Remove almost all references to airflow.contrib (#9559)

c858babddf

2020-06-26

Remove kwargs from Super calls in AWS Secrets Backends (#9523)

87fdbd0708

2020-06-25

Use literal syntax instead of function calls to create data structure (#9516)

c7a454aa32

2020-06-22

Add AWS ECS system test (#8888)

df8efd04f3

2020-06-21

Enable & Fix "Docstring Content Issues" PyDocStyle Check (#9460)

e13a14c873

2020-06-21

Enable & Fix Whitespace related PyDocStyle Checks (#9458)

d0e7db4024

2020-06-19

Fixed release number for fresh release (#9408)

12af6a0800

2020-06-19

Final cleanup for 2020.6.23rc1 release preparation (#9404)

992a18c84a

2020-06-19

Move MySqlToS3Operator to transfers (#9400)

a60f589aa2

2020-06-19

Add MySqlToS3Operator (#9054)

c7e5bce57f

2020-06-19

Prepare backport release candidate for 2020.6.23rc1 (#9370)

40bf8f28f9

2020-06-18

Detect automatically the lack of reference to the guide in the operator descriptions (#9290)

f6bd817a3a

2020-06-16

Introduce 'transfers' packages (#9320)

58a8ec0e46

2020-06-16

AWSBatchOperator <> ClientHook relation changed to composition (#9306)

a80cd25e8e

2020-06-15

Close/Flush byte stream in s3 hook load_string and load_bytes (#9211)

ffb8574037

2020-06-14

Decrypt secrets from SystemsManagerParameterStoreBackend (#9214)

a69b031f20

2020-06-10

Add S3ToRedshift example dag and system test (#8877)

17adcea835

2020-06-02

Fix handling of subprocess error handling in s3_file_transform and gcs (#9106)

357e11e0cf

2020-05-29

Add Delete/Create S3 bucket operators (#8895)

1ed171bfb2

2020-05-28

Add script_args for S3FileTransformOperator (#9019)

0b0e4f7a4c

2020-05-26

Preparing for RC3 relase of backports (#9026)

00642a46d0

2020-05-26

Fixed name of 20 remaining wrongly named operators. (#8994)

1d36b0303b

2020-05-23

Fix references in docs (#8984)

f946f96da4

2020-05-23

Old json boto compat removed from dynamodb_to_s3 operator (#8987)

375d1ca229

2020-05-19

Release candidate 2 for backport packages 2020.05.20 (#8898)

12c5e5d8ae

2020-05-17

Prepare release candidate for backport packages (#8891)

f3521fb0e3

2020-05-16

Regenerate readme files for backport package release (#8886)

f4edd90a94

2020-05-16

Speed up TestAwsLambdaHook by not actually running a function (#8882)

92585ca4cb

2020-05-15

Added automated release notes generation for backport operators (#8807)

85bbab27db

2020-05-15

Add EMR operators howto docs (#8863)

e61b9bb9bb

2020-05-13

Add AWS EMR System tests (#8618)

ed3f5131a2

2020-05-13

Correctly pass sleep time from AWSAthenaOperator down to the hook. (#8845)

7236862a1f

2020-05-12

[AIRFLOW-2310] Enable AWS Glue Job Integration (#6007)

d590e5e767

2020-05-11

Add option to propagate tags in ECSOperator (#8811)

0c3db84c3c

2020-05-11

[AIRFLOW-7068] Create EC2 Hook, Operator and Sensor (#7731)

cbebed2b4d

2020-05-10

Allow passing backend_kwargs to AWS SSM client (#8802)

c7788a6894

2020-05-10

Add imap_attachment_to_s3 example dag and system test (#8669)

ff5b70149b

2020-05-07

Add google_api_to_s3_transfer example dags and system tests (#8581)

4421f011ee

2020-05-01

Improve template capabilities of EMR job and step operators (#8572)

379a884d64

2020-04-28

fix: aws hook should work without conn id (#8534)

74bc316c56

2020-04-27

[AIRFLOW-4438] Add Gzip compression to S3_hook (#8571)

7ea66a1a95

2020-04-26

Add example DAG for ECSOperator (#8452)

b6434dedf9

2020-04-24

[AIRFLOW-7111] Add generate_presigned_url method to S3Hook (#8441)

becedd5af8

2020-04-19

Remove unrelated EC2 references in ECSOperator (#8451)

ab1290cb0c

2020-04-13

Make launch_type parameter optional (#8248)

87969a350d

2020-04-09

[AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170)

b46d6c0602

2020-04-08

Add support for AWS Secrets Manager as Secrets Backend (#8186)

68d1714f29

2020-04-04

[AIRFLOW-6822] AWS hooks should cache boto3 client (#7541)

8a02402576

2020-03-31

Rename CloudBaseHook to GoogleBaseHook and move it to google.common (#8011)

7239d9a82d

2020-03-28

Get Airflow Variables from AWS Systems Manager Parameter Store (#7945)

eb4af4f944

2020-03-28

Make BaseSecretsBackend.build_path generic (#7948)

438da7241e

2020-03-28

[AIRFLOW-5825] SageMakerEndpointOperator is not idempotent (#7891)

686d7d50bd

2020-03-25

Standardize SecretBackend class names (#7846)

eef87b9953

2020-03-23

[AIRFLOW-7105] Unify Secrets Backend method interfaces (#7830)

5648dfbc30

2020-03-23

Add missing call to Super class in 'amazon', 'cloudant & 'databricks' providers (#7827)

a360024123

2020-03-19

[AIRFLOW-5705] Make AwsSsmSecretsBackend consistent with VaultBackend (#7753)

2a54512d78

2020-03-17

[AIRFLOW-5705] Fix bugs in AWS SSM Secrets Backend (#7745)

a8b5fc74d0

2020-03-16

[AIRFLOW-4175] S3Hook load_file should support ACL policy paramete (#7733)

e31e9ddd23

2020-03-14

[AIRFLOW-5705] Add secrets backend and support for AWS SSM (#6376)

3bb60afc7b

2020-03-13

[AIRFLOW-6975] Base AWSHook AssumeRoleWithSAML (#7619)

c0c5f11ad1

2020-03-12

[AIRFLOW-6884] Make SageMakerTrainingOperator idempotent (#7598)

b7cdda1c64

2020-03-10

[AIRFLOW-4438] Add Gzip compression to S3_hook (#7680)

42eef38217

2020-03-07

[AIRFLOW-6877] Add cross-provider dependencies as extras (#7506)

9a94ab246d

2020-03-01

[AIRFLOW-6962] Fix compeleted to completed (#7600)

1b38f6d9b6

2020-02-29

[AIRFLOW-5908] Add download_file to S3 Hook (#6577)

3ea3e1a2b5

2020-02-26

[AIRFLOW-6824] EMRAddStepsOperator problem with multi-step XCom (#7443)

6eaa7e3b18

2020-02-25

[AIRFLOW-5924] Automatically unify bucket name and key in S3Hook (#6574)

3320e432a1

2020-02-24

[AIRFLOW-6817] Lazy-load 'airflow.DAG' to keep user-facing API untouched (#7517)

7d0e7122dd

2020-02-24

[AIRFLOW-6830] Add Subject/MessageAttributes to SNS hook and operator (#7451)

4d03e33c11

2020-02-22

[AIRFLOW-6817] remove imports from 'airflow/__init__.py', replaced implicit imports with explicit imports, added entry to 'UPDATING.MD' - squashed/rebased (#7456)

47a922b864

2020-02-21

[AIRFLOW-6854] Fix missing typing_extensions on python 3.8 (#7474)

9cbd7de6d1

2020-02-18

[AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412)

58c3542ed2

2020-02-12

[AIRFLOW-5231] Fix S3Hook.delete_objects method (#7375)

b7aa778b38

2020-02-10

[AIRFLOW-6767] Correct name for default Athena workgroup (#7394)

9282185e66

2020-02-09

[AIRFLOW-6761] Fix WorkGroup param in AWSAthenaHook (#7386)

94fccca970

2020-02-04

[AIRFLOW-XXXX] Add pre-commit check for utf-8 file encoding (#7347)

f3ad5cf618

2020-02-03

[AIRFLOW-4681] Make sensors module pylint compatible (#7309)

88e40c714d

2020-02-03

[AIRFLOW-6716] Fix AWS Datasync Example DAG (#7339)

a311d3d82e

2020-02-03

[AIRFLOW-6718] Fix more occurrences of utils.dates.days_ago (#7341)

cb766b05b1

2020-02-03

[AIRFLOW-XXXX] Fix Static Checks on CI (#7342)

97a429f9d0

2020-02-02

[AIRFLOW-6714] Remove magic comments about UTF-8 (#7338)

7527eddc5e

2020-02-02

[AIRFLOW-4364] Make all code in airflow/providers/amazon pylint compatible (#7336)

cf141506a2

2020-02-02

[AIRFLOW-6708] Set unique logger names (#7330)

63aa3db88f

2020-02-02

[AIRFLOW-6258] Add CloudFormation operators to AWS providers (#6824)

af4157fdef

2020-02-02

[AIRFLOW-6672] AWS DataSync - better logging of error message (#7288)

373c6aa4a2

2020-01-30

[AIRFLOW-6682] Move GCP classes to providers package (#7295)

83c037873f

2020-01-30

[AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287)

1988a97e8f

2020-01-28

[AIRFLOW-6659] Move AWS Transfer operators to providers package (#7274)

ab10443e96

2020-01-28

[AIRFLOW-6424] Added a operator to modify EMR cluster (#7213)

40246132a7

2020-01-28

[AIRFLOW-6654] AWS DataSync - bugfix when creating locations (#7270)

82c0e5aff6

2020-01-28

[AIRFLOW-6655] Move AWS classes to providers (#7271)

599e4791c9

2020-01-18

[AIRFLOW-6541] Use EmrJobFlowSensor for other states (#7146)

c319e81cae

2020-01-17

[AIRFLOW-6572] Move AWS classes to providers.amazon.aws package (#7178)

941a070578

2020-01-15

[AIRFLOW-6570] Add dag tag for all example dag (#7176)

78d8fe6944

2020-01-08

[AIRFLOW-6245] Add custom waiters for AWS batch jobs (#6811)

e0b0227257

2019-12-28

[AIRFLOW-6319] Add support for AWS Athena workgroups (#6871)

57da456854

2019-12-24

[AIRFLOW-6333] Bump Pylint to 2.4.4 & fix/disable new checks (#6888)

cf647c27e0

2019-12-18

[AIRFLOW-6038] AWS DataSync reworked (#6773)

7502cad284

2019-12-17

[AIRFLOW-6206] Move and rename AWS batch operator [AIP-21] (#6764)

c4c635df69

2019-12-17

[AIRFLOW-6083] Adding ability to pass custom configuration to lambda client. (#6678)

4fb498f87e

2019-12-09

[AIRFLOW-6072] aws_hook: Outbound http proxy setting and other enhancements (#6686)

a1e2f86352

2019-11-20

[AIRFLOW-6021] Replace list literal with list constructor (#6617)

baae140847

2019-11-19

[AIRFLOW-5781] AIP-21 Migrate AWS Kinesis to /providers/amazon/aws (#6588)

504cfbac1a

2019-11-18

[AIRFLOW-5783] AIP-21 Move aws redshift into providers structure (#6539)

992f0e3acf

2019-11-12

AIRFLOW-5824: AWS DataSync Hook and Operators added (#6512)

c015eb2f64

2019-11-10

[AIRFLOW-5786] Migrate AWS SNS to /providers/amazon/aws (#6502)

3d76fb4bf2

2019-11-09

[AIRFLOW-5782] Migrate AWS Lambda to /providers/amazon/aws [AIP-21] (#6518)

Was this entry helpful?