Package apache-airflow-providers-amazon

Amazon integration (including Amazon Web Services (AWS)).

This is detailed commit list of changes for versions provider package: amazon. For high-level changelog, see package information including changelog.

8.23.0

Latest change: 2024-05-23

Commit

Committed

Subject

e565cea65c

2024-05-23

Resolving EMR deprecated warnings (#39743)

7b588b4dd9

2024-05-22

misc: add comment about remove unused code (#39748)

a78ee74b6a

2024-05-22

bugfix: handle invalid cluster states in NeptuneStopDbClusterOperator (#38287)

49b38719e2

2024-05-21

Fix automatic termination issue in 'EmrOperator' by ensuring 'waiter_max_attempts' is set for deferrable triggers (#38658)

8d1bd345b2

2024-05-17

fix: empty openlineage dataset name for AthenaExtractor (#39677)

f3687b68a6

2024-05-16

Sagemaker trigger: pass the job name as part of the event (#39671)

9ea78d9d72

2024-05-15

Fix default value for aws batch operator retry strategy (#39608)

9284dc5391

2024-05-15

Amazon Bedrock - Retrieve and RetrieveAndGenerate (#39500)

9dd77520be

2024-05-15

Introduce Amazon Comprehend Service (#39592)

339ea508e2

2024-05-14

Handle task adoption for batch executor (#39590)

8.22.0

Latest change: 2024-05-12

Commit

Committed

Subject

97e867f170

2024-05-12

Prepare docs 2nd wave May 2024 (#39565)

ca058a635e

2024-05-11

enh(amazon_hook): raise not found exception instead of general exception when download file (#39509)

2b1a2f8d56

2024-05-11

Reapply templates for all providers (#39554)

2c05187b07

2024-05-10

Faster 'airflow_version' imports (#39552)

c9f4618be4

2024-05-09

Drop 'xmlsec' pin (#39534)

3938f71dfa

2024-05-08

Scheduler to handle incrementing of try_number (#39336)

73918925ed

2024-05-08

Simplify 'airflow_version' imports (#39497)

9c739d7142

2024-05-07

'S3DeleteObjectsOperator' Added ability to filter keys by last modified time (#39151)

a74b5f0694

2024-05-06

ECS Executor: Set tasks to RUNNING state once active (#39212)

598398a816

2024-05-02

Amazon Bedrock - Knowledge Bases and Data Sources (#39245)

4910c0439b

2024-05-01

Add 'jmespath' as an explicit dependency (#39350)

8.21.0

Latest change: 2024-05-01

Commit

Committed

Subject

fe4605a10e

2024-05-01

Prepare docs 1st wave May 2024 (#39328)

91490fb054

2024-04-30

Added logging_config,snapstart,ephemeral_storage parameters to aws lambdacreatefunctionoperator (#39300)

4fa9fe119e

2024-04-29

Rename "try_number" increments that are unrelated to the airflow concept (#39317)

6d09adf992

2024-04-26

Add tests for 'EmrServerlessJobSensor' and 'EmrServerlessApplicationSensor' (#39099)

ead9b00f7c

2024-04-25

Bump minimum Airflow version in providers to Airflow 2.7.0 (#39240)

f7a2f60325

2024-04-22

Update 'is_authorized_custom_view' from auth manager to handle custom actions (#39167)

fcb2bee1c6

2024-04-22

Update logic to allow retries in AWS Batch Client hook to be effective (#38998)

4b9b400cff

2024-04-18

Allow importing the aws executors with a shorter path (#39093)

cd888870ba

2024-04-18

Fix main failing because of the new xmlsec 1.3.14 compatibility (#39104)

1ded297509

2024-04-15

Remove flag from AWS auth manager to use it (#39033)

6520653c43

2024-04-14

Activate RUF015 that checks for unnecessary iterable allocation for first element (#38949)

1c9a6609f3

2024-04-14

Adding MSGraphOperator in Microsoft Azure provider (#38111)

d946d7b013

2024-04-13

Fix bug in GlueJobOperator where consecutive runs fail when a local script file is used (#38960)

c25d346adf

2024-04-11

Amazon Bedrock - Model Throughput Provisioning (#38850)

8.20.0

Latest change: 2024-04-10

Commit

Committed

Subject

5fa80b6aea

2024-04-10

Prepare docs 1st wave (RC1) April 2024 (#38863)

b7ac00d12d

2024-04-09

Revert "fix: COMMAND string should be raw to avoid SyntaxWarning: invalid escape sequence '\s' (#38734)" (#38864)

7ed31d5fdf

2024-04-08

Amazon Bedrock - Model Customization Jobs (#38693)

bfaa4f2012

2024-04-08

fix: COMMAND string should be raw to avoid SyntaxWarning: invalid escape sequence '\s' (#38734)

830b71b3be

2024-04-08

fix: try002 for provider amazon (#38789)

1f03b9c86c

2024-04-05

Typo fix (#38783)

12944002aa

2024-04-03

Add fallback 'region_name' value to AWS Executors (#38704)

0723a8f01d

2024-03-30

Introduce Amazon Bedrock service (#38602)

ff28969ff3

2024-03-25

fix: EmrServerlessStartJobOperator not serializing DAGs correctly when partial/expand is used. (#38022)

9ea4050d41

2024-03-22

fix(amazon): add return statement to yield within a while loop in triggers (#38396)

c893cb3bfb

2024-03-22

Fix set deprecated amazon operators arguments in 'MappedOperator' (#38346)

ea951afb69

2024-03-21

Add check in AWS auth manager to check if the Amazon Verified Permissions schema is up to date (#38333)

5023ae084c

2024-03-20

Update AWS auth manager CLI command to not disable AVP schema validation (#38301)

111245af3f

2024-03-18

'ECSExecutor' API Retry bug fix (#38118)

6029c71e2c

2024-03-18

Fix 'region' argument in 'MappedOperator' based on 'AwsBaseOperator' / 'AwsBaseSensor' (#38178)

b5b972a106

2024-03-18

Update yanked versions in providers changelogs (#38262)

0a74928894

2024-03-18

Bump ruff to 0.3.3 (#38240)

2e35854a05

2024-03-15

Make the method 'BaseAuthManager.is_authorized_custom_view' abstract (#37915)

68282c1790

2024-03-12

Replace "Role" by "Group" in AWS auth manager (#38078)

a192751dcd

2024-03-12

Add back system test for AWS auth manager (#38044)

c0b849ad2b

2024-03-11

Avoid use of 'assert' outside of the tests (#37718)

1d3a00a95f

2024-03-11

Use 'AwsLogsHook' when fetching Glue job logs (#38010)

06e3197ccb

2024-03-09

Fix bug for ECS Executor where tasks were being skipped if one task failed. (#37979)

89f5cde97e

2024-03-08

Revert "Add system test to test the AWS auth manager (#37947)" (#38004)

39befdce12

2024-03-08

Add system test to test the AWS auth manager (#37947)

47348ce66c

2024-03-08

Implement 'filter_permitted_dag_ids' in AWS auth manager (#37666)

f2628fda7a

2024-03-06

ECS Executor - add support to adopt orphaned tasks. (#37786)

fbbe03ea40

2024-03-06

AWS auth manager CLI: persist the policy store description when doing updates (#37946)

e7214fd5f4

2024-03-06

Reduce 's3hook' memory usage (#37886)

29acfb1924

2024-03-06

Change f-string to formatting into the logging messages for Batch Executor (#37929)

3f52790d42

2024-03-06

Resolve G004: Logging statement uses f-string (#37873)

c52ec9d225

2024-03-05

AWS Batch Executor (#37618)

ce00420014

2024-03-05

Fix init checks for aws redshift to s3 operator (#37861)

8.19.0

Latest change: 2024-03-04

Commit

Committed

Subject

83316b8158

2024-03-04

Prepare docs 1st wave (RC1) March 2024 (#37876)

30f7b2abe6

2024-03-04

Avoid to use too broad 'noqa' (#37862)

a7d13315e1

2024-03-02

Resolve G003: "Logging statement uses +" (#37848)

9da6a21159

2024-02-29

Use named loggers instead of root logger (#37801)

77341ef6a1

2024-02-29

Avoid non-recommended usage of logging (#37792)

dc08e6acc2

2024-02-28

D105 Check on Amazon (#37764)

2bc103698f

2024-02-28

Unify 'aws_conn_id' type to always be 'str | None' (#37768)

9e4bdc9e45

2024-02-27

Limit 'pandas' to '<2.2' (#37748)

b124d6e94f

2024-02-26

Fix init checks for aws 'eks' (#37674)

b52b227c04

2024-02-26

Implement AIP-60 Dataset URI formats (#37005)

f3159df406

2024-02-25

Bump min versions of openapi validators (#37691)

42f6373e52

2024-02-24

Fix 'example_emr' system test (#37667)

a2db179d9c

2024-02-23

Init checks for aws gcs_to_s3 (#37662)

f36d17ce75

2024-02-23

Implement 'filter_permitted_menu_items' in AWS auth manager (#37627)

0c2d2c6544

2024-02-22

Implement 'batch_is_authorized_*' APIs in AWS auth manager (#37430)

d8c8989d42

2024-02-21

Update action names in AWS auth manager (#37572)

8.18.0

Latest change: 2024-02-17

Commit

Committed

Subject

75182363a2

2024-02-17

Prepare docs 1st wave (RC2) of Providers February 2024 (#37471)

5a0be392e6

2024-02-16

Add comment about versions updated by release manager (#37488)

c75a105935

2024-02-16

add type annotations to Amazon provider "execute_coplete" methods (#36330)

42f8d048d2

2024-02-16

Replace usage of 'datetime.utcnow' and 'datetime.utcfromtimestamp' in providers (#37138)

f91c93ccfe

2024-02-14

Add retry configuration in 'EmrContainerOperator' (#37426)

56c27f8f5a

2024-02-14

Create CLI commands for AWS auth manager to create AWS Identity Center related resources (#37407)

b341b5927e

2024-02-14

docs: Add doc page with providers deprecations (#37075)

b5b452b590

2024-02-13

Add extra operator links for EMR Serverless (#34225)

bfb054e9e8

2024-02-12

Prepare docs 1st wave of Providers February 2024 (#37326)

8fac799a25

2024-02-10

D401 support in amazon provider (#37275)

48bfb1a970

2024-02-09

Merge all ECS executor configs following recursive python dict update (#37137)

90e2b12d6b

2024-02-08

Upgrade mypy to 1.8.0 (#36428)

1f1fa2f7e3

2024-02-07

Update default value for 'BatchSensor' (#37234)

d8ce75cd53

2024-02-07

remove info log from download_file (#37211)

af30e1b619

2024-02-06

feature: S3ToRedshiftOperator templating aws_conn_id (#37195)

41ebf28103

2024-02-05

ECS Executor - Add backoff on failed task retry (#37109)

2e95a2a4ca

2024-02-05

check sagemaker training job status before deferring 'SageMakerTrainingOperator' (#36685)

55cc7bda56

2024-02-01

Updates to ECS Docs (#37125)

fa29ddbb81

2024-01-31

Fix 'log_query' to format SQL statement correctly in 'AthenaOperator' (#36962)

7ea40fe972

2024-01-30

Make Amazon Provider tests compatible with 'moto>=5' (#37060)

dec2662190

2024-01-30

feat: Switch all class, functions, methods deprecations to decorators (#36876)

8914e49551

2024-01-30

SqlToS3Operator: feat/ add max_rows_per_file parameter (#37055)

d576c72c20

2024-01-28

Limit moto to version below 5.0.0 (#37054)

004d1d3a84

2024-01-26

Adding Amazon Neptune Hook and Operators (#37000)

8.17.0

Latest change: 2024-01-26

Commit

Committed

Subject

cead3da4a6

2024-01-26

Add docs for RC2 wave of providers for 2nd round of Jan 2024 (#37019)

2b4da0101f

2024-01-22

Prepare docs 2nd wave of Providers January 2024 (#36945)

d18c01a7a2

2024-01-18

EC2 'CreateInstance': terminate instances in on_kill (#36828)

9563dc573b

2024-01-18

add deferrable mode to RedshiftDataOperator (#36586)

f6e357a5fc

2024-01-18

Fallback to default value if '[aws] cloudwatch_task_handler_json_serializer' not set (#36851)

6ff96af480

2024-01-18

Fix stacklevel in warnings.warn into the providers (#36831)

666127238b

2024-01-17

AthenaSqlHook implementation (#36171)

08cc59a0c4

2024-01-16

Raise AirflowOptionalProviderfeature exception for AVP command (#36824)

81be6ac6c0

2024-01-15

Create CLI commands for AWS auth manager to create Amazon Verified Permissions related resources (#36799)

01724d85bc

2024-01-15

Use base aws classes in AWS DMS Operators/Sensors (#36772)

4883c38f3b

2024-01-15

Use base aws classes in AWS Redshift Data API Operators (#36764)

1e0a99c5f4

2024-01-15

Use base aws classes in Amazon EventBridge Operators (#36765)

9eab3e199e

2024-01-15

Use base aws classes in Amazon QuickSight Operators/Sensors (#36776)

c7f518fe09

2024-01-15

Use base aws classes in AWS Datasync Operators (#36766)

b241577c9c

2024-01-14

Use base aws classes in Amazon DynamoDB Sensors (#36770)

1455a3babb

2024-01-14

Use base aws classes in AWS CloudFormation Operators/Sensors (#36771)

e7166bb759

2024-01-11

Adds support for capacity providers to ECS Executor (#36722)

b260367208

2024-01-11

check transform job status before deferring SageMakerTransformOperator (#36680)

c439ab87c4

2024-01-10

Standardize airflow build process and switch to Hatchling build backend (#36537)

9f04716179

2024-01-10

Add use_regex argument for allowing 'S3KeySensor' to check s3 keys with regular expression (#36578)

5a6f959bd5

2024-01-10

check sagemaker processing job status before deferring (#36658)

88c9596f4a

2024-01-10

check job_status before BatchOperator execute in deferrable mode (#36523)

98b9e491e5

2024-01-10

Update the redshift hostname check to avoid possible bugs (#36703)

ecb2c9f24d

2024-01-09

Set min pandas dependency to 1.2.5 for all providers and airflow (#36698)

cb1182ea4f

2024-01-09

Refresh credentials in 'AwsEcsExecutor' (#36179)

9cb2052810

2024-01-09

Fix docstring for apply_wildcard parameter in 'S3ListOperator'. Changed the order of docstring for fix (#36679)

4d5e05b28b

2024-01-08

Add deferrable mode to RedshiftClusterSensor (#36550)

298c37d355

2024-01-08

Bump min version of amazon-provider related dependencies (#36660)

43afb2f6b8

2024-01-08

Implement 'is_authorized_dag' in AWS auth manager (#36619)

8.16.0

Latest change: 2024-01-07

Commit

Committed

Subject

19ebcac239

2024-01-07

Prepare docs 1st wave of Providers January 2024 (#36640)

1d41fc7ddb

2024-01-06

Check redshift cluster state before deferring to triggerer (#36416)

365f206a32

2024-01-05

Select ruff B006 to detect the usage of mutable values as argument default (#36626)

16d16e2933

2024-01-05

Use base aws classes in Amazon SQS Operators/Sensors/Triggers (#36613)

034e618347

2024-01-05

Use base aws classes in Amazon SNS Operators (#36615)

c1bba9906c

2024-01-05

Fix assignment of template field in '__init__' in 'AwsToAwsBaseOperator' (#36604)

a877bde5a3

2024-01-05

Fix assignment of template field in '__init__' in 'DataSyncOperator' (#36605)

ebd588b9f4

2024-01-04

Add AWS Step Functions links (#36599)

44b97e1687

2024-01-04

Add OpenLineage support for Redshift SQL. (#35794)

6937ae7647

2023-12-30

Speed up autocompletion of Breeze by simplifying provider state (#36499)

22294abf68

2023-12-28

Use base aws classes in AWS Step Functions Operators/Sensors/Triggers (#36468)

8.15.0

Latest change: 2023-12-28

Commit

Committed

Subject

9b5d6bfe27

2023-12-28

Add documentation for 3rd wave of providers in Deember (#36464)

d73bef2a43

2023-12-27

Add Amazon Athena query results extra link (#36447)

73d87945e9

2023-12-26

Use base aws classes in Amazon ECS Operators/Sensors/Triggers (#36393)

7bd998e2ec

2023-12-25

fix(providers/amazon): remove event['message'] call in EmrContainerOperator.execute_complete|as the key message no longer exists (#36417)

a1e1dc60fb

2023-12-25

handle tzinfo in S3Hook.is_keys_unchanged_async (#36363)

8.14.0

Latest change: 2023-12-23

Commit

Committed

Subject

b15d5578da

2023-12-23

Re-apply updated version numbers to 2nd wave of providers in December (#36380)

f5883d6e7b

2023-12-23

Prepare 2nd wave of providers in December (#36373)

0b32613480

2023-12-21

Increase ConflictException retries to 4 total (#36337)

30afa46e90

2023-12-21

Increase width of execution_date input in trigger.html (#36278) (#36304)

2b31f373ef

2023-12-20

Remove remaining Airflow 2.6 backcompat code from Amazon Provider (#36324)

e9ba37bb58

2023-12-17

Add code snippet formatting in docstrings via Ruff (#36262)

357355ac09

2023-12-11

Remove 'is_authorized_cluster_activity' from auth manager (#36175)

e37fe8f576

2023-12-11

Add 'jsonpath_ng.ext.parse' support for 'SqsSensor' (#36170)

cd476acd8f

2023-12-11

Follow BaseHook connection fields method signature in child classes (#36086)

aba58adb83

2023-12-08

Allow storage options to be passed (#35820)

8.13.0

Latest change: 2023-12-08

Commit

Committed

Subject

999b70178a

2023-12-08

Prepare docs 1st wave of Providers December 2023 (#36112)

7329e9eed9

2023-12-07

Fix for 'EksCreateClusterOperator' deferrable mode (#36079)

d0918d77ee

2023-12-07

Bump minimum Airflow version in providers to Airflow 2.6.0 (#36017)

ef5eebdb26

2023-12-06

Fix AWS system tests (#36091)

acf91af6bf

2023-12-05

Update 'boto3' and 'botocore' versions notes (#36073)

04a781666b

2023-12-04

Fix handling of single quotes in 'RedshiftToS3Operator' (#35986)

e0df7441fa

2023-12-04

Fix a bug in get_iam_token for Redshift Serverless (#36001)

fd03dc2933

2023-12-01

Fix reraise outside of try block in 'AthenaHook.get_output_location' (#36008)

decc6d9414

2023-12-01

Improve typing hints for only_client_type decorator (#35997)

b1e547ef53

2023-12-01

Refactor some methods in EmrContainerHook (#35999)

9f212d4276

2023-12-01

Refacto get_output_location in AthenaHook (#35996)

cf052dc64f

2023-12-01

Add feature to build "chicken-egg" packages from sources (#35890)

eed6427b66

2023-12-01

Avoid creating the hook in the EmrServerlessCancelJobsTrigger init (#35992)

8346fd58e8

2023-12-01

Fix a bug with accessing hooks in EKS trigger (#35989)

a9132f3891

2023-12-01

Move RDS hook to a cached property in RDS trigger (#35990)

4a9824de8e

2023-11-30

Replace default empty dict value by None in AzureBlobStorageToS3Operator (#35977)

ddb4370dc6

2023-11-30

Update 'set_context' signature to match superclass one and stop setting the instance attribute (#35975)

7e1f67b4b8

2023-11-30

Fix a bug in method name used in 'GlacierToGCSOperator' (#35978)

df36e7381a

2023-11-30

Use S3 hook instead of AwsGenericHook in AWS S3 FS (#35973)

985d0589af

2023-11-29

AWS auth manager: implement all 'is_authorized_*' methods (but 'is_authorized_dag') (#35928)

ab835c20b2

2023-11-29

Fix EC2Hook get_instance for client_type api (#35960)

9ab343714a

2023-11-29

Remove setting a non-existing object param and use local var instead in S3Hook (#35950)

f6962a929b

2023-11-28

Support IAM authentication for Redshift serverless (#35897)

3b3ebafdce

2023-11-27

Implement 'is_authorized_variable' in AWS auth manager (#35804)

0f5db49ec4

2023-11-27

Stop getting message from event after migrating 'EmrContainerTrigger' to 'AwsBaseWaiterTrigger' (#35892)

9059f72668

2023-11-25

Enhance 'attribute_value' in 'DynamoDBValueSensor' to accept list (#35831)

8.12.0

Latest change: 2023-11-24

Commit

Committed

Subject

0b23d5601c

2023-11-24

Prepare docs 2nd wave of Providers November 2023 (#35836)

ca1202fd31

2023-11-23

Add 'EC2HibernateInstanceOperator' and 'EC2RebootInstanceOperator' (#35790)

ef2ad070c2

2023-11-23

Add OpenLineage support to 'S3FileTransformOperator' (#35819)

a794e0d020

2023-11-23

Fix Batch operator's retry_strategy (#35808)

ac977c4e57

2023-11-22

Make EksPodOperator exec config not  rely on log level (#35771)

9e159fc48d

2023-11-22

Add OpenLineage support to S3Operators - Copy, Delete and Create Object (#35796)

bcb5eebd62

2023-11-22

Updated docstring: 'check_key_async' is now in line with description of '_check_key_async' (#35799)

b71c14c74a

2023-11-22

Added retry strategy parameter to Amazon AWS provider Batch Operator to allow dynamic Batch retry strategies (#35789)

2d811d526a

2023-11-22

Update emr.py (#35787)

2a06e278d2

2023-11-21

Check attr on parent not self re TaskContextLogger set_context (#35780)

379b7c09d1

2023-11-21

Implement login and logout in AWS auth manager (#35488)

4d72bf1a89

2023-11-20

Allow a wider range of watchtower versions (#35713)

99534e47f3

2023-11-19

Use reproducible builds for provider packages (#35693)

09fef3c3ee

2023-11-17

Update http to s3 system test (#35711)

3e6676bfae

2023-11-17

Extend task context logging support for remote logging using AWS S3 (#32950)

03a0b72672

2023-11-17

Added name field to template_fields in EmrServerlessStartJobOperator (#35648)

99df205f42

2023-11-16

Fix and reapply templates for provider documentation (#35686)

5626590406

2023-11-14

openlineage, aws: Add OpenLineage support for AthenaOperator. (#35090)

9990443fa1

2023-11-08

Log failure reason for containers if a task fails for ECS Executor (#35496)

8.11.0

Latest change: 2023-11-08

Commit

Committed

Subject

1b059c57d6

2023-11-08

Prepare docs 1st wave of Providers November 2023 (#35537)

16ffc87ff4

2023-11-08

Improve error handling in AWS Links (#35518)

b67a4f78e5

2023-11-07

Update ECS executor healthcheck with a catchall except (#35512)

11bdfe4c12

2023-11-07

Work around typing issue in examples and providers (#35494)

f24e5199c7

2023-11-06

Fix AWS RDS hook's DB instance state check (#34773)

a61da3cc87

2023-11-04

Add verificationy that provider docs are as expected (#35424)

ae9a7b8188

2023-11-03

ECS Executor Health Check (#35412)

92d1e8c447

2023-11-03

Move ECS Executor to its own file (#35418)

9782ee3bbc

2023-11-01

Fix parameter syntax in Amazon docstrings (#35349)

69bac3fba8

2023-10-31

Improve docs on objectstorage (#35294)

651b32606c

2023-10-31

Clarify "task" in ECS Executor log messages (#35304)

55b015f995

2023-10-31

Add support for anonymous access to s3 buckets for objectstorage (#35273)

ba4b55a194

2023-10-30

Make optional 'output_location' attribute in 'AthenaOperator' (#35265)

8.10.0

Latest change: 2023-10-28

Commit

Committed

Subject

d1c58d86de

2023-10-28

Prepare docs 3rd wave of Providers October 2023 - FIX (#35233)

3592ff4046

2023-10-28

Prepare docs 3rd wave of Providers October 2023 (#35187)

04e2fbd92b

2023-10-27

AIP-58: Add Airflow ObjectStore (AFS) (#34729)

86640d166c

2023-10-26

Add Http to s3 operator (#35176)

5f4d2b5dee

2023-10-25

Add AWS ECS Executor (#34381)

95980a9bc5

2023-10-25

Enable encryption in S3 download_files() hook. (#35037)

3721c9a441

2023-10-24

Use base aws classes in Amazon S3 Glacier Operators/Sensors (#35108)

da456065df

2023-10-24

Use base aws classes in Amazon Athena Operators/Sensors/Triggers (#35133)

bc4a22c6bd

2023-10-23

Use base aws classes in Amazon AppFlow Operators (#35082)

78187ca863

2023-10-23

Expose catalog parameter in 'AthenaOpeartor' (#35103)

f816237196

2023-10-20

Refactor string splitting (#34185)

a66437222b

2023-10-20

Use base classes for AWS Lambda Operators/Sensors (#34890)

dd7ba3cae1

2023-10-19

Pre-upgrade 'ruff==0.0.292' changes in providers (#35053)

b75f9e8806

2023-10-18

Upgrade pre-commits (#35033)

8.9.0

Latest change: 2023-10-18

Commit

Committed

Subject

39e611b43b

2023-10-18

Prepare docs 2nd wave of Providers in October 2023 (#35020)

4a37777567

2023-10-16

Glue 'DataBrew' operator (#34807)

b392f66c42

2023-10-16

Set 'EcsRunTaskOperator' default waiter duration to 70 days (#34928)

b1196460db

2023-10-16

Add 'check_interval' and 'max_attempts' as parameter of 'DynamoDBToS3Operator' (#34972)

f23170c9dd

2023-10-16

D401 Support - A thru Common (Inclusive) (#34934)

8.8.0

Latest change: 2023-10-13

Commit

Committed

Subject

e9987d5059

2023-10-13

Prepare docs 1st wave of Providers in October 2023 (#34916)

545e4d505e

2023-10-12

Extend hooks arguments into 'AwsBaseWaiterTrigger' (#34884)

84a3daed86

2023-10-11

Implements 'AwsBaseOperator' and 'AwsBaseSensor' (#34784)

8e26865763

2023-10-06

Refactor consolidate import from io in providers (#34378)

c01abd1c2e

2023-10-06

Upgrade watchtower to 3.0.1 (#25019) (#34747)

0c8e30e43b

2023-10-05

Bump min airflow version of providers (#34728)

99f320354b

2023-10-04

Refactor: consolidate import time in providers (#34402)

3064812280

2023-10-03

Include AWS Lambda execution logs to task logs (#34692)

7ebf4220c9

2023-09-28

Refactor usage of str() in providers (#34320)

ca3ce78fba

2023-09-28

Refactor import from collections (#34406)

dd325b46c8

2023-09-28

Allow setup 'endpoint_url' per-service in AWS Connection (#34593)

e333380077

2023-09-27

Clarify Amazon Lambda invocation and sensing (#34653)

a09d0c4e38

2023-09-26

do not fail operator if we cannot find logs (#34570)

8bea45f37f

2023-09-26

Refactor multiple equals to contains in providers (#34441)

b6499ace63

2023-09-26

Rename 'bucket' to 'gcs_bucket' in 'GCSToS3Operator' (#33031)

a4ecdc910f

2023-09-25

fix(providers/amazon): respect soft_fail argument when exception is raised (#34134)

5a133e8b52

2023-09-25

Respect 'soft_fail' argument when running 'BatchSensors' (#34592)

2b5c7676b5

2023-09-25

Respect 'soft_fail' argument when running 'SqsSensor' (#34569)

84f70dac4e

2023-09-25

Respect 'soft_fail' argument when running 'EcsBaseSensor' (#34596)

e8e79ae3c6

2023-09-24

Remove duplicate 'asgiref' dependency in Amazon Provider (#34580)

e76b505fee

2023-09-22

Respect 'soft_fail' argument when running 'SageMakerBaseSensor' (#34565)

e79895308a

2023-09-22

Respect 'soft_fail' parameter in 'S3KeysUnchangedSensor' and 'S3KeySensor' (#34550)

b4feb5c20d

2023-09-22

Respect 'soft_fail' parameter in 'LambdaFunctionStateSensor' (#34551)

5128e57196

2023-09-22

Respect 'soft_fail' parameter in 'AthenaSensor' (#34553)

c4c4a16269

2023-09-22

Respect 'soft_fail' parameter in 'QuickSightSensor' (#34555)

ed3df3d157

2023-09-22

Respect 'soft_fail' parameter in 'GlacierJobOperationSensor' (#34557)

4c0459d73a

2023-09-22

Respect 'soft_fail' parameter in 'GlueJobSensor', 'GlueCatalogPartitionSensor' and 'GlueCrawlerSensor' (#34559)

626b7edcbe

2023-09-22

Respect 'soft_fail' parameter in 'StepFunctionExecutionSensor' (#34560)

04515ef008

2023-09-22

Update 'BatchOperator' operator_extra_links property (#34506)

642b4ee2a9

2023-09-21

sagemaker.py spell error:  tranform change to  transform (#34445)

659d94f0ae

2023-09-21

Use 'airflow.exceptions.AirflowException' in providers (#34511)

9924e3e694

2023-09-19

Use AirflowProviderDeprecationWarning in the deprecated decorator in Amazon provider (#34488)

7de7149bc6

2023-09-19

Works on #34425 (#34453)

bbfa228868

2023-09-18

Deprecate get_hook in DataSyncOperator and use hook instead (#34427)

8ecd576de1

2023-09-14

Refactor shorter defaults in providers (#34347)

8.7.1

Latest change: 2023-09-14

Commit

Committed

Subject

7574e16e75

2023-09-14

Prepare docs for Sep 2023 2nd wave of Providers (#34360)

05036e619c

2023-09-13

Refactor: Think positively in providers (#34279)

401e7bd531

2023-09-12

Bugfix: Fix RDS triggers parameters so that they handle serialization/deserialization (#34222)

7813d956d2

2023-09-12

Remove unused parameter 'cluster_role_arn' from 'EksPodOperator''s docstring (#34300)

891b33bee8

2023-09-11

Correct parameter names in docstring for 'S3CreateObjectOperator' (#34263)

94d07908a2

2023-09-11

Refactor: Simplify comparisons (#34181)

f0467c9fd6

2023-09-11

Use a AwsBaseWaiterTrigger-based trigger in EmrAddStepsOperator deferred mode (#34216)

c5ec7cd294

2023-09-10

Simplify  to bool(...) (#34258)

8.7.0

Latest change: 2023-09-08

Commit

Committed

Subject

21990ed894

2023-09-08

Prepare docs for 09 2023 - 1st wave of Providers (#34201)

4fa66d1700

2023-09-07

Refactor: Consolidate import and usage of random (#34108)

9079093291

2023-09-07

Consolidate importing of os.path.* (#34060)

a7310f9c91

2023-09-05

Refactor regex in providers (#33898)

b1c2b07e58

2023-09-04

Refactor: Simplify loop in aws/triggers/batch.py (#34052)

bf2d411a2a

2023-09-04

Add decorator for suppress optional internal methods in Amazon Provider (#34034)

fa5e54c4c5

2023-09-03

Combine similar if logics in providers (#33987)

c82806641f

2023-09-03

Replace single quotes by double quotes in tests (#33864)

47bd5dd0e1

2023-09-03

Remove useless string join from providers (#33968)

6eaa69ee46

2023-09-01

Make 'aws.session_factory' part of Amazon provider configuration documentation (#33960)

875387afa5

2023-09-01

Refactor unneeded  jumps in providers (#33833)

c4967b00c4

2023-09-01

Make Amazon Chime connection lazy loaded and consistent with docs (#34000)

a9bbb430fc

2023-09-01

Replace try - except pass by contextlib.suppress in providers (#33980)

0a5e2281e0

2023-08-31

Remove some useless try/except from providers code (#33967)

17d031df66

2023-08-31

Add Amazon SQS Notifier (#33962)

097e3e618e

2023-08-31

Fix AWS 'EmrStepSensor' ignoring the specified 'aws_conn_id' in deferred mode  (#33952)

f860141cfd

2023-08-31

respect "soft_fail" argument when running BatchSensor in deferrable mode (#33405)

b4d4f55b47

2023-08-31

Refactor: Replace lambdas with comprehensions in providers (#33771)

55976af32e

2023-08-31

Replace sequence concatination by unpacking in Airflow providers (#33933)

b497234eda

2023-08-31

Reorganize devel_only extra in airflow's setup.py (#33907)

ea44ed9f54

2023-08-30

Increase 'waiter_max_attempts' default value in 'EcsRunTaskOperator' (#33712)

3ef770e3d2

2023-08-30

Remove explicit str concat from Airflow providers package and tests (#33860)

869f84e9c3

2023-08-29

Add Amazon SNS Notifier (#33828)

7d267fbefe

2023-08-29

Fix type annotation in AppflowHook (#33881)

667ab8c6ea

2023-08-28

Improve modules import in AWS probvider by move some of them into a type-checking block (#33780)

cede385e93

2023-08-28

Always use 'Literal' from 'typing_extensions' (#33794)

b11525702c

2023-08-26

Use literal dict instead of calling dict() in providers (#33761)

353b1482d3

2023-08-26

remove unnecessary and rewrite it using list in providers (#33763)

8.6.0

Latest change: 2023-08-26

Commit

Committed

Subject

c077d19060

2023-08-26

Prepare docs for Aug 2023 3rd wave of Providers (#33730)

633217c842

2023-08-25

Simplify conditions on len() in providers/amazon (#33565)

83efcaa835

2023-08-24

always push ECS task ARN to xcom in 'EcsRunTaskOperator' (#33703)

2d8625253f

2023-08-24

Remove non-public interface usage in EcsRunTaskOperator (#29447)

85acbb4ae9

2023-08-24

Refactor: Remove useless str() calls (#33629)

53a8973952

2023-08-24

Fix bug in task logs when using AWS CloudWatch. Do not set 'start_time' (#33673)

94f70d8184

2023-08-23

Replace strftime with f-strings where nicer (#33455)

5f504e9a17

2023-08-23

Upgrade botocore/aiobotocore minimum requirements (#33649)

85aea74b64

2023-08-23

Fix AWS Batch waiter failure state (#33656)

a54c2424df

2023-08-23

Fix typos (double words and it's/its) (#33623)

8ed38c1619

2023-08-22

Add Appflow system test + improvements (#33614)

41d9be072a

2023-08-22

Fix AWS appflow waiter (#33613)

8402e9adf4

2023-08-21

Use 'boto3.client' linked to resource meta instead of create new one for waiters (#33552)

95a930bc0a

2023-08-21

Consolidate import and usage of itertools (#33479)

1407e277ae

2023-08-19

Add 'sql_hook_params' parameter to 'S3ToSqlOperator' (#33427)

b555ed6f35

2023-08-18

Fix striping tags when falling back to update in 'SageMakerEndpointOperator' (#33487)

8e88eb8fa7

2023-08-17

Consolidate import and usage of pandas (#33480)

223b41d68f

2023-08-16

Added Amazon SageMaker Notebook hook and operators (#33219)

45d5f64127

2023-08-16

Add 'sql_hook_params' parameter to 'SqlToS3Operator' (#33425)

60df70526a

2023-08-15

Add parameter to pass role ARN to 'GlueJobOperator ' (#33408)

4d99705f69

2023-08-14

Add 'deferrable' option to 'LambdaCreateFunctionOperator' (#33327)

bd11ea81e5

2023-08-13

Add Deferrable mode to GlueCatalogPartitionSensor (#33239)

c645d8e40c

2023-08-12

D401 Support - Providers: Airbyte to Atlassian (Inclusive) (#33354)

0df0d7457e

2023-08-11

Add new RdsStartExportTaskOperator parameters (#33251)

8.5.1

Latest change: 2023-08-11

Commit

Committed

Subject

b5a4d36383

2023-08-11

Prepare docs for Aug 2023 2nd wave of Providers (#33291)

681ee46b21

2023-08-10

Fix get_log_events() in AWS logs hook (#33290)

c14cb85f16

2023-08-10

Improve fetching logs from AWS (#33231)

83bd60fd97

2023-08-09

Refactor: Simplify code in providers/amazon (#33222)

741fb27f50

2023-08-08

Implement EventBridge enable and disable rule operators (#33226)

8bbea9217a

2023-08-08

Get failure information on EMR job failure (#32151)

46862cfa94

2023-08-06

Update mypy-boto3-appflow dependency (#32930)

76ca94d2f2

2023-08-05

use 'cached_property' from functools in 'RdsBaseOperator' (#33133)

03fcbcc96e

2023-08-05

Use set for 'template_fields' of 'EcsDeregisterTaskDefinitionOperator' (#33129)

8.5.0

Latest change: 2023-08-05

Commit

Committed

Subject

60677b0ba3

2023-08-05

Prepare docs for Aug 2023 1st wave of Providers (#33128)

519d99baee

2023-08-04

Check google provider version in GCSToS3Operator before provide match_glob param (#32925)

bbc0968905

2023-08-04

openlineage, sagemaker: add missing OpenLineage type signature (#33114)

087d14ada2

2023-08-03

Deferrable mode for Sqs Sensor (#32809)

4e42edb203

2023-08-03

Set longer default 'waiter_max_attempts' for deferred BatchJobOperator (#33045)

44234c2bf0

2023-08-03

Add S3Bucket for mypy (#33028)

62f9e68a54

2023-08-02

openlineage, sagemaker: add OpenLineage support for SageMaker's Processing, Transform and Training operators (#31816)

86193f5608

2023-07-31

Increase the number of attempts in AWS system test 'example_rds_export' (#32976)

196d336585

2023-07-31

Add Amazon EventBridge PutRule hook and operator (#32869)

915f9e4060

2023-07-31

Add GCS Requester Pays bucket support to GCSToS3Operator (#32760)

8.4.0

Latest change: 2023-07-29

Commit

Committed

Subject

d06b7af69a

2023-07-29

Prepare docs for July 2023 3rd wave of Providers (#32875)

ddb685cf26

2023-07-28

Further limit mypy-boto3-appflow as the fix is not in sight (#32927)

25124dfd8b

2023-07-28

Limit Appflow mypy to 1.28.12 as it introduces strange typing issue (#32901)

e93460383f

2023-07-26

Move all k8S classes to cncf.kubernetes provider (#32767)

9570cb1482

2023-07-25

Make Start and Stop SageMaker Pipelines operators deferrable (#32683)

1706f05858

2023-07-24

EMR serverless Create/Start/Stop/Delete Application deferrable mode (#32513)

282854b55f

2023-07-24

Add endpoint_url in test_connection (#32664)

8012c9fce6

2023-07-24

Add support for querying Redshift Serverless clusters (#32785)

57f203251b

2023-07-22

FIX AWS deferrable operators by using AioCredentials when using 'assume_role' (#32733)

815655101b

2023-07-21

Add Deferrable mode to StepFunctionStartExecutionOperator (#32563)

75ed3bc3f8

2023-07-20

[bugfix] fix AWS triggers where deserialization would crash if region was not specified (#32729)

27b5f696a4

2023-07-20

Add Deferrable mode for EMR Serverless Start Job Operator (#32534)

eea53a22c9

2023-07-20

Add Eventbridge PutEvents operator and hook (#32498)

bbd290266c

2023-07-19

Fix bug in prune_dict where empty dict and list would be removed even in strict mode (#32573)

b9c84eb663

2023-07-19

add deferrable mode to rds start & stop DB (#32437)

7ed791dab7

2023-07-19

Do not return success from AWS ECS trigger after max_attempts (#32589)

113018ec99

2023-07-17

Deferrable mode for EKS Create/Delete Operator (#32355)

145b16caaa

2023-07-13

Fix S3ToRedshiftOperator does not support default values on UPSERT (#32558)

8.3.1

Latest change: 2023-07-12

Commit

Committed

Subject

e7f59a913e

2023-07-12

Prepare docs for July 2023 2nd wave of Providers (#32566)

50a68c6c4e

2023-07-12

Append region info to S3ToRedshitOperator if present (#32328)

8.3.0

Latest change: 2023-07-09

Commit

Committed

Subject

cd1ac927a7

2023-07-09

Prepare docs for July 2023 RC3 amazon provider (#32455)

c99c03135c

2023-07-08

D205 Support - Providers: Stragglers and new additions (#32447)

8c6751ff0f

2023-07-07

quick fix on RDS operator to prevent parameter collision (#32436)

869f3a93a8

2023-07-07

Remove ability to specify arbitrary hook params in AWS RDS trigger (#32386)

05f1acfcb7

2023-07-07

Introduce a base class for aws triggers (#32274)

7a3bc8d7c8

2023-07-06

Only update crawler tags if present in config dict (#32331)

225e3041d2

2023-07-06

Prepare docs for July 2023 wave of Providers (RC2) (#32381)

3878fe6fab

2023-07-05

Remove spurious headers for provider changelogs (#32373)

cb4927a018

2023-07-05

Prepare docs for July 2023 wave of Providers (#32298)

f8593503cb

2023-07-05

Add default_deferrable config (#31712)

5623a21a1f

2023-07-04

deprecate arbitrary parameter passing to RDS hook (#32352)

575bf2f040

2023-07-04

Bug fix GCSToS3Operator: avoid 'ValueError' when 'replace=False' with files already in S3 (#32322)

17132ef4c6

2023-07-04

Added 'AzureBlobStorageToS3Operator' transfer operator (#32270)

5c72befcfd

2023-07-03

Fix 'LambdaInvokeFunctionOperator' payload parameter type (#32259)

d6e254db68

2023-06-30

Deprecate 'delimiter' param and source object's wildcards in GCS, introduce 'match_glob' param. (#31261)

dd937e51fe

2023-06-30

Add 'on_finish_action' to 'KubernetesPodOperator' (#30718)

e781aef1a7

2023-06-29

aws waiter util: log status info with error level on waiter error (#32247)

a46b942f48

2023-06-29

Add deferrable mode to S3KeysUnchangedSensor (#31940)

b1b69af88f

2023-06-28

Add deferrable mode to 'RdsCreateDbInstanceOperator' and 'RdsDeleteDbInstanceOperator' (#32171)

d029e043f4

2023-06-28

Add 'ChimeNotifier' (#32222)

1d60332cf8

2023-06-28

Add an option to 'GlueJobOperator' to stop the job run when the TI is killed (#32155)

bd2f156bc8

2023-06-28

D205 Support - Providers: Amazon/AWS (#32224)

25526a112f

2023-06-28

Add deferrable mode for 'AthenaOperator' (#32186)

1fb2831239

2023-06-28

Add a deferrable mode to 'BatchCreateComputeEnvironmentOperator' (#32036)

14785bc84c

2023-06-27

deferrable mode for 'SageMakerTuningOperator' and 'SageMakerEndpointOperator' (#32112)

2794c4172e

2023-06-27

D205 Support - Auto-fixes and Stragglers (#32212)

09d4718d3a

2023-06-27

Improve provider documentation and README structure (#32125)

06b5a1e850

2023-06-27

Add deferrable mode in EMR operator and sensor (#32029)

3a85d4e7e8

2023-06-27

Revert "add deferrable mode for 'AthenaOperator' (#32110)" (#32172)

256438c3d6

2023-06-27

add deferrable mode for 'AthenaOperator' (#32110)

e0f4de347f

2023-06-27

EKS Create/Delete Nodegroup Deferrable mode (#32165)

10df7436f3

2023-06-27

Add 'ChimeWebhookHook' (#31939)

e4eb19866e

2023-06-26

rewrite method used in ecs to fetch less logs (#31786)

2f96127b9e

2023-06-26

Minor name change for the util wait method. (#32152)

cc87ae578e

2023-06-26

feature: AWS - GlueJobOperator - job_poll_interval (#32147)

e4468ed380

2023-06-26

Clean up string concatenation (#32129)

8057659e96

2023-06-25

Handle 'UnboundLocalError' while parsing invalid 's3_url' (#32120)

d49fa999a9

2023-06-23

bugfix: break down run+wait method in ECS operator (#32104)

72d09a677f

2023-06-23

Use a waiter in 'AthenaHook' (#31942)

5c887988b0

2023-06-23

Refactor Eks Create Cluster Operator code (#31960)

415e076761

2023-06-23

Deferrable mode for ECS operators (#31881)

479719297f

2023-06-22

add async wait method to the "with logging" aws utils (#32055)

afe293d934

2023-06-21

cleanup Amazon CHANGELOG.rst (#32031)

743bf5a0ae

2023-06-20

Add custom waiters to EMR Serverless  (#30463)

8.2.0

Latest change: 2023-06-20

Commit

Committed

Subject

79bcc2e668

2023-06-20

Prepare RC1 docs for June 2023 wave of Providers (#32001)

8b146152d6

2023-06-20

Add note about dropping Python 3.7 for providers (#32015)

f0b91ac6a7

2023-06-20

Add 'deferrable' param in 'EmrContainerSensor' (#30945)

e01ff4749c

2023-06-19

Add realtime container execution logs for BatchOperator (#31837)

41fb9b4c49

2023-06-17

Deprecate 'wait_for_completion' from 'EcsRegisterTaskDefinitionOperator' and 'EcsDeregisterTaskDefinitionOperator' (#31884)

e0f21f43c6

2023-06-16

Various fixes on ECS run task operator (#31838)

3689cee485

2023-06-15

Use a continuation token to get logs in ecs (#31824)

9be22e4cc0

2023-06-15

Add deferrable option to EmrTerminateJobFlowOperator (#31646)

67204565b8

2023-06-14

Add Deferrable option to EmrCreateJobFlowOperator (#31641)

212a37fbec

2023-06-14

Deferrable mode for EksCreateFargateProfileOperator and EksDeleteFargateProfileOperator (#31657)

688f91b330

2023-06-14

Add deferrable mode to 'BatchSensor'  (#30279)

4e61b654c3

2023-06-08

Fetch status in while loop so as to not exit too early (#31804)

b9b8da79b5

2023-06-08

Add deferrable mode for S3KeySensor (#31018)

0854500769

2023-06-08

Amazon provider docstring improvements (#31729)

3a7c9f277f

2023-06-07

Add Deferrable mode to Emr Add Steps operator (#30928)

359dfb5446

2023-06-07

Added config template field to EmrServerlessStartJobOperator (#31746)

a3768b44e9

2023-06-07

[AWS hook] use provided client to get the official waiter on fallback (#31748)

07ea574fed

2023-06-07

Add D400 pydocstyle check (#31742)

9e268e13b1

2023-06-07

Replace spelling directive with spelling:word-list (#31752)

cda83c226b

2023-06-05

Add D400 pydocstyle check - Amazon provider only (#31423)

c255ac411b

2023-06-05

Support of wildcard in S3ListOperator and S3ToGCSOperator (#31640)

62938e945b

2023-06-05

fix return values on glue operators deferrable mode (#31694)

4c62a4f58b

2023-06-05

Add back missing AsyncIterator import (#31710)

f69dd29e87

2023-06-04

Remove aws unused code (#31610)

a247a8f7c9

2023-06-04

Add deferrable mode in Redshift delete cluster (#30244)

5dc6e5bfbe

2023-06-02

allow anonymous AWS access (#31659)

dc5bf3fd02

2023-06-02

Add discoverability for triggers in provider.yaml (#31576)

635f94cc39

2023-05-31

Add deferrable mode to AWS glue operators (Job & Crawl) (#30948)

a8c45b088e

2023-05-31

handle missing LogUri in emr 'describe_cluster' API response (#31482)

ce7766e0a5

2023-05-31

Add docstring and signature for _read_remote_logs (#31623)

5b3382f638

2023-05-30

Add null check for host in Amazon Redshift connection (#31567)

9fa75aaf7a

2023-05-29

Remove Python 3.7 support (#30963)

fb10108eec

2023-05-27

add workgroup to templated fields (#31574)

5b0f668b6d

2023-05-25

Add deferrable param in BatchOperator (#30865)

aac2f8f0a9

2023-05-24

AWS system test example_dynamodb_to_s3: add retry when fecthing the export time (#31388)

44741f354c

2023-05-24

`` Change Deferrable implementation for RedshiftResumeClusterOperator to follow standard (#30864)``

911bd1cdb8

2023-05-24

Add Deferrable Mode to RedshiftCreateClusterSnapshotOperator (#30856)

0b7c095c9f

2023-05-23

Change Deferrable implementation for RedshiftPauseClusterOperator to follow standard (#30853)

c5597d1fab

2023-05-23

Add Python 3.11 support (#27264)

8.1.0

Latest change: 2023-05-19

Commit

Committed

Subject

45548b9451

2023-05-19

Prepare RC2 docs for May 2023 wave of Providers (#31416)

0b4f1c116a

2023-05-19

Fix AWS system test example_dynamodb (#31395)

abea189022

2023-05-18

Use '__version__' in providers not 'version' (#31393)

f5aed58d9f

2023-05-18

Fixing circular import error in providers caused by airflow version check (#31379)

0b3b6704cb

2023-05-17

Fix AWS system test example_dynamodb_to_s3 (#31362)

e05e3a9db8

2023-05-16

Handle temporary credentials when resource_type is used to get custom waiters (#31333)

d9ff55cf6d

2023-05-16

Prepare docs for May 2023 wave of Providers (#31252)

0117246db6

2023-05-15

Add future-compatible mongo Hook typing (#31289)

3193857376

2023-05-13

Add Deferrable Mode for EC2StateSensor (#31130)

6b21e4b88c

2023-05-13

Bring back detection of implicit single-line string concatenation (#31270)

d6051fd10a

2023-05-12

Add on_kill to EMR Serverless Job Operator (#31169)

8a5fe6ad7d

2023-05-10

Add retries to S3 delete_bucket (#31192)

cd3fa33e82

2023-05-09

DynamoDBToS3Operator - Add a feature to export the table to a point in time. (#31142)

4c9b5fe4c1

2023-05-09

Add deferrable param in SageMakerTransformOperator (#31063)

dff7e0de36

2023-05-08

Revert "DynamoDBToS3Operator - Add feature to export table to a point in time (#30501)" (#31139)

a809c91528

2023-05-08

Add deferrable param in SageMakerTrainingOperator (#31042)

1c144ee141

2023-05-08

Add deferrable param in SageMakerProcessingOperator (#31062)

fc4166127a

2023-05-08

DynamoDBToS3Operator - Add feature to export table to a point in time (#30501)

c99d2d2369

2023-05-05

Import aiobotocore only if deferrable is true (#31094)

e3d9d7dc4c

2023-05-04

Add template field to S3ToRedshiftOperator (#30781)

9c5908e050

2023-05-04

'StepFunctionStartExecutionOperator': get logs in case of failure (#31072)

ac46902154

2023-05-04

Move TaskInstanceKey to a separate file (#31033)

cb71d41c75

2023-05-03

Update return types of 'get_key' methods on 'S3Hook' (#30923)

2d5166f982

2023-05-03

Add extras links to some more EMR Operators and Sensors (#31032)

0a30706aa7

2023-05-03

Use 'AirflowProviderDeprecationWarning' in providers (#30975)

eef5bc7f16

2023-05-03

Add full automation for min Airflow version for providers (#30994)

e4d935e490

2023-05-02

Add tags param in RedshiftCreateClusterSnapshotOperator (#31006)

2f247a2ba2

2023-05-02

Add IAM authentication to Amazon Redshift Connection by AWS Connection (#28187)

9662fd8cc0

2023-05-01

bigfix: EMRHook  Loop through paginated response to check for cluster id (#29732)

a7eb32a5b2

2023-04-30

Bump minimum Airflow version in providers (#30917)

612676b975

2023-04-28

Support 'shareIdentifier' in BatchOperator (#30829)

1f0174931b

2023-04-28

improve/fix glue job logs printing (#30886)

b36c33230f

2023-04-28

BaseAWS - Override client when resource_type is user to get custom waiters (#30897)

8.0.0

Latest change: 2023-04-26

Commit

Committed

Subject

97ad7cee44

2023-04-26

Prepare docs for ad-hoc rc3 of Amazon provider (#30876)

a044a21859

2023-04-26

Fix async conn for none aws_session_token (#30868)

b335e474e2

2023-04-26

Restore aiobotocore as optional dependency of amazon provider (#30874)

84e9cec701

2023-04-25

Prepare docs for ad-hoc release of Amazon provider (#30848)

f3aa33aa13

2023-04-24

Update AWS EMR Cluster Link to use the new dashboard (#30844)

ecaffd5892

2023-04-24

Add a "force" option to emr serverless stop/delete operator (#30757)

62ea0ff21c

2023-04-24

Add support for deferrable operators in AMPP (#30032)

c585ad51c5

2023-04-22

Upgrade ruff to 0.0.262 (#30809)

e6723aa3f0

2023-04-21

fixes to system tests following obsolete cleanup (#30804)

e8b978a4cf

2023-04-21

restore fallback to empty connection behavior (#30806)

e46ce78b66

2023-04-21

Prepare docs for adhoc release of providers (#30787)

e4b8729739

2023-04-21

Remove deprecated code from Amazon provider (#30755)

7e01c09644

2023-04-21

AWS logs. Exit fast when 3 consecutive responses are returned from AWS Cloudwatch logs (#30756)

8a191938b6

2023-04-21

Remove @poke_mode_only from EmrStepSensor (#30774)

fbc1382514

2023-04-21

remove delegate_to from GCP operators and hooks (#30748)

c14bc770f6

2023-04-19

add a stop operator to emr serverless (#30720)

d7cef588d6

2023-04-19

SqlToS3Operator - Add feature to partition SQL table (#30460)

221249e872

2023-04-18

Fixed logging issue (#30703)

38f2b4a4df

2023-04-14

Organize Amazon providers docs index (#30541)

7c2d3617bf

2023-04-14

DynamoDBHook - waiter_path() to consider 'resource_type' or 'client_type' (#30595)

51f9910ecb

2023-04-14

Remove duplicate param docstring in EksPodOperator (#30634)

96661789cc

2023-04-14

New AWS sensor DynamoDBValueSensor (#28338)

92cab74b28

2023-04-12

Add ability to override waiter delay in EcsRunTaskOperator (#30586)

2ce1130006

2023-04-11

Add support in AWS Batch Operator for multinode jobs (#29522)

58294c5440

2023-04-10

Decouple "job runner" from BaseJob ORM model (#30255)

7.4.1

Latest change: 2023-04-09

Commit

Committed

Subject

874ea9588e

2023-04-09

Prepare docs for ad hoc release of Providers (#30545)

fa4fb1f5fe

2023-04-05

Revert "Add AWS deferrable BatchOperator (#29300)" (#30489)

c1b5eafc82

2023-04-05

Add more info to quicksight error messages (#30466)

77c272e6e8

2023-04-05

Add AWS deferrable BatchOperator (#29300)

2736765956

2023-04-05

add template field for s3 bucket (#30472)

d23a3bbed8

2023-04-04

Add mechanism to suspend providers (#30422)

9fc0f20132

2023-04-03

Add s3_bucket to template fields in SFTP to S3 operator (#30444)

8bf4f62ae6

2023-04-03

Fix 'RedshiftResumeClusterOperator' deferrable implementation (#30370)

7.4.0

Latest change: 2023-04-02

Commit

Committed

Subject

55dbf1ff1f

2023-04-02

Prepare docs for April 2023 wave of Providers (#30378)

46d9a0c294

2023-03-21

Make update config behavior optional in GlueJobOperator (#30162)

2a42cb46af

2023-03-21

Move and convert all AWS example dags to system tests (#30003)

05c0841880

2023-03-21

custom waiters with dynamic values, applied to appflow (#29911)

0036ef7d35

2023-03-21

Add deferrable mode to 'RedshiftResumeClusterOperator' (#30090)

b54285d0a1

2023-03-16

Remove aws async ci job (#30127)

4effd6f48b

2023-03-14

Add 'AwsToAwsBaseOperator' (#30044)

cf77c3b966

2023-03-13

Add deferrable mode in RedshiftPauseClusterOperator (#28850)

3780b01fc4

2023-03-10

Add support of a different AWS connection for DynamoDB (#29452)

d2cc9df82c

2023-03-07

Add 'EC2CreateInstanceOperator', 'EC2TerminateInstanceOperator' (#29548)

b6392ae5fd

2023-03-07

Support deleting the local log files when using remote logging (#29772)

bf27e5379c

2023-03-05

Move string enum class to utils module + add test (#29906)

971039454a

2023-03-04

Align cncf provider file names with AIP-21 (#29905)

2cebdc5007

2023-03-03

rewrite polling code for appflow hook (#28869)

7.3.0

Latest change: 2023-03-03

Commit

Committed

Subject

fcd3c0149f

2023-03-03

Prepare docs for 03/2023 wave of Providers (#29878)

76d8aaa836

2023-03-02

Fix Amazon ECS Enums (#29871)

faf792f634

2023-03-02

Implement custom boto waiters for some EMR operators (#29822)

ea8ce218b9

2023-03-02

Impovements for RedshiftDataOperator: better error reporting and an ability to return SQL results (#29434)

181a825259

2023-03-01

Use waiters in ECS Operators instead of inner sensors (#29761)

5de47910f3

2023-03-01

Allow to specify which connection, variable or config are being looked up in the backend using *_lookup_pattern parameters (#29580)

1f7bc1ab3c

2023-02-28

add num rows affected to Redshift Data API hook (#29797)

4b36137a31

2023-02-28

Implement file credentials provider for AWS hook AssumeRoleWithWebIdentity (#29623)

df4abcbcfe

2023-02-27

fix code checking job names in sagemaker (#29245)

38b901ec3f

2023-02-24

Standardize AWS lambda naming (#29749)

5e006d743d

2023-02-23

Avoid emitting fallback message for S3TaskHandler if streaming logs (#29708)

ba2d562cfb

2023-02-22

Add 'wait_for_completion' param in 'RedshiftCreateClusterOperator' (#29657)

6c13f04365

2023-02-22

AWS Glue job hook: Make s3_bucket parameter optional (#29659)

45419e23a9

2023-02-20

'RedshiftDataOperator' replace 'await_result' with 'wait_for_completion' (#29633)

0604033829

2023-02-20

Add Amazon Redshift-data to S3<>RS Transfer Operators (#27947)

7.2.1

Latest change: 2023-02-18

Commit

Committed

Subject

470fdaea27

2023-02-18

Prepare docs for 02 2023 midmonth wave of Providers (#29589)

46d45e09cb

2023-02-17

Explicitly handle exceptions raised by config parsing in AWS provider (#29587)

cadab59e8d

2023-02-15

Fix docstring for EcsRunTaskOperator region_name -> region (#29562)

f9e9d23457

2023-02-11

Restore trigger logging (#29482)

60d4bcd1d1

2023-02-10

Revert "Enable individual trigger logging (#27758)" (#29472)

7.2.0

Latest change: 2023-02-08

Commit

Committed

Subject

ce6ae2457e

2023-02-08

Prepare docs for Feb 2023 wave of Providers (#29379)

1b18a501fe

2023-02-03

Enable individual trigger logging (#27758)

cb0c90bd66

2023-02-02

Decrypt SecureString value obtained by SsmHook (#29142)

efc8857d55

2023-02-01

log the observed status in redshift sensor (#29274)

a671561b8e

2023-01-31

shorten other wait times in sys tests (#29254)

aacf4da7e8

2023-01-30

Use thin/passthrough hook instead of one-liner hook method (#29252)

62825678b3

2023-01-30

Move imports in AWS SqlToS3Operator transfer to callable function (#29045)

5490102a41

2023-01-30

Add option to wait for completion on the EmrCreateJobFlowOperator (#28827)

44024564cb

2023-01-27

fix: 'num_of_dpus' typehints- GlueJobHook/Operator (#29176)

e1a14ae9ee

2023-01-27

Fix false-positive spellcheck failure (#29190)

2493476a7e

2023-01-26

introduce base class for EKS sensors (#29053)

2c4928da40

2023-01-24

introduce a method to convert dictionaries to boto-style key-value lists (#28816)

efaed34213

2023-01-23

Add transfer operator S3 to (generic) SQL (#29085)

6190e34388

2023-01-23

add retries to stop_pipeline on conflict (#29077)

17e8bb7f9e

2023-01-19

Update provide_bucket_name() decorator to handle new conn_type (#28706)

1ab7ea81a1

2023-01-19

uniformize getting hook through cached property in aws sensors (#29001)

395b731b94

2023-01-18

Add log for AWS Glue Job Console URL (#28925)

3a3adfb8e6

2023-01-15

Fix typo in DataSyncHook boto3 methods for create location in NFS and EFS (#28948)

198e96aca1

2023-01-14

Use boto3 intersphinx inventory in documentation/docstrings. (#28945)

7.1.0

Latest change: 2023-01-14

Commit

Committed

Subject

911b708ffd

2023-01-14

Prepare docs for Jan 2023 mid-month wave of Providers (#28929)

923bcd2865

2023-01-13

new operator to create a sagemaker experiment (#28837)

3e4e5b1fdb

2023-01-13

Add ''configuration_overrides'' to templated fields (#28920)

9a643363e9

2023-01-12

Avoid circular import from S3HookUriParseFailure (#28908)

ce858a5d71

2023-01-12

Switch to ruff for faster static checks (#28893)

870ecd477a

2023-01-11

Add a new SSM hook and use it in the System Test context builder (#28755)

3baa40d72c

2023-01-10

Use compat for cached_property in AWS Batch modules (#28835)

3eee33ac8c

2023-01-06

Apply "unify bucket and key" before "provide bucket" (#28710)

3a7cb66784

2023-01-06

Update S3ToRedshiftOperator docs to inform users about multiple key functionality (#28705)

a9493c1317

2023-01-06

Add waiter config params to emr.add_job_flow_steps (#28464)

ce188e5093

2023-01-05

Refactor waiter function and improve unit tests (#28753)

e8533d295e

2023-01-05

Add AWS Sagemaker Auto ML operator and sensor (#28472)

8c5ee5e3c1

2023-01-04

Better exception raised in case of numpy missing (#28722)

9ab9c18d68

2023-01-04

Don't call get_connection from provide_bucket_name (#28716)

7.0.0

Latest change: 2023-01-02

Commit

Committed

Subject

5246c009c5

2023-01-02

Prepare docs for Jan 2023 wave of Providers (#28651)

3ce7cbbda1

2022-12-30

add description of breaking changes (#28582)

297aa7480e

2022-12-23

Add execution role parameter to AddStepsOperator (#28484)

38e40c6dc4

2022-12-21

Remove outdated compat imports/code from providers (#28507)

d9ae90fc64

2022-12-21

Make pandas dependency optional for Amazon Provider (#28505)

39abd5e065

2022-12-21

Add AWS SageMaker operator to register a model's version (#28024)

fefcb1d567

2022-12-20

Add link for EMR Steps Sensor logs (#28180)

e377e869da

2022-12-19

Fix EmrAddStepsOperature wait_for_completion parameter is not working (#28052)

21f0600f69

2022-12-18

Correctly template Glue Jobs 'create_job_kwargs' arg (#28403)

8e0df8881f

2022-12-17

Add Amazon Elastic Container Registry (ECR) Hook (#28279)

29f574301a

2022-12-15

Add EMR Notebook operators (#28312)

381160c0f6

2022-12-14

Fix template rendered bucket_key in S3KeySensor (#28340)

9d9b15989a

2022-12-14

Create 'LambdaCreateFunctionOperator' and sensor (#28241)

27569a8b37

2022-12-13

Better support for Boto Waiters (#28236)

fb5182bb2f

2022-12-12

Fix S3KeySensor documentation (#28297)

1eaedc8ae8

2022-12-08

Improve docstrings for 'AwsLambdaInvokeFunctionOperator' (#28233)

a6315c2f4e

2022-12-08

Amazon Provider Package user agent (#27823)

0d90c62bac

2022-12-06

Fix Type Error while using DynamoDBToS3Operator (#28158)

b609ab9001

2022-12-06

AWSGlueJobHook updates job configuration if it exists (#27893)

3ee5c404b7

2022-12-06

Fix GlueCrawlerOperature failure when using tags (#28005)

0da004838f

2022-12-06

Allow waiter to be configured via EmrServerless Operators (#27784)

0ef8d934f2

2022-12-06

Add operators + sensor for aws sagemaker pipelines (#27786)

7398853c86

2022-12-06

Update RdsHook docstrings to match correct argument names (#28108)

8f0265d0d9

2022-12-05

AWS Secrets Manager Backend - major update (#27920)

8cf6dca36b

2022-12-05

add some important log in aws athena hook (#27917)

4a3a429658

2022-12-03

[misc] Get rid of 'pass' statement in conditions (#27775)

527b948856

2022-12-03

[misc] Replace XOR '^' conditions by 'exactly_one' helper in providers (#27858)

0cd969c9c1

2022-12-02

Lambda hook: make runtime and handler optional (#27778)

6.2.0

Latest change: 2022-11-26

Commit

Committed

Subject

25bdbc8e67

2022-11-26

Updated docs for RC3 wave of providers (#27937)

2ab5c1fdf0

2022-11-26

Add retry option in RedshiftDeleteClusterOperator to retry when an operation is running in the cluster (#27820)

2e20e9f7eb

2022-11-24

Prepare for follow-up relase for November providers (#27774)

80c327bd3b

2022-11-24

Bump common.sql provider to 1.3.1 (#27888)

336e065e6a

2022-11-23

Correct job name matching in SagemakerProcessingOperator (#27634)

239440df23

2022-11-17

System Test for EMR (AIP-47) (#27286)

2bba98f109

2022-11-17

Use Boto waiters instead of customer _await_status method for RDS Operators (#27410)

2063e141e4

2022-11-17

Handle transient state errors in 'RedshiftResumeClusterOperator' and 'RedshiftPauseClusterOperator' (#27276)

6.1.0

Latest change: 2022-11-15

Commit

Committed

Subject

12c3c39d1a

2022-11-15

pRepare docs for November 2022 wave of Providers (#27613)

00af5c007e

2022-11-14

Replace urlparse with urlsplit (#27389)

0a059eea67

2022-11-11

sagemaker operators: mutualize init of aws_conn_id (#27579)

c490a328f4

2022-11-11

CloudWatch task handler doesn't fall back to local logs when Amazon CloudWatch logs aren't found (#27564)

9f9ab30218

2022-11-11

SagemakerProcessingOperator stopped honoring 'existing_jobs_found' (#27456)

f919abc918

2022-11-10

Fix backwards compatibility for RedshiftSQLOperator (#27602)

a5c0aeb566

2022-11-10

Add info about JSON Connection format for AWS SSM Parameter Store Secrets Backend (#27134)

2ef15c5da0

2022-11-10

Add default name to EMR Serverless jobs (#27458)

4dc9b1c592

2022-11-08

Sagemaker hook: remove extra call at the end when waiting for completion (#27551)

d479b99388

2022-11-07

Fix typo in redshift sql hook get_ui_field_behaviour (#27533)

5cd78cf425

2022-11-06

Upgrade dependencies in order to avoid backtracking (#27531)

531f2d2116

2022-11-04

Code quality improvements on sagemaker operators/hook (#27453)

1bbd8fe3ef

2022-10-28

Fix example_emr_serverless system test (#27149)

9e2eac3b6c

2022-10-28

Fix param in docstring RedshiftSQLHook get_table_primary_key method (#27330)

9ab1a6a3e7

2022-10-27

Update old style typing (#26872)

6b2dc6f2cc

2022-10-27

System test for SQL to S3 Transfer (AIP-47) (#27097)

777b57f0c6

2022-10-26

Adding 'preserve_file_name' param to 'S3Hook.download_file' method (#26886)

6a1a6f7bef

2022-10-26

Adds s3_key_prefix to template fields (#27207)

78b8ea2f22

2022-10-24

Move min airflow version to 2.3.0 for all providers (#27196)

2a34dc9e84

2022-10-23

Enable string normalization in python formatting - providers (#27205)

737e50a02a

2022-10-21

Fix assume role if user explicit set credentials (#26946)

0e8dcdc4ff

2022-10-21

Add GlacierUploadArchiveOperator (#26652)

a2413cf6ca

2022-10-19

Add RdsStopDbOperator and RdsStartDbOperator (#27076)

d4bfccb3c9

2022-10-19

ECS Buglette (#26921)

9fed22fc99

2022-10-18

'GoogleApiToS3Operator' : add 'gcp_conn_id' to template fields (#27017)

ecd4d6654f

2022-10-18

Add SQLExecuteQueryOperator (#25717)

f8d7290178

2022-10-10

Improve testing AWS Connection response (#26953)

66294de4e0

2022-10-10

Fix failure state in waiter call for EmrServerlessStartJobOperator. (#26853)

62d5bab3b4

2022-10-10

Convert emr_eks example dag to system test (#26723)

e68c8b9d52

2022-10-10

System test for Dynamo DB (#26729)

f17abcc931

2022-10-09

ECS System Test (#26808)

db02c29789

2022-10-09

RDS Instance System Tests (#26733)

6dd4593829

2022-10-07

Fix a bunch of deprecation warnings AWS tests (#26857)

8a1bbcfcb3

2022-10-06

Avoid circular imports in AWS Secrets Backends if obtain secrets from config (#26784)

f3ad164aef

2022-10-01

Add information about Amazon Elastic MapReduce Connection (#26687)

9c59312fbc

2022-10-01

Fix null strings bug in SqlToS3Operator in non parquet formats (#26676)

677df10254

2022-09-30

Add BatchOperator template fields (#26805)

6.0.0

Latest change: 2022-09-28

Commit

Committed

Subject

ec1615b589

2022-09-28

Fix errors in CHANGELOGS for slack and amazon (#26746)

f8db64c35c

2022-09-28

Update docs for September Provider's release (#26731)

4970bccfa6

2022-09-27

Change links to 'boto3' documentation (#26708)

89e44c46ad

2022-09-27

Remove duplicated connection-type within the provider (#26628)

9b232846b3

2022-09-26

Redshift to S3 and S3 to Redshift System test (AIP-47) (#26613)

0c7b4cbf62

2022-09-22

Fix SageMakerEndpointConfigOperator's return value (#26541)

d0951366d7

2022-09-21

Convert example_eks_with_fargate_in_one_step.py and example_eks_with_fargate_profile to AIP-47 (#26537)

cf73cb79d7

2022-09-21

Remove Amazon S3 Connection Type (#25980)

956ea7c40e

2022-09-21

Redshift System Test (AIP-47) (#26187)

5b2d0e02c6

2022-09-21

GoogleAPIToS3Operator System Test (AIP-47) (#26370)

23d4f632d7

2022-09-21

Convert EKS with Nodegroups sample DAG to a system test (AIP-47) (#26539)

156fbd0c67

2022-09-21

Convert EC2 sample DAG to system test (#26540)

0751b77048

2022-09-21

Convert S3 example DAG to System test (AIP-47) (#26535)

8f1c78f6e0

2022-09-19

EMR Serverless Fix for Jobs marked as success even on failure (#26218)

a2b186a152

2022-09-19

Fix AWS Connection warn condition for invalid 'profile_name' argument (#26464)

f51587e85e

2022-09-19

Remove redundand catch exception in Amazon Log Task Handlers (#26442)

13892883cf

2022-09-19

Convert 'example_eks_with_nodegroup_in_one_step' sample DAG to system test (AIP-47) (#26410)

3783be420c

2022-09-19

Migrate DMS sample dag to system test (#26270)

1f7b296227

2022-09-18

Auto tail file logs in Web UI (#26169)

06acf40a43

2022-09-13

Apply PEP-563 (Postponed Evaluation of Annotations) to non-core airflow (#26289)

d5820a77e8

2022-09-12

Athena and EMR operator max_retries mix-up fix (#25971)

a45ab47d7a

2022-09-09

Add RdsDbSensor to amazon provider package (#26003)

5066844513

2022-09-09

D400 first line should end with period batch02 (#25268)

1573ab9014

2022-09-06

Fixes SageMaker operator return values (#23628)

751cb9a826

2022-09-05

Set template_fields on RDS operators (#26005)

5.1.0

Latest change: 2022-09-05

Commit

Committed

Subject

25d0baa4ee

2022-09-05

Prepare bug-fix release of providers out of band (#26109)

6c57acc654

2022-08-31

Additional mask aws credentials (#26014)

6d703dd9e1

2022-08-31

Fix display aws connection info (#26025)

8acdc2a834

2022-08-30

Replace SQL with Common SQL in pre commit (#26058)

1d06374194

2022-08-30

Hook into Mypy to get rid of those cast() (#26023)

1ed014647e

2022-08-29

Add 'output' property to MappedOperator (#25604)

dbfa6487b8

2022-08-27

Fix 'EcsBaseOperator' and 'EcsBaseSensor' arguments (#25989)

c9c89e5c3b

2022-08-27

Add RedshiftDeleteClusterSnapshotOperator (#25975)

695e1a53f8

2022-08-27

Raise an error on create bucket if use regional endpoint for us-east-1 and region not set (#25945)

b75797e809

2022-08-27

Fix EMR serverless system test (#25969)

810f3847c2

2022-08-27

Update AWS system tests to use SystemTestContextBuilder (#25748)

626a54904a

2022-08-26

Convert Quicksight Sample DAG to System Test (#25696)

994f18872a

2022-08-25

Add redshift create cluster snapshot operator (#25857)

1a1f352479

2022-08-23

Add Airflow specific warning classes (#25799)

6b7a343b25

2022-08-22

Implement 'EmrEksCreateClusterOperator' (#25816)

e1ace8d018

2022-08-21

Fix RDS system test (#25839)

f1e0a48500

2022-08-19

Avoid circular import problems when instantiating AWS SM backend (#25810)

92fce4fe87

2022-08-19

Improve error handling/messaging around bucket exist check (#25805)

ca9229b6fe

2022-08-18

Add common-sql lower bound for common-sql (#25789)

b9b8841ef3

2022-08-16

Allow AWS Secrets Backends use AWS Connection capabilities (#25628)

762588dcf4

2022-08-15

fix bug construction of Connection object in version 5.0.0rc3 (#25716)

1b412c9cbe

2022-08-10

Consolidate to one 'schedule' param (#25410)

5.0.0

Latest change: 2022-08-10

Commit

Committed

Subject

5923788143

2022-08-10

Fix CHANGELOG for common.sql provider and add amazon commit (#25636)

358593c6b6

2022-08-10

Enable multiple query execution in RedshiftDataOperator (#25619)

e5ac6c7cfb

2022-08-10

Prepare docs for new providers release (August 2022) (#25618)

8a1b7d43e0

2022-08-10

Refactor monolithic ECS Operator into Operators, Sensors, and a Hook (#25413)

85137f3763

2022-08-09

Remove deprecated modules from Amazon provider package (#25609)

a0212a3593

2022-08-08

refactor: Deprecate parameter 'host' as an extra attribute for the connection. Depreciation is happening in favor of 'endpoint_url' in extra. (#25494)

ae7bf47410

2022-08-07

Avoid requirement that AWS Secret Manager JSON values be urlencoded. (#25432)

65ac62867e

2022-08-07

Get boto3.session.Session by appropriate method (#25569)

33fbe75dd5

2022-08-06

System test for EMR Serverless  (#25559)

029e3ae96f

2022-08-05

Remove deprecated modules (#25543)

d4f560b98e

2022-08-05

Fix S3Hook transfer config arguments validation (#25544)

8df84e99b7

2022-08-05

Add EMR Serverless Operators and Hooks (#25324)

4193558e80

2022-08-05

Resolve Amazon Hook's 'region_name' and 'config' in wrapper (#25336)

171aaf017a

2022-08-04

Hide unused fields for Amazon Web Services connection (#25416)

cd14f3f65a

2022-08-03

Convert Local to S3 example DAG to System Test (AIP-47) (#25345)

007b1920dd

2022-08-02

Enable Auto-incrementing Transform job name in SageMakerTransformOperator (#25263)

c6d3b48d5d

2022-07-28

Convert ECS Fargate Sample DAG to System Test (#25316)

432977be0c

2022-07-26

Resolve and validate AWS Connection parameters in wrapper (#25256)

ceb1658565

2022-07-22

Fix BatchOperator links on wait_for_completion = True (#25228)

df00436569

2022-07-22

Unify DbApiHook.run() method with the methods which override it (#23971)

d66e427c4d

2022-07-22

Sagemaker System Tests - Part 3 of 3 - example_sagemaker_endpoint.py (AIP-47) (#25134)

f6bda38e20

2022-07-21

Convert RDS Export Sample DAG to System Test (AIP-47) (#25205)

47b72056c4

2022-07-21

SQSPublishOperator should allow sending messages to a FIFO Queue (#25171)

6d41067cf7

2022-07-19

Standardize AwsLambda (#25100)

c6d9bccdb6

2022-07-19

AIP-47 - Migrate redshift DAGs to new design #22438 (#24239)

5a77c46bf0

2022-07-19

Glue Job Driver logging (#25142)

c48c185627

2022-07-18

Convert Glue Sample DAG to System Test (#25136)

693fe60de4

2022-07-18

Makes changes to SqlToS3Operator method _fix_int_dtypes (#25083)

b7f51b9156

2022-07-18

Convert the batch sample dag to system tests (AIP-47) (#24448)

e32e9c5880

2022-07-18

Bump typing-extensions and mypy for ParamSpec (#25088)

77f51dcf72

2022-07-16

Migrate datasync sample dag to system tests (AIP-47) (#24354)

d872edacfe

2022-07-16

Sagemaker System Tests - Part 2 of 3 - example_sagemaker.py (#25079)

f611b1feff

2022-07-15

Migrate lambda sample dag to system test (AIP-47) (#24355)

543161a1af

2022-07-15

SageMaker system tests - Part 1 of 3 - Prep Work (AIP-47) (#25078)

4.1.0

Latest change: 2022-07-13

Commit

Committed

Subject

d2459a241b

2022-07-13

Add documentation for July 2022 Provider's release (#25030)

109acc75c4

2022-07-08

Convert RDS Event and Snapshot Sample DAGs to System Tests (#24932)

60c2a3bf82

2022-07-08

Refactor and fix AWS secret manager invalid exception (#24898)

c1526a2888

2022-07-07

Convert Step Functions Example DAG to System Test (AIP-47) (#24643)

46bbfdade0

2022-07-07

Move all SQL classes to common-sql provider (#24836)

c61f86dde5

2022-07-05

Update AWS Connection docs and deprecate some extras (#24670)

210549c658

2022-07-04

Add test_connection method to AWS hook (#24662)

e2fd41f7b1

2022-07-04

Remove 'xcom_push' flag from providers (#24823)

46ac083f7e

2022-07-01

Align Black and blacken-docs configs (#24785)

49925be664

2022-07-01

Restore Optional value of script_location (#24754)

0de31bd73a

2022-06-29

Move provider dependencies to inside provider folders (#24672)

45b11d4ed1

2022-06-29

Use our yaml util in all providers (#24720)

bf727525e1

2022-06-28

Add AWS operators to create and delete RDS Database (#24099)

510a6bab45

2022-06-28

Remove 'hook-class-names' from provider.yaml (#24702)

9b4a053bc6

2022-06-28

Add batch option to 'SqsSensor' (#24554)

9c59831ee7

2022-06-21

Update providers to use functools compat for ''cached_property'' (#24582)

e477f4ba6c

2022-06-21

Amazon appflow (#24057)

7293e31f1c

2022-06-20

Make extra_args in S3Hook immutable between calls (#24527)

f48112ccff

2022-06-20

Convert SQS Sample DAG to System Test (#24513)

796e0a0b52

2022-06-19

fix: RedshiftDataHook and RdsHook not use cached connection (#24387)

cfbcd31b69

2022-06-14

Convert Cloudformation Sample DAG to System Test (#24447)

7d8a17b210

2022-06-14

Add AWS Batch & AWS CloudWatch Extra Links (#24406)

08b675cf66

2022-06-13

Fix links to sources for examples (#24386)

a1e417c4fe

2022-06-12

Convert SNS Sample DAG to System Test (#24384)

19dd9f5873

2022-06-12

Refactoring EmrClusterLink and add for other AWS EMR Operators (#24294)

7fed7f31c3

2022-06-11

Fix S3KeySensor. See #24321 (#24378)

99d9833631

2022-06-10

Fix: 'emr_conn_id' should be optional in 'EmrCreateJobFlowOperator' (#24306)

4.0.0

Latest change: 2022-06-09

Commit

Committed

Subject

dcdcf3a2b8

2022-06-09

Update release notes for RC2 release of Providers for May 2022 (#24307)

dc9c083a4b

2022-06-08

fix: patches #24215. Won't raise KeyError when 'create_job_kwargs' contains the 'Command' key. (#24308)

717a7588bc

2022-06-07

Update package description to remove double min-airflow specification (#24292)

b1ad017cee

2022-06-07

pydocstyle D202 added (#24221)

aeabe994b3

2022-06-07

Prepare docs for May 2022 provider's release (#24231)

b88ce95188

2022-06-07

Update doc and sample dag for EMR Containers (#24087)

c23826915d

2022-06-07

Apply per-run log templates to log handlers (#24153)

41898d8922

2022-06-06

Refactor GlueJobHook get_or_create_glue_job method. (#24215)

027b707d21

2022-06-05

Add explanatory note for contributors about updating Changelog (#24229)

daa138c8eb

2022-06-04

fix: StepFunctionHook ignores explicit set 'region_name' (#23976)

5b32966c35

2022-06-03

Remove old Athena Sample DAG (#24170)

595981c8ad

2022-05-31

Light Refactor and Clean-up AWS Provider (#23907)

94f2ce9342

2022-05-30

Add partition related methods to GlueCatalogHook: (#23857)

92ddcf4ac6

2022-05-27

Introduce 'flake8-implicit-str-concat' plugin to static checks (#23873)

47fc253ea4

2022-05-24

Move string arg evals to 'execute()' in 'EksCreateClusterOperator' (#23877)

ec6761a5c0

2022-05-23

Clean up f-strings in logging calls (#23597)

5d2296becb

2022-05-22

Fix Amazon EKS example DAG raises warning during Imports (#23849)

e54ca47262

2022-05-22

Add support for associating  custom tags to job runs submitted via EmrContainerOperator (#23769)

69f444f87a

2022-05-22

Add number of node params only for single-node cluster in RedshiftCreateClusterOperator (#23839)

509b277dce

2022-05-22

Update sample dag and doc for RDS (#23651)

4c9f756035

2022-05-20

Reformat the whole AWS documentation (#23810)

fb3b980b5d

2022-05-19

Update the DMS Sample DAG and Docs (#23681)

64d0d9cd92

2022-05-17

Add AWS project structure tests (re: AIP-47) (#23630)

ca25436108

2022-05-16

Add doc and sample dag for GCSToS3Operator (#23730)

1a8f1ee276

2022-05-12

Update doc and sample dag for Quicksight (#23653)

094e50eb43

2022-05-12

Replace "absolute()" with "resolve()" in pathlib objects (#23675)

3.4.0

Latest change: 2022-05-12

Commit

Committed

Subject

75c60923e0

2022-05-12

Prepare provider documentation 2022.05.11 (#23631)

3ed895bb7b

2022-05-11

Add 'RedshiftDeleteClusterOperator' support (#23563)

5c149c341e

2022-05-10

Add Quicksight create ingestion Hook and Operator (#21863)

d21e49dfda

2022-05-10

Add sample dag and doc for S3ListPrefixesOperator (#23448)

7354d2eac9

2022-05-09

Add sample dag and doc for S3ListOperator (#23449)

389676bb0d

2022-05-09

Add doc and sample dag for EC2 (#23547)

428a439953

2022-05-09

Clean up in-line f-string concatenation (#23591)

ec4dcce338

2022-05-09

Update sample dag and doc for Datasync (#23511)

5d1e6ff19a

2022-05-09

Add default 'aws_conn_id' to SageMaker Operators #21808 (#23515)

c3386c5fcf

2022-05-09

Fix conn close error on retrieving log events (#23470)

ad863ce510

2022-05-08

Amazon Sagemaker Sample DAG and docs update (#23256)

27a80511ec

2022-05-07

Fix LocalFilesystemToS3Operator and S3CreateObjectOperator to support full s3:// style keys (#23180)

46af5baba8

2022-05-07

Update the Athena Sample DAG and Docs (#23428)

6065d1203e

2022-05-06

Update docs Amazon Glacier Docs (#23372)

7f40fa0130

2022-05-04

Add doc and example dag for Amazon SQS Operators (#23312)

2d109401b3

2022-05-04

Bump pre-commit hook versions (#22887)

d6141c6594

2022-05-01

Fix attempting to reattach in 'ECSOperator' (#23370)

fa0d93418b

2022-04-30

Allow back script_location in Glue to be None (#23357)

9021c2b97d

2022-04-26

Fix doc build failure on main (#23240)

754e293c54

2022-04-26

Add RedshiftCreateClusterOperator

ff85c12f4a

2022-04-26

Fix "Chain not supported for different length Iterable"

444794446d

2022-04-26

Add sample dag and doc for S3KeysUnchangedSensor

692a089943

2022-04-25

Add doc and sample dag for S3FileTransformOperator

8cfb2be989

2022-04-25

Add doc and example dag for AWS Step Functions Operators

d91b6cd40f

2022-04-23

'S3Hook': fix 'load_bytes' docstring (#23182)

8b6b0848a3

2022-04-23

Use new Breese for building, pulling and verifying the images. (#23104)

9e1ac6e425

2022-04-20

Add 'S3CreateObjectOperator' (#22758)

ddb5d9b4a2

2022-04-14

Add doc and sample dag for S3CopyObjectOperator and S3DeleteObjectsOperator (#22959)

dffb0d27f2

2022-04-12

Deprecate 'S3PrefixSensor' and 'S3KeySizeSensor' in favor of 'S3KeySensor' (#22737)

6933022e94

2022-04-10

Fix new MyPy errors in main (#22884)

3.3.0

Latest change: 2022-04-07

Commit

Committed

Subject

56ab82ed7a

2022-04-07

Prepare mid-April provider documentation. (#22819)

de84eaf1b0

2022-04-06

Pass custom headers through in SES email backend (#22667)

e7650b85a3

2022-03-31

Add doc and sample dag for SqlToS3Operator (#22603)

898d31e9c2

2022-03-31

Adds HiveToDynamoDB Transfer Sample DAG and Docs (#22517)

616a5dd4d7

2022-03-31

Add doc and sample dag for MongoToS3Operator (#22575)

55ee62e28a

2022-03-31

Add doc for LocalFilesystemToS3Operator (#22574)

02526b3f64

2022-03-27

Add doc and example dag for AWS CloudFormation Operators (#22533)

df473d7e89

2022-03-27

GoogleApiToS3Operator: update sample dag and doc (#22507)

d91b8334f0

2022-03-27

SalesforceToS3Operator: update sample dag and doc (#22489)

8ade99f97d

2022-03-27

Add doc and sample dag for S3ToFTPOperator and FTPToS3Operator (#22534)

7ab45d41d6

2022-03-24

Update secrets backends to use get_conn_value instead of get_conn_uri (#22348)

3.2.0

Latest change: 2022-03-22

Commit

Committed

Subject

d7dbfb7e26

2022-03-22

Add documentation for bugfix release of Providers (#22383)

4de9d6622c

2022-03-22

ImapAttachmentToS3Operator: fix it, update sample dag and update doc (#22351)

e972b6a48d

2022-03-21

Add docs and example dag for AWS Glue (#22295)

dd0cbaad3f

2022-03-21

Update doc and sample dag for S3ToSFTPOperator and SFTPToS3Operator (#22313)

5eb6335742

2022-03-19

Update sample dag and doc for S3CreateBucketOperator, S3PutBucketTaggingOperator, S3GetBucketTaggingOperator, S3DeleteBucketTaggingOperator, S3DeleteBucketOperator (#22312)

926f6d1894

2022-03-15

Add arguments to filter list: start_after_key, from_datetime, to_datetime, object_filter callable (#22231)

3.1.1

Latest change: 2022-03-14

Commit

Committed

Subject

16adc035b1

2022-03-14

Add documentation for Classifier release for March 2022 (#22226)

46c61ed3e9

2022-03-14

EMR Sample DAG and Docs Update (#22189)

c1ab8e2d7b

2022-03-14

Protect against accidental misuse of XCom.get_value() (#22244)

4f6d24f865

2022-03-14

use different logger to avoid duplicate log entry (#22256)

6f8f535619

2022-03-14

Add sample dags and update doc for RedshiftClusterSensor, RedshiftPauseClusterOperator and RedshiftResumeClusterOperator (#22128)

a840561e1f

2022-03-13

AWS RDS integration fixes (#22125)

d08284ed25

2022-03-11

`` Add map_index to XCom model and interface (#22112)``

46a120dc5f

2022-03-11

Fix RedshiftDataOperator and update doc (#22157)

e63f6e36d1

2022-03-11

additional information in the ECSOperator around support of launch_type=EXTERNAL (#22093)

16ad03cae5

2022-03-11

Bugfix for retrying on provision failuers(#22137)

bd809bc83a

2022-03-09

If uploading task logs to S3 fails, retry once (#21981)

45162565db

2022-03-08

EMR on EKS Sample DAG and Docs Update (#22095)

c7286e5306

2022-03-08

Bug-fix GCSToS3Operator (#22071)

184a46fc93

2022-03-08

refactors polling logic for athena queries (#21488)

a150ee0bc1

2022-03-08

Add template fields to DynamoDBToS3Operator (#22080)

c8d49f63ca

2022-03-08

fixes query status polling logic (#21423)

374354dda7

2022-03-08

Dynamo to S3 Sample DAG and Docs (#21920)

c1faaf3745

2022-03-07

Add sample dag and doc for RedshiftToS3Operator (#22060)

f5b96315fe

2022-03-07

Add documentation for Feb Providers release (#22056)

0209a5c3f0

2022-03-07

Add docs and sample dags for AWS Batch (#22010)

01a1a263fd

2022-03-07

retry on very specific eni provision failures (#22002)

c22fb319ff

2022-03-07

Cleanup RedshiftSQLOperator documentation (#21976)

7724a5a2ec

2022-03-07

Move S3ToRedshiftOperator documentation to transfer dir (#21975)

80c52a1875

2022-03-06

Added AWS RDS sensors (#21231)

f968eba470

2022-03-06

Added AWS RDS operators (#20907)

a9b7dd6900

2022-03-06

Resolve mypy issue in athena example dag (#22020)

9ce45ff756

2022-03-04

Rename 'S3' hook name to 'Amazon S3' (#21988)

af79df69b2

2022-03-02

Add RedshiftDataHook (#19137)

3f9295a4f4

2022-03-02

Update ECS sample DAG and Docs to new standards (#21828)

08575ddd8a

2022-03-01

Change BaseOperatorLink interface to take a ti_key, not a datetime (#21798)

33edeb2cb1

2022-03-01

Feature: Add invoke lambda function operator (#21686)

3218cca14b

2022-03-01

Fix the Type Hints in ''RedshiftSQLOperator'' (#21885)

c819b4f8d0

2022-02-28

Configurable AWS Session Factory (#21778)

5276ef8ad9

2022-02-28

Add JSON output on SqlToS3Operator (#21779)

cb24ee9414

2022-02-27

Add SageMakerDeleteModelOperator (#21673)

f0b6398dd6

2022-02-26

Bug Fix - S3DeleteObjectsOperator will try and delete all keys (#21458)

037865970b

2022-02-26

Added Hook for Amazon RDS. Added 'boto3_stub' library for autocomplete. (#20642)

dec05fb6b2

2022-02-19

Update EKS sample DAGs and docs (#21523)

b28f4c578c

2022-02-19

Fix Amazon SES emailer signature (#21681)

fc44836504

2022-02-15

S3KeySensor to use S3Hook url parser (#21500)

69bf74f9a6

2022-02-15

Fix EcsOperatorError, so it can be loaded from a picklefile (#21441)

21a90c5b7e

2022-02-15

Get log events after sleep to get all logs (#21574)

8e81615edb

2022-02-11

[doc] Improve s3 operator example by adding task upload_keys (#21422)

2c5f636e5c

2022-02-11

Use temporary file in GCSToS3Operator (#21295)

598e836043

2022-02-09

Added SNS example DAG and rst (#21475)

0a3ff43d41

2022-02-08

Add pre-commit check for docstring param types (#21398)

3.0.0

Latest change: 2022-02-08

Commit

Committed

Subject

d94fa37830

2022-02-08

Fixed changelog for January 2022 (delayed) provider's release (#21439)

33ca0f2654

2022-02-08

eks_hook log level fatal -> FATAL  (#21427)

8f81b9a01c

2022-02-08

Add conditional 'template_fields_renderers' check for new SQL lexers (#21403)

d1150182cb

2022-02-06

Bug fix in AWS glue operator related to num_of_dpus #19787 (#21353)

0a6ea572fb

2022-02-06

Fix to check if values are integer or float and convert accordingly. (#21277)

6c3a67d4fc

2022-02-05

Add documentation for January 2021 providers release (#21257)

39e395f981

2022-02-04

Add more SQL template fields renderers (#21237)

ddb5246bd1

2022-02-03

Refactor operator links to not create ad hoc TaskInstances (#21285)

5185d6ab26

2022-01-29

Alleviate import warning for 'EmrClusterLink' in deprecated AWS module (#21195)

7ae156fd29

2022-01-29

[SQSSensor] Add opt-in to disable auto-delete messages (#21159)

ff4939f23c

2022-01-25

Remove ':type' directives from 'SqlToS3Operator' (#21079)

bad070f7f4

2022-01-24

Create a generic operator SqlToS3Operator and deprecate the MySqlToS3Operator.  (#20807)

c5ffe0c2da

2022-01-23

fix: cloudwatch logs fetch logic (#20814)

27b77d37a9

2022-01-21

Fix all Amazon Provider MyPy errors (#20935)

73c0d241d8

2022-01-21

Remove a few stray ':type's in docs (#21014)

a59a2be571

2022-01-21

Move some base_aws logging from info to debug level (#20858)

602abe8394

2022-01-20

Remove ':type' lines now sphinx-autoapi supports typehints (#20951)

34efb42ebe

2022-01-20

Rename params to cloudformation_parameter in CloudFormation operators. (#20989)

730db3fb77

2022-01-18

Remove all "fake" stub files (#20936)

307d356519

2022-01-14

AWS: Adds support for optional kwargs in the EKS Operators (#20819)

b15027410b

2022-01-14

Fix MyPy issues in AWS Sensors (#20863)

ce06e6b917

2022-01-13

AwsAthenaOperator: do not generate ''client_request_token'' if not provided (#20854)

f8fd0f7b4c

2022-01-13

Explain stub files are introduced for Mypy errors in examples (#20827)

341b461e4f

2022-01-09

Fix mypy in providers/aws/hooks (#20353)

6776586904

2022-01-09

Standardize AWS SQS classes names (#20732)

88e3f2ae5e

2022-01-08

Rename amazon EMR hook name (#20767)

0ebd55e0f8

2022-01-06

Standardize AWS Batch naming (#20369)

88ea157507

2022-01-06

Standardize AWS Redshift naming (#20374)

51dc4fd808

2022-01-06

Fix MyPy issues in AWS Sensors (#20717)

dd12cfcfe9

2022-01-06

Fix MyPy in Amazon provider for Sagemaker operator (#20715)

cf5c31137d

2022-01-06

Fix MyPy errors for Amazon DMS in hooks and operator (#20710)

6af2137ef0

2022-01-06

Fix MyPy issues in ''airflow/providers/amazon/aws/transfers'' (#20708)

1fc0fa5ea9

2022-01-06

Standardize DynamoDB naming (#20360)

9c0ba1b6ab

2022-01-04

Standardize AWS ECS naming (#20332)

2.6.0

Latest change: 2021-12-31

Commit

Committed

Subject

f77417eb0d

2021-12-31

Fix K8S changelog to be PyPI-compatible (#20614)

97496ba2b4

2021-12-31

Update documentation for provider December 2021 release (#20523)

83f8e178ba

2021-12-31

Even more typing in operators (template_fields/ext) (#20608)

746ee587da

2021-12-31

Delete pods by default in KubernetesPodOperator (#20575)

b164124bfe

2021-12-31

Fix mypy errors in amazon aws transfer (#20590)

d56e7b56bb

2021-12-30

Fix template_fields type to have MyPy friendly Sequence type (#20571)

6d25d63679

2021-12-30

Fixe static checks on few other not sorted stub files (#20572)

a3caea0903

2021-12-30

Fix mypy aws example dags (#20497)

a0821235fb

2021-12-30

Use typed Context EVERYWHERE (#20565)

051fac0776

2021-12-29

Add support to replace S3 file on MySqlToS3Operator (#20506)

2ab2ae8849

2021-12-22

Fix backwards compatibility issue in AWS provider's _get_credentials (#20463)

d557965bab

2021-12-21

Organize Sagemaker classes in Amazon provider (#20370)

1ce71f823f

2021-12-21

move emr_container hook (#20375)

4dd751d2fc

2021-12-20

Standardize AWS Athena naming (#20305)

ecbe160797

2021-12-20

Standardize AWS EKS naming (#20354)

463e3b2b25

2021-12-19

Fix mypy errors in aws/transfers (#20403)

404cd2eb69

2021-12-19

Fix mypy errors in aws/sensors (#20402)

1f4710f16a

2021-12-19

Fix mypy errors in providers/amazon/aws/operators (#20401)

1baa648e2a

2021-12-19

Standardize AWS Glue naming (#20372)

5769defb2a

2021-12-18

Add aws_conn_id to DynamoDBToS3Operator (#20363)

cef498efe9

2021-12-18

Standardize Amazon SES naming (#20367)

2a3db4d385

2021-12-17

Standardize AWS CloudFormation naming (#20357)

bb82cc0fbb

2021-12-17

Fix deprecation messages after splitting redshift modules (#20366)

ca492e1681

2021-12-17

Standardize AWS Lambda naming (#20365)

f6a41a036d

2021-12-17

Standardize AWS Kinesis/Firehose naming (#20362)

3d354084ef

2021-12-17

Standardize Amazon SNS naming (#20368)

bfcaf195a5

2021-12-16

Split redshift sql and cluster objects (#20276)

a3870611a7

2021-12-16

Organize EMR classes in Amazon provider (#20160)

206cce971d

2021-12-16

ECSOperator: fix KeyError on missing exitCode (#20264)

38fd65dcfe

2021-12-16

Rename DataSync Hook and Operator (#20328)

2fb5e1d0ec

2021-12-15

Fix cached_property MyPy declaration and related MyPy errors (#20226)

5712e2b587

2021-12-15

Deprecate passing execution_date to XCom methods (#19825)

60b72dd8f5

2021-12-14

Organize Dms classes in Amazon provider (#20156)

e77c05fa1b

2021-12-13

Add RedshiftResumeClusterOperator and RedshiftPauseClusterOperator (#19665)

a208463802

2021-12-13

Organize S3 Classes in Amazon Provider (#20167)

1d2f2d3dfe

2021-12-13

Organize Step Function classes in Amazon provider (#20158)

985bb06ba5

2021-12-09

Organize EC2 classes in Amazon provider (#20157)

0e2a0ccd30

2021-12-08

Added function in AWSAthenaHook to get s3 output query results file URI  (#20124)

6e15e3a65e

2021-12-06

Bug fix in AWS glue operator when specifying the WorkerType & NumberOfWorkers (#19787)

af28b41903

2021-12-05

Add sensor for AWS Batch (#19850) (#19885)

480c333c45

2021-12-03

Add state details to EMR container failure reason (#19579)

2539cb44b4

2021-12-01

Move to watchtower 2.0.1 (#19907)

2.5.0

Latest change: 2021-11-30

Commit

Committed

Subject

853576d901

2021-11-30

Update documentation for November 2021 provider's release (#19882)

83b51e5306

2021-11-26

Amazon provider remove deprecation, second try (#19815)

d58df468c8

2021-11-24

Revert "Adjust built-in base_aws methods to avoid Deprecation warnings (#19725)" (#19791)

4be04143a5

2021-11-24

Adjust built-in base_aws methods to avoid Deprecation warnings (#19725)

fe682ec3d3

2021-11-24

Fix duplicate changelog entries (#19759)

186513e24e

2021-11-15

Catch AccessDeniedException in AWS Secrets Manager Backend (#19324)

4c495ca94e

2021-11-15

Cleanup of start_date and default arg use for Amazon example DAGs (#19237)

eb16fd51e0

2021-11-12

Adding support for using ''client_type'' API for interacting with EC2 and support filters (#9011)

aa2cb5545f

2021-11-12

Remove remaining 'pylint: disable' comments (#19541)

9053de7718

2021-11-10

Do not check for S3 key before attempting download (#19504)

ebb7394005

2021-11-08

MySQLToS3Operator  actually allow writing parquet files to s3. (#19094)

2.4.0

Latest change: 2021-11-04

Commit

Committed

Subject

5a113f3027

2021-11-04

Add documentation for RC2 release of Amazon provider for October (#19413)

96dd70348a

2021-11-04

`` fix SagemakerProcessingOperator ThrottlingException (#19195)``

a3266ba2b9

2021-11-03

Doc: Fix typos in variable and comments (#19349)

6148ddd365

2021-11-03

Fix S3ToRedshiftOperator (#19358)

1600f1dfd7

2021-10-30

Remove duplicated entries in changelog (#19331)

d9567eb106

2021-10-29

Prepare documentation for October Provider's release (#19321)

1543dc28f4

2021-10-29

Fixing ses email backend (#18042)

3c08c025c5

2021-10-27

Move validation of templated input params to run after the context init (#19048)

f5ad26dcdd

2021-10-21

Fixup string concatenations (#19099)

86a2a19ad2

2021-10-17

More f-strings (#18855)

258451cfba

2021-10-15

MySQLToS3Operator add support for parquet format (#18755)

176165de3b

2021-10-11

Update S3PrefixSensor to support checking multiple prefixes within a bucket (#18807)

1d7cfdbcd9

2021-10-10

Remove extra postgres dependency from AWS Provider (#18844)

1df9a512c2

2021-10-08

Add RedshiftSQLHook, RedshiftSQLOperator (#18447)

22768ff61e

2021-10-08

Removed duplicated code on S3ToRedshiftOperator (#18671)

2.3.0

Latest change: 2021-10-08

Commit

Committed

Subject

a680e876b6

2021-10-08

Prepare documentation for RC2 Amazon Provider release for September (#18830)

ea8f478909

2021-10-08

Add AWS Fargate profile support (#18645)

9344c34522

2021-10-08

Enable AWS Secrets Manager backend to retrieve conns using different fields (#18764)

1a35644b5d

2021-10-08

Add emr cluster link (#18691)

e0af0b976c

2021-10-08

AwsGlueJobOperator: add wait_for_completion to Glue job run (#18814)

8e56ed234b

2021-10-07

Enable FTPToS3Operator to transfer several files (#17937)

28284a37b3

2021-10-07

Amazon Athena Example (#18785)

38c6cf9c27

2021-10-07

AwsGlueJobOperator: add run_job_kwargs to Glue job run (#16796)

72e49ad3a3

2021-10-06

Amazon SQS Example (#18760)

767a4f5207

2021-10-05

ECSOperator: airflow exception on edge case when cloudwatch log stream is not found (#18733)

760bf6e51c

2021-10-06

Adds an s3 list prefixes operator (#17145)

12763f125a

2021-10-05

Add additional dependency for postgres extra for amazon provider (#18737)

86bf2a29ba

2021-10-04

Simplify strings previously split across lines (#18679)

12133861ec

2021-10-01

Support all Unix wildcards in S3KeySensor (#18211)

840ea3efb9

2021-09-30

Update documentation for September providers release (#18613)

8a1437e55e

2021-09-29

Refresh credentials for long-running pods on EKS (#17951)

2fbd23878f

2021-09-28

Update s3_list.py (#18561)

a458fcc573

2021-09-27

Updating miscellaneous provider DAGs to use TaskFlow API where applicable (#18278)

e25eea052f

2021-09-19

Inclusive Language (#18349)

4cd190c9bc

2021-09-18

ECSOperator realtime logging (#17626)

27088c4533

2021-09-18

Add IAM Role Credentials to S3ToRedshiftTransfer and RedshiftToS3Transfer (#18156)

2d4f3cb644

2021-09-15

Adding missing 'replace' param in docstring (#18241)

81ebd78db4

2021-09-12

Added upsert method on S3ToRedshift operator (#18027)

02397761af

2021-09-12

Deprecate default pod name in EKSPodOperator (#18036)

e6cb2f7beb

2021-09-10

ECSOperator returns last logs when ECS task fails (#17209)

b8795501ea

2021-09-10

Aws secrets manager backend (#17448)

6e101317a2

2021-09-10

Simplify s3 ''unify_bucket_name_and_key'' (#17325)

3fe948a860

2021-09-08

sftp_to_s3 stream file option (#17609)

867e9305f0

2021-09-03

AwsBaseHook make 'client_type' & 'resource_type' optional params for 'get_client_type' & 'get_resource_type' (#17987)

bcd81f23af

2021-09-03

Add Spark to the EMR cluster for the job flow examples (#17563)

7c4d3173f2

2021-09-02

Delete unnecessary parameters in EKSPodOperator (#17960)

2.2.0

Latest change: 2021-08-30

Commit

Committed

Subject

0a68588479

2021-08-30

Add August 2021 Provider's documentation (#17890)

653c13ec0c

2021-08-30

Fix broken XCOM in EKSPodOperator (#17918)

42e13e1a5a

2021-08-30

Remove all deprecation warnings in providers (#17900)

890bd4310e

2021-08-28

Add an Amazon EMR on EKS provider package (#16766)

41632e03b8

2021-08-27

Fix provider.yaml errors due to exit(0) in test (#17858)

be75dcd39c

2021-08-23

Update description about the new ''connection-types'' provider meta-data

76ed2a49c6

2021-08-19

Import Hooks lazily individually in providers manager (#17682)

bee48f31f1

2021-08-19

Implemented Basic EKS Integration (#16571)

d26b862330

2021-08-19

Add optional SQL parameters in ''RedshiftToS3Operator'' (#17640)

29aab6434f

2021-08-17

Adds secrets backend/logging/auth information to provider yaml (#17625)

1632c9f519

2021-08-14

Add new LocalFilesystemToS3Operator under Amazon provider (#17168) (#17382)

e7eeaa6086

2021-08-12

Doc: Fix docstrings for ''MongoToS3Operator'' (#17588)

987575787d

2021-08-12

Add Mongo projections to hook and transfer (#17379)

77c4325fb0

2021-08-10

Fixing ParamValidationError when executing load_file in Glue hooks/operators (#16012)

d28efbfb77

2021-08-02

Improve AWS SQS Sensor (#16880) (#16904)

71088986f1

2021-08-02

make platform version as independent parameter of ECSOperator (#17281)

80fc80ace6

2021-08-02

Fixes #16972 - Slugify role session name in AWS base hook (#17210)

2.1.0

Latest change: 2021-07-26

Commit

Committed

Subject

87f408b1e7

2021-07-26

Prepares docs for Rc2 release of July providers (#17116)

569659db38

2021-07-26

Updating Amazon-AWS example DAGs to use XComArgs (#16868)

763919d415

2021-07-25

Adding custom Salesforce connection type + SalesforceToS3Operator updates (#17162)

8b100fcb42

2021-07-21

ECSOperator / pass context to self.xcom_pull as it was missing (when using reattach) (#17141)

f44d7bd9cf

2021-07-21

Made S3ToRedshiftOperator transaction safe (#17117)

32582b5bf1

2021-07-21

Adding SalesforceToS3Operator to Amazon Provider (#17094)

bb1d79cb81

2021-07-19

Fixed template_fields_renderers for Amazon provider (#17087)

8f77a54b53

2021-07-19

removing try-catch block (#17081)

cda78333b4

2021-07-18

Added docs & doc ref's for AWS transfer operators between SFTP & S3 (#16964)

d02ded65ea

2021-07-15

Fixed wrongly escaped characters in amazon's changelog (#17020)

b916b75079

2021-07-15

Prepare documentation for July release of providers. (#17015)

fc0250f1d5

2021-07-15

Allow attaching to previously launched task in ECSOperator (#16685)

d3f300fba8

2021-07-11

Fix wrong template_fields_renderers for AWS operators (#16820)

f0df184e4d

2021-07-07

Update AWS Base hook to use refreshable credentials (#16770) (#16771)

ffe8fab653

2021-07-03

Added select_query to the templated fields in RedshiftToS3Operator (#16767)

866a601b76

2021-06-28

Removes pylint from our toolchain (#16682)

0d80383bdd

2021-06-28

AWS Hook - allow IDP HTTP retry (#12639) (#16612)

3a57d9fc60

2021-06-26

Bump ''sphinxcontrib-spelling'' and minor improvements (#16675)

2543c74c19

2021-06-24

AWS DataSync cancel task on exception (#11011) (#16589)

2ab2cbf93d

2021-06-23

Update Boto3 API calls in ECSOperator (#16050)

2.0.0

Latest change: 2021-06-21

Commit

Committed

Subject

19ed074e9c

2021-06-21

Use safe get with AWS DMS describe replication tasks (#16540)

bbc627a3da

2021-06-18

Prepares documentation for rc2 release of Providers (#16501)

db10c6841b

2021-06-18

Add AWS DMS replication task operators (#15850)

1c82b4d015

2021-06-17

Fix S3ToFTPOperator (#13796)

36dc6a8100

2021-06-16

Make job name check optional in SageMakerTrainingOperator (#16327)

cbf8001d76

2021-06-16

Synchronizes updated changelog after buggfix release (#16464)

1fba5402bb

2021-06-15

More documentation update for June providers release (#16405)

9cd7930c34

2021-06-13

Update copy command for s3 to redshift (#16241)

643f3c35a6

2021-06-13

fix: AwsGlueJobOperator change order of args for load_file (#16216)

30708b5b25

2021-06-13

Add support of capacity provider strategy for ECSOperator (#15848)

9c94b72d44

2021-06-07

Updated documentation for June 2021 provider release (#16294)

9fcdf3d4de

2021-06-02

Fix S3 Select payload join (#16189)

8d16638285

2021-05-29

remove retry for now (#16150)

5fbc86f036

2021-05-27

Remove the 'not-allow-trailing-slash' rule on S3_hook (#15609)

904709d34f

2021-05-27

Check synctatic correctness for code-snippets (#16005)

476d0f6e3d

2021-05-22

Bump pyupgrade v2.13.0 to v2.18.1 (#15991)

821ea6fc18

2021-05-17

Fix spacing in ''AwsBatchWaitersHook'' docstring (#15839)

1467046058

2021-05-14

CloudwatchTaskHandler reads timestamp from Cloudwatch events (#15173)

dab10d9fae

2021-05-10

MongoToS3Operator failed when running with a single query (not aggregate pipeline) (#15680)

9c8391a13f

2021-05-10

Fix spelling (#15699)

37681bca00

2021-05-07

Auto-apply apply_default decorator (#15667)

9953a047c4

2021-05-07

Add Connection Documentation for the Hive Provider (#15704)

0f97a3970d

2021-05-04

Rename example bucket names to use INVALID BUCKET NAME by default (#15651)

db557a8c4a

2021-05-01

Docs: Replace 'airflow' to 'apache-airflow' to install extra (#15628)

1.4.0

Latest change: 2021-05-01

Commit

Committed

Subject

807ad32ce5

2021-05-01

Prepares provider release after PIP 21 compatibility (#15576)

814e471d13

2021-04-29

Update pre-commit checks (#15583)

bf2b48174a

2021-04-27

Add Connection Documentation for Providers (#15499)

4b031d39e1

2021-04-27

Make Airflow code Pylint 2.8 compatible (#15534)

657384615f

2021-04-27

Fix 'logging.exception' redundancy (#14823)

d598630cd7

2021-04-26

Fix AthenaSensor calling AthenaHook incorrectly (#15427)

71c673e427

2021-04-22

Update Docstrings of Modules with Missing Params (#15391)

a82de56b9d

2021-04-13

S3Hook.load_file should accept Path object in addition to str (#15232)

b4770725a3

2021-04-12

Add links to new modules for deprecated modules (#15316)

da780fc8b1

2021-04-12

Fixes doc for SQSSensor (#15323)

1.3.0

Latest change: 2021-04-06

Commit

Committed

Subject

042be2e4e0

2021-04-06

Updated documentation for provider packages before April release (#15236)

266384a63f

2021-04-05

Fix string concatenation using 'f-strings' (#15200)

eda538f56c

2021-04-02

AWS: Do not log info when SSM & SecretsManager secret not found (#15120)

9b76b94c94

2021-04-02

A bunch of template_fields_renderers additions (#15130)

6822665102

2021-04-01

Send region_name into parant class of AwsGlueJobHook (#14251)

5379698892

2021-03-27

Improve docstrings for various modules (#15047)

614be87b23

2021-03-26

Added retry to ECS Operator (#14263)

a7ca1b3b0b

2021-03-26

Fix Sphinx Issues with Docstrings (#14968)

0f327788b5

2021-03-24

doc: Fix typo in 'secrets_manager.py' docstring (#14943)

93982e3bb6

2021-03-22

Make script_args templated in AwsGlueJobOperator (#14925)

e172bd0e16

2021-03-22

Update docstrings to adhere to sphinx standards (#14918)

68e4c4dcb0

2021-03-20

Remove Backport Providers (#14886)

a3778127ed

2021-03-15

Add FTPToS3Operator (#13707)

b896aee8cc

2021-03-07

Cache Hook when initializing 'CloudFormationCreateStackSensor' (#14638)

e7bb17aeb8

2021-03-06

Use built-in 'cached_property' on Python 3.8 where possible (#14606)

697abf399d

2021-03-05

S3DataSource is not required (#14220)

8ced652ecf

2021-02-28

Implemented S3 Bucket Tagging (#14402)

1.2.0

Latest change: 2021-02-27

Commit

Committed

Subject

589d6dec92

2021-02-27

Prepare to release the next wave of providers: (#14487)

13854c32a3

2021-02-27

Adding support to put extra arguments for Glue Job. (#14027)

0d6cae4172

2021-02-24

Avoid using threads in S3 remote logging uplod (#14414)

ca35bd7f7f

2021-02-21

By default PIP will install all packages in .local folder (#14125)

1b14726307

2021-02-11

Allow AWS Operator RedshiftToS3Transfer To Run a Custom Query (#14177)

9034f277ef

2021-02-10

Document configuration for email backend credentials. (#14006)

8c5594b02f

2021-02-08

includes the STS token if STS credentials are used (#11227)

cddbf9c11d

2021-02-06

Use MongoDB color for MongoToS3Operator (#14103)

10343ec29f

2021-02-05

Corrections in docs and tools after releasing provider RCs (#14082)

1.1.0

Latest change: 2021-02-04

Commit

Committed

Subject

88bdcfa0df

2021-02-04

Prepare to release a new wave of providers. (#14013)

ac2f72c98d

2021-02-01

Implement provider versioning tools (#13767)

01049ddce2

2021-01-31

Add aws ses email backend for use with EmailOperator. (#13986)

ecfdc60bb6

2021-01-29

Add bucket_name to template fileds in S3 operators (#13973)

d0ab7f6d3a

2021-01-25

Add ExasolToS3Operator (#13847)

6d55f329f9

2021-01-25

AWS Glue Crawler Integration (#13072)

f473ca7130

2021-01-24

Replace 'google_cloud_storage_conn_id' by 'gcp_conn_id' when using 'GCSHook' (#13851)

a9ac2b040b

2021-01-23

Switch to f-strings using flynt. (#13732)

3fd5ef3555

2021-01-21

Add missing logos for integrations (#13717)

29730d7200

2021-01-20

Add acl_policy to S3CopyObjectOperator (#13773)

c065d32189

2021-01-19

AllowDiskUse parameter and docs in MongotoS3Operator (#12033)

ab5fe56ac4

2021-01-16

Fix bug in GCSToS3Operator (#13718)

04d278f93f

2021-01-13

Add S3ToFTPOperator (#11747)

8d42d9ed69

2021-01-11

add xcom push for ECSOperator (#12096)

308f1d0666

2021-01-07

[AIRFLOW-3723] Add Gzip capability to mongo_to_S3 operator (#13187)

f69405fb0b

2021-01-07

Fix S3KeysUnchangedSensor so that template_fields work (#13490)

4e479e1e1b

2021-01-06

Add S3KeySizeSensor (#13049)

f7a1334abe

2021-01-02

Add 'mongo_collection' to template_fields in MongoToS3Operator (#13361)

bd74eb0ca0

2020-12-31

Allow Tags on AWS Batch Job Submission (#13396)

295d66f914

2020-12-30

Fix Grammar in PIP warning (#13380)

625576a3af

2020-12-18

Fix spelling (#13135)

6cf76d7ac0

2020-12-18

Fix typo in pip upgrade command :( (#13148)

5090fb0c89

2020-12-15

Add script to generate integrations.json (#13073)

1.0.0

Latest change: 2020-12-09

Commit

Committed

Subject

32971a1a2d

2020-12-09

Updates providers versions to 1.0.0 (#12955)

d5589673a9

2020-12-08

Move dummy_operator.py to dummy.py (#11178) (#11293)

b40dffa085

2020-12-08

Rename remaing modules to match AIP-21 (#12917)

9b39f24780

2020-12-08

Add support for dynamic connection form fields per provider (#12558)

bd90136aaf

2020-11-30

Move operator guides to provider documentation packages (#12681)

02d94349be

2020-11-29

Don't use time.time() or timezone.utcnow() for duration calculations (#12353)

de3b1e687b

2020-11-28

Move connection guides to provider documentation packages (#12653)

663259d4b5

2020-11-25

Fix AWS DataSync tests failing (#11020)

3fa51f94d7

2020-11-24

Add check for duplicates in provider.yaml files (#12578)

ed09915a02

2020-11-23

[AIRFLOW-5115] Bugfix for S3KeySensor failing to accept template_fields (#12389)

370e7d07d1

2020-11-21

Fix Python Docstring parameters (#12513)

c34ef853c8

2020-11-20

Separate out documentation building per provider  (#12444)

0080354502

2020-11-18

Update provider READMEs for 1.0.0b2 batch release (#12449)

7ca0b6f121

2020-11-18

Enable Markdownlint rule MD003/heading-style/header-style (#12427) (#12438)

ae7cb4a1e2

2020-11-17

Update wrong commit hash in backport provider changes (#12390)

6889a333cf

2020-11-15

Improvements for operators and hooks ref docs (#12366)

c94b1241a1

2020-11-13

Add extra error handling to S3 remote logging (#9908)

7825e8f590

2020-11-13

Docs installation improvements (#12304)

250436d962

2020-11-10

Fix spelling in Python files (#12230)

85a18e13d9

2020-11-09

Point at pypi project pages for cross-dependency of provider packages (#12212)

59eb5de78c

2020-11-09

Update provider READMEs for up-coming 1.0.0beta1 releases (#12206)

b2a28d1590

2020-11-09

Moves provider packages scripts to dev (#12082)

fcb6b00efe

2020-11-08

Add authentication to AWS with Google credentials (#12079)

fb6bddba0c

2020-11-07

In AWS Secrets backend, a lookup is optional (#12143)

cf9437d79f

2020-11-06

Simplify string expressions (#12123)

41bf172c1d

2020-11-04

Simplify string expressions (#12093)

4e8f9cc8d0

2020-11-03

Enable Black - Python Auto Formmatter (#9550)

8c42cf1b00

2020-11-03

Use PyUpgrade to use Python 3.6 features (#11447)

5e77a61543

2020-11-02

Docstring fix for S3DeleteBucketOperator (#12049)

8222851348

2020-10-29

Add Template Fields to RedshiftToS3Operator & S3ToRedshiftOperator (#11844)

db121f726b

2020-10-28

Add truncate table (before copy) option to S3ToRedshiftOperator (#9246)

5a439e84eb

2020-10-26

Prepare providers release 0.0.2a1 (#11855)

8afdb6ac6a

2020-10-26

Fix spellings (#11825)

872b1566a1

2020-10-25

Generated backport providers readmes/setup for 2020.10.29 (#11826)

6ce855af11

2020-10-24

Fix spelling (#11821)

3934ef2249

2020-10-24

Remove redundant builtins imports (#11809)

4c8e033c0e

2020-10-24

Fix spelling and grammar (#11814)

4830687453

2020-10-24

Use Python 3 style super classes (#11806)

0df60b7736

2020-10-23

Add reattach flag to ECSOperator (#10643)

b9d677cdd6

2020-10-22

Add type hints to  aws provider (#11531)

349b0811c3

2020-10-20

Add D200 pydocstyle check (#11688)

674368f66c

2020-10-19

Fixes MySQLToS3 float to int conversion (#10437)

0823d46a7f

2020-10-16

Add type annotations for AWS operators and hooks (#11434)

16e7129719

2020-10-13

Added support for provider packages for Airflow 2.0 (#11487)

d38a0a781e

2020-10-12

added type hints for aws cloud formation (#11470)

d305876bee

2020-10-12

Remove redundant None provided as default to dict.get() (#11448)

c3e340584b

2020-10-11

Change prefix of AwsDynamoDB hook module (#11209)

42a23d16fe

2020-10-11

Update MySQLToS3Operator's s3_bucket to template_fields (#10778)

422b61a9dd

2020-10-09

Adding ElastiCache Hook for creating, describing and deleting replication groups (#8701)

dd98b21494

2020-10-06

Add acl_policy parameter to GCSToS3Operator (#10804) (#10829)

32b3cfbcf0

2020-10-06

Strict type check for all hooks in amazon (#11250)

6d573e8abb

2020-10-03

Add s3 key to template fields for s3/redshift transfer operators (#10890)

0a0e1af800

2020-10-03

Fix Broken Markdown links in Providers README TOC (#11249)

ca4238eb4d

2020-10-02

Fixed month in backport packages to October (#11242)

5220e4c384

2020-10-02

Prepare Backport release 2020.09.07 (#11238)

00ffedb8c4

2020-09-30

Add amazon glacier to GCS transfer operator (#10947)

e3f96ce7a8

2020-09-24

Fix incorrect Usage of Optional[bool] (#11138)

f3e87c5030

2020-09-22

Add D202 pydocstyle check (#11032)

b61225a885

2020-09-21

Add D204 pydocstyle check (#11031)

2410f592a4

2020-09-19

Get Airflow configs with sensitive data from AWS Systems Manager (#11023)

2bf7b7cac7

2020-09-19

Add typing to amazon provider EMR (#10910)

9edfcb7ac4

2020-09-19

Support extra_args in S3Hook and GCSToS3Operator (#11001)

4e1f3a69db

2020-09-14

[AIRFLOW-10645] Add AWS Secrets Manager Hook (#10655)

e9add79160

2020-09-14

Fix Failing static tests on Master (#10927)

383a118d2d

2020-09-14

Add more type annotations to AWS hooks (#10671)

9549274d11

2020-09-09

Upgrade black to 20.8b1 (#10818)

2934220dc9

2020-09-08

Always return a list from S3Hook list methods (#10774)

f40ac9b151

2020-09-01

Add placement_strategy option (#9444)

e4878e6775

2020-08-31

fix type hints for s3 hook read_key method (#10653)

2ca615cffe

2020-08-29

Update Google Cloud branding (#10642)

8969b7185e

2020-08-28

Removed bad characters from AWS operator (#10590)

8349061f9c

2020-08-26

Improve Docstring for AWS Athena Hook/Operator (#10580)

fdd9b6f65b

2020-08-25

Enable Black on Providers Packages (#10543)

3696c34c28

2020-08-24

Fix typo in the word "release" (#10528)

3734876d98

2020-08-24

Implement impersonation in google operators (#10052)

ee7ca128a1

2020-08-22

Fix broken Markdown refernces in Providers README (#10483)

c6358045f9

2020-08-22

Fixes S3ToRedshift COPY query (#10436)

7c206a82a6

2020-08-22

Replace assigment with Augmented assignment (#10468)

27d08b76a2

2020-08-21

Amazon SES Hook (#10391)

dea345b05c

2020-08-17

Fix AwsGlueJobSensor to stop running after the Glue job finished (#9022)

f6734b3b85

2020-08-12

Enable Sphinx spellcheck for doc generation (#10280)

82f744b871

2020-08-11

Add type annotations to AwsGlueJobHook, RedshiftHook modules (#10286)

19bc97d0ce

2020-08-10

Revert "Add Amazon SES hook (#10004)" (#10276)

f06fe616e6

2020-08-10

Add Amazon SES hook (#10004)

0c77ea8a3c

2020-08-06

Add type annotations to S3 hook module (#10164)

24c8e4c2d6

2020-08-06

Changes to all the constructors to remove the args argument (#10163)

9667314b2f

2020-08-05

Add correct signatures for operators in amazon provider package (#10167)

000287753b

2020-08-03

Improve Typing coverage of amazon/aws/athena (#10025)

53ada6e791

2020-08-03

Add S3KeysUnchangedSensor (#9817)

aeea71274d

2020-08-02

Remove 'args' parameter from provider operator constructors (#10097)

2b8dea64e9

2020-08-01

Fix typo in Athena sensor retries (#10079)

1508c43ec9

2020-07-29

Adding new SageMaker operator for ProcessingJobs (#9594)

7d24b088cd

2020-07-25

Stop using start_date in default_args in example_dags (2) (#9985)

8b10a4b35e

2020-07-25

Stop using start_date in default_args in example_dags (#9982)

33f0cd2657

2020-07-22

apply_default keeps the function signature for mypy (#9784)

e7c87fe453

2020-07-20

Refactor AwsBaseHook._get_credentials (#9878)

2577f9334a

2020-07-16

Fix S3FileTransformOperator to support S3 Select transformation only (#8936)

52b6efe1ec

2020-07-15

Add option to delete by prefix to S3DeleteObjectsOperator (#9350)

553bb7af7c

2020-07-13

Keep functions signatures in decorators (#9786)

2f31b3060e

2020-07-08

Get Airflow configs with sensitive data from Secret Backends (#9645)

07b81029eb

2020-07-08

Allow AWSAthenaHook to get more than 1000/first page of results (#6075)

564192c162

2020-07-08

Add AWS StepFunctions integrations to the aws provider (#8749)

ecce1ace7a

2020-07-08

[AIRFLOW-XXXX] Remove unnecessary docstring in AWSAthenaOperator

a79e2d4c4a

2020-07-06

Move provider's log task handlers to the provider package (#9604)

ee20086b8c

2020-07-02

Move S3TaskHandler to the AWS provider package (#9602)

40add26d45

2020-06-29

Remove almost all references to airflow.contrib (#9559)

c858babddf

2020-06-26

Remove kwargs from Super calls in AWS Secrets Backends (#9523)

87fdbd0708

2020-06-25

Use literal syntax instead of function calls to create data structure (#9516)

c7a454aa32

2020-06-22

Add AWS ECS system test (#8888)

df8efd04f3

2020-06-21

Enable & Fix "Docstring Content Issues" PyDocStyle Check (#9460)

e13a14c873

2020-06-21

Enable & Fix Whitespace related PyDocStyle Checks (#9458)

d0e7db4024

2020-06-19

Fixed release number for fresh release (#9408)

12af6a0800

2020-06-19

Final cleanup for 2020.6.23rc1 release preparation (#9404)

992a18c84a

2020-06-19

Move MySqlToS3Operator to transfers (#9400)

a60f589aa2

2020-06-19

Add MySqlToS3Operator (#9054)

c7e5bce57f

2020-06-19

Prepare backport release candidate for 2020.6.23rc1 (#9370)

40bf8f28f9

2020-06-18

Detect automatically the lack of reference to the guide in the operator descriptions (#9290)

f6bd817a3a

2020-06-16

Introduce 'transfers' packages (#9320)

58a8ec0e46

2020-06-16

AWSBatchOperator <> ClientHook relation changed to composition (#9306)

a80cd25e8e

2020-06-15

Close/Flush byte stream in s3 hook load_string and load_bytes (#9211)

ffb8574037

2020-06-14

Decrypt secrets from SystemsManagerParameterStoreBackend (#9214)

a69b031f20

2020-06-10

Add S3ToRedshift example dag and system test (#8877)

17adcea835

2020-06-02

Fix handling of subprocess error handling in s3_file_transform and gcs (#9106)

357e11e0cf

2020-05-29

Add Delete/Create S3 bucket operators (#8895)

1ed171bfb2

2020-05-28

Add script_args for S3FileTransformOperator (#9019)

0b0e4f7a4c

2020-05-26

Preparing for RC3 relase of backports (#9026)

00642a46d0

2020-05-26

Fixed name of 20 remaining wrongly named operators. (#8994)

1d36b0303b

2020-05-23

Fix references in docs (#8984)

f946f96da4

2020-05-23

Old json boto compat removed from dynamodb_to_s3 operator (#8987)

375d1ca229

2020-05-19

Release candidate 2 for backport packages 2020.05.20 (#8898)

12c5e5d8ae

2020-05-17

Prepare release candidate for backport packages (#8891)

f3521fb0e3

2020-05-16

Regenerate readme files for backport package release (#8886)

f4edd90a94

2020-05-16

Speed up TestAwsLambdaHook by not actually running a function (#8882)

92585ca4cb

2020-05-15

Added automated release notes generation for backport operators (#8807)

85bbab27db

2020-05-15

Add EMR operators howto docs (#8863)

e61b9bb9bb

2020-05-13

Add AWS EMR System tests (#8618)

ed3f5131a2

2020-05-13

Correctly pass sleep time from AWSAthenaOperator down to the hook. (#8845)

7236862a1f

2020-05-12

[AIRFLOW-2310] Enable AWS Glue Job Integration (#6007)

d590e5e767

2020-05-11

Add option to propagate tags in ECSOperator (#8811)

0c3db84c3c

2020-05-11

[AIRFLOW-7068] Create EC2 Hook, Operator and Sensor (#7731)

cbebed2b4d

2020-05-10

Allow passing backend_kwargs to AWS SSM client (#8802)

c7788a6894

2020-05-10

Add imap_attachment_to_s3 example dag and system test (#8669)

ff5b70149b

2020-05-07

Add google_api_to_s3_transfer example dags and system tests (#8581)

4421f011ee

2020-05-01

Improve template capabilities of EMR job and step operators (#8572)

379a884d64

2020-04-28

fix: aws hook should work without conn id (#8534)

74bc316c56

2020-04-27

[AIRFLOW-4438] Add Gzip compression to S3_hook (#8571)

7ea66a1a95

2020-04-26

Add example DAG for ECSOperator (#8452)

b6434dedf9

2020-04-24

[AIRFLOW-7111] Add generate_presigned_url method to S3Hook (#8441)

becedd5af8

2020-04-19

Remove unrelated EC2 references in ECSOperator (#8451)

ab1290cb0c

2020-04-13

Make launch_type parameter optional (#8248)

87969a350d

2020-04-09

[AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170)

b46d6c0602

2020-04-08

Add support for AWS Secrets Manager as Secrets Backend (#8186)

68d1714f29

2020-04-04

[AIRFLOW-6822] AWS hooks should cache boto3 client (#7541)

8a02402576

2020-03-31

Rename CloudBaseHook to GoogleBaseHook and move it to google.common (#8011)

7239d9a82d

2020-03-28

Get Airflow Variables from AWS Systems Manager Parameter Store (#7945)

eb4af4f944

2020-03-28

Make BaseSecretsBackend.build_path generic (#7948)

438da7241e

2020-03-28

[AIRFLOW-5825] SageMakerEndpointOperator is not idempotent (#7891)

686d7d50bd

2020-03-25

Standardize SecretBackend class names (#7846)

eef87b9953

2020-03-23

[AIRFLOW-7105] Unify Secrets Backend method interfaces (#7830)

5648dfbc30

2020-03-23

Add missing call to Super class in 'amazon', 'cloudant & 'databricks' providers (#7827)

a360024123

2020-03-19

[AIRFLOW-5705] Make AwsSsmSecretsBackend consistent with VaultBackend (#7753)

2a54512d78

2020-03-17

[AIRFLOW-5705] Fix bugs in AWS SSM Secrets Backend (#7745)

a8b5fc74d0

2020-03-16

[AIRFLOW-4175] S3Hook load_file should support ACL policy paramete (#7733)

e31e9ddd23

2020-03-14

[AIRFLOW-5705] Add secrets backend and support for AWS SSM (#6376)

3bb60afc7b

2020-03-13

[AIRFLOW-6975] Base AWSHook AssumeRoleWithSAML (#7619)

c0c5f11ad1

2020-03-12

[AIRFLOW-6884] Make SageMakerTrainingOperator idempotent (#7598)

b7cdda1c64

2020-03-10

[AIRFLOW-4438] Add Gzip compression to S3_hook (#7680)

42eef38217

2020-03-07

[AIRFLOW-6877] Add cross-provider dependencies as extras (#7506)

9a94ab246d

2020-03-01

[AIRFLOW-6962] Fix compeleted to completed (#7600)

1b38f6d9b6

2020-02-29

[AIRFLOW-5908] Add download_file to S3 Hook (#6577)

3ea3e1a2b5

2020-02-26

[AIRFLOW-6824] EMRAddStepsOperator problem with multi-step XCom (#7443)

6eaa7e3b18

2020-02-25

[AIRFLOW-5924] Automatically unify bucket name and key in S3Hook (#6574)

3320e432a1

2020-02-24

[AIRFLOW-6817] Lazy-load 'airflow.DAG' to keep user-facing API untouched (#7517)

7d0e7122dd

2020-02-24

[AIRFLOW-6830] Add Subject/MessageAttributes to SNS hook and operator (#7451)

4d03e33c11

2020-02-22

[AIRFLOW-6817] remove imports from 'airflow/__init__.py', replaced implicit imports with explicit imports, added entry to 'UPDATING.MD' - squashed/rebased (#7456)

47a922b864

2020-02-21

[AIRFLOW-6854] Fix missing typing_extensions on python 3.8 (#7474)

9cbd7de6d1

2020-02-18

[AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412)

58c3542ed2

2020-02-12

[AIRFLOW-5231] Fix S3Hook.delete_objects method (#7375)

b7aa778b38

2020-02-10

[AIRFLOW-6767] Correct name for default Athena workgroup (#7394)

9282185e66

2020-02-09

[AIRFLOW-6761] Fix WorkGroup param in AWSAthenaHook (#7386)

94fccca970

2020-02-04

[AIRFLOW-XXXX] Add pre-commit check for utf-8 file encoding (#7347)

f3ad5cf618

2020-02-03

[AIRFLOW-4681] Make sensors module pylint compatible (#7309)

88e40c714d

2020-02-03

[AIRFLOW-6716] Fix AWS Datasync Example DAG (#7339)

a311d3d82e

2020-02-03

[AIRFLOW-6718] Fix more occurrences of utils.dates.days_ago (#7341)

cb766b05b1

2020-02-03

[AIRFLOW-XXXX] Fix Static Checks on CI (#7342)

97a429f9d0

2020-02-02

[AIRFLOW-6714] Remove magic comments about UTF-8 (#7338)

7527eddc5e

2020-02-02

[AIRFLOW-4364] Make all code in airflow/providers/amazon pylint compatible (#7336)

cf141506a2

2020-02-02

[AIRFLOW-6708] Set unique logger names (#7330)

63aa3db88f

2020-02-02

[AIRFLOW-6258] Add CloudFormation operators to AWS providers (#6824)

af4157fdef

2020-02-02

[AIRFLOW-6672] AWS DataSync - better logging of error message (#7288)

373c6aa4a2

2020-01-30

[AIRFLOW-6682] Move GCP classes to providers package (#7295)

83c037873f

2020-01-30

[AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287)

1988a97e8f

2020-01-28

[AIRFLOW-6659] Move AWS Transfer operators to providers package (#7274)

ab10443e96

2020-01-28

[AIRFLOW-6424] Added a operator to modify EMR cluster (#7213)

40246132a7

2020-01-28

[AIRFLOW-6654] AWS DataSync - bugfix when creating locations (#7270)

82c0e5aff6

2020-01-28

[AIRFLOW-6655] Move AWS classes to providers (#7271)

599e4791c9

2020-01-18

[AIRFLOW-6541] Use EmrJobFlowSensor for other states (#7146)

c319e81cae

2020-01-17

[AIRFLOW-6572] Move AWS classes to providers.amazon.aws package (#7178)

941a070578

2020-01-15

[AIRFLOW-6570] Add dag tag for all example dag (#7176)

78d8fe6944

2020-01-08

[AIRFLOW-6245] Add custom waiters for AWS batch jobs (#6811)

e0b0227257

2019-12-28

[AIRFLOW-6319] Add support for AWS Athena workgroups (#6871)

57da456854

2019-12-24

[AIRFLOW-6333] Bump Pylint to 2.4.4 & fix/disable new checks (#6888)

cf647c27e0

2019-12-18

[AIRFLOW-6038] AWS DataSync reworked (#6773)

7502cad284

2019-12-17

[AIRFLOW-6206] Move and rename AWS batch operator [AIP-21] (#6764)

c4c635df69

2019-12-17

[AIRFLOW-6083] Adding ability to pass custom configuration to lambda client. (#6678)

4fb498f87e

2019-12-09

[AIRFLOW-6072] aws_hook: Outbound http proxy setting and other enhancements (#6686)

a1e2f86352

2019-11-20

[AIRFLOW-6021] Replace list literal with list constructor (#6617)

baae140847

2019-11-19

[AIRFLOW-5781] AIP-21 Migrate AWS Kinesis to /providers/amazon/aws (#6588)

504cfbac1a

2019-11-18

[AIRFLOW-5783] AIP-21 Move aws redshift into providers structure (#6539)

992f0e3acf

2019-11-12

AIRFLOW-5824: AWS DataSync Hook and Operators added (#6512)

c015eb2f64

2019-11-10

[AIRFLOW-5786] Migrate AWS SNS to /providers/amazon/aws (#6502)

3d76fb4bf2

2019-11-09

[AIRFLOW-5782] Migrate AWS Lambda to /providers/amazon/aws [AIP-21] (#6518)

Was this entry helpful?