Package apache-airflow-providers-google

Google services including:

This is detailed commit list of changes for versions provider package: google. For high-level changelog, see package information including changelog.

6.4.0

Latest change: 2022-02-13

Commit

Committed

Subject

6bb0857df

2022-02-13

(providers_google) add a location check in bigquery (#19571)

6579648af

2022-02-13

Fix bigquery-hook when no  engine_kwargs are passed

da485da29

2022-02-13

Add support for BeamGoPipelineOperator (#20386)

05a883b35

2022-02-11

Google Cloud Composer opearators (#21251)

833087f4f

2022-02-10

Enable asynchronous job submission in BigQuery hook (#21385)

51aff276c

2022-02-10

Optionally raise an error if source file does not exist in GCSToGCSOperator (#21391)

07fe9e8c6

2022-02-09

Never set DagRun.state to State.NONE (#21263)

0a3ff43d4

2022-02-08

Add pre-commit check for docstring param types (#21398)

d94fa3783

2022-02-08

Fixed changelog for January 2022 (delayed) provider's release (#21439)

e97374020

2022-02-08

Create CustomJob and Datasets operators for Vertex AI service (#21253)

34d63fabc

2022-02-08

Fix BigQueryDataTransferServiceHook.get_transfer_run() request parameter (#21293)

6b88d432d

2022-02-06

Support to upload file to Google Shared Drive (#21319)

1a77bc648

2022-02-06

:bug: (BigQueryHook) fix compatibility with sqlalchemy engine (#19508)

6c3a67d4f

2022-02-05

Add documentation for January 2021 providers release (#21257)

39e395f98

2022-02-04

Add more SQL template fields renderers (#21237)

e840acf8d

2022-02-04

Fix BigQuery system test (#21320)

ddb5246bd

2022-02-03

Refactor operator links to not create ad hoc TaskInstances (#21285)

1d4b709e2

2022-01-28

Revert "Create CustomJob and Datasets operators for Vertex AI service (#20077)" (#21203)

48d44b885

2022-01-28

Cloudsql import links fix. (#21199)

640c0b676

2022-01-28

Create CustomJob and Datasets operators for Vertex AI service (#20077)

cb7305321

2022-01-27

Add optional features in providers. (#21074)

60aa518eb

2022-01-26

batch as templated field in DataprocCreateBatchOperator (#20905)

623163f16

2022-01-25

Extend dataproc example dag (#21091)

86ef016ea

2022-01-23

Make timeout Optional for wait_for_operation (#20981)

506efb6fa

2022-01-21

Squelch more deprecation warnings (#21003)

372849486

2022-01-21

Fix last google provider MyPy errors (#21010)

73c0d241d

2022-01-21

Remove a few stray ':type's in docs (#21014)

602abe839

2022-01-20

Remove ':type' lines now sphinx-autoapi supports typehints (#20951)

b8526abc2

2022-01-19

Add encoding parameter to 'GCSToLocalFilesystemOperator' to fix #20901 (#20919)

58452f97d

2022-01-03

Add hook for integrating with Google Calendar (#20542)

6.3.0

Latest change: 2021-12-31

Commit

Committed

Subject

f77417eb0

2021-12-31

Fix K8S changelog to be PyPI-compatible (#20614)

97496ba2b

2021-12-31

Update documentation for provider December 2021 release (#20523)

a22d5bd07

2021-12-31

Fix mypy errors in Google Cloud provider (#20611)

4233ebe5c

2021-12-31

Fix setting of project ID in ''provide_authorized_gcloud'' (#20428)

83f8e178b

2021-12-31

Even more typing in operators (template_fields/ext) (#20608)

746ee587d

2021-12-31

Delete pods by default in KubernetesPodOperator (#20575)

41dbe2c4f

2021-12-30

Fix mypy errors in google/cloud/operators/stackdriver (#20601)

dda688776

2021-12-30

Fix Google mlengine MyPy errors (#20569)

d56e7b56b

2021-12-30

Fix template_fields type to have MyPy friendly Sequence type (#20571)

bd9e8cef2

2021-12-30

Fix Google Mypy Dataproc errors (#20570)

a6e60ce25

2021-12-30

Change download_video parameter to resourceName (#20528)

af4a2b024

2021-12-30

Fix big query to mssql/mysql transfer issues (#20001)

a0821235f

2021-12-30

Use typed Context EVERYWHERE (#20565)

da88ed194

2021-12-29

Fix MyPy errors in Google Cloud (again) (#20469)

3a480f5ff

2021-12-29

Fix passing the gzip compression parameter on sftp_to_gcs. (#20553)

bfd6d45ce

2021-12-29

switch to follow_redirects on httpx.get call in CloudSQL provider (#20239)

7d4d38b54

2021-12-29

avoid deprecation warnings in BigQuery transfer operators (#20502)

b7086f981

2021-12-28

Use Python3.7+ syntax in pyupgrade (#20501)

a4622e19f

2021-12-22

Support regional GKE cluster (#18966)

2ffdcf4b4

2021-12-21

Fixes docstring for PubSubCreateSubscriptionOperator (#20237)

d4c4f9e09

2021-12-21

Fix mypy errors for google.cloud_build (#20234)

c6dbb3f88

2021-12-21

Fix MyPy for Google Bigquery (#20329)

ed604b62f

2021-12-18

Fix remaining MyPy errors in Google Provider (#20358)

17404f1f1

2021-12-16

Move source_objects datatype check out of GCSToBigQueryOperator.__init__ (#20347)

174681911

2021-12-16

Fix MyPy Errors for dataproc package (#20327)

2fb5e1d0e

2021-12-15

Fix cached_property MyPy declaration and related MyPy errors (#20226)

21b866188

2021-12-15

Fix missing get_backup method for Dataproc Metastore (#20326)

cdaa9a252

2021-12-15

Fix MyPy errors for google.cloud.tasks (#20233)

43efde623

2021-12-15

Fix MyPy Errors for Apache Beam (and Dataflow) provider. (#20301)

c4b369410

2021-12-15

Fix MyPy errors in leveldb (#20222)

1570519a9

2021-12-14

Fix MyPy errors for google.cloud.transfers (#20229)

632bd0133

2021-12-13

Fix MyPY errors for google.cloud.example_dags (#20232)

644051abc

2021-12-13

Fix MyPy errors for google/marketing_platform and suite (#20227)

a20846380

2021-12-13

Organize S3 Classes in Amazon Provider (#20167)

98514cc15

2021-12-13

Add optional location to bigquery data transfer service (#15088) (#20221)

1f662571b

2021-12-12

Fix MyPy errors in google.cloud.sensors (#20228)

22341b90d

2021-12-11

Add Google Cloud Tasks how-to documentation (#20145)

e9262752d

2021-12-11

Finalised Datastore documentation (#20138)

fa96b0939

2021-12-09

Update Sphinx and Sphinx-AutoAPI (#20079)

ed8b63ba2

2021-12-08

Providers facebook hook multiple account (#19377)

50bf53665

2021-12-08

Remove deprecated method call (blob.download_as_string) (#20091)

564fe635b

2021-12-06

Added example DAG for MSSQL to Google Cloud Storage (GCS) (#19873)

cb082d361

2021-12-02

Remove deprecated template_fields from GoogleDriveToGCSOperator (#19991)

6977c4757

2021-12-01

BigQueryHook fix typo in run_load doc string (#19924)

f6dca1fa5

2021-12-01

Update doc reference links (#19909)

6.2.0

Latest change: 2021-11-30

Commit

Committed

Subject

853576d90

2021-11-30

Update documentation for November 2021 provider's release (#19882)

fb478c00c

2021-11-28

Move 'bucket_name' validation out of '__init__' in Google Marketing Platform operators (#19383)

e9e530979

2021-11-28

Update 'default_args' value in example_functions DAG from str to int (#19865)

bf68b9a84

2021-11-26

Create dataproc serverless spark batches operator (#19248)

a192cecf6

2021-11-26

updates pipeline_timeout CloudDataFusionStartPipelineOperator (#18773)

eb163c81d

2021-11-25

Fix GCS system tests (#19227)

744d11bdb

2021-11-25

Clean up ''default_args'' usage in docs (#19803)

0b2e1a874

2021-11-22

Added wait mechanizm to the DataprocJobSensor to avoid 509 errors when Job is not available (#19740)

3336bb6c3

2021-11-19

Fix badly merged impersonation in GKEPodOperator (#19696)

952ef908b

2021-11-19

Support impersonation_chain parameter in the GKEStartPodOperator (#19518)

853c16465

2021-11-18

Clean-up of google cloud example dags - batch 3 (#19664)

355dec8fe

2021-11-17

Misc. documentation typos and language improvements (#19599)

b9d31cd44

2021-11-17

Cleanup dynamic 'start_date' use for miscellaneous Google example DAGs (#19400)

daf234bd5

2021-11-16

Remove reference to deprecated operator in example_dataproc (#19619)

48f228cf9

2021-11-15

#16691 Providing more information in docs for DataprocCreateCluster operator migration (#19446)

6ef44b6a5

2021-11-15

Clean-up of google cloud example dags - batch 2 (#19527)

dc0159e7e

2021-11-14

Add support in GCP connection for reading key from Secret Manager (#19164)

4212c4932

2021-11-14

Update Azure modules to comply with AIP-21 (#19431)

aa2cb5545

2021-11-12

Remove remaining 'pylint: disable' comments (#19541)

c8dc0311d

2021-11-08

Fix Cloud SQL system tests (#19014)

26ad55beb

2021-11-08

Add dataproc metastore operators (#18945)

9efb989d1

2021-11-07

Clean-up of google cloud example dags (#19436)

f421409b4

2021-11-05

Fix typos in warnings, docstrings, exceptions (#19424)

a3c9956f7

2021-10-30

Add support of 'path' parameter for GCloud Storage Transfer Service operators (#17446)

6.1.0

Latest change: 2021-10-29

Commit

Committed

Subject

d9567eb10

2021-10-29

Prepare documentation for October Provider's release (#19321)

55abc2f62

2021-10-28

Support query timeout as an argument in CassandraToGCSOperator (#18927)

e4aa377da

2021-10-28

Update BigQueryCreateExternalTableOperator doc and parameters (#18676)

20847fdbf

2021-10-27

Add value to "namespaceId" of query (#19163)

3c08c025c

2021-10-27

Move validation of templated input params to run after the context init (#19048)

eba1b68b3

2021-10-27

Update dataflow.py (#19231)

7ecf29f70

2021-10-26

Fix hard-coded /tmp directory in CloudSQL Hook (#19229)

726a1517e

2021-10-26

Fix bug in Dataflow hook when no jobs are returned (#18981)

d9192a55b

2021-10-22

Replacing non-attribute template_fields for BigQueryToMsSqlOperator (#19052)

4fae04a47

2021-10-21

Upgrade the Dataproc package to 3.0.0 and migrate from v1beta2 to v1 api (#18879)

0e95b5777

2021-10-19

Google provider catch invalid secret name (#18790)

86a2a19ad

2021-10-17

More f-strings (#18855)

a418fd96f

2021-10-17

Use google cloud credentials when executing beam command in subprocess (#18992)

5c3e45382

2021-10-15

Fix BigQueryToMsSqlOperator documentation (#18995)

406b38b2e

2021-10-15

Replace default api_version of FacebookAdsReportToGcsOperator (#18996)

1571f8054

2021-10-14

Add pre-commit hook for common misspelling check in files (#18964)

20df60de2

2021-10-07

Dataflow Operators - use project and location from job in on_kill method. (#18699)

86bf2a29b

2021-10-04

Simplify strings previously split across lines (#18679)

6.0.0

Latest change: 2021-09-30

Commit

Committed

Subject

840ea3efb

2021-09-30

Update documentation for September providers release (#18613)

9279c44c9

2021-09-29

Fix part of Google system tests (#18494)

2fadf3c3c

2021-09-27

Fix kubernetes engine system test (#18548)

a458fcc57

2021-09-27

Updating miscellaneous provider DAGs to use TaskFlow API where applicable (#18278)

97d689231

2021-09-25

Rename AzureDataLakeStorage to ADLS (#18493)

a5439eee7

2021-09-23

Add index to the dataset name to have separate dataset for each example DAG (#18459)

18d7e1e22

2021-09-21

Fix BigQuery system test (#18373)

e25eea052

2021-09-19

Inclusive Language (#18349)

7458f1e78

2021-09-18

Remove check for at least one schema in GCSToBigquery (#18150)

2474f8922

2021-09-13

Migrate Google Cloud Build from Discovery API to Python SDK (#18184)

8ae2bb9bf

2021-09-13

Fix error when create external table using table resource (#17998)

9140ad8d8

2021-09-11

Use parameters instead of params (#18143)

3d4bfdcbb

2021-09-10

Add missing __init__.py files for some test packages (#18142)

cfb602a33

2021-09-10

Fix ''BigQuery'' data extraction in ''BigQueryToMySqlOperator'' (#18073)

2fd3f27eb

2021-09-10

Make next_dagrun_info take a data interval (#18088)

944dcfbb9

2021-09-07

Change TaskInstance and TaskReschedule PK from execution_date to run_id (#17719)

bfad233b9

2021-09-06

Fix providers tests in main branch with eager upgrades (#18040)

21348c194

2021-09-03

fix(CloudSqlProxyRunner): don't query connections from Airflow DB (#18006)

9a0c10ba3

2021-09-01

deduplicate running jobs on BigQueryInsertJobOperator (#17496)

fe34582fc

2021-09-01

New google operator: SQLToGoogleSheetsOperator (#17887)

500780651

2021-08-31

Add possibility to run DAGs from system tests and see DAGs logs (#17868)

5.1.0

Latest change: 2021-08-30

Commit

Committed

Subject

0a6858847

2021-08-30

Add August 2021 Provider's documentation (#17890)

b5da846dd

2021-08-30

Fix missing Data Fusion sensor integration (#17914)

07405e6df

2021-08-30

[AIRFLOW-9300] Add DatafusionPipelineStateSensor and aync option to the CloudDataFusionStartPipelineOperator (#17787)

42e13e1a5

2021-08-30

Remove all deprecation warnings in providers (#17900)

aa5952e58

2021-08-27

Gcp ai hyperparameter tuning (#17790)

87769db98

2021-08-27

Allow omission of 'initial_node_count' if 'node_pools' is specified (#17820)

be75dcd39

2021-08-23

Update description about the new ''connection-types'' provider meta-data

d04aa1352

2021-08-20

[Airflow 13779] use provided parameters in the wait_for_pipeline_state hook (#17137)

76ed2a49c

2021-08-19

Import Hooks lazily individually in providers manager (#17682)

b68d1935f

2021-08-19

Add error check for config_file parameter in GKEStartPodOperator (#17700)

29aab6434

2021-08-17

Adds secrets backend/logging/auth information to provider yaml (#17625)

b06d52860

2021-08-11

Don't cache Google Secret Manager client (#17539)

67cbb0f18

2021-08-02

Enable specifying dictionary paths in 'template_fields_renderers' (#17321)

c384f9b0f

2021-07-29

GCP Secret Manager error handling for missing credentials (#17264)

5.0.0

Latest change: 2021-07-26

Commit

Committed

Subject

87f408b1e

2021-07-26

Prepares docs for Rc2 release of July providers (#17116)

448e50bd2

2021-07-26

Updating Google Cloud example DAGs to use XComArgs (#16875)

aaf44ccac

2021-07-26

Updating miscellaneous Google example DAGs to use XComArgs (#16876)

d01cc945d

2021-07-26

Fixes several failing tests after broken main (#17222)

babc4250f

2021-07-26

Fixes statich check failures (#17218)

5d2224795

2021-07-25

Google Ads Hook: Support newer versions of the google-ads library (#17160)

966b25019

2021-07-25

Fix GCStoGCS operator with replace diabled and existing destination object (#16991)

763919d41

2021-07-25

Adding custom Salesforce connection type + SalesforceToS3Operator updates (#17162)

81bd40933

2021-07-23

[CASSANDRA-16814] Fix cassandra to gcs type inconsistency. (#17183)

026ffe65d

2021-07-19

fix: dataprocpysparkjob project_id as self.project_id (#17075)

d02ded65e

2021-07-15

Fixed wrongly escaped characters in amazon's changelog (#17020)

b916b7507

2021-07-15

Prepare documentation for July release of providers. (#17015)

a3f5c9380

2021-07-13

Update alias for field_mask in Google Memmcache (#16975)

b0f7f91fe

2021-07-07

Standardise dataproc location param to region (#16034)

866a601b7

2021-06-28

Removes pylint from our toolchain (#16682)

4.0.0

Latest change: 2021-06-18

Commit

Committed

Subject

bbc627a3d

2021-06-18

Prepares documentation for rc2 release of Providers (#16501)

cbf8001d7

2021-06-16

Synchronizes updated changelog after buggfix release (#16464)

8a9c33783

2021-06-15

Remove class references in changelogs (#16454)

1fba5402b

2021-06-15

More documentation update for June providers release (#16405)

3c5cc42e1

2021-06-14

Fix deprecation warnings location in google provider (#16403)

b272f9cec

2021-06-13

fix: ensure datetime-related values fully compatible with MySQL and BigQuery (#15026)

7f8f75eb8

2021-06-12

Add BigQueryToMsSqlOperator (#15422)

0c80a7d41

2021-06-11

Fixes AzureFileShare connection extras (#16388)

9c94b72d4

2021-06-07

Updated documentation for June 2021 provider release (#16294)

1e647029e

2021-06-01

Rename the main branch of the Airflow repo to be 'main' (#16149)

99d153528

2021-05-31

Fix: GCS To BigQuery source_object (#16160)

e1137523d

2021-05-30

Fix: Unnecessary downloads in ''GCSToLocalFilesystemOperator'' (#16171)

904709d34

2021-05-27

Check synctatic correctness for code-snippets (#16005)

86768859c

2021-05-26

Fix bigquery type error when export format is parquet (#16027)

6ae9aeec3

2021-05-26

pass wait_for_done parameter down to _DataflowJobsController (#15541)

476d0f6e3

2021-05-22

Bump pyupgrade v2.13.0 to v2.18.1 (#15991)

aa4713e43

2021-05-21

Use api version only in GoogleAdsHook not operators (#15266)

76a80bb17

2021-05-19

Move plyvel to google provider extra (#15812)

bb115da0b

2021-05-17

Get rid of requests as core dependency (#15781)

9c8391a13

2021-05-10

Fix spelling (#15699)

3711a29e5

2021-05-09

Fix argument ordering and type of bucket and object (#15738)

a01567c47

2021-05-08

Fix sql_to_gcs docstring lint error (#15730)

f3fada910

2021-05-07

Add short description to BaseSQLToGCSOperator docstring (#15728)

37681bca0

2021-05-07

Auto-apply apply_default decorator (#15667)

b8c0fde38

2021-05-07

Add extra links for google dataproc (#10343)

3b4fdd0a7

2021-05-06

add oracle  connection link (#15632)

cf6324e43

2021-05-04

Implement BigQuery Table Schema Update Operator (#15367)

0f97a3970

2021-05-04

Rename example bucket names to use INVALID BUCKET NAME by default (#15651)

3.0.0

Latest change: 2021-05-01

Commit

Committed

Subject

807ad32ce

2021-05-01

Prepares provider release after PIP 21 compatibility (#15576)

814e471d1

2021-04-29

Update pre-commit checks (#15583)

bf2b48174

2021-04-27

Add Connection Documentation for Providers (#15499)

4b031d39e

2021-04-27

Make Airflow code Pylint 2.8 compatible (#15534)

e229f3541

2021-04-27

Use Pip 21.* to install airflow officially (#15513)

71c673e42

2021-04-22

Update Docstrings of Modules with Missing Params (#15391)

3b9a91806

2021-04-22

Bugfix: Fix rendering of ''object_name'' in ''GCSToLocalFilesystemOperator'' (#15487)

c5e302030

2021-04-21

Fix typo in DataprocCreateClusterOperator (#15462)

42a1ca8aa

2021-04-20

Fixes wrongly specified path for leveldb hook (#15453)

6da36bad2

2021-04-18

[Airflow-15245] - passing custom image family name to the DataProcClusterCreateoperator (#15250)

f64990560

2021-04-15

fix docstring typos (#15392)

7bf69edca

2021-04-08

Fix typo in a docstring (#15276)

2.2.0

Latest change: 2021-04-06

Commit

Committed

Subject

042be2e4e

2021-04-06

Updated documentation for provider packages before April release (#15236)

eae22cec9

2021-04-06

Adds 'Trino' provider (with lower memory footprint for tests) (#15187)

e49722859

2021-04-05

Updates 3.6 limits for latest versions of a few libraries (#15209)

1d641d8f1

2021-04-01

update remaining old import paths of operators (#15127)

099c490cf

2021-03-28

Override project in dataprocSubmitJobOperator (#14981)

537969889

2021-03-27

Improve docstrings for various modules (#15047)

a7ca1b3b0

2021-03-26

Fix Sphinx Issues with Docstrings (#14968)

a7e144bec

2021-03-23

Google Dataflow Hook to handle no Job Type (#14914)

72ea841b4

2021-03-22

GCS to BigQuery Transfer Operator with Labels and Description parameter (#14881)

e172bd0e1

2021-03-22

Update docstrings to adhere to sphinx standards (#14918)

68e4c4dcb

2021-03-20

Remove Backport Providers (#14886)

ddc9133d3

2021-03-15

Add GCS timespan transform operator (#13996)

943baff67

2021-03-10

Add job labels to bigquery check operators. (#14685)

6dc24c95e

2021-03-07

Fix grammar and remove duplicate words (#14647)

e7bb17aeb

2021-03-06

Use built-in 'cached_property' on Python 3.8 where possible (#14606)

7daebefd1

2021-03-05

Use libyaml C library when available. (#14577)

35c9a9029

2021-03-01

Add Google leveldb hook and operator (#13109) (#14105)

2.1.0

Latest change: 2021-02-27

Commit

Committed

Subject

589d6dec9

2021-02-27

Prepare to release the next wave of providers: (#14487)

50a1504c5

2021-02-27

Fix spellings (#14483)

bfef559cf

2021-02-27

Corrects order of argument in docstring in GCSHook.download method (#14497)

33214d932

2021-02-26

Refactor SQL/BigQuery/Qubole/Druid Check operators (#12677)

c28197998

2021-02-23

Documentation and example dag for CloudDLPDeidentifyContentOperator, GCSObjectExistenceSensor, GCSObjectsWithPrefixExistenceSensor (#14033)

ca35bd7f7

2021-02-21

By default PIP will install all packages in .local folder (#14125)

a7e4266d6

2021-02-21

Refactor GoogleDriveToGCSOperator to use common methods (#14276)

1ab406663

2021-02-16

Add GoogleDriveToLocalOperator (#14191)

59c94c679

2021-02-13

Add 'exists_ok' flag to BigQueryCreateEmptyTable(Dataset)Operator (#14026)

e31b27d59

2021-02-13

Add materialized view support for BigQuery (#14201)

e3bcaa3ba

2021-02-12

Correct typo in GCSObjectsWtihPrefixExistenceSensor  (#14179)

7faa2d978

2021-02-10

Add BigQueryUpdateTableOperator (#14149)

1da697216

2021-02-10

Fixes to dataproc operators and hook (#14086)

02288cf2b

2021-02-10

Add param to CloudDataTransferServiceOperator (#14118)

7d3864547

2021-02-09

#9803 fix bug in copy operation without wildcard  (#13919)

b0c382426

2021-02-07

Add gdrive_to_gcs operator, drive sensor, additional functionality to drive hook, and supporting tests (#13982)

5d7d46bb3

2021-02-05

Improve GCSToSFTPOperator paths handling (#11284)

10343ec29

2021-02-05

Corrections in docs and tools after releasing provider RCs (#14082)

2.0.0

Latest change: 2021-02-04

Commit

Committed

Subject

88bdcfa0d

2021-02-04

Prepare to release a new wave of providers. (#14013)

1872d8719

2021-02-03

Add Apache Beam operators (#12814)

0e8c77b93

2021-02-03

Support google-cloud-logging' >=2.0.0 (#13801)

833e33832

2021-02-02

Fix four bugs in StackdriverTaskHandler (#13784)

d2efb3323

2021-02-02

Support google-cloud-monitoring>=2.0.0 (#13769)

ac2f72c98

2021-02-01

Implement provider versioning tools (#13767)

823741cfe

2021-01-28

Improve GCS system test envs (#13946)

6d6588fe2

2021-01-28

Add Google Cloud Workflows Operators (#13366)

810c15ed8

2021-01-27

Fix and improve GCP BigTable hook and system test (#13896)

661661733

2021-01-27

Add env variables to PubSub example dag (#13794)

f473ca713

2021-01-24

Replace 'google_cloud_storage_conn_id' by 'gcp_conn_id' when using 'GCSHook' (#13851)

a9ac2b040

2021-01-23

Switch to f-strings using flynt. (#13732)

9592be88e

2021-01-22

Fix Google Spanner example dag (#13842)

af52fdb51

2021-01-22

Improve environment variables in GCP Dataflow system test (#13841)

e7946f1cb

2021-01-22

Improve environment variables in GCP Datafusion system test (#13837)

61c1d6ec6

2021-01-22

Improve environment variables in GCP Memorystore system test (#13833)

202f66093

2021-01-22

Improve environment variables in GCP Lifeciences system test (#13834)

70bf307f3

2021-01-21

Add How To Guide for Dataflow (#13461)

3fd5ef355

2021-01-21

Add missing logos for integrations (#13717)

309788e5e

2021-01-18

Refactor DataprocOperators to support google-cloud-dataproc 2.0 (#13256)

7ec858c45

2021-01-17

updated Google DV360 Hook to fix SDF issue (#13703)

ef8617ec9

2021-01-14

Support google-cloud-tasks>=2.0.0 (#13347)

189af5404

2021-01-13

Add system tests for Stackdriver operators (#13644)

a6f999b62

2021-01-11

Support google-cloud-automl >=2.1.0 (#13505)

947dbb73b

2021-01-11

Support google-cloud-datacatalog>=3.0.0 (#13534)

2fb68342b

2021-01-07

Replace deprecated module and operator in example_tasks.py (#13527)

003584bbf

2021-01-05

Fix failing backport packages test (#13497)

7d1ea4cb1

2021-01-05

Replace deprecated module and operator in example_tasks.py (#13473)

c7d75ad88

2021-01-05

Revert "Support google-cloud-datacatalog 3.0.0 (#13224)" (#13482)

feb84057d

2021-01-04

Support google-cloud-datacatalog 3.0.0 (#13224)

3a3e73998

2021-01-04

Fix insert_all method of BigQueryHook to support tables without schema (#13138)

c33d2c06b

2021-01-02

Fix another pylint c-extension-no-member (#13438)

f6518dd6a

2021-01-02

Generalize MLEngineStartTrainingJobOperator to custom images (#13318)

9de712708

2020-12-31

Support google-cloud-bigquery-datatransfer>=3.0.0 (#13337)

406181d64

2020-12-31

Add Parquet data type to BaseSQLToGCSOperator (#13359)

295d66f91

2020-12-30

Fix Grammar in PIP warning (#13380)

13a9747bf

2020-12-28

Revert "Support google-cloud-tasks>=2.0.0 (#13334)" (#13341)

04ec45f04

2020-12-28

Add DataprocCreateWorkflowTemplateOperator (#13338)

1f712219f

2020-12-28

Support google-cloud-tasks>=2.0.0 (#13334)

f4745c8ce

2020-12-26

Fix typo in example (#13321)

e9d65bd45

2020-12-24

Decode Remote Google Logs (#13115)

e7aeacf33

2020-12-24

Add OracleToGCS Transfer (#13246)

323084e97

2020-12-24

Add timeout option to gcs hook methods. (#13156)

0b626c804

2020-12-22

Support google-cloud-redis>=2.0.0 (#13117)

9042a5855

2020-12-22

Add more operators to example DAGs for Cloud Tasks (#13235)

8c00ec89b

2020-12-22

Support google-cloud-pubsub>=2.0.0 (#13127)

b26b0df5b

2020-12-22

Update compatibility with google-cloud-kms>=2.0 (#13124)

9a1d3820d

2020-12-22

Support google-cloud-datacatalog>=1.0.0 (#13097)

f95b1c9c9

2020-12-21

Add regional support to dataproc workflow template operators (#12907)

6cf76d7ac

2020-12-18

Fix typo in pip upgrade command :( (#13148)

23f27c1b1

2020-12-18

Add system tests for CloudKMSHook (#13122)

cddbf81b1

2020-12-17

Fix Google BigQueryHook method get_schema() (#13136)

1259c712a

2020-12-17

Update compatibility with google-cloud-os-login>=2.0.0 (#13126)

bcf77586e

2020-12-16

Fix Data Catalog operators (#13096)

5090fb0c8

2020-12-15

Add script to generate integrations.json (#13073)

b4b9cf559

2020-12-14

Check for missing references to operator guides (#13059)

1c1ef7ee6

2020-12-14

Add project_id to client inside BigQuery hook update_table method (#13018)

1.0.0

Latest change: 2020-12-09

Commit

Committed

Subject

32971a1a2

2020-12-09

Updates providers versions to 1.0.0 (#12955)

b40dffa08

2020-12-08

Rename remaing modules to match AIP-21 (#12917)

9b39f2478

2020-12-08

Add support for dynamic connection form fields per provider (#12558)

1dcd3e13f

2020-12-05

Add support for extra links coming from the providers (#12472)

2037303ee

2020-11-29

Adds support for Connection/Hook discovery from providers (#12466)

02d94349b

2020-11-29

Don't use time.time() or timezone.utcnow() for duration calculations (#12353)

76bcd08dc

2020-11-28

Added '@apply_defaults' decorator. (#12620)

e1ebfa68b

2020-11-27

Add DataflowJobMessagesSensor and DataflowAutoscalingEventsSensor (#12249)

3fa51f94d

2020-11-24

Add check for duplicates in provider.yaml files (#12578)

c34ef853c

2020-11-20

Separate out documentation building per provider  (#12444)

9e3b2c554

2020-11-19

GCP Secrets Optional Lookup (#12360)

008035450

2020-11-18

Update provider READMEs for 1.0.0b2 batch release (#12449)

7ca0b6f12

2020-11-18

Enable Markdownlint rule MD003/heading-style/header-style (#12427) (#12438)

8d0950646

2020-11-18

Fix download method in GCSToBigQueryOperator (#12442)

2c0920fba

2020-11-17

Adds mechanism for provider package discovery. (#12383)

2cda2f2a0

2020-11-17

Add missing pre-commit definition - provider-yamls (#12393)

80a957f14

2020-11-17

Add Dataflow sensors - job metrics (#12039)

ae7cb4a1e

2020-11-17

Update wrong commit hash in backport provider changes (#12390)

917e6c442

2020-11-16

Add provide_file_and_upload to GCSHook (#12310)

cfa4ecfeb

2020-11-15

Add DataflowJobStatusSensor and support non-blocking execution of jobs (#11726)

6889a333c

2020-11-15

Improvements for operators and hooks ref docs (#12366)

7825e8f59

2020-11-13

Docs installation improvements (#12304)

32b59f835

2020-11-12

Fixes the sending of an empty list to BigQuery 'list_rows' (#12307)

250436d96

2020-11-10

Fix spelling in Python files (#12230)

502ba309e

2020-11-10

Enable Markdownlint rule - MD022/blanks-around-headings (#12225)

dd2095f4a

2020-11-10

Simplify string expressions & Use f-string (#12216)

f37c6e6fc

2020-11-10

Add Compute Engine SSH hook (#9879)

85a18e13d

2020-11-09

Point at pypi project pages for cross-dependency of provider packages (#12212)

59eb5de78

2020-11-09

Update provider READMEs for up-coming 1.0.0beta1 releases (#12206)

61feb6ec4

2020-11-09

Provider's readmes generated for elasticsearch and google packages (#12194)

b2a28d159

2020-11-09

Moves provider packages scripts to dev (#12082)

fcb6b00ef

2020-11-08

Add authentication to AWS with Google credentials (#12079)

2ef3b7ef8

2020-11-08

Fix ERROR - Object of type 'bytes' is not JSON serializable when using store_to_xcom_key parameter (#12172)

0caec9fd3

2020-11-06

Dataflow - add waiting for successful job cancel (#11501)

cf9437d79

2020-11-06

Simplify string expressions (#12123)

91a64db50

2020-11-04

Format all files (without excepions) by black (#12091)

fd3db778e

2020-11-04

Add server side cursor support for postgres to GCS operator (#11793)

f1f194026

2020-11-04

Add DataflowStartSQLQuery operator (#8553)

41bf172c1

2020-11-04

Simplify string expressions (#12093)

5f5244b74

2020-11-04

Add template fields renderers to Biguery and Dataproc operators (#12067)

4e8f9cc8d

2020-11-03

Enable Black - Python Auto Formmatter (#9550)

8c42cf1b0

2020-11-03

Use PyUpgrade to use Python 3.6 features (#11447)

45ae145c2

2020-11-03

Log BigQuery job id in insert method of BigQueryHook (#12056)

e324b37a6

2020-11-03

Add job name and progress logs to Cloud Storage Transfer Hook (#12014)

6071fdd58

2020-11-02

Improve handling server errors in DataprocSubmitJobOperator (#11947)

2f703df12

2020-10-30

Add SalesforceToGcsOperator (#10760)

e5713e00b

2020-10-29

Add drain option when canceling Dataflow pipelines (#11374)

37eaac3c5

2020-10-29

The PRs which are not approved run subset of tests (#11828)

79cb77199

2020-10-28

Fixing re pattern and changing to use a single character class. (#11857)

5a439e84e

2020-10-26

Prepare providers release 0.0.2a1 (#11855)

240c7d4d7

2020-10-26

Google Memcached hooks - improve protobuf messages handling (#11743)

8afdb6ac6

2020-10-26

Fix spellings (#11825)

872b1566a

2020-10-25

Generated backport providers readmes/setup for 2020.10.29 (#11826)

6ce855af1

2020-10-24

Fix spelling (#11821)

483068745

2020-10-24

Use Python 3 style super classes (#11806)

727c739af

2020-10-22

Improve Cloud Memorystore for Redis example (#11735)

1da8379c9

2020-10-22

Fix static checks after merging #10121 (#11737)

91503308c

2020-10-22

Add Google Cloud Memorystore Memcached Operators (#10121)

950c16d0b

2020-10-21

Retry requests in case of error in Google ML Engine Hook (#11712)

2bfc53b5e

2020-10-21

Fix doc errors in google provider files. (#11713)

53e606210

2020-10-21

Enforce strict rules for yamllint (#11709)

349b0811c

2020-10-20

Add D200 pydocstyle check (#11688)

2d854c350

2020-10-19

Add service_account to Google ML Engine operator (#11619)

46a121fb7

2020-10-18

docs: Update Bigquery clustering docstrings (#11232)

49c58147f

2020-10-18

Strict type checking for provider Google (#11609)

0823d46a7

2020-10-16

Add type annotations for AWS operators and hooks (#11434)

3c10ca650

2020-10-16

Add DataflowStartFlexTemplateOperator (#8550)

8865d14df

2020-10-16

Strict type checking for provider google cloud  (#11548)

16e712971

2020-10-13

Added support for provider packages for Airflow 2.0 (#11487)

06141d6d0

2020-10-12

Google cloud operator strict type check (#11450)

d305876be

2020-10-12

Remove redundant None provided as default to dict.get() (#11448)

1845cd11b

2020-10-11

Strict type check for google ads and cloud hooks (#11390)

bd204bb91

2020-10-11

Optionally set null marker in csv exports in BaseSQLToGCSOperator (#11409)

75071831b

2020-10-10

Remove redundant parentheses from Python files (#10967)

8baf657fc

2020-10-09

Fix regression in DataflowTemplatedJobStartOperator (#11167)

b0fcf6755

2020-10-07

Add AzureFileShareToGCSOperator (#10991)

47b05a87f

2020-10-07

Improve handling of job_id in BigQuery operators (#11287)

0a0e1af80

2020-10-03

Fix Broken Markdown links in Providers README TOC (#11249)

ca4238eb4

2020-10-02

Fixed month in backport packages to October (#11242)

5220e4c38

2020-10-02

Prepare Backport release 2020.09.07 (#11238)

cb52fb0ae

2020-09-27

Add example DAG and system test for MySQLToGCSOperator (#10990)

99accec29

2020-09-25

Fix incorrect Usage of Optional[str] & Optional[int] (#11141)

e3f96ce7a

2020-09-24

Fix incorrect Usage of Optional[bool] (#11138)

daf8f3108

2020-09-23

Add template fields renderers for better UI rendering (#11061)

f3e87c503

2020-09-22

Add D202 pydocstyle check (#11032)

cb979f9f2

2020-09-22

Get Airflow configs with sensitive data from CloudSecretManagerBackend (#11024)

76545bb3d

2020-09-16

Add example dag and system test for S3ToGCSOperator (#10951)

22c631625

2020-09-16

Fix more docs spellings (#10965)

12a652f53

2020-09-13

Fix parameter name collision in AutoMLBatchPredictOperator #10723 (#10869)

41a62735e

2020-09-11

Add on_kill method to BigQueryInsertJobOperator (#10866)

3e91da56e

2020-09-11

fix typo in firebase/example_filestore DAG (#10875)

68cc7273b

2020-09-10

Add on_kill method to DataprocSubmitJobOperator (#10847)

f92095721

2020-09-10

Fix and remove some more typos from spelling_wordlist.txt (#10845)

9549274d1

2020-09-09

Upgrade black to 20.8b1 (#10818)

078bfaf60

2020-09-08

Extract missing gcs_to_local example DAG from gcs example (#10767)

10ce31127

2020-09-08

Deprecate using global as the default region in Google Dataproc operators and hooks (#10772)

f14f37971

2020-09-07

[AIRFLOW-10672] Refactor BigQueryToGCSOperator to use new method (#10773)

c8ee45568

2020-09-07

Refactor DataprocCreateCluster operator to use simpler interface (#10403)

ece685b5b

2020-09-05

Asynchronous execution of Dataproc jobs with a Sensor (#10673)

6e3d7b63d

2020-09-04

Add masterConfig parameter to MLEngineStartTrainingJobOperator (#10578)

804548d58

2020-09-01

Add Dataprep operators (#10304)

11c00bc82

2020-08-30

Fix typos: duplicated "the" (#10647)

2ca615cff

2020-08-29

Update Google Cloud branding (#10642)

1b533f617

2020-08-28

Fix broken master - DLP (#10635)

5ae82a56d

2020-08-28

Fix Google DLP example and improve ops idempotency (#10608)

3867f7662

2020-08-28

Update Google Cloud branding (#10615)

91ff31ad1

2020-08-27

Documentation for Google Cloud Data Loss Prevention (#8201) (#9651)

fdd9b6f65

2020-08-25

Enable Black on Providers Packages (#10543)

d76026545

2020-08-25

PyDocStyle: No whitespaces allowed surrounding docstring text (#10533)

d1bce91bb

2020-08-25

PyDocStyle: Enable D403: Capitalized first word of docstring (#10530)

866701c80

2020-08-25

Fix typo in "Cloud" (#10534)

47265e7b5

2020-08-24

Fix typo in PostgresHook (#10529)

3696c34c2

2020-08-24

Fix typo in the word "release" (#10528)

2f2d8dbfa

2020-08-25

Remove all "noinspection" comments native to IntelliJ (#10525)

3734876d9

2020-08-24

Implement impersonation in google operators (#10052)

b0598b535

2020-08-24

Add support for creating multiple replicated clusters in Bigtable hook and operator (#10475)

ee7ca128a

2020-08-22

Fix broken Markdown refernces in Providers README (#10483)

515cc72c9

2020-08-22

Fix typo in timed_out (#10459)

7c206a82a

2020-08-22

Replace assigment with Augmented assignment (#10468)

88c7d2e52

2020-08-21

Dataflow operators don't not always create a virtualenv (#10373)

083c3c129

2020-08-18

Simplified GCSTaskHandler configuration (#10365)

1ae5bdf23

2020-08-17

Add test for GCSTaskHandler (#9600) (#9861)

e195a980b

2020-08-16

Add type annotations for mlengine_operator_utils (#10297)

382c1011b

2020-08-16

Add Bigtable Update Instance Hook/Operator (#10340)

bfa5a8d5f

2020-08-15

CI: Fix failing docs-build (#10342)

be46d20fb

2020-08-15

Improve idempotency of BigQueryInsertJobOperator (#9590)

47387a69e

2020-08-14

Catch Permission Denied exception when getting secret from GCP Secret Manager. (#10326)

2f0613b0c

2020-08-13

Implement Google BigQuery Table Partition Sensor (#10218)

f6734b3b8

2020-08-12

Enable Sphinx spellcheck for doc generation (#10280)

8f8db8959

2020-08-12

DbApiHook: Support kwargs in get_pandas_df (#9730)

ef088314f

2020-08-09

Added DataprepGetJobsForJobGroupOperator (#10246)

b43f90abf

2020-08-09

Fix various typos in the repo (#10263)

c29533888

2020-08-08

Add labels param to Google MLEngine Operators (#10222)

cdec30125

2020-08-07

Add correct signature to all operators and sensors (#10205)

eff0f0321

2020-08-06

`` Update guide for Google Cloud Secret Manager Backend (#10172)``

24c8e4c2d

2020-08-06

Changes to all the constructors to remove the args argument (#10163)

010322692

2020-08-06

Improve handling Dataproc cluster creation with ERROR state (#9593)

1437cb749

2020-08-04

Add correct signatures for operators in google provider package (#10144)

6efa1b9cb

2020-08-03

Add additional Cloud Datastore operators (#10032)

27020f8e5

2020-08-03

Add try clause to DataFusionHook.wait_for_pipeline_state (#10031)

4e3799fec

2020-08-02

[AIRFLOW-4541] Replace os.mkdirs usage with pathlib.Path(path).mkdir (#10117)

85c56b173

2020-08-02

Add missing params to GCP Pub/Sub creation_subscription (#10106)

b79466c12

2020-08-02

Fix sensor not providing arguments for GCSHook (#10074)

4ee35d027

2020-08-02

Fix hook not passing gcp_conn_id to base class (#10075)

aeea71274

2020-08-02

Remove 'args' parameter from provider operator constructors (#10097)

4c84661ad

2020-07-31

Split Display Video 360 example into smaler DAGs (#10077)

59cbff087

2020-07-29

Fix docstrings in BigQueryGetDataOperator (#10042)

81b87d48e

2020-07-27

Add unit tests for GcpBodyFieldSanitizer in Google providers (#9996)

7d24b088c

2020-07-25

Stop using start_date in default_args in example_dags (2) (#9985)

8b10a4b35

2020-07-25

Stop using start_date in default_args in example_dags (#9982)

ef98edf4d

2020-07-23

Add more information about using GoogleAdsHook (#9951)

33f0cd265

2020-07-22

apply_default keeps the function signature for mypy (#9784)

39a0288a4

2020-07-22

Add Google Authentication for experimental API (#9848)

c2db0dfeb

2020-07-22

More strict rules in mypy (#9705) (#9906)

c4244e18b

2020-07-22

Fix calling 'get_client' in BigQueryHook.table_exists (#9916)

5eacc1642

2020-07-22

Add support for impersonation in GCP hooks (#9915)

1cfdebf5f

2020-07-21

Fix insert_job method of BigQueryHook (#9899)

c8c52e69c

2020-07-21

Remove type hint causing DeprecationWarning in Firestore operators (#9819)

eb6f1d1cf

2020-07-16

Fix typo in datafusion operator (#9859)

b01d95ec2

2020-07-15

Change DAG.clear to take dag_run_state (#9824)

6d65c15d1

2020-07-15

Add guide for AI Platform (previously Machine Learning Engine) Operators  (#9798)

770de53eb

2020-07-15

BigQueryTableExistenceSensor needs to specify keyword arguments (#9832)

2d8dbacdf

2020-07-15

Add CloudVisionDeleteReferenceImageOperator  (#9698)

9f017951b

2020-07-15

Add Google Deployment Manager Hook (#9159)

ed5004cca

2020-07-14

Allow 'replace' flag in gcs_to_gcs operator. (#9667)

553bb7af7

2020-07-13

Keep functions signatures in decorators (#9786)

68925904e

2020-07-13

Add multiple file upload functionality to GCS hook (#8849)

1de78e8f9

2020-07-12

Add Google Stackdriver link (#9765)

092d33f29

2020-07-11

Fix StackdriverTaskHandler + add system tests (#9761)

b2305660f

2020-07-09

Update example DAG for AI Platform operators (#9727)

23f80f34a

2020-07-08

Move gcs & wasb task handlers to their respective provider packages (#9714)

44d4ae809

2020-07-06

Upgrade to latest pre-commit checks (#9686)

a79e2d4c4

2020-07-06

Move provider's log task handlers to the provider package (#9604)

cd3d9d934

2020-07-02

Fix using .json template extension in GMP operators (#9566)

4799af30e

2020-06-30

Extend BigQuery example with include clause (#9572)

e33f1a12d

2020-06-30

Add template_ext to BigQueryInsertJobOperator (#9568)

40add26d4

2020-06-29

Remove almost all references to airflow.contrib (#9559)

c420dbd6e

2020-06-27

Bump Pylint to 2.5.3 (#9294)

0051c89cb

2020-06-26

nitpick fix (#9527)

87fdbd070

2020-06-25

Use literal syntax instead of function calls to create data structure (#9516)

7256f4caa

2020-06-22

Pylint fixes and deprecation of rare used methods in Connection (#9419)

e13a14c87

2020-06-21

Enable & Fix Whitespace related PyDocStyle Checks (#9458)

5b680e27e

2020-06-19

Don't use connection to store task handler credentials (#9381)

d0e7db402

2020-06-19

Fixed release number for fresh release (#9408)

416334e2e

2020-06-19

Properly propagated warnings in operators (#9348)

12af6a080

2020-06-19

Final cleanup for 2020.6.23rc1 release preparation (#9404)

c7e5bce57

2020-06-19

Prepare backport release candidate for 2020.6.23rc1 (#9370)

4e09c6442

2020-06-18

Adds GCP Secret Manager Hook (#9368)

40bf8f28f

2020-06-18

Detect automatically the lack of reference to the guide in the operator descriptions (#9290)

f6bd817a3

2020-06-16

Introduce 'transfers' packages (#9320)

639972d99

2020-06-16

Add support for latest Apache Beam SDK in Dataflow operators (#9323)

1459970b3

2020-06-15

Rename CloudBuildCreateBuildOperator to CloudBuildCreateOperator (#9314)

431ea3291

2020-06-15

Resolve upstream tasks when template field is XComArg (#8805)

aee6ab94e

2020-06-15

Wait for pipeline state in Data Fusion operators (#8954)

fb1c8b83d

2020-06-10

Add test for BQ operations using location (#9206)

a26afbfa5

2020-06-10

Make generated job_id more informative in BQ insert_job (#9203)

c41192fa1

2020-06-10

Upgrade pendulum to latest major version ~2.0 (#9184)

b1c8c5ed5

2020-06-09

Allows using private endpoints in GKEStartPodOperator (#9169)

5918efc86

2020-06-05

Add 3.8 to the test matrices (#8836)

9bcdadaf7

2020-06-05

Add 'main' param to template_fields in DataprocSubmitPySparkJobOperator (#9154)

f56811dff

2020-06-05

[AIRFLOW-6290] Create guide for GKE operators (#8883)

76962867b

2020-06-04

Fix sql_to_gcs hook gzip of schema_file (#9140)

17adcea83

2020-06-02

Fix handling of subprocess error handling in s3_file_transform and gcs (#9106)

789852546

2020-06-01

Add BigQueryInsertJobOperator (#8868)

29eb68b90

2020-05-31

Create guide for Dataproc Operators (#9037)

886afaf62

2020-05-29

Add example dag and system test for LocalFilesystemToGCSOperator (#9043)

a779c4dfc

2020-05-29

add separate example dags and system tests for GCSToGoogleSheetsOperator (#9066)

ada26be23

2020-05-29

Add correct description for dst param in LocalFilesystemToGCSOperator (#9055)

81b2761b8

2020-05-29

add example dag and system test for GoogleSheetsToGCSOperator (#9056)

0b0e4f7a4

2020-05-26

Preparing for RC3 relase of backports (#9026)

00642a46d

2020-05-26

Fixed name of 20 remaining wrongly named operators. (#8994)

3994030ea

2020-05-26

Refactor BigQuery operators (#8858)

cdb3f2545

2020-05-26

All classes in backport providers are now importable in Airflow 1.10 (#8991)

1d36b0303

2020-05-23

Fix references in docs (#8984)

cf5cf45e1

2020-05-23

Support YAML input for CloudBuildCreateOperator (#8808)

499493c5c

2020-05-19

[AIRFLOW-6586] Improvements to gcs sensor (#7197)

375d1ca22

2020-05-19

Release candidate 2 for backport packages 2020.05.20 (#8898)

841d81664

2020-05-19

Allow setting the pooling time in DLPHook (#8824)

12c5e5d8a

2020-05-17

Prepare release candidate for backport packages (#8891)

f3521fb0e

2020-05-16

Regenerate readme files for backport package release (#8886)

15273f0ea

2020-05-16

Check for same task instead of Equality to detect Duplicate Tasks (#8828)

92585ca4c

2020-05-15

Added automated release notes generation for backport operators (#8807)

e1e833bb2

2020-05-13

Update GoogleBaseHook to not follow 308 and use 60s timeout (#8816)

8b5491971

2020-05-12

Refactor BigQuery hook methods to use python library (#8631)

6911dfe83

2020-05-12

Fix template fields in Google operators (#8840)

4b06fde0f

2020-05-12

Fix Flake8 errors (#8841)

1d12c347c

2020-05-12

Refactor BigQuery check operators (#8813)

493b685d7

2020-05-10

Add separate example DAGs and system tests for google cloud speech (#8778)

79ef8bed8

2020-05-10

Added Upload Multiple Entity Read Files to specified big query dataset (#8610)

280f1f0c4

2020-05-10

Correctly restore upstream_task_ids when deserializing Operators (#8775)

58aefb23b

2020-05-08

Added SDFtoGCSOperator (#8740)

723c52c94

2020-05-07

Add documentation for SpannerDeployInstanceOperator (#8750)

25ee4211b

2020-05-06

Support all RuntimeEnvironment parameters in DataflowTemplatedJobStartOperator (#8531)

8d6f1aa4b

2020-05-05

Support num_retries field in env var for GCP connection (#8700)

67caae0f2

2020-05-04

Add system test for gcs_to_bigquery (#8556)

bc45fa675

2020-05-03

Add system test and docs for Facebook Ads operators (#8503)

a28c66f23

2020-04-30

[AIRFLOW-4734] Upsert functionality for PostgresHook.insert_rows() (#8625)

992a24ce4

2020-04-28

Split and improve BigQuery example DAG (#8529)

c1fb28230

2020-04-28

Refactor BigQueryHook dataset operations (#8477)

e8d0f8fea

2020-04-26

Improve idempodency in CloudDataTransferServiceCreateJobOperator (#8430)

37fdfa977

2020-04-26

[AIRFLOW-6281] Create guide for GCS to GCS transfer operators (#8442)

14b22e6ff

2020-04-25

Add hook and operator for Google Cloud Life Sciences (#8481)

72ddc94d1

2020-04-23

Pass location using parmamter in Dataflow integration (#8382)

912aa4b42

2020-04-23

Added GoogleDisplayVideo360DownloadLineItemsOperator (#8174)

57c8c0583

2020-04-22

Use python client in BQ hook create_empty_table/dataset and table_exists (#8377)

5d3a7eef3

2020-04-20

Allow multiple extra_packages in Dataflow (#8394)

79c99b1b6

2020-04-18

Added location parameter to BigQueryCheckOperator (#8273)

79d3f33c1

2020-04-17

Clean up temporary files in Dataflow operators (#8313)

efcffa323

2020-04-16

Add Dataproc SparkR Example (#8240)

b198a1fa9

2020-04-15

Create guide for BigQuery operators (#8276)

2636cc932

2020-04-14

Raise exception when GCP credential doesn't support account impersonation (#8213)

eee4ebaee

2020-04-14

Added Facebook Ads Operator #7887 (#8008)

8cae07ea1

2020-04-14

fixed typo (#8294)

45c898330

2020-04-13

Less aggressive eager upgrade of requirements (#8267)

1fd9ed384

2020-04-13

Add mypy plugin for decorators. (#8145)

327b0a9f7

2020-04-13

Added GoogleDisplayVideo360UploadLineItemsOperator (#8216)

bb5e403a3

2020-04-10

Honor schema type for MySQL to GCS data pre-process (#8090)

87969a350

2020-04-09

[AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170)

3fc89f29f

2020-04-06

[AIRFLOW-7106] Cloud data fusion integration - Allow to pass args to start pipeline (#7849)

7ef75d239

2020-04-03

[AIRFLOW-7117] Honor self.schema in sql_to_gcs as schema to upload (#8049)

ed2bc0057

2020-04-02

Add Google Ads list accounts operator (#8007)

3808a6206

2020-04-01

Unify Google class/package names (#8033)

8a0240257

2020-03-31

Rename CloudBaseHook to GoogleBaseHook and move it to google.common (#8011)

8e8978007

2020-03-31

Add more refactor steps for providers.google (#8010)

aae3b8fb2

2020-03-31

Individual package READMEs (#8012)

779023968

2020-03-30

[AIRFLOW-7075] Operators for storing information from GCS into GA (#7743)

49abce521

2020-03-30

Improve system tests for Cloud Build (#8003)

0f19a930d

2020-03-29

Remove GKEStartPodOperator when backporting (#7908)

0e1c238b2

2020-03-28

Get Airflow Variables from GCP Secrets Manager (#7946)

eb4af4f94

2020-03-28

Make BaseSecretsBackend.build_path generic (#7948)

01f99426f

2020-03-28

Add download/upload operators for GCS and Google Sheets (#7866)

892522f8e

2020-03-26

Change signature of GSheetsHook methods (#7853)

bfd425157

2020-03-26

Improve idempotency in MLEngineHook.create_model (#7811)

f9c226343

2020-03-26

Fix CloudSecretsManagerBackend invalid connections_prefix (#7861)

e3920f12f

2020-03-26

Improve setUp/tearDown in Cloud Firestore system test (#7862)

8ba8a7295

2020-03-26

Improve example DAGs for Cloud Memorystore (#7855)

f7d1a437c

2020-03-26

Fix CloudMemorystoreCreateInstanceAndImportOperator operator (#7856)

beef6c230

2020-03-26

Improve authorization in GCP system tests (#7863)

5f165f3e4

2020-03-26

[AIRFLOW-5801] Get GCP credentials from file instead of JSON blob (#7869)

686d7d50b

2020-03-25

Standardize SecretBackend class names (#7846)

1982c3fdc

2020-03-24

Run Dataflow for ML Engine summary in venv (#7809)

eef87b995

2020-03-23

[AIRFLOW-7105] Unify Secrets Backend method interfaces (#7830)

529db07b2

2020-03-23

Improve Google PubSub hook publish method (#7831)

4bde99f13

2020-03-23

Make airflow/providers pylint compatible (#7802)

a001489b5

2020-03-23

Improve example DAG for ML Engine (#7810)

9e5a8e7f8

2020-03-23

Add call to Super class in 'google' providers (#7823)

b86bf79bf

2020-03-23

Fix typo in GCP credentials_provider's docstring (#7818)

56c013ce9

2020-03-23

Add missing docstring in BigQueryHook.create_empty_table (#7817)

426a79847

2020-03-23

Imrove support for laatest API in  MLEngineStartTrainingJobOperator (#7812)

cdf1809fc

2020-03-23

[AIRFLOW-7104] Add Secret backend for GCP Secrets Manager (#7795)

27dac00e1

2020-03-22

[AIRFLOW-7099] Improve system test for cloud transfer service (#7794)

0daf5d729

2020-03-22

Add ability to specify a maximum modified time for objects in GCSToGCSOperator (#7791)

c8088c2bd

2020-03-20

[AIRFLOW-7100] Add GoogleAnalyticsGetAdsLinkOperator (#7781)

5106a2931

2020-03-20

[AIRFLOW-6752] Add GoogleAnalyticsRetrieveAdsLinksListOperator (#7748)

759ce2a80

2020-03-20

[AIRFLOW-6978] Add PubSubPullOperator (#7766)

6b9b214e4

2020-03-20

[AIRFLOW-6732] Add GoogleAdsHook and GoogleAdsToGcsOperator (#7692)

b11891696

2020-03-19

[AIRFLOW-7069] Fix cloudsql system tests (#7770)

ae854cae5

2020-03-19

[AIRFLOW-7082] Remove catch_http_exception decorator in GCP hooks (#7756)

7e1e954d2

2020-03-19

[AIRFLOW-7085] Cache credentials, project_id in GCP Base Hook (#7759)

6e21c139b

2020-03-19

[AIRFLOW-XXXX] Fix reference to GCP classes in guides (#7762)

ce022a3f7

2020-03-19

[AIRFLOW-XXXX] Add cross-references for operators guide (#7760)

029c84e55

2020-03-18

[AIRFLOW-5421] Add Presto to GCS transfer operator (#7718)

63a3102ed

2020-03-18

[AIRFLOW-7064] Add CloudFirestoreExportDatabaseOperator (#7725)

73305c7bd

2020-03-18

[AIRFLOW-7081] Remove env variables from GCP guide (#7755)

60fdbf6d9

2020-03-18

[AIRFLOW-5610] Add ability to specify multiple objects to copy in GCSToGCSOperator (#7728)

de7e934ca

2020-03-17

[AIRFLOW-7079] Remove redundant code for storing template_fields (#7750)

0de0347b2

2020-03-17

[AIRFLOW-6855]: Escape project_dataset_table in SQL query in gcs to bq (#7475)

91557c6f8

2020-03-17

[AIRFLOW-7073] GKEStartPodOperator always use connection credentials (#7738)

51161dbd9

2020-03-16

[AIRFLOW-5664] Store timestamps with microseconds precision (#6354)

2bc020c43

2020-03-14

[AIRFLOW-7055] Verbose logging option for google provider (#7711)

c997cab42

2020-03-13

[AIRFLOW-6724] Add Google Analytics 360 Accounts Retrieve Operator (#7630)

137896f32

2020-03-12

[AIRFLOW-7034] Remove feature: Assigning Dag to task using Bitshift Op (#7685)

1f77f943d

2020-03-10

[AIRFLOW-6980] Improve system tests and building providers package (#7615)

bf9b6b6d7

2020-03-09

[AIRFLOW-5013] Add GCP Data Catalog Hook and operators (#7664)

e5130dc9f

2020-03-09

[AIRFLOW-2911] Add job cancellation capability to Dataflow service (#7659)

faf0df4b9

2020-03-09

[AIRFLOW-XXXX] Fix upsert operator in BQ example DAG (#7666)

42eef3821

2020-03-07

[AIRFLOW-6877] Add cross-provider dependencies as extras (#7506)

b5b9795f0

2020-03-07

[AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (fix) (#7624)

6b65038fb

2020-03-06

[AIRFLOW-6990] Improve system tests for Google Marketing Platform (#7631)

755fe5224

2020-03-05

[AIRFLOW-6915] Add AI Platform Console Link for MLEngineStartTrainingJobOperator (#7535)

cb2f33911

2020-03-04

[AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (#7609)

09fea3ce8

2020-03-04

[AIRFLOW-6977] Fix BigQuery DTS example DAG (#7612)

8230ccc48

2020-03-04

[AIRFLOW-6926] Fix Google Tasks operators return types and idempotency (#7547)

0d1e3088a

2020-03-04

[AIRFLOW-6970] Improve GCP Video Intelligence system tests (#7604)

ab6bb0012

2020-03-03

[AIRFLOW-6971] Fix return type in CloudSpeechToTextRecognizeSpeechOperator (#7607)

3db4ade3d

2020-02-29

[AIRFLOW-6924] Fix Google DLP operators return types (#7546)

008b4bab1

2020-02-27

[AIRFLOW-6730] Use total_seconds instead of seconds (#7363)

bb552b2d9

2020-02-25

[AIRFLOW-6908] Lazy load AirflowException (#7528)

d1a34246a

2020-02-25

[AIRFLOW-6593] Add GCP Stackdriver Alerting Hooks and Operators (#7322)

3320e432a

2020-02-24

[AIRFLOW-6817] Lazy-load 'airflow.DAG' to keep user-facing API untouched (#7517)

dcf874352

2020-02-24

[AIRFLOW-6894] Prevent db query in example_dags (#7516)

4d03e33c1

2020-02-22

[AIRFLOW-6817] remove imports from 'airflow/__init__.py', replaced implicit imports with explicit imports, added entry to 'UPDATING.MD' - squashed/rebased (#7456)

35b961637

2020-02-21

[AIRFLOW-4973] Add Cloud Data Fusion Pipeline integration (#7486)

aff3a361b

2020-02-20

[AIRFLOW-6558] Campaign Manager operators for conversions (#7420)

9cbd7de6d

2020-02-18

[AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412)

5b199cb86

2020-02-17

[AIRFLOW-XXXX] Typo in example_bigquery DAG (#7429)

2c9345a8e

2020-02-17

[AIRFLOW-6759] Added MLEngine operator/hook to cancel MLEngine jobs (#7400)

946bdc23c

2020-02-16

[AIRFLOW-6405] Add GCP BigQuery Table Upsert Operator (#7126)

2381c820c

2020-02-13

[AIRFLOW-6505] Let emoji encoded properly for json.dumps() (#7399)

04c1fefbf

2020-02-03

[AIRFLOW-6676] added GCSDeleteBucketOperator (#7307)

a0252748f

2020-02-03

[AIRFLOW-6717] Remove non-existent field from templated_fields (#7340)

97a429f9d

2020-02-02

[AIRFLOW-6714] Remove magic comments about UTF-8 (#7338)

9d8d07557

2020-02-03

[AIRFLOW-6715] Fix Google Cloud DLP Example DAG (#7337)

cf141506a

2020-02-02

[AIRFLOW-6708] Set unique logger names (#7330)

373c6aa4a

2020-01-30

[AIRFLOW-6682] Move GCP classes to providers package (#7295)

83c037873

2020-01-30

[AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287)

057f3ae3a

2020-01-29

[AIRFLOW-6670][depends on AIRFLOW-6669] Move contrib operators to providers package (#7286)

ceea293c1

2020-01-28

[AIRFLOW-6656] Fix AIP-21 moving (#7272)

c42a375e7

2020-01-27

[AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265)

059eda05f

2020-01-21

[AIRFLOW-6610] Move software classes to providers package (#7231)

f4d3e5e54

2020-01-13

[AIRFLOW-6102] [AIP-21] Rename Dataproc operators (#7151)

e7bf8ecb4

2020-01-13

[AIRFLOW-6119] [AIP-21] Rename GCS operators, hooks and sensors (#7125)

5b6772cb8

2020-01-09

[AIRFLOW-6125] [AIP-21] Rename S3 operator and SFTP operator (#7112)

4f8592ae8

2020-01-08

[AIRFLOW-6118] [AIP-21] Rename Pubsub operators and hook (#7046)

20299473f

2020-01-03

[AIRFLOW-6115] [AIP-21] Rename GCP vision operators (#7020)

18e8cea4e

2020-01-03

[AIRFLOW-6428] Fix import path for airflow.utils.dates.days_ago in Example DAGs (#7007)

95087af14

2019-12-31

[AIRFLOW-6110] [AIP-21] Rename natural_language service (#6968)

69629a5a9

2019-12-09

[AIRFLOW-5807] Move SFTP from contrib to providers. (#6464)

25e9047a4

2019-12-09

[AIRFLOW-6193] Do not use asserts in Airflow main code (#6749)

ed0a14f32

2019-12-09

[AIRFLOW-6120] Rename GoogleCloudBaseHook (#6734)

2f2f89c14

2019-12-01

[AIRFLOW-6139] Consistent spaces in pylint enable/disable (#6701)

03c870a61

2019-11-26

[AIRFLOW-6010] Remove cyclic imports and pylint hacks (#6601)

5c4cfea8c

2019-11-15

[AIRFLOW-5718] Add SFTPToGoogleCloudStorageOperator (#6393)

44a8c37a9

2019-11-13

[AIRFLOW-XXX] Fix the docstring for Dataproc get_job method (#6581)

d633d3ac4

2019-11-13

[AIRFLOW-5691] Rewrite Dataproc operators to use python library (#6371)

d985c02d9

2019-11-05

[AIRFLOW-XXX] Add How-To-Guide to GCP PubSub (#6497)

a296cdabd

2019-11-04

[AIRFLOW-5743] Move Google PubSub to providers package (#6476)

470b2a779

2019-10-30

[AIRFLOW-5741] Move Cloud Natural Language to providers (#6421)

f2caa451f

2019-10-27

[AIRFLOW-5742] Move Google Cloud Vision to providers package (#6424)

16d7accb2

2019-10-22

[AIRFLOW-4971] Add Google Display & Video 360 integration (#6170)

4e661f535

2019-10-22

[AIRFLOW-5379] Add Google Search Ads 360 operators (#6228)

19e32b4e2

2019-10-18

[AIRFLOW-5656] Rename provider to providers module (#6333)

Was this entry helpful?