Package apache-airflow-providers-google

Google services including:

This is detailed commit list of changes for versions provider package: google. For high-level changelog, see package information including changelog.

2.1.0

Latest change: 2021-02-27

Commit

Committed

Subject

50a1504c5

2021-02-27

Fix spellings (#14483)

bfef559cf

2021-02-27

Corrects order of argument in docstring in GCSHook.download method (#14497)

33214d932

2021-02-26

Refactor SQL/BigQuery/Qubole/Druid Check operators (#12677)

c28197998

2021-02-23

Documentation and example dag for CloudDLPDeidentifyContentOperator, GCSObjectExistenceSensor, GCSObjectsWithPrefixExistenceSensor (#14033)

ca35bd7f7

2021-02-21

By default PIP will install all packages in .local folder (#14125)

a7e4266d6

2021-02-21

Refactor GoogleDriveToGCSOperator to use common methods (#14276)

1ab406663

2021-02-16

Add GoogleDriveToLocalOperator (#14191)

59c94c679

2021-02-13

Add 'exists_ok' flag to BigQueryCreateEmptyTable(Dataset)Operator (#14026)

e31b27d59

2021-02-13

Add materialized view support for BigQuery (#14201)

e3bcaa3ba

2021-02-12

Correct typo in GCSObjectsWtihPrefixExistenceSensor  (#14179)

7faa2d978

2021-02-10

Add BigQueryUpdateTableOperator (#14149)

1da697216

2021-02-10

Fixes to dataproc operators and hook (#14086)

02288cf2b

2021-02-10

Add param to CloudDataTransferServiceOperator (#14118)

7d3864547

2021-02-09

#9803 fix bug in copy operation without wildcard  (#13919)

b0c382426

2021-02-07

Add gdrive_to_gcs operator, drive sensor, additional functionality to drive hook, and supporting tests (#13982)

5d7d46bb3

2021-02-05

Improve GCSToSFTPOperator paths handling (#11284)

10343ec29

2021-02-05

Corrections in docs and tools after releasing provider RCs (#14082)

2.0.0

Latest change: 2021-02-04

Commit

Committed

Subject

88bdcfa0d

2021-02-04

Prepare to release a new wave of providers. (#14013)

1872d8719

2021-02-03

Add Apache Beam operators (#12814)

0e8c77b93

2021-02-03

Support google-cloud-logging' >=2.0.0 (#13801)

833e33832

2021-02-02

Fix four bugs in StackdriverTaskHandler (#13784)

d2efb3323

2021-02-02

Support google-cloud-monitoring>=2.0.0 (#13769)

ac2f72c98

2021-02-01

Implement provider versioning tools (#13767)

823741cfe

2021-01-28

Improve GCS system test envs (#13946)

6d6588fe2

2021-01-28

Add Google Cloud Workflows Operators (#13366)

810c15ed8

2021-01-27

Fix and improve GCP BigTable hook and system test (#13896)

661661733

2021-01-27

Add env variables to PubSub example dag (#13794)

f473ca713

2021-01-24

Replace 'google_cloud_storage_conn_id' by 'gcp_conn_id' when using 'GCSHook' (#13851)

a9ac2b040

2021-01-23

Switch to f-strings using flynt. (#13732)

9592be88e

2021-01-22

Fix Google Spanner example dag (#13842)

af52fdb51

2021-01-22

Improve environment variables in GCP Dataflow system test (#13841)

e7946f1cb

2021-01-22

Improve environment variables in GCP Datafusion system test (#13837)

61c1d6ec6

2021-01-22

Improve environment variables in GCP Memorystore system test (#13833)

202f66093

2021-01-22

Improve environment variables in GCP Lifeciences system test (#13834)

70bf307f3

2021-01-21

Add How To Guide for Dataflow (#13461)

3fd5ef355

2021-01-21

Add missing logos for integrations (#13717)

309788e5e

2021-01-18

Refactor DataprocOperators to support google-cloud-dataproc 2.0 (#13256)

7ec858c45

2021-01-17

updated Google DV360 Hook to fix SDF issue (#13703)

ef8617ec9

2021-01-14

Support google-cloud-tasks>=2.0.0 (#13347)

189af5404

2021-01-13

Add system tests for Stackdriver operators (#13644)

a6f999b62

2021-01-11

Support google-cloud-automl >=2.1.0 (#13505)

947dbb73b

2021-01-11

Support google-cloud-datacatalog>=3.0.0 (#13534)

2fb68342b

2021-01-07

Replace deprecated module and operator in example_tasks.py (#13527)

003584bbf

2021-01-05

Fix failing backport packages test (#13497)

7d1ea4cb1

2021-01-05

Replace deprecated module and operator in example_tasks.py (#13473)

c7d75ad88

2021-01-05

Revert "Support google-cloud-datacatalog 3.0.0 (#13224)" (#13482)

feb84057d

2021-01-04

Support google-cloud-datacatalog 3.0.0 (#13224)

3a3e73998

2021-01-04

Fix insert_all method of BigQueryHook to support tables without schema (#13138)

c33d2c06b

2021-01-02

Fix another pylint c-extension-no-member (#13438)

f6518dd6a

2021-01-02

Generalize MLEngineStartTrainingJobOperator to custom images (#13318)

9de712708

2020-12-31

Support google-cloud-bigquery-datatransfer>=3.0.0 (#13337)

406181d64

2020-12-31

Add Parquet data type to BaseSQLToGCSOperator (#13359)

295d66f91

2020-12-30

Fix Grammar in PIP warning (#13380)

13a9747bf

2020-12-28

Revert "Support google-cloud-tasks>=2.0.0 (#13334)" (#13341)

04ec45f04

2020-12-28

Add DataprocCreateWorkflowTemplateOperator (#13338)

1f712219f

2020-12-28

Support google-cloud-tasks>=2.0.0 (#13334)

f4745c8ce

2020-12-26

Fix typo in example (#13321)

e9d65bd45

2020-12-24

Decode Remote Google Logs (#13115)

e7aeacf33

2020-12-24

Add OracleToGCS Transfer (#13246)

323084e97

2020-12-24

Add timeout option to gcs hook methods. (#13156)

0b626c804

2020-12-22

Support google-cloud-redis>=2.0.0 (#13117)

9042a5855

2020-12-22

Add more operators to example DAGs for Cloud Tasks (#13235)

8c00ec89b

2020-12-22

Support google-cloud-pubsub>=2.0.0 (#13127)

b26b0df5b

2020-12-22

Update compatibility with google-cloud-kms>=2.0 (#13124)

9a1d3820d

2020-12-22

Support google-cloud-datacatalog>=1.0.0 (#13097)

f95b1c9c9

2020-12-21

Add regional support to dataproc workflow template operators (#12907)

6cf76d7ac

2020-12-18

Fix typo in pip upgrade command :( (#13148)

23f27c1b1

2020-12-18

Add system tests for CloudKMSHook (#13122)

cddbf81b1

2020-12-17

Fix Google BigQueryHook method get_schema() (#13136)

1259c712a

2020-12-17

Update compatibility with google-cloud-os-login>=2.0.0 (#13126)

bcf77586e

2020-12-16

Fix Data Catalog operators (#13096)

5090fb0c8

2020-12-15

Add script to generate integrations.json (#13073)

b4b9cf559

2020-12-14

Check for missing references to operator guides (#13059)

1c1ef7ee6

2020-12-14

Add project_id to client inside BigQuery hook update_table method (#13018)

1.0.0

Latest change: 2020-12-09

Commit

Committed

Subject

32971a1a2

2020-12-09

Updates providers versions to 1.0.0 (#12955)

b40dffa08

2020-12-08

Rename remaing modules to match AIP-21 (#12917)

9b39f2478

2020-12-08

Add support for dynamic connection form fields per provider (#12558)

1dcd3e13f

2020-12-05

Add support for extra links coming from the providers (#12472)

2037303ee

2020-11-29

Adds support for Connection/Hook discovery from providers (#12466)

02d94349b

2020-11-29

Don't use time.time() or timezone.utcnow() for duration calculations (#12353)

76bcd08dc

2020-11-28

Added '@apply_defaults' decorator. (#12620)

e1ebfa68b

2020-11-27

Add DataflowJobMessagesSensor and DataflowAutoscalingEventsSensor (#12249)

3fa51f94d

2020-11-24

Add check for duplicates in provider.yaml files (#12578)

c34ef853c

2020-11-20

Separate out documentation building per provider  (#12444)

9e3b2c554

2020-11-19

GCP Secrets Optional Lookup (#12360)

008035450

2020-11-18

Update provider READMEs for 1.0.0b2 batch release (#12449)

7ca0b6f12

2020-11-18

Enable Markdownlint rule MD003/heading-style/header-style (#12427) (#12438)

8d0950646

2020-11-18

Fix download method in GCSToBigQueryOperator (#12442)

2c0920fba

2020-11-17

Adds mechanism for provider package discovery. (#12383)

2cda2f2a0

2020-11-17

Add missing pre-commit definition - provider-yamls (#12393)

80a957f14

2020-11-17

Add Dataflow sensors - job metrics (#12039)

ae7cb4a1e

2020-11-17

Update wrong commit hash in backport provider changes (#12390)

917e6c442

2020-11-16

Add provide_file_and_upload to GCSHook (#12310)

cfa4ecfeb

2020-11-15

Add DataflowJobStatusSensor and support non-blocking execution of jobs (#11726)

6889a333c

2020-11-15

Improvements for operators and hooks ref docs (#12366)

7825e8f59

2020-11-13

Docs installation improvements (#12304)

32b59f835

2020-11-12

Fixes the sending of an empty list to BigQuery 'list_rows' (#12307)

250436d96

2020-11-10

Fix spelling in Python files (#12230)

502ba309e

2020-11-10

Enable Markdownlint rule - MD022/blanks-around-headings (#12225)

dd2095f4a

2020-11-10

Simplify string expressions & Use f-string (#12216)

f37c6e6fc

2020-11-10

Add Compute Engine SSH hook (#9879)

85a18e13d

2020-11-09

Point at pypi project pages for cross-dependency of provider packages (#12212)

59eb5de78

2020-11-09

Update provider READMEs for up-coming 1.0.0beta1 releases (#12206)

61feb6ec4

2020-11-09

Provider's readmes generated for elasticsearch and google packages (#12194)

b2a28d159

2020-11-09

Moves provider packages scripts to dev (#12082)

fcb6b00ef

2020-11-08

Add authentication to AWS with Google credentials (#12079)

2ef3b7ef8

2020-11-08

Fix ERROR - Object of type 'bytes' is not JSON serializable when using store_to_xcom_key parameter (#12172)

0caec9fd3

2020-11-06

Dataflow - add waiting for successful job cancel (#11501)

cf9437d79

2020-11-06

Simplify string expressions (#12123)

91a64db50

2020-11-04

Format all files (without excepions) by black (#12091)

fd3db778e

2020-11-04

Add server side cursor support for postgres to GCS operator (#11793)

f1f194026

2020-11-04

Add DataflowStartSQLQuery operator (#8553)

41bf172c1

2020-11-04

Simplify string expressions (#12093)

5f5244b74

2020-11-04

Add template fields renderers to Biguery and Dataproc operators (#12067)

4e8f9cc8d

2020-11-03

Enable Black - Python Auto Formmatter (#9550)

8c42cf1b0

2020-11-03

Use PyUpgrade to use Python 3.6 features (#11447)

45ae145c2

2020-11-03

Log BigQuery job id in insert method of BigQueryHook (#12056)

e324b37a6

2020-11-03

Add job name and progress logs to Cloud Storage Transfer Hook (#12014)

6071fdd58

2020-11-02

Improve handling server errors in DataprocSubmitJobOperator (#11947)

2f703df12

2020-10-30

Add SalesforceToGcsOperator (#10760)

e5713e00b

2020-10-29

Add drain option when canceling Dataflow pipelines (#11374)

37eaac3c5

2020-10-29

The PRs which are not approved run subset of tests (#11828)

79cb77199

2020-10-28

Fixing re pattern and changing to use a single character class. (#11857)

5a439e84e

2020-10-26

Prepare providers release 0.0.2a1 (#11855)

240c7d4d7

2020-10-26

Google Memcached hooks - improve protobuf messages handling (#11743)

8afdb6ac6

2020-10-26

Fix spellings (#11825)

872b1566a

2020-10-25

Generated backport providers readmes/setup for 2020.10.29 (#11826)

6ce855af1

2020-10-24

Fix spelling (#11821)

483068745

2020-10-24

Use Python 3 style super classes (#11806)

727c739af

2020-10-22

Improve Cloud Memorystore for Redis example (#11735)

1da8379c9

2020-10-22

Fix static checks after merging #10121 (#11737)

91503308c

2020-10-22

Add Google Cloud Memorystore Memcached Operators (#10121)

950c16d0b

2020-10-21

Retry requests in case of error in Google ML Engine Hook (#11712)

2bfc53b5e

2020-10-21

Fix doc errors in google provider files. (#11713)

53e606210

2020-10-21

Enforce strict rules for yamllint (#11709)

349b0811c

2020-10-20

Add D200 pydocstyle check (#11688)

2d854c350

2020-10-19

Add service_account to Google ML Engine operator (#11619)

46a121fb7

2020-10-18

docs: Update Bigquery clustering docstrings (#11232)

49c58147f

2020-10-18

Strict type checking for provider Google (#11609)

0823d46a7

2020-10-16

Add type annotations for AWS operators and hooks (#11434)

3c10ca650

2020-10-16

Add DataflowStartFlexTemplateOperator (#8550)

8865d14df

2020-10-16

Strict type checking for provider google cloud  (#11548)

16e712971

2020-10-13

Added support for provider packages for Airflow 2.0 (#11487)

06141d6d0

2020-10-12

Google cloud operator strict type check (#11450)

d305876be

2020-10-12

Remove redundant None provided as default to dict.get() (#11448)

1845cd11b

2020-10-11

Strict type check for google ads and cloud hooks (#11390)

bd204bb91

2020-10-11

Optionally set null marker in csv exports in BaseSQLToGCSOperator (#11409)

75071831b

2020-10-10

Remove redundant parentheses from Python files (#10967)

8baf657fc

2020-10-09

Fix regression in DataflowTemplatedJobStartOperator (#11167)

b0fcf6755

2020-10-07

Add AzureFileShareToGCSOperator (#10991)

47b05a87f

2020-10-07

Improve handling of job_id in BigQuery operators (#11287)

0a0e1af80

2020-10-03

Fix Broken Markdown links in Providers README TOC (#11249)

ca4238eb4

2020-10-02

Fixed month in backport packages to October (#11242)

5220e4c38

2020-10-02

Prepare Backport release 2020.09.07 (#11238)

cb52fb0ae

2020-09-27

Add example DAG and system test for MySQLToGCSOperator (#10990)

99accec29

2020-09-25

Fix incorrect Usage of Optional[str] & Optional[int] (#11141)

e3f96ce7a

2020-09-24

Fix incorrect Usage of Optional[bool] (#11138)

daf8f3108

2020-09-23

Add template fields renderers for better UI rendering (#11061)

f3e87c503

2020-09-22

Add D202 pydocstyle check (#11032)

cb979f9f2

2020-09-22

Get Airflow configs with sensitive data from CloudSecretManagerBackend (#11024)

76545bb3d

2020-09-16

Add example dag and system test for S3ToGCSOperator (#10951)

22c631625

2020-09-16

Fix more docs spellings (#10965)

12a652f53

2020-09-13

Fix parameter name collision in AutoMLBatchPredictOperator #10723 (#10869)

41a62735e

2020-09-11

Add on_kill method to BigQueryInsertJobOperator (#10866)

3e91da56e

2020-09-11

fix typo in firebase/example_filestore DAG (#10875)

68cc7273b

2020-09-10

Add on_kill method to DataprocSubmitJobOperator (#10847)

f92095721

2020-09-10

Fix and remove some more typos from spelling_wordlist.txt (#10845)

9549274d1

2020-09-09

Upgrade black to 20.8b1 (#10818)

078bfaf60

2020-09-08

Extract missing gcs_to_local example DAG from gcs example (#10767)

10ce31127

2020-09-08

Deprecate using global as the default region in Google Dataproc operators and hooks (#10772)

f14f37971

2020-09-07

[AIRFLOW-10672] Refactor BigQueryToGCSOperator to use new method (#10773)

c8ee45568

2020-09-07

Refactor DataprocCreateCluster operator to use simpler interface (#10403)

ece685b5b

2020-09-05

Asynchronous execution of Dataproc jobs with a Sensor (#10673)

6e3d7b63d

2020-09-04

Add masterConfig parameter to MLEngineStartTrainingJobOperator (#10578)

804548d58

2020-09-01

Add Dataprep operators (#10304)

11c00bc82

2020-08-30

Fix typos: duplicated "the" (#10647)

2ca615cff

2020-08-29

Update Google Cloud branding (#10642)

1b533f617

2020-08-28

Fix broken master - DLP (#10635)

5ae82a56d

2020-08-28

Fix Google DLP example and improve ops idempotency (#10608)

3867f7662

2020-08-28

Update Google Cloud branding (#10615)

91ff31ad1

2020-08-27

Documentation for Google Cloud Data Loss Prevention (#8201) (#9651)

fdd9b6f65

2020-08-25

Enable Black on Providers Packages (#10543)

d76026545

2020-08-25

PyDocStyle: No whitespaces allowed surrounding docstring text (#10533)

d1bce91bb

2020-08-25

PyDocStyle: Enable D403: Capitalized first word of docstring (#10530)

866701c80

2020-08-25

Fix typo in "Cloud" (#10534)

47265e7b5

2020-08-24

Fix typo in PostgresHook (#10529)

3696c34c2

2020-08-24

Fix typo in the word "release" (#10528)

2f2d8dbfa

2020-08-25

Remove all "noinspection" comments native to IntelliJ (#10525)

3734876d9

2020-08-24

Implement impersonation in google operators (#10052)

b0598b535

2020-08-24

Add support for creating multiple replicated clusters in Bigtable hook and operator (#10475)

ee7ca128a

2020-08-22

Fix broken Markdown refernces in Providers README (#10483)

515cc72c9

2020-08-22

Fix typo in timed_out (#10459)

7c206a82a

2020-08-22

Replace assigment with Augmented assignment (#10468)

88c7d2e52

2020-08-21

Dataflow operators don't not always create a virtualenv (#10373)

083c3c129

2020-08-18

Simplified GCSTaskHandler configuration (#10365)

1ae5bdf23

2020-08-17

Add test for GCSTaskHandler (#9600) (#9861)

e195a980b

2020-08-16

Add type annotations for mlengine_operator_utils (#10297)

382c1011b

2020-08-16

Add Bigtable Update Instance Hook/Operator (#10340)

bfa5a8d5f

2020-08-15

CI: Fix failing docs-build (#10342)

be46d20fb

2020-08-15

Improve idempotency of BigQueryInsertJobOperator (#9590)

47387a69e

2020-08-14

Catch Permission Denied exception when getting secret from GCP Secret Manager. (#10326)

2f0613b0c

2020-08-13

Implement Google BigQuery Table Partition Sensor (#10218)

f6734b3b8

2020-08-12

Enable Sphinx spellcheck for doc generation (#10280)

8f8db8959

2020-08-12

DbApiHook: Support kwargs in get_pandas_df (#9730)

ef088314f

2020-08-09

Added DataprepGetJobsForJobGroupOperator (#10246)

b43f90abf

2020-08-09

Fix various typos in the repo (#10263)

c29533888

2020-08-08

Add labels param to Google MLEngine Operators (#10222)

cdec30125

2020-08-07

Add correct signature to all operators and sensors (#10205)

eff0f0321

2020-08-06

`` Update guide for Google Cloud Secret Manager Backend (#10172)``

24c8e4c2d

2020-08-06

Changes to all the constructors to remove the args argument (#10163)

010322692

2020-08-06

Improve handling Dataproc cluster creation with ERROR state (#9593)

1437cb749

2020-08-04

Add correct signatures for operators in google provider package (#10144)

6efa1b9cb

2020-08-03

Add additional Cloud Datastore operators (#10032)

27020f8e5

2020-08-03

Add try clause to DataFusionHook.wait_for_pipeline_state (#10031)

4e3799fec

2020-08-02

[AIRFLOW-4541] Replace os.mkdirs usage with pathlib.Path(path).mkdir (#10117)

85c56b173

2020-08-02

Add missing params to GCP Pub/Sub creation_subscription (#10106)

b79466c12

2020-08-02

Fix sensor not providing arguments for GCSHook (#10074)

4ee35d027

2020-08-02

Fix hook not passing gcp_conn_id to base class (#10075)

aeea71274

2020-08-02

Remove 'args' parameter from provider operator constructors (#10097)

4c84661ad

2020-07-31

Split Display Video 360 example into smaler DAGs (#10077)

59cbff087

2020-07-29

Fix docstrings in BigQueryGetDataOperator (#10042)

81b87d48e

2020-07-27

Add unit tests for GcpBodyFieldSanitizer in Google providers (#9996)

7d24b088c

2020-07-25

Stop using start_date in default_args in example_dags (2) (#9985)

8b10a4b35

2020-07-25

Stop using start_date in default_args in example_dags (#9982)

ef98edf4d

2020-07-23

Add more information about using GoogleAdsHook (#9951)

33f0cd265

2020-07-22

apply_default keeps the function signature for mypy (#9784)

39a0288a4

2020-07-22

Add Google Authentication for experimental API (#9848)

c2db0dfeb

2020-07-22

More strict rules in mypy (#9705) (#9906)

c4244e18b

2020-07-22

Fix calling 'get_client' in BigQueryHook.table_exists (#9916)

5eacc1642

2020-07-22

Add support for impersonation in GCP hooks (#9915)

1cfdebf5f

2020-07-21

Fix insert_job method of BigQueryHook (#9899)

c8c52e69c

2020-07-21

Remove type hint causing DeprecationWarning in Firestore operators (#9819)

eb6f1d1cf

2020-07-16

Fix typo in datafusion operator (#9859)

b01d95ec2

2020-07-15

Change DAG.clear to take dag_run_state (#9824)

6d65c15d1

2020-07-15

Add guide for AI Platform (previously Machine Learning Engine) Operators  (#9798)

770de53eb

2020-07-15

BigQueryTableExistenceSensor needs to specify keyword arguments (#9832)

2d8dbacdf

2020-07-15

Add CloudVisionDeleteReferenceImageOperator  (#9698)

9f017951b

2020-07-15

Add Google Deployment Manager Hook (#9159)

ed5004cca

2020-07-14

Allow 'replace' flag in gcs_to_gcs operator. (#9667)

553bb7af7

2020-07-13

Keep functions signatures in decorators (#9786)

68925904e

2020-07-13

Add multiple file upload functionality to GCS hook (#8849)

1de78e8f9

2020-07-12

Add Google Stackdriver link (#9765)

092d33f29

2020-07-11

Fix StackdriverTaskHandler + add system tests (#9761)

b2305660f

2020-07-09

Update example DAG for AI Platform operators (#9727)

23f80f34a

2020-07-08

Move gcs & wasb task handlers to their respective provider packages (#9714)

44d4ae809

2020-07-06

Upgrade to latest pre-commit checks (#9686)

a79e2d4c4

2020-07-06

Move provider's log task handlers to the provider package (#9604)

cd3d9d934

2020-07-02

Fix using .json template extension in GMP operators (#9566)

4799af30e

2020-06-30

Extend BigQuery example with include clause (#9572)

e33f1a12d

2020-06-30

Add template_ext to BigQueryInsertJobOperator (#9568)

40add26d4

2020-06-29

Remove almost all references to airflow.contrib (#9559)

c420dbd6e

2020-06-27

Bump Pylint to 2.5.3 (#9294)

0051c89cb

2020-06-26

nitpick fix (#9527)

87fdbd070

2020-06-25

Use literal syntax instead of function calls to create data structure (#9516)

7256f4caa

2020-06-22

Pylint fixes and deprecation of rare used methods in Connection (#9419)

e13a14c87

2020-06-21

Enable & Fix Whitespace related PyDocStyle Checks (#9458)

5b680e27e

2020-06-19

Don't use connection to store task handler credentials (#9381)

d0e7db402

2020-06-19

Fixed release number for fresh release (#9408)

416334e2e

2020-06-19

Properly propagated warnings in operators (#9348)

12af6a080

2020-06-19

Final cleanup for 2020.6.23rc1 release preparation (#9404)

c7e5bce57

2020-06-19

Prepare backport release candidate for 2020.6.23rc1 (#9370)

4e09c6442

2020-06-18

Adds GCP Secret Manager Hook (#9368)

40bf8f28f

2020-06-18

Detect automatically the lack of reference to the guide in the operator descriptions (#9290)

f6bd817a3

2020-06-16

Introduce 'transfers' packages (#9320)

639972d99

2020-06-16

Add support for latest Apache Beam SDK in Dataflow operators (#9323)

1459970b3

2020-06-15

Rename CloudBuildCreateBuildOperator to CloudBuildCreateOperator (#9314)

431ea3291

2020-06-15

Resolve upstream tasks when template field is XComArg (#8805)

aee6ab94e

2020-06-15

Wait for pipeline state in Data Fusion operators (#8954)

fb1c8b83d

2020-06-10

Add test for BQ operations using location (#9206)

a26afbfa5

2020-06-10

Make generated job_id more informative in BQ insert_job (#9203)

c41192fa1

2020-06-10

Upgrade pendulum to latest major version ~2.0 (#9184)

b1c8c5ed5

2020-06-09

Allows using private endpoints in GKEStartPodOperator (#9169)

5918efc86

2020-06-05

Add 3.8 to the test matrices (#8836)

9bcdadaf7

2020-06-05

Add 'main' param to template_fields in DataprocSubmitPySparkJobOperator (#9154)

f56811dff

2020-06-05

[AIRFLOW-6290] Create guide for GKE operators (#8883)

76962867b

2020-06-04

Fix sql_to_gcs hook gzip of schema_file (#9140)

17adcea83

2020-06-02

Fix handling of subprocess error handling in s3_file_transform and gcs (#9106)

789852546

2020-06-01

Add BigQueryInsertJobOperator (#8868)

29eb68b90

2020-05-31

Create guide for Dataproc Operators (#9037)

886afaf62

2020-05-29

Add example dag and system test for LocalFilesystemToGCSOperator (#9043)

a779c4dfc

2020-05-29

add separate example dags and system tests for GCSToGoogleSheetsOperator (#9066)

ada26be23

2020-05-29

Add correct description for dst param in LocalFilesystemToGCSOperator (#9055)

81b2761b8

2020-05-29

add example dag and system test for GoogleSheetsToGCSOperator (#9056)

0b0e4f7a4

2020-05-26

Preparing for RC3 relase of backports (#9026)

00642a46d

2020-05-26

Fixed name of 20 remaining wrongly named operators. (#8994)

3994030ea

2020-05-26

Refactor BigQuery operators (#8858)

cdb3f2545

2020-05-26

All classes in backport providers are now importable in Airflow 1.10 (#8991)

1d36b0303

2020-05-23

Fix references in docs (#8984)

cf5cf45e1

2020-05-23

Support YAML input for CloudBuildCreateOperator (#8808)

499493c5c

2020-05-19

[AIRFLOW-6586] Improvements to gcs sensor (#7197)

375d1ca22

2020-05-19

Release candidate 2 for backport packages 2020.05.20 (#8898)

841d81664

2020-05-19

Allow setting the pooling time in DLPHook (#8824)

12c5e5d8a

2020-05-17

Prepare release candidate for backport packages (#8891)

f3521fb0e

2020-05-16

Regenerate readme files for backport package release (#8886)

15273f0ea

2020-05-16

Check for same task instead of Equality to detect Duplicate Tasks (#8828)

92585ca4c

2020-05-15

Added automated release notes generation for backport operators (#8807)

e1e833bb2

2020-05-13

Update GoogleBaseHook to not follow 308 and use 60s timeout (#8816)

8b5491971

2020-05-12

Refactor BigQuery hook methods to use python library (#8631)

6911dfe83

2020-05-12

Fix template fields in Google operators (#8840)

4b06fde0f

2020-05-12

Fix Flake8 errors (#8841)

1d12c347c

2020-05-12

Refactor BigQuery check operators (#8813)

493b685d7

2020-05-10

Add separate example DAGs and system tests for google cloud speech (#8778)

79ef8bed8

2020-05-10

Added Upload Multiple Entity Read Files to specified big query dataset (#8610)

280f1f0c4

2020-05-10

Correctly restore upstream_task_ids when deserializing Operators (#8775)

58aefb23b

2020-05-08

Added SDFtoGCSOperator (#8740)

723c52c94

2020-05-07

Add documentation for SpannerDeployInstanceOperator (#8750)

25ee4211b

2020-05-06

Support all RuntimeEnvironment parameters in DataflowTemplatedJobStartOperator (#8531)

8d6f1aa4b

2020-05-05

Support num_retries field in env var for GCP connection (#8700)

67caae0f2

2020-05-04

Add system test for gcs_to_bigquery (#8556)

bc45fa675

2020-05-03

Add system test and docs for Facebook Ads operators (#8503)

a28c66f23

2020-04-30

[AIRFLOW-4734] Upsert functionality for PostgresHook.insert_rows() (#8625)

992a24ce4

2020-04-28

Split and improve BigQuery example DAG (#8529)

c1fb28230

2020-04-28

Refactor BigQueryHook dataset operations (#8477)

e8d0f8fea

2020-04-26

Improve idempodency in CloudDataTransferServiceCreateJobOperator (#8430)

37fdfa977

2020-04-26

[AIRFLOW-6281] Create guide for GCS to GCS transfer operators (#8442)

14b22e6ff

2020-04-25

Add hook and operator for Google Cloud Life Sciences (#8481)

72ddc94d1

2020-04-23

Pass location using parmamter in Dataflow integration (#8382)

912aa4b42

2020-04-23

Added GoogleDisplayVideo360DownloadLineItemsOperator (#8174)

57c8c0583

2020-04-22

Use python client in BQ hook create_empty_table/dataset and table_exists (#8377)

5d3a7eef3

2020-04-20

Allow multiple extra_packages in Dataflow (#8394)

79c99b1b6

2020-04-18

Added location parameter to BigQueryCheckOperator (#8273)

79d3f33c1

2020-04-17

Clean up temporary files in Dataflow operators (#8313)

efcffa323

2020-04-16

Add Dataproc SparkR Example (#8240)

b198a1fa9

2020-04-15

Create guide for BigQuery operators (#8276)

2636cc932

2020-04-14

Raise exception when GCP credential doesn't support account impersonation (#8213)

eee4ebaee

2020-04-14

Added Facebook Ads Operator #7887 (#8008)

8cae07ea1

2020-04-14

fixed typo (#8294)

45c898330

2020-04-13

Less aggressive eager upgrade of requirements (#8267)

1fd9ed384

2020-04-13

Add mypy plugin for decorators. (#8145)

327b0a9f7

2020-04-13

Added GoogleDisplayVideo360UploadLineItemsOperator (#8216)

bb5e403a3

2020-04-10

Honor schema type for MySQL to GCS data pre-process (#8090)

87969a350

2020-04-09

[AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170)

3fc89f29f

2020-04-06

[AIRFLOW-7106] Cloud data fusion integration - Allow to pass args to start pipeline (#7849)

7ef75d239

2020-04-03

[AIRFLOW-7117] Honor self.schema in sql_to_gcs as schema to upload (#8049)

ed2bc0057

2020-04-02

Add Google Ads list accounts operator (#8007)

3808a6206

2020-04-01

Unify Google class/package names (#8033)

8a0240257

2020-03-31

Rename CloudBaseHook to GoogleBaseHook and move it to google.common (#8011)

8e8978007

2020-03-31

Add more refactor steps for providers.google (#8010)

aae3b8fb2

2020-03-31

Individual package READMEs (#8012)

779023968

2020-03-30

[AIRFLOW-7075] Operators for storing information from GCS into GA (#7743)

49abce521

2020-03-30

Improve system tests for Cloud Build (#8003)

0f19a930d

2020-03-29

Remove GKEStartPodOperator when backporting (#7908)

0e1c238b2

2020-03-28

Get Airflow Variables from GCP Secrets Manager (#7946)

eb4af4f94

2020-03-28

Make BaseSecretsBackend.build_path generic (#7948)

01f99426f

2020-03-28

Add download/upload operators for GCS and Google Sheets (#7866)

892522f8e

2020-03-26

Change signature of GSheetsHook methods (#7853)

bfd425157

2020-03-26

Improve idempotency in MLEngineHook.create_model (#7811)

f9c226343

2020-03-26

Fix CloudSecretsManagerBackend invalid connections_prefix (#7861)

e3920f12f

2020-03-26

Improve setUp/tearDown in Cloud Firestore system test (#7862)

8ba8a7295

2020-03-26

Improve example DAGs for Cloud Memorystore (#7855)

f7d1a437c

2020-03-26

Fix CloudMemorystoreCreateInstanceAndImportOperator operator (#7856)

beef6c230

2020-03-26

Improve authorization in GCP system tests (#7863)

5f165f3e4

2020-03-26

[AIRFLOW-5801] Get GCP credentials from file instead of JSON blob (#7869)

686d7d50b

2020-03-25

Standardize SecretBackend class names (#7846)

1982c3fdc

2020-03-24

Run Dataflow for ML Engine summary in venv (#7809)

eef87b995

2020-03-23

[AIRFLOW-7105] Unify Secrets Backend method interfaces (#7830)

529db07b2

2020-03-23

Improve Google PubSub hook publish method (#7831)

4bde99f13

2020-03-23

Make airflow/providers pylint compatible (#7802)

a001489b5

2020-03-23

Improve example DAG for ML Engine (#7810)

9e5a8e7f8

2020-03-23

Add call to Super class in 'google' providers (#7823)

b86bf79bf

2020-03-23

Fix typo in GCP credentials_provider's docstring (#7818)

56c013ce9

2020-03-23

Add missing docstring in BigQueryHook.create_empty_table (#7817)

426a79847

2020-03-23

Imrove support for laatest API in  MLEngineStartTrainingJobOperator (#7812)

cdf1809fc

2020-03-23

[AIRFLOW-7104] Add Secret backend for GCP Secrets Manager (#7795)

27dac00e1

2020-03-22

[AIRFLOW-7099] Improve system test for cloud transfer service (#7794)

0daf5d729

2020-03-22

Add ability to specify a maximum modified time for objects in GCSToGCSOperator (#7791)

c8088c2bd

2020-03-20

[AIRFLOW-7100] Add GoogleAnalyticsGetAdsLinkOperator (#7781)

5106a2931

2020-03-20

[AIRFLOW-6752] Add GoogleAnalyticsRetrieveAdsLinksListOperator (#7748)

759ce2a80

2020-03-20

[AIRFLOW-6978] Add PubSubPullOperator (#7766)

6b9b214e4

2020-03-20

[AIRFLOW-6732] Add GoogleAdsHook and GoogleAdsToGcsOperator (#7692)

b11891696

2020-03-19

[AIRFLOW-7069] Fix cloudsql system tests (#7770)

ae854cae5

2020-03-19

[AIRFLOW-7082] Remove catch_http_exception decorator in GCP hooks (#7756)

7e1e954d2

2020-03-19

[AIRFLOW-7085] Cache credentials, project_id in GCP Base Hook (#7759)

6e21c139b

2020-03-19

[AIRFLOW-XXXX] Fix reference to GCP classes in guides (#7762)

ce022a3f7

2020-03-19

[AIRFLOW-XXXX] Add cross-references for operators guide (#7760)

029c84e55

2020-03-18

[AIRFLOW-5421] Add Presto to GCS transfer operator (#7718)

63a3102ed

2020-03-18

[AIRFLOW-7064] Add CloudFirestoreExportDatabaseOperator (#7725)

73305c7bd

2020-03-18

[AIRFLOW-7081] Remove env variables from GCP guide (#7755)

60fdbf6d9

2020-03-18

[AIRFLOW-5610] Add ability to specify multiple objects to copy in GCSToGCSOperator (#7728)

de7e934ca

2020-03-17

[AIRFLOW-7079] Remove redundant code for storing template_fields (#7750)

0de0347b2

2020-03-17

[AIRFLOW-6855]: Escape project_dataset_table in SQL query in gcs to bq (#7475)

91557c6f8

2020-03-17

[AIRFLOW-7073] GKEStartPodOperator always use connection credentials (#7738)

51161dbd9

2020-03-16

[AIRFLOW-5664] Store timestamps with microseconds precision (#6354)

2bc020c43

2020-03-14

[AIRFLOW-7055] Verbose logging option for google provider (#7711)

c997cab42

2020-03-13

[AIRFLOW-6724] Add Google Analytics 360 Accounts Retrieve Operator (#7630)

137896f32

2020-03-12

[AIRFLOW-7034] Remove feature: Assigning Dag to task using Bitshift Op (#7685)

1f77f943d

2020-03-10

[AIRFLOW-6980] Improve system tests and building providers package (#7615)

bf9b6b6d7

2020-03-09

[AIRFLOW-5013] Add GCP Data Catalog Hook and operators (#7664)

e5130dc9f

2020-03-09

[AIRFLOW-2911] Add job cancellation capability to Dataflow service (#7659)

faf0df4b9

2020-03-09

[AIRFLOW-XXXX] Fix upsert operator in BQ example DAG (#7666)

42eef3821

2020-03-07

[AIRFLOW-6877] Add cross-provider dependencies as extras (#7506)

b5b9795f0

2020-03-07

[AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (fix) (#7624)

6b65038fb

2020-03-06

[AIRFLOW-6990] Improve system tests for Google Marketing Platform (#7631)

755fe5224

2020-03-05

[AIRFLOW-6915] Add AI Platform Console Link for MLEngineStartTrainingJobOperator (#7535)

cb2f33911

2020-03-04

[AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (#7609)

09fea3ce8

2020-03-04

[AIRFLOW-6977] Fix BigQuery DTS example DAG (#7612)

8230ccc48

2020-03-04

[AIRFLOW-6926] Fix Google Tasks operators return types and idempotency (#7547)

0d1e3088a

2020-03-04

[AIRFLOW-6970] Improve GCP Video Intelligence system tests (#7604)

ab6bb0012

2020-03-03

[AIRFLOW-6971] Fix return type in CloudSpeechToTextRecognizeSpeechOperator (#7607)

3db4ade3d

2020-02-29

[AIRFLOW-6924] Fix Google DLP operators return types (#7546)

008b4bab1

2020-02-27

[AIRFLOW-6730] Use total_seconds instead of seconds (#7363)

bb552b2d9

2020-02-25

[AIRFLOW-6908] Lazy load AirflowException (#7528)

d1a34246a

2020-02-25

[AIRFLOW-6593] Add GCP Stackdriver Alerting Hooks and Operators (#7322)

3320e432a

2020-02-24

[AIRFLOW-6817] Lazy-load 'airflow.DAG' to keep user-facing API untouched (#7517)

dcf874352

2020-02-24

[AIRFLOW-6894] Prevent db query in example_dags (#7516)

4d03e33c1

2020-02-22

[AIRFLOW-6817] remove imports from 'airflow/__init__.py', replaced implicit imports with explicit imports, added entry to 'UPDATING.MD' - squashed/rebased (#7456)

35b961637

2020-02-21

[AIRFLOW-4973] Add Cloud Data Fusion Pipeline integration (#7486)

aff3a361b

2020-02-20

[AIRFLOW-6558] Campaign Manager operators for conversions (#7420)

9cbd7de6d

2020-02-18

[AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412)

5b199cb86

2020-02-17

[AIRFLOW-XXXX] Typo in example_bigquery DAG (#7429)

2c9345a8e

2020-02-17

[AIRFLOW-6759] Added MLEngine operator/hook to cancel MLEngine jobs (#7400)

946bdc23c

2020-02-16

[AIRFLOW-6405] Add GCP BigQuery Table Upsert Operator (#7126)

2381c820c

2020-02-13

[AIRFLOW-6505] Let emoji encoded properly for json.dumps() (#7399)

04c1fefbf

2020-02-03

[AIRFLOW-6676] added GCSDeleteBucketOperator (#7307)

a0252748f

2020-02-03

[AIRFLOW-6717] Remove non-existent field from templated_fields (#7340)

97a429f9d

2020-02-02

[AIRFLOW-6714] Remove magic comments about UTF-8 (#7338)

9d8d07557

2020-02-03

[AIRFLOW-6715] Fix Google Cloud DLP Example DAG (#7337)

cf141506a

2020-02-02

[AIRFLOW-6708] Set unique logger names (#7330)

373c6aa4a

2020-01-30

[AIRFLOW-6682] Move GCP classes to providers package (#7295)

83c037873

2020-01-30

[AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287)

057f3ae3a

2020-01-29

[AIRFLOW-6670][depends on AIRFLOW-6669] Move contrib operators to providers package (#7286)

ceea293c1

2020-01-28

[AIRFLOW-6656] Fix AIP-21 moving (#7272)

c42a375e7

2020-01-27

[AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265)

059eda05f

2020-01-21

[AIRFLOW-6610] Move software classes to providers package (#7231)

f4d3e5e54

2020-01-13

[AIRFLOW-6102] [AIP-21] Rename Dataproc operators (#7151)

e7bf8ecb4

2020-01-13

[AIRFLOW-6119] [AIP-21] Rename GCS operators, hooks and sensors (#7125)

5b6772cb8

2020-01-09

[AIRFLOW-6125] [AIP-21] Rename S3 operator and SFTP operator (#7112)

4f8592ae8

2020-01-08

[AIRFLOW-6118] [AIP-21] Rename Pubsub operators and hook (#7046)

20299473f

2020-01-03

[AIRFLOW-6115] [AIP-21] Rename GCP vision operators (#7020)

18e8cea4e

2020-01-03

[AIRFLOW-6428] Fix import path for airflow.utils.dates.days_ago in Example DAGs (#7007)

95087af14

2019-12-31

[AIRFLOW-6110] [AIP-21] Rename natural_language service (#6968)

69629a5a9

2019-12-09

[AIRFLOW-5807] Move SFTP from contrib to providers. (#6464)

25e9047a4

2019-12-09

[AIRFLOW-6193] Do not use asserts in Airflow main code (#6749)

ed0a14f32

2019-12-09

[AIRFLOW-6120] Rename GoogleCloudBaseHook (#6734)

2f2f89c14

2019-12-01

[AIRFLOW-6139] Consistent spaces in pylint enable/disable (#6701)

03c870a61

2019-11-26

[AIRFLOW-6010] Remove cyclic imports and pylint hacks (#6601)

5c4cfea8c

2019-11-15

[AIRFLOW-5718] Add SFTPToGoogleCloudStorageOperator (#6393)

44a8c37a9

2019-11-13

[AIRFLOW-XXX] Fix the docstring for Dataproc get_job method (#6581)

d633d3ac4

2019-11-13

[AIRFLOW-5691] Rewrite Dataproc operators to use python library (#6371)

d985c02d9

2019-11-05

[AIRFLOW-XXX] Add How-To-Guide to GCP PubSub (#6497)

a296cdabd

2019-11-04

[AIRFLOW-5743] Move Google PubSub to providers package (#6476)

470b2a779

2019-10-30

[AIRFLOW-5741] Move Cloud Natural Language to providers (#6421)

f2caa451f

2019-10-27

[AIRFLOW-5742] Move Google Cloud Vision to providers package (#6424)

16d7accb2

2019-10-22

[AIRFLOW-4971] Add Google Display & Video 360 integration (#6170)

4e661f535

2019-10-22

[AIRFLOW-5379] Add Google Search Ads 360 operators (#6228)

19e32b4e2

2019-10-18

[AIRFLOW-5656] Rename provider to providers module (#6333)

Was this entry helpful?