Package apache-airflow-providers-google

Google services including:

This is detailed commit list of changes for versions provider package: google. For high-level changelog, see package information including changelog.

10.3.0

Latest change: 2023-07-05

Commit

Committed

Subject

3878fe6fab

2023-07-05

Remove spurious headers for provider changelogs (#32373)

cb4927a018

2023-07-05

Prepare docs for July 2023 wave of Providers (#32298)

f8593503cb

2023-07-05

Add default_deferrable config (#31712)

d6e254db68

2023-06-30

Deprecate 'delimiter' param and source object's wildcards in GCS, introduce 'match_glob' param. (#31261)

dd937e51fe

2023-06-30

Add 'on_finish_action' to 'KubernetesPodOperator' (#30718)

c0eaa9b25d

2023-06-29

Add deferrable mode to CloudSQLExportInstanceOperator (#30852)

f3f69bf1e0

2023-06-29

Refactor GKECreateClusterOperator's body validation (#31923)

7d2ec76c72

2023-06-29

Make the deferrable version of DataprocCreateBatchOperator handle a batch_id that already exists (#32216)

09d4718d3a

2023-06-27

Improve provider documentation and README structure (#32125)

b156db3a70

2023-06-23

Adding 'src_fmt_configs' to the list of template fields. (#32097)

59d64d8f2e

2023-06-22

[Issue-32069] Fix name format in the batch requests (#32070)

fd116cc196

2023-06-22

Google provider docstring improvements (#31731)

8f41584777

2023-06-21

Optimize deferrable mode execution for 'BigQueryValueCheckOperator' (#31872)

fe7a1aa096

2023-06-21

Switch Google Ads API version from v13 to v14 (#32028)

43fa157e51

2023-06-20

Fix 'BigQueryInsertJobOperator'  error handling in deferrable mode (#32034)

2a79fb74fd

2023-06-20

Fix 'BIGQUERY_JOB_DETAILS_LINK_FMT' in 'BigQueryConsoleLink' (#31953)

10.2.0

Latest change: 2023-06-20

Commit

Committed

Subject

79bcc2e668

2023-06-20

Prepare RC1 docs for June 2023 wave of Providers (#32001)

8b146152d6

2023-06-20

Add note about dropping Python 3.7 for providers (#32015)

f2ebc292fe

2023-06-19

Provide missing project id and creds for TabularDataset (#31991)

66299338eb

2023-06-18

add a return when the event is yielded in a loop to stop the execution (#31985)

e6960f1ad6

2023-06-15

Revert "Fix 'BIGQUERY_JOB_DETAILS_LINK_FMT' in 'BigQueryConsoleLink' (#31457)" (#31935)

c7072c0490

2023-06-15

Fix 'BIGQUERY_JOB_DETAILS_LINK_FMT' in 'BigQueryConsoleLink' (#31457)

a81ac70b33

2023-06-15

Add deferrable mode to PubsubPullSensor (#31284)

b502e665d6

2023-06-14

Add a new param to set parquet row group size in 'BaseSQLToGCSOperator' (#31831)

810d46776a

2023-06-11

Implement MetastoreHivePartitionSensor (#31016)

233663046d

2023-06-08

Add 'cacheControl' field to google cloud storage (#31338)

ba3665f76a

2023-06-08

Bigquery: fix links for already existing tables and datasets. (#31589)

fbeb01cb17

2023-06-07

Replace unicodecsv with standard csv library (#31693)

d91861d3bd

2023-06-07

Optimize deferrable mode (#31758)

9e268e13b1

2023-06-07

Replace spelling directive with spelling:word-list (#31752)

36ffbee4aa

2023-06-05

Add D400 pydocstyle check - Google provider only (#31422)

495ae23d45

2023-06-05

Optimize deferrable mode execution for 'DataprocSubmitJobOperator' (#31317)

86b5ba2802

2023-06-04

Remove return statement after yield from triggers class (#31703)

dc5bf3fd02

2023-06-02

Add discoverability for triggers in provider.yaml (#31576)

47c2023df2

2023-05-31

Add 'preserveAsciiControlCharacters' to 'src_fmt_configs' (#31643)

e3ec1ac72e

2023-05-30

Add support for credential configuation file auth to Google Secrets Manager secrets backend (#31597)

9fa75aaf7a

2023-05-29

Remove Python 3.7 support (#30963)

ef40148170

2023-05-26

Add credential configuration file support to Google Cloud Hook (#31548)

22e44ab9f2

2023-05-26

FIPS environments: Mark uses of md5 as "not-used-for-security" (#31171)

5ae9728db7

2023-05-25

Add deferrable mode to 'GCSUploadSessionCompleteSensor' (#31081)

28f2e70916

2023-05-25

Optimize deferrable mode execution for 'BigQueryInsertJobOperator' (#31249)

769e204d53

2023-05-24

Add append_job_name parameter in DataflowStartFlexTemplateOperator (#31511)

10.1.1

Latest change: 2023-05-24

Commit

Committed

Subject

d745cee3db

2023-05-24

Prepare adhoc wave of Providers (#31478)

c082aec089

2023-05-23

Fix accessing a GKE cluster through the private endpoint in 'GKEStartPodOperator' (#31391)

0d6e626b05

2023-05-22

Fix 'BigQueryGetDataOperator''s query job bugs in deferrable mode (#31433)

10.1.0

Latest change: 2023-05-19

Commit

Committed

Subject

45548b9451

2023-05-19

Prepare RC2 docs for May 2023 wave of Providers (#31416)

54f1fb0574

2023-05-19

Docstring improvements (#31375)

cfe759dc59

2023-05-19

Switch default Google ads to v13 (#31382)

abea189022

2023-05-18

Use '__version__' in providers not 'version' (#31393)

db8cbf6ab5

2023-05-18

Add get_namespace to GKEPodHook (#31397)

f5aed58d9f

2023-05-18

Fixing circular import error in providers caused by airflow version check (#31379)

d677a263be

2023-05-18

Switch to google ads v13 (#31369)

28d1bf8dfc

2023-05-18

Update SDKs for google provider package (#30067)

d9ff55cf6d

2023-05-16

Prepare docs for May 2023 wave of Providers (#31252)

cf1e26b046

2023-05-16

Add BigQueryToPostgresOperator (#30658)

d9f70dffd1

2023-05-16

Add CloudBuild build id log (#30516)

caeca2d143

2023-05-15

Add protocol to define methods relied upon by KubernetesPodOperator (#31298)

d3a2dbe028

2023-05-15

GKEPodHook needs to have all methods KPO calls (#31266)

fb6c501124

2023-05-13

Add flag apply_gcs_prefix to S3ToGCSOperator (b/245077385) (#31127)

a66edcbb2c

2023-05-13

'CreateBatchPredictionJobOperator' Add batch_size param for Vertex AI BatchPredictionJob objects (#31118)

d1fe67184d

2023-05-12

Add 'use_legacy_sql' param to 'BigQueryGetDataOperator' (#31190)

b8f73768ec

2023-05-09

Add 'as_dict' param to 'BigQueryGetDataOperator' (#30887)

e68d4a7764

2023-05-08

implement gcs_schema_object for BigQueryCreateExternalTableOperator (#30961)

810b5d4da4

2023-05-08

'DataflowTemplatedJobStartOperator' fix overwriting of location with default value, when a region is provided. (#31082)

ac46902154

2023-05-04

Move TaskInstanceKey to a separate file (#31033)

0a30706aa7

2023-05-03

Use 'AirflowProviderDeprecationWarning' in providers (#30975)

eef5bc7f16

2023-05-03

Add full automation for min Airflow version for providers (#30994)

b0a40bb812

2023-04-30

Optimize deferred execution mode (#30946)

a7eb32a5b2

2023-04-30

Bump minimum Airflow version in providers (#30917)

f89d7b9848

2023-04-28

Poke once before defer for GCSObjectsWithPrefixExistenceSensor (#30939)

a3741e0e02

2023-04-28

Optimize deferrable mode execution (#30920)

0d95acef1d

2023-04-28

Add deferrable mode to DataprocInstantiateInlineWorkflowTemplateOperator (#30878)

3a5b583c91

2023-04-27

Optimize deferrable mode in 'GCSObjectExistenceSensor' (#30901)

eed5d5b7cc

2023-04-27

Add deferrable mode to 'GCSObjectsWithPrefixExistenceSensor' (#30618)

48c9625c70

2023-04-24

Add 'priority' parameter to BigQueryHook (#30655)

9409446097

2023-04-24

Add cli cmd to list the provider trigger info (#30822)

432697d90c

2023-04-23

allow multiple prefixes in gcs delete/list hooks and operators (#30815)

c499b6beb2

2023-04-22

Small refactors in ClusterGenerator of dataproc (#30714)

c585ad51c5

2023-04-22

Upgrade ruff to 0.0.262 (#30809)

676a95b220

2023-04-22

Fix removed delegate_to parameter in deferrable GCS sensor (#30810)

9e49d91a0a

2023-04-22

Add deferrable mode to 'GCSObjectUpdateSensor' (#30579)

10.0.0

Latest change: 2023-04-21

Commit

Committed

Subject

e46ce78b66

2023-04-21

Prepare docs for adhoc release of providers (#30787)

fbc1382514

2023-04-21

remove delegate_to from GCP operators and hooks (#30748)

b48f959ae9

2023-04-21

Update DataprocCreateCluster operator to use 'label' parameter properly (#30741)

da2749cae5

2023-04-15

Update Google Campaign Manager360 operators to use API v4 (#30598)

4eab616e9f

2023-04-15

add missing project_id in BigQueryGetDataOperator (#30651)

57c09e59ee

2023-04-14

Display Video 360 cleanup v1 API usage (#30577)

9.0.0

Latest change: 2023-04-12

Commit

Committed

Subject

0f3b6579cb

2023-04-12

Prepare docs for RC2 of provider wave (#30606)

874ea9588e

2023-04-09

Prepare docs for ad hoc release of Providers (#30545)

71db47a73d

2023-04-09

Update DV360 operators to use API v2 (#30326)

3d2c96e3f5

2023-04-08

Add deferrable mode to GKEStartPodOperator (#29266)

4703f9a0e5

2023-04-08

BigQueryHook list_rows/get_datasets_list can return iterator (#30543)

d9896fd96e

2023-04-08

Fix dynamic imports in google ads vendored in library (#30544)

d23a3bbed8

2023-04-04

Add mechanism to suspend providers (#30422)

2ba1e63c37

2023-04-04

Fix cloud build async credentials (#30441)

cc6fd5c0d9

2023-04-03

Small quotation fix (#30448)

8.12.0

Latest change: 2023-04-02

Commit

Committed

Subject

55dbf1ff1f

2023-04-02

Prepare docs for April 2023 wave of Providers (#30378)

25048fa6b2

2023-04-01

Switch to using vendored-in google ads. (#30410)

2e65c70e99

2023-04-01

Merging of the google ads vendored-in code. (#30399)

540a076801

2023-03-30

merge BigQueryTableExistenceAsyncSensor into BigQueryTableExistenceSensor (#30235)

29eba167ea

2023-03-22

Merge BigQueryTableExistencePartitionAsyncSensor into BigQueryTableExistencePartitionSensor (#30231)

79a2fa7db9

2023-03-21

Merge GCSObjectExistenceAsyncSensor logic to GCSObjectExistenceSensor (#30014)

af4627fec9

2023-03-20

fix setting project_id for gs to bq and bq to gs (#30053)

75fd5e8c54

2023-03-16

Add missing 'poll_interval' in Bigquery operator (#30132)

5a3be7256b

2023-03-15

Handling project location param on async BigQuery dts trigger (#29786)

a6715805c7

2023-03-14

Add poll_interval param in BigQueryInsertJobOperator (#30091)

57fb80cff0

2023-03-14

Support CloudDataTransferServiceJobStatusSensor without specifying a project_id (#30035)

def1f89e70

2023-03-10

Fix location on cloud build operators (#29937)

599c587e26

2023-03-10

Add 'job_id' to 'BigQueryToGCSOperator' templated_fields (#30006)

c3867781e0

2023-03-08

adding trigger info to provider yaml (#29950)

b6392ae5fd

2023-03-07

Support deleting the local log files when using remote logging (#29772)

464ab1b7ca

2023-03-05

Wait insert_job result in normal mode (#29925)

f55b9576b1

2023-03-05

'GoogleDriveHook': Fixing log message + adding more verbose documentation (#29694)

035ad26d79

2023-03-04

Add "BOOLEAN" to type_map of MSSQLToGCSOperator, fix incorrect bit->int type conversion by specifying BIT fields explicitly (#29902)

5a632f78eb

2023-03-04

Google Cloud Providers - Fix _MethodDefault deepcopy failure (#29518)

971039454a

2023-03-04

Align cncf provider file names with AIP-21 (#29905)

864ff2e3ce

2023-03-04

Remove  unnecessary upper constraints from google provider (#29915)

8.11.0

Latest change: 2023-03-03

Commit

Committed

Subject

fcd3c0149f

2023-03-03

Prepare docs for 03/2023 wave of Providers (#29878)

3fc9461654

2023-03-03

Add 'CloudSQLCloneInstanceOperator' (#29726)

47ab0ca629

2023-03-03

Move help message to the google auth code (#29888)

972fca2253

2023-02-28

Fix 'NoneType' object is not subscriptable. (#29820)

ec844eaa0a

2023-02-27

Add deferrable mode to BigQueryTablePartitionExistenceSensor. (#29735)

a5adb87ab4

2023-02-26

Add a new param for BigQuery operators to support additional actions when resource exists (#29394)

1e7c064560

2023-02-25

Google Cloud Providers - Introduce GoogleCloudBaseOperator (#29680)

ad08f66228

2023-02-22

Remove <2.0.0 limit on google-cloud-bigtable (#29644)

dba390e323

2023-02-22

Fix and augment 'check-for-inclusive-language' CI check (#29549)

f51742d20b

2023-02-21

Don't push secret in XCOM in BigQueryCreateDataTransferOperator (#29348)

3dbcf99d20

2023-02-21

Update google cloud dlp package and adjust hook and operators (#29234)

6ef5ba9104

2023-02-20

Refactor Dataproc Trigger (#29364)

7e3a9fc858

2023-02-20

Dataproc batches (#29136)

1677d80e65

2023-02-20

Add deferrable mode to DataprocInstantiateWorkflowTemplateOperator (#28618)

8.10.0

Latest change: 2023-02-18

Commit

Committed

Subject

470fdaea27

2023-02-18

Prepare docs for 02 2023 midmonth wave of Providers (#29589)

f37772adfd

2023-02-18

'GoogleDriveHook': Add folder_id param to upload_file (#29477)

28126c12fb

2023-02-14

Add defer mode to GKECreateClusterOperator and GKEDeleteClusterOperator (#28406)

32c571e592

2023-02-14

Move cloud_sql_binary_path from connection to Hook (#29499)

41fade2d21

2023-02-13

Upgrade Mypy to 1.0 (#29468)

5e6f8eb4d5

2023-02-13

Check that cloud sql provider version is valid (#29497)

f9e9d23457

2023-02-11

Restore trigger logging (#29482)

7ee1a56244

2023-02-11

Add documentation for BigQuery transfer operators (#29466)

60d4bcd1d1

2023-02-10

Revert "Enable individual trigger logging (#27758)" (#29472)

6c1eeb5839

2023-02-11

Revert "Upgrade mypy to 0.991 (#28926)" (#29470)

6ae0a80cba

2023-02-11

Upgrade mypy to 0.991 (#28926)

8.9.0

Latest change: 2023-02-08

Commit

Committed

Subject

ce6ae2457e

2023-02-08

Prepare docs for Feb 2023 wave of Providers (#29379)

1b18a501fe

2023-02-03

Enable individual trigger logging (#27758)

872df121e2

2023-02-03

Add deferrable capability to existing ''DataprocDeleteClusterOperator'' (#29349)

094d6bf01b

2023-01-30

Add deferrable mode to dataflow operators (#27776)

9d9351728c

2023-01-30

Add deferrable mode to DataprocCreateBatchOperator (#28457)

9fd80130e2

2023-01-25

Add deferrable mode to DataprocCreateClusterOperator and DataprocUpdateClusterOperator (#28529)

02bebf897b

2023-01-25

Add deferrable mode to MLEngineStartTrainingJobOperator (#27405)

cf90a1a567

2023-01-25

Keyfile dict can be dict not str (#29135)

b4c50dadd3

2023-01-24

GCSTaskHandler may use remote log conn id (#29117)

b2825e1185

2023-01-24

Fix GoogleDriveHook writing files to trashed folders on upload v2 (#29119)

be0e35321f

2023-01-24

fix Google provider CHANGELOG.rst (#29122)

3374fdfcbd

2023-01-23

Deprecate 'delegate_to' param in GCP operators and update docs (#29088)

7e2493e3c8

2023-01-23

fix Google provider CHANGELOG.rst (#29114)

90e6277da6

2023-01-23

Auto ML assets (#25466)

e926bb9bb0

2023-01-20

Add deferrable mode to DataFusionStartPipelineOperator (#28690)

5fcdd321c5

2023-01-20

Add deferrable mode for Big Query Transfer operator (#27833)

5350be2194

2023-01-19

Add support for write_on_empty in BaseSQLToGCSOperator (#28959)

dc3a3c7c52

2023-01-16

Add DataprocCancelOperationOperator (#28456)

8.8.0

Latest change: 2023-01-14

Commit

Committed

Subject

911b708ffd

2023-01-14

Prepare docs for Jan 2023 mid-month wave of Providers (#28929)

ce858a5d71

2023-01-12

Switch to ruff for faster static checks (#28893)

f1eb2f1af4

2023-01-12

'BigQueryCreateExternalTableOperator' fix field delimiter not working with csv (#28856)

a337e6209a

2023-01-11

Fix using private _get_credentials instead of public get_credentials (#28588)

284cd52989

2023-01-10

Add deferrable ''GCSObjectExistenceSensorAsync'' (#28763)

35a8ffc55a

2023-01-10

Support partition_columns in BaseSQLToGCSOperator (#28677)

c0b2fcff24

2023-01-09

assign "datasetReference" attribute to dataset_reference dict. by default if not already set in create_empty_dataset method of bigquery hook (#28782)

71306b31f1

2023-01-09

Fix'GoogleCampaignManagerReportSensor' with 'QUEUED' status (#28735)

c67f4af667

2023-01-09

Fix BigQueryColumnCheckOperator runtime error (#28796)

8.7.0

Latest change: 2023-01-02

Commit

Committed

Subject

5246c009c5

2023-01-02

Prepare docs for Jan 2023 wave of Providers (#28651)

fec1460eb7

2023-01-01

Push job_id in xcom for dataproc submit job op (#28639)

0fae6a0c9e

2022-12-28

Add table_resource to template fields for BigQueryCreateEmptyTableOperator (#28235)

d7f5f6d737

2022-12-24

GCSToBigQueryOperator allows autodetect None and infers schema (#28564)

034039beb2

2022-12-24

Remove 'pylint' messages control instructions (#28555)

8fb7be2fb5

2022-12-22

Set bigquery ''use_legacy_sql'' param in job config correctly (#28522)

23264fb820

2022-12-21

Fix for issue with reading schema fields for JSON files in GCSToBigQueryOperator (#28284)

7950fb9711

2022-12-21

Remove deprecated AIPlatformConsoleLinkk from google/provider.yaml (#28449)

820f5a9374

2022-12-20

Use object instead of array in config.yml for config template (#28417)

9eacf607be

2022-12-20

Fix GCSToBigQueryOperator not respecting schema_obj (#28444)

bdf3175e96

2022-12-06

Improve memory usage in Dataproc deferrable operators (#28117)

3fef462838

2022-12-06

Fix GCSToGCSOperator copying list of objects without wildcard (#28111)

2d663df055

2022-12-04

Fix: re-enable use of parameters in gcs_to_bq which had been disabled (#27961)

5cdff50557

2022-12-04

Add retry param in GCSObjectExistenceSensor (#27943)

8f98bfeb53

2022-12-03

Add preserveAsciiControlCharacters to src_fmt_configs (#27679)

4a3a429658

2022-12-03

[misc] Get rid of 'pass' statement in conditions (#27775)

6b3bb3c3e9

2022-12-03

Change log level to DEBUG when secret not found for google secret manager (#27856)

527b948856

2022-12-03

[misc] Replace XOR '^' conditions by 'exactly_one' helper in providers (#27858)

c931d88893

2022-12-03

Add deferrable mode to CloudBuildCreateBuildOperator (#27783)

8.6.0

Latest change: 2022-11-26

Commit

Committed

Subject

25bdbc8e67

2022-11-26

Updated docs for RC3 wave of providers (#27937)

f0820e8d9e

2022-11-25

Add Export Format to Template Fields in BigQueryToGCSOperator (#27910)

2e20e9f7eb

2022-11-24

Prepare for follow-up relase for November providers (#27774)

80c327bd3b

2022-11-24

Bump common.sql provider to 1.3.1 (#27888)

bc0063af99

2022-11-16

Fix to read location parameter properly in BigQueryToBigQueryOperator (#27661)

0cb6450d6d

2022-11-16

Persist DataprocLink for workflow operators regardless of job status (#26986)

ddbc758540

2022-11-16

Deferrable mode for BigQueryToGCSOperator (#27683)

8.5.0

Latest change: 2022-11-15

Commit

Committed

Subject

12c3c39d1a

2022-11-15

pRepare docs for November 2022 wave of Providers (#27613)

00af5c007e

2022-11-14

Replace urlparse with urlsplit (#27389)

1059de6294

2022-11-11

Dataform operators, links, update system tests and docs (#27144)

3aed495f50

2022-11-11

Rename  hook bigquery function '_bq_cast' to 'bq_cast' (#27543)

e8ab8ccc0e

2022-11-11

Add backward compatibility with old versions of Apache Beam (#27263)

59e3198f7e

2022-11-10

Change dataprep system tests assets (#26488)

98a9c574e3

2022-11-08

set project_id and location when canceling BigQuery job (#27521)

a691ab56a6

2022-11-08

Add new Compute Engine Operators and fix system tests (#25608)

199359bb38

2022-11-07

Use non-deprecated method for on_kill in BigQueryHook (#27547)

7297892558

2022-11-07

Remove unnecessary newlines around single arg in signature (#27525)

5cd78cf425

2022-11-06

Upgrade dependencies in order to avoid backtracking (#27531)

332c01d6e0

2022-10-31

Allow values in WorkflowsCreateExecutionOperator execution argument to be dicts (#27361)

50d217a129

2022-10-31

DataflowStopJobOperator Operator (#27033)

eb8c0cf0d2

2022-10-31

Migration of System Tests: Cloud Composer (AIP-47)  (#27227)

528ecbbc00

2022-10-31

Rewrite system tests for ML Engine service (#26915)

bcb026bf7c

2022-10-31

use the proper key to retrieve the dataflow job_id (#27336)

42841f70d5

2022-10-31

Migration of System Tests: Cloud BigQuery Data Transfer (AIP-47) (#27312)

1447158e69

2022-10-31

Typecast biquery job response col value (#27236)

95e5675714

2022-10-31

Migration of System Tests: Dataplex (AIP-47) (#26989)

124fb3948d

2022-10-31

Add deferrable mode to GCPToBigQueryOperator + tests (#27052)

7a7c5f8fc4

2022-10-31

Add system tests for Vertex AI operators in new approach (#27053)

4e55d7fa2b

2022-10-31

Migration of System Tests: Cloud Vision Operators (AIP-47) (#26963)

896479d1a0

2022-10-31

Google Drive to local - system tests migrations (AIP-47) (#26798)

3d5f34cb0f

2022-10-28

Allow and prefer non-prefixed extra fields for dataprep hook (#27039)

04f674c13b

2022-10-27

Migrate Bigtable operators system tests according to AIP-47 (#26911)

58d61826a3

2022-10-27

Migrate Dataproc Metastore system tests according to AIP-47 (#26858)

9ab1a6a3e7

2022-10-27

Update old style typing (#26872)

87eb46bbc6

2022-10-26

Common sql bugfixes and improvements (#26761)

7653c61df8

2022-10-26

Make GSheetsHook return an empty list when there are no values (#27261)

78b8ea2f22

2022-10-24

Move min airflow version to 2.3.0 for all providers (#27196)

2a34dc9e84

2022-10-23

Enable string normalization in python formatting - providers (#27205)

58378cfd42

2022-10-23

Cloud ML Engine operators assets (AIP-47) (#26836)

de9633f93a

2022-10-22

Update google hooks to prefer non-prefixed extra fields (#27023)

b54a2de8c7

2022-10-09

Local filesystem to Google Drive Operator - system tests migration (AIP-47) (#26797)

b4cef6da21

2022-10-09

SFTP to Google Cloud Storage Transfer system tests migration (AIP-47) (#26799)

6f0b600293

2022-10-09

Fix delay in Dataproc CreateBatch operator (#26126)

2f326a6c03

2022-10-06

Remove <2 limit on google-cloud-storage (#26922)

a67bcf3eca

2022-10-06

Allow for the overriding of stringify_dict for json/jsonb column data type in Postgres #26875 (#26876)

8.4.0

Latest change: 2022-10-04

Commit

Committed

Subject

403ed7163f

2022-10-04

Add docs for Google/Slack RC providers (#26860)

fa0cb363b8

2022-10-01

Correcting the transfer config name. (#25719)

cee610ae5c

2022-10-01

Fix parsing of optional 'mode' field in BigQuery Result Schema (#26786)

b7203cd36e

2022-10-01

Fix MaxID logic for GCSToBigQueryOperator (#26768)

f8db64c35c

2022-09-28

Update docs for September Provider's release (#26731)

dce27557eb

2022-09-28

Fix GCS sensor system tests failing with DebugExecutor (#26742)

26f94c5370

2022-09-26

Cloud Data Loss Prevention Operators assets (#26618)

01ac40af75

2022-09-22

Update gcs.py (#26570)

e61d823f18

2022-09-21

Cloud Storage Transfer Operators assets & system tests migration (AIP-47) (#26072)

a60e3b9317

2022-09-21

Migrate Data Loss Prevention system tests according to AIP-47 (#26060)

c4256ca1a0

2022-09-21

Add BigQuery Column and Table Check Operators (#26368)

4c33f6bcf5

2022-09-20

Merge deferrable BigQuery operators to exisitng one (#26433)

8e98b1c6df

2022-09-20

Google Drive to Google Cloud Storage Transfer Operator - system tests migration (AIP-47) (#26487)

e315900396

2022-09-20

specifying project id when calling wait_for_operation in delete/create cluster (#26418)

6045f7ad69

2022-09-19

Cloud Functions Operators assets & system tests migration (AIP-47) (#26073)

1f7b296227

2022-09-18

Auto tail file logs in Web UI (#26169)

07fe356de0

2022-09-18

GCSToBigQueryOperator Resolve 'max_id_key' job retrieval and xcom return (#26285)

b4f8a069f0

2022-09-18

Allow for the overriding of 'stringify_dict' for json export format on BaseSQLToGCSOperator (#26277)

706a618014

2022-09-18

Append GoogleLink base in the link class (#26057)

97b144fbed

2022-09-18

Fix JSONDecodeError in Datafusion operators (#26202)

9444d9789b

2022-09-14

Work around pyupgrade edge cases (#26384)

d67ac5932d

2022-09-14

Apply PEP-563 (Postponed Evaluation of Annotations) to core airflow (#26290)

06acf40a43

2022-09-13

Apply PEP-563 (Postponed Evaluation of Annotations) to non-core airflow (#26289)

23ad7e292a

2022-09-10

Cloud Video Intelligence Operators assets & system tests migration (AIP-47) (#26132)

3a539ff663

2022-09-09

Life Science assets & system tests migration (AIP-47) (#25548)

5066844513

2022-09-09

D400 first line should end with period batch02 (#25268)

f938cd4fc8

2022-09-08

Add deferrable big query operators and sensors (#26156)

8cac96918b

2022-09-07

GCSToBigQueryOperator allow for schema_object in alternate GCS Bucket (#26190)

12cbc0f1dd

2022-09-07

Don't throw an exception when a BQ cusor job has no schema (#26096)

8acdc2a834

2022-08-30

Replace SQL with Common SQL in pre commit (#26058)

1d06374194

2022-08-30

Hook into Mypy to get rid of those cast() (#26023)

da8f133053

2022-08-29

Use AsyncClient for Composer Operators in deferrable mode (#25951)

1ed014647e

2022-08-29

Add 'output' property to MappedOperator (#25604)

d4eb60712d

2022-08-27

Use project_id to get authenticated client (#25984)

4c3fb1ff2b

2022-08-27

Google Cloud Tasks Sensor for queue being empty (#25622)

c81178063a

2022-08-27

Cloud Build assets & system tests migration (AIP-47) (#25895)

62a46c1e18

2022-08-27

Added append_job_name parameter to DataflowTemplatedJobStartOperator (#25746)

15b49add28

2022-08-23

Sql to GSC operators update docs for parquet format (#25878)

25a9ae3b2e

2022-08-23

Limit Google Protobuf for compatibility with biggtable client (#25886)

ecf0460b7d

2022-08-22

Dataproc submit job operator async (#25302)

fc6dfa338a

2022-08-20

Support project_id argument in BigQueryGetDataOperator (#25782)

6e66dd7776

2022-08-19

Make GoogleBaseHook credentials functions public (#25785)

6e41c7eb33

2022-08-16

Fixed never ending loop to in CreateWorkflowInvocation (#25737)

6c5b0776c0

2022-08-14

Adding a parameter for exclusion of trashed files in GoogleDriveHook (#25675)

1b412c9cbe

2022-08-10

Consolidate to one 'schedule' param (#25410)

8.3.0

Latest change: 2022-08-10

Commit

Committed

Subject

e5ac6c7cfb

2022-08-10

Prepare docs for new providers release (August 2022) (#25618)

2e2d4bffd5

2022-08-09

Dataform operators (#25587)

c8c4a42723

2022-08-08

Fix GCSListObjectsOperator docstring (#25614)

029e3ae96f

2022-08-05

Remove deprecated modules (#25543)

7d2c2ee879

2022-08-04

add description method in BigQueryCursor class (#25366)

e84d753015

2022-08-04

Fix BigQueryInsertJobOperator cancel_on_kill (#25342)

803c0e252f

2022-08-03

Fix BaseSQLToGCSOperator approx_max_file_size_bytes (#25469)

faf3c4fe47

2022-08-02

Fix PostgresToGCSOperat bool dtype (#25475)

c8cacad4d6

2022-08-02

Migrate Google example trino_to_gcs to new design AIP-47 (#25420)

d2900022a2

2022-08-02

Migrate Google example automl_nl_text_extraction to new design AIP-47 (#25418)

acab8f52dd

2022-07-29

Move all "old" SQL operators to common.sql providers (#25350)

f6b48ac6df

2022-07-28

Memorystore assets & system tests migration (AIP-47) (#25361)

f4b93cc097

2022-07-28

Translate system tests migration (AIP-47) (#25340)

a8e4519815

2022-07-28

Fix Vertex AI Custom Job training issue (#25367)

5d4abbd58c

2022-07-27

Deprecate hql parameters and synchronize DBApiHook method APIs (#25299)

8bc147192c

2022-07-27

Fix Flask Login user setting for Flask 2.2 and Flask-Login 0.6.2 (#25318)

28db8c10b2

2022-07-26

Migrate Google example life_sciences to new design AIP-47 (#25264)

10c9a3697a

2022-07-26

Migrate Google example natural_language to new design AIP-47 (#25262)

b288bf4da4

2022-07-26

Delete redundant system test bigquery_to_bigquery (#25261)

c8af0592c0

2022-07-26

Improve taskflow type hints with ParamSpec (#25173)

df00436569

2022-07-22

Unify DbApiHook.run() method with the methods which override it (#23971)

66b3ca1d28

2022-07-21

Migrate Google example bigquery_to_mssql to new design AIP-47 (#25174)

9644451676

2022-07-19

Migrate Google example compute_igm to new design AIP-47 (#25132)

3a80b36ed9

2022-07-19

Migrate Google example automl_vision to new design AIP-47 (#25152)

c0ce8a8375

2022-07-18

Migrate Google example gcs_to_sftp to new design AIP-47 (#25107)

e32e9c5880

2022-07-18

Bump typing-extensions and mypy for ParamSpec (#25088)

4473b27d08

2022-07-16

Migrate Google campaign manager example to new design AIP-47 (#25069)

9b7e4a7324

2022-07-16

Migrate Google analytics example to new design AIP-47 (#25006)

77626b7fc8

2022-07-13

Add project_id as a templated variable in two BQ operators (#24768)

8.2.0

Latest change: 2022-07-13

Commit

Committed

Subject

d2459a241b

2022-07-13

Add documentation for July 2022 Provider's release (#25030)

93992f2361

2022-07-12

PubSub assets & system tests migration (AIP-47) (#24867)

a13c51e224

2022-07-12

Migrate Google sheets example to new design AIP-47 (#24975)

a038b52b5a

2022-07-12

Migrate Google ads example to new design AIP-47 (#24941)

c618da444e

2022-07-12

Modify BigQueryCreateExternalTableOperator to use updated hook function (#24363)

626d9db290

2022-07-12

Migrate Google example gcs_to_gdrive to new design AIP-47 (#24949)

fb51e04cfd

2022-07-12

Migrate Google firestore example to new design AIP-47 (#24830)

b777514253

2022-07-12

Add handling state of existing Dataproc batch (#24924)

acaa0635c8

2022-07-08

Automatically detect if non-lazy logging interpolation is used (#24910)

fb7162418e

2022-07-07

Add links for Google Kubernetes Engine operators (#24786)

46bbfdade0

2022-07-07

Move all SQL classes to common-sql provider (#24836)

80b6754746

2022-07-06

Migrate Google example sql_to_sheets to new design AIP-47 (#24814)

3b35325840

2022-07-06

Add test_connection method to 'GoogleBaseHook' (#24682)

96b01a8012

2022-07-05

Remove "bad characters" from our codebase (#24841)

9227d56e68

2022-07-04

Datacatalog assets & system tests migration (AIP-47) (#24600)

fe13eae3bf

2022-07-04

perf(BigQuery): pass table_id as str type (#23141)

37ea530cb7

2022-07-04

Migrate Google example DAG mssql_to_gcs to new design AIP-47 (#24541)

46ac083f7e

2022-07-01

Align Black and blacken-docs configs (#24785)

0de31bd73a

2022-06-29

Move provider dependencies to inside provider folders (#24672)

45b11d4ed1

2022-06-29

Use our yaml util in all providers (#24720)

510a6bab45

2022-06-28

Remove 'hook-class-names' from provider.yaml (#24702)

7a7ca50160

2022-06-28

Migrate Google example DAG s3_to_gcs to new design AIP-47 (#24641)

abb304c92f

2022-06-25

Migrate Google example DAG bigquery_transfer to new design AIP-47 (#24543)

ded22eb5b6

2022-06-24

Add gcp_conn_id argument to GoogleDriveToLocalOperator (#24622)

e2f19505bf

2022-06-22

Upgrade FAB to 4.1.1 (#24399)

9c59831ee7

2022-06-21

Update providers to use functools compat for ''cached_property'' (#24582)

88ddf65708

2022-06-20

Migrate Google example DAG oracle_to_gcs to new design AIP-47 (#24542)

32fc4be502

2022-06-20

Migrate Google example DAG mysql_to_gcs to new design AIP-47 (#24540)

a35f342833

2022-06-20

Migrate Google search_ads DAG to new design AIP-47 (#24298)

e7a1c50d62

2022-06-20

GCSDeleteObjectsOperator empty prefix bug fix (#24353)

dd35fdaf35

2022-06-20

Migrate Google gcs_to_sheets DAG to new design AIP-47 (#24501)

0561c1aac4

2022-06-19

Add DeprecationWarning for column_transformations parameter in AutoML (#24467)

8.1.0

Latest change: 2022-06-15

Commit

Committed

Subject

952a5ea8d8

2022-06-15

Update release docs for Google and Oracle providers (#24461)

ce50d3731a

2022-06-15

Use insert_job in the BigQueryToGCPOpertor and adjust links (#24416)

2a084ee8d7

2022-06-14

Update Oracle library to latest version (#24311)

69c46252dd

2022-06-14

fix typo in google provider additional extras (#24431)

08b675cf66

2022-06-13

Fix links to sources for examples (#24386)

94257f48f4

2022-06-13

Expose SQL to GCS Metadata (#24382)

8e0bddaea6

2022-06-12

Deprecate remaining occurrences of 'bigquery_conn_id' in favor of 'gcp_conn_id' (#24376)

6eb60f816c

2022-06-12

Migrate Google calendar example DAG to new design AIP-47 (#24333)

bc3fc8c9fc

2022-06-12

Migrate Google azure_fileshare example DAG to new design AIP-47 (#24349)

6ab02b69a0

2022-06-12

Remove bigquery example already migrated to AIP-47 (#24379)

cb90ca7afb

2022-06-12

Migrate Google sheets example DAG to new design AIP-47 (#24351)

8.0.0

Latest change: 2022-06-09

Commit

Committed

Subject

dcdcf3a2b8

2022-06-09

Update release notes for RC2 release of Providers for May 2022 (#24307)

047a6162b0

2022-06-08

Workaround job race bug on biguery to gcs transfer (#24330)

717a7588bc

2022-06-07

Update package description to remove double min-airflow specification (#24292)

b1ad017cee

2022-06-07

pydocstyle D202 added (#24221)

aeabe994b3

2022-06-07

Prepare docs for May 2022 provider's release (#24231)

c3a9ef1ada

2022-06-07

AIP-47 - Migrate google leveldb DAGs to new design ##22447 (#24233)

c23826915d

2022-06-07

Apply per-run log templates to log handlers (#24153)

80c1ce76e1

2022-06-06

Cloud Storage assets & StorageLink update (#23865)

ec84ffe71c

2022-06-06

Fix GCSToGCSOperator cannot copy a single file/folder without copying other files/folders with that prefix (#24039)

027b707d21

2022-06-05

Add explanatory note for contributors about updating Changelog (#24229)

55fd02a389

2022-06-04

Add key_secret_project_id parameter which specifies a project with KeyFile (#23930)

90233bc7cb

2022-06-04

Added impersonation_chain for DataflowStartFlexTemplateOperator and DataflowStartSqlJobOperator (#24046)

c01a5a50b4

2022-06-04

Fix BigQuery system tests (#24013)

a597a76e8f

2022-06-03

fix BigQueryInsertJobOperator (#24165)

e13b15946e

2022-06-03

Workflows assets & system tests migration (AIP-47) (#24105)

368f292ca1

2022-06-03

Update credentials when using ADC in Compute Engine (#23773)

96e8fb4a07

2022-06-01

Fix the link to google workplace (#24080)

3dd7b1ddba

2022-06-01

set color to operators in cloud_sql.py (#24000)

841ed27101

2022-06-01

Spanner assets & system tests migration (AIP-47) (#23957)

fedab9d64a

2022-06-01

Remove hack from BigQuery DTS hook (#23887)

e58985598f

2022-05-30

Ensure @contextmanager decorates generator func (#23103)

92ddcf4ac6

2022-05-27

Introduce 'flake8-implicit-str-concat' plugin to static checks (#23873)

ec6761a5c0

2022-05-23

Clean up f-strings in logging calls (#23597)

65f3b18fc1

2022-05-22

Sql to gcs with exclude columns (#23695)

a43e98d050

2022-05-22

Fix DataprocJobBaseOperator not being compatible with dotted names (#23439). (#23791)

5bfacf81c6

2022-05-20

[Issue#22846] allow option to encode or not encode UUID when uploading from Cassandra to GCS (#23766)

f60fa98a2e

2022-05-19

Cloud SQL assets & system tests migration (AIP-47) (#23583)

d3b0880286

2022-05-17

Speech To Text assets & system tests migration (AIP-47) (#23643)

3bf9a1df38

2022-05-16

Add fields to CLOUD_SQL_EXPORT_VALIDATION. (#23724)

bc0dcddfb5

2022-05-12

Migrate Dataproc to new system tests design (#22777)

7.0.0

Latest change: 2022-05-12

Commit

Committed

Subject

75c60923e0

2022-05-12

Prepare provider documentation 2022.05.11 (#23631)

cd49a8b9f6

2022-05-11

[FEATURE] google provider - BigQueryInsertJobOperator log query (#23648)

60a1d9d191

2022-05-10

[FEATURE] google provider - split GkeStartPodOperator execute (#23518)

74557e41e3

2022-05-10

Add exportContext.offload flag to CLOUD_SQL_EXPORT_VALIDATION. (#23614)

428a439953

2022-05-09

Clean up in-line f-string concatenation (#23591)

766726f2e3

2022-05-09

Fix 'PostgresToGCSOperator' does not allow nested JSON (#23063)

82c244f9c7

2022-05-08

Fix GCSToGCSOperator ignores replace parameter when there is no wildcard (#23340)

627b5698ec

2022-05-04

Add Stackdriver assets and migrate system tests to AIP-47 (#23320)

3977e1798d

2022-05-04

CloudTasks assets & system tests migration (AIP-47) (#23282)

dfe0f75938

2022-05-04

TextToSpeech assets & system tests migration (AIP-47) (#23247)

2d109401b3

2022-05-04

Bump pre-commit hook versions (#22887)

427e14b763

2022-05-03

Fix code-snippets in google provider (#23438)

fa0cc7cec7

2022-05-02

Cleanup Google provider CHANGELOG.rst (#23390)

3f6d5eef42

2022-05-01

'DataprocHook': Remove deprecated function 'submit' (#23389)

511d0ee256

2022-04-30

Bigquery assets (#23165)

3f9845095e

2022-04-29

Remove redundant docstring in 'BigQueryUpdateTableSchemaOperator' (#23349)

0fcdc5e1fb

2022-04-29

'S3ToGCSOperator': Remove 'dest_gcs_conn_id' (#23348)

05ccfd42f2

2022-04-29

Dataproc: Remove default value of 'region' (#23350)

359dc58207

2022-04-29

Google provider: Remove 'bigquery_conn_id', 'google_cloud_storage_conn_id' (#23326)

c82b3b9466

2022-04-28

'GCSFileTransformOperator': New templated fields 'source_object', 'destination_object' (#23328)

9449a107f0

2022-04-28

'DatastoreHook': Remove 'datastore_conn_id' (#23323)

1f32603549

2022-04-28

update processor to fix broken download URLs (#23299)

8a7b61a8e4

2022-04-28

Migrate gcs to new system tests design (#22778)

72e2ea68a1

2022-04-27

'CloudBuildCreateBuildOperator': Remove deprecated 'body' parameter (#23263)

6cf0176f2a

2022-04-27

Remove deprecated parameters from PubSub operators: (#23261)

4d9c55c9d9

2022-04-27

Remove deprecated parameters from BigQueryHook: (#23269)

915b0c689e

2022-04-27

add missing docstring in 'BigQueryHook.create_empty_table' (#23270)

710eb6f3e6

2022-04-26

* 'CloudDatastoreImportEntitiesOperator' : Remove 'xcom_push'. Please use 'BaseOperator.do_xcom_push' (#23252)

2d569fdaf0

2022-04-26

Create links for Biqtable operators (#23164)

434ab5a03c

2022-04-26

'BigtableCreateInstanceOperator' & 'BigtableHook.create_instance' Remove 'replica_cluster_id', 'replica_cluster_zone'. (#23251)

5ca1f3bf70

2022-04-26

Dataproc : remove 'location' in favor of 'region' (#23250)

1416ac4195

2022-04-26

'PubSubPullSensor': Remove 'project' and 'return_immediately' (#23231)

06dfc2536c

2022-04-26

Remove deprecated 'params' from google operators (#23230)

37a7b27242

2022-04-26

'LookerStartPdtBuildOperator', 'LookerCheckPdtBuildSensor' : fix empty materialization id handling (#23025)

967140e6c3

2022-04-25

Add location support to BigQueryDataTransferServiceTransferRunSensor.

d6094e58ba

2022-04-25

Fix static checks

22ea28f23e

2022-04-25

Remove run_in_gke_cluster flag

c46d04eb2d

2022-04-25

Create system test for K8s and dataproc operators

35cbc89c3a

2022-04-25

Create Dataproc operators for GKE

27ad3b7827

2022-04-25

Remove 'GCSObjectsWtihPrefixExistenceSensor'

544d658921

2022-04-25

Change CloudDatastoreExportEntitiesLink to StorageLink

b3cc2f5d10

2022-04-25

Fix pre-commit check

43ded6c877

2022-04-25

Add links for Cloud Datastore operators

de65a5cc5a

2022-04-25

Support serviceAccount attr for dataflow in the Apache beam

76dc7375b2

2022-04-25

Migrate Datastore system tests to new design (AIP-47)

0373fb0247

2022-04-25

'GoogleDriveToGCSOperator': Remove 'destination_bucket' and 'destination_object'

6b459995b2

2022-04-25

Add the format of Vertex Endpoint ID to the docstrings

27af0b7ebe

2022-04-25

Add the new parameter to the docstring

48abf571be

2022-04-25

Add 'endpoint_id' arg to 'google.cloud.operators.vertex_ai.CreateEndpointOperator'

8b6b0848a3

2022-04-23

Use new Breese for building, pulling and verifying the images. (#23104)

07a13bb708

2022-04-21

Change ComputeSSH to throw provider import error instead paramiko (#23035)

c36bcc4c06

2022-04-15

Upgrade to support Google Ads v10 (#22965)

ea1ae1963e

2022-04-14

Fix cancel_on_kill after execution timeout for DataprocSubmitJobOperator (#22955)

9a623e94cb

2022-04-13

migrate system test gcs_to_bigquery into new design (#22753)

aa317d92ea

2022-04-13

Fix select * query xcom push for BigQueryGetDataOperator (#22936)

27b3e31178

2022-04-11

implements #22859 - Add .sql as templatable extension (#22920)

03e1c9b152

2022-04-11

MSSQLToGCSOperator fails: datetime is not JSON Serializable (#22882)

6933022e94

2022-04-10

Fix new MyPy errors in main (#22884)

6aa65a38e0

2022-04-08

Add example DAG for demonstrating usage of GCS sensors (#22808)

6.8.0

Latest change: 2022-04-07

Commit

Committed

Subject

56ab82ed7a

2022-04-07

Prepare mid-April provider documentation. (#22819)

838cf401b9

2022-04-06

Fail ''LocalFilesystemToGCSOperator'' if src does not exist (#22772)

99b0211d50

2022-04-04

Modify transfer operators to handle more data (#22495)

f9e18472c0

2022-04-04

Add autodetect arg in BQCreateExternalTable Operator (#22710)

327eab3e26

2022-03-31

Add links for BigQuery Data Transfer (#22280)

02976bef88

2022-03-27

Refactor: BigQuery to GCS Operator (#22506)

719135ade0

2022-03-27

Remove references to deprecated operators/params in PubSub operators (#22519)

ca4b8d1744

2022-03-27

Create Endpoint and Model Service, Batch Prediction and Hyperparameter Tuning Jobs operators for Vertex AI service (#22088)

388723950d

2022-03-27

PostgresToGoogleCloudStorageOperator - BigQuery schema type for time zone naive fields (#22536)

c063fc688c

2022-03-25

Update black precommit (#22521)

3c7cd47319

2022-03-25

New design of system tests (#22311)

7ab45d41d6

2022-03-24

Update secrets backends to use get_conn_value instead of get_conn_uri (#22348)

d231e9b448

2022-03-24

Remove coerce_datetime usage from GCSTimeSpanFileTransformOperator (#22501)

82a26c0591

2022-03-24

Fix the docstrings (#22497)

38fde2ea79

2022-03-23

Fix 'download_media' url in 'GoogleDisplayVideo360SDFtoGCSOperator' (#22479)

0f0a1a7d22

2022-03-23

Fix to 'CloudBuildRunBuildTriggerOperator' fails to find build id. (#22419)

6.7.0

Latest change: 2022-03-22

Commit

Committed

Subject

d7dbfb7e26

2022-03-22

Add documentation for bugfix release of Providers (#22383)

7b851edc91

2022-03-21

Add 'LocalFilesystemToGoogleDriveOperator' (#22219)

14e6b657c2

2022-03-21

Add timeout and retry to the BigQueryInsertJobOperator (#22395)

a3ffbee7c9

2022-03-20

Fix skipping non-GCS located jars (#22302)

88402038ca

2022-03-19

Add dataflow_default_options to templated_fields (#22367)

6448b2458c

2022-03-15

[FIX] typo doc of gcs operator (#22290)

6.6.0

Latest change: 2022-03-14

Commit

Committed

Subject

16adc035b1

2022-03-14

Add documentation for Classifier release for March 2022 (#22226)

87c1246b79

2022-03-14

Add Dataplex operators (#20377)

c1ab8e2d7b

2022-03-14

Protect against accidental misuse of XCom.get_value() (#22244)

c108f264ab

2022-03-13

Change the default 'chunk_size' to a clear representation & add documentation (#22222)

45435399fe

2022-03-13

Support Uploading Bigger Files to Google Drive (#22179)

42a891d605

2022-03-13

Update ''GKEDeleteClusterOperator', ''GKECreateClusterOperator'' docstrings (#22212)

d08284ed25

2022-03-11

`` Add map_index to XCom model and interface (#22112)``

828d1cba4d

2022-03-10

Add support for ARM platform (#22127)

4ac771c316

2022-03-09

Fix spelling (#22107)

dd0724fdd2

2022-03-08

Add guide for DataprocInstantiateInlineWorkflowTemplateOperator (#22062)

dfd9805a23

2022-03-08

Use yaml safe load (#22091)

eba9703751

2022-03-08

Revert "Use yaml safe load (#22085)" (#22089)

7f4935bab3

2022-03-08

Use yaml safe load (#22085)

a11d831e3f

2022-03-07

Allow for uploading metadata with GCS Hook Upload (#22058)

6.5.0

Latest change: 2022-03-07

Commit

Committed

Subject

f5b96315fe

2022-03-07

Add documentation for Feb Providers release (#22056)

6db9b0029b

2022-03-07

Add Looker PDT operators (#20882)

9020b3a89d

2022-03-06

Add autodetect arg to external table creation in GCSToBigQueryOperator (#21944)

a0e2ebaa27

2022-03-02

Unpin 'google-cloud-memcache' (#21912)

84ed747db8

2022-03-02

Unpin ''pandas-gbq'' and remove unused code (#21915)

fb6b2d1fee

2022-03-01

Make project_id argument optional in all dataproc operators (#21866)

08575ddd8a

2022-03-01

Change BaseOperatorLink interface to take a ti_key, not a datetime (#21798)

6ca118dff1

2022-03-01

Allow templates in more DataprocUpdateClusterOperator fields (#21865)

0c55ca2cda

2022-02-28

Suppress hook warnings from the Bigquery transfers (#20119)

73eb24f25c

2022-02-24

Fix bigquery_dts parameter docstring typo (#21786)

3b4c26eb3a

2022-02-23

Add Dataproc assets/links (#21756)

6061cc4219

2022-02-20

Add Auto ML operators for Vertex AI service (#21470)

295efd36ea

2022-02-17

Dataflow Assets (#21639)

af2c047320

2022-02-16

Add GoogleCalendarToGCSOperator (#20769)

1b568d73e1

2022-02-15

Extract ClientInfo to module level (#21554)

dc03000de8

2022-02-15

Datafusion assets (#21518)

56365b102c

2022-02-15

Dataproc metastore assets (#21267)

6692e9191d

2022-02-15

Normalize *_conn_id parameters in BigQuery sensors (#21430)

2eb10565b2

2022-02-15

Fixed PostgresToGCSOperator fail on empty resultset for use_server_side_cursor=True (#21307)

da1e6578e0

2022-02-15

Fix multi query scenario in bigquery example DAG (#21575)

6.4.0

Latest change: 2022-02-14

Commit

Committed

Subject

28378d867a

2022-02-14

Add documentation for RC3 release of providers for Jan 2022 (#21553)

6bb0857df9

2022-02-13

(providers_google) add a location check in bigquery (#19571)

6579648af2

2022-02-13

Fix bigquery-hook when no  engine_kwargs are passed

da485da29a

2022-02-13

Add support for BeamGoPipelineOperator (#20386)

05a883b35e

2022-02-11

Google Cloud Composer opearators (#21251)

833087f4f9

2022-02-10

Enable asynchronous job submission in BigQuery hook (#21385)

51aff276ca

2022-02-10

Optionally raise an error if source file does not exist in GCSToGCSOperator (#21391)

07fe9e8c6a

2022-02-09

Never set DagRun.state to State.NONE (#21263)

0a3ff43d41

2022-02-08

Add pre-commit check for docstring param types (#21398)

d94fa37830

2022-02-08

Fixed changelog for January 2022 (delayed) provider's release (#21439)

e973740208

2022-02-08

Create CustomJob and Datasets operators for Vertex AI service (#21253)

34d63fabc0

2022-02-08

Fix BigQueryDataTransferServiceHook.get_transfer_run() request parameter (#21293)

6b88d432d9

2022-02-06

Support to upload file to Google Shared Drive (#21319)

1a77bc6481

2022-02-06

:bug: (BigQueryHook) fix compatibility with sqlalchemy engine (#19508)

6c3a67d4fc

2022-02-05

Add documentation for January 2021 providers release (#21257)

39e395f981

2022-02-04

Add more SQL template fields renderers (#21237)

e840acf8d1

2022-02-04

Fix BigQuery system test (#21320)

ddb5246bd1

2022-02-03

Refactor operator links to not create ad hoc TaskInstances (#21285)

1d4b709e20

2022-01-28

Revert "Create CustomJob and Datasets operators for Vertex AI service (#20077)" (#21203)

48d44b885b

2022-01-28

Cloudsql import links fix. (#21199)

640c0b6763

2022-01-28

Create CustomJob and Datasets operators for Vertex AI service (#20077)

cb73053211

2022-01-27

Add optional features in providers. (#21074)

60aa518ebf

2022-01-26

batch as templated field in DataprocCreateBatchOperator (#20905)

623163f16a

2022-01-25

Extend dataproc example dag (#21091)

86ef016eab

2022-01-23

Make timeout Optional for wait_for_operation (#20981)

506efb6fa3

2022-01-21

Squelch more deprecation warnings (#21003)

372849486c

2022-01-21

Fix last google provider MyPy errors (#21010)

73c0d241d8

2022-01-21

Remove a few stray ':type's in docs (#21014)

602abe8394

2022-01-20

Remove ':type' lines now sphinx-autoapi supports typehints (#20951)

b8526abc2c

2022-01-19

Add encoding parameter to 'GCSToLocalFilesystemOperator' to fix #20901 (#20919)

58452f97db

2022-01-03

Add hook for integrating with Google Calendar (#20542)

6.3.0

Latest change: 2021-12-31

Commit

Committed

Subject

f77417eb0d

2021-12-31

Fix K8S changelog to be PyPI-compatible (#20614)

97496ba2b4

2021-12-31

Update documentation for provider December 2021 release (#20523)

a22d5bd076

2021-12-31

Fix mypy errors in Google Cloud provider (#20611)

4233ebe5ce

2021-12-31

Fix setting of project ID in ''provide_authorized_gcloud'' (#20428)

83f8e178ba

2021-12-31

Even more typing in operators (template_fields/ext) (#20608)

746ee587da

2021-12-31

Delete pods by default in KubernetesPodOperator (#20575)

41dbe2c4fc

2021-12-30

Fix mypy errors in google/cloud/operators/stackdriver (#20601)

dda688776c

2021-12-30

Fix Google mlengine MyPy errors (#20569)

d56e7b56bb

2021-12-30

Fix template_fields type to have MyPy friendly Sequence type (#20571)

bd9e8cef26

2021-12-30

Fix Google Mypy Dataproc errors (#20570)

a6e60ce25d

2021-12-30

Change download_video parameter to resourceName (#20528)

af4a2b0240

2021-12-30

Fix big query to mssql/mysql transfer issues (#20001)

a0821235fb

2021-12-30

Use typed Context EVERYWHERE (#20565)

da88ed1943

2021-12-29

Fix MyPy errors in Google Cloud (again) (#20469)

3a480f5ff4

2021-12-29

Fix passing the gzip compression parameter on sftp_to_gcs. (#20553)

bfd6d45cec

2021-12-29

switch to follow_redirects on httpx.get call in CloudSQL provider (#20239)

7d4d38b546

2021-12-29

avoid deprecation warnings in BigQuery transfer operators (#20502)

b7086f9815

2021-12-28

Use Python3.7+ syntax in pyupgrade (#20501)

a4622e19fa

2021-12-22

Support regional GKE cluster (#18966)

2ffdcf4b41

2021-12-21

Fixes docstring for PubSubCreateSubscriptionOperator (#20237)

d4c4f9e09e

2021-12-21

Fix mypy errors for google.cloud_build (#20234)

c6dbb3f885

2021-12-21

Fix MyPy for Google Bigquery (#20329)

ed604b62f3

2021-12-18

Fix remaining MyPy errors in Google Provider (#20358)

17404f1f10

2021-12-16

Move source_objects datatype check out of GCSToBigQueryOperator.__init__ (#20347)

174681911f

2021-12-16

Fix MyPy Errors for dataproc package (#20327)

2fb5e1d0ec

2021-12-15

Fix cached_property MyPy declaration and related MyPy errors (#20226)

21b8661886

2021-12-15

Fix missing get_backup method for Dataproc Metastore (#20326)

cdaa9a2529

2021-12-15

Fix MyPy errors for google.cloud.tasks (#20233)

43efde6230

2021-12-15

Fix MyPy Errors for Apache Beam (and Dataflow) provider. (#20301)

c4b3694101

2021-12-15

Fix MyPy errors in leveldb (#20222)

1570519a97

2021-12-14

Fix MyPy errors for google.cloud.transfers (#20229)

632bd0133e

2021-12-13

Fix MyPY errors for google.cloud.example_dags (#20232)

644051abcb

2021-12-13

Fix MyPy errors for google/marketing_platform and suite (#20227)

a208463802

2021-12-13

Organize S3 Classes in Amazon Provider (#20167)

98514cc159

2021-12-13

Add optional location to bigquery data transfer service (#15088) (#20221)

1f662571b2

2021-12-12

Fix MyPy errors in google.cloud.sensors (#20228)

22341b90da

2021-12-11

Add Google Cloud Tasks how-to documentation (#20145)

e9262752dc

2021-12-11

Finalised Datastore documentation (#20138)

fa96b09395

2021-12-09

Update Sphinx and Sphinx-AutoAPI (#20079)

ed8b63ba24

2021-12-08

Providers facebook hook multiple account (#19377)

50bf536656

2021-12-08

Remove deprecated method call (blob.download_as_string) (#20091)

564fe635bd

2021-12-06

Added example DAG for MSSQL to Google Cloud Storage (GCS) (#19873)

cb082d361a

2021-12-02

Remove deprecated template_fields from GoogleDriveToGCSOperator (#19991)

6977c47572

2021-12-01

BigQueryHook fix typo in run_load doc string (#19924)

f6dca1fa5e

2021-12-01

Update doc reference links (#19909)

6.2.0

Latest change: 2021-11-30

Commit

Committed

Subject

853576d901

2021-11-30

Update documentation for November 2021 provider's release (#19882)

fb478c00cd

2021-11-28

Move 'bucket_name' validation out of '__init__' in Google Marketing Platform operators (#19383)

e9e530979a

2021-11-28

Update 'default_args' value in example_functions DAG from str to int (#19865)

bf68b9a846

2021-11-26

Create dataproc serverless spark batches operator (#19248)

a192cecf6b

2021-11-26

updates pipeline_timeout CloudDataFusionStartPipelineOperator (#18773)

eb163c81d1

2021-11-25

Fix GCS system tests (#19227)

744d11bdb2

2021-11-25

Clean up ''default_args'' usage in docs (#19803)

0b2e1a8744

2021-11-22

Added wait mechanizm to the DataprocJobSensor to avoid 509 errors when Job is not available (#19740)

3336bb6c3c

2021-11-19

Fix badly merged impersonation in GKEPodOperator (#19696)

952ef908bc

2021-11-19

Support impersonation_chain parameter in the GKEStartPodOperator (#19518)

853c16465a

2021-11-18

Clean-up of google cloud example dags - batch 3 (#19664)

355dec8fea

2021-11-17

Misc. documentation typos and language improvements (#19599)

b9d31cd449

2021-11-17

Cleanup dynamic 'start_date' use for miscellaneous Google example DAGs (#19400)

daf234bd5e

2021-11-16

Remove reference to deprecated operator in example_dataproc (#19619)

48f228cf9e

2021-11-15

#16691 Providing more information in docs for DataprocCreateCluster operator migration (#19446)

6ef44b6a50

2021-11-15

Clean-up of google cloud example dags - batch 2 (#19527)

dc0159e7e4

2021-11-14

Add support in GCP connection for reading key from Secret Manager (#19164)

4212c49324

2021-11-14

Update Azure modules to comply with AIP-21 (#19431)

aa2cb5545f

2021-11-12

Remove remaining 'pylint: disable' comments (#19541)

c8dc0311da

2021-11-08

Fix Cloud SQL system tests (#19014)

26ad55beb0

2021-11-08

Add dataproc metastore operators (#18945)

9efb989d19

2021-11-07

Clean-up of google cloud example dags (#19436)

f421409b4d

2021-11-05

Fix typos in warnings, docstrings, exceptions (#19424)

a3c9956f79

2021-10-30

Add support of 'path' parameter for GCloud Storage Transfer Service operators (#17446)

6.1.0

Latest change: 2021-10-29

Commit

Committed

Subject

d9567eb106

2021-10-29

Prepare documentation for October Provider's release (#19321)

55abc2f620

2021-10-28

Support query timeout as an argument in CassandraToGCSOperator (#18927)

e4aa377da7

2021-10-28

Update BigQueryCreateExternalTableOperator doc and parameters (#18676)

20847fdbf8

2021-10-27

Add value to "namespaceId" of query (#19163)

3c08c025c5

2021-10-27

Move validation of templated input params to run after the context init (#19048)

eba1b68b30

2021-10-27

Update dataflow.py (#19231)

7ecf29f70d

2021-10-26

Fix hard-coded /tmp directory in CloudSQL Hook (#19229)

726a1517ec

2021-10-26

Fix bug in Dataflow hook when no jobs are returned (#18981)

d9192a55ba

2021-10-22

Replacing non-attribute template_fields for BigQueryToMsSqlOperator (#19052)

4fae04a471

2021-10-21

Upgrade the Dataproc package to 3.0.0 and migrate from v1beta2 to v1 api (#18879)

0e95b57772

2021-10-19

Google provider catch invalid secret name (#18790)

86a2a19ad2

2021-10-17

More f-strings (#18855)

a418fd96f7

2021-10-17

Use google cloud credentials when executing beam command in subprocess (#18992)

5c3e453820

2021-10-15

Fix BigQueryToMsSqlOperator documentation (#18995)

406b38b2e3

2021-10-15

Replace default api_version of FacebookAdsReportToGcsOperator (#18996)

1571f80546

2021-10-14

Add pre-commit hook for common misspelling check in files (#18964)

20df60de24

2021-10-07

Dataflow Operators - use project and location from job in on_kill method. (#18699)

86bf2a29ba

2021-10-04

Simplify strings previously split across lines (#18679)

6.0.0

Latest change: 2021-09-30

Commit

Committed

Subject

840ea3efb9

2021-09-30

Update documentation for September providers release (#18613)

9279c44c91

2021-09-29

Fix part of Google system tests (#18494)

2fadf3c3cf

2021-09-27

Fix kubernetes engine system test (#18548)

a458fcc573

2021-09-27

Updating miscellaneous provider DAGs to use TaskFlow API where applicable (#18278)

97d6892318

2021-09-25

Rename AzureDataLakeStorage to ADLS (#18493)

a5439eee72

2021-09-23

Add index to the dataset name to have separate dataset for each example DAG (#18459)

18d7e1e227

2021-09-21

Fix BigQuery system test (#18373)

e25eea052f

2021-09-19

Inclusive Language (#18349)

7458f1e786

2021-09-18

Remove check for at least one schema in GCSToBigquery (#18150)

2474f8922d

2021-09-13

Migrate Google Cloud Build from Discovery API to Python SDK (#18184)

8ae2bb9bfa

2021-09-13

Fix error when create external table using table resource (#17998)

9140ad8d8f

2021-09-11

Use parameters instead of params (#18143)

3d4bfdcbb9

2021-09-10

Add missing __init__.py files for some test packages (#18142)

cfb602a33d

2021-09-10

Fix ''BigQuery'' data extraction in ''BigQueryToMySqlOperator'' (#18073)

2fd3f27ebd

2021-09-10

Make next_dagrun_info take a data interval (#18088)

944dcfbb91

2021-09-07

Change TaskInstance and TaskReschedule PK from execution_date to run_id (#17719)

bfad233b91

2021-09-06

Fix providers tests in main branch with eager upgrades (#18040)

21348c194d

2021-09-03

fix(CloudSqlProxyRunner): don't query connections from Airflow DB (#18006)

9a0c10ba3f

2021-09-01

deduplicate running jobs on BigQueryInsertJobOperator (#17496)

fe34582fc2

2021-09-01

New google operator: SQLToGoogleSheetsOperator (#17887)

500780651c

2021-08-31

Add possibility to run DAGs from system tests and see DAGs logs (#17868)

5.1.0

Latest change: 2021-08-30

Commit

Committed

Subject

0a68588479

2021-08-30

Add August 2021 Provider's documentation (#17890)

b5da846dd1

2021-08-30

Fix missing Data Fusion sensor integration (#17914)

07405e6df4

2021-08-30

[AIRFLOW-9300] Add DatafusionPipelineStateSensor and aync option to the CloudDataFusionStartPipelineOperator (#17787)

42e13e1a5a

2021-08-30

Remove all deprecation warnings in providers (#17900)

aa5952e58c

2021-08-27

Gcp ai hyperparameter tuning (#17790)

87769db98f

2021-08-27

Allow omission of 'initial_node_count' if 'node_pools' is specified (#17820)

be75dcd39c

2021-08-23

Update description about the new ''connection-types'' provider meta-data

d04aa13526

2021-08-20

[Airflow 13779] use provided parameters in the wait_for_pipeline_state hook (#17137)

76ed2a49c6

2021-08-19

Import Hooks lazily individually in providers manager (#17682)

b68d1935f9

2021-08-19

Add error check for config_file parameter in GKEStartPodOperator (#17700)

29aab6434f

2021-08-17

Adds secrets backend/logging/auth information to provider yaml (#17625)

b06d528603

2021-08-11

Don't cache Google Secret Manager client (#17539)

67cbb0f181

2021-08-02

Enable specifying dictionary paths in 'template_fields_renderers' (#17321)

c384f9b0f5

2021-07-29

GCP Secret Manager error handling for missing credentials (#17264)

5.0.0

Latest change: 2021-07-26

Commit

Committed

Subject

87f408b1e7

2021-07-26

Prepares docs for Rc2 release of July providers (#17116)

448e50bd23

2021-07-26

Updating Google Cloud example DAGs to use XComArgs (#16875)

aaf44ccace

2021-07-26

Updating miscellaneous Google example DAGs to use XComArgs (#16876)

d01cc945dd

2021-07-26

Fixes several failing tests after broken main (#17222)

babc4250f3

2021-07-26

Fixes statich check failures (#17218)

5d2224795b

2021-07-25

Google Ads Hook: Support newer versions of the google-ads library (#17160)

966b250199

2021-07-25

Fix GCStoGCS operator with replace diabled and existing destination object (#16991)

763919d415

2021-07-25

Adding custom Salesforce connection type + SalesforceToS3Operator updates (#17162)

81bd40933e

2021-07-23

[CASSANDRA-16814] Fix cassandra to gcs type inconsistency. (#17183)

026ffe65d4

2021-07-19

fix: dataprocpysparkjob project_id as self.project_id (#17075)

d02ded65ea

2021-07-15

Fixed wrongly escaped characters in amazon's changelog (#17020)

b916b75079

2021-07-15

Prepare documentation for July release of providers. (#17015)

a3f5c93806

2021-07-13

Update alias for field_mask in Google Memmcache (#16975)

b0f7f91fe2

2021-07-07

Standardise dataproc location param to region (#16034)

866a601b76

2021-06-28

Removes pylint from our toolchain (#16682)

4.0.0

Latest change: 2021-06-18

Commit

Committed

Subject

bbc627a3da

2021-06-18

Prepares documentation for rc2 release of Providers (#16501)

cbf8001d76

2021-06-16

Synchronizes updated changelog after buggfix release (#16464)

8a9c337838

2021-06-15

Remove class references in changelogs (#16454)

1fba5402bb

2021-06-15

More documentation update for June providers release (#16405)

3c5cc42e13

2021-06-14

Fix deprecation warnings location in google provider (#16403)

b272f9cec9

2021-06-13

fix: ensure datetime-related values fully compatible with MySQL and BigQuery (#15026)

7f8f75eb80

2021-06-12

Add BigQueryToMsSqlOperator (#15422)

0c80a7d411

2021-06-11

Fixes AzureFileShare connection extras (#16388)

9c94b72d44

2021-06-07

Updated documentation for June 2021 provider release (#16294)

1e647029e4

2021-06-01

Rename the main branch of the Airflow repo to be 'main' (#16149)

99d1535287

2021-05-31

Fix: GCS To BigQuery source_object (#16160)

e1137523d4

2021-05-30

Fix: Unnecessary downloads in ''GCSToLocalFilesystemOperator'' (#16171)

904709d34f

2021-05-27

Check synctatic correctness for code-snippets (#16005)

86768859c6

2021-05-26

Fix bigquery type error when export format is parquet (#16027)

6ae9aeec3f

2021-05-26

pass wait_for_done parameter down to _DataflowJobsController (#15541)

476d0f6e3d

2021-05-22

Bump pyupgrade v2.13.0 to v2.18.1 (#15991)

aa4713e43f

2021-05-21

Use api version only in GoogleAdsHook not operators (#15266)

76a80bb17c

2021-05-19

Move plyvel to google provider extra (#15812)

bb115da0b7

2021-05-17

Get rid of requests as core dependency (#15781)

9c8391a13f

2021-05-10

Fix spelling (#15699)

3711a29e5e

2021-05-09

Fix argument ordering and type of bucket and object (#15738)

a01567c471

2021-05-08

Fix sql_to_gcs docstring lint error (#15730)

f3fada9101

2021-05-07

Add short description to BaseSQLToGCSOperator docstring (#15728)

37681bca00

2021-05-07

Auto-apply apply_default decorator (#15667)

b8c0fde38a

2021-05-07

Add extra links for google dataproc (#10343)

3b4fdd0a7a

2021-05-06

add oracle  connection link (#15632)

cf6324e43b

2021-05-04

Implement BigQuery Table Schema Update Operator (#15367)

0f97a3970d

2021-05-04

Rename example bucket names to use INVALID BUCKET NAME by default (#15651)

3.0.0

Latest change: 2021-05-01

Commit

Committed

Subject

807ad32ce5

2021-05-01

Prepares provider release after PIP 21 compatibility (#15576)

814e471d13

2021-04-29

Update pre-commit checks (#15583)

bf2b48174a

2021-04-27

Add Connection Documentation for Providers (#15499)

4b031d39e1

2021-04-27

Make Airflow code Pylint 2.8 compatible (#15534)

e229f3541d

2021-04-27

Use Pip 21.* to install airflow officially (#15513)

71c673e427

2021-04-22

Update Docstrings of Modules with Missing Params (#15391)

3b9a91806e

2021-04-22

Bugfix: Fix rendering of ''object_name'' in ''GCSToLocalFilesystemOperator'' (#15487)

c5e302030d

2021-04-21

Fix typo in DataprocCreateClusterOperator (#15462)

42a1ca8aab

2021-04-20

Fixes wrongly specified path for leveldb hook (#15453)

6da36bad2c

2021-04-18

[Airflow-15245] - passing custom image family name to the DataProcClusterCreateoperator (#15250)

f649905606

2021-04-15

fix docstring typos (#15392)

7bf69edca0

2021-04-08

Fix typo in a docstring (#15276)

2.2.0

Latest change: 2021-04-06

Commit

Committed

Subject

042be2e4e0

2021-04-06

Updated documentation for provider packages before April release (#15236)

eae22cec9c

2021-04-06

Adds 'Trino' provider (with lower memory footprint for tests) (#15187)

e49722859b

2021-04-05

Updates 3.6 limits for latest versions of a few libraries (#15209)

1d641d8f11

2021-04-01

update remaining old import paths of operators (#15127)

099c490cff

2021-03-28

Override project in dataprocSubmitJobOperator (#14981)

5379698892

2021-03-27

Improve docstrings for various modules (#15047)

a7ca1b3b0b

2021-03-26

Fix Sphinx Issues with Docstrings (#14968)

a7e144bec8

2021-03-23

Google Dataflow Hook to handle no Job Type (#14914)

72ea841b4b

2021-03-22

GCS to BigQuery Transfer Operator with Labels and Description parameter (#14881)

e172bd0e16

2021-03-22

Update docstrings to adhere to sphinx standards (#14918)

68e4c4dcb0

2021-03-20

Remove Backport Providers (#14886)

ddc9133d36

2021-03-15

Add GCS timespan transform operator (#13996)

943baff670

2021-03-10

Add job labels to bigquery check operators. (#14685)

6dc24c95e3

2021-03-07

Fix grammar and remove duplicate words (#14647)

e7bb17aeb8

2021-03-06

Use built-in 'cached_property' on Python 3.8 where possible (#14606)

7daebefd15

2021-03-05

Use libyaml C library when available. (#14577)

35c9a90292

2021-03-01

Add Google leveldb hook and operator (#13109) (#14105)

2.1.0

Latest change: 2021-02-27

Commit

Committed

Subject

589d6dec92

2021-02-27

Prepare to release the next wave of providers: (#14487)

50a1504c52

2021-02-27

Fix spellings (#14483)

bfef559cf6

2021-02-27

Corrects order of argument in docstring in GCSHook.download method (#14497)

33214d9326

2021-02-26

Refactor SQL/BigQuery/Qubole/Druid Check operators (#12677)

c281979982

2021-02-23

Documentation and example dag for CloudDLPDeidentifyContentOperator, GCSObjectExistenceSensor, GCSObjectsWithPrefixExistenceSensor (#14033)

ca35bd7f7f

2021-02-21

By default PIP will install all packages in .local folder (#14125)

a7e4266d67

2021-02-21

Refactor GoogleDriveToGCSOperator to use common methods (#14276)

1ab406663e

2021-02-16

Add GoogleDriveToLocalOperator (#14191)

59c94c679e

2021-02-13

Add 'exists_ok' flag to BigQueryCreateEmptyTable(Dataset)Operator (#14026)

e31b27d593

2021-02-13

Add materialized view support for BigQuery (#14201)

e3bcaa3ba3

2021-02-12

Correct typo in GCSObjectsWtihPrefixExistenceSensor  (#14179)

7faa2d978c

2021-02-10

Add BigQueryUpdateTableOperator (#14149)

1da6972165

2021-02-10

Fixes to dataproc operators and hook (#14086)

02288cf2ba

2021-02-10

Add param to CloudDataTransferServiceOperator (#14118)

7d38645472

2021-02-09

#9803 fix bug in copy operation without wildcard  (#13919)

b0c382426c

2021-02-07

Add gdrive_to_gcs operator, drive sensor, additional functionality to drive hook, and supporting tests (#13982)

5d7d46bb33

2021-02-05

Improve GCSToSFTPOperator paths handling (#11284)

10343ec29f

2021-02-05

Corrections in docs and tools after releasing provider RCs (#14082)

2.0.0

Latest change: 2021-02-04

Commit

Committed

Subject

88bdcfa0df

2021-02-04

Prepare to release a new wave of providers. (#14013)

1872d8719d

2021-02-03

Add Apache Beam operators (#12814)

0e8c77b93a

2021-02-03

Support google-cloud-logging' >=2.0.0 (#13801)

833e338323

2021-02-02

Fix four bugs in StackdriverTaskHandler (#13784)

d2efb33239

2021-02-02

Support google-cloud-monitoring>=2.0.0 (#13769)

ac2f72c98d

2021-02-01

Implement provider versioning tools (#13767)

823741cfea

2021-01-28

Improve GCS system test envs (#13946)

6d6588fe2b

2021-01-28

Add Google Cloud Workflows Operators (#13366)

810c15ed85

2021-01-27

Fix and improve GCP BigTable hook and system test (#13896)

6616617331

2021-01-27

Add env variables to PubSub example dag (#13794)

f473ca7130

2021-01-24

Replace 'google_cloud_storage_conn_id' by 'gcp_conn_id' when using 'GCSHook' (#13851)

a9ac2b040b

2021-01-23

Switch to f-strings using flynt. (#13732)

9592be88e5

2021-01-22

Fix Google Spanner example dag (#13842)

af52fdb511

2021-01-22

Improve environment variables in GCP Dataflow system test (#13841)

e7946f1cb7

2021-01-22

Improve environment variables in GCP Datafusion system test (#13837)

61c1d6ec6c

2021-01-22

Improve environment variables in GCP Memorystore system test (#13833)

202f66093a

2021-01-22

Improve environment variables in GCP Lifeciences system test (#13834)

70bf307f38

2021-01-21

Add How To Guide for Dataflow (#13461)

3fd5ef3555

2021-01-21

Add missing logos for integrations (#13717)

309788e5e2

2021-01-18

Refactor DataprocOperators to support google-cloud-dataproc 2.0 (#13256)

7ec858c452

2021-01-17

updated Google DV360 Hook to fix SDF issue (#13703)

ef8617ec9d

2021-01-14

Support google-cloud-tasks>=2.0.0 (#13347)

189af54043

2021-01-13

Add system tests for Stackdriver operators (#13644)

a6f999b62e

2021-01-11

Support google-cloud-automl >=2.1.0 (#13505)

947dbb73bb

2021-01-11

Support google-cloud-datacatalog>=3.0.0 (#13534)

2fb68342b0

2021-01-07

Replace deprecated module and operator in example_tasks.py (#13527)

003584bbf1

2021-01-05

Fix failing backport packages test (#13497)

7d1ea4cb10

2021-01-05

Replace deprecated module and operator in example_tasks.py (#13473)

c7d75ad887

2021-01-05

Revert "Support google-cloud-datacatalog 3.0.0 (#13224)" (#13482)

feb84057d3

2021-01-04

Support google-cloud-datacatalog 3.0.0 (#13224)

3a3e739981

2021-01-04

Fix insert_all method of BigQueryHook to support tables without schema (#13138)

c33d2c06b6

2021-01-02

Fix another pylint c-extension-no-member (#13438)

f6518dd6a1

2021-01-02

Generalize MLEngineStartTrainingJobOperator to custom images (#13318)

9de7127083

2020-12-31

Support google-cloud-bigquery-datatransfer>=3.0.0 (#13337)

406181d64a

2020-12-31

Add Parquet data type to BaseSQLToGCSOperator (#13359)

295d66f914

2020-12-30

Fix Grammar in PIP warning (#13380)

13a9747bf1

2020-12-28

Revert "Support google-cloud-tasks>=2.0.0 (#13334)" (#13341)

04ec45f045

2020-12-28

Add DataprocCreateWorkflowTemplateOperator (#13338)

1f712219fa

2020-12-28

Support google-cloud-tasks>=2.0.0 (#13334)

f4745c8ce1

2020-12-26

Fix typo in example (#13321)

e9d65bd458

2020-12-24

Decode Remote Google Logs (#13115)

e7aeacf335

2020-12-24

Add OracleToGCS Transfer (#13246)

323084e97d

2020-12-24

Add timeout option to gcs hook methods. (#13156)

0b626c8042

2020-12-22

Support google-cloud-redis>=2.0.0 (#13117)

9042a58553

2020-12-22

Add more operators to example DAGs for Cloud Tasks (#13235)

8c00ec89b9

2020-12-22

Support google-cloud-pubsub>=2.0.0 (#13127)

b26b0df5b0

2020-12-22

Update compatibility with google-cloud-kms>=2.0 (#13124)

9a1d3820d6

2020-12-22

Support google-cloud-datacatalog>=1.0.0 (#13097)

f95b1c9c95

2020-12-21

Add regional support to dataproc workflow template operators (#12907)

6cf76d7ac0

2020-12-18

Fix typo in pip upgrade command :( (#13148)

23f27c1b1c

2020-12-18

Add system tests for CloudKMSHook (#13122)

cddbf81b12

2020-12-17

Fix Google BigQueryHook method get_schema() (#13136)

1259c712a4

2020-12-17

Update compatibility with google-cloud-os-login>=2.0.0 (#13126)

bcf77586ef

2020-12-16

Fix Data Catalog operators (#13096)

5090fb0c89

2020-12-15

Add script to generate integrations.json (#13073)

b4b9cf5597

2020-12-14

Check for missing references to operator guides (#13059)

1c1ef7ee69

2020-12-14

Add project_id to client inside BigQuery hook update_table method (#13018)

1.0.0

Latest change: 2020-12-09

Commit

Committed

Subject

32971a1a2d

2020-12-09

Updates providers versions to 1.0.0 (#12955)

b40dffa085

2020-12-08

Rename remaing modules to match AIP-21 (#12917)

9b39f24780

2020-12-08

Add support for dynamic connection form fields per provider (#12558)

1dcd3e13fd

2020-12-05

Add support for extra links coming from the providers (#12472)

2037303eef

2020-11-29

Adds support for Connection/Hook discovery from providers (#12466)

02d94349be

2020-11-29

Don't use time.time() or timezone.utcnow() for duration calculations (#12353)

76bcd08dca

2020-11-28

Added '@apply_defaults' decorator. (#12620)

e1ebfa68b1

2020-11-27

Add DataflowJobMessagesSensor and DataflowAutoscalingEventsSensor (#12249)

3fa51f94d7

2020-11-24

Add check for duplicates in provider.yaml files (#12578)

c34ef853c8

2020-11-20

Separate out documentation building per provider  (#12444)

9e3b2c554d

2020-11-19

GCP Secrets Optional Lookup (#12360)

0080354502

2020-11-18

Update provider READMEs for 1.0.0b2 batch release (#12449)

7ca0b6f121

2020-11-18

Enable Markdownlint rule MD003/heading-style/header-style (#12427) (#12438)

8d09506464

2020-11-18

Fix download method in GCSToBigQueryOperator (#12442)

2c0920fba5

2020-11-17

Adds mechanism for provider package discovery. (#12383)

2cda2f2a0a

2020-11-17

Add missing pre-commit definition - provider-yamls (#12393)

80a957f142

2020-11-17

Add Dataflow sensors - job metrics (#12039)

ae7cb4a1e2

2020-11-17

Update wrong commit hash in backport provider changes (#12390)

917e6c4424

2020-11-16

Add provide_file_and_upload to GCSHook (#12310)

cfa4ecfeb0

2020-11-15

Add DataflowJobStatusSensor and support non-blocking execution of jobs (#11726)

6889a333cf

2020-11-15

Improvements for operators and hooks ref docs (#12366)

7825e8f590

2020-11-13

Docs installation improvements (#12304)

32b59f8350

2020-11-12

Fixes the sending of an empty list to BigQuery 'list_rows' (#12307)

250436d962

2020-11-10

Fix spelling in Python files (#12230)

502ba309ea

2020-11-10

Enable Markdownlint rule - MD022/blanks-around-headings (#12225)

dd2095f4a8

2020-11-10

Simplify string expressions & Use f-string (#12216)

f37c6e6fce

2020-11-10

Add Compute Engine SSH hook (#9879)

85a18e13d9

2020-11-09

Point at pypi project pages for cross-dependency of provider packages (#12212)

59eb5de78c

2020-11-09

Update provider READMEs for up-coming 1.0.0beta1 releases (#12206)

61feb6ec45

2020-11-09

Provider's readmes generated for elasticsearch and google packages (#12194)

b2a28d1590

2020-11-09

Moves provider packages scripts to dev (#12082)

fcb6b00efe

2020-11-08

Add authentication to AWS with Google credentials (#12079)

2ef3b7ef8c

2020-11-08

Fix ERROR - Object of type 'bytes' is not JSON serializable when using store_to_xcom_key parameter (#12172)

0caec9fd32

2020-11-06

Dataflow - add waiting for successful job cancel (#11501)

cf9437d79f

2020-11-06

Simplify string expressions (#12123)

91a64db505

2020-11-04

Format all files (without excepions) by black (#12091)

fd3db778e7

2020-11-04

Add server side cursor support for postgres to GCS operator (#11793)

f1f1940261

2020-11-04

Add DataflowStartSQLQuery operator (#8553)

41bf172c1d

2020-11-04

Simplify string expressions (#12093)

5f5244b74d

2020-11-04

Add template fields renderers to Biguery and Dataproc operators (#12067)

4e8f9cc8d0

2020-11-03

Enable Black - Python Auto Formmatter (#9550)

8c42cf1b00

2020-11-03

Use PyUpgrade to use Python 3.6 features (#11447)

45ae145c25

2020-11-03

Log BigQuery job id in insert method of BigQueryHook (#12056)

e324b37a67

2020-11-03

Add job name and progress logs to Cloud Storage Transfer Hook (#12014)

6071fdd584

2020-11-02

Improve handling server errors in DataprocSubmitJobOperator (#11947)

2f703df12d

2020-10-30

Add SalesforceToGcsOperator (#10760)

e5713e00b3

2020-10-29

Add drain option when canceling Dataflow pipelines (#11374)

37eaac3c5d

2020-10-29

The PRs which are not approved run subset of tests (#11828)

79cb771992

2020-10-28

Fixing re pattern and changing to use a single character class. (#11857)

5a439e84eb

2020-10-26

Prepare providers release 0.0.2a1 (#11855)

240c7d4d72

2020-10-26

Google Memcached hooks - improve protobuf messages handling (#11743)

8afdb6ac6a

2020-10-26

Fix spellings (#11825)

872b1566a1

2020-10-25

Generated backport providers readmes/setup for 2020.10.29 (#11826)

6ce855af11

2020-10-24

Fix spelling (#11821)

4830687453

2020-10-24

Use Python 3 style super classes (#11806)

727c739afb

2020-10-22

Improve Cloud Memorystore for Redis example (#11735)

1da8379c91

2020-10-22

Fix static checks after merging #10121 (#11737)

91503308c7

2020-10-22

Add Google Cloud Memorystore Memcached Operators (#10121)

950c16d0b0

2020-10-21

Retry requests in case of error in Google ML Engine Hook (#11712)

2bfc53b5eb

2020-10-21

Fix doc errors in google provider files. (#11713)

53e6062105

2020-10-21

Enforce strict rules for yamllint (#11709)

349b0811c3

2020-10-20

Add D200 pydocstyle check (#11688)

2d854c3505

2020-10-19

Add service_account to Google ML Engine operator (#11619)

46a121fb7b

2020-10-18

docs: Update Bigquery clustering docstrings (#11232)

49c58147fe

2020-10-18

Strict type checking for provider Google (#11609)

0823d46a7f

2020-10-16

Add type annotations for AWS operators and hooks (#11434)

3c10ca6504

2020-10-16

Add DataflowStartFlexTemplateOperator (#8550)

8865d14df4

2020-10-16

Strict type checking for provider google cloud  (#11548)

16e7129719

2020-10-13

Added support for provider packages for Airflow 2.0 (#11487)

06141d6d01

2020-10-12

Google cloud operator strict type check (#11450)

d305876bee

2020-10-12

Remove redundant None provided as default to dict.get() (#11448)

1845cd11b7

2020-10-11

Strict type check for google ads and cloud hooks (#11390)

bd204bb91b

2020-10-11

Optionally set null marker in csv exports in BaseSQLToGCSOperator (#11409)

75071831ba

2020-10-10

Remove redundant parentheses from Python files (#10967)

8baf657fc2

2020-10-09

Fix regression in DataflowTemplatedJobStartOperator (#11167)

b0fcf67559

2020-10-07

Add AzureFileShareToGCSOperator (#10991)

47b05a87f0

2020-10-07

Improve handling of job_id in BigQuery operators (#11287)

0a0e1af800

2020-10-03

Fix Broken Markdown links in Providers README TOC (#11249)

ca4238eb4d

2020-10-02

Fixed month in backport packages to October (#11242)

5220e4c384

2020-10-02

Prepare Backport release 2020.09.07 (#11238)

cb52fb0ae1

2020-09-27

Add example DAG and system test for MySQLToGCSOperator (#10990)

99accec29d

2020-09-25

Fix incorrect Usage of Optional[str] & Optional[int] (#11141)

e3f96ce7a8

2020-09-24

Fix incorrect Usage of Optional[bool] (#11138)

daf8f31080

2020-09-23

Add template fields renderers for better UI rendering (#11061)

f3e87c5030

2020-09-22

Add D202 pydocstyle check (#11032)

cb979f9f21

2020-09-22

Get Airflow configs with sensitive data from CloudSecretManagerBackend (#11024)

76545bb3d6

2020-09-16

Add example dag and system test for S3ToGCSOperator (#10951)

22c631625f

2020-09-16

Fix more docs spellings (#10965)

12a652f534

2020-09-13

Fix parameter name collision in AutoMLBatchPredictOperator #10723 (#10869)

41a62735ed

2020-09-11

Add on_kill method to BigQueryInsertJobOperator (#10866)

3e91da56e8

2020-09-11

fix typo in firebase/example_filestore DAG (#10875)

68cc7273bf

2020-09-10

Add on_kill method to DataprocSubmitJobOperator (#10847)

f920957214

2020-09-10

Fix and remove some more typos from spelling_wordlist.txt (#10845)

9549274d11

2020-09-09

Upgrade black to 20.8b1 (#10818)

078bfaf60a

2020-09-08

Extract missing gcs_to_local example DAG from gcs example (#10767)

10ce31127f

2020-09-08

Deprecate using global as the default region in Google Dataproc operators and hooks (#10772)

f14f379716

2020-09-07

[AIRFLOW-10672] Refactor BigQueryToGCSOperator to use new method (#10773)

c8ee455685

2020-09-07

Refactor DataprocCreateCluster operator to use simpler interface (#10403)

ece685b5b8

2020-09-05

Asynchronous execution of Dataproc jobs with a Sensor (#10673)

6e3d7b63d3

2020-09-04

Add masterConfig parameter to MLEngineStartTrainingJobOperator (#10578)

804548d58f

2020-09-01

Add Dataprep operators (#10304)

11c00bc820

2020-08-30

Fix typos: duplicated "the" (#10647)

2ca615cffe

2020-08-29

Update Google Cloud branding (#10642)

1b533f617e

2020-08-28

Fix broken master - DLP (#10635)

5ae82a56da

2020-08-28

Fix Google DLP example and improve ops idempotency (#10608)

3867f76625

2020-08-28

Update Google Cloud branding (#10615)

91ff31ad10

2020-08-27

Documentation for Google Cloud Data Loss Prevention (#8201) (#9651)

fdd9b6f65b

2020-08-25

Enable Black on Providers Packages (#10543)

d760265452

2020-08-25

PyDocStyle: No whitespaces allowed surrounding docstring text (#10533)

d1bce91bb2

2020-08-25

PyDocStyle: Enable D403: Capitalized first word of docstring (#10530)

866701c801

2020-08-25

Fix typo in "Cloud" (#10534)

47265e7b58

2020-08-24

Fix typo in PostgresHook (#10529)

3696c34c28

2020-08-24

Fix typo in the word "release" (#10528)

2f2d8dbfaf

2020-08-25

Remove all "noinspection" comments native to IntelliJ (#10525)

3734876d98

2020-08-24

Implement impersonation in google operators (#10052)

b0598b5351

2020-08-24

Add support for creating multiple replicated clusters in Bigtable hook and operator (#10475)

ee7ca128a1

2020-08-22

Fix broken Markdown refernces in Providers README (#10483)

515cc72c99

2020-08-22

Fix typo in timed_out (#10459)

7c206a82a6

2020-08-22

Replace assigment with Augmented assignment (#10468)

88c7d2e526

2020-08-21

Dataflow operators don't not always create a virtualenv (#10373)

083c3c129b

2020-08-18

Simplified GCSTaskHandler configuration (#10365)

1ae5bdf23e

2020-08-17

Add test for GCSTaskHandler (#9600) (#9861)

e195a980bc

2020-08-16

Add type annotations for mlengine_operator_utils (#10297)

382c1011b6

2020-08-16

Add Bigtable Update Instance Hook/Operator (#10340)

bfa5a8d5f1

2020-08-15

CI: Fix failing docs-build (#10342)

be46d20fb4

2020-08-15

Improve idempotency of BigQueryInsertJobOperator (#9590)

47387a69e6

2020-08-14

Catch Permission Denied exception when getting secret from GCP Secret Manager. (#10326)

2f0613b0c2

2020-08-13

Implement Google BigQuery Table Partition Sensor (#10218)

f6734b3b85

2020-08-12

Enable Sphinx spellcheck for doc generation (#10280)

8f8db8959e

2020-08-12

DbApiHook: Support kwargs in get_pandas_df (#9730)

ef088314f8

2020-08-09

Added DataprepGetJobsForJobGroupOperator (#10246)

b43f90abf4

2020-08-09

Fix various typos in the repo (#10263)

c29533888f

2020-08-08

Add labels param to Google MLEngine Operators (#10222)

cdec301254

2020-08-07

Add correct signature to all operators and sensors (#10205)

eff0f03210

2020-08-06

`` Update guide for Google Cloud Secret Manager Backend (#10172)``

24c8e4c2d6

2020-08-06

Changes to all the constructors to remove the args argument (#10163)

010322692e

2020-08-06

Improve handling Dataproc cluster creation with ERROR state (#9593)

1437cb7495

2020-08-04

Add correct signatures for operators in google provider package (#10144)

6efa1b9cb7

2020-08-03

Add additional Cloud Datastore operators (#10032)

27020f8e58

2020-08-03

Add try clause to DataFusionHook.wait_for_pipeline_state (#10031)

4e3799fec4

2020-08-02

[AIRFLOW-4541] Replace os.mkdirs usage with pathlib.Path(path).mkdir (#10117)

85c56b1737

2020-08-02

Add missing params to GCP Pub/Sub creation_subscription (#10106)

b79466c12f

2020-08-02

Fix sensor not providing arguments for GCSHook (#10074)

4ee35d0279

2020-08-02

Fix hook not passing gcp_conn_id to base class (#10075)

aeea71274d

2020-08-02

Remove 'args' parameter from provider operator constructors (#10097)

4c84661adb

2020-07-31

Split Display Video 360 example into smaler DAGs (#10077)

59cbff0874

2020-07-29

Fix docstrings in BigQueryGetDataOperator (#10042)

81b87d48ed

2020-07-27

Add unit tests for GcpBodyFieldSanitizer in Google providers (#9996)

7d24b088cd

2020-07-25

Stop using start_date in default_args in example_dags (2) (#9985)

8b10a4b35e

2020-07-25

Stop using start_date in default_args in example_dags (#9982)

ef98edf4da

2020-07-23

Add more information about using GoogleAdsHook (#9951)

33f0cd2657

2020-07-22

apply_default keeps the function signature for mypy (#9784)

39a0288a47

2020-07-22

Add Google Authentication for experimental API (#9848)

c2db0dfeb1

2020-07-22

More strict rules in mypy (#9705) (#9906)

c4244e18bb

2020-07-22

Fix calling 'get_client' in BigQueryHook.table_exists (#9916)

5eacc16420

2020-07-22

Add support for impersonation in GCP hooks (#9915)

1cfdebf5f8

2020-07-21

Fix insert_job method of BigQueryHook (#9899)

c8c52e69c8

2020-07-21

Remove type hint causing DeprecationWarning in Firestore operators (#9819)

eb6f1d1cf0

2020-07-16

Fix typo in datafusion operator (#9859)

b01d95ec22

2020-07-15

Change DAG.clear to take dag_run_state (#9824)

6d65c15d15

2020-07-15

Add guide for AI Platform (previously Machine Learning Engine) Operators  (#9798)

770de53eb5

2020-07-15

BigQueryTableExistenceSensor needs to specify keyword arguments (#9832)

2d8dbacdf6

2020-07-15

Add CloudVisionDeleteReferenceImageOperator  (#9698)

9f017951b9

2020-07-15

Add Google Deployment Manager Hook (#9159)

ed5004cca7

2020-07-14

Allow 'replace' flag in gcs_to_gcs operator. (#9667)

553bb7af7c

2020-07-13

Keep functions signatures in decorators (#9786)

68925904e4

2020-07-13

Add multiple file upload functionality to GCS hook (#8849)

1de78e8f97

2020-07-12

Add Google Stackdriver link (#9765)

092d33f298

2020-07-11

Fix StackdriverTaskHandler + add system tests (#9761)

b2305660f0

2020-07-09

Update example DAG for AI Platform operators (#9727)

23f80f34ad

2020-07-08

Move gcs & wasb task handlers to their respective provider packages (#9714)

44d4ae809c

2020-07-06

Upgrade to latest pre-commit checks (#9686)

a79e2d4c4a

2020-07-06

Move provider's log task handlers to the provider package (#9604)

cd3d9d9340

2020-07-02

Fix using .json template extension in GMP operators (#9566)

4799af30ee

2020-06-30

Extend BigQuery example with include clause (#9572)

e33f1a12d7

2020-06-30

Add template_ext to BigQueryInsertJobOperator (#9568)

40add26d45

2020-06-29

Remove almost all references to airflow.contrib (#9559)

c420dbd6e1

2020-06-27

Bump Pylint to 2.5.3 (#9294)

0051c89cba

2020-06-26

nitpick fix (#9527)

87fdbd0708

2020-06-25

Use literal syntax instead of function calls to create data structure (#9516)

7256f4caa2

2020-06-22

Pylint fixes and deprecation of rare used methods in Connection (#9419)

e13a14c873

2020-06-21

Enable & Fix Whitespace related PyDocStyle Checks (#9458)

5b680e27e8

2020-06-19

Don't use connection to store task handler credentials (#9381)

d0e7db4024

2020-06-19

Fixed release number for fresh release (#9408)

416334e2ec

2020-06-19

Properly propagated warnings in operators (#9348)

12af6a0800

2020-06-19

Final cleanup for 2020.6.23rc1 release preparation (#9404)

c7e5bce57f

2020-06-19

Prepare backport release candidate for 2020.6.23rc1 (#9370)

4e09c64423

2020-06-18

Adds GCP Secret Manager Hook (#9368)

40bf8f28f9

2020-06-18

Detect automatically the lack of reference to the guide in the operator descriptions (#9290)

f6bd817a3a

2020-06-16

Introduce 'transfers' packages (#9320)

639972d995

2020-06-16

Add support for latest Apache Beam SDK in Dataflow operators (#9323)

1459970b3b

2020-06-15

Rename CloudBuildCreateBuildOperator to CloudBuildCreateOperator (#9314)

431ea3291c

2020-06-15

Resolve upstream tasks when template field is XComArg (#8805)

aee6ab94eb

2020-06-15

Wait for pipeline state in Data Fusion operators (#8954)

fb1c8b83d4

2020-06-10

Add test for BQ operations using location (#9206)

a26afbfa51

2020-06-10

Make generated job_id more informative in BQ insert_job (#9203)

c41192fa1f

2020-06-10

Upgrade pendulum to latest major version ~2.0 (#9184)

b1c8c5ed5b

2020-06-09

Allows using private endpoints in GKEStartPodOperator (#9169)

5918efc86a

2020-06-05

Add 3.8 to the test matrices (#8836)

9bcdadaf7e

2020-06-05

Add 'main' param to template_fields in DataprocSubmitPySparkJobOperator (#9154)

f56811dff3

2020-06-05

[AIRFLOW-6290] Create guide for GKE operators (#8883)

76962867b5

2020-06-04

Fix sql_to_gcs hook gzip of schema_file (#9140)

17adcea835

2020-06-02

Fix handling of subprocess error handling in s3_file_transform and gcs (#9106)

7898525468

2020-06-01

Add BigQueryInsertJobOperator (#8868)

29eb68b90b

2020-05-31

Create guide for Dataproc Operators (#9037)

886afaf622

2020-05-29

Add example dag and system test for LocalFilesystemToGCSOperator (#9043)

a779c4dfc2

2020-05-29

add separate example dags and system tests for GCSToGoogleSheetsOperator (#9066)

ada26be23c

2020-05-29

Add correct description for dst param in LocalFilesystemToGCSOperator (#9055)

81b2761b86

2020-05-29

add example dag and system test for GoogleSheetsToGCSOperator (#9056)

0b0e4f7a4c

2020-05-26

Preparing for RC3 relase of backports (#9026)

00642a46d0

2020-05-26

Fixed name of 20 remaining wrongly named operators. (#8994)

3994030ea6

2020-05-26

Refactor BigQuery operators (#8858)

cdb3f25456

2020-05-26

All classes in backport providers are now importable in Airflow 1.10 (#8991)

1d36b0303b

2020-05-23

Fix references in docs (#8984)

cf5cf45e1c

2020-05-23

Support YAML input for CloudBuildCreateOperator (#8808)

499493c5c5

2020-05-19

[AIRFLOW-6586] Improvements to gcs sensor (#7197)

375d1ca229

2020-05-19

Release candidate 2 for backport packages 2020.05.20 (#8898)

841d816647

2020-05-19

Allow setting the pooling time in DLPHook (#8824)

12c5e5d8ae

2020-05-17

Prepare release candidate for backport packages (#8891)

f3521fb0e3

2020-05-16

Regenerate readme files for backport package release (#8886)

15273f0ea0

2020-05-16

Check for same task instead of Equality to detect Duplicate Tasks (#8828)

92585ca4cb

2020-05-15

Added automated release notes generation for backport operators (#8807)

e1e833bb26

2020-05-13

Update GoogleBaseHook to not follow 308 and use 60s timeout (#8816)

8b54919711

2020-05-12

Refactor BigQuery hook methods to use python library (#8631)

6911dfe837

2020-05-12

Fix template fields in Google operators (#8840)

4b06fde0f1

2020-05-12

Fix Flake8 errors (#8841)

1d12c347cb

2020-05-12

Refactor BigQuery check operators (#8813)

493b685d78

2020-05-10

Add separate example DAGs and system tests for google cloud speech (#8778)

79ef8bed89

2020-05-10

Added Upload Multiple Entity Read Files to specified big query dataset (#8610)

280f1f0c4c

2020-05-10

Correctly restore upstream_task_ids when deserializing Operators (#8775)

58aefb23b1

2020-05-08

Added SDFtoGCSOperator (#8740)

723c52c942

2020-05-07

Add documentation for SpannerDeployInstanceOperator (#8750)

25ee4211b3

2020-05-06

Support all RuntimeEnvironment parameters in DataflowTemplatedJobStartOperator (#8531)

8d6f1aa4b5

2020-05-05

Support num_retries field in env var for GCP connection (#8700)

67caae0f25

2020-05-04

Add system test for gcs_to_bigquery (#8556)

bc45fa6759

2020-05-03

Add system test and docs for Facebook Ads operators (#8503)

a28c66f23d

2020-04-30

[AIRFLOW-4734] Upsert functionality for PostgresHook.insert_rows() (#8625)

992a24ce41

2020-04-28

Split and improve BigQuery example DAG (#8529)

c1fb28230f

2020-04-28

Refactor BigQueryHook dataset operations (#8477)

e8d0f8feab

2020-04-26

Improve idempodency in CloudDataTransferServiceCreateJobOperator (#8430)

37fdfa9775

2020-04-26

[AIRFLOW-6281] Create guide for GCS to GCS transfer operators (#8442)

14b22e6ffe

2020-04-25

Add hook and operator for Google Cloud Life Sciences (#8481)

72ddc94d1e

2020-04-23

Pass location using parmamter in Dataflow integration (#8382)

912aa4b423

2020-04-23

Added GoogleDisplayVideo360DownloadLineItemsOperator (#8174)

57c8c05839

2020-04-22

Use python client in BQ hook create_empty_table/dataset and table_exists (#8377)

5d3a7eef30

2020-04-20

Allow multiple extra_packages in Dataflow (#8394)

79c99b1b6a

2020-04-18

Added location parameter to BigQueryCheckOperator (#8273)

79d3f33c1b

2020-04-17

Clean up temporary files in Dataflow operators (#8313)

efcffa323d

2020-04-16

Add Dataproc SparkR Example (#8240)

b198a1fa94

2020-04-15

Create guide for BigQuery operators (#8276)

2636cc932c

2020-04-14

Raise exception when GCP credential doesn't support account impersonation (#8213)

eee4ebaeeb

2020-04-14

Added Facebook Ads Operator #7887 (#8008)

8cae07ea18

2020-04-14

fixed typo (#8294)

45c8983306

2020-04-13

Less aggressive eager upgrade of requirements (#8267)

1fd9ed3840

2020-04-13

Add mypy plugin for decorators. (#8145)

327b0a9f77

2020-04-13

Added GoogleDisplayVideo360UploadLineItemsOperator (#8216)

bb5e403a32

2020-04-10

Honor schema type for MySQL to GCS data pre-process (#8090)

87969a350d

2020-04-09

[AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170)

3fc89f29f5

2020-04-06

[AIRFLOW-7106] Cloud data fusion integration - Allow to pass args to start pipeline (#7849)

7ef75d2393

2020-04-03

[AIRFLOW-7117] Honor self.schema in sql_to_gcs as schema to upload (#8049)

ed2bc00576

2020-04-02

Add Google Ads list accounts operator (#8007)

3808a6206e

2020-04-01

Unify Google class/package names (#8033)

8a02402576

2020-03-31

Rename CloudBaseHook to GoogleBaseHook and move it to google.common (#8011)

8e89780071

2020-03-31

Add more refactor steps for providers.google (#8010)

aae3b8fb27

2020-03-31

Individual package READMEs (#8012)

779023968f

2020-03-30

[AIRFLOW-7075] Operators for storing information from GCS into GA (#7743)

49abce5217

2020-03-30

Improve system tests for Cloud Build (#8003)

0f19a930d1

2020-03-29

Remove GKEStartPodOperator when backporting (#7908)

0e1c238b2f

2020-03-28

Get Airflow Variables from GCP Secrets Manager (#7946)

eb4af4f944

2020-03-28

Make BaseSecretsBackend.build_path generic (#7948)

01f99426fd

2020-03-28

Add download/upload operators for GCS and Google Sheets (#7866)

892522f8e2

2020-03-26

Change signature of GSheetsHook methods (#7853)

bfd425157a

2020-03-26

Improve idempotency in MLEngineHook.create_model (#7811)

f9c226343d

2020-03-26

Fix CloudSecretsManagerBackend invalid connections_prefix (#7861)

e3920f12f4

2020-03-26

Improve setUp/tearDown in Cloud Firestore system test (#7862)

8ba8a7295a

2020-03-26

Improve example DAGs for Cloud Memorystore (#7855)

f7d1a437c1

2020-03-26

Fix CloudMemorystoreCreateInstanceAndImportOperator operator (#7856)

beef6c230e

2020-03-26

Improve authorization in GCP system tests (#7863)

5f165f3e42

2020-03-26

[AIRFLOW-5801] Get GCP credentials from file instead of JSON blob (#7869)

686d7d50bd

2020-03-25

Standardize SecretBackend class names (#7846)

1982c3fdca

2020-03-24

Run Dataflow for ML Engine summary in venv (#7809)

eef87b9953

2020-03-23

[AIRFLOW-7105] Unify Secrets Backend method interfaces (#7830)

529db07b2e

2020-03-23

Improve Google PubSub hook publish method (#7831)

4bde99f132

2020-03-23

Make airflow/providers pylint compatible (#7802)

a001489b59

2020-03-23

Improve example DAG for ML Engine (#7810)

9e5a8e7f83

2020-03-23

Add call to Super class in 'google' providers (#7823)

b86bf79bff

2020-03-23

Fix typo in GCP credentials_provider's docstring (#7818)

56c013ce92

2020-03-23

Add missing docstring in BigQueryHook.create_empty_table (#7817)

426a79847c

2020-03-23

Imrove support for laatest API in  MLEngineStartTrainingJobOperator (#7812)

cdf1809fce

2020-03-23

[AIRFLOW-7104] Add Secret backend for GCP Secrets Manager (#7795)

27dac00e12

2020-03-22

[AIRFLOW-7099] Improve system test for cloud transfer service (#7794)

0daf5d729a

2020-03-22

Add ability to specify a maximum modified time for objects in GCSToGCSOperator (#7791)

c8088c2bd7

2020-03-20

[AIRFLOW-7100] Add GoogleAnalyticsGetAdsLinkOperator (#7781)

5106a29314

2020-03-20

[AIRFLOW-6752] Add GoogleAnalyticsRetrieveAdsLinksListOperator (#7748)

759ce2a80c

2020-03-20

[AIRFLOW-6978] Add PubSubPullOperator (#7766)

6b9b214e4c

2020-03-20

[AIRFLOW-6732] Add GoogleAdsHook and GoogleAdsToGcsOperator (#7692)

b118916969

2020-03-19

[AIRFLOW-7069] Fix cloudsql system tests (#7770)

ae854cae5a

2020-03-19

[AIRFLOW-7082] Remove catch_http_exception decorator in GCP hooks (#7756)

7e1e954d23

2020-03-19

[AIRFLOW-7085] Cache credentials, project_id in GCP Base Hook (#7759)

6e21c139b3

2020-03-19

[AIRFLOW-XXXX] Fix reference to GCP classes in guides (#7762)

ce022a3f72

2020-03-19

[AIRFLOW-XXXX] Add cross-references for operators guide (#7760)

029c84e552

2020-03-18

[AIRFLOW-5421] Add Presto to GCS transfer operator (#7718)

63a3102ede

2020-03-18

[AIRFLOW-7064] Add CloudFirestoreExportDatabaseOperator (#7725)

73305c7bd5

2020-03-18

[AIRFLOW-7081] Remove env variables from GCP guide (#7755)

60fdbf6d92

2020-03-18

[AIRFLOW-5610] Add ability to specify multiple objects to copy in GCSToGCSOperator (#7728)

de7e934ca3

2020-03-17

[AIRFLOW-7079] Remove redundant code for storing template_fields (#7750)

0de0347b27

2020-03-17

[AIRFLOW-6855]: Escape project_dataset_table in SQL query in gcs to bq (#7475)

91557c6f87

2020-03-17

[AIRFLOW-7073] GKEStartPodOperator always use connection credentials (#7738)

51161dbd9d

2020-03-16

[AIRFLOW-5664] Store timestamps with microseconds precision (#6354)

2bc020c431

2020-03-14

[AIRFLOW-7055] Verbose logging option for google provider (#7711)

c997cab42d

2020-03-13

[AIRFLOW-6724] Add Google Analytics 360 Accounts Retrieve Operator (#7630)

137896f326

2020-03-12

[AIRFLOW-7034] Remove feature: Assigning Dag to task using Bitshift Op (#7685)

1f77f943d5

2020-03-10

[AIRFLOW-6980] Improve system tests and building providers package (#7615)

bf9b6b6d70

2020-03-09

[AIRFLOW-5013] Add GCP Data Catalog Hook and operators (#7664)

e5130dc9fe

2020-03-09

[AIRFLOW-2911] Add job cancellation capability to Dataflow service (#7659)

faf0df4b94

2020-03-09

[AIRFLOW-XXXX] Fix upsert operator in BQ example DAG (#7666)

42eef38217

2020-03-07

[AIRFLOW-6877] Add cross-provider dependencies as extras (#7506)

b5b9795f04

2020-03-07

[AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (fix) (#7624)

6b65038fb4

2020-03-06

[AIRFLOW-6990] Improve system tests for Google Marketing Platform (#7631)

755fe52249

2020-03-05

[AIRFLOW-6915] Add AI Platform Console Link for MLEngineStartTrainingJobOperator (#7535)

cb2f339116

2020-03-04

[AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (#7609)

09fea3ce8e

2020-03-04

[AIRFLOW-6977] Fix BigQuery DTS example DAG (#7612)

8230ccc48b

2020-03-04

[AIRFLOW-6926] Fix Google Tasks operators return types and idempotency (#7547)

0d1e3088aa

2020-03-04

[AIRFLOW-6970] Improve GCP Video Intelligence system tests (#7604)

ab6bb0012c

2020-03-03

[AIRFLOW-6971] Fix return type in CloudSpeechToTextRecognizeSpeechOperator (#7607)

3db4ade3dc

2020-02-29

[AIRFLOW-6924] Fix Google DLP operators return types (#7546)

008b4bab14

2020-02-27

[AIRFLOW-6730] Use total_seconds instead of seconds (#7363)

bb552b2d9f

2020-02-25

[AIRFLOW-6908] Lazy load AirflowException (#7528)

d1a34246ac

2020-02-25

[AIRFLOW-6593] Add GCP Stackdriver Alerting Hooks and Operators (#7322)

3320e432a1

2020-02-24

[AIRFLOW-6817] Lazy-load 'airflow.DAG' to keep user-facing API untouched (#7517)

dcf8743521

2020-02-24

[AIRFLOW-6894] Prevent db query in example_dags (#7516)

4d03e33c11

2020-02-22

[AIRFLOW-6817] remove imports from 'airflow/__init__.py', replaced implicit imports with explicit imports, added entry to 'UPDATING.MD' - squashed/rebased (#7456)

35b9616378

2020-02-21

[AIRFLOW-4973] Add Cloud Data Fusion Pipeline integration (#7486)

aff3a361b4

2020-02-20

[AIRFLOW-6558] Campaign Manager operators for conversions (#7420)

9cbd7de6d1

2020-02-18

[AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412)

5b199cb86b

2020-02-17

[AIRFLOW-XXXX] Typo in example_bigquery DAG (#7429)

2c9345a8e0

2020-02-17

[AIRFLOW-6759] Added MLEngine operator/hook to cancel MLEngine jobs (#7400)

946bdc23c0

2020-02-16

[AIRFLOW-6405] Add GCP BigQuery Table Upsert Operator (#7126)

2381c820c8

2020-02-13

[AIRFLOW-6505] Let emoji encoded properly for json.dumps() (#7399)

04c1fefbf2

2020-02-03

[AIRFLOW-6676] added GCSDeleteBucketOperator (#7307)

a0252748ff

2020-02-03

[AIRFLOW-6717] Remove non-existent field from templated_fields (#7340)

97a429f9d0

2020-02-02

[AIRFLOW-6714] Remove magic comments about UTF-8 (#7338)

9d8d075578

2020-02-03

[AIRFLOW-6715] Fix Google Cloud DLP Example DAG (#7337)

cf141506a2

2020-02-02

[AIRFLOW-6708] Set unique logger names (#7330)

373c6aa4a2

2020-01-30

[AIRFLOW-6682] Move GCP classes to providers package (#7295)

83c037873f

2020-01-30

[AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287)

057f3ae3a4

2020-01-29

[AIRFLOW-6670][depends on AIRFLOW-6669] Move contrib operators to providers package (#7286)

ceea293c16

2020-01-28

[AIRFLOW-6656] Fix AIP-21 moving (#7272)

c42a375e79

2020-01-27

[AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265)

059eda05f8

2020-01-21

[AIRFLOW-6610] Move software classes to providers package (#7231)

f4d3e5e545

2020-01-13

[AIRFLOW-6102] [AIP-21] Rename Dataproc operators (#7151)

e7bf8ecb48

2020-01-13

[AIRFLOW-6119] [AIP-21] Rename GCS operators, hooks and sensors (#7125)

5b6772cb83

2020-01-09

[AIRFLOW-6125] [AIP-21] Rename S3 operator and SFTP operator (#7112)

4f8592ae8f

2020-01-08

[AIRFLOW-6118] [AIP-21] Rename Pubsub operators and hook (#7046)

20299473f1

2020-01-03

[AIRFLOW-6115] [AIP-21] Rename GCP vision operators (#7020)

18e8cea4e7

2020-01-03

[AIRFLOW-6428] Fix import path for airflow.utils.dates.days_ago in Example DAGs (#7007)

95087af140

2019-12-31

[AIRFLOW-6110] [AIP-21] Rename natural_language service (#6968)

69629a5a94

2019-12-09

[AIRFLOW-5807] Move SFTP from contrib to providers. (#6464)

25e9047a4a

2019-12-09

[AIRFLOW-6193] Do not use asserts in Airflow main code (#6749)

ed0a14f321

2019-12-09

[AIRFLOW-6120] Rename GoogleCloudBaseHook (#6734)

2f2f89c148

2019-12-01

[AIRFLOW-6139] Consistent spaces in pylint enable/disable (#6701)

03c870a617

2019-11-26

[AIRFLOW-6010] Remove cyclic imports and pylint hacks (#6601)

5c4cfea8c0

2019-11-15

[AIRFLOW-5718] Add SFTPToGoogleCloudStorageOperator (#6393)

44a8c37a9a

2019-11-13

[AIRFLOW-XXX] Fix the docstring for Dataproc get_job method (#6581)

d633d3ac44

2019-11-13

[AIRFLOW-5691] Rewrite Dataproc operators to use python library (#6371)

d985c02d9f

2019-11-05

[AIRFLOW-XXX] Add How-To-Guide to GCP PubSub (#6497)

a296cdabdb

2019-11-04

[AIRFLOW-5743] Move Google PubSub to providers package (#6476)

470b2a779d

2019-10-30

[AIRFLOW-5741] Move Cloud Natural Language to providers (#6421)

f2caa451fc

2019-10-27

[AIRFLOW-5742] Move Google Cloud Vision to providers package (#6424)

16d7accb22

2019-10-22

[AIRFLOW-4971] Add Google Display & Video 360 integration (#6170)

4e661f535d

2019-10-22

[AIRFLOW-5379] Add Google Search Ads 360 operators (#6228)

19e32b4e2c

2019-10-18

[AIRFLOW-5656] Rename provider to providers module (#6333)

Was this entry helpful?