32971a1a2d |
2020-12-09 |
Updates providers versions to 1.0.0 (#12955)
|
b40dffa085 |
2020-12-08 |
Rename remaing modules to match AIP-21 (#12917)
|
9b39f24780 |
2020-12-08 |
Add support for dynamic connection form fields per provider (#12558)
|
1dcd3e13fd |
2020-12-05 |
Add support for extra links coming from the providers (#12472)
|
2037303eef |
2020-11-29 |
Adds support for Connection/Hook discovery from providers (#12466)
|
02d94349be |
2020-11-29 |
Don't use time.time() or timezone.utcnow() for duration calculations (#12353)
|
76bcd08dca |
2020-11-28 |
Added '@apply_defaults' decorator. (#12620)
|
e1ebfa68b1 |
2020-11-27 |
Add DataflowJobMessagesSensor and DataflowAutoscalingEventsSensor (#12249)
|
3fa51f94d7 |
2020-11-24 |
Add check for duplicates in provider.yaml files (#12578)
|
c34ef853c8 |
2020-11-20 |
Separate out documentation building per provider (#12444)
|
9e3b2c554d |
2020-11-19 |
GCP Secrets Optional Lookup (#12360)
|
0080354502 |
2020-11-18 |
Update provider READMEs for 1.0.0b2 batch release (#12449)
|
7ca0b6f121 |
2020-11-18 |
Enable Markdownlint rule MD003/heading-style/header-style (#12427) (#12438)
|
8d09506464 |
2020-11-18 |
Fix download method in GCSToBigQueryOperator (#12442)
|
2c0920fba5 |
2020-11-17 |
Adds mechanism for provider package discovery. (#12383)
|
2cda2f2a0a |
2020-11-17 |
Add missing pre-commit definition - provider-yamls (#12393)
|
80a957f142 |
2020-11-17 |
Add Dataflow sensors - job metrics (#12039)
|
ae7cb4a1e2 |
2020-11-17 |
Update wrong commit hash in backport provider changes (#12390)
|
917e6c4424 |
2020-11-16 |
Add provide_file_and_upload to GCSHook (#12310)
|
cfa4ecfeb0 |
2020-11-15 |
Add DataflowJobStatusSensor and support non-blocking execution of jobs (#11726)
|
6889a333cf |
2020-11-15 |
Improvements for operators and hooks ref docs (#12366)
|
7825e8f590 |
2020-11-13 |
Docs installation improvements (#12304)
|
32b59f8350 |
2020-11-12 |
Fixes the sending of an empty list to BigQuery 'list_rows' (#12307)
|
250436d962 |
2020-11-10 |
Fix spelling in Python files (#12230)
|
502ba309ea |
2020-11-10 |
Enable Markdownlint rule - MD022/blanks-around-headings (#12225)
|
dd2095f4a8 |
2020-11-10 |
Simplify string expressions & Use f-string (#12216)
|
f37c6e6fce |
2020-11-10 |
Add Compute Engine SSH hook (#9879)
|
85a18e13d9 |
2020-11-09 |
Point at pypi project pages for cross-dependency of provider packages (#12212)
|
59eb5de78c |
2020-11-09 |
Update provider READMEs for up-coming 1.0.0beta1 releases (#12206)
|
61feb6ec45 |
2020-11-09 |
Provider's readmes generated for elasticsearch and google packages (#12194)
|
b2a28d1590 |
2020-11-09 |
Moves provider packages scripts to dev (#12082)
|
fcb6b00efe |
2020-11-08 |
Add authentication to AWS with Google credentials (#12079)
|
2ef3b7ef8c |
2020-11-08 |
Fix ERROR - Object of type 'bytes' is not JSON serializable when using store_to_xcom_key parameter (#12172)
|
0caec9fd32 |
2020-11-06 |
Dataflow - add waiting for successful job cancel (#11501)
|
cf9437d79f |
2020-11-06 |
Simplify string expressions (#12123)
|
91a64db505 |
2020-11-04 |
Format all files (without excepions) by black (#12091)
|
fd3db778e7 |
2020-11-04 |
Add server side cursor support for postgres to GCS operator (#11793)
|
f1f1940261 |
2020-11-04 |
Add DataflowStartSQLQuery operator (#8553)
|
41bf172c1d |
2020-11-04 |
Simplify string expressions (#12093)
|
5f5244b74d |
2020-11-04 |
Add template fields renderers to Biguery and Dataproc operators (#12067)
|
4e8f9cc8d0 |
2020-11-03 |
Enable Black - Python Auto Formmatter (#9550)
|
8c42cf1b00 |
2020-11-03 |
Use PyUpgrade to use Python 3.6 features (#11447)
|
45ae145c25 |
2020-11-03 |
Log BigQuery job id in insert method of BigQueryHook (#12056)
|
e324b37a67 |
2020-11-03 |
Add job name and progress logs to Cloud Storage Transfer Hook (#12014)
|
6071fdd584 |
2020-11-02 |
Improve handling server errors in DataprocSubmitJobOperator (#11947)
|
2f703df12d |
2020-10-30 |
Add SalesforceToGcsOperator (#10760)
|
e5713e00b3 |
2020-10-29 |
Add drain option when canceling Dataflow pipelines (#11374)
|
37eaac3c5d |
2020-10-29 |
The PRs which are not approved run subset of tests (#11828)
|
79cb771992 |
2020-10-28 |
Fixing re pattern and changing to use a single character class. (#11857)
|
5a439e84eb |
2020-10-26 |
Prepare providers release 0.0.2a1 (#11855)
|
240c7d4d72 |
2020-10-26 |
Google Memcached hooks - improve protobuf messages handling (#11743)
|
8afdb6ac6a |
2020-10-26 |
Fix spellings (#11825)
|
872b1566a1 |
2020-10-25 |
Generated backport providers readmes/setup for 2020.10.29 (#11826)
|
6ce855af11 |
2020-10-24 |
Fix spelling (#11821)
|
4830687453 |
2020-10-24 |
Use Python 3 style super classes (#11806)
|
727c739afb |
2020-10-22 |
Improve Cloud Memorystore for Redis example (#11735)
|
1da8379c91 |
2020-10-22 |
Fix static checks after merging #10121 (#11737)
|
91503308c7 |
2020-10-22 |
Add Google Cloud Memorystore Memcached Operators (#10121)
|
950c16d0b0 |
2020-10-21 |
Retry requests in case of error in Google ML Engine Hook (#11712)
|
2bfc53b5eb |
2020-10-21 |
Fix doc errors in google provider files. (#11713)
|
53e6062105 |
2020-10-21 |
Enforce strict rules for yamllint (#11709)
|
349b0811c3 |
2020-10-20 |
Add D200 pydocstyle check (#11688)
|
2d854c3505 |
2020-10-19 |
Add service_account to Google ML Engine operator (#11619)
|
46a121fb7b |
2020-10-18 |
docs: Update Bigquery clustering docstrings (#11232)
|
49c58147fe |
2020-10-18 |
Strict type checking for provider Google (#11609)
|
0823d46a7f |
2020-10-16 |
Add type annotations for AWS operators and hooks (#11434)
|
3c10ca6504 |
2020-10-16 |
Add DataflowStartFlexTemplateOperator (#8550)
|
8865d14df4 |
2020-10-16 |
Strict type checking for provider google cloud (#11548)
|
16e7129719 |
2020-10-13 |
Added support for provider packages for Airflow 2.0 (#11487)
|
06141d6d01 |
2020-10-12 |
Google cloud operator strict type check (#11450)
|
d305876bee |
2020-10-12 |
Remove redundant None provided as default to dict.get() (#11448)
|
1845cd11b7 |
2020-10-11 |
Strict type check for google ads and cloud hooks (#11390)
|
bd204bb91b |
2020-10-11 |
Optionally set null marker in csv exports in BaseSQLToGCSOperator (#11409)
|
75071831ba |
2020-10-10 |
Remove redundant parentheses from Python files (#10967)
|
8baf657fc2 |
2020-10-09 |
Fix regression in DataflowTemplatedJobStartOperator (#11167)
|
b0fcf67559 |
2020-10-07 |
Add AzureFileShareToGCSOperator (#10991)
|
47b05a87f0 |
2020-10-07 |
Improve handling of job_id in BigQuery operators (#11287)
|
0a0e1af800 |
2020-10-03 |
Fix Broken Markdown links in Providers README TOC (#11249)
|
ca4238eb4d |
2020-10-02 |
Fixed month in backport packages to October (#11242)
|
5220e4c384 |
2020-10-02 |
Prepare Backport release 2020.09.07 (#11238)
|
cb52fb0ae1 |
2020-09-27 |
Add example DAG and system test for MySQLToGCSOperator (#10990)
|
99accec29d |
2020-09-25 |
Fix incorrect Usage of Optional[str] & Optional[int] (#11141)
|
e3f96ce7a8 |
2020-09-24 |
Fix incorrect Usage of Optional[bool] (#11138)
|
daf8f31080 |
2020-09-23 |
Add template fields renderers for better UI rendering (#11061)
|
f3e87c5030 |
2020-09-22 |
Add D202 pydocstyle check (#11032)
|
cb979f9f21 |
2020-09-22 |
Get Airflow configs with sensitive data from CloudSecretManagerBackend (#11024)
|
76545bb3d6 |
2020-09-16 |
Add example dag and system test for S3ToGCSOperator (#10951)
|
22c631625f |
2020-09-16 |
Fix more docs spellings (#10965)
|
12a652f534 |
2020-09-13 |
Fix parameter name collision in AutoMLBatchPredictOperator #10723 (#10869)
|
41a62735ed |
2020-09-11 |
Add on_kill method to BigQueryInsertJobOperator (#10866)
|
3e91da56e8 |
2020-09-11 |
fix typo in firebase/example_filestore DAG (#10875)
|
68cc7273bf |
2020-09-10 |
Add on_kill method to DataprocSubmitJobOperator (#10847)
|
f920957214 |
2020-09-10 |
Fix and remove some more typos from spelling_wordlist.txt (#10845)
|
9549274d11 |
2020-09-09 |
Upgrade black to 20.8b1 (#10818)
|
078bfaf60a |
2020-09-08 |
Extract missing gcs_to_local example DAG from gcs example (#10767)
|
10ce31127f |
2020-09-08 |
Deprecate using global as the default region in Google Dataproc operators and hooks (#10772)
|
f14f379716 |
2020-09-07 |
[AIRFLOW-10672] Refactor BigQueryToGCSOperator to use new method (#10773)
|
c8ee455685 |
2020-09-07 |
Refactor DataprocCreateCluster operator to use simpler interface (#10403)
|
ece685b5b8 |
2020-09-05 |
Asynchronous execution of Dataproc jobs with a Sensor (#10673)
|
6e3d7b63d3 |
2020-09-04 |
Add masterConfig parameter to MLEngineStartTrainingJobOperator (#10578)
|
804548d58f |
2020-09-01 |
Add Dataprep operators (#10304)
|
11c00bc820 |
2020-08-30 |
Fix typos: duplicated "the" (#10647)
|
2ca615cffe |
2020-08-29 |
Update Google Cloud branding (#10642)
|
1b533f617e |
2020-08-28 |
Fix broken master - DLP (#10635)
|
5ae82a56da |
2020-08-28 |
Fix Google DLP example and improve ops idempotency (#10608)
|
3867f76625 |
2020-08-28 |
Update Google Cloud branding (#10615)
|
91ff31ad10 |
2020-08-27 |
Documentation for Google Cloud Data Loss Prevention (#8201) (#9651)
|
fdd9b6f65b |
2020-08-25 |
Enable Black on Providers Packages (#10543)
|
d760265452 |
2020-08-25 |
PyDocStyle: No whitespaces allowed surrounding docstring text (#10533)
|
d1bce91bb2 |
2020-08-25 |
PyDocStyle: Enable D403: Capitalized first word of docstring (#10530)
|
866701c801 |
2020-08-25 |
Fix typo in "Cloud" (#10534)
|
47265e7b58 |
2020-08-24 |
Fix typo in PostgresHook (#10529)
|
3696c34c28 |
2020-08-24 |
Fix typo in the word "release" (#10528)
|
2f2d8dbfaf |
2020-08-25 |
Remove all "noinspection" comments native to IntelliJ (#10525)
|
3734876d98 |
2020-08-24 |
Implement impersonation in google operators (#10052)
|
b0598b5351 |
2020-08-24 |
Add support for creating multiple replicated clusters in Bigtable hook and operator (#10475)
|
ee7ca128a1 |
2020-08-22 |
Fix broken Markdown refernces in Providers README (#10483)
|
515cc72c99 |
2020-08-22 |
Fix typo in timed_out (#10459)
|
7c206a82a6 |
2020-08-22 |
Replace assigment with Augmented assignment (#10468)
|
88c7d2e526 |
2020-08-21 |
Dataflow operators don't not always create a virtualenv (#10373)
|
083c3c129b |
2020-08-18 |
Simplified GCSTaskHandler configuration (#10365)
|
1ae5bdf23e |
2020-08-17 |
Add test for GCSTaskHandler (#9600) (#9861)
|
e195a980bc |
2020-08-16 |
Add type annotations for mlengine_operator_utils (#10297)
|
382c1011b6 |
2020-08-16 |
Add Bigtable Update Instance Hook/Operator (#10340)
|
bfa5a8d5f1 |
2020-08-15 |
CI: Fix failing docs-build (#10342)
|
be46d20fb4 |
2020-08-15 |
Improve idempotency of BigQueryInsertJobOperator (#9590)
|
47387a69e6 |
2020-08-14 |
Catch Permission Denied exception when getting secret from GCP Secret Manager. (#10326)
|
2f0613b0c2 |
2020-08-13 |
Implement Google BigQuery Table Partition Sensor (#10218)
|
f6734b3b85 |
2020-08-12 |
Enable Sphinx spellcheck for doc generation (#10280)
|
8f8db8959e |
2020-08-12 |
DbApiHook: Support kwargs in get_pandas_df (#9730)
|
ef088314f8 |
2020-08-09 |
Added DataprepGetJobsForJobGroupOperator (#10246)
|
b43f90abf4 |
2020-08-09 |
Fix various typos in the repo (#10263)
|
c29533888f |
2020-08-08 |
Add labels param to Google MLEngine Operators (#10222)
|
cdec301254 |
2020-08-07 |
Add correct signature to all operators and sensors (#10205)
|
eff0f03210 |
2020-08-06 |
`` Update guide for Google Cloud Secret Manager Backend (#10172)`` |
24c8e4c2d6 |
2020-08-06 |
Changes to all the constructors to remove the args argument (#10163)
|
010322692e |
2020-08-06 |
Improve handling Dataproc cluster creation with ERROR state (#9593)
|
1437cb7495 |
2020-08-04 |
Add correct signatures for operators in google provider package (#10144)
|
6efa1b9cb7 |
2020-08-03 |
Add additional Cloud Datastore operators (#10032)
|
27020f8e58 |
2020-08-03 |
Add try clause to DataFusionHook.wait_for_pipeline_state (#10031)
|
4e3799fec4 |
2020-08-02 |
[AIRFLOW-4541] Replace os.mkdirs usage with pathlib.Path(path).mkdir (#10117)
|
85c56b1737 |
2020-08-02 |
Add missing params to GCP Pub/Sub creation_subscription (#10106)
|
b79466c12f |
2020-08-02 |
Fix sensor not providing arguments for GCSHook (#10074)
|
4ee35d0279 |
2020-08-02 |
Fix hook not passing gcp_conn_id to base class (#10075)
|
aeea71274d |
2020-08-02 |
Remove 'args' parameter from provider operator constructors (#10097)
|
4c84661adb |
2020-07-31 |
Split Display Video 360 example into smaler DAGs (#10077)
|
59cbff0874 |
2020-07-29 |
Fix docstrings in BigQueryGetDataOperator (#10042)
|
81b87d48ed |
2020-07-27 |
Add unit tests for GcpBodyFieldSanitizer in Google providers (#9996)
|
7d24b088cd |
2020-07-25 |
Stop using start_date in default_args in example_dags (2) (#9985)
|
8b10a4b35e |
2020-07-25 |
Stop using start_date in default_args in example_dags (#9982)
|
ef98edf4da |
2020-07-23 |
Add more information about using GoogleAdsHook (#9951)
|
33f0cd2657 |
2020-07-22 |
apply_default keeps the function signature for mypy (#9784)
|
39a0288a47 |
2020-07-22 |
Add Google Authentication for experimental API (#9848)
|
c2db0dfeb1 |
2020-07-22 |
More strict rules in mypy (#9705) (#9906)
|
c4244e18bb |
2020-07-22 |
Fix calling 'get_client' in BigQueryHook.table_exists (#9916)
|
5eacc16420 |
2020-07-22 |
Add support for impersonation in GCP hooks (#9915)
|
1cfdebf5f8 |
2020-07-21 |
Fix insert_job method of BigQueryHook (#9899)
|
c8c52e69c8 |
2020-07-21 |
Remove type hint causing DeprecationWarning in Firestore operators (#9819)
|
eb6f1d1cf0 |
2020-07-16 |
Fix typo in datafusion operator (#9859)
|
b01d95ec22 |
2020-07-15 |
Change DAG.clear to take dag_run_state (#9824)
|
6d65c15d15 |
2020-07-15 |
Add guide for AI Platform (previously Machine Learning Engine) Operators (#9798)
|
770de53eb5 |
2020-07-15 |
BigQueryTableExistenceSensor needs to specify keyword arguments (#9832)
|
2d8dbacdf6 |
2020-07-15 |
Add CloudVisionDeleteReferenceImageOperator (#9698)
|
9f017951b9 |
2020-07-15 |
Add Google Deployment Manager Hook (#9159)
|
ed5004cca7 |
2020-07-14 |
Allow 'replace' flag in gcs_to_gcs operator. (#9667)
|
553bb7af7c |
2020-07-13 |
Keep functions signatures in decorators (#9786)
|
68925904e4 |
2020-07-13 |
Add multiple file upload functionality to GCS hook (#8849)
|
1de78e8f97 |
2020-07-12 |
Add Google Stackdriver link (#9765)
|
092d33f298 |
2020-07-11 |
Fix StackdriverTaskHandler + add system tests (#9761)
|
b2305660f0 |
2020-07-09 |
Update example DAG for AI Platform operators (#9727)
|
23f80f34ad |
2020-07-08 |
Move gcs & wasb task handlers to their respective provider packages (#9714)
|
44d4ae809c |
2020-07-06 |
Upgrade to latest pre-commit checks (#9686)
|
a79e2d4c4a |
2020-07-06 |
Move provider's log task handlers to the provider package (#9604)
|
cd3d9d9340 |
2020-07-02 |
Fix using .json template extension in GMP operators (#9566)
|
4799af30ee |
2020-06-30 |
Extend BigQuery example with include clause (#9572)
|
e33f1a12d7 |
2020-06-30 |
Add template_ext to BigQueryInsertJobOperator (#9568)
|
40add26d45 |
2020-06-29 |
Remove almost all references to airflow.contrib (#9559)
|
c420dbd6e1 |
2020-06-27 |
Bump Pylint to 2.5.3 (#9294)
|
0051c89cba |
2020-06-26 |
nitpick fix (#9527)
|
87fdbd0708 |
2020-06-25 |
Use literal syntax instead of function calls to create data structure (#9516)
|
7256f4caa2 |
2020-06-22 |
Pylint fixes and deprecation of rare used methods in Connection (#9419)
|
e13a14c873 |
2020-06-21 |
Enable & Fix Whitespace related PyDocStyle Checks (#9458)
|
5b680e27e8 |
2020-06-19 |
Don't use connection to store task handler credentials (#9381)
|
d0e7db4024 |
2020-06-19 |
Fixed release number for fresh release (#9408)
|
416334e2ec |
2020-06-19 |
Properly propagated warnings in operators (#9348)
|
12af6a0800 |
2020-06-19 |
Final cleanup for 2020.6.23rc1 release preparation (#9404)
|
c7e5bce57f |
2020-06-19 |
Prepare backport release candidate for 2020.6.23rc1 (#9370)
|
4e09c64423 |
2020-06-18 |
Adds GCP Secret Manager Hook (#9368)
|
40bf8f28f9 |
2020-06-18 |
Detect automatically the lack of reference to the guide in the operator descriptions (#9290)
|
f6bd817a3a |
2020-06-16 |
Introduce 'transfers' packages (#9320)
|
639972d995 |
2020-06-16 |
Add support for latest Apache Beam SDK in Dataflow operators (#9323)
|
1459970b3b |
2020-06-15 |
Rename CloudBuildCreateBuildOperator to CloudBuildCreateOperator (#9314)
|
431ea3291c |
2020-06-15 |
Resolve upstream tasks when template field is XComArg (#8805)
|
aee6ab94eb |
2020-06-15 |
Wait for pipeline state in Data Fusion operators (#8954)
|
fb1c8b83d4 |
2020-06-10 |
Add test for BQ operations using location (#9206)
|
a26afbfa51 |
2020-06-10 |
Make generated job_id more informative in BQ insert_job (#9203)
|
c41192fa1f |
2020-06-10 |
Upgrade pendulum to latest major version ~2.0 (#9184)
|
b1c8c5ed5b |
2020-06-09 |
Allows using private endpoints in GKEStartPodOperator (#9169)
|
5918efc86a |
2020-06-05 |
Add 3.8 to the test matrices (#8836)
|
9bcdadaf7e |
2020-06-05 |
Add 'main' param to template_fields in DataprocSubmitPySparkJobOperator (#9154)
|
f56811dff3 |
2020-06-05 |
[AIRFLOW-6290] Create guide for GKE operators (#8883)
|
76962867b5 |
2020-06-04 |
Fix sql_to_gcs hook gzip of schema_file (#9140)
|
17adcea835 |
2020-06-02 |
Fix handling of subprocess error handling in s3_file_transform and gcs (#9106)
|
7898525468 |
2020-06-01 |
Add BigQueryInsertJobOperator (#8868)
|
29eb68b90b |
2020-05-31 |
Create guide for Dataproc Operators (#9037)
|
886afaf622 |
2020-05-29 |
Add example dag and system test for LocalFilesystemToGCSOperator (#9043)
|
a779c4dfc2 |
2020-05-29 |
add separate example dags and system tests for GCSToGoogleSheetsOperator (#9066)
|
ada26be23c |
2020-05-29 |
Add correct description for dst param in LocalFilesystemToGCSOperator (#9055)
|
81b2761b86 |
2020-05-29 |
add example dag and system test for GoogleSheetsToGCSOperator (#9056)
|
0b0e4f7a4c |
2020-05-26 |
Preparing for RC3 relase of backports (#9026)
|
00642a46d0 |
2020-05-26 |
Fixed name of 20 remaining wrongly named operators. (#8994)
|
3994030ea6 |
2020-05-26 |
Refactor BigQuery operators (#8858)
|
cdb3f25456 |
2020-05-26 |
All classes in backport providers are now importable in Airflow 1.10 (#8991)
|
1d36b0303b |
2020-05-23 |
Fix references in docs (#8984)
|
cf5cf45e1c |
2020-05-23 |
Support YAML input for CloudBuildCreateOperator (#8808)
|
499493c5c5 |
2020-05-19 |
[AIRFLOW-6586] Improvements to gcs sensor (#7197)
|
375d1ca229 |
2020-05-19 |
Release candidate 2 for backport packages 2020.05.20 (#8898)
|
841d816647 |
2020-05-19 |
Allow setting the pooling time in DLPHook (#8824)
|
12c5e5d8ae |
2020-05-17 |
Prepare release candidate for backport packages (#8891)
|
f3521fb0e3 |
2020-05-16 |
Regenerate readme files for backport package release (#8886)
|
15273f0ea0 |
2020-05-16 |
Check for same task instead of Equality to detect Duplicate Tasks (#8828)
|
92585ca4cb |
2020-05-15 |
Added automated release notes generation for backport operators (#8807)
|
e1e833bb26 |
2020-05-13 |
Update GoogleBaseHook to not follow 308 and use 60s timeout (#8816)
|
8b54919711 |
2020-05-12 |
Refactor BigQuery hook methods to use python library (#8631)
|
6911dfe837 |
2020-05-12 |
Fix template fields in Google operators (#8840)
|
4b06fde0f1 |
2020-05-12 |
Fix Flake8 errors (#8841)
|
1d12c347cb |
2020-05-12 |
Refactor BigQuery check operators (#8813)
|
493b685d78 |
2020-05-10 |
Add separate example DAGs and system tests for google cloud speech (#8778)
|
79ef8bed89 |
2020-05-10 |
Added Upload Multiple Entity Read Files to specified big query dataset (#8610)
|
280f1f0c4c |
2020-05-10 |
Correctly restore upstream_task_ids when deserializing Operators (#8775)
|
58aefb23b1 |
2020-05-08 |
Added SDFtoGCSOperator (#8740)
|
723c52c942 |
2020-05-07 |
Add documentation for SpannerDeployInstanceOperator (#8750)
|
25ee4211b3 |
2020-05-06 |
Support all RuntimeEnvironment parameters in DataflowTemplatedJobStartOperator (#8531)
|
8d6f1aa4b5 |
2020-05-05 |
Support num_retries field in env var for GCP connection (#8700)
|
67caae0f25 |
2020-05-04 |
Add system test for gcs_to_bigquery (#8556)
|
bc45fa6759 |
2020-05-03 |
Add system test and docs for Facebook Ads operators (#8503)
|
a28c66f23d |
2020-04-30 |
[AIRFLOW-4734] Upsert functionality for PostgresHook.insert_rows() (#8625)
|
992a24ce41 |
2020-04-28 |
Split and improve BigQuery example DAG (#8529)
|
c1fb28230f |
2020-04-28 |
Refactor BigQueryHook dataset operations (#8477)
|
e8d0f8feab |
2020-04-26 |
Improve idempodency in CloudDataTransferServiceCreateJobOperator (#8430)
|
37fdfa9775 |
2020-04-26 |
[AIRFLOW-6281] Create guide for GCS to GCS transfer operators (#8442)
|
14b22e6ffe |
2020-04-25 |
Add hook and operator for Google Cloud Life Sciences (#8481)
|
72ddc94d1e |
2020-04-23 |
Pass location using parmamter in Dataflow integration (#8382)
|
912aa4b423 |
2020-04-23 |
Added GoogleDisplayVideo360DownloadLineItemsOperator (#8174)
|
57c8c05839 |
2020-04-22 |
Use python client in BQ hook create_empty_table/dataset and table_exists (#8377)
|
5d3a7eef30 |
2020-04-20 |
Allow multiple extra_packages in Dataflow (#8394)
|
79c99b1b6a |
2020-04-18 |
Added location parameter to BigQueryCheckOperator (#8273)
|
79d3f33c1b |
2020-04-17 |
Clean up temporary files in Dataflow operators (#8313)
|
efcffa323d |
2020-04-16 |
Add Dataproc SparkR Example (#8240)
|
b198a1fa94 |
2020-04-15 |
Create guide for BigQuery operators (#8276)
|
2636cc932c |
2020-04-14 |
Raise exception when GCP credential doesn't support account impersonation (#8213)
|
eee4ebaeeb |
2020-04-14 |
Added Facebook Ads Operator #7887 (#8008)
|
8cae07ea18 |
2020-04-14 |
fixed typo (#8294)
|
45c8983306 |
2020-04-13 |
Less aggressive eager upgrade of requirements (#8267)
|
1fd9ed3840 |
2020-04-13 |
Add mypy plugin for decorators. (#8145)
|
327b0a9f77 |
2020-04-13 |
Added GoogleDisplayVideo360UploadLineItemsOperator (#8216)
|
bb5e403a32 |
2020-04-10 |
Honor schema type for MySQL to GCS data pre-process (#8090)
|
87969a350d |
2020-04-09 |
[AIRFLOW-6515] Change Log Levels from Info/Warn to Error (#8170)
|
3fc89f29f5 |
2020-04-06 |
[AIRFLOW-7106] Cloud data fusion integration - Allow to pass args to start pipeline (#7849)
|
7ef75d2393 |
2020-04-03 |
[AIRFLOW-7117] Honor self.schema in sql_to_gcs as schema to upload (#8049)
|
ed2bc00576 |
2020-04-02 |
Add Google Ads list accounts operator (#8007)
|
3808a6206e |
2020-04-01 |
Unify Google class/package names (#8033)
|
8a02402576 |
2020-03-31 |
Rename CloudBaseHook to GoogleBaseHook and move it to google.common (#8011)
|
8e89780071 |
2020-03-31 |
Add more refactor steps for providers.google (#8010)
|
aae3b8fb27 |
2020-03-31 |
Individual package READMEs (#8012)
|
779023968f |
2020-03-30 |
[AIRFLOW-7075] Operators for storing information from GCS into GA (#7743)
|
49abce5217 |
2020-03-30 |
Improve system tests for Cloud Build (#8003)
|
0f19a930d1 |
2020-03-29 |
Remove GKEStartPodOperator when backporting (#7908)
|
0e1c238b2f |
2020-03-28 |
Get Airflow Variables from GCP Secrets Manager (#7946)
|
eb4af4f944 |
2020-03-28 |
Make BaseSecretsBackend.build_path generic (#7948)
|
01f99426fd |
2020-03-28 |
Add download/upload operators for GCS and Google Sheets (#7866)
|
892522f8e2 |
2020-03-26 |
Change signature of GSheetsHook methods (#7853)
|
bfd425157a |
2020-03-26 |
Improve idempotency in MLEngineHook.create_model (#7811)
|
f9c226343d |
2020-03-26 |
Fix CloudSecretsManagerBackend invalid connections_prefix (#7861)
|
e3920f12f4 |
2020-03-26 |
Improve setUp/tearDown in Cloud Firestore system test (#7862)
|
8ba8a7295a |
2020-03-26 |
Improve example DAGs for Cloud Memorystore (#7855)
|
f7d1a437c1 |
2020-03-26 |
Fix CloudMemorystoreCreateInstanceAndImportOperator operator (#7856)
|
beef6c230e |
2020-03-26 |
Improve authorization in GCP system tests (#7863)
|
5f165f3e42 |
2020-03-26 |
[AIRFLOW-5801] Get GCP credentials from file instead of JSON blob (#7869)
|
686d7d50bd |
2020-03-25 |
Standardize SecretBackend class names (#7846)
|
1982c3fdca |
2020-03-24 |
Run Dataflow for ML Engine summary in venv (#7809)
|
eef87b9953 |
2020-03-23 |
[AIRFLOW-7105] Unify Secrets Backend method interfaces (#7830)
|
529db07b2e |
2020-03-23 |
Improve Google PubSub hook publish method (#7831)
|
4bde99f132 |
2020-03-23 |
Make airflow/providers pylint compatible (#7802)
|
a001489b59 |
2020-03-23 |
Improve example DAG for ML Engine (#7810)
|
9e5a8e7f83 |
2020-03-23 |
Add call to Super class in 'google' providers (#7823)
|
b86bf79bff |
2020-03-23 |
Fix typo in GCP credentials_provider's docstring (#7818)
|
56c013ce92 |
2020-03-23 |
Add missing docstring in BigQueryHook.create_empty_table (#7817)
|
426a79847c |
2020-03-23 |
Imrove support for laatest API in MLEngineStartTrainingJobOperator (#7812)
|
cdf1809fce |
2020-03-23 |
[AIRFLOW-7104] Add Secret backend for GCP Secrets Manager (#7795)
|
27dac00e12 |
2020-03-22 |
[AIRFLOW-7099] Improve system test for cloud transfer service (#7794)
|
0daf5d729a |
2020-03-22 |
Add ability to specify a maximum modified time for objects in GCSToGCSOperator (#7791)
|
c8088c2bd7 |
2020-03-20 |
[AIRFLOW-7100] Add GoogleAnalyticsGetAdsLinkOperator (#7781)
|
5106a29314 |
2020-03-20 |
[AIRFLOW-6752] Add GoogleAnalyticsRetrieveAdsLinksListOperator (#7748)
|
759ce2a80c |
2020-03-20 |
[AIRFLOW-6978] Add PubSubPullOperator (#7766)
|
6b9b214e4c |
2020-03-20 |
[AIRFLOW-6732] Add GoogleAdsHook and GoogleAdsToGcsOperator (#7692)
|
b118916969 |
2020-03-19 |
[AIRFLOW-7069] Fix cloudsql system tests (#7770)
|
ae854cae5a |
2020-03-19 |
[AIRFLOW-7082] Remove catch_http_exception decorator in GCP hooks (#7756)
|
7e1e954d23 |
2020-03-19 |
[AIRFLOW-7085] Cache credentials, project_id in GCP Base Hook (#7759)
|
6e21c139b3 |
2020-03-19 |
[AIRFLOW-XXXX] Fix reference to GCP classes in guides (#7762)
|
ce022a3f72 |
2020-03-19 |
[AIRFLOW-XXXX] Add cross-references for operators guide (#7760)
|
029c84e552 |
2020-03-18 |
[AIRFLOW-5421] Add Presto to GCS transfer operator (#7718)
|
63a3102ede |
2020-03-18 |
[AIRFLOW-7064] Add CloudFirestoreExportDatabaseOperator (#7725)
|
73305c7bd5 |
2020-03-18 |
[AIRFLOW-7081] Remove env variables from GCP guide (#7755)
|
60fdbf6d92 |
2020-03-18 |
[AIRFLOW-5610] Add ability to specify multiple objects to copy in GCSToGCSOperator (#7728)
|
de7e934ca3 |
2020-03-17 |
[AIRFLOW-7079] Remove redundant code for storing template_fields (#7750)
|
0de0347b27 |
2020-03-17 |
[AIRFLOW-6855]: Escape project_dataset_table in SQL query in gcs to bq … (#7475)
|
91557c6f87 |
2020-03-17 |
[AIRFLOW-7073] GKEStartPodOperator always use connection credentials (#7738)
|
51161dbd9d |
2020-03-16 |
[AIRFLOW-5664] Store timestamps with microseconds precision (#6354)
|
2bc020c431 |
2020-03-14 |
[AIRFLOW-7055] Verbose logging option for google provider (#7711)
|
c997cab42d |
2020-03-13 |
[AIRFLOW-6724] Add Google Analytics 360 Accounts Retrieve Operator (#7630)
|
137896f326 |
2020-03-12 |
[AIRFLOW-7034] Remove feature: Assigning Dag to task using Bitshift Op (#7685)
|
1f77f943d5 |
2020-03-10 |
[AIRFLOW-6980] Improve system tests and building providers package (#7615)
|
bf9b6b6d70 |
2020-03-09 |
[AIRFLOW-5013] Add GCP Data Catalog Hook and operators (#7664)
|
e5130dc9fe |
2020-03-09 |
[AIRFLOW-2911] Add job cancellation capability to Dataflow service (#7659)
|
faf0df4b94 |
2020-03-09 |
[AIRFLOW-XXXX] Fix upsert operator in BQ example DAG (#7666)
|
42eef38217 |
2020-03-07 |
[AIRFLOW-6877] Add cross-provider dependencies as extras (#7506)
|
b5b9795f04 |
2020-03-07 |
[AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (fix) (#7624)
|
6b65038fb4 |
2020-03-06 |
[AIRFLOW-6990] Improve system tests for Google Marketing Platform (#7631)
|
755fe52249 |
2020-03-05 |
[AIRFLOW-6915] Add AI Platform Console Link for MLEngineStartTrainingJobOperator (#7535)
|
cb2f339116 |
2020-03-04 |
[AIRFLOW-6973] Make GCSCreateBucketOperator idempotent (#7609)
|
09fea3ce8e |
2020-03-04 |
[AIRFLOW-6977] Fix BigQuery DTS example DAG (#7612)
|
8230ccc48b |
2020-03-04 |
[AIRFLOW-6926] Fix Google Tasks operators return types and idempotency (#7547)
|
0d1e3088aa |
2020-03-04 |
[AIRFLOW-6970] Improve GCP Video Intelligence system tests (#7604)
|
ab6bb0012c |
2020-03-03 |
[AIRFLOW-6971] Fix return type in CloudSpeechToTextRecognizeSpeechOperator (#7607)
|
3db4ade3dc |
2020-02-29 |
[AIRFLOW-6924] Fix Google DLP operators return types (#7546)
|
008b4bab14 |
2020-02-27 |
[AIRFLOW-6730] Use total_seconds instead of seconds (#7363)
|
bb552b2d9f |
2020-02-25 |
[AIRFLOW-6908] Lazy load AirflowException (#7528)
|
d1a34246ac |
2020-02-25 |
[AIRFLOW-6593] Add GCP Stackdriver Alerting Hooks and Operators (#7322)
|
3320e432a1 |
2020-02-24 |
[AIRFLOW-6817] Lazy-load 'airflow.DAG' to keep user-facing API untouched (#7517)
|
dcf8743521 |
2020-02-24 |
[AIRFLOW-6894] Prevent db query in example_dags (#7516)
|
4d03e33c11 |
2020-02-22 |
[AIRFLOW-6817] remove imports from 'airflow/__init__.py', replaced implicit imports with explicit imports, added entry to 'UPDATING.MD' - squashed/rebased (#7456)
|
35b9616378 |
2020-02-21 |
[AIRFLOW-4973] Add Cloud Data Fusion Pipeline integration (#7486)
|
aff3a361b4 |
2020-02-20 |
[AIRFLOW-6558] Campaign Manager operators for conversions (#7420)
|
9cbd7de6d1 |
2020-02-18 |
[AIRFLOW-6792] Remove _operator/_hook/_sensor in providers package and add tests (#7412)
|
5b199cb86b |
2020-02-17 |
[AIRFLOW-XXXX] Typo in example_bigquery DAG (#7429)
|
2c9345a8e0 |
2020-02-17 |
[AIRFLOW-6759] Added MLEngine operator/hook to cancel MLEngine jobs (#7400)
|
946bdc23c0 |
2020-02-16 |
[AIRFLOW-6405] Add GCP BigQuery Table Upsert Operator (#7126)
|
2381c820c8 |
2020-02-13 |
[AIRFLOW-6505] Let emoji encoded properly for json.dumps() (#7399)
|
04c1fefbf2 |
2020-02-03 |
[AIRFLOW-6676] added GCSDeleteBucketOperator (#7307)
|
a0252748ff |
2020-02-03 |
[AIRFLOW-6717] Remove non-existent field from templated_fields (#7340)
|
97a429f9d0 |
2020-02-02 |
[AIRFLOW-6714] Remove magic comments about UTF-8 (#7338)
|
9d8d075578 |
2020-02-03 |
[AIRFLOW-6715] Fix Google Cloud DLP Example DAG (#7337)
|
cf141506a2 |
2020-02-02 |
[AIRFLOW-6708] Set unique logger names (#7330)
|
373c6aa4a2 |
2020-01-30 |
[AIRFLOW-6682] Move GCP classes to providers package (#7295)
|
83c037873f |
2020-01-30 |
[AIRFLOW-6674] Move example_dags in accordance with AIP-21 (#7287)
|
057f3ae3a4 |
2020-01-29 |
[AIRFLOW-6670][depends on AIRFLOW-6669] Move contrib operators to providers package (#7286)
|
ceea293c16 |
2020-01-28 |
[AIRFLOW-6656] Fix AIP-21 moving (#7272)
|
c42a375e79 |
2020-01-27 |
[AIRFLOW-6644][AIP-21] Move service classes to providers package (#7265)
|
059eda05f8 |
2020-01-21 |
[AIRFLOW-6610] Move software classes to providers package (#7231)
|
f4d3e5e545 |
2020-01-13 |
[AIRFLOW-6102] [AIP-21] Rename Dataproc operators (#7151)
|
e7bf8ecb48 |
2020-01-13 |
[AIRFLOW-6119] [AIP-21] Rename GCS operators, hooks and sensors (#7125)
|
5b6772cb83 |
2020-01-09 |
[AIRFLOW-6125] [AIP-21] Rename S3 operator and SFTP operator (#7112)
|
4f8592ae8f |
2020-01-08 |
[AIRFLOW-6118] [AIP-21] Rename Pubsub operators and hook (#7046)
|
20299473f1 |
2020-01-03 |
[AIRFLOW-6115] [AIP-21] Rename GCP vision operators (#7020)
|
18e8cea4e7 |
2020-01-03 |
[AIRFLOW-6428] Fix import path for airflow.utils.dates.days_ago in Example DAGs (#7007)
|
95087af140 |
2019-12-31 |
[AIRFLOW-6110] [AIP-21] Rename natural_language service (#6968)
|
69629a5a94 |
2019-12-09 |
[AIRFLOW-5807] Move SFTP from contrib to providers. (#6464)
|
25e9047a4a |
2019-12-09 |
[AIRFLOW-6193] Do not use asserts in Airflow main code (#6749)
|
ed0a14f321 |
2019-12-09 |
[AIRFLOW-6120] Rename GoogleCloudBaseHook (#6734)
|
2f2f89c148 |
2019-12-01 |
[AIRFLOW-6139] Consistent spaces in pylint enable/disable (#6701)
|
03c870a617 |
2019-11-26 |
[AIRFLOW-6010] Remove cyclic imports and pylint hacks (#6601)
|
5c4cfea8c0 |
2019-11-15 |
[AIRFLOW-5718] Add SFTPToGoogleCloudStorageOperator (#6393)
|
44a8c37a9a |
2019-11-13 |
[AIRFLOW-XXX] Fix the docstring for Dataproc get_job method (#6581)
|
d633d3ac44 |
2019-11-13 |
[AIRFLOW-5691] Rewrite Dataproc operators to use python library (#6371)
|
d985c02d9f |
2019-11-05 |
[AIRFLOW-XXX] Add How-To-Guide to GCP PubSub (#6497)
|
a296cdabdb |
2019-11-04 |
[AIRFLOW-5743] Move Google PubSub to providers package (#6476)
|
470b2a779d |
2019-10-30 |
[AIRFLOW-5741] Move Cloud Natural Language to providers (#6421)
|
f2caa451fc |
2019-10-27 |
[AIRFLOW-5742] Move Google Cloud Vision to providers package (#6424)
|
16d7accb22 |
2019-10-22 |
[AIRFLOW-4971] Add Google Display & Video 360 integration (#6170)
|
4e661f535d |
2019-10-22 |
[AIRFLOW-5379] Add Google Search Ads 360 operators (#6228)
|
19e32b4e2c |
2019-10-18 |
[AIRFLOW-5656] Rename provider to providers module (#6333)
|
