Example Airflow DAG that execute the following tasks using
Cloud DLP service in the Google Cloud:
1) Creating a content inspect template;
2) Using the created template to inspect content;
3) Deleting the template from Google Cloud .
Module Contents
-
airflow.providers.google.cloud.example_dags.example_dlp.START_DATE[source]
-
airflow.providers.google.cloud.example_dags.example_dlp.GCP_PROJECT[source]
-
airflow.providers.google.cloud.example_dags.example_dlp.TEMPLATE_ID = dlp-inspect-838746[source]
-
airflow.providers.google.cloud.example_dags.example_dlp.ITEM[source]
-
airflow.providers.google.cloud.example_dags.example_dlp.INSPECT_CONFIG[source]
-
airflow.providers.google.cloud.example_dags.example_dlp.INSPECT_TEMPLATE[source]
-
airflow.providers.google.cloud.example_dags.example_dlp.OUTPUT_BUCKET[source]
-
airflow.providers.google.cloud.example_dags.example_dlp.OUTPUT_FILENAME = test.txt[source]
-
airflow.providers.google.cloud.example_dags.example_dlp.OBJECT_GCS_URI[source]
-
airflow.providers.google.cloud.example_dags.example_dlp.OBJECT_GCS_OUTPUT_URI[source]
-
airflow.providers.google.cloud.example_dags.example_dlp.create_template[source]
-
airflow.providers.google.cloud.example_dags.example_dlp.CUSTOM_INFO_TYPE_ID = custom_info_type[source]
-
airflow.providers.google.cloud.example_dags.example_dlp.CUSTOM_INFO_TYPES[source]
-
airflow.providers.google.cloud.example_dags.example_dlp.UPDATE_CUSTOM_INFO_TYPE[source]
-
airflow.providers.google.cloud.example_dags.example_dlp.create_info_type[source]
-
airflow.providers.google.cloud.example_dags.example_dlp.JOB_TRIGGER[source]
-
airflow.providers.google.cloud.example_dags.example_dlp.TRIGGER_ID = example_trigger[source]
-
airflow.providers.google.cloud.example_dags.example_dlp.create_trigger[source]
-
airflow.providers.google.cloud.example_dags.example_dlp.DEIDENTIFY_CONFIG[source]
-
airflow.providers.google.cloud.example_dags.example_dlp.deidentify_content[source]