`airflow.providers.amazon.aws.example_dags.example_glue`¶

Module Contents¶

Functions¶

upload_artifacts_to_s3()

Upload example CSV input data and an example Spark script to be used by the Glue Job

Attributes¶

`GLUE_DATABASE_NAME`
`GLUE_EXAMPLE_S3_BUCKET`
`GLUE_CRAWLER_ROLE`
`GLUE_CRAWLER_NAME`
`GLUE_CRAWLER_CONFIG`
`EXAMPLE_CSV`
`EXAMPLE_SCRIPT`
`setup_upload_artifacts_to_s3`

airflow.providers.amazon.aws.example_dags.example_glue.GLUE_DATABASE_NAME[source]¶

airflow.providers.amazon.aws.example_dags.example_glue.GLUE_EXAMPLE_S3_BUCKET[source]¶

airflow.providers.amazon.aws.example_dags.example_glue.GLUE_CRAWLER_ROLE[source]¶

airflow.providers.amazon.aws.example_dags.example_glue.GLUE_CRAWLER_NAME = example_crawler[source]¶

airflow.providers.amazon.aws.example_dags.example_glue.GLUE_CRAWLER_CONFIG[source]¶

airflow.providers.amazon.aws.example_dags.example_glue.EXAMPLE_CSV = Multiline-String[source]¶

Show Value

apple,0.5
milk,2.5
bread,4.0

airflow.providers.amazon.aws.example_dags.example_glue.EXAMPLE_SCRIPT[source]¶

airflow.providers.amazon.aws.example_dags.example_glue.upload_artifacts_to_s3()[source]¶: Upload example CSV input data and an example Spark script to be used by the Glue Job

airflow.providers.amazon.aws.example_dags.example_glue.setup_upload_artifacts_to_s3[source]¶

Was this entry helpful?