Configuration Reference¶
This page contains the list of all available Airflow configurations for the
apache-airflow-providers-amazon provider that can be set in the airflow.cfg file or using environment variables.
Note
The configuration embedded in provider packages started to be used as of Airflow 2.7.0. Previously the configuration was described and configured in the Airflow core package - so if you are using Airflow below 2.7.0, look at Airflow documentation for the list of available configuration options that were available in Airflow core.
Note
For more information see Setting Configuration Options.
Sections:
[aws]¶
This section contains settings for Amazon Web Services (AWS) integration.
cloudwatch_task_handler_json_serializer¶
New in version 8.7.2.
By default, when logging non-string messages, all non-json objects are logged as null. Except datetime objects which are ISO formatted. Users can optionally use a repr serializer or provide their own JSON serializer for any non-JSON-serializable objects in the logged message.
airflow.providers.amazon.aws.log.cloudwatch_task_handler.json_serialize uses repr (be aware there is the potential of logging sensitive data depending on the repr method of logged objects)
airflow.providers.amazon.aws.log.cloudwatch_task_handler.json_serialize_legacy uses null.
If a custom serializer is provided, it must adhere to Callable[[Any], str | None], where None serializes to null (e.g. def my_serializer(o: Any) -> str | None). Since this is on the logging path and it’s possible there’s an exception being handled, special care should be taken to fail gracefully without raising a new exception inside of your serializer.
- Type
string
- Default
airflow.providers.amazon.aws.log.cloudwatch_task_handler.json_serialize_legacy- Environment Variable
AIRFLOW__AWS__CLOUDWATCH_TASK_HANDLER_JSON_SERIALIZER- Example
airflow.providers.amazon.aws.log.cloudwatch_task_handler.json_serialize
session_factory¶
New in version 3.1.1.
Full import path to the class which implements a custom session factory for
boto3.session.Session. For more details please have a look at
Session Factory.
- Type
string
- Default
None- Environment Variable
AIRFLOW__AWS__SESSION_FACTORY- Example
my_company.aws.MyCustomSessionFactory