Writing Logs to Amazon Cloudwatch¶

Remote logging to Amazon Cloudwatch uses an existing Airflow connection to read or write logs. If you don't have a connection properly setup, this process will fail.

To enable this feature, airflow.cfg must be configured as follows:

[logging]
# Airflow can store logs remotely in AWS Cloudwatch. Users must supply a log group
# ARN (starting with 'cloudwatch://...') and an Airflow connection
# id that provides write and read access to the log location.
remote_logging = True
remote_base_log_folder = cloudwatch://arn:aws:logs:<region name>:<account id>:log-group:<group name>
remote_log_conn_id = MyCloudwatchConn

In the above example, Airflow will try to use AwsLogsHook('MyCloudwatchConn').