Writing logs to Amazon Cloudwatch¶
Remote logging to Amazon Cloudwatch uses an existing Airflow connection to read or write logs. If you don’t have a connection properly setup, this process will fail.
To enable this feature,
airflow.cfg must be configured as follows:
[logging] # Airflow can store logs remotely in AWS Cloudwatch. Users must supply a log group # ARN (starting with 'cloudwatch://...') and an Airflow connection # id that provides write and read access to the log location. remote_logging = True remote_base_log_folder = cloudwatch://arn:aws:logs:<region name>:<account id>:log-group:<group name> remote_log_conn_id = MyCloudwatchConn
In the above example, Airflow will try to use