WasbTaskHandler is a python log handler that handles and reads
- class airflow.providers.microsoft.azure.log.wasb_task_handler.WasbTaskHandler(base_log_folder, wasb_log_folder, wasb_container, delete_local_copy, *, filename_template=None)¶
WasbTaskHandler is a python log handler that handles and reads task instance logs. It extends airflow FileTaskHandler and uploads to and reads from Wasb remote storage.
Provide task_instance context to airflow task handler.
Generally speaking returns None. But if attr maintain_propagate has been set to propagate, then returns sentinel MAINTAIN_PROPAGATE. This has the effect of overriding the default behavior to set propagate to False whenever set_context is called. At time of writing, this functionality is only used in unit testing.
ti – task instance object
Close and upload local log file to remote storage Wasb.
Check if remote_log_location exists in remote storage
- wasb_read(remote_log_location, return_error=False)¶
Returns the log found at the remote_log_location. Returns ‘’ if no logs are found or there is an error.
- wasb_write(log, remote_log_location, append=True)¶
Writes the log to the remote_log_location. Fails silently if no hook was created.