airflow.providers.openlineage.conf

This module provides functions for safely retrieving and handling OpenLineage configurations.

To prevent errors caused by invalid user-provided configuration values, we use conf.get() to fetch values as strings and perform safe conversions using custom functions.

Any invalid configuration values should be treated as incorrect and replaced with default values. For example, if the default for boolean custom_ol_var is False, any non-true value provided: "asdf", 12345, {"key": 1} or empty string, will result in False being used.

By using default values for invalid configuration values, we ensure that the configurations are handled safely, preventing potential runtime errors due to conversion issues.

Module Contents

Functions

decorator(func)

config_path([check_legacy_env_var])

[openlineage] config_path.

is_source_enabled()

[openlineage] disable_source_code.

disabled_operators()

[openlineage] disabled_for_operators.

selective_enable()

[openlineage] selective_enable.

custom_extractors()

[openlineage] extractors.

namespace()

[openlineage] namespace.

transport()

[openlineage] transport.

is_disabled()

[openlineage] disabled + check if any configuration is present.

dag_state_change_process_pool_size()

[openlineage] dag_state_change_process_pool_size.

execution_timeout()

[openlineage] execution_timeout.
airflow.providers.openlineage.conf.decorator(func)[source]
airflow.providers.openlineage.conf.config_path(check_legacy_env_var=True)[source]

[openlineage] config_path.

airflow.providers.openlineage.conf.is_source_enabled()[source]

[openlineage] disable_source_code.

airflow.providers.openlineage.conf.disabled_operators()[source]

[openlineage] disabled_for_operators.

airflow.providers.openlineage.conf.selective_enable()[source]

[openlineage] selective_enable.

airflow.providers.openlineage.conf.custom_extractors()[source]

[openlineage] extractors.

airflow.providers.openlineage.conf.namespace()[source]

[openlineage] namespace.

airflow.providers.openlineage.conf.transport()[source]

[openlineage] transport.

airflow.providers.openlineage.conf.is_disabled()[source]

[openlineage] disabled + check if any configuration is present.

airflow.providers.openlineage.conf.dag_state_change_process_pool_size()[source]

[openlineage] dag_state_change_process_pool_size.

airflow.providers.openlineage.conf.execution_timeout()[source]

[openlineage] execution_timeout.

Was this entry helpful?