airflow.providers.apache.druid.operators.druid

Module Contents

Classes

DruidOperator

Allows to submit a task directly to druid
class airflow.providers.apache.druid.operators.druid.DruidOperator(*, json_index_file, druid_ingest_conn_id='druid_ingest_default', timeout=1, max_ingestion_time=None, **kwargs)[source]

Bases: airflow.models.BaseOperator

Allows to submit a task directly to druid

Parameters

  • json_index_file (str) – The filepath to the druid index specification

  • druid_ingest_conn_id (str) – The connection id of the Druid overlord which accepts index jobs

  • timeout (int) – The interval (in seconds) between polling the Druid job for the status of the ingestion job. Must be greater than or equal to 1

  • max_ingestion_time (int | None) – The maximum ingestion time before assuming the job failed

template_fields: Sequence[str] = ('json_index_file',)[source]
template_ext: Sequence[str] = ('.json',)[source]
template_fields_renderers[source]
execute(context)[source]

This is the main method to derive when creating an operator. Context is the same dictionary used as when rendering jinja templates.

Refer to get_template_context for more context.

Was this entry helpful?