airflow.providers.apache.druid.operators.druid

Module Contents

Classes

DruidOperator

Allows to submit a task directly to druid

class airflow.providers.apache.druid.operators.druid.DruidOperator(*, json_index_file, druid_ingest_conn_id='druid_ingest_default', timeout=1, max_ingestion_time=None, **kwargs)[source]

Bases: airflow.models.BaseOperator

Allows to submit a task directly to druid

Parameters
  • json_index_file (str) – The filepath to the druid index specification

  • druid_ingest_conn_id (str) – The connection id of the Druid overlord which accepts index jobs

  • timeout (int) – The interval (in seconds) between polling the Druid job for the status of the ingestion job. Must be greater than or equal to 1

  • max_ingestion_time (Optional[int]) – The maximum ingestion time before assuming the job failed

template_fields :Sequence[str] = ['json_index_file'][source]
template_ext :Sequence[str] = ['.json'][source]
template_fields_renderers[source]
execute(self, context)[source]

This is the main method to derive when creating an operator. Context is the same dictionary used as when rendering jinja templates.

Refer to get_template_context for more context.

Was this entry helpful?