airflow.providers.google.cloud.sensors.looker

This module contains Google Cloud Looker sensors.

Module Contents

Classes

LookerCheckPdtBuildSensor

Check for the state of a previously submitted PDT materialization job.

class airflow.providers.google.cloud.sensors.looker.LookerCheckPdtBuildSensor(materialization_id, looker_conn_id, cancel_on_kill=True, **kwargs)[source]

Bases: airflow.sensors.base.BaseSensorOperator

Check for the state of a previously submitted PDT materialization job.

Parameters
  • materialization_id (str) -- Required. The materialization job ID to poll. (templated)

  • looker_conn_id (str) -- Required. The connection ID to use connecting to Looker.

  • cancel_on_kill (bool) -- Optional. Flag which indicates whether cancel the hook's job or not, when on_kill is called.

template_fields = ['materialization_id'][source]
poke(self, context)[source]

Function that the sensors defined while deriving this class should override.

on_kill(self)[source]

Override this method to cleanup subprocesses when a task instance gets killed. Any use of the threading, subprocess or multiprocessing module within an operator needs to be cleaned up or it will leave ghost processes behind.

Was this entry helpful?