airflow.providers.apache.hdfs.sensors.web_hdfs

Module Contents

Classes

WebHdfsSensor

Waits for a file or folder to land in HDFS
class airflow.providers.apache.hdfs.sensors.web_hdfs.WebHdfsSensor(*, filepath, webhdfs_conn_id='webhdfs_default', **kwargs)[source]

Bases: airflow.sensors.base.BaseSensorOperator

Waits for a file or folder to land in HDFS

template_fields :Sequence[str] = ['filepath'][source]
poke(self, context)[source]

Function that the sensors defined while deriving this class should override.

Was this entry helpful?