airflow.contrib.sensors.hdfs_sensor

Module Contents

class airflow.contrib.sensors.hdfs_sensor.HdfsSensorRegex(regex, *args, **kwargs)[source]

Bases: airflow.sensors.hdfs_sensor.HdfsSensor

poke(self, context)[source]

poke matching files in a directory with self.regex

Returns

Bool depending on the search criteria

class airflow.contrib.sensors.hdfs_sensor.HdfsSensorFolder(be_empty=False, *args, **kwargs)[source]

Bases: airflow.sensors.hdfs_sensor.HdfsSensor

poke(self, context)[source]

poke for a non empty directory

Returns

Bool depending on the search criteria

Was this entry helpful?