airflow.contrib.sensors.hdfs_sensor

Module Contents

class airflow.contrib.sensors.hdfs_sensor.HdfsSensorRegex(regex, *args, **kwargs)

Bases: airflow.sensors.hdfs_sensor.HdfsSensor

poke(self, context)

poke matching files in a directory with self.regex

Returns

Bool depending on the search criteria

class airflow.contrib.sensors.hdfs_sensor.HdfsSensorFolder(be_empty=False, *args, **kwargs)

Bases: airflow.sensors.hdfs_sensor.HdfsSensor

poke(self, context)

poke for a non empty directory

Returns

Bool depending on the search criteria