WebHDFS Operators¶
WebHDFS provides web services access to data stored in HDFS. At the same time, it retains the security the native Hadoop protocol offers and uses parallelism, for better throughput.
WebHdfsSensor¶
Waits for a file or folder to land in HDFS¶
The WebHdfsSensor is used to check for a file or folder
to land in HDFS.
Use the filepath parameter to poke until the provided file is found.
Reference¶
For further information, look at WebHDFS REST API.