You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Andre (JIRA)" <ji...@apache.org> on 2016/05/25 07:28:12 UTC
[jira] [Created] (AIRFLOW-173) Create a FileSensor / NFSFileSensor
sensor
Andre created AIRFLOW-173:
-----------------------------
Summary: Create a FileSensor / NFSFileSensor sensor
Key: AIRFLOW-173
URL: https://issues.apache.org/jira/browse/AIRFLOW-173
Project: Apache Airflow
Issue Type: Improvement
Reporter: Andre
Priority: Minor
While HDFS and WebHDFS suit most organisations using Hadoop, for some shops running MapR-FS, Airflow implementation is simplified by the use of plain files pointing to MapR's NFS gateways.
A FileSensor and/or a NFSFileSensor would assist the adoption of Airflow within the MapR customer base, but more importantly, help those who are using POSIX compliant distributed filesystems that can be mounted on Unix derivative systems (e.g. as MapR-FS (via NFS), CephFS, GlusterFS, etc).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)