You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Andre (JIRA)" <ji...@apache.org> on 2016/05/25 07:28:12 UTC

[jira] [Created] (AIRFLOW-173) Create a FileSensor / NFSFileSensor sensor

Andre created AIRFLOW-173:
-----------------------------

             Summary: Create a FileSensor / NFSFileSensor sensor
                 Key: AIRFLOW-173
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-173
             Project: Apache Airflow
          Issue Type: Improvement
            Reporter: Andre
            Priority: Minor


While HDFS and WebHDFS suit most organisations using Hadoop, for some shops running MapR-FS, Airflow implementation is simplified by the use of plain files pointing to MapR's NFS gateways.

A FileSensor and/or a NFSFileSensor would assist the adoption of Airflow within the MapR customer base, but more importantly, help those who are using POSIX compliant distributed filesystems that can be mounted on Unix derivative systems (e.g. as MapR-FS (via NFS), CephFS, GlusterFS, etc).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)