You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@nifi.apache.org by "Greg Senia (JIRA)" <ji...@apache.org> on 2018/03/22 20:46:00 UTC

[jira] [Created] (NIFI-5004) Ability to Execute File (FTP/CIFS/SFTP) Copy jobs on Mapreduce From Nifi

Greg Senia created NIFI-5004:
--------------------------------

             Summary: Ability to Execute File (FTP/CIFS/SFTP) Copy jobs on Mapreduce From Nifi
                 Key: NIFI-5004
                 URL: https://issues.apache.org/jira/browse/NIFI-5004
             Project: Apache NiFi
          Issue Type: Wish
            Reporter: Greg Senia


Would like to see Nifi run programs on MapReduce exampesl of these like FTP2HDFS [https://github.com/gss2002/ftp2hdfs] and CIFS2HDFS [https://github.com/gss2002/cifs2hdfs] as a MapReduce application where the final resting place is HDFS without any type of data transform on the way in. This would reduce overhead on the Nifi node and move the incoming data directly to the datanode via shortcircuit/read rites. As I currently have these two applications running as MR jobs now and doing this being able to do this from within Nifi pointing at HDFS/YARN.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)