You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nifi.apache.org by Jeremy Farbota <jf...@payoff.com> on 2017/07/18 17:48:49 UTC
Re: FTPS support in FTPTransfer (List/Fetch/Get/PutFTP) in NiFi 1.3
Moving this comment to dev per Andy's suggestion.
Currently NiFi does not support FTPS.
Box.com does not use SFTP (only FTP over SSL or FTPS). It'd be great to
move my ftp stuff to NiFi, but I need FTPS. AFAIK the FTPTransfer util
would need to include FTPSClient library and reference it. While I could
tape this together with an execute script or invoke script, I'd prefer it
built-in so I can utilize all the functionality of ListFtp, FetchFtp, etc.
Let me know if anyone would be interested to work on this, and I'd be glad
to test and give feedback.
Kindly,
[image: Payoff, Inc.]
*Jeremy Farbota*
Software Engineer, Data
Payoff, Inc.
jfarbota@payoff.com
(217) 898-8110 <+2178988110>
On Mon, Jul 17, 2017 at 5:53 PM, Andy LoPresto <al...@apache.org> wrote:
> Jeremy,
>
> I believe you are correct that substituting the FTPSClient class (explicit
> by default) would work [1]. If your workflow is pretty consistent in the
> necessary operations, you may not even need to extend the entire processor,
> and could instead script something quickly via ExecuteScript/
> InvokeScriptedProcessor.
>
> I can’t speak to an explicit reason FTPS was not implemented. It is likely
> that the user requirements at the time found (S)FTP to be sufficient for
> the documented use cases. In general, existing tickets which target
> non-latest releases, have a low priority, are unassigned, and have not been
> updated in many months are unlikely to be included in future releases
> without revitalized attention. If this is something you’re interested in,
> I’m sure there would be support on the lists (probably more on
> dev@nifi.apache.org) to help you pursue it. If you’re not prepared to
> tackle it, you may still have better luck finding another community member
> willing to help there.
>
> [1] https://stackoverflow.com/a/36309570/70465
>
>
> Andy LoPresto
> alopresto@apache.org
> *alopresto.apache@gmail.com <al...@gmail.com>*
> PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69
>
> On Jul 17, 2017, at 4:47 PM, Jeremy Farbota <jf...@payoff.com> wrote:
>
> Our secure file storage provider does not support SFTP. I'm hoping to
> migrate our folder sync processes and some other operational stuff to NiFi.
> Unfortunately it seems NiFi does not support FTPS.
>
>
> After a little research[1] it seems that one could extend FTPTransfer[2]
> to work with FTPS[3][4] (possibly using an implicit = true/false parameter
> in the processor).
>
>
> Is there a reason why FTPS support was left out? Does anyone have a custom
> processor that handles FTPS already?
>
>
> I noticed this ticket which is listed under 0.7 low priority[5]. Is this
> something that might come in a later version?
>
>
> Thanks in advance.
>
>
> [1] https://community.hortonworks.com/questions/33314/can-nifi-connect-to-
> ftps-protocol.html
> [2] https://github.com/apache/nifi/blob/master/nifi-nar-
> bundles/nifi-standard-bundle/nifi-standard-processors/src/
> main/java/org/apache/nifi/processors/standard/util/FTPTransfer.java
> [3] https://commons.apache.org/proper/commons-net/
> apidocs/org/apache/commons/net/ftp/FTPSClient.html
> [4] https://commons.apache.org/proper/commons-net/
> examples/ftp/FTPClientExample.java
> [5] https://issues.apache.org/jira/browse/NIFI-2278
>
> [image: Payoff, Inc.]
> *Jeremy Farbota*
> Software Engineer, Data
> Payoff, Inc.
>
> jfarbota@payoff.com
>
>
>
Re: FTPS support in FTPTransfer (List/Fetch/Get/PutFTP) in NiFi 1.3
Posted by Joey Frazee <jo...@icloud.com>.
Jeremy, I started on this at one point (see https://github.com/jfrazee/nifi/commits/NIFI-2188). It’s lacking tests and there’s some changes needed to make it more explicit when you’ve misconfigured it, but it might be worth a go if you want to try building from the branch.
I somehow knew this would be for Box.com.
Thanks!
-joey
On Jul 18, 2017, 10:49 AM -0700, Jeremy Farbota <jf...@payoff.com>, wrote:
> Moving this comment to dev per Andy's suggestion.
>
> Currently NiFi does not support FTPS.
>
> Box.com does not use SFTP (only FTP over SSL or FTPS). It'd be great to
> move my ftp stuff to NiFi, but I need FTPS. AFAIK the FTPTransfer util
> would need to include FTPSClient library and reference it. While I could
> tape this together with an execute script or invoke script, I'd prefer it
> built-in so I can utilize all the functionality of ListFtp, FetchFtp, etc.
>
> Let me know if anyone would be interested to work on this, and I'd be glad
> to test and give feedback.
>
> Kindly,
>
>
> [image: Payoff, Inc.]
> *Jeremy Farbota*
> Software Engineer, Data
> Payoff, Inc.
>
> jfarbota@payoff.com
> (217) 898-8110 <+2178988110
>
> On Mon, Jul 17, 2017 at 5:53 PM, Andy LoPresto <al...@apache.org> wrote:
>
> > Jeremy,
> >
> > I believe you are correct that substituting the FTPSClient class (explicit
> > by default) would work [1]. If your workflow is pretty consistent in the
> > necessary operations, you may not even need to extend the entire processor,
> > and could instead script something quickly via ExecuteScript/
> > InvokeScriptedProcessor.
> >
> > I can’t speak to an explicit reason FTPS was not implemented. It is likely
> > that the user requirements at the time found (S)FTP to be sufficient for
> > the documented use cases. In general, existing tickets which target
> > non-latest releases, have a low priority, are unassigned, and have not been
> > updated in many months are unlikely to be included in future releases
> > without revitalized attention. If this is something you’re interested in,
> > I’m sure there would be support on the lists (probably more on
> > dev@nifi.apache.org) to help you pursue it. If you’re not prepared to
> > tackle it, you may still have better luck finding another community member
> > willing to help there.
> >
> > [1] https://stackoverflow.com/a/36309570/70465
> >
> >
> > Andy LoPresto
> > alopresto@apache.org
> > *alopresto.apache@gmail.com <al...@gmail.com>*
> > PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69
> >
> > On Jul 17, 2017, at 4:47 PM, Jeremy Farbota <jf...@payoff.com> wrote:
> >
> > Our secure file storage provider does not support SFTP. I'm hoping to
> > migrate our folder sync processes and some other operational stuff to NiFi.
> > Unfortunately it seems NiFi does not support FTPS.
> >
> >
> > After a little research[1] it seems that one could extend FTPTransfer[2]
> > to work with FTPS[3][4] (possibly using an implicit = true/false parameter
> > in the processor).
> >
> >
> > Is there a reason why FTPS support was left out? Does anyone have a custom
> > processor that handles FTPS already?
> >
> >
> > I noticed this ticket which is listed under 0.7 low priority[5]. Is this
> > something that might come in a later version?
> >
> >
> > Thanks in advance.
> >
> >
> > [1] https://community.hortonworks.com/questions/33314/can-nifi-connect-to-
> > ftps-protocol.html
> > [2] https://github.com/apache/nifi/blob/master/nifi-nar-
> > bundles/nifi-standard-bundle/nifi-standard-processors/src/
> > main/java/org/apache/nifi/processors/standard/util/FTPTransfer.java
> > [3] https://commons.apache.org/proper/commons-net/
> > apidocs/org/apache/commons/net/ftp/FTPSClient.html
> > [4] https://commons.apache.org/proper/commons-net/
> > examples/ftp/FTPClientExample.java
> > [5] https://issues.apache.org/jira/browse/NIFI-2278
> >
> > [image: Payoff, Inc.]
> > *Jeremy Farbota*
> > Software Engineer, Data
> > Payoff, Inc.
> >
> > jfarbota@payoff.com
> >
> >
> >