You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@hop.apache.org by Florian CHEVALIER <fl...@mind-and-go.com> on 2021/07/19 08:41:48 UTC
How to use FTPS action
Hello everyone,
Sorry for this question, I'm new too Apache Hop, but I've found on the documentation an action which is called "Get a File with FTP"S (link right here : https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html).
For some reason, I can't find it when I try to create an action on my workflow. I can see the action to get a file with FTP or SFTP (same for sending a file), but nothing for FTPS.
Not sure if I need to add another plugin or something, or if I'm just blind. In any case, any help will be really much appreciated.
Regards,
Florian Chevalier
Re: How to use FTPS action
Posted by Hans Van Akelyen <ha...@gmail.com>.
Hi Florian,
If you create a pipeline and add a "Get variables" transform you can fetch
the ${java.home} Variable, this will contain the java that is being used.
You can use the Preview button to see the value
https://i.snipboard.io/Cd7JaA.jpg
I am not sure you can bypass the certification validation by setting a java
property.
Cheers,
Hans
On Tue, 27 Jul 2021 at 10:06, Florian CHEVALIER <
florian.chevalier@mind-and-go.com> wrote:
> Hi,
>
> I tried to add the certificate to the cacerts but it doesn't work, maybe
> Hop is using another VM.
> I was thinking about adding parameters to java command line like
> -Dtrust_all_cert=true, which must resolve my problem, and if so, I will be
> sure that this is a certificate issue.
> I tried adding those parameters to the hop-gui.sh like so line 76 :
> "$_HOP_JAVA" ${HOP_OPTIONS} -Djava.library.path=$LIBPATH
> -Dtrust_all_cert=true -classpath "${CLASSPATH}"
> org.apache.hop.ui.hopgui.HopGui $@
> But it don't seem to have any effect.
> Should I add the parameter to all the scripts or is there a way to add a
> Java parameter to Hop just at one place ?
>
> Regards,
> Florian Chevalier
>
> ----- Mail original -----
> De: "Hans Van Akelyen" <ha...@gmail.com>
> À: "users" <us...@hop.apache.org>
> Envoyé: Mercredi 21 Juillet 2021 13:44:19
> Objet: Re: How to use FTPS action
>
> Hi,
> Yes there is a high possibility the connection is being closed because of
> that.
> The only solution I see requires you to add the certificate to your java
> truststore.
> You can do this by using the keytool in the bin folder of your java
> installation (or globally available on linux/macos) and add the certificate
> to the keystore.
> The command will look like:
> keytool -import -file "/path/to/certificate.cer" -keystore
> "/path/to/java/jre/lib/security/cacerts" -alias "My FTPS Server
> certificate"
>
> I must admit this is also untested territory for me, but I hope it helps
> solve your problem.
>
> Cheers,
> Hans
>
> On Wed, 21 Jul 2021 at 13:21, Florian CHEVALIER < [ mailto:
> florian.chevalier@mind-and-go.com | florian.chevalier@mind-and-go.com ] >
> wrote:
>
>
> Hi,
>
> Thank you very much for the fix, it works perfectly and I don't have the
> same issue anymore.
> I want to get files from a ftps connexion implicit on TLS.
> I can connect to my server on FileZilla for exemple, but FileZila ask me
> to accept a self signed certificate on every session.
>
> With the copy file action using VFS on Hop, I got the following error :
> Caused by: org.apache.commons.net.ftp.FTPConnectionClosedException:
> Connection closed without indication
>
> I guess this is due to the certificate which is not accepted when using
> Hop.
> Is there an action I can use to do this ?
>
> Regards,
> Florian Chevalier
>
> ----- Mail original -----
> De: "Hans Van Akelyen" < [ mailto:hans.van.akelyen@gmail.com |
> hans.van.akelyen@gmail.com ] >
> À: "users" < [ mailto:users@hop.apache.org | users@hop.apache.org ] >
> Envoyé: Mardi 20 Juillet 2021 10:13:26
> Objet: Re: How to use FTPS action
>
> Hi Florian,
> As I was sure this should work I started digging a bit, it seems we have
> found a bug. But no worries.... It has an easy fix.
> We are missing a dependency in the project to make ftp/ftps and some
> others work.
> The quick fix is to copy the commons-net-3.7.2 dependency from the
> plugins/actions/ftp/lib folder to the main /lib folder and restart the
> application.
>
> I have created a ticket to solve it permanently [1].
>
> Cheers,
> Hans
>
> [1] [ [ https://issues.apache.org/jira/browse/HOP-3102 |
> https://issues.apache.org/jira/browse/HOP-3102 ] | [
> https://issues.apache.org/jira/browse/HOP-3102 |
> https://issues.apache.org/jira/browse/HOP-3102 ] ]
>
> On Tue, 20 Jul 2021 at 08:34, Florian CHEVALIER < [ mailto: [ mailto:
> florian.chevalier@mind-and-go.com | florian.chevalier@mind-and-go.com ] |
> [ mailto:florian.chevalier@mind-and-go.com |
> florian.chevalier@mind-and-go.com ] ] > wrote:
>
>
> Hi again,
>
> First of all, thanks for all the docs.
> I still have an issue, my URI in the copy files action is never valid. The
> one I want to use is a little bit complex because of special characters so
> I tried the one I joined based one the doc and what I have found elsewhere.
> In the screenshot you can also see the error.
> The main issue seems to be Expecting // to follow the scheme in URI
> "ftps://test:***@ [ [ http://example.com/ | http://example.com/ ] | [
> http://example.com/ | example.com ] ] ". The given URI respects the
> format of the documentation ftps://[ username[: password]@] hostname[:
> port][ absolute-path].
> I also tried to add a path right after adn/or a port but nothing really
> worked.
> Once again, your help will be really much appreciated.
>
> Regards,
> Florian Chevalier
>
> ----- Mail original -----
> De: "Hans Van Akelyen" < [ mailto: [ mailto:hans.van.akelyen@gmail.com |
> hans.van.akelyen@gmail.com ] | [ mailto:hans.van.akelyen@gmail.com |
> hans.van.akelyen@gmail.com ] ] >
> À: "users" < [ mailto: [ mailto:users@hop.apache.org |
> users@hop.apache.org ] | [ mailto:users@hop.apache.org |
> users@hop.apache.org ] ] >
> Envoyé: Lundi 19 Juillet 2021 11:53:11
> Objet: Re: How to use FTPS action
>
> Hi Florian,
> You are right, there used to be an action for FTPS, unfortunately we had
> to remove it because it was using non Apache License compatible libraries.
>
> You should however also be able to use the Copy Files or Move Files action
> and use a VFS url to retrieve the files.
>
> For more information on VFS see following documentation [1] [2] I have
> created a ticket to remove the faulty docs. [3]
>
> If you have more questions, we are here to help.
>
> Cheers,
> Hans
>
> [1] [ [ [
> https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems
> |
> https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems
> ] | [
> https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems
> |
> https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems
> ] ] | [ [
> https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems
> |
> https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems
> ] | [
> https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems
> |
> https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems
> ] ] ]
> [2] [ [ [
> https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS |
> https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS ] | [
> https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS |
> https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS ] ] |
> [ [ https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS |
> https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS ] | [
> https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS |
> https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS ] ] ]
> [3] [ [ [ https://issues.apache.org/jira/browse/HOP-3098 |
> https://issues.apache.org/jira/browse/HOP-3098 ] | [
> https://issues.apache.org/jira/browse/HOP-3098 |
> https://issues.apache.org/jira/browse/HOP-3098 ] ] | [ [
> https://issues.apache.org/jira/browse/HOP-3098 |
> https://issues.apache.org/jira/browse/HOP-3098 ] | [
> https://issues.apache.org/jira/browse/HOP-3098 |
> https://issues.apache.org/jira/browse/HOP-3098 ] ] ]
>
> On Mon, 19 Jul 2021 at 10:41, Florian CHEVALIER < [ mailto: [ mailto: [
> mailto:florian.chevalier@mind-and-go.com |
> florian.chevalier@mind-and-go.com ] | [ mailto:
> florian.chevalier@mind-and-go.com | florian.chevalier@mind-and-go.com ] ]
> | [ mailto: [ mailto:florian.chevalier@mind-and-go.com |
> florian.chevalier@mind-and-go.com ] | [ mailto:
> florian.chevalier@mind-and-go.com | florian.chevalier@mind-and-go.com ] ]
> ] > wrote:
>
>
> Hello everyone,
>
> Sorry for this question, I'm new too Apache Hop, but I've found on the
> documentation an action which is called "Get a File with FTP"S (link right
> here : [ [ [
> https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html |
> https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html ] | [
> https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html |
> https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html ] ] |
> [ [ https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html |
> https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html ] | [
> https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html |
> https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html ] ] ]
> ).
> For some reason, I can't find it when I try to create an action on my
> workflow. I can see the action to get a file with FTP or SFTP (same for
> sending a file), but nothing for FTPS.
> Not sure if I need to add another plugin or something, or if I'm just
> blind. In any case, any help will be really much appreciated.
>
> Regards,
> Florian Chevalier
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
Re: How to use FTPS action
Posted by Florian CHEVALIER <fl...@mind-and-go.com>.
Hi,
I tried to add the certificate to the cacerts but it doesn't work, maybe Hop is using another VM.
I was thinking about adding parameters to java command line like -Dtrust_all_cert=true, which must resolve my problem, and if so, I will be sure that this is a certificate issue.
I tried adding those parameters to the hop-gui.sh like so line 76 :
"$_HOP_JAVA" ${HOP_OPTIONS} -Djava.library.path=$LIBPATH -Dtrust_all_cert=true -classpath "${CLASSPATH}" org.apache.hop.ui.hopgui.HopGui $@
But it don't seem to have any effect.
Should I add the parameter to all the scripts or is there a way to add a Java parameter to Hop just at one place ?
Regards,
Florian Chevalier
----- Mail original -----
De: "Hans Van Akelyen" <ha...@gmail.com>
À: "users" <us...@hop.apache.org>
Envoyé: Mercredi 21 Juillet 2021 13:44:19
Objet: Re: How to use FTPS action
Hi,
Yes there is a high possibility the connection is being closed because of that.
The only solution I see requires you to add the certificate to your java truststore.
You can do this by using the keytool in the bin folder of your java installation (or globally available on linux/macos) and add the certificate to the keystore.
The command will look like:
keytool -import -file "/path/to/certificate.cer" -keystore "/path/to/java/jre/lib/security/cacerts" -alias "My FTPS Server certificate"
I must admit this is also untested territory for me, but I hope it helps solve your problem.
Cheers,
Hans
On Wed, 21 Jul 2021 at 13:21, Florian CHEVALIER < [ mailto:florian.chevalier@mind-and-go.com | florian.chevalier@mind-and-go.com ] > wrote:
Hi,
Thank you very much for the fix, it works perfectly and I don't have the same issue anymore.
I want to get files from a ftps connexion implicit on TLS.
I can connect to my server on FileZilla for exemple, but FileZila ask me to accept a self signed certificate on every session.
With the copy file action using VFS on Hop, I got the following error :
Caused by: org.apache.commons.net.ftp.FTPConnectionClosedException: Connection closed without indication
I guess this is due to the certificate which is not accepted when using Hop.
Is there an action I can use to do this ?
Regards,
Florian Chevalier
----- Mail original -----
De: "Hans Van Akelyen" < [ mailto:hans.van.akelyen@gmail.com | hans.van.akelyen@gmail.com ] >
À: "users" < [ mailto:users@hop.apache.org | users@hop.apache.org ] >
Envoyé: Mardi 20 Juillet 2021 10:13:26
Objet: Re: How to use FTPS action
Hi Florian,
As I was sure this should work I started digging a bit, it seems we have found a bug. But no worries.... It has an easy fix.
We are missing a dependency in the project to make ftp/ftps and some others work.
The quick fix is to copy the commons-net-3.7.2 dependency from the plugins/actions/ftp/lib folder to the main /lib folder and restart the application.
I have created a ticket to solve it permanently [1].
Cheers,
Hans
[1] [ [ https://issues.apache.org/jira/browse/HOP-3102 | https://issues.apache.org/jira/browse/HOP-3102 ] | [ https://issues.apache.org/jira/browse/HOP-3102 | https://issues.apache.org/jira/browse/HOP-3102 ] ]
On Tue, 20 Jul 2021 at 08:34, Florian CHEVALIER < [ mailto: [ mailto:florian.chevalier@mind-and-go.com | florian.chevalier@mind-and-go.com ] | [ mailto:florian.chevalier@mind-and-go.com | florian.chevalier@mind-and-go.com ] ] > wrote:
Hi again,
First of all, thanks for all the docs.
I still have an issue, my URI in the copy files action is never valid. The one I want to use is a little bit complex because of special characters so I tried the one I joined based one the doc and what I have found elsewhere.
In the screenshot you can also see the error.
The main issue seems to be Expecting // to follow the scheme in URI "ftps://test:***@ [ [ http://example.com/ | http://example.com/ ] | [ http://example.com/ | example.com ] ] ". The given URI respects the format of the documentation ftps://[ username[: password]@] hostname[: port][ absolute-path].
I also tried to add a path right after adn/or a port but nothing really worked.
Once again, your help will be really much appreciated.
Regards,
Florian Chevalier
----- Mail original -----
De: "Hans Van Akelyen" < [ mailto: [ mailto:hans.van.akelyen@gmail.com | hans.van.akelyen@gmail.com ] | [ mailto:hans.van.akelyen@gmail.com | hans.van.akelyen@gmail.com ] ] >
À: "users" < [ mailto: [ mailto:users@hop.apache.org | users@hop.apache.org ] | [ mailto:users@hop.apache.org | users@hop.apache.org ] ] >
Envoyé: Lundi 19 Juillet 2021 11:53:11
Objet: Re: How to use FTPS action
Hi Florian,
You are right, there used to be an action for FTPS, unfortunately we had to remove it because it was using non Apache License compatible libraries.
You should however also be able to use the Copy Files or Move Files action and use a VFS url to retrieve the files.
For more information on VFS see following documentation [1] [2] I have created a ticket to remove the faulty docs. [3]
If you have more questions, we are here to help.
Cheers,
Hans
[1] [ [ [ https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems | https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems ] | [ https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems | https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems ] ] | [ [ https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems | https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems ] | [ https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems | https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems ] ] ]
[2] [ [ [ https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS | https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS ] | [ https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS | https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS ] ] | [ [ https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS | https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS ] | [ https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS | https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS ] ] ]
[3] [ [ [ https://issues.apache.org/jira/browse/HOP-3098 | https://issues.apache.org/jira/browse/HOP-3098 ] | [ https://issues.apache.org/jira/browse/HOP-3098 | https://issues.apache.org/jira/browse/HOP-3098 ] ] | [ [ https://issues.apache.org/jira/browse/HOP-3098 | https://issues.apache.org/jira/browse/HOP-3098 ] | [ https://issues.apache.org/jira/browse/HOP-3098 | https://issues.apache.org/jira/browse/HOP-3098 ] ] ]
On Mon, 19 Jul 2021 at 10:41, Florian CHEVALIER < [ mailto: [ mailto: [ mailto:florian.chevalier@mind-and-go.com | florian.chevalier@mind-and-go.com ] | [ mailto:florian.chevalier@mind-and-go.com | florian.chevalier@mind-and-go.com ] ] | [ mailto: [ mailto:florian.chevalier@mind-and-go.com | florian.chevalier@mind-and-go.com ] | [ mailto:florian.chevalier@mind-and-go.com | florian.chevalier@mind-and-go.com ] ] ] > wrote:
Hello everyone,
Sorry for this question, I'm new too Apache Hop, but I've found on the documentation an action which is called "Get a File with FTP"S (link right here : [ [ [ https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html | https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html ] | [ https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html | https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html ] ] | [ [ https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html | https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html ] | [ https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html | https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html ] ] ] ).
For some reason, I can't find it when I try to create an action on my workflow. I can see the action to get a file with FTP or SFTP (same for sending a file), but nothing for FTPS.
Not sure if I need to add another plugin or something, or if I'm just blind. In any case, any help will be really much appreciated.
Regards,
Florian Chevalier
Re: How to use FTPS action
Posted by Hans Van Akelyen <ha...@gmail.com>.
Hi,
Yes there is a high possibility the connection is being closed because of
that.
The only solution I see requires you to add the certificate to your java
truststore.
You can do this by using the keytool in the bin folder of your java
installation (or globally available on linux/macos) and add the certificate
to the keystore.
The command will look like:
keytool -import -file "/path/to/certificate.cer" -keystore
"/path/to/java/jre/lib/security/cacerts" -alias "My FTPS Server certificate"
I must admit this is also untested territory for me, but I hope it helps
solve your problem.
Cheers,
Hans
On Wed, 21 Jul 2021 at 13:21, Florian CHEVALIER <
florian.chevalier@mind-and-go.com> wrote:
> Hi,
>
> Thank you very much for the fix, it works perfectly and I don't have the
> same issue anymore.
> I want to get files from a ftps connexion implicit on TLS.
> I can connect to my server on FileZilla for exemple, but FileZila ask me
> to accept a self signed certificate on every session.
>
> With the copy file action using VFS on Hop, I got the following error :
> Caused by: org.apache.commons.net.ftp.FTPConnectionClosedException:
> Connection closed without indication
>
> I guess this is due to the certificate which is not accepted when using
> Hop.
> Is there an action I can use to do this ?
>
> Regards,
> Florian Chevalier
>
> ----- Mail original -----
> De: "Hans Van Akelyen" <ha...@gmail.com>
> À: "users" <us...@hop.apache.org>
> Envoyé: Mardi 20 Juillet 2021 10:13:26
> Objet: Re: How to use FTPS action
>
> Hi Florian,
> As I was sure this should work I started digging a bit, it seems we have
> found a bug. But no worries.... It has an easy fix.
> We are missing a dependency in the project to make ftp/ftps and some
> others work.
> The quick fix is to copy the commons-net-3.7.2 dependency from the
> plugins/actions/ftp/lib folder to the main /lib folder and restart the
> application.
>
> I have created a ticket to solve it permanently [1].
>
> Cheers,
> Hans
>
> [1] [ https://issues.apache.org/jira/browse/HOP-3102 |
> https://issues.apache.org/jira/browse/HOP-3102 ]
>
> On Tue, 20 Jul 2021 at 08:34, Florian CHEVALIER < [ mailto:
> florian.chevalier@mind-and-go.com | florian.chevalier@mind-and-go.com ] >
> wrote:
>
>
> Hi again,
>
> First of all, thanks for all the docs.
> I still have an issue, my URI in the copy files action is never valid. The
> one I want to use is a little bit complex because of special characters so
> I tried the one I joined based one the doc and what I have found elsewhere.
> In the screenshot you can also see the error.
> The main issue seems to be Expecting // to follow the scheme in URI
> "ftps://test:***@ [ http://example.com/ | example.com ] ". The given URI
> respects the format of the documentation ftps://[ username[: password]@]
> hostname[: port][ absolute-path].
> I also tried to add a path right after adn/or a port but nothing really
> worked.
> Once again, your help will be really much appreciated.
>
> Regards,
> Florian Chevalier
>
> ----- Mail original -----
> De: "Hans Van Akelyen" < [ mailto:hans.van.akelyen@gmail.com |
> hans.van.akelyen@gmail.com ] >
> À: "users" < [ mailto:users@hop.apache.org | users@hop.apache.org ] >
> Envoyé: Lundi 19 Juillet 2021 11:53:11
> Objet: Re: How to use FTPS action
>
> Hi Florian,
> You are right, there used to be an action for FTPS, unfortunately we had
> to remove it because it was using non Apache License compatible libraries.
>
> You should however also be able to use the Copy Files or Move Files action
> and use a VFS url to retrieve the files.
>
> For more information on VFS see following documentation [1] [2] I have
> created a ticket to remove the faulty docs. [3]
>
> If you have more questions, we are here to help.
>
> Cheers,
> Hans
>
> [1] [ [
> https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems
> |
> https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems
> ] | [
> https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems
> |
> https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems
> ] ]
> [2] [ [
> https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS |
> https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS ] | [
> https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS |
> https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS ] ]
> [3] [ [ https://issues.apache.org/jira/browse/HOP-3098 |
> https://issues.apache.org/jira/browse/HOP-3098 ] | [
> https://issues.apache.org/jira/browse/HOP-3098 |
> https://issues.apache.org/jira/browse/HOP-3098 ] ]
>
> On Mon, 19 Jul 2021 at 10:41, Florian CHEVALIER < [ mailto: [ mailto:
> florian.chevalier@mind-and-go.com | florian.chevalier@mind-and-go.com ] |
> [ mailto:florian.chevalier@mind-and-go.com |
> florian.chevalier@mind-and-go.com ] ] > wrote:
>
>
> Hello everyone,
>
> Sorry for this question, I'm new too Apache Hop, but I've found on the
> documentation an action which is called "Get a File with FTP"S (link right
> here : [ [
> https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html |
> https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html ] | [
> https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html |
> https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html ] ] ).
> For some reason, I can't find it when I try to create an action on my
> workflow. I can see the action to get a file with FTP or SFTP (same for
> sending a file), but nothing for FTPS.
> Not sure if I need to add another plugin or something, or if I'm just
> blind. In any case, any help will be really much appreciated.
>
> Regards,
> Florian Chevalier
>
>
>
>
>
>
>
>
>
>
>
Re: How to use FTPS action
Posted by Florian CHEVALIER <fl...@mind-and-go.com>.
Hi,
Thank you very much for the fix, it works perfectly and I don't have the same issue anymore.
I want to get files from a ftps connexion implicit on TLS.
I can connect to my server on FileZilla for exemple, but FileZila ask me to accept a self signed certificate on every session.
With the copy file action using VFS on Hop, I got the following error :
Caused by: org.apache.commons.net.ftp.FTPConnectionClosedException: Connection closed without indication
I guess this is due to the certificate which is not accepted when using Hop.
Is there an action I can use to do this ?
Regards,
Florian Chevalier
----- Mail original -----
De: "Hans Van Akelyen" <ha...@gmail.com>
À: "users" <us...@hop.apache.org>
Envoyé: Mardi 20 Juillet 2021 10:13:26
Objet: Re: How to use FTPS action
Hi Florian,
As I was sure this should work I started digging a bit, it seems we have found a bug. But no worries.... It has an easy fix.
We are missing a dependency in the project to make ftp/ftps and some others work.
The quick fix is to copy the commons-net-3.7.2 dependency from the plugins/actions/ftp/lib folder to the main /lib folder and restart the application.
I have created a ticket to solve it permanently [1].
Cheers,
Hans
[1] [ https://issues.apache.org/jira/browse/HOP-3102 | https://issues.apache.org/jira/browse/HOP-3102 ]
On Tue, 20 Jul 2021 at 08:34, Florian CHEVALIER < [ mailto:florian.chevalier@mind-and-go.com | florian.chevalier@mind-and-go.com ] > wrote:
Hi again,
First of all, thanks for all the docs.
I still have an issue, my URI in the copy files action is never valid. The one I want to use is a little bit complex because of special characters so I tried the one I joined based one the doc and what I have found elsewhere.
In the screenshot you can also see the error.
The main issue seems to be Expecting // to follow the scheme in URI "ftps://test:***@ [ http://example.com/ | example.com ] ". The given URI respects the format of the documentation ftps://[ username[: password]@] hostname[: port][ absolute-path].
I also tried to add a path right after adn/or a port but nothing really worked.
Once again, your help will be really much appreciated.
Regards,
Florian Chevalier
----- Mail original -----
De: "Hans Van Akelyen" < [ mailto:hans.van.akelyen@gmail.com | hans.van.akelyen@gmail.com ] >
À: "users" < [ mailto:users@hop.apache.org | users@hop.apache.org ] >
Envoyé: Lundi 19 Juillet 2021 11:53:11
Objet: Re: How to use FTPS action
Hi Florian,
You are right, there used to be an action for FTPS, unfortunately we had to remove it because it was using non Apache License compatible libraries.
You should however also be able to use the Copy Files or Move Files action and use a VFS url to retrieve the files.
For more information on VFS see following documentation [1] [2] I have created a ticket to remove the faulty docs. [3]
If you have more questions, we are here to help.
Cheers,
Hans
[1] [ [ https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems | https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems ] | [ https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems | https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems ] ]
[2] [ [ https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS | https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS ] | [ https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS | https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS ] ]
[3] [ [ https://issues.apache.org/jira/browse/HOP-3098 | https://issues.apache.org/jira/browse/HOP-3098 ] | [ https://issues.apache.org/jira/browse/HOP-3098 | https://issues.apache.org/jira/browse/HOP-3098 ] ]
On Mon, 19 Jul 2021 at 10:41, Florian CHEVALIER < [ mailto: [ mailto:florian.chevalier@mind-and-go.com | florian.chevalier@mind-and-go.com ] | [ mailto:florian.chevalier@mind-and-go.com | florian.chevalier@mind-and-go.com ] ] > wrote:
Hello everyone,
Sorry for this question, I'm new too Apache Hop, but I've found on the documentation an action which is called "Get a File with FTP"S (link right here : [ [ https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html | https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html ] | [ https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html | https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html ] ] ).
For some reason, I can't find it when I try to create an action on my workflow. I can see the action to get a file with FTP or SFTP (same for sending a file), but nothing for FTPS.
Not sure if I need to add another plugin or something, or if I'm just blind. In any case, any help will be really much appreciated.
Regards,
Florian Chevalier
Re: How to use FTPS action
Posted by Hans Van Akelyen <ha...@gmail.com>.
Hi Florian,
As I was sure this should work I started digging a bit, it seems we have
found a bug. But no worries.... It has an easy fix.
We are missing a dependency in the project to make ftp/ftps and some others
work.
The quick fix is to copy the commons-net-3.7.2 dependency from the
plugins/actions/ftp/lib folder to the main /lib folder and restart the
application.
I have created a ticket to solve it permanently [1].
Cheers,
Hans
[1] https://issues.apache.org/jira/browse/HOP-3102
On Tue, 20 Jul 2021 at 08:34, Florian CHEVALIER <
florian.chevalier@mind-and-go.com> wrote:
> Hi again,
>
> First of all, thanks for all the docs.
> I still have an issue, my URI in the copy files action is never valid. The
> one I want to use is a little bit complex because of special characters so
> I tried the one I joined based one the doc and what I have found elsewhere.
> In the screenshot you can also see the error.
> The main issue seems to be Expecting // to follow the scheme in URI
> "ftps://test:***@example.com". The given URI respects the format of the
> documentation ftps://[ username[: password]@] hostname[: port][
> absolute-path].
> I also tried to add a path right after adn/or a port but nothing really
> worked.
> Once again, your help will be really much appreciated.
>
> Regards,
> Florian Chevalier
>
> ----- Mail original -----
> De: "Hans Van Akelyen" <ha...@gmail.com>
> À: "users" <us...@hop.apache.org>
> Envoyé: Lundi 19 Juillet 2021 11:53:11
> Objet: Re: How to use FTPS action
>
> Hi Florian,
> You are right, there used to be an action for FTPS, unfortunately we had
> to remove it because it was using non Apache License compatible libraries.
>
> You should however also be able to use the Copy Files or Move Files action
> and use a VFS url to retrieve the files.
>
> For more information on VFS see following documentation [1] [2] I have
> created a ticket to remove the faulty docs. [3]
>
> If you have more questions, we are here to help.
>
> Cheers,
> Hans
>
> [1] [
> https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems
> |
> https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems
> ]
> [2] [ https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS
> | https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS ]
> [3] [ https://issues.apache.org/jira/browse/HOP-3098 |
> https://issues.apache.org/jira/browse/HOP-3098 ]
>
> On Mon, 19 Jul 2021 at 10:41, Florian CHEVALIER < [ mailto:
> florian.chevalier@mind-and-go.com | florian.chevalier@mind-and-go.com ] >
> wrote:
>
>
> Hello everyone,
>
> Sorry for this question, I'm new too Apache Hop, but I've found on the
> documentation an action which is called "Get a File with FTP"S (link right
> here : [
> https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html |
> https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html ] ).
> For some reason, I can't find it when I try to create an action on my
> workflow. I can see the action to get a file with FTP or SFTP (same for
> sending a file), but nothing for FTPS.
> Not sure if I need to add another plugin or something, or if I'm just
> blind. In any case, any help will be really much appreciated.
>
> Regards,
> Florian Chevalier
>
>
>
>
>
>
Re: How to use FTPS action
Posted by Florian CHEVALIER <fl...@mind-and-go.com>.
Hi again,
First of all, thanks for all the docs.
I still have an issue, my URI in the copy files action is never valid. The one I want to use is a little bit complex because of special characters so I tried the one I joined based one the doc and what I have found elsewhere.
In the screenshot you can also see the error.
The main issue seems to be Expecting // to follow the scheme in URI "ftps://test:***@example.com". The given URI respects the format of the documentation ftps://[ username[: password]@] hostname[: port][ absolute-path].
I also tried to add a path right after adn/or a port but nothing really worked.
Once again, your help will be really much appreciated.
Regards,
Florian Chevalier
----- Mail original -----
De: "Hans Van Akelyen" <ha...@gmail.com>
À: "users" <us...@hop.apache.org>
Envoyé: Lundi 19 Juillet 2021 11:53:11
Objet: Re: How to use FTPS action
Hi Florian,
You are right, there used to be an action for FTPS, unfortunately we had to remove it because it was using non Apache License compatible libraries.
You should however also be able to use the Copy Files or Move Files action and use a VFS url to retrieve the files.
For more information on VFS see following documentation [1] [2] I have created a ticket to remove the faulty docs. [3]
If you have more questions, we are here to help.
Cheers,
Hans
[1] [ https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems | https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems ]
[2] [ https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS | https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS ]
[3] [ https://issues.apache.org/jira/browse/HOP-3098 | https://issues.apache.org/jira/browse/HOP-3098 ]
On Mon, 19 Jul 2021 at 10:41, Florian CHEVALIER < [ mailto:florian.chevalier@mind-and-go.com | florian.chevalier@mind-and-go.com ] > wrote:
Hello everyone,
Sorry for this question, I'm new too Apache Hop, but I've found on the documentation an action which is called "Get a File with FTP"S (link right here : [ https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html | https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html ] ).
For some reason, I can't find it when I try to create an action on my workflow. I can see the action to get a file with FTP or SFTP (same for sending a file), but nothing for FTPS.
Not sure if I need to add another plugin or something, or if I'm just blind. In any case, any help will be really much appreciated.
Regards,
Florian Chevalier
Re: How to use FTPS action
Posted by Hans Van Akelyen <ha...@gmail.com>.
Hi Florian,
You are right, there used to be an action for FTPS, unfortunately we had to
remove it because it was using non Apache License compatible libraries.
You should however also be able to use the Copy Files or Move Files action
and use a VFS url to retrieve the files.
For more information on VFS see following documentation [1] [2] I have
created a ticket to remove the faulty docs. [3]
If you have more questions, we are here to help.
Cheers,
Hans
[1]
https://hop.apache.org/manual/latest/vfs.html#_apache_hop_vfs_file_systems
[2] https://commons.apache.org/proper/commons-vfs/filesystems.html#FTPS
[3] https://issues.apache.org/jira/browse/HOP-3098
On Mon, 19 Jul 2021 at 10:41, Florian CHEVALIER <
florian.chevalier@mind-and-go.com> wrote:
> Hello everyone,
>
> Sorry for this question, I'm new too Apache Hop, but I've found on the
> documentation an action which is called "Get a File with FTP"S (link right
> here : https://hop.apache.org/manual/latest/workflow/actions/ftpsget.html
> ).
> For some reason, I can't find it when I try to create an action on my
> workflow. I can see the action to get a file with FTP or SFTP (same for
> sending a file), but nothing for FTPS.
> Not sure if I need to add another plugin or something, or if I'm just
> blind. In any case, any help will be really much appreciated.
>
> Regards,
> Florian Chevalier
>
>