You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by "Carlos Manuel Fernandes (DSI)" <ca...@cgd.pt> on 2017/10/20 10:07:01 UTC
FetchSftp with user/password dont move the file
Hi,
I configured a fetchSftp with username/password (no privatekey for certificate) and the processor is able to fetch the file but gives an error when try to move the file.
Apparently to move the file the processor try use authentication with certificate, not user/pwd. I'm using NIFI 1.30.
This is the warning:
WARN [Timer-Driven Process Thread-2] o.a.nifi.processors.standard.FetchSFTP FetchSFTP[id=1dce6844-015d-1000-9ddf-513c44ecb93f] Successfully fetched the content for StandardFlowFileRecord[uuid=bd37a9c5-7345-4305-9044-befd2e025b0a,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1508492612055-61, container=default, section=61], offset=4282, length=25699415],offset=0,name=xxx.xxx,size=25699415] from host:22/batch/cdirect/in/xxx.xxx but failed to rename the remote file due to java.io.IOException: Failed to obtain connection to remote host due to com.jcraft.jsch.JSchException: Auth cancel:
tks
Carlos
RE: FetchSftp with user/password dont move the file
Posted by "Carlos Manuel Fernandes (DSI)" <ca...@cgd.pt>.
Yes Pierre,
i make the manual test of moving the file using the same user. The strange Thing with the processor : the file is pulled just not moved.
Carlos
From: Pierre Villard [mailto:pierre.villard.fr@gmail.com]
Sent: sexta-feira, 20 de outubro de 2017 12:21
To: users@nifi.apache.org
Subject: Re: FetchSftp with user/password dont move the file
Hi Carlos,
Is the user allowed to move the file on the FTP server? Are the permissions on the file correct?
Pierre
2017-10-20 12:07 GMT+02:00 Carlos Manuel Fernandes (DSI) <ca...@cgd.pt>>:
Hi,
I configured a fetchSftp with username/password (no privatekey for certificate) and the processor is able to fetch the file but gives an error when try to move the file.
Apparently to move the file the processor try use authentication with certificate, not user/pwd. I’m using NIFI 1.30.
This is the warning:
WARN [Timer-Driven Process Thread-2] o.a.nifi.processors.standard.FetchSFTP FetchSFTP[id=1dce6844-015d-1000-9ddf-513c44ecb93f] Successfully fetched the content for StandardFlowFileRecord[uuid=bd37a9c5-7345-4305-9044-befd2e025b0a,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1508492612055-61, container=default, section=61], offset=4282, length=25699415],offset=0,name=xxx.xxx,size=25699415] from host:22/batch/cdirect/in/xxx.xxx but failed to rename the remote file due to java.io.IOException: Failed to obtain connection to remote host due to com.jcraft.jsch.JSchException: Auth cancel:
tks
Carlos
Re: FetchSftp with user/password dont move the file
Posted by Pierre Villard <pi...@gmail.com>.
Hi Carlos,
Is the user allowed to move the file on the FTP server? Are the permissions
on the file correct?
Pierre
2017-10-20 12:07 GMT+02:00 Carlos Manuel Fernandes (DSI) <
carlos.antonio.fernandes@cgd.pt>:
>
>
> Hi,
>
>
>
> I configured a fetchSftp with username/password (no privatekey for
> certificate) and the processor is able to fetch the file but gives an
> error when try to move the file.
>
> Apparently to move the file the processor try use authentication with
> certificate, not user/pwd. I’m using NIFI 1.30.
>
>
>
> This is the warning:
>
>
>
> WARN [Timer-Driven Process Thread-2] o.a.nifi.processors.standard.FetchSFTP
> FetchSFTP[id=1dce6844-015d-1000-9ddf-513c44ecb93f] Successfully fetched
> the content for StandardFlowFileRecord[uuid=bd37a9c5-7345-4305-9044-
> befd2e025b0a,claim=StandardContentClaim [resourceClaim=
> StandardResourceClaim[id=1508492612055-61, container=default,
> section=61], offset=4282, length=25699415],offset=0,name=xxx.xxx,size=25699415]
> from host:22/batch/cdirect/in/xxx.xxx but failed to rename the remote
> file due to java.io.IOException: Failed to obtain connection to remote host
> due to com.jcraft.jsch.JSchException: Auth cancel:
>
>
>
> tks
>
>
>
> Carlos
>
Re: FetchSftp with user/password dont move the file
Posted by Mark Payne <ma...@hotmail.com>.
Great, please let us know if you run into any more issues!
-Mark
On Oct 20, 2017, at 9:55 AM, Carlos Manuel Fernandes (DSI) <ca...@cgd.pt>> wrote:
Thanks Mark,
In fact i’m using expression language, I will upgrade to 1.4.
Carlos
From: Mark Payne [mailto:markap14@hotmail.com]
Sent: sexta-feira, 20 de outubro de 2017 14:52
To: users@nifi.apache.org<ma...@nifi.apache.org>
Subject: Re: FetchSftp with user/password dont move the file
Carlos,
Are you using the Expression Language in your configuration of FetchSFTP? There was an issue [1] that
caused the processor not to behavior properly when using Expression Language. I have seen two different
problems occur because of the issue. The first one is the "Auth cancel" error that you're showing here. The
other issue that I've seen occur is when the Completion Strategy is set to Move, it will sometimes
indicate a FileNotFoundException even after it has pulled the data.
Fortunately, though, this issue was address in NiFi 1.4.0, so if this is the issue you're hitting you should be
good to go on the newest version of NiFi.
Thanks
-Mark
[1] https://issues.apache.org/jira/browse/NIFI-3281
On Oct 20, 2017, at 6:07 AM, Carlos Manuel Fernandes (DSI) <ca...@cgd.pt>> wrote:
Hi,
I configured a fetchSftp with username/password (no privatekey for certificate) and the processor is able to fetch the file but gives an error when try to move the file.
Apparently to move the file the processor try use authentication with certificate, not user/pwd. I’m using NIFI 1.30.
This is the warning:
WARN [Timer-Driven Process Thread-2] o.a.nifi.processors.standard.FetchSFTP FetchSFTP[id=1dce6844-015d-1000-9ddf-513c44ecb93f] Successfully fetched the content for StandardFlowFileRecord[uuid=bd37a9c5-7345-4305-9044-befd2e025b0a,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1508492612055-61, container=default, section=61], offset=4282, length=25699415],offset=0,name=xxx.xxx,size=25699415] from host:22/batch/cdirect/in/xxx.xxx but failed to rename the remote file due to java.io.IOException: Failed to obtain connection to remote host due to com.jcraft.jsch.JSchException: Auth cancel:
tks
Carlos
RE: FetchSftp with user/password dont move the file
Posted by "Carlos Manuel Fernandes (DSI)" <ca...@cgd.pt>.
Thanks Mark,
In fact i’m using expression language, I will upgrade to 1.4.
Carlos
From: Mark Payne [mailto:markap14@hotmail.com]
Sent: sexta-feira, 20 de outubro de 2017 14:52
To: users@nifi.apache.org
Subject: Re: FetchSftp with user/password dont move the file
Carlos,
Are you using the Expression Language in your configuration of FetchSFTP? There was an issue [1] that
caused the processor not to behavior properly when using Expression Language. I have seen two different
problems occur because of the issue. The first one is the "Auth cancel" error that you're showing here. The
other issue that I've seen occur is when the Completion Strategy is set to Move, it will sometimes
indicate a FileNotFoundException even after it has pulled the data.
Fortunately, though, this issue was address in NiFi 1.4.0, so if this is the issue you're hitting you should be
good to go on the newest version of NiFi.
Thanks
-Mark
[1] https://issues.apache.org/jira/browse/NIFI-3281
On Oct 20, 2017, at 6:07 AM, Carlos Manuel Fernandes (DSI) <ca...@cgd.pt>> wrote:
Hi,
I configured a fetchSftp with username/password (no privatekey for certificate) and the processor is able to fetch the file but gives an error when try to move the file.
Apparently to move the file the processor try use authentication with certificate, not user/pwd. I’m using NIFI 1.30.
This is the warning:
WARN [Timer-Driven Process Thread-2] o.a.nifi.processors.standard.FetchSFTP FetchSFTP[id=1dce6844-015d-1000-9ddf-513c44ecb93f] Successfully fetched the content for StandardFlowFileRecord[uuid=bd37a9c5-7345-4305-9044-befd2e025b0a,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1508492612055-61, container=default, section=61], offset=4282, length=25699415],offset=0,name=xxx.xxx,size=25699415] from host:22/batch/cdirect/in/xxx.xxx but failed to rename the remote file due to java.io.IOException: Failed to obtain connection to remote host due to com.jcraft.jsch.JSchException: Auth cancel:
tks
Carlos
Re: FetchSftp with user/password dont move the file
Posted by Mark Payne <ma...@hotmail.com>.
Carlos,
Are you using the Expression Language in your configuration of FetchSFTP? There was an issue [1] that
caused the processor not to behavior properly when using Expression Language. I have seen two different
problems occur because of the issue. The first one is the "Auth cancel" error that you're showing here. The
other issue that I've seen occur is when the Completion Strategy is set to Move, it will sometimes
indicate a FileNotFoundException even after it has pulled the data.
Fortunately, though, this issue was address in NiFi 1.4.0, so if this is the issue you're hitting you should be
good to go on the newest version of NiFi.
Thanks
-Mark
[1] https://issues.apache.org/jira/browse/NIFI-3281
On Oct 20, 2017, at 6:07 AM, Carlos Manuel Fernandes (DSI) <ca...@cgd.pt>> wrote:
Hi,
I configured a fetchSftp with username/password (no privatekey for certificate) and the processor is able to fetch the file but gives an error when try to move the file.
Apparently to move the file the processor try use authentication with certificate, not user/pwd. I’m using NIFI 1.30.
This is the warning:
WARN [Timer-Driven Process Thread-2] o.a.nifi.processors.standard.FetchSFTP FetchSFTP[id=1dce6844-015d-1000-9ddf-513c44ecb93f] Successfully fetched the content for StandardFlowFileRecord[uuid=bd37a9c5-7345-4305-9044-befd2e025b0a,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1508492612055-61, container=default, section=61], offset=4282, length=25699415],offset=0,name=xxx.xxx,size=25699415] from host:22/batch/cdirect/in/xxx.xxx but failed to rename the remote file due to java.io.IOException: Failed to obtain connection to remote host due to com.jcraft.jsch.JSchException: Auth cancel:
tks
Carlos