You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by "Ben .T.George" <be...@gmail.com> on 2023/05/11 08:57:37 UTC

how SCP full directory to remote location

Hello,

How can we scp directory with many sub folders and files to remote sftp
server?

Regards,
Ben

Re: how SCP full directory to remote location

Posted by Joe Witt <jo...@gmail.com>.
Hello

NiFi doesn't offer an SCP specific processor.  Instead you would use
List/FetchSFTP to pull from the target directory and remote source server
(and recurse to subdirs as desired) and then use PutSFTP to write to the
target directory (including subdirs as desired) of the remote destination
server.

This would not be as efficient as simply using SCP from one host to another
as of course NiFi will be pulling a copy local then pushing.  So if that is
all you need I would just setup a cron to do the scp periodically.  But if
you might want to tap into the data feed to send some to a certain system,
or so you can alter the data in some way/filter things out/etc.. then NiFi
will be a great answer.

Thanks

On Thu, May 11, 2023 at 8:48 AM Eric Secules <es...@gmail.com> wrote:

> Hi Ben,
>
> To clarify, do you want to move files from the same server nifi is running
> on to an sftp server?
>
> -Eric
>
> On Thu., May 11, 2023, 1:58 a.m. Ben .T.George, <be...@gmail.com>
> wrote:
>
>> Hello,
>>
>> How can we scp directory with many sub folders and files to remote sftp
>> server?
>>
>> Regards,
>> Ben
>>
>

Re: how SCP full directory to remote location

Posted by Eric Secules <es...@gmail.com>.
Hi Ben,

To clarify, do you want to move files from the same server nifi is running
on to an sftp server?

-Eric

On Thu., May 11, 2023, 1:58 a.m. Ben .T.George, <be...@gmail.com>
wrote:

> Hello,
>
> How can we scp directory with many sub folders and files to remote sftp
> server?
>
> Regards,
> Ben
>