You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nifi.apache.org by Kartik Veerepalli <ka...@syntasa.com> on 2015/04/07 23:08:22 UTC

Conflict Resolution Strategy

Hello all,

I have a use case to copy files from one server to another server and use those files for further processing. Using simple GetFile (with Keep Source File property set to true) and PutFile processors. But, when I move those files from the destination server for processing, Apache Nifi is copying the files from the source server to the destination server all over again. Is there a way I can work around this? There are only 3 options under the conflict resolution strategy property - replace, ignore and fail none of which fits my use case. Any suggestions?

Thanks
Kartik

Re: Conflict Resolution Strategy

Posted by Corey Flowers <cf...@onyxpoint.com>.
Hey Kartik!

       I am not sure I fully understand your problem. Let me see if I have this right.

1) you want to keep the files on the source but have a copy picked up and sent to the destination.
2) you then want the copies to be processed on the destination without keeping a copy of them.

Is that right?

Sent from my iPhone

> On Apr 7, 2015, at 5:08 PM, Kartik Veerepalli <ka...@syntasa.com> wrote:
> 
> Hello all,
> 
> I have a use case to copy files from one server to another server and use those files for further processing. Using simple GetFile (with Keep Source File property set to true) and PutFile processors. But, when I move those files from the destination server for processing, Apache Nifi is copying the files from the source server to the destination server all over again. Is there a way I can work around this? There are only 3 options under the conflict resolution strategy property - replace, ignore and fail none of which fits my use case. Any suggestions?
> 
> Thanks
> Kartik

Re: Conflict Resolution Strategy

Posted by Joe Witt <jo...@gmail.com>.
Kartik

I would recommend running something lime rsync for that case.  Nifi is
meant to automate the continuous flow of data from producers to consumers.

Happy to help you think through this further if i have misunderstood.

Thanks
Joe
On Apr 7, 2015 4:14 PM, "Kartik Veerepalli" <ka...@syntasa.com>
wrote:

> Hello all,
>
> I have a use case to copy files from one server to another server and use
> those files for further processing. Using simple GetFile (with Keep Source
> File property set to true) and PutFile processors. But, when I move those
> files from the destination server for processing, Apache Nifi is copying
> the files from the source server to the destination server all over again.
> Is there a way I can work around this? There are only 3 options under the
> conflict resolution strategy property - replace, ignore and fail none of
> which fits my use case. Any suggestions?
>
> Thanks
> Kartik
>