Large files and GetFile

[mbwagne <mi...@wavestrike.com>]

It seems that GetFile can start to process a file while it's still being
transferred to its input directory. Is there a way to prevent this? I'm
getting errors opening zip files in downstream processing.



--
View this message in context: http://apache-nifi-incubating-developer-list.39713.n7.nabble.com/Large-files-and-GetFile-tp1178.html
Sent from the Apache NiFi (incubating) Developer List mailing list archive at Nabble.com.

Re: Large files and GetFile

[Joe Witt <jo...@gmail.com>]

Mike,

Yes.  This is a classic race condition i was mentioning on the other thread.

Check out the "Minimum File Age" property out from GetFile.  That is a
good way to fight against the race condition problem.

Thanks
Joe

On Mon, Apr 20, 2015 at 4:48 PM, mbwagne <mi...@wavestrike.com> wrote:
> It seems that GetFile can start to process a file while it's still being
> transferred to its input directory. Is there a way to prevent this? I'm
> getting errors opening zip files in downstream processing.
>
>
>
> --
> View this message in context: http://apache-nifi-incubating-developer-list.39713.n7.nabble.com/Large-files-and-GetFile-tp1178.html
> Sent from the Apache NiFi (incubating) Developer List mailing list archive at Nabble.com.

Re: Large files and GetFile

[GM <gs...@yahoo.com>]

Hi, have you found a solution to prevent the processing of a large file
before its transfer got completed?



--
View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/Large-files-and-GetFile-tp1178p12326.html
Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.