[GitHub] [nifi] bbende commented on issue #3597: NIFI-6462 ListHDFS should be triggerable

[GitBox <gi...@apache.org>]

bbende commented on issue #3597: NIFI-6462 ListHDFS should be triggerable
URL: https://github.com/apache/nifi/pull/3597#issuecomment-514214460
 
 
   ListHDFS is meant to maintain state for a specific directory and find newer files during each execution. This works because the processor knows it is tracking a single directory and can detect when the user changes the Directory property. By allowing incoming flow files it means the processor is now tracking a potentially infinite number of directories which are coming dynamically from incoming flow files.
   
   This was discussed a few times on the mailing list and the general consensus was to leave ListHDFS and implement an alternate processor that supported incoming flow files, but did not maintain state, basically a one-time listing. I believe GetHDFSFileInfo already provides this functionality.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services