[GitHub] [nifi] ijokarumawak edited a comment on issue #3538: NIFI-6385 Add option to penalize waiting FlowFiles

[GitBox <gi...@apache.org>]

ijokarumawak edited a comment on issue #3538: NIFI-6385 Add option to penalize waiting FlowFiles
URL: https://github.com/apache/nifi/pull/3538#issuecomment-503684306
 
 
   Hi @aramatev let me try to explain.
   
   Wait processor only processes one signal per run, regardless of what Prioritizer is used. FIFO passes the First-In FlowFile to Wait processor. PriorityPrioritizer passes the most priority FlowFile. It's not like 'With FIFO, entire queue can be processed by Wait processor', it's more like 'With FIFO, each queued FlowFile can be processed by Wait processor one by one at each scheduled run'. Wait processor runs at every configured 'Run Schedule' ('0 ms' by default, which means the processor keeps running if there's a thread available).
   
   The reason why FIFO works is that when Wait processor route a FlowFile to 'wait' relationship, the FlowFile is re-queued at the end of the queue. Then the next FlowFile is processed at the next Wait processor run.
   
   With PriorityPrioritizer, the same FlowFile is processed again and again, because that is the most priority one.
   
   Actually all Prioritizer sees entire queue. I don't think this is an issue on Prioritizer implementations.
   
   If you have alternative solutions, I'd be interested in hearing that. This PR is just one of many possible approaches. Thanks!

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services