You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Hsin-Ying Lee (Jira)" <ji...@apache.org> on 2021/06/25 08:03:00 UTC

[jira] [Updated] (NIFI-8739) Penalized flowfiles should be able to be polled from the queue in some cases

     [ https://issues.apache.org/jira/browse/NIFI-8739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hsin-Ying Lee updated NIFI-8739:
--------------------------------
    Description: 
We have penalize strategy for the FlowFiles to let them not be processed by the downstream processor.

But the interface of the queue `FlowFileQueue` has no APIs for choosing a strategy for polling.

So when we send the penalized FlowFiles to other nodes, we need to wait until the FlowFiles are over the penalize time.

This impact including offloading the node or using load balance in connections, it might block the node to offload

  was:
We have penalize strategy for the FlowFiles to let them not be processed by the downstream processor.

But the interface of the queue `FlowFileQueue` has no APIs for choosing a strategy for polling.
So when we send the penalized FlowFiles to other nodes, we need to wait until the FlowFiles are over the penalize time.
This impact including offloading the node or using load balance in connections, it might block the node to offload


> Penalized flowfiles should be able to be polled from the queue in some cases
> ----------------------------------------------------------------------------
>
>                 Key: NIFI-8739
>                 URL: https://issues.apache.org/jira/browse/NIFI-8739
>             Project: Apache NiFi
>          Issue Type: Improvement
>          Components: Core Framework
>            Reporter: Hsin-Ying Lee
>            Assignee: Hsin-Ying Lee
>            Priority: Major
>
> We have penalize strategy for the FlowFiles to let them not be processed by the downstream processor.
> But the interface of the queue `FlowFileQueue` has no APIs for choosing a strategy for polling.
> So when we send the penalized FlowFiles to other nodes, we need to wait until the FlowFiles are over the penalize time.
> This impact including offloading the node or using load balance in connections, it might block the node to offload



--
This message was sent by Atlassian Jira
(v8.3.4#803005)