[jira] [Created] (NIFI-3431) Support batch update in Notify processor

["Koji Kawamura (JIRA)" <ji...@apache.org>]

Koji Kawamura created NIFI-3431:
-----------------------------------

             Summary: Support batch update in Notify processor
                 Key: NIFI-3431
                 URL: https://issues.apache.org/jira/browse/NIFI-3431
             Project: Apache NiFi
          Issue Type: Improvement
          Components: Extensions
    Affects Versions: 1.2.0
            Reporter: Koji Kawamura
            Assignee: Koji Kawamura


NIFI-3216 added ability to wait for N signals. It supports waiting for N fragments split by SplitXXXX processors. However, since Notify processor has to increase count one by one by calling expensive replace cache operation over network, it doesn't provide a practical performance when user configured a flow looks like below as N glow:

{code}
Split
 --> (original) -> Wait for N
 --> (split) -> Do something -> Notify 1
{code}

This JIRA improves Notify processor by:

- Add "Signal Buffer Count" to specify max number of flow files that can be buffered and update cache at once
- Add "Signal Counter Delta" to specify delta grater than 1, EL supported

"Signal Buffer Count" would be useful in a flow like this:

{code}
Split
 --> (original) -> Wait for N
 --> (split) -> Filter or something -> Notify M
{code}

Buffer incoming M flow files and perform cache replace operation once.

So does "Signal Counter Delta":

{code}
Split
 --> (original) -> Wait for N
 --> (split) -> Filter or something -> Merge M -> PutXXX -> Notify M
{code}

Specify 'M' via Attribute Expression Language.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)