[jira] [Comment Edited] (NIFI-10081) MergeContent processor is not executed when Scheduling Strategy is set to Cron Driven.

["Etienne Neveu (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/NIFI-10081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572046#comment-17572046 ] 

Etienne Neveu edited comment on NIFI-10081 at 7/27/22 5:41 PM:
---------------------------------------------------------------

What if we want to write those files at specific times (e.g. every hour using a cron expression like "0 0 * * * ?")?

Can we combine a MergeContent processor (set to run all the time with a "Max Bin Age" and "Maximum Number of Entries") with another processor that accumulates those merged flowfiles and sends them every hour?

We were using the MergeContent processor with a CRON-driven schedule to do this, but it seems the behaviour changed in 1.16.x, and it is not the right approach anyway.

Edit: so what I am asking, is how could Angel achieve the behaviour he needs in his initial ticket, where a single file is written once a day?


was (Author: eneveu):
What if we want to write those files at specific times (e.g. every hour using a cron expression like "0 0 * * * ?")?

Can we combine a MergeContent processor (set to run all the time with a "Max Bin Age" and "Maximum Number of Entries") with another processor that accumulates those merged flowfiles and sends them every hour?

We were using the MergeContent processor with a CRON-driven schedule to do this, but it seems the behaviour changed in 1.16.x, and it is not the right approach anyway.

> MergeContent processor is not executed when Scheduling Strategy is set to Cron Driven.
> --------------------------------------------------------------------------------------
>
>                 Key: NIFI-10081
>                 URL: https://issues.apache.org/jira/browse/NIFI-10081
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Core Framework
>    Affects Versions: 1.16.1, 1.16.2
>         Environment: RHEL 7.9, Linux 3.10.0-1160.21.1.el7.x86_64
> java version "1.8.0_331"
> Java(TM) SE Runtime Environment (build 1.8.0_331-b09)
> Java HotSpot(TM) 64-Bit Server VM (build 25.331-b09, mixed mode)
> Intel(R) Xeon(R) Silver 4110 CPU @ 2.10GHz
> 6 cores
>            Reporter: Angel Oropeza
>            Priority: Minor
>              Labels: crondriven, merge-content, scheduling
>         Attachments: image-2022-06-01-22-22-32-958.png, image-2022-06-01-22-33-10-811.png, image-2022-06-01-22-33-47-519.png
>
>
> I was able to replicate my problem using the following configuration:
> !image-2022-06-01-22-22-32-958.png!
> The MergeContent configuration is as follows
> !image-2022-06-01-22-33-10-811.png!
> !image-2022-06-01-22-33-47-519.png!
> Although the conditions of the MergeContent processor are met, it does not concatenate the incoming flowfiles.
> The last version in which the above flow worked was version 1.15.3.
> Any suggestions on how to solve this? Is this a bug?
> P.S.: The flow is so designed due to a dependency on only writing one file per day.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)