You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Matt Burgess (Jira)" <ji...@apache.org> on 2023/12/13 20:17:00 UTC

[jira] [Commented] (NIFI-5642) QueryCassandra processor : output FlowFiles as soon fetch_size is reached

    [ https://issues.apache.org/jira/browse/NIFI-5642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17796449#comment-17796449 ] 

Matt Burgess commented on NIFI-5642:
------------------------------------

That's not what Fetch Size is for, it's the number of rows the client asks for at a time. The Max Rows Per Flow File is what should be used to send FlowFiles downstream when they're "full". Any commits should be reverted as this will change the behavior other users expect.

> QueryCassandra processor : output FlowFiles as soon fetch_size is reached
> -------------------------------------------------------------------------
>
>                 Key: NIFI-5642
>                 URL: https://issues.apache.org/jira/browse/NIFI-5642
>             Project: Apache NiFi
>          Issue Type: Bug
>    Affects Versions: 1.7.1
>            Reporter: André Gomes Lamas Otero
>            Assignee: Levi Lentz
>            Priority: Major
>             Fix For: 2.0.0-M1, 1.22.0
>
>          Time Spent: 4h 10m
>  Remaining Estimate: 0h
>
> When I'm using QueryCassandra alongside with fetch_size parameter I expected that as soon my reader reaches the fetch_size the processor outputs some data to be processed by the next processor, but QueryCassandra reads all the data, then output the flow files.
> I'll start to work on a patch for this situation, I'll appreciate any suggestion.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)