You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@nifi.apache.org by "Timea Barna (Jira)" <ji...@apache.org> on 2022/03/30 11:19:00 UTC

[jira] [Updated] (NIFI-9846) Implement pagination listing for Azure List processors

     [ https://issues.apache.org/jira/browse/NIFI-9846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Timea Barna updated NIFI-9846:
------------------------------
    Description: 
If listing a huge azure blob it could make the NiFi JVM go OOM depending on JVM size.
For instance screenshot attached ListAzureBlob is generating OOM since their blob storage is huge.

Mark suggested I make this JIRA to improve this behavior by setting a "batch size"

To enable some kind of paging listing requests needs to use pagination. 

> Implement pagination listing for Azure List processors
> ------------------------------------------------------
>
>                 Key: NIFI-9846
>                 URL: https://issues.apache.org/jira/browse/NIFI-9846
>             Project: Apache NiFi
>          Issue Type: Improvement
>            Reporter: Timea Barna
>            Assignee: Timea Barna
>            Priority: Major
>
> If listing a huge azure blob it could make the NiFi JVM go OOM depending on JVM size.
> For instance screenshot attached ListAzureBlob is generating OOM since their blob storage is huge.
> Mark suggested I make this JIRA to improve this behavior by setting a "batch size"
> To enable some kind of paging listing requests needs to use pagination. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)