You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@nifi.apache.org by "Pierre Villard (Jira)" <ji...@apache.org> on 2026/03/09 11:21:00 UTC

[jira] [Updated] (NIFI-15685) ListS3 V1 pagination fails when delimiter is not set causing infinite loop for buckets with more than 1000 objects

     [ https://issues.apache.org/jira/browse/NIFI-15685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Pierre Villard updated NIFI-15685:
----------------------------------
    Status: Patch Available  (was: Open)

> ListS3 V1 pagination fails when delimiter is not set causing infinite loop for buckets with more than 1000 objects
> ------------------------------------------------------------------------------------------------------------------
>
>                 Key: NIFI-15685
>                 URL: https://issues.apache.org/jira/browse/NIFI-15685
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Extensions
>            Reporter: Pierre Villard
>            Assignee: Pierre Villard
>            Priority: Major
>
> In S3ObjectBucketLister.setNextMarker() (the V1 lister), the code unconditionally used listObjectsResponse.nextMarker() as the pagination marker. Per the AWS S3 ListObjects V1 API, nextMarker is only populated when a delimiter is specified in the request. Without a delimiter, nextMarker() returns null, which resets the listing back to the beginning of the bucket, creating an infinite loop re-fetching the same first page of objects.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)