[jira] [Created] (NIFI-12063) Paginated Elasticsearch processors do not pass Dynamic Properties as Request Parameters for SCROLL pagination

["Chris Sampson (Jira)" <ji...@apache.org>]

Chris Sampson created NIFI-12063:
------------------------------------

             Summary: Paginated Elasticsearch processors do not pass Dynamic Properties as Request Parameters for SCROLL pagination
                 Key: NIFI-12063
                 URL: https://issues.apache.org/jira/browse/NIFI-12063
             Project: Apache NiFi
          Issue Type: Bug
    Affects Versions: 1.23.2
            Reporter: Chris Sampson
             Fix For: 1.latest, 2.latest


Dynamic Properties added to the Paginated Elasticsearch processors are meant to be used as Request Parameters when searching Elasticsearch.

This *does* happen, *except* for subsequent pages of a *SCROLL* type query. This is because the [Elasticsearch Scroll API|https://www.elastic.co/guide/en/elasticsearch/reference/current/scroll-api.html] does not accept such request parameters.

NiFi should clarify this in its documentation for users. NiFi users can easily change to using SEARCH_AFTER or POINT_IN_TIME (requires Elasticsearch 7.10+ and X-Pack) instead of SCROLL, where the Request Parameters are used for every call to the [Elasticsearch Search API|https://www.elastic.co/guide/en/elasticsearch/reference/current/search-search.html].



--
This message was sent by Atlassian Jira
(v8.20.10#820010)