You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Chris Sampson (Jira)" <ji...@apache.org> on 2023/09/14 19:38:00 UTC

[jira] [Updated] (NIFI-12063) Paginated Elasticsearch processors do not pass Dynamic Properties as Request Parameters for SCROLL pagination

     [ https://issues.apache.org/jira/browse/NIFI-12063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chris Sampson updated NIFI-12063:
---------------------------------
    Status: Patch Available  (was: In Progress)

> Paginated Elasticsearch processors do not pass Dynamic Properties as Request Parameters for SCROLL pagination
> -------------------------------------------------------------------------------------------------------------
>
>                 Key: NIFI-12063
>                 URL: https://issues.apache.org/jira/browse/NIFI-12063
>             Project: Apache NiFi
>          Issue Type: Bug
>    Affects Versions: 1.23.2
>            Reporter: Chris Sampson
>            Assignee: Chris Sampson
>            Priority: Trivial
>             Fix For: 1.latest, 2.latest
>
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Dynamic Properties added to the Paginated Elasticsearch processors are meant to be used as Request Parameters when searching Elasticsearch.
> This *does* happen, *except* for subsequent pages of a *SCROLL* type query. This is because the [Elasticsearch Scroll API|https://www.elastic.co/guide/en/elasticsearch/reference/current/scroll-api.html] does not accept such request parameters.
> NiFi should clarify this in its documentation for users. NiFi users can easily change to using SEARCH_AFTER or POINT_IN_TIME (requires Elasticsearch 7.10+ and X-Pack) instead of SCROLL, where the Request Parameters are used for every call to the [Elasticsearch Search API|https://www.elastic.co/guide/en/elasticsearch/reference/current/search-search.html].



--
This message was sent by Atlassian Jira
(v8.20.10#820010)