[jira] [Commented] (NIFI-3264) ScrollElasticsearchHTTP support for sliced scroll

["Chris Sampson (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/NIFI-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17618805#comment-17618805 ] 

Chris Sampson commented on NIFI-3264:
-------------------------------------

Think this was covered by NIFI-8001 where dynamic properties were enabled as request parameters in (most of) the Elasticsearch based processors.

The {{ScrollElasticsearchHTTP}} processor has now been deprecated in favour of the {{SearchElasticsearch}} processor (uses the Elasticsearch REST Client for connections and more up-to-date pagination features of Elasticsearch), {{PaginatedJsonQueryElasticsearch}} is another alternative that uses input FlowFiles to generate the Elasticsearch query.

> ScrollElasticsearchHTTP support for sliced scroll
> -------------------------------------------------
>
>                 Key: NIFI-3264
>                 URL: https://issues.apache.org/jira/browse/NIFI-3264
>             Project: Apache NiFi
>          Issue Type: Improvement
>            Reporter: Josh Harrison
>            Priority: Major
>
> Elasticsearch 5.x supports sliced scrolls - adding functionality to the ScrollElasticsearchHTTP processor to take advantage of this has the potential to dramatically speed up extraction of data from an ES cluster with the ScrollElasticsearchHTTP processor.
> This could either be an explicit processor setting, or could be the default behavior when increasing the threading on a ScrollElasticsearchHTTP processor.
> See for reference:
> https://www.elastic.co/guide/en/elasticsearch/reference/5.1/search-request-scroll.html#sliced-scroll



--
This message was sent by Atlassian Jira
(v8.20.10#820010)