You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Joseph Gresock (JIRA)" <ji...@apache.org> on 2016/09/22 20:28:20 UTC

[jira] [Closed] (NIFI-2417) Implement Query and Scroll processors for ElasticSearch

     [ https://issues.apache.org/jira/browse/NIFI-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Joseph Gresock closed NIFI-2417.
--------------------------------

> Implement Query and Scroll processors for ElasticSearch
> -------------------------------------------------------
>
>                 Key: NIFI-2417
>                 URL: https://issues.apache.org/jira/browse/NIFI-2417
>             Project: Apache NiFi
>          Issue Type: New Feature
>          Components: Extensions
>    Affects Versions: 1.0.0
>            Reporter: Joseph Gresock
>            Assignee: Joseph Gresock
>            Priority: Minor
>             Fix For: 1.1.0
>
>
> FetchElasticsearchHttp allows users to select a single document from Elasticsearch in NiFi, but there is no way to run a query to retrieve multiple documents.
> We should add a QueryElasticsearchHttp processor for running a query and returning a flow file per result, for small result sets.  This should allow both input and non-input execution.  
> A separate ScrollElasticsearchHttp processor would also be useful for scrolling through a huge result set.  This should use the state manager to maintain the scroll_id value, and use this as input to the next scroll page.  As a result, this processor should not allow flow file input, but should retrieve one page per run.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)