You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "George Agnelli (JIRA)" <ji...@apache.org> on 2017/07/14 10:30:00 UTC

[jira] [Commented] (BEAM-1637) Create Elasticsearch IO compatible with ES 5.x

    [ https://issues.apache.org/jira/browse/BEAM-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16087154#comment-16087154 ] 

George Agnelli commented on BEAM-1637:
--------------------------------------

Any news on this?

> Create Elasticsearch IO compatible with ES 5.x
> ----------------------------------------------
>
>                 Key: BEAM-1637
>                 URL: https://issues.apache.org/jira/browse/BEAM-1637
>             Project: Beam
>          Issue Type: New Feature
>          Components: sdk-java-extensions
>            Reporter: Etienne Chauchot
>            Assignee: Etienne Chauchot
>            Priority: Minor
>
> The current Elasticsearch IO (see https://issues.apache.org/jira/browse/BEAM-425) is only compatible with Elasticsearch v 2.x. The aim is to have an IO compatible with ES v 5.x. Beyond being able to address v5.x elasticsearch instances, we could also leverage the use of the Elasticsearch pipeline API and also better split the dataset (be as close as possible of desiredBundleSize) thanks to the new ES split API that allows ES shards splitting.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)