You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Etienne Chauchot (Jira)" <ji...@apache.org> on 2020/05/27 09:50:00 UTC

[jira] [Commented] (FLINK-17961) Create an Elasticsearch source

    [ https://issues.apache.org/jira/browse/FLINK-17961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17117590#comment-17117590 ] 

Etienne Chauchot commented on FLINK-17961:
------------------------------------------

I was thinking about implementing it as a _RichParallelSourceFunction_ with similar architecture as the simple _IntegerSource._ Is this the correct way to go ?

Also, to connect to ES there are low level Rest client that supports all versions of ES but with a very low level REST string API and there is the high level REST client that has versions for each ES backend. As the existing ES sink uses high level REST client and as packages are already divided into ES version specific modules, it is better to keep this organization and use the high level client.

> Create an Elasticsearch source
> ------------------------------
>
>                 Key: FLINK-17961
>                 URL: https://issues.apache.org/jira/browse/FLINK-17961
>             Project: Flink
>          Issue Type: New Feature
>          Components: Connectors / ElasticSearch
>            Reporter: Etienne Chauchot
>            Priority: Minor
>
> There is only an Elasticsearch sink available. There are opensource github repos such as [this one|[https://github.com/mnubo/flink-elasticsearch-source-connector]]. Also the apache bahir project does not provide an Elasticsearch source connector for flink either. IMHO I think the project would benefit from having an bundled source connector for ES alongside with the available sink connector.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)