You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Bob Tiernay (Jira)" <ji...@apache.org> on 2020/07/21 00:42:00 UTC
[jira] [Commented] (FLINK-11747) Elasticsearch 6 connector - Expose
RestHighLevelClient to allow for custom sniffing
[ https://issues.apache.org/jira/browse/FLINK-11747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17161629#comment-17161629 ]
Bob Tiernay commented on FLINK-11747:
-------------------------------------
Using sniff mode is required in a lot of contexts where hosts are dynamically coming and going (e.g. cloud environments). Right now we have to use reflective hacks and package private classes to workaround this limitation while minimizing the amount of code required to get the functionality.
> Elasticsearch 6 connector - Expose RestHighLevelClient to allow for custom sniffing
> -----------------------------------------------------------------------------------
>
> Key: FLINK-11747
> URL: https://issues.apache.org/jira/browse/FLINK-11747
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / ElasticSearch
> Reporter: Samir Desai
> Assignee: Aleksandr Salatich
> Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> In the Elasticsearch6 connector, the [RestClientFactory|https://github.com/apache/flink/blob/release-1.6/flink-connectors/flink-connector-elasticsearch6/src/main/java/org/apache/flink/streaming/connectors/elasticsearch6/RestClientFactory.java#L31] allows users to customize the {{RestClientBuilder}}. However, certain customizations like adding [Sniffing|https://www.elastic.co/guide/en/elasticsearch/client/java-rest/master/_usage.html]
> require access to the low-level rest client, which can be obtained through the high level rest client. The {{RestHighLevelClient}} is [instantiated|https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-elasticsearch6/src/main/java/org/apache/flink/streaming/connectors/elasticsearch6/Elasticsearch6ApiCallBridge.java#L75] in the api call bridge, and is never exposed to the user.
> To my knowledge, the current Elasticsearch6 connector does not utilize sniffing or provide a way to add it in. The Elasticsearch6 connector should expose some type of access to the RestHighLevelClient to allow for custom sniffing.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)