You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Rion Williams (Jira)" <ji...@apache.org> on 2021/10/09 19:30:00 UTC
[jira] [Commented] (FLINK-23977) Add Support for Dynamic Elastic
Cluster/Index Routing
[ https://issues.apache.org/jira/browse/FLINK-23977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17426696#comment-17426696 ]
Rion Williams commented on FLINK-23977:
---------------------------------------
Closing per the discussion on the related pull request after some discussion with [~arvid] and [~fabian.paul]; Creating FLINK-24493 to handle that work. If someone can assign it to me, I'll start working on it when I have some time.
> Add Support for Dynamic Elastic Cluster/Index Routing
> -----------------------------------------------------
>
> Key: FLINK-23977
> URL: https://issues.apache.org/jira/browse/FLINK-23977
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / ElasticSearch
> Reporter: Rion Williams
> Assignee: Rion Williams
> Priority: Major
> Labels: elasticsearch, pull-request-available
> Time Spent: 16h
> Remaining Estimate: 0h
>
> Currently only index-level dynamic routing is supported within the Elasticsearch connector, which can be problematic if information such as the host of the cluster (e.g. HttpHosts) is not known until run-time.
> The idea behind this ticket would be to implement a wrapper that would allow Elasticsearch sink instances to be created at run time and stored within an in-memory cache (i.e. HashMap) using a key-value association where the key represents a deterministically unique "route" and the value is the sink to which all items with a given key are written.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)