You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Rion Williams (Jira)" <ji...@apache.org> on 2021/08/25 19:03:00 UTC

[jira] [Created] (FLINK-23977) Add Support for Dynamic Elastic Index Routing

Rion Williams created FLINK-23977:
-------------------------------------

             Summary: Add Support for Dynamic Elastic Index Routing
                 Key: FLINK-23977
                 URL: https://issues.apache.org/jira/browse/FLINK-23977
             Project: Flink
          Issue Type: Improvement
          Components: Connectors / ElasticSearch
            Reporter: Rion Williams


Currently only index-level dynamic routing is supported within the Elasticsearch connector, which can be problematic if information such as the host of the cluster (e.g. HttpHosts) is not known until run-time. 

The idea behind this ticket would be to implement a wrapper that would allow Elasticsearch sink instances to be created at run time and stored within an in-memory cache (i.e. HashMap) using a key-value association where the key represents a deterministically unique "route" and the value is the sink to which all items with a given key are written.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)