Sink Multiple Stream Elastic search

[shashank734 <sh...@gmail.com>]

Hello,

I am using Elastic search5 Connector. Can I use same connection while
sinking multiple streams to Elastic search? Currently, I think it creates a
different transport connection for each sink. I think it's creating a lot of
connections with the cluster. Cause I am sinking 5-6 streams. 




--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Sink Multiple Stream Elastic search

[Timo Walther <tw...@apache.org>]

Hi,

I'm not aware that multiple Flink operators can share transport 
connections. They usually perform independent communication with the 
target system. If the pressure is too high for Elasticsearch, have you 
thought about reducing the parallelism of the sink. Also the buffering 
options could help [1].

Regards,
Timo

[1] 
https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/connectors/elasticsearch.html#configuring-the-internal-bulk-processor

Am 02.08.18 um 13:51 schrieb shashank734:
> Hello,
>
> I am using Elastic search5 Connector. Can I use same connection while
> sinking multiple streams to Elastic search? Currently, I think it creates a
> different transport connection for each sink. I think it's creating a lot of
> connections with the cluster. Cause I am sinking 5-6 streams.
>
>
>
>
> --
> Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/