RE: EXT :Flink solution for having shared variable between task managers

["Martin, Nick J [US] (IS)" <Ni...@ngc.com>]

I think you’re looking for Broadcast State. Here’s a detailed guide.

https://flink.apache.org/2019/06/26/broadcast-state.html

From: Soheil Pourbafrani [mailto:soheil.ir08@gmail.com]
Sent: Friday, January 17, 2020 6:50 AM
To: user <us...@flink.apache.org>
Subject: EXT :Flink solution for having shared variable between task managers

Hi,

According to the processing logic, I need to have a HashMap variable that should be shared between the taskmanagers. The scenario is the HashMap data will be continuously updated according to the incoming stream of data.

What I observed is declaring the HashMap variable as a class attribute, it will be shared among a single taskmanagers slots, but in case I have multiple taskmanager, each will have a separate HashMap instance.

What is the standard way to achieve this? Does Flink provide any utility for that?