You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by Anchit Jatana <de...@gmail.com> on 2016/09/30 06:13:58 UTC

How to Broadcast a very large model object (used in iterative scoring in recommendation system) in Flink

Hi All,

I'm building a recommendation system streaming application for which I need
to broadcast a very large model object (used in iterative scoring) among
all the task managers performing the operation parallely for the operator

I'm doing an this operation in map1 of CoMapFunction. Please suggest me
some way to achieve the broadcasting of the large model variable (something
similar to what Spark has with broadcast variables).

Thank you

Regards,
Anchit