You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by zhen li <li...@hotmail.com> on 2018/08/29 10:25:03 UTC

share the big data structure between slots

Hi all:
    When I broadcast the big config stream,every parallel instance should store the data, cause waste of the momery and time. Is there some method to make the slots to share the big data structure within the taskmanager?
Here is the doc:
   By adjusting the number of task slots, users can define how subtasks are isolated from each other. Having one slot per TaskManager means each task group runs in a separate JVM (which can be started in a separate container, for example). Having multiple slots means more subtasks share the same JVM. Tasks in the same JVM share TCP connections (via multiplexing) and heartbeat messages. They may also share data sets and data structures, thus reducing the per-task overhead.