You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Greg Hogan (JIRA)" <ji...@apache.org> on 2017/02/03 19:34:01 UTC

[jira] [Closed] (FLINK-2319) Collect size limitation due to akka.

     [ https://issues.apache.org/jira/browse/FLINK-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Greg Hogan closed FLINK-2319.
-----------------------------
    Resolution: Fixed

FLINK-4399 describes a general solution.

> Collect size limitation due to akka.
> ------------------------------------
>
>                 Key: FLINK-2319
>                 URL: https://issues.apache.org/jira/browse/FLINK-2319
>             Project: Flink
>          Issue Type: Bug
>          Components: Distributed Coordination, JobManager
>    Affects Versions: 0.10.0
>            Reporter: Kostas Kloudas
>
> Each TaksManager keeps the results of a local task in a set of Accumulators. Upon termination of the task, the Accumulators are sent back to the JobManager, who merges them, before sending them back to the Client. 
> To exchange the Accumulators and their content, akka is used. This limits the size of the output of a task to no more than akka.framesize bytes. In other case, akka would drop the message.
> This ticket is to propose the removal of this limitation so that results can be of arbitrary size.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)