You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Kostas (JIRA)" <ji...@apache.org> on 2015/07/05 19:53:05 UTC

[jira] [Created] (FLINK-2319) Collect size limitation due to akka.

Kostas created FLINK-2319:
-----------------------------

             Summary: Collect size limitation due to akka.
                 Key: FLINK-2319
                 URL: https://issues.apache.org/jira/browse/FLINK-2319
             Project: Flink
          Issue Type: New Feature
          Components: JobManager, TaskManager
    Affects Versions: 0.10
            Reporter: Kostas


Each TaksManager keeps the results of a local task in a set of Accumulators. Upon termination of the task, the Accumulators are sent back to the JobManager, who merges them, before sending them back to the Client. 

To exchange the Accumulators and their content, akka is used. This limits the size of the output of a task to no more than akka.framesize bytes. In other case, akka would drop the message.

This ticket is to propose the removal of this limitation so that results can be of arbitrary size.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)