You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Greg Hogan (JIRA)" <ji...@apache.org> on 2017/02/03 19:34:01 UTC
[jira] [Closed] (FLINK-2319) Collect size limitation due to akka.
[ https://issues.apache.org/jira/browse/FLINK-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Greg Hogan closed FLINK-2319.
-----------------------------
Resolution: Fixed
FLINK-4399 describes a general solution.
> Collect size limitation due to akka.
> ------------------------------------
>
> Key: FLINK-2319
> URL: https://issues.apache.org/jira/browse/FLINK-2319
> Project: Flink
> Issue Type: Bug
> Components: Distributed Coordination, JobManager
> Affects Versions: 0.10.0
> Reporter: Kostas Kloudas
>
> Each TaksManager keeps the results of a local task in a set of Accumulators. Upon termination of the task, the Accumulators are sent back to the JobManager, who merges them, before sending them back to the Client.
> To exchange the Accumulators and their content, akka is used. This limits the size of the output of a task to no more than akka.framesize bytes. In other case, akka would drop the message.
> This ticket is to propose the removal of this limitation so that results can be of arbitrary size.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)