You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Konstantin Knauf (Jira)" <ji...@apache.org> on 2021/07/29 07:37:14 UTC

[jira] [Updated] (FLINK-5305) Documentation of collect() should mention parameter akka.framesize

     [ https://issues.apache.org/jira/browse/FLINK-5305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Konstantin Knauf updated FLINK-5305:
------------------------------------
      Labels:   (was: auto-closed)
    Priority: Not a Priority  (was: Minor)

> Documentation of collect() should mention parameter akka.framesize
> ------------------------------------------------------------------
>
>                 Key: FLINK-5305
>                 URL: https://issues.apache.org/jira/browse/FLINK-5305
>             Project: Flink
>          Issue Type: Improvement
>          Components: API / DataSet, Documentation
>    Affects Versions: 1.1.3
>            Reporter: Arnaud Linz
>            Priority: Not a Priority
>
> When calling collect() on a big dataset, if the data size exceeds the value of akka.framesize, which is 10Mb by default, the collect() freezes and some "akka payload size exceeded" logs appear in the yarn logs (but neither in the flink console output nor UI logs).
> 10Mb is not that big, and its relation to akka.framesize is hard to find in the documentation (in Flink internals section). I believe that the "easy to find" collect documentation should mention this parameter to save hours of users time.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)