[jira] [Commented] (FLINK-4377) akka.remote.OversizedPayloadException: Discarding oversized payload

["Stephan Ewen (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-4377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15417338#comment-15417338 ] 

Stephan Ewen commented on FLINK-4377:
-------------------------------------

Yes, this can currently happen. The only way to immediately solve this is to increase the akka maximum frame size.

We are prototyping a new RPC abstraction on top of Akka, which will be a good point to solve this problem.

> akka.remote.OversizedPayloadException: Discarding oversized payload
> -------------------------------------------------------------------
>
>                 Key: FLINK-4377
>                 URL: https://issues.apache.org/jira/browse/FLINK-4377
>             Project: Flink
>          Issue Type: Bug
>          Components: DataSet API
>    Affects Versions: 1.1.0
>         Environment: Linux
>            Reporter: Sajeev Ramakrishnan
>
> Dear Team,
>   I was trying to create a hash map with a size around 1 million. Then I encountered the below issue. For smaller maps, I am not seeing any issues.
> akka.remote.OversizedPayloadException: Discarding oversized payload sent to Actor[akka.tcp://flink@localhost:58247/user/$d#458673459]: max allowed size 10485760 bytes, actual size of encoded class org.apache.flink.runtime.messages.JobManagerMessages$JobResultSuccess was 175254213 bytes.
> Regards,
> Sajeev



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)