You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "sachin aggarwal (JIRA)" <ji...@apache.org> on 2016/02/03 05:59:39 UTC

[jira] [Commented] (SPARK-13069) ActorHelper is not throttled by rate limiter

    [ https://issues.apache.org/jira/browse/SPARK-13069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15129787#comment-15129787 ] 

sachin aggarwal commented on SPARK-13069:
-----------------------------------------

As of Spark 2.0 (not yet released), Spark does not use Akka any more. 

See https://issues.apache.org/jira/browse/SPARK-5293

can you check with latest 2.0 build, to see if similar problem exists.


> ActorHelper is not throttled by rate limiter
> --------------------------------------------
>
>                 Key: SPARK-13069
>                 URL: https://issues.apache.org/jira/browse/SPARK-13069
>             Project: Spark
>          Issue Type: Bug
>          Components: Streaming
>    Affects Versions: 1.6.0
>            Reporter: Lin Zhao
>
> The rate an actor receiver sends data to spark is not limited by maxRate or back pressure. Spark would control how fast it writes the data to block manager, but the receiver actor sends events asynchronously and would fill out akka mailbox with millions of events until memory runs out.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org