You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "junhaoMg (JIRA)" <ji...@apache.org> on 2015/11/10 10:51:11 UTC
[jira] [Updated] (SPARK-11627) Spark Streaming backpressure mechanism has no initial input rate limit,receivers receive data at the maximum speed , it might cause OOM exception
[ https://issues.apache.org/jira/browse/SPARK-11627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
junhaoMg updated SPARK-11627:
-----------------------------
Summary: Spark Streaming backpressure mechanism has no initial input rate limit,receivers receive data at the maximum speed , it might cause OOM exception (was: Spark Streaming backpressure mechanism has no initial input rate limit,receivers receive data at the maximum speed , it maight cause OOM exception)
> Spark Streaming backpressure mechanism has no initial input rate limit,receivers receive data at the maximum speed , it might cause OOM exception
> --------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-11627
> URL: https://issues.apache.org/jira/browse/SPARK-11627
> Project: Spark
> Issue Type: Bug
> Components: Streaming
> Affects Versions: 1.5.1
> Reporter: junhaoMg
> Original Estimate: 72h
> Remaining Estimate: 72h
>
> Spark Streaming backpressure mechanism has no initial input rate limit, receivers receive data at the maximum speed they can reach in the first batch, the data received might exhaust executors memory resources and cause out of memory exception. Eventually the streaming job would failed, the backpressure mechanism become invalid.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org