You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Tathagata Das (JIRA)" <ji...@apache.org> on 2015/08/14 08:52:46 UTC

[jira] [Created] (SPARK-9968) BlockGenerator lock structure can cause lock starvation of the block updating thread

Tathagata Das created SPARK-9968:
------------------------------------

             Summary: BlockGenerator lock structure can cause lock starvation of the block updating thread
                 Key: SPARK-9968
                 URL: https://issues.apache.org/jira/browse/SPARK-9968
             Project: Spark
          Issue Type: Sub-task
            Reporter: Tathagata Das
            Assignee: Tathagata Das


When the rate limiter is actually limiting the rate at which data is inserted into the buffer, the synchronized block of BlockGenerator.addData stays blocked for long time. This causes the thread switching the buffer and generating blocks (synchronized with addData) to starve and not generate blocks for seconds. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org