You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Reynold Xin (JIRA)" <ji...@apache.org> on 2014/08/19 22:33:18 UTC

[jira] [Created] (SPARK-3137) Use finer grained locking in TorrentBroadcast.readObject

Reynold Xin created SPARK-3137:
----------------------------------

             Summary: Use finer grained locking in TorrentBroadcast.readObject
                 Key: SPARK-3137
                 URL: https://issues.apache.org/jira/browse/SPARK-3137
             Project: Spark
          Issue Type: Sub-task
            Reporter: Reynold Xin


TorrentBroadcast.readObject uses a global lock so only one task can be fetching the blocks at the same time.

This is not optimal if we are running multiple stages concurrently because they should be able to independently fetch their own blocks.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org