You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by rx...@apache.org on 2013/12/19 07:22:35 UTC
[2/2] git commit: Merge pull request #247 from aarondav/minor
Merge pull request #247 from aarondav/minor
Increase spark.akka.askTimeout default to 30 seconds
In experimental clusters we've observed that a 10 second timeout was insufficient, despite having a low number of nodes and relatively small workload (16 nodes, <1.5 TB data). This would cause an entire job to fail at the beginning of the reduce phase.
There is no particular reason for this value to be small as a timeout should only occur in an exceptional situation.
Also centralized the reading of spark.akka.askTimeout to AkkaUtils (surely this can later be cleaned up to use Typesafe).
Finally, deleted some lurking implicits. If anyone can think of a reason they should still be there, please let me know.
Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/bfba5323
Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/bfba5323
Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/bfba5323
Branch: refs/heads/master
Commit: bfba5323bedca3aa021e3cd9267d88379e767a92
Parents: c64a53a 293a0af
Author: Reynold Xin <rx...@apache.org>
Authored: Wed Dec 18 22:22:21 2013 -0800
Committer: Reynold Xin <rx...@apache.org>
Committed: Wed Dec 18 22:22:21 2013 -0800
----------------------------------------------------------------------
.../scala/org/apache/spark/MapOutputTracker.scala | 5 ++---
.../org/apache/spark/deploy/client/Client.scala | 6 +++---
.../org/apache/spark/deploy/master/Master.scala | 17 ++++++-----------
.../spark/deploy/master/ui/ApplicationPage.scala | 14 +++++---------
.../apache/spark/deploy/master/ui/IndexPage.scala | 16 ++++++----------
.../spark/deploy/master/ui/MasterWebUI.scala | 10 +++-------
.../apache/spark/deploy/worker/ui/IndexPage.scala | 4 ++--
.../spark/deploy/worker/ui/WorkerWebUI.scala | 10 +++-------
.../cluster/CoarseGrainedSchedulerBackend.scala | 10 ++++------
.../apache/spark/storage/BlockManagerMaster.scala | 7 ++++---
.../spark/storage/BlockManagerMasterActor.scala | 11 ++++-------
.../apache/spark/ui/storage/BlockManagerUI.scala | 3 ---
.../scala/org/apache/spark/util/AkkaUtils.scala | 6 ++++++
13 files changed, 48 insertions(+), 71 deletions(-)
----------------------------------------------------------------------