You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by pw...@apache.org on 2014/01/14 07:32:49 UTC
[7/7] git commit: Merge pull request #401 from andrewor14/master
Merge pull request #401 from andrewor14/master
External sorting - Add number of bytes spilled to Web UI
Additionally, update test suite for external sorting to induce spilling.
Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/0ca0d4d6
Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/0ca0d4d6
Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/0ca0d4d6
Branch: refs/heads/master
Commit: 0ca0d4d657f4db519187cc27546104b38c38917f
Parents: 08b9fec 8399341
Author: Patrick Wendell <pw...@gmail.com>
Authored: Mon Jan 13 22:32:21 2014 -0800
Committer: Patrick Wendell <pw...@gmail.com>
Committed: Mon Jan 13 22:32:21 2014 -0800
----------------------------------------------------------------------
.../scala/org/apache/spark/Aggregator.scala | 12 ++-
.../org/apache/spark/executor/Executor.scala | 2 +-
.../org/apache/spark/executor/TaskMetrics.scala | 10 +++
.../org/apache/spark/rdd/CoGroupedRDD.scala | 3 +
.../org/apache/spark/rdd/PairRDDFunctions.scala | 10 ++-
.../apache/spark/ui/jobs/ExecutorSummary.scala | 2 +
.../apache/spark/ui/jobs/ExecutorTable.scala | 4 +
.../spark/ui/jobs/JobProgressListener.scala | 14 ++++
.../org/apache/spark/ui/jobs/StagePage.scala | 53 +++++++++++++-
.../util/collection/ExternalAppendOnlyMap.scala | 11 ++-
.../collection/ExternalAppendOnlyMapSuite.scala | 77 +++++++++++---------
11 files changed, 151 insertions(+), 47 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/0ca0d4d6/core/src/main/scala/org/apache/spark/executor/Executor.scala
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/0ca0d4d6/core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala
----------------------------------------------------------------------