You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by pw...@apache.org on 2013/12/20 03:12:52 UTC
[8/8] git commit: Merge pull request #272 from tmyklebu/master
Merge pull request #272 from tmyklebu/master
Track and report task result serialisation time.
- DirectTaskResult now has a ByteBuffer valueBytes instead of a T value.
- DirectTaskResult now has a member function T value() that deserialises valueBytes.
- Executor serialises value into a ByteBuffer and passes it to DTR's ctor.
- Executor tracks the time taken to do so and puts it in a new field in TaskMetrics.
- StagePage now reports serialisation time from TaskMetrics along with the other things it reported.
Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/eca68d44
Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/eca68d44
Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/eca68d44
Branch: refs/heads/master
Commit: eca68d44253cf4d36e43c58038015a4980f9052e
Parents: 7990c56 d3b1af4
Author: Patrick Wendell <pw...@gmail.com>
Authored: Thu Dec 19 18:12:22 2013 -0800
Committer: Patrick Wendell <pw...@gmail.com>
Committed: Thu Dec 19 18:12:22 2013 -0800
----------------------------------------------------------------------
.../org/apache/spark/executor/Executor.scala | 12 ++++++++----
.../org/apache/spark/executor/TaskMetrics.scala | 5 +++++
.../org/apache/spark/scheduler/TaskResult.scala | 20 ++++++++++----------
.../org/apache/spark/ui/jobs/StagePage.scala | 12 +++++++++++-
.../cluster/ClusterTaskSetManagerSuite.scala | 3 ++-
5 files changed, 36 insertions(+), 16 deletions(-)
----------------------------------------------------------------------