You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by pw...@apache.org on 2013/12/20 03:12:52 UTC

[8/8] git commit: Merge pull request #272 from tmyklebu/master

Merge pull request #272 from tmyklebu/master

Track and report task result serialisation time.

 - DirectTaskResult now has a ByteBuffer valueBytes instead of a T value.
 - DirectTaskResult now has a member function T value() that deserialises valueBytes.
 - Executor serialises value into a ByteBuffer and passes it to DTR's ctor.
 - Executor tracks the time taken to do so and puts it in a new field in TaskMetrics.
 - StagePage now reports serialisation time from TaskMetrics along with the other things it reported.


Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/eca68d44
Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/eca68d44
Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/eca68d44

Branch: refs/heads/master
Commit: eca68d44253cf4d36e43c58038015a4980f9052e
Parents: 7990c56 d3b1af4
Author: Patrick Wendell <pw...@gmail.com>
Authored: Thu Dec 19 18:12:22 2013 -0800
Committer: Patrick Wendell <pw...@gmail.com>
Committed: Thu Dec 19 18:12:22 2013 -0800

----------------------------------------------------------------------
 .../org/apache/spark/executor/Executor.scala    | 12 ++++++++----
 .../org/apache/spark/executor/TaskMetrics.scala |  5 +++++
 .../org/apache/spark/scheduler/TaskResult.scala | 20 ++++++++++----------
 .../org/apache/spark/ui/jobs/StagePage.scala    | 12 +++++++++++-
 .../cluster/ClusterTaskSetManagerSuite.scala    |  3 ++-
 5 files changed, 36 insertions(+), 16 deletions(-)
----------------------------------------------------------------------