You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by an...@apache.org on 2015/05/15 01:56:35 UTC

spark git commit: [SPARK-7643] [UI] use the correct size in RDDPage for storage info and partitions

Repository: spark
Updated Branches:
  refs/heads/master 93dbb3ad8 -> 57ed16cf9


[SPARK-7643] [UI] use the correct size in RDDPage for storage info and partitions

`dataDistribution` and `partitions` are `Option[Seq[_]]`. andrewor14 squito

Author: Xiangrui Meng <me...@databricks.com>

Closes #6157 from mengxr/SPARK-7643 and squashes the following commits:

99fe8a4 [Xiangrui Meng] use the correct size in RDDPage for storage info and partitions


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/57ed16cf
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/57ed16cf
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/57ed16cf

Branch: refs/heads/master
Commit: 57ed16cf9372c109e84bd51b728f2c82940949a7
Parents: 93dbb3a
Author: Xiangrui Meng <me...@databricks.com>
Authored: Thu May 14 16:56:32 2015 -0700
Committer: Andrew Or <an...@databricks.com>
Committed: Thu May 14 16:56:32 2015 -0700

----------------------------------------------------------------------
 core/src/main/scala/org/apache/spark/ui/storage/RDDPage.scala | 7 +++++--
 1 file changed, 5 insertions(+), 2 deletions(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/spark/blob/57ed16cf/core/src/main/scala/org/apache/spark/ui/storage/RDDPage.scala
----------------------------------------------------------------------
diff --git a/core/src/main/scala/org/apache/spark/ui/storage/RDDPage.scala b/core/src/main/scala/org/apache/spark/ui/storage/RDDPage.scala
index 05f94a7..fbce917 100644
--- a/core/src/main/scala/org/apache/spark/ui/storage/RDDPage.scala
+++ b/core/src/main/scala/org/apache/spark/ui/storage/RDDPage.scala
@@ -77,14 +77,17 @@ private[ui] class RDDPage(parent: StorageTab) extends WebUIPage("rdd") {
 
       <div class="row-fluid">
         <div class="span12">
-          <h4> Data Distribution on {rddStorageInfo.dataDistribution.size} Executors </h4>
+          <h4>
+            Data Distribution on {rddStorageInfo.dataDistribution.map(_.size).getOrElse(0)}
+            Executors
+          </h4>
           {workerTable}
         </div>
       </div>
 
       <div class="row-fluid">
         <div class="span12">
-          <h4> {rddStorageInfo.partitions.size} Partitions </h4>
+          <h4> {rddStorageInfo.partitions.map(_.size).getOrElse(0)} Partitions </h4>
           {blockTable}
         </div>
       </div>;


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org