You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/05/21 04:35:31 UTC
[jira] [Resolved] (SPARK-18095) There is a display problem in spark
UI storage tab when rdd was persisted in multiple replicas
[ https://issues.apache.org/jira/browse/SPARK-18095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon resolved SPARK-18095.
----------------------------------
Resolution: Incomplete
> There is a display problem in spark UI storage tab when rdd was persisted in multiple replicas
> ----------------------------------------------------------------------------------------------
>
> Key: SPARK-18095
> URL: https://issues.apache.org/jira/browse/SPARK-18095
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.1.0
> Reporter: Weichen Xu
> Priority: Major
> Labels: bulk-closed
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> There is a display problem in spark UI storage tab when rdd was persisted in multiple replicas.
> e.g, if we use MEMORY_AND_DISK_2, it will show the persisting status as:
> || Block Name || Storage Level || Size in Memory|| Size on Disk|| Executors ||
> |rdd_1_0|Memory Deserialized 1x Replicated|176.0B|0.0B|hadoop2:48622 hadoop0:47393|
> |rdd_1_0|Memory Deserialized 2x Replicated|176.0B|0.0B|hadoop2:48622 hadoop0:47393|
> |rdd_1_1|Memory Deserialized 1x Replicated|176.0B|0.0B|hadoop2:48622 hadoop2:34284|
> |rdd_1_1|Memory Deserialized 2x Replicated|176.0B|0.0B|hadoop2:48622 hadoop2:34284|
> and there are some duplicated items in the displayed table, and the storage level column 1x and 2x replicas both exists will cause user confusing.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org