You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/07/15 06:09:00 UTC
[jira] [Commented] (SPARK-28352) Spark UI misses some executor
metrics
[ https://issues.apache.org/jira/browse/SPARK-28352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16884875#comment-16884875 ]
Hyukjin Kwon commented on SPARK-28352:
--------------------------------------
Can you show the codes you run so that people can investigate the issue and fix?
> Spark UI misses some executor metrics
> -------------------------------------
>
> Key: SPARK-28352
> URL: https://issues.apache.org/jira/browse/SPARK-28352
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 2.4.1
> Reporter: Burak KÖSE
> Priority: Minor
> Attachments: executor_page.png, executor_summary.png, storage_page.png
>
>
> We have recently migrated our application from 2.2.1 to 2.4.1. We have realized that Spark UI is missing some critical information or shows wrong ones.
> We have a big cluster, with 80+ executors. It is Spark Streaming with customer receivers. On Spark UI in storage tab, we can see memory blocks and their size. This page shows correct information that we can see on Ganglia and host level monitors. However, in executor tab, `RDD blocks` shows `0` while we have thousands of them in memory. Moreover, `Storage Memory` shows incorrect numbers.
>
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org