[jira] [Commented] (SPARK-28352) Spark UI shows RDD blocks as 0 in some executor metrics

["Burak KÖSE (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-28352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885208#comment-16885208 ] 

Burak KÖSE commented on SPARK-28352:
------------------------------------

I don't think I can show the code because there are more than 10k lines code running on production. I can try to elaborate more about the issue. This is a cluster running on more than 20TB memory. Everything is working flawlessly on 2.2.1. Once we migrated the application to 2.4.1, UI is not precisely showing the correct information. 

 

Currently following metrics are completely broken; executor memory usage, failed tasks, rdd blocks.

We though it might have been because of `spark.scheduler.listenerbus.eventqueue.capacity` setting, and set it to 70k. No solution for now. 


It is running on Mesos 1.7.2. It is a spark streaming application with custom receivers.

> Spark UI shows RDD blocks as 0 in some executor metrics
> -------------------------------------------------------
>
>                 Key: SPARK-28352
>                 URL: https://issues.apache.org/jira/browse/SPARK-28352
>             Project: Spark
>          Issue Type: Bug
>          Components: Web UI
>    Affects Versions: 2.4.1
>            Reporter: Burak KÖSE
>            Priority: Minor
>         Attachments: executor_page.png, executor_summary.png, storage_page.png
>
>
> We have recently migrated our application from 2.2.1 to 2.4.1. We have realized that Spark UI is missing some critical information or shows wrong ones.
> We have a big cluster, with 80+ executors. It is Spark Streaming with customer receivers. On Spark UI in storage tab, we can see memory blocks and their size. This page shows correct information that we can see on Ganglia and host level monitors. However, in executor tab, `RDD blocks` shows `0` while we have thousands of them in memory. Moreover, `Storage Memory` shows incorrect numbers.
>  



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org