You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/05/21 05:35:30 UTC

[jira] [Updated] (SPARK-3957) Broadcast variable memory usage not reflected in UI

     [ https://issues.apache.org/jira/browse/SPARK-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon updated SPARK-3957:
--------------------------------
    Labels: bulk-closed  (was: )

> Broadcast variable memory usage not reflected in UI
> ---------------------------------------------------
>
>                 Key: SPARK-3957
>                 URL: https://issues.apache.org/jira/browse/SPARK-3957
>             Project: Spark
>          Issue Type: Bug
>          Components: Block Manager, Web UI
>    Affects Versions: 1.0.2, 1.1.0
>            Reporter: Shivaram Venkataraman
>            Assignee: Nan Zhu
>            Priority: Major
>              Labels: bulk-closed
>
> Memory used by broadcast variables are not reflected in the memory usage reported in the WebUI. For example, the executors tab shows memory used in each executor but this number doesn't include memory used by broadcast variables. Similarly the storage tab only shows list of rdds cached and how much memory they use.  
> We should add a separate column / tab for broadcast variables to make it easier to debug.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org