You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2019/02/28 13:15:00 UTC

[jira] [Assigned] (SPARK-27012) Storage tab shows rdd details even after executor ended

     [ https://issues.apache.org/jira/browse/SPARK-27012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apache Spark reassigned SPARK-27012:
------------------------------------

    Assignee: Apache Spark

> Storage tab shows rdd details even after executor ended
> -------------------------------------------------------
>
>                 Key: SPARK-27012
>                 URL: https://issues.apache.org/jira/browse/SPARK-27012
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core, Web UI
>    Affects Versions: 2.3.3, 3.0.0
>            Reporter: Ajith S
>            Assignee: Apache Spark
>            Priority: Major
>
>  
> After we cache a table, we can see its details in Storage Tab of spark UI. If the executor has shutdown ( graceful shutdown/ Dynamic executor scenario) UI still shows the rdd as cached and when we click the link it throws error. This is because on executor remove event, we fail to adjust rdd partition details.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org