You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Marcelo Vanzin (JIRA)" <ji...@apache.org> on 2019/03/05 18:43:00 UTC

[jira] [Resolved] (SPARK-27012) Storage tab shows rdd details even after executor ended

     [ https://issues.apache.org/jira/browse/SPARK-27012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Marcelo Vanzin resolved SPARK-27012.
------------------------------------
       Resolution: Fixed
         Assignee: Ajith S
    Fix Version/s: 3.0.0

> Storage tab shows rdd details even after executor ended
> -------------------------------------------------------
>
>                 Key: SPARK-27012
>                 URL: https://issues.apache.org/jira/browse/SPARK-27012
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core, Web UI
>    Affects Versions: 2.3.3, 3.0.0
>            Reporter: Ajith S
>            Assignee: Ajith S
>            Priority: Major
>             Fix For: 3.0.0
>
>
>  
> After we cache a table, we can see its details in Storage Tab of spark UI. If the executor has shutdown ( graceful shutdown/ Dynamic executor scenario) UI still shows the rdd as cached and when we click the link it throws error. This is because on executor remove event, we fail to adjust rdd partition details.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org