You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Ajith S (JIRA)" <ji...@apache.org> on 2019/02/28 13:15:00 UTC

[jira] [Commented] (SPARK-27012) Storage tab shows rdd details even after executor ended

    [ https://issues.apache.org/jira/browse/SPARK-27012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16780498#comment-16780498 ] 

Ajith S commented on SPARK-27012:
---------------------------------

I will be working on this

> Storage tab shows rdd details even after executor ended
> -------------------------------------------------------
>
>                 Key: SPARK-27012
>                 URL: https://issues.apache.org/jira/browse/SPARK-27012
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core, Web UI
>    Affects Versions: 2.3.3, 3.0.0
>            Reporter: Ajith S
>            Priority: Major
>
>  
> After we cache a table, we can see its details in Storage Tab of spark UI. If the executor has shutdown ( graceful shutdown/ Dynamic executor scenario) UI still shows the rdd as cached and when we click the link it throws error. This is because on executor remove event, we fail to adjust rdd partition details.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org