You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "David C Navas (JIRA)" <ji...@apache.org> on 2019/05/15 18:35:00 UTC

[jira] [Updated] (SPARK-27729) Extract deletion of the summaries from the stage deletion loop

     [ https://issues.apache.org/jira/browse/SPARK-27729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

David C Navas updated SPARK-27729:
----------------------------------
    Attachment: ExtractDeletes.pdf

> Extract deletion of the summaries from the stage deletion loop
> --------------------------------------------------------------
>
>                 Key: SPARK-27729
>                 URL: https://issues.apache.org/jira/browse/SPARK-27729
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Spark Core
>    Affects Versions: 2.3.3
>            Reporter: David C Navas
>            Priority: Major
>         Attachments: ExtractDeletes.pdf
>
>
> Like the Task deletion, Summary deletion can also be expensive when there are many active stages (and thus even more summaries).  Extract summary deletion in the same way that Task is.  The attachment also describes this, and hints at the next subtask....



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org