You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Deependra Patel (Jira)" <ji...@apache.org> on 2023/08/07 12:25:00 UTC

[jira] [Commented] (SPARK-44704) Cleanup shuffle files from host node after migration due to graceful decommissioning

    [ https://issues.apache.org/jira/browse/SPARK-44704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17751654#comment-17751654 ] 

Deependra Patel commented on SPARK-44704:
-----------------------------------------

I will create for this soon.

> Cleanup shuffle files from host node after migration due to graceful decommissioning
> ------------------------------------------------------------------------------------
>
>                 Key: SPARK-44704
>                 URL: https://issues.apache.org/jira/browse/SPARK-44704
>             Project: Spark
>          Issue Type: Improvement
>          Components: Block Manager
>    Affects Versions: 3.4.1
>            Reporter: Deependra Patel
>            Priority: Minor
>
> Although these files will be deleted at the end of the application by the external shuffle service, doing this early can free up resources and can help in long running applications running out of disk space.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org