You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Wenchen Fan (Jira)" <ji...@apache.org> on 2025/08/27 15:23:00 UTC

[jira] [Resolved] (SPARK-52777) Enable shuffle cleanup mode configuration in Spark SQL

     [ https://issues.apache.org/jira/browse/SPARK-52777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wenchen Fan resolved SPARK-52777.
---------------------------------
    Fix Version/s: 4.1.0
       Resolution: Fixed

Issue resolved by pull request 51458
[https://github.com/apache/spark/pull/51458]

> Enable shuffle cleanup mode configuration in Spark SQL
> ------------------------------------------------------
>
>                 Key: SPARK-52777
>                 URL: https://issues.apache.org/jira/browse/SPARK-52777
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 4.0.0
>            Reporter: Karuppayya
>            Assignee: Karuppayya
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.1.0
>
>
> Currently, shuffle cleanup mode configuration only works in Spark Connect but is ignored in regular Spark SQL execution. This creates an inconsistency where users can control shuffle cleanup behavior in Spark Connect but not in standard Spark SQL operations.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org