You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ch...@apache.org on 2026/06/12 03:29:04 UTC

(spark) branch master updated: [SPARK-56903][SQL][FOLLOWUP] Fix null join key shuffle config version

This is an automated email from the ASF dual-hosted git repository.

pan3793 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/master by this push:
     new 3d4c8b0ce633 [SPARK-56903][SQL][FOLLOWUP] Fix null join key shuffle config version
3d4c8b0ce633 is described below

commit 3d4c8b0ce633cc95a3a7f35c28bf746d2698e9c5
Author: Chao Sun <su...@apache.org>
AuthorDate: Fri Jun 12 11:28:53 2026 +0800

    [SPARK-56903][SQL][FOLLOWUP] Fix null join key shuffle config version
    
    ## Why are the changes needed?
    
    `spark.sql.shuffle.spreadNullJoinKeys.enabled` was introduced on the Spark 4.3 development line, but its configuration metadata incorrectly says that it was introduced in Spark 4.1.0.
    
    This follow-up addresses the review comment on apache/spark#55927 so the documented version matches the first Spark release that contains the configuration.
    
    ## What changes were proposed in this PR?
    
    Update the configuration's `version` metadata from `4.1.0` to `4.3.0`.
    
    ## How was this PR tested?
    
    - Ran `git diff --check`.
    - No runtime tests were added because this change only corrects configuration metadata and does not affect behavior.
    
    Closes #56462 from sunchao/dev/chao/codex/spark-56903-config-version.
    
    Authored-by: Chao Sun <su...@apache.org>
    Signed-off-by: Cheng Pan <ch...@apache.org>
---
 sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala b/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
index 971eddf7bef9..4ea181330acb 100644
--- a/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
+++ b/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
@@ -1007,7 +1007,7 @@ object SQLConf {
         "equi-joins may require an extra shuffle. If one input is already hash partitioned, " +
         "only the other input may be reshuffled into the null-aware layout, so the pre-shuffled " +
         "input can keep its NULL skew.")
-      .version("4.1.0")
+      .version("4.3.0")
       .withBindingPolicy(ConfigBindingPolicy.SESSION)
       .booleanConf
       .createWithDefault(false)


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org