You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ch...@apache.org on 2026/06/12 03:29:04 UTC
(spark) branch master updated: [SPARK-56903][SQL][FOLLOWUP] Fix null join key shuffle config version
This is an automated email from the ASF dual-hosted git repository.
pan3793 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 3d4c8b0ce633 [SPARK-56903][SQL][FOLLOWUP] Fix null join key shuffle config version
3d4c8b0ce633 is described below
commit 3d4c8b0ce633cc95a3a7f35c28bf746d2698e9c5
Author: Chao Sun <su...@apache.org>
AuthorDate: Fri Jun 12 11:28:53 2026 +0800
[SPARK-56903][SQL][FOLLOWUP] Fix null join key shuffle config version
## Why are the changes needed?
`spark.sql.shuffle.spreadNullJoinKeys.enabled` was introduced on the Spark 4.3 development line, but its configuration metadata incorrectly says that it was introduced in Spark 4.1.0.
This follow-up addresses the review comment on apache/spark#55927 so the documented version matches the first Spark release that contains the configuration.
## What changes were proposed in this PR?
Update the configuration's `version` metadata from `4.1.0` to `4.3.0`.
## How was this PR tested?
- Ran `git diff --check`.
- No runtime tests were added because this change only corrects configuration metadata and does not affect behavior.
Closes #56462 from sunchao/dev/chao/codex/spark-56903-config-version.
Authored-by: Chao Sun <su...@apache.org>
Signed-off-by: Cheng Pan <ch...@apache.org>
---
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala b/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
index 971eddf7bef9..4ea181330acb 100644
--- a/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
+++ b/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
@@ -1007,7 +1007,7 @@ object SQLConf {
"equi-joins may require an extra shuffle. If one input is already hash partitioned, " +
"only the other input may be reshuffled into the null-aware layout, so the pre-shuffled " +
"input can keep its NULL skew.")
- .version("4.1.0")
+ .version("4.3.0")
.withBindingPolicy(ConfigBindingPolicy.SESSION)
.booleanConf
.createWithDefault(false)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org