You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Eric Yang (Jira)" <ji...@apache.org> on 2026/04/13 22:37:00 UTC

[jira] [Created] (SPARK-56462) MERGE INTO schema evolution fails with UPDATE * / INSERT * when source has column names containing dots

Eric Yang created SPARK-56462:
---------------------------------

             Summary: MERGE INTO schema evolution fails with UPDATE * / INSERT * when source has column names containing dots
                 Key: SPARK-56462
                 URL: https://issues.apache.org/jira/browse/SPARK-56462
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 4.1.1
            Reporter: Eric Yang


When schemaEvolutionEnabled = true and a star action (UPDATE * or INSERT *) encounters a source column whose name contains a dot (e.g. `a.b`) that doesn't exist in the target, Analyzer.scala constructs UnresolvedAttribute(sourceAttr.name) using the apply() method. This parses "a.b" into nameParts = Seq("a", "b"), whereas the source AttributeReference returns Seq("a.b") via extractFieldPath. The resulting keyPath != valuePath mismatch causes isSchemaEvolutionCandidate to return false, blocking the schema evolution path entirely and producing an UNRESOLVED_COLUMN analysis error instead of adding the new column.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org