[jira] [Updated] (SPARK-39783) Wrong column backticks in UNRESOLVED_COLUMN error

["Enrico Minack (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-39783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Enrico Minack updated SPARK-39783:
----------------------------------
    Description: 
The following code references a nested value {{{}`the`.`id`{}}}, that does not exist. The proposed / existing column names are not correctly wrapped in backticks:
{code:scala}
Seq((0)).toDF("the.id")
  .select("the.id").show()

org.apache.spark.sql.AnalysisException: [UNRESOLVED_COLUMN] A column or function parameter with name `the`.`id` cannot be resolved. Did you mean one of the following? [`the`.`id`];
{code}
Instead of {{{}[`the`.`id`]{}}}, you would expect {{{}[`the.id`]{}}}.

Here an example where the nested column exists:
{code:scala}
spark.range(1).select(struct("id").as("the"))
  .select("the.id").show()

+---+
| id|
+---+
|  0|
+---+
{code}

  was:
The following code references a column {{`the`.`id`}}, that does not exist. The proposed / existing column names are not correctly wrapped in backticks:

{code}
Seq((1)).toDF("the.id").select("the.id").show()
org.apache.spark.sql.AnalysisException: [UNRESOLVED_COLUMN] A column or function parameter with name `the`.`id` cannot be resolved. Did you mean one of the following? [`the`.`id`];
{code}

Instead of {{[`the`.`id`]}}, you would expect {{[`the.id`]}}.


> Wrong column backticks in UNRESOLVED_COLUMN error
> -------------------------------------------------
>
>                 Key: SPARK-39783
>                 URL: https://issues.apache.org/jira/browse/SPARK-39783
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 3.4.0
>            Reporter: Enrico Minack
>            Priority: Major
>
> The following code references a nested value {{{}`the`.`id`{}}}, that does not exist. The proposed / existing column names are not correctly wrapped in backticks:
> {code:scala}
> Seq((0)).toDF("the.id")
>   .select("the.id").show()
> org.apache.spark.sql.AnalysisException: [UNRESOLVED_COLUMN] A column or function parameter with name `the`.`id` cannot be resolved. Did you mean one of the following? [`the`.`id`];
> {code}
> Instead of {{{}[`the`.`id`]{}}}, you would expect {{{}[`the.id`]{}}}.
> Here an example where the nested column exists:
> {code:scala}
> spark.range(1).select(struct("id").as("the"))
>   .select("the.id").show()
> +---+
> | id|
> +---+
> |  0|
> +---+
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org