[jira] [Reopened] (SPARK-51428) Implicit aliases of collated trees are assigned non-deterministically

["Marko Ilic (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-51428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Marko Ilic reopened SPARK-51428:
--------------------------------

Since supporting DEFAULT COLLATION for Views, we have this issue again.

> Implicit aliases of collated trees are assigned non-deterministically
> ---------------------------------------------------------------------
>
>                 Key: SPARK-51428
>                 URL: https://issues.apache.org/jira/browse/SPARK-51428
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 4.0.0
>            Reporter: Vladimir Golubev
>            Assignee: Vladimir Golubev
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.0.0
>
>
> Consider the following collated queries and their schemas:
> 1.
> ```
> SELECT 'a' COLLATE UTF8_LCASE < 'A'
> ->
> (collate(a, UTF8_LCASE) < 'A' collate UTF8_LCASE)
> ```
> 2.
> ```
> SELECT CONCAT_WS('a', col1, col1) FROM VALUES ('a' COLLATE UTF8_LCASE)
> ->
> concat_ws(a, col1, col1)
> ```
> The 1. case has an explicit alias where 'A' literal is marked as collated, which is correct. However, in the second case, 'a' literal is not marked as collated in the output implicit alias, despite the fact that it is indeed collated by `CollationTypeCoercion`. The 2. output schema has to be `concat_ws('a' collate UTF8_LCASE, col1, col1)|`.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org