You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2024/11/20 17:24:00 UTC

[jira] [Updated] (SPARK-50373) Prohibit set operations on Variant type

     [ https://issues.apache.org/jira/browse/SPARK-50373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated SPARK-50373:
-----------------------------------
    Labels: pull-request-available  (was: )

> Prohibit set operations on Variant type
> ---------------------------------------
>
>                 Key: SPARK-50373
>                 URL: https://issues.apache.org/jira/browse/SPARK-50373
>             Project: Spark
>          Issue Type: Task
>          Components: SQL
>    Affects Versions: 4.0.0
>            Reporter: Harsh Motwani
>            Priority: Major
>              Labels: pull-request-available
>
> Currently, the operations `DISTINCT`, `INTERSECT` and `EXCEPT` are allowed on Variant columns. However, since Variant is not orderable, and Variant equality is not defined, we should not allow this behavior. Sometimes, these queries fail during execution. However, they should fail during analysis with a well defined error message. Example:
> select distinct (parse_json(case when id = 0 then 'null' else '1' end) as v, id % 5 as id) from range(0, 100, 1, 5)



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org