You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@calcite.apache.org by "Guillaume Massé (Jira)" <ji...@apache.org> on 2023/04/01 01:38:00 UTC
[jira] [Updated] (CALCITE-5624) Cannot parse array function for Spark Dialect
[ https://issues.apache.org/jira/browse/CALCITE-5624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Guillaume Massé updated CALCITE-5624:
-------------------------------------
Description:
The following query is valid in Apache Spark.
{code:java}
spark-shell
scala> spark.sql("""select array(1, 2, 3)""")
res1: org.apache.spark.sql.DataFrame = [array(1, 2, 3): array<int>]{code}
However, it would fail to parse in Apache Calcite
AtomicRowExpression should not have ArrayConstructor for Apache Spark. Arrays are constructed by calling the array function ([https://spark.apache.org/docs/latest/api/sql/index.html#array]).
{code:java}
array()
array(1)
array(1, 2, 3){code}
was:
AtomicRowExpression should not have ArrayConstructor for Apache Spark. Arrays are constructed by calling the array function ([https://spark.apache.org/docs/latest/api/sql/index.html#array]).
{code:java}
array()
array(1)
array(1, 2, 3){code}
> Cannot parse array function for Spark Dialect
> ---------------------------------------------
>
> Key: CALCITE-5624
> URL: https://issues.apache.org/jira/browse/CALCITE-5624
> Project: Calcite
> Issue Type: Bug
> Components: core
> Affects Versions: 1.34.0
> Reporter: Guillaume Massé
> Priority: Minor
> Labels: pull-request-available
> Time Spent: 50m
> Remaining Estimate: 0h
>
> The following query is valid in Apache Spark.
> {code:java}
> spark-shell
> scala> spark.sql("""select array(1, 2, 3)""")
> res1: org.apache.spark.sql.DataFrame = [array(1, 2, 3): array<int>]{code}
> However, it would fail to parse in Apache Calcite
>
> AtomicRowExpression should not have ArrayConstructor for Apache Spark. Arrays are constructed by calling the array function ([https://spark.apache.org/docs/latest/api/sql/index.html#array]).
>
> {code:java}
> array()
> array(1)
> array(1, 2, 3){code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)