You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@calcite.apache.org by "David Savage (JIRA)" <ji...@apache.org> on 2019/08/03 07:39:00 UTC
[jira] [Commented] (CALCITE-277) Support java arrays coming from
JavaRowFormat.CUSTOM
[ https://issues.apache.org/jira/browse/CALCITE-277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899402#comment-16899402 ]
David Savage commented on CALCITE-277:
--------------------------------------
Just wondering, did this problem ever get fixed or was a work around found?
I'm experiencing a similar error when trying to use UNNEST on a java array:
org.apache.calcite.runtime.CalciteContextException: From line 3, column 12 to line 3, column 32: Cannot apply 'UNNEST' to arguments of type 'UNNEST(<JAVATYPE(CLASS [LJAVA.LANG.OBJECT;)>)'. Supported form(s): 'UNNEST(<MULTISET>)'
'UNNEST(<ARRAY>)'
'UNNEST(<MAP>)'
UNNEST(<MULTISET>)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:463)
at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:783)
at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:768)
at org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError(SqlValidatorImpl.java:4759)
at org.apache.calcite.sql.SqlCallBinding.newValidationSignatureError(SqlCallBinding.java:280)
at org.apache.calcite.sql.type.CompositeOperandTypeChecker.checkOperandTypes(CompositeOperandTypeChecker.java:250)
at org.apache.calcite.sql.SqlOperator.checkOperandTypes(SqlOperator.java:659)
at org.apache.calcite.sql.SqlOperator.validateOperands(SqlOperator.java:432)
at org.apache.calcite.sql.validate.UnnestNamespace.validateImpl(UnnestNamespace.java:66)
at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:84)
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:967)
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:943)
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:3029)
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:3014)
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateJoin(SqlValidatorImpl.java:3066)
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:3023)
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect(SqlValidatorImpl.java:3273)
at org.apache.calcite.sql.validate.SelectNamespace.validateImpl(SelectNamespace.java:60)
at org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:84)
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:967)
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:943)
at org.apache.calcite.sql.SqlSelect.validate(SqlSelect.java:225)
at org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression(SqlValidatorImpl.java:918)
at org.apache.calcite.sql.validate.SqlValidatorImpl.validate(SqlValidatorImpl.java:628)
at org.apache.calcite.sql2rel.SqlToRelConverter.convertQuery(SqlToRelConverter.java:552)
at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:264)
at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:230)
at org.apache.calcite.prepare.CalcitePrepareImpl.prepare2_(CalcitePrepareImpl.java:772)
at org.apache.calcite.prepare.CalcitePrepareImpl.prepare_(CalcitePrepareImpl.java:636)
at org.apache.calcite.prepare.CalcitePrepareImpl.prepareSql(CalcitePrepareImpl.java:606)
at org.apache.calcite.jdbc.CalciteConnectionImpl.parseQuery(CalciteConnectionImpl.java:229)
at org.apache.calcite.jdbc.CalciteConnectionImpl.prepareStatement_(CalciteConnectionImpl.java:211)
... 20 common frames omitted
For background, I'm using Calcite via NiFi and have the following trivial example:
FLOWFILE record:
[
{
"id": "1",
"tags": ["a", "b", "c"]
},
{
"id": "2",
"tags": ["a", "b"]
},
{
"id": "3",
"tags": ["d", "e", "f"]
}
]
Query:
SELECT id, flattened_tags
FROM FLOWFILE
CROSS JOIN UNNEST(FLOWFILE.tags) AS flattened_tags
> Support java arrays coming from JavaRowFormat.CUSTOM
> ----------------------------------------------------
>
> Key: CALCITE-277
> URL: https://issues.apache.org/jira/browse/CALCITE-277
> Project: Calcite
> Issue Type: Bug
> Reporter: GitHub Import
> Priority: Major
> Labels: github-import
>
> When implementing ([#276|https://github.com/JulianHyde/optiq/issues/276] | [FLINK-276|https://issues.apache.org/jira/browse/OPTIQ-276]), I discovered that `SqlValidator` does not treat java arrays as sql `ARRAY`.
> Failing sql:
> ```sql
> select t.*, cardinality(names)
> from table("s"."get_hints"(?, ?)) as t(id, names, type)
> ```
> `names` is a `String[]` field.
> Error:
> ```
> java.sql.SQLException: Error while preparing statement [select *, cardinality(names)
> from table("s"."get_hints"(?, ?)) as t(id, names, type)]
> at net.hydromatic.avatica.Helper.createException(Helper.java:40)
> at net.hydromatic.optiq.jdbc.OptiqConnectionImpl.prepareStatement(OptiqConnectionImpl.java:136)
> at net.hydromatic.avatica.AvaticaConnection.prepareStatement(AvaticaConnection.java:99)
> at net.hydromatic.optiq.test.JdbcTest.adviseSql(JdbcTest.java:358)
> at net.hydromatic.optiq.test.JdbcTest.testSqlAdvisorGetHintsFunction(JdbcTest.java:317)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
> at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
> at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
> at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
> at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
> at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
> at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
> at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
> at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
> at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
> at org.junit.runner.JUnitCore.run(JUnitCore.java:160)
> at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:74)
> at com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:202)
> at com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:65)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at com.intellij.rt.execution.application.AppMain.main(AppMain.java:120)
> Caused by: org.eigenbase.util.EigenbaseContextException: From line 1, column 11 to line 1, column 28: Cannot apply 'CARDINALITY' to arguments of type 'CARDINALITY(<JAVATYPE(CLASS [LJAVA.LANG.STRING;)>)'. Supported form(s): 'CARDINALITY(<MULTISET>)'
> 'CARDINALITY(<ARRAY>)'
> 'CARDINALITY(<MAP>)'
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
> at org.eigenbase.resource.Resources$ExInstWithCause.ex(Resources.java:348)
> at org.eigenbase.sql.SqlUtil.newContextException(SqlUtil.java:667)
> at org.eigenbase.sql.SqlUtil.newContextException(SqlUtil.java:655)
> at org.eigenbase.sql.validate.SqlValidatorImpl.newValidationError(SqlValidatorImpl.java:3517)
> at org.eigenbase.sql.SqlCallBinding.newValidationSignatureError(SqlCallBinding.java:181)
> at org.eigenbase.sql.type.FamilyOperandTypeChecker.checkSingleOperandType(FamilyOperandTypeChecker.java:83)
> at org.eigenbase.sql.type.FamilyOperandTypeChecker.checkOperandTypes(FamilyOperandTypeChecker.java:101)
> at org.eigenbase.sql.type.CompositeOperandTypeChecker.checkOperandTypes(CompositeOperandTypeChecker.java:322)
> at org.eigenbase.sql.SqlOperator.checkOperandTypes(SqlOperator.java:534)
> at org.eigenbase.sql.SqlOperator.validateOperands(SqlOperator.java:413)
> at org.eigenbase.sql.SqlFunction.deriveType(SqlFunction.java:290)
> at org.eigenbase.sql.SqlFunction.deriveType(SqlFunction.java:206)
> at org.eigenbase.sql.validate.SqlValidatorImpl$DeriveTypeVisitor.visit(SqlValidatorImpl.java:3872)
> at org.eigenbase.sql.validate.SqlValidatorImpl$DeriveTypeVisitor.visit(SqlValidatorImpl.java:3859)
> at org.eigenbase.sql.SqlCall.accept(SqlCall.java:133)
> at org.eigenbase.sql.validate.SqlValidatorImpl.deriveTypeImpl(SqlValidatorImpl.java:1318)
> at org.eigenbase.sql.validate.SqlValidatorImpl.deriveType(SqlValidatorImpl.java:1301)
> at org.eigenbase.sql.validate.SqlValidatorImpl.expandSelectItem(SqlValidatorImpl.java:419)
> at org.eigenbase.sql.validate.SqlValidatorImpl.validateSelectList(SqlValidatorImpl.java:3024)
> at org.eigenbase.sql.validate.SqlValidatorImpl.validateSelect(SqlValidatorImpl.java:2777)
> at org.eigenbase.sql.validate.SelectNamespace.validateImpl(SelectNamespace.java:60)
> at org.eigenbase.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:85)
> at org.eigenbase.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:748)
> at org.eigenbase.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:737)
> at org.eigenbase.sql.SqlSelect.validate(SqlSelect.java:209)
> at org.eigenbase.sql.validate.SqlValidatorImpl.validateScopedExpression(SqlValidatorImpl.java:711)
> at org.eigenbase.sql.validate.SqlValidatorImpl.validate(SqlValidatorImpl.java:427)
> at org.eigenbase.sql2rel.SqlToRelConverter.convertQuery(SqlToRelConverter.java:430)
> at net.hydromatic.optiq.prepare.Prepare.prepareSql(Prepare.java:227)
> at net.hydromatic.optiq.prepare.Prepare.prepareSql(Prepare.java:196)
> at net.hydromatic.optiq.prepare.OptiqPrepareImpl.prepare2_(OptiqPrepareImpl.java:338)
> at net.hydromatic.optiq.prepare.OptiqPrepareImpl.prepare_(OptiqPrepareImpl.java:246)
> at net.hydromatic.optiq.prepare.OptiqPrepareImpl.prepareSql(OptiqPrepareImpl.java:215)
> at net.hydromatic.optiq.jdbc.OptiqConnectionImpl.parseQuery(OptiqConnectionImpl.java:149)
> at net.hydromatic.optiq.jdbc.OptiqConnectionImpl.prepareStatement(OptiqConnectionImpl.java:124)
> ... 29 more
> Caused by: org.eigenbase.sql.validate.SqlValidatorException: Cannot apply 'CARDINALITY' to arguments of type 'CARDINALITY(<JAVATYPE(CLASS [LJAVA.LANG.STRING;)>)'. Supported form(s): 'CARDINALITY(<MULTISET>)'
> 'CARDINALITY(<ARRAY>)'
> 'CARDINALITY(<MAP>)'
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
> at org.eigenbase.resource.Resources$ExInstWithCause.ex(Resources.java:348)
> at org.eigenbase.resource.Resources$ExInst.ex(Resources.java:457)
> ... 63 more
> ```
> ---------------- Imported from GitHub ----------------
> Url: https://github.com/julianhyde/optiq/issues/277
> Created by: [vlsi|https://github.com/vlsi]
> Labels:
> Created at: Sun May 11 08:23:08 CEST 2014
> State: open
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)