[GitHub] [beam] damccorm opened a new issue, #20126: BeamZetaSqlCalcRel$CalcFn.processElement field is not nullable in Array field $arrayx

[GitBox <gi...@apache.org>]

damccorm opened a new issue, #20126:
URL: https://github.com/apache/beam/issues/20126

   One failure in shard 12, five failures in shard 16, one failure in shard 19, fourteen failures on shard 50
   ```
   
   org.apache.beam.sdk.Pipeline$PipelineExecutionException: java.lang.IllegalArgumentException: FieldType{typeName=STRING,
   nullable=false, logicalType=null, collectionElementType=null, mapKeyType=null, mapValueType=null, rowSchema=null,
   metadata={}} is not nullable in Array field $arraytz
   	at org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.waitUntilFinish(DirectRunner.java:348)
   	at
   org.apache.beam.runners.direct.DirectRunner$DirectPipelineResult.waitUntilFinish(DirectRunner.java:318)
   	at
   org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:213)
   	at org.apache.beam.runners.direct.DirectRunner.run(DirectRunner.java:67)
   	at
   org.apache.beam.sdk.Pipeline.run(Pipeline.java:317)
   	at org.apache.beam.sdk.Pipeline.run(Pipeline.java:303)
   	at
   org.apache.beam.sdk.extensions.sql.impl.rel.BeamEnumerableConverter.runCollector(BeamEnumerableConverter.java:201)
   	at
   org.apache.beam.sdk.extensions.sql.impl.rel.BeamEnumerableConverter.collectRows(BeamEnumerableConverter.java:218)
   	at
   org.apache.beam.sdk.extensions.sql.impl.rel.BeamEnumerableConverter.toRowList(BeamEnumerableConverter.java:150)
   	at
   org.apache.beam.sdk.extensions.sql.impl.rel.BeamEnumerableConverter.toRowList(BeamEnumerableConverter.java:127)
   	at
   cloud.dataflow.sql.ExecuteQueryServiceServer$SqlComplianceServiceImpl.executeQuery(ExecuteQueryServiceServer.java:329)
   	at
   com.google.zetasql.testing.SqlComplianceServiceGrpc$MethodHandlers.invoke(SqlComplianceServiceGrpc.java:423)
   	at
   com.google.zetasql.io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:171)
   	at
   com.google.zetasql.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.halfClosed(ServerCallImpl.java:283)
   	at
   com.google.zetasql.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1HalfClosed.runInContext(ServerImpl.java:711)
   	at
   com.google.zetasql.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
   	at com.google.zetasql.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
   	at
   java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at
   java.lang.Thread.run(Thread.java:748)
   Caused by: java.lang.IllegalArgumentException: FieldType{typeName=STRING,
   nullable=false, logicalType=null, collectionElementType=null, mapKeyType=null, mapValueType=null, rowSchema=null,
   metadata={}} is not nullable in Array field $arraytz
   	at org.apache.beam.sdk.values.SchemaVerification.verifyArray(SchemaVerification.java:101)
   	at
   org.apache.beam.sdk.values.SchemaVerification.verifyFieldValue(SchemaVerification.java:65)
   	at org.apache.beam.sdk.values.SchemaVerification.verifyRowValues(SchemaVerification.java:57)
   	at
   org.apache.beam.sdk.values.Row$Builder.build(Row.java:673)
   	at org.apache.beam.sdk.extensions.sql.zetasql.BeamZetaSqlCalcRel$CalcFn.processElement(BeamZetaSqlCalcRel.java:195)
   
   ```
   
   ```
   
   Apr 01, 2020 6:02:53 PM cloud.dataflow.sql.ExecuteQueryServiceServer$SqlComplianceServiceImpl executeQuery
   INFO:
   Processing Sql statement: select timestamp("2011-02-03 10:20:30+05", tz) from (select tz from unnest(["+02",
   NULL, "America/Los_Angeles"]) tz);
   Apr 01, 2020 6:05:07 PM cloud.dataflow.sql.ExecuteQueryServiceServer$SqlComplianceServiceImpl
   executeQuery
   INFO: Processing Sql statement: SELECT [1, 4, 9, NULL, 10] non_empty_array
   Apr 01, 2020
   6:05:08 PM cloud.dataflow.sql.ExecuteQueryServiceServer$SqlComplianceServiceImpl executeQuery
   INFO:
   Processing Sql statement: SELECT [CAST(5 AS INT64), NULL] int64_val
   Apr 01, 2020 6:05:09 PM cloud.dataflow.sql.ExecuteQueryServiceServer$SqlComplianceServiceImpl
   executeQuery
   INFO: Processing Sql statement: SELECT [true, NULL, false, true] bool_val
   Apr 01, 2020
   6:05:09 PM cloud.dataflow.sql.ExecuteQueryServiceServer$SqlComplianceServiceImpl executeQuery
   INFO:
   Processing Sql statement: SELECT [CAST("8" AS STRING), NULL, CAST("googlesql" AS STRING)] string_val
   Apr
   01, 2020 6:05:10 PM cloud.dataflow.sql.ExecuteQueryServiceServer$SqlComplianceServiceImpl executeQuery
   INFO:
   Processing Sql statement: SELECT [NULL, CAST(b"9" AS BYTES)] bytes_val
   Apr 01, 2020 5:58:24 PM cloud.dataflow.sql.ExecuteQueryServiceServer$SqlComplianceServiceImpl
   executeQuery
   INFO: Processing Sql statement: SELECT x FROM UNNEST([3, NULL]) x;
   Apr 01, 2020 6:01:36
   PM cloud.dataflow.sql.ExecuteQueryServiceServer$SqlComplianceServiceImpl executeQuery
   INFO: Processing
   Sql statement: SELECT ARRAY<STRUCT<int64, int64>>[(11, 12), NULL, (31, 32)];
   
   ```
   
   
   Imported from Jira [BEAM-9519](https://issues.apache.org/jira/browse/BEAM-9519). Original Jira may contain additional context.
   Reported by: apilloud.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org