You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Beam JIRA Bot (Jira)" <ji...@apache.org> on 2021/02/02 17:15:06 UTC
[jira] [Commented] (BEAM-11060) Bigquery readTableRowsWithSchema
fails with IllegalStateException
[ https://issues.apache.org/jira/browse/BEAM-11060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17277321#comment-17277321 ]
Beam JIRA Bot commented on BEAM-11060:
--------------------------------------
This issue was marked "stale-P2" and has not received a public comment in 14 days. It is now automatically moved to P3. If you are still affected by it, you can comment and move it back to P2.
> Bigquery readTableRowsWithSchema fails with IllegalStateException
> -----------------------------------------------------------------
>
> Key: BEAM-11060
> URL: https://issues.apache.org/jira/browse/BEAM-11060
> Project: Beam
> Issue Type: Bug
> Components: io-java-gcp
> Affects Versions: 2.20.0, 2.21.0, 2.22.0, 2.23.0, 2.24.0
> Environment: local, dataflow
> Reporter: Behroz Sikander
> Priority: P3
>
> If you are templating the pipeline and use the function BigQueryIO.readTableRowsWithSchema(), it fails with the following exception even though no .get() was called on the ValueProvider
> {code:java}
> An exception occured while executing the Java class. Value only available at runtime, but accessed from a non-runtime context: RuntimeValueProvider
> {code}
>
> The following stack trace gives more clue and the problem seems to be that BigQueryQuerySourceDef is trying to call a .get on ValueProvider which is wrong. Here is the exact code line in master
> [https://github.com/apache/beam/blame/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryQuerySourceDef.java#L103]
>
> {code:java}
> java.lang.IllegalStateException: Value only available at runtime, but accessed from a non-runtime context: RuntimeValueProvider{propertyName=tablename, default=null}
> at org.apache.beam.sdk.options.ValueProvider$RuntimeValueProvider.get (ValueProvider.java:250)
> at org.apache.beam.sdk.options.ValueProvider$NestedValueProvider.get (ValueProvider.java:141)
> at org.apache.beam.sdk.io.gcp.bigquery.BigQueryQuerySourceDef.getBeamSchema (BigQueryQuerySourceDef.java:163)
> at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$TypedRead.expand (BigQueryIO.java:1188)
> at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$TypedRead.expand (BigQueryIO.java:701)
> at org.apache.beam.sdk.Pipeline.applyInternal (Pipeline.java:542)
> at org.apache.beam.sdk.Pipeline.applyTransform (Pipeline.java:493)
> at org.apache.beam.sdk.values.PBegin.apply (PBegin.java:56)
> at org.apache.beam.sdk.Pipeline.apply (Pipeline.java:186)
> at com.abc.pipeline.main (BomboraIntentCrmIdPipeline.java:93)
> at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke (Method.java:498)
> at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:282)
> at java.lang.Thread.run (Thread.java:836)
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)