You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2021/07/06 14:23:00 UTC
[jira] [Work logged] (BEAM-9613) BigQuery IO not support convert
double type for beam row
[ https://issues.apache.org/jira/browse/BEAM-9613?focusedWorklogId=619383&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-619383 ]
ASF GitHub Bot logged work on BEAM-9613:
----------------------------------------
Author: ASF GitHub Bot
Created on: 06/Jul/21 14:22
Start Date: 06/Jul/21 14:22
Worklog Time Spent: 10m
Work Description: mouyang commented on pull request #14350:
URL: https://github.com/apache/beam/pull/14350#issuecomment-874804973
> @pabloem - Would you be able to review this?
+1 @pabloem how is this going? Because of the access modifiers on the methods, I need to fork this file to work around this and other BigQueryUtils issues.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 619383)
Time Spent: 5.5h (was: 5h 20m)
> BigQuery IO not support convert double type for beam row
> --------------------------------------------------------
>
> Key: BEAM-9613
> URL: https://issues.apache.org/jira/browse/BEAM-9613
> Project: Beam
> Issue Type: Bug
> Components: io-java-gcp
> Affects Versions: 2.28.0
> Reporter: MAKSIM TSYGAN
> Priority: P3
> Time Spent: 5.5h
> Remaining Estimate: 0h
>
> If execute query with double column via BigQueryIO.readFrom(), I get exception:
> Caused by: java.lang.UnsupportedOperationException: Converting BigQuery type 'class java.lang.Double' to 'FieldType\{typeName=DOUBLE, nullable=true, logicalType=null, collectionElementType=null, mapKeyType=null, mapValueType=null, rowSchema=null, metadata={}}' is not supported
> at org.apache.beam.sdk.io.gcp.bigquery.BigQueryUtils.toBeamValue(BigQueryUtils.java:532)
> at org.apache.beam.sdk.io.gcp.bigquery.BigQueryUtils.toBeamRowFieldValue(BigQueryUtils.java:483)
> at org.apache.beam.sdk.io.gcp.bigquery.BigQueryUtils.lambda$toBeamRow$6(BigQueryUtils.java:469)
> at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
> at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382)
> at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
> at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
> at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
> at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
> at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)
> at org.apache.beam.sdk.io.gcp.bigquery.BigQueryUtils.toBeamRow(BigQueryUtils.java:470)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)