You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Ismaël Mejía (Jira)" <ji...@apache.org> on 2020/04/01 08:10:00 UTC
[jira] [Updated] (BEAM-9652) BigQueryIO MultiPartitionsWriteTables
fails with ClassCastException: java.lang.Object cannot be cast to
org.apache.beam.sdk.values.KV
[ https://issues.apache.org/jira/browse/BEAM-9652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ismaël Mejía updated BEAM-9652:
-------------------------------
Status: Open (was: Triage Needed)
> BigQueryIO MultiPartitionsWriteTables fails with ClassCastException: java.lang.Object cannot be cast to org.apache.beam.sdk.values.KV
> -------------------------------------------------------------------------------------------------------------------------------------
>
> Key: BEAM-9652
> URL: https://issues.apache.org/jira/browse/BEAM-9652
> Project: Beam
> Issue Type: Bug
> Components: io-java-gcp
> Affects Versions: 2.19.0
> Reporter: Luke Cwik
> Assignee: Luke Cwik
> Priority: Major
> Fix For: 2.21.0
>
> Time Spent: 40m
> Remaining Estimate: 0h
>
> It looks like the coder inference fails for BatchLoad.writeTempTables and selects an avro coder:
> {code:java}
> object_value: <
> type: "org.apache.beam.sdk.coders.AvroCoder"
> parameters: <
> name: "type"
> value: <
> string_value: "java.lang.Object"
> >
> >
> parameters: <
> name: "schema"
> value: <
> string_value: "{\"type\":\"record\",\"name\":\"Object\",\"namespace\":\"java.lang\",\"fields\":[]}"
> >
> >
> {code}
> Full exception:
> {code:java}
> exception: "java.lang.ClassCastException: java.lang.Object cannot be cast to org.apache.beam.sdk.values.KV at org.apache.beam.sdk.coders.KvCoder.registerByteSizeObserver(KvCoder.java:36) at org.apache.beam.sdk.coders.IterableLikeCoder.registerByteSizeObserver(IterableLikeCoder.java:191) at org.apache.beam.sdk.coders.IterableLikeCoder.registerByteSizeObserver(IterableLikeCoder.java:60) at org.apache.beam.sdk.util.WindowedValue$FullWindowedValueCoder.registerByteSizeObserver(WindowedValue.java:623) at org.apache.beam.sdk.util.WindowedValue$FullWindowedValueCoder.registerByteSizeObserver(WindowedValue.java:539) at org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory$ElementByteSizeObservableCoder.registerByteSizeObserver(IntrinsicMapTaskExecutorFactory.java:400)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)