You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Alexey Romanenko (Jira)" <ji...@apache.org> on 2021/12/08 14:24:00 UTC

[jira] [Updated] (BEAM-13341) Serialization of AvroCoder for dataflow workers discard reflect option

     [ https://issues.apache.org/jira/browse/BEAM-13341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alexey Romanenko updated BEAM-13341:
------------------------------------
    Status: Open  (was: Triage Needed)

> Serialization of AvroCoder for dataflow workers discard reflect option
> ----------------------------------------------------------------------
>
>                 Key: BEAM-13341
>                 URL: https://issues.apache.org/jira/browse/BEAM-13341
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-dataflow
>    Affects Versions: 2.34.0
>            Reporter: Michel Davit
>            Priority: P3
>          Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> [AvroCoderCloudObjectTranslator|https://github.com/apache/beam/blob/master/runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/util/AvroCoderCloudObjectTranslator.java]  used to serialize AvroCoder to the dataflow worker does not take in account the 'useRelectApi' [AvroCoder|https://github.com/apache/beam/blob/f6e4aef7cc22ea934bde471fd2e2ea2c110721d4/sdks/java/core/src/main/java/org/apache/beam/sdk/coders/AvroCoder.java#L131] parameter, and will deserialize coders with default value (true).
> The CloudObjectTranslator should propagate this setting so that the deserialized coder behaves the same way as the serialized one.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)