You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Koen Egelink (Jira)" <ji...@apache.org> on 2021/09/13 01:45:00 UTC

[jira] [Updated] (BEAM-12877) Beam Row Avro conversion: fixed and bytes decimals

     [ https://issues.apache.org/jira/browse/BEAM-12877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Koen Egelink updated BEAM-12877:
--------------------------------
    Attachment: beam-sdks-java-core-2.32.0-fixed-decimal.patch

> Beam Row Avro conversion: fixed and bytes decimals
> --------------------------------------------------
>
>                 Key: BEAM-12877
>                 URL: https://issues.apache.org/jira/browse/BEAM-12877
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-core
>    Affects Versions: 2.32.0
>            Reporter: Koen Egelink
>            Priority: P2
>         Attachments: beam-sdks-java-core-2.32.0-fixed-decimal.patch
>
>
> An Avro decimal logical type annotates Avro bytes or fixed types.
> Current Row to Avro conversion is limited to bytes type and in addition hardcodes precision to MAX_INT and scale to 0. 
> I have attached a patch that adds support for decimal bytes and fixed types.
> I could think of 2 possible ways to solve this:
>  # Change Row decimal type to a logical type
>  # Use Beam field options to pass additional metadata required to serialize decimals
> I felt that overhauling Beam schema types might not be a good idea. Instead I went with option 2.
> Passes ./gradlew check
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)