You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Koen Egelink (Jira)" <ji...@apache.org> on 2021/09/13 01:44:00 UTC

[jira] [Created] (BEAM-12877) Beam Row Avro conversion: fixed and bytes decimals

Koen Egelink created BEAM-12877:
-----------------------------------

             Summary: Beam Row Avro conversion: fixed and bytes decimals
                 Key: BEAM-12877
                 URL: https://issues.apache.org/jira/browse/BEAM-12877
             Project: Beam
          Issue Type: Improvement
          Components: sdk-java-core
    Affects Versions: 2.32.0
            Reporter: Koen Egelink


An Avro decimal logical type annotates Avro bytes or fixed types.

Current Row to Avro conversion is limited to bytes type and in addition hardcodes precision to MAX_INT and scale to 0. 

I have attached a patch that adds support for decimal bytes and fixed types.

I could think of 2 possible ways to solve this:
 # Change Row decimal type to a logical type
 # Use Beam field options to pass additional metadata required to serialize decimals

I felt that overhauling Beam schema types might not be a good idea. Instead I went with option 2.

Passes ./gradlew check

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)