[jira] [Updated] (BEAM-9275) BIP-1: Beam Schema Options

["Alex Van Boxel (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/BEAM-9275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alex Van Boxel updated BEAM-9275:
---------------------------------
    Description: Introduce the concept of Options in Beam Schema’s to add extra context to fields and schemas. In contrast to the current Beam metadata that is present in a FieldType, options would be added to fields, logical types and schemas. The schema convertors (ex. Avro, Proto, …) can add options/annotations/decorators that were in the original schema to the Beam schema with these options. These options, that add contextual metadata, can be used in the pipeline for specific transformations or augment the end schema in the target output.

> BIP-1: Beam Schema Options
> --------------------------
>
>                 Key: BEAM-9275
>                 URL: https://issues.apache.org/jira/browse/BEAM-9275
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-core
>            Reporter: Alex Van Boxel
>            Priority: Major
>
> Introduce the concept of Options in Beam Schema’s to add extra context to fields and schemas. In contrast to the current Beam metadata that is present in a FieldType, options would be added to fields, logical types and schemas. The schema convertors (ex. Avro, Proto, …) can add options/annotations/decorators that were in the original schema to the Beam schema with these options. These options, that add contextual metadata, can be used in the pipeline for specific transformations or augment the end schema in the target output.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)