You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/12/02 06:34:00 UTC

[jira] [Work logged] (BEAM-4454) Provide automatic schema registration for AVROs

     [ https://issues.apache.org/jira/browse/BEAM-4454?focusedWorklogId=171348&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-171348 ]

ASF GitHub Bot logged work on BEAM-4454:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 02/Dec/18 06:33
            Start Date: 02/Dec/18 06:33
    Worklog Time Spent: 10m 
      Work Description: reuvenlax opened a new pull request #7181: [BEAM-4454] Add more AVRO utilities to convert between Beam and Avro.
URL: https://github.com/apache/beam/pull/7181
 
 
   This PR extends the Avro <-> Beam conversion utilities. It adds conversions between the different schema types as well as from Beam Row to GenericRecord. In addition nullability support was extended to handle the case of nullable list and map element values.
   
   This PR does not add support for SpecificRecord. SpecificRecord will be handled by extending our existing ByteBuddy codegen for Java Bean objects (as SpecificRecord is basically a Java Bean). 
   
   Next steps will be to extend AvroIO (as well as other sources such as PubsubIO.readAvros) to register the correct schema on the output PCollection. Once this happens, all these PCollections will automatically work on any schema-aware transform.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

            Worklog Id:     (was: 171348)
            Time Spent: 10m
    Remaining Estimate: 0h

> Provide automatic schema registration for AVROs
> -----------------------------------------------
>
>                 Key: BEAM-4454
>                 URL: https://issues.apache.org/jira/browse/BEAM-4454
>             Project: Beam
>          Issue Type: Sub-task
>          Components: sdk-java-core
>            Reporter: Reuven Lax
>            Assignee: Reuven Lax
>            Priority: Major
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Need to make sure this is a compatible change



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)