You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Hung Tran (Jira)" <ji...@apache.org> on 2020/08/03 19:21:00 UTC

[jira] [Reopened] (GOBBLIN-757) Add support for decorating Avro records with additional fields

     [ https://issues.apache.org/jira/browse/GOBBLIN-757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hung Tran reopened GOBBLIN-757:
-------------------------------

> Add support for decorating Avro records with additional fields 
> ---------------------------------------------------------------
>
>                 Key: GOBBLIN-757
>                 URL: https://issues.apache.org/jira/browse/GOBBLIN-757
>             Project: Apache Gobblin
>          Issue Type: Improvement
>          Components: gobblin-codecs
>            Reporter: Shirshanka Das
>            Assignee: Shirshanka Das
>            Priority: Minor
>          Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> Pipeline constructs (e.g. converters) often need to attach additional data to a record as it is being processed.
> A simple use-case could be attaching record-level "lineage" metadata from the source system such as the host, the source cluster, the identifier for this record in the source system etc. 
> We propose adding utility functions to make these sorts of transformations easy to do on Avro Generic Records. 
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)