You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "Sudarshan Vasudevan (Jira)" <ji...@apache.org> on 2020/08/03 19:25:00 UTC
[jira] [Updated] (GOBBLIN-757) Add support for decorating Avro
records with additional fields
[ https://issues.apache.org/jira/browse/GOBBLIN-757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sudarshan Vasudevan updated GOBBLIN-757:
----------------------------------------
Affects Version/s: 0.15.0
> Add support for decorating Avro records with additional fields
> ---------------------------------------------------------------
>
> Key: GOBBLIN-757
> URL: https://issues.apache.org/jira/browse/GOBBLIN-757
> Project: Apache Gobblin
> Issue Type: Improvement
> Components: gobblin-codecs
> Affects Versions: 0.15.0
> Reporter: Shirshanka Das
> Assignee: Shirshanka Das
> Priority: Minor
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> Pipeline constructs (e.g. converters) often need to attach additional data to a record as it is being processed.
> A simple use-case could be attaching record-level "lineage" metadata from the source system such as the host, the source cluster, the identifier for this record in the source system etc.
> We propose adding utility functions to make these sorts of transformations easy to do on Avro Generic Records.
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)