You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "Vikram Bohra (JIRA)" <ji...@apache.org> on 2019/05/06 22:55:00 UTC
[jira] [Closed] (GOBBLIN-758) Use keys to push messages to kafka.
Implemented Metric and Event reporters that push messages without
serialization.
[ https://issues.apache.org/jira/browse/GOBBLIN-758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vikram Bohra closed GOBBLIN-758.
--------------------------------
Resolution: Fixed
Fix Version/s: 0.15.0
> Use keys to push messages to kafka. Implemented Metric and Event reporters that push messages without serialization.
> --------------------------------------------------------------------------------------------------------------------
>
> Key: GOBBLIN-758
> URL: https://issues.apache.org/jira/browse/GOBBLIN-758
> Project: Apache Gobblin
> Issue Type: Improvement
> Reporter: Vikram Bohra
> Priority: Major
> Fix For: 0.15.0
>
> Time Spent: 1h 40m
> Remaining Estimate: 0h
>
> This ticket introduces the following changes.
> 1) It reduces the number of connections to Kafka by using a randomly generated key for each instance of the reporter.
> 2) Introduces a KeyValuePusher interface that provides a cleaner way to push key value messages to kafka.
> 3) Default implementation of the above interface for kafka.
> 4) New Reporters for reporting GobblinTrackingEvent and MetricReport without serializing them.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)