You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "Vikram Bohra (JIRA)" <ji...@apache.org> on 2019/05/06 22:55:00 UTC

[jira] [Closed] (GOBBLIN-758) Use keys to push messages to kafka. Implemented Metric and Event reporters that push messages without serialization.

     [ https://issues.apache.org/jira/browse/GOBBLIN-758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vikram Bohra closed GOBBLIN-758.
--------------------------------
       Resolution: Fixed
    Fix Version/s: 0.15.0

> Use keys to push messages to kafka. Implemented Metric and Event reporters that push messages without serialization.
> --------------------------------------------------------------------------------------------------------------------
>
>                 Key: GOBBLIN-758
>                 URL: https://issues.apache.org/jira/browse/GOBBLIN-758
>             Project: Apache Gobblin
>          Issue Type: Improvement
>            Reporter: Vikram Bohra
>            Priority: Major
>             Fix For: 0.15.0
>
>          Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> This ticket introduces the following changes.
> 1) It reduces the number of connections to Kafka by using a randomly generated key for each instance of the reporter.
> 2) Introduces a KeyValuePusher interface that provides a cleaner way to push key value messages to kafka.
> 3) Default implementation of the above interface for kafka. 
> 4) New Reporters for reporting GobblinTrackingEvent and MetricReport without serializing them.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)