You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Sudarshan Vasudevan (Jira)" <ji...@apache.org> on 2019/11/21 23:32:00 UTC

[jira] [Closed] (GOBBLIN-945) Refactor Kafka extractor statistics tracking to allow code reuse across both batch and streaming execution modes

     [ https://issues.apache.org/jira/browse/GOBBLIN-945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sudarshan Vasudevan closed GOBBLIN-945.
---------------------------------------

> Refactor Kafka extractor statistics tracking to allow code reuse across both batch and streaming execution modes
> ----------------------------------------------------------------------------------------------------------------
>
>                 Key: GOBBLIN-945
>                 URL: https://issues.apache.org/jira/browse/GOBBLIN-945
>             Project: Apache Gobblin
>          Issue Type: Improvement
>          Components: gobblin-kafka
>    Affects Versions: 0.15.0
>            Reporter: Sudarshan Vasudevan
>            Assignee: Shirshanka Das
>            Priority: Major
>             Fix For: 0.15.0
>
>          Time Spent: 2h 40m
>  Remaining Estimate: 0h
>
> Current implementation of kafka extractor stats tracking is deeply integrated with the batch implementation of KafkaExtractor preventing it from being used in streaming Kafka extractor implementations. In addition to code reuse, the refactoring allows for writing unit tests for statistics tracker. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)