You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@samza.apache.org by "Boris Shkolnik (JIRA)" <ji...@apache.org> on 2019/03/20 16:39:01 UTC

[jira] [Resolved] (SAMZA-1793) Upgrade to recent API for kafka consumer / producer.

     [ https://issues.apache.org/jira/browse/SAMZA-1793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Boris Shkolnik resolved SAMZA-1793.
-----------------------------------
    Resolution: Fixed

> Upgrade to recent API for kafka consumer / producer.
> ----------------------------------------------------
>
>                 Key: SAMZA-1793
>                 URL: https://issues.apache.org/jira/browse/SAMZA-1793
>             Project: Samza
>          Issue Type: New Feature
>            Reporter: Shanthoosh Venkataraman
>            Assignee: Boris Shkolnik
>            Priority: Major
>
> Kafka consumer: 
>  1.  Samza currently uses SimpleConsumer to consume messages from the KafkaBroker. However, the SimpleConsumer API is deprecated and is slated to be removed in future kafka-clients release. It's essential to migrate to KafkaConsumer api sooner to continue kafka connector support in samza. 
> 2. Internally within linkedIn, we've been using an implementation of the new consumer/produce for a while with some success.
> Kafka Producer: 
> Since 0.10.1, Kafka’s messages can carry timestamps, indicating the time the event has occurred or the time when the message has been written to the Kafka broker. This is essential to support rewinding of checkpoints based upon time.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)