You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Ismael Juma (JIRA)" <ji...@apache.org> on 2018/10/20 16:32:00 UTC

[jira] [Updated] (KAFKA-5235) GetOffsetShell: retrieve offsets for all given topics and partitions with single request to the broker

     [ https://issues.apache.org/jira/browse/KAFKA-5235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ismael Juma updated KAFKA-5235:
-------------------------------
    Fix Version/s:     (was: 2.1.0)
                   2.2.0

> GetOffsetShell: retrieve offsets for all given topics and partitions with single request to the broker
> ------------------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-5235
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5235
>             Project: Kafka
>          Issue Type: Improvement
>          Components: tools
>            Reporter: Arseniy Tashoyan
>            Priority: Major
>              Labels: kip, tool
>             Fix For: 2.2.0
>
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> GetOffsetShell is implemented on old SimpleConsumer. It needs Zookeeper to retrieve metadata about topics and partitions. At present, GetOffsetShell does the following:
> - get metadata from Zookeeper
> - iterate over partitions
> - for each partition, connect to its leader broker and request offsets
> Instead, GetOffsetShell can use new KafkaConsumer and retrieve offsets by means of endOffsets(), beginningOffsets() and offsetsForTimes() methods. One request is sufficient for all topics and partitions.
> As far as GetOffsetShell is re-implemented with new KafkaConsumer API, it will not depend on obsolete API: SimpleConsumer, old producer API.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)