[jira] [Commented] (KAFKA-5235) GetOffsetShell: retrieve offsets for all given topics and partitions with single request to the broker

["Arseniy Tashoyan (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-5235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009792#comment-16009792 ] 

Arseniy Tashoyan commented on KAFKA-5235:
-----------------------------------------

Both improvements can be done in scope of switching to KafkaConsumer API

> GetOffsetShell: retrieve offsets for all given topics and partitions with single request to the broker
> ------------------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-5235
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5235
>             Project: Kafka
>          Issue Type: Improvement
>          Components: tools
>            Reporter: Arseniy Tashoyan
>              Labels: tool
>             Fix For: 0.11.0.0
>
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> GetOffsetShell is implemented on old SimpleConsumer. It needs Zookeeper to retrieve metadata about topics and partitions. At present, GetOffsetShell does the following:
> - get metadata from Zookeeper
> - iterate over partitions
> - for each partition, connect to its leader broker and request offsets
> Instead, GetOffsetShell can use new KafkaConsumer and retrieve offsets by means of endOffsets(), beginningOffsets() and offsetsForTimes() methods. One request is sufficient for all topics and partitions.
> As far as GetOffsetShell is re-implemented with new KafkaConsumer API, it will not depend on obsolete API: SimpleConsumer, old producer API.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)