You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Arseniy Tashoyan (JIRA)" <ji...@apache.org> on 2017/05/14 16:57:04 UTC

[jira] [Created] (KAFKA-5235) GetOffsetShell: retrieve offsets for all given topics and partitions with single request to the broker

Arseniy Tashoyan created KAFKA-5235:
---------------------------------------

             Summary: GetOffsetShell: retrieve offsets for all given topics and partitions with single request to the broker
                 Key: KAFKA-5235
                 URL: https://issues.apache.org/jira/browse/KAFKA-5235
             Project: Kafka
          Issue Type: Improvement
          Components: tools
            Reporter: Arseniy Tashoyan
             Fix For: 0.11.0.0


GetOffsetShell is implemented on old SimpleConsumer. It needs Zookeeper to retrieve metadata about topics and partitions. At present, GetOffsetShell does the following:
- get metadata from Zookeeper
- iterate over partitions
- for each partition, connect to its leader broker and request offsets
Instead, GetOffsetShell can use new KafkaConsumer and retrieve offsets by means of endOffsets(), beginningOffsets() and offsetsForTimes() methods. One request is sufficient for all topics and partitions.
As far as GetOffsetShell is re-implemented with new KafkaConsumer API, it will not depend on obsolete API: SimpleConsumer, old producer API.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)