You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Arseniy Tashoyan (JIRA)" <ji...@apache.org> on 2017/05/14 16:57:04 UTC
[jira] [Created] (KAFKA-5235) GetOffsetShell: retrieve offsets for
all given topics and partitions with single request to the broker
Arseniy Tashoyan created KAFKA-5235:
---------------------------------------
Summary: GetOffsetShell: retrieve offsets for all given topics and partitions with single request to the broker
Key: KAFKA-5235
URL: https://issues.apache.org/jira/browse/KAFKA-5235
Project: Kafka
Issue Type: Improvement
Components: tools
Reporter: Arseniy Tashoyan
Fix For: 0.11.0.0
GetOffsetShell is implemented on old SimpleConsumer. It needs Zookeeper to retrieve metadata about topics and partitions. At present, GetOffsetShell does the following:
- get metadata from Zookeeper
- iterate over partitions
- for each partition, connect to its leader broker and request offsets
Instead, GetOffsetShell can use new KafkaConsumer and retrieve offsets by means of endOffsets(), beginningOffsets() and offsetsForTimes() methods. One request is sufficient for all topics and partitions.
As far as GetOffsetShell is re-implemented with new KafkaConsumer API, it will not depend on obsolete API: SimpleConsumer, old producer API.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)