You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Daniel Urban (Jira)" <ji...@apache.org> on 2020/06/29 14:14:00 UTC
[jira] [Assigned] (KAFKA-5235) GetOffsetShell: retrieve offsets for
all given topics and partitions with single request to the broker
[ https://issues.apache.org/jira/browse/KAFKA-5235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Urban reassigned KAFKA-5235:
-----------------------------------
Assignee: Daniel Urban
> GetOffsetShell: retrieve offsets for all given topics and partitions with single request to the broker
> ------------------------------------------------------------------------------------------------------
>
> Key: KAFKA-5235
> URL: https://issues.apache.org/jira/browse/KAFKA-5235
> Project: Kafka
> Issue Type: Improvement
> Components: tools
> Reporter: Arseniy Tashoyan
> Assignee: Daniel Urban
> Priority: Major
> Labels: kip, tool
> Original Estimate: 168h
> Remaining Estimate: 168h
>
> GetOffsetShell is implemented on old SimpleConsumer. It needs Zookeeper to retrieve metadata about topics and partitions. At present, GetOffsetShell does the following:
> - get metadata from Zookeeper
> - iterate over partitions
> - for each partition, connect to its leader broker and request offsets
> Instead, GetOffsetShell can use new KafkaConsumer and retrieve offsets by means of endOffsets(), beginningOffsets() and offsetsForTimes() methods. One request is sufficient for all topics and partitions.
> As far as GetOffsetShell is re-implemented with new KafkaConsumer API, it will not depend on obsolete API: SimpleConsumer, old producer API.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)