You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Tejas Patil (JIRA)" <ji...@apache.org> on 2013/08/19 21:41:47 UTC
[jira] [Created] (KAFKA-1012) Implement an Offset Manager and hook
offset requests to it
Tejas Patil created KAFKA-1012:
----------------------------------
Summary: Implement an Offset Manager and hook offset requests to it
Key: KAFKA-1012
URL: https://issues.apache.org/jira/browse/KAFKA-1012
Project: Kafka
Issue Type: Sub-task
Components: consumer
Reporter: Tejas Patil
Assignee: Tejas Patil
Priority: Minor
After KAFKA-657, we have a protocol for consumers to commit and fetch offsets from brokers. Currently, consumers are not using this API and directly talking with Zookeeper.
This Jira will involve following:
1. Add a special topic in kafka for storing offsets
2. Add an OffsetManager interface which would handle storing, accessing, loading and maintaining consumer offsets
3. Implement offset managers for both of these 2 choices : existing ZK based storage or inbuilt storage for offsets.
4. Leader brokers would now maintain an additional hash table of offsets for the group-topic-partitions that they lead
5. Consumers should now use the OffsetCommit and OffsetFetch API
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira