You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "A. Sophie Blee-Goldman (Jira)" <ji...@apache.org> on 2021/03/16 19:57:00 UTC

[jira] [Created] (KAFKA-12485) Speed up Consumer#committed by returning cached offsets for owned partitions

A. Sophie Blee-Goldman created KAFKA-12485:
----------------------------------------------

             Summary: Speed up Consumer#committed by returning cached offsets for owned partitions
                 Key: KAFKA-12485
                 URL: https://issues.apache.org/jira/browse/KAFKA-12485
             Project: Kafka
          Issue Type: Improvement
          Components: consumer
            Reporter: A. Sophie Blee-Goldman


All of the KafkaConsumer#committed APIs will currently make a remote blocking call to the server to fetch the committed offsets. This is typically used to reset the offsets after a crash or restart, or to fetch offsets for other consumers in the group. However some users may wish to invoke this API on partitions which are currently owned by the Consumer, in which case the remote call is unnecessary since those offsets should already be known.

We should consider optimizing these APIs to just return the cached offsets in place of the remote call when passed in only partitions that are currently owned. This is similar to what we do in Consumer#position, although there we have a guarantee that the partitions are owned by the Consumer whereas in #committed we do not



--
This message was sent by Atlassian Jira
(v8.3.4#803005)