You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Ashok Bala (Jira)" <ji...@apache.org> on 2020/10/30 02:52:00 UTC
[jira] [Updated] (KAFKA-6217) Allow consumers to read messages from
LEO
[ https://issues.apache.org/jira/browse/KAFKA-6217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashok Bala updated KAFKA-6217:
------------------------------
Description:
we have a use case(real time customer facing application) to support high throughput(reduced latency) & high volume of transactions through Kafka. During performance testing, we noted that consumer listening to single replicated partition topics get messages faster than the consumers listening to replicated partitions.
Make messages to be visible immediately to consumer rather than waiting for high water mark. Make change in consumer & core, based on consumer configuration, LEO messages to be visible to consumer like followers. It is the risk of consumer to lose messages during fail over of leader for which we are OK.
was:
we have a use case(real time customer facing application) to support high throughput(reduced latency) & high volume of transactions through Kafka. During performance testing, we noted that consumer listening to single partition topics get messages faster than the consumers listening to replicated partitions.
Make messages to be visible immediately to consumer rather than waiting for high water mark. Make change in consumer & core, based on consumer configuration, LEO messages to be visible to consumer like followers. It is the risk of consumer to lose messages during fail over of leader for which we are OK.
> Allow consumers to read messages from LEO
> -----------------------------------------
>
> Key: KAFKA-6217
> URL: https://issues.apache.org/jira/browse/KAFKA-6217
> Project: Kafka
> Issue Type: Improvement
> Components: consumer, core
> Reporter: Ashok Bala
> Priority: Major
>
> we have a use case(real time customer facing application) to support high throughput(reduced latency) & high volume of transactions through Kafka. During performance testing, we noted that consumer listening to single replicated partition topics get messages faster than the consumers listening to replicated partitions.
> Make messages to be visible immediately to consumer rather than waiting for high water mark. Make change in consumer & core, based on consumer configuration, LEO messages to be visible to consumer like followers. It is the risk of consumer to lose messages during fail over of leader for which we are OK.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)