You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Tomoyuki Saito (Jira)" <ji...@apache.org> on 2019/12/16 03:35:00 UTC
[jira] [Updated] (KAFKA-9301) KafkaProducer#flush should block
until all the sent records get completed
[ https://issues.apache.org/jira/browse/KAFKA-9301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tomoyuki Saito updated KAFKA-9301:
----------------------------------
Description:
h2. ProducerBatch split makes ProducerBatch.produceFuture completed
KAFKA-3995 introduced ProducerBatch split and resend when RecordTooLargeException happens on broker side. When ProducerBatch split happens, ProducerBatch.produceFuture becomes completed, even though records in a batch will be resent to a broker.
h2. KafkaProducer#flush implementation
With the current implementation, KafkaProducer#flush blocks until accumulated ProducerBatches get completed. As described above, that does not ensure all the sent records get completed.
This issue is also mentioned in: https://github.com/apache/kafka/pull/6469
was:
h2. ProducerBatch split makes ProducerBatch.produceFuture completed
KAFKA-3995 introduced ProducerBatch split and resend when RecordTooLargeException happens on broker side. When ProducerBatch split happens, ProducerBatch.produceFuture becomes completed, even though records in a batch will be resent to a broker.
h2. KafkaProducer#flush implementation
With the current implementation, KafkaProducer#flush blocks until accumulated ProducerBatches to be completed. As described above, that does not ensure all the sent records get completed.
This issue is also mentioned in: https://github.com/apache/kafka/pull/6469
> KafkaProducer#flush should block until all the sent records get completed
> -------------------------------------------------------------------------
>
> Key: KAFKA-9301
> URL: https://issues.apache.org/jira/browse/KAFKA-9301
> Project: Kafka
> Issue Type: Bug
> Components: producer
> Affects Versions: 0.11.0.0
> Reporter: Tomoyuki Saito
> Priority: Major
>
> h2. ProducerBatch split makes ProducerBatch.produceFuture completed
> KAFKA-3995 introduced ProducerBatch split and resend when RecordTooLargeException happens on broker side. When ProducerBatch split happens, ProducerBatch.produceFuture becomes completed, even though records in a batch will be resent to a broker.
> h2. KafkaProducer#flush implementation
> With the current implementation, KafkaProducer#flush blocks until accumulated ProducerBatches get completed. As described above, that does not ensure all the sent records get completed.
> This issue is also mentioned in: https://github.com/apache/kafka/pull/6469
--
This message was sent by Atlassian Jira
(v8.3.4#803005)