You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Srinivas Dhruvakumar (JIRA)" <ji...@apache.org> on 2016/11/22 02:20:58 UTC
[jira] [Updated] (KAFKA-4430) Broker logging Topic and partition to
exceptions: [topic,6] -> kafka.common.MessageSizeTooLargeException
[ https://issues.apache.org/jira/browse/KAFKA-4430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Srinivas Dhruvakumar updated KAFKA-4430:
----------------------------------------
Description:
I have a setup as below
DC Kafka
Mirrormaker
Aggregate Kafka
Here is the following settings. I have set the max.message.bytes to 1 M on DC and AGG kafka. Mirrormaker producer batch setting is set to 500 KBytes and max.request.size is set to 1 M Byte and ack -> 0 and compression-> gzip .
However on the Aggregate Kafka I get the following exception
Closing connection due to error during produce request with correlation id 414156659 from client id producer-1 with ack=0
KafkaServer.log.3:Topic and partition to exceptions: [topic1,6] -> kafka.common.MessageSizeTooLargeException
Is this a bug or why would this happen. Noticed that this happens in the Kafka API class. I have configured mirrormaker to send messages less than 1 M Bytes
was:
I have a setup as below
DC Kafka
Mirrormaker
AGG Kafka
Here is the following settings. I have set the max.message.bytes to 1 M on DC and AGG kafka. Mirrormaker producer batch setting is set to 500 KBytes and max.request.size is set to 1 M Byte and ack -> 0.
However on the AGG Kafka I get the following exception
Closing connection due to error during produce request with correlation id 414156659 from client id producer-1 with ack=0
KafkaServer.log.3:Topic and partition to exceptions: [topic1,6] -> kafka.common.MessageSizeTooLargeException
Is this a bug or why would this happen. Noticed that this happens in the Kafka API class.
> Broker logging Topic and partition to exceptions: [topic,6] -> kafka.common.MessageSizeTooLargeException
> --------------------------------------------------------------------------------------------------------
>
> Key: KAFKA-4430
> URL: https://issues.apache.org/jira/browse/KAFKA-4430
> Project: Kafka
> Issue Type: Bug
> Components: core
> Affects Versions: 0.9.0.1
> Environment: Production
> Reporter: Srinivas Dhruvakumar
> Priority: Minor
> Labels: newbie
>
> I have a setup as below
> DC Kafka
> Mirrormaker
> Aggregate Kafka
> Here is the following settings. I have set the max.message.bytes to 1 M on DC and AGG kafka. Mirrormaker producer batch setting is set to 500 KBytes and max.request.size is set to 1 M Byte and ack -> 0 and compression-> gzip .
> However on the Aggregate Kafka I get the following exception
> Closing connection due to error during produce request with correlation id 414156659 from client id producer-1 with ack=0
> KafkaServer.log.3:Topic and partition to exceptions: [topic1,6] -> kafka.common.MessageSizeTooLargeException
> Is this a bug or why would this happen. Noticed that this happens in the Kafka API class. I have configured mirrormaker to send messages less than 1 M Bytes
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)