You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Jayesh <ja...@gmail.com> on 2016/05/31 16:29:52 UTC

Get "Error processing append operation on partition" in bursts (non deterministically)

Hello Everyone,

I have a load of ~10k messages/sec. As the load increases, I see a burst of
following error in Kafka (before everything starts working fine again):
*Error*: ERROR kafka.server.ReplicaManager: [Replica Manager on Broker 22]:
Error processing append operation on partition _topic_name_-_partition_
*Pastebin*: http://pastebin.com/QbkwHJ3W

I'm using the GO Sarama library <https://github.com/Shopify/sarama> as the
producer

Strangely, when I retry the same message it works. I'm using Snappy
Compression while publishing.

Does this issue sound familiar to anyone?


Thank you for your help!