You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Fredrik S Loekke <fs...@lindcapital.com> on 2014/11/03 16:21:04 UTC
corrupt message
When running a C# producer against a kafka 0.8.1.1 server running on a virtual linux (virtualbox, Ubuntu) I keep getting the following error:
[2014-11-03 15:19:08,595] ERROR [KafkaApi-0] Error processing ProducerRequest with correlation id 601 from client Kafka-Net on partition [xxxxx,0] (kafka.server.KafkaApis)
kafka.message.InvalidMessageException: Message is corrupt (stored crc = 1767811542, computed crc = 1256103753)
at kafka.message.Message.ensureValid(Message.scala:166)
at kafka.log.Log$$anonfun$analyzeAndValidateMessageSet$1.apply(Log.scala:330)
at kafka.log.Log$$anonfun$analyzeAndValidateMessageSet$1.apply(Log.scala:318)
at scala.collection.Iterator$class.foreach(Iterator.scala:772)
at kafka.utils.IteratorTemplate.foreach(IteratorTemplate.scala:32)
at kafka.log.Log.analyzeAndValidateMessageSet(Log.scala:318)
at kafka.log.Log.append(Log.scala:231)
at kafka.cluster.Partition.appendMessagesToLeader(Partition.scala:354)
at kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.scala:376)
at kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.scala:366)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:233)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:233)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95)
at scala.collection.Iterator$class.foreach(Iterator.scala:772)
at scala.collection.mutable.HashTable$$anon$1.foreach(HashTable.scala:157)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:190)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:45)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:95)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:233)
at scala.collection.mutable.HashMap.map(HashMap.scala:45)
at kafka.server.KafkaApis.appendToLocalLog(KafkaApis.scala:366)
at kafka.server.KafkaApis.handleProducerRequest(KafkaApis.scala:292)
at kafka.server.KafkaApis.handle(KafkaApis.scala:185)
at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
at java.lang.Thread.run(Thread.java:745)
Any suggestion on how to resolve this issue?
Best regards / Med venlig hilsen
Fredrik Skeel Løkke
Software Developer ǀ IT & Analysis
Mob.: +45 3176 8438
fsl@lindcapital.com<ma...@lindcapital.com>
[Beskrivelse: Beskrivelse: Beskrivelse: Beskrivelse: cid:image001.png@01CD4A0C.218B6960]
Lind Capital A/S
Værkmestergade 3, 2
DK-8000 Aarhus C
www.lindcapital.com<http://www.lindcapital.com/>
Follow us on
[linkedin]<http://www.linkedin.com/company/lind-capital-a-s> [facebook] <http://www.facebook.com/LindCapital>
Re: corrupt message
Posted by 马哲超 <ma...@gmail.com>.
I've got almost the same error, but also haven't figured out the reason.
2014-11-07 9:05 GMT+08:00 Neha Narkhede <ne...@gmail.com>:
> This may be due to a bug in the client. Non-java Kafka clients are
> maintained by the individual client owners. You might want to ping the
> owner of your library directly.
>
> On Mon, Nov 3, 2014 at 7:21 AM, Fredrik S Loekke <fs...@lindcapital.com>
> wrote:
>
> > When running a C# producer against a kafka 0.8.1.1 server running on a
> > virtual linux (virtualbox, Ubuntu) I keep getting the following error:
> >
> >
> >
> > [2014-11-03 15:19:08,595] ERROR [KafkaApi-0] Error processing
> > ProducerRequest with correlation id 601 from client Kafka-Net on
> partition
> > [xxxxx,0] (kafka.server.KafkaApis)
> >
> > kafka.message.InvalidMessageException: Message is corrupt (stored crc =
> > 1767811542, computed crc = 1256103753)
> >
> > at kafka.message.Message.ensureValid(Message.scala:166)
> >
> > at
> >
> kafka.log.Log$$anonfun$analyzeAndValidateMessageSet$1.apply(Log.scala:330)
> >
> > at
> >
> kafka.log.Log$$anonfun$analyzeAndValidateMessageSet$1.apply(Log.scala:318)
> >
> > at scala.collection.Iterator$class.foreach(Iterator.scala:772)
> >
> > at
> kafka.utils.IteratorTemplate.foreach(IteratorTemplate.scala:32)
> >
> > at kafka.log.Log.analyzeAndValidateMessageSet(Log.scala:318)
> >
> > at kafka.log.Log.append(Log.scala:231)
> >
> > at
> > kafka.cluster.Partition.appendMessagesToLeader(Partition.scala:354)
> >
> > at
> >
> kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.scala:376)
> >
> > at
> >
> kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.scala:366)
> >
> > at
> >
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:233)
> >
> > at
> >
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:233)
> >
> > at
> >
> scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95)
> >
> > at
> >
> scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95)
> >
> > at scala.collection.Iterator$class.foreach(Iterator.scala:772)
> >
> > at
> > scala.collection.mutable.HashTable$$anon$1.foreach(HashTable.scala:157)
> >
> > at
> >
> scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:190)
> >
> > at
> scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:45)
> >
> > at scala.collection.mutable.HashMap.foreach(HashMap.scala:95)
> >
> > at
> > scala.collection.TraversableLike$class.map(TraversableLike.scala:233)
> >
> > at scala.collection.mutable.HashMap.map(HashMap.scala:45)
> >
> > at kafka.server.KafkaApis.appendToLocalLog(KafkaApis.scala:366)
> >
> > at
> > kafka.server.KafkaApis.handleProducerRequest(KafkaApis.scala:292)
> >
> > at kafka.server.KafkaApis.handle(KafkaApis.scala:185)
> >
> > at
> > kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
> >
> > at java.lang.Thread.run(Thread.java:745)
> >
> >
> >
> > Any suggestion on how to resolve this issue?
> >
> >
> >
> > Best regards / Med venlig hilsen
> >
> >
> >
> > *Fredrik Skeel Løkke*
> >
> > Software Developer ǀ IT & Analysis
> >
> >
> >
> > Mob.: +45 3176 8438
> >
> > fsl@lindcapital.com
> >
> >
> >
> > [image: Beskrivelse: Beskrivelse: Beskrivelse: Beskrivelse:
> > cid:image001.png@01CD4A0C.218B6960]
> >
> >
> >
> > Lind Capital A/S
> >
> > Værkmestergade 3, 2
> >
> > DK-8000 Aarhus C
> >
> > www.lindcapital.com
> >
> > Follow us on
> >
> > [image: linkedin] <http://www.linkedin.com/company/lind-capital-a-s>
> [image:
> > facebook] <http://www.facebook.com/LindCapital>
> >
> >
> >
>
Re: corrupt message
Posted by Neha Narkhede <ne...@gmail.com>.
This may be due to a bug in the client. Non-java Kafka clients are
maintained by the individual client owners. You might want to ping the
owner of your library directly.
On Mon, Nov 3, 2014 at 7:21 AM, Fredrik S Loekke <fs...@lindcapital.com>
wrote:
> When running a C# producer against a kafka 0.8.1.1 server running on a
> virtual linux (virtualbox, Ubuntu) I keep getting the following error:
>
>
>
> [2014-11-03 15:19:08,595] ERROR [KafkaApi-0] Error processing
> ProducerRequest with correlation id 601 from client Kafka-Net on partition
> [xxxxx,0] (kafka.server.KafkaApis)
>
> kafka.message.InvalidMessageException: Message is corrupt (stored crc =
> 1767811542, computed crc = 1256103753)
>
> at kafka.message.Message.ensureValid(Message.scala:166)
>
> at
> kafka.log.Log$$anonfun$analyzeAndValidateMessageSet$1.apply(Log.scala:330)
>
> at
> kafka.log.Log$$anonfun$analyzeAndValidateMessageSet$1.apply(Log.scala:318)
>
> at scala.collection.Iterator$class.foreach(Iterator.scala:772)
>
> at kafka.utils.IteratorTemplate.foreach(IteratorTemplate.scala:32)
>
> at kafka.log.Log.analyzeAndValidateMessageSet(Log.scala:318)
>
> at kafka.log.Log.append(Log.scala:231)
>
> at
> kafka.cluster.Partition.appendMessagesToLeader(Partition.scala:354)
>
> at
> kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.scala:376)
>
> at
> kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.scala:366)
>
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:233)
>
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:233)
>
> at
> scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95)
>
> at
> scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95)
>
> at scala.collection.Iterator$class.foreach(Iterator.scala:772)
>
> at
> scala.collection.mutable.HashTable$$anon$1.foreach(HashTable.scala:157)
>
> at
> scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:190)
>
> at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:45)
>
> at scala.collection.mutable.HashMap.foreach(HashMap.scala:95)
>
> at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:233)
>
> at scala.collection.mutable.HashMap.map(HashMap.scala:45)
>
> at kafka.server.KafkaApis.appendToLocalLog(KafkaApis.scala:366)
>
> at
> kafka.server.KafkaApis.handleProducerRequest(KafkaApis.scala:292)
>
> at kafka.server.KafkaApis.handle(KafkaApis.scala:185)
>
> at
> kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
>
> at java.lang.Thread.run(Thread.java:745)
>
>
>
> Any suggestion on how to resolve this issue?
>
>
>
> Best regards / Med venlig hilsen
>
>
>
> *Fredrik Skeel Løkke*
>
> Software Developer ǀ IT & Analysis
>
>
>
> Mob.: +45 3176 8438
>
> fsl@lindcapital.com
>
>
>
> [image: Beskrivelse: Beskrivelse: Beskrivelse: Beskrivelse:
> cid:image001.png@01CD4A0C.218B6960]
>
>
>
> Lind Capital A/S
>
> Værkmestergade 3, 2
>
> DK-8000 Aarhus C
>
> www.lindcapital.com
>
> Follow us on
>
> [image: linkedin] <http://www.linkedin.com/company/lind-capital-a-s> [image:
> facebook] <http://www.facebook.com/LindCapital>
>
>
>