You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@nifi.apache.org by KhajaAsmath Mohammed <md...@gmail.com> on 2020/02/05 21:27:13 UTC

COnsumekakarecord error messages

Hi,

I was able to consume messages from consumekafkarecord processor. Suddenly
I started getting below error. any solutions for this please?

[image: image.png]

Thanks,
Asmath

Re: COnsumekakarecord error messages

Posted by Mike Thomsen <mi...@gmail.com>.

I think what Pierre might be getting at is that someone or something else
besides NiFi might have dropped invalid data into your Kafka queue. If NiFi
is writing to Kafka and consuming from it too, odds are low (but not
impossible) that it's NiFi. I'd consider setting up a little script to read
the impacted topic and see if anything looks off. Could be someone did
something like connect with the console producer and try to put a message
in there to test something.

On Wed, Feb 5, 2020 at 5:09 PM KhajaAsmath Mohammed <md...@gmail.com>
wrote:

> I am using json record reader and json record set writer in consume kafka.
> Do I need to change these record readers just to confirm about the corrupt
> data? Can you help me what readers should I use in that case ?
>
> Sent from my iPhone
>
> On Feb 5, 2020, at 3:47 PM, Pierre Villard <pi...@gmail.com>
> wrote:
>
> 
> Hi,
>
> It seems like you have a message that cannot be parsed correctly by your
> record processor. It is probably not matching your schema or containing
> some corrupted data? You could use a the non record ConsumeKafka processor
> to get the message without doing any parsing and see what the message looks
> like.
>
> HTH
> Pierre
>
> Le mer. 5 févr. 2020 à 16:27, KhajaAsmath Mohammed <
> mdkhajaasmath@gmail.com> a écrit :
>
>> Hi,
>>
>> I was able to consume messages from consumekafkarecord processor.
>> Suddenly I started getting below error. any solutions for this please?
>>
>> <image.png>
>>
>>
>> Thanks,
>> Asmath
>>
>

Re: COnsumekakarecord error messages

Posted by KhajaAsmath Mohammed <md...@gmail.com>.

I am using json record reader and json record set writer in consume kafka. Do I need to change these record readers just to confirm about the corrupt data? Can you help me what readers should I use in that case ?

Sent from my iPhone

> On Feb 5, 2020, at 3:47 PM, Pierre Villard <pi...@gmail.com> wrote:
> 
> 
> Hi,
> 
> It seems like you have a message that cannot be parsed correctly by your record processor. It is probably not matching your schema or containing some corrupted data? You could use a the non record ConsumeKafka processor to get the message without doing any parsing and see what the message looks like.
> 
> HTH
> Pierre
> 
>> Le mer. 5 févr. 2020 à 16:27, KhajaAsmath Mohammed <md...@gmail.com> a écrit :
>> Hi,
>> 
>> I was able to consume messages from consumekafkarecord processor. Suddenly I started getting below error. any solutions for this please?
>> 
>> <image.png>
>> 
>> 
>> Thanks,
>> Asmath

Re: COnsumekakarecord error messages

Posted by Pierre Villard <pi...@gmail.com>.

Hi,

It seems like you have a message that cannot be parsed correctly by your
record processor. It is probably not matching your schema or containing
some corrupted data? You could use a the non record ConsumeKafka processor
to get the message without doing any parsing and see what the message looks
like.

HTH
Pierre

Le mer. 5 févr. 2020 à 16:27, KhajaAsmath Mohammed <md...@gmail.com>
a écrit :

> Hi,
>
> I was able to consume messages from consumekafkarecord processor. Suddenly
> I started getting below error. any solutions for this please?
>
> [image: image.png]
>
> Thanks,
> Asmath
>