You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by Juan Pablo Gardella <ga...@gmail.com> on 2017/08/29 12:41:27 UTC
NPE at ConsumeKafka_0_10
Hi all,
I was using ConsumerKafka_0_10 processor and yesterday I saw the following
error, the gist
<https://gist.githubusercontent.com/gardellajuanpablo/941a19dd11786cf1758f49ba0fdaeaf8/raw/506a3943c0492cef6f4ff9093475c8c04b35965a/gistfile1.txt>is
here for the log. The issue prevents consume data.
logs1/nifi-app_2017-08-28_16.0.log:2017-08-28 16:52:11,379 ERROR
[Timer-Driven Process Thread-3] o.a.n.p.kafka.pubsub.ConsumeKafka_0_10
ConsumeKafka_0_10[id=8d493045-3a66-146a-9581-5b01d5575
186] Exception while processing data from kafka so will close the
lease org.apache.nifi.processors.kafka.pubsub.ConsumerPool$SimpleConsumerLease@3c3de236
due to java.lang.NullPointerExceptio
n: java.lang.NullPointerException
logs1/nifi-app_2017-08-28_16.0.log-java.lang.NullPointerException:
null*logs1/nifi-app_2017-08-28_16.0.log- at
org.apache.nifi.stream.io.ByteCountingOutputStream.write(ByteCountingOutputStream.java:44)
*logs1/nifi-app_2017-08-28_16.0.log- at
org.apache.nifi.controller.repository.io.FlowFileAccessOutputStream.write(FlowFileAccessOutputStream.java:78)
logs1/nifi-app_2017-08-28_16.0.log- at
org.apache.nifi.processors.kafka.pubsub.ConsumerLease.lambda$writeData$9(ConsumerLease.java:382)
logs1/nifi-app_2017-08-28_16.0.log- at
org.apache.nifi.controller.repository.StandardProcessSession.write(StandardProcessSession.java:2529)
logs1/nifi-app_2017-08-28_16.0.log- at
org.apache.nifi.processors.kafka.pubsub.ConsumerLease.writeData(ConsumerLease.java:381)
logs1/nifi-app_2017-08-28_16.0.log- at
org.apache.nifi.processors.kafka.pubsub.ConsumerLease.lambda$null$7(ConsumerLease.java:323)
logs1/nifi-app_2017-08-28_16.0.log- at
java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1374)
logs1/nifi-app_2017-08-28_16.0.log- at
java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580)
logs1/nifi-app_2017-08-28_16.0.log- at
org.apache.nifi.processors.kafka.pubsub.ConsumerLease.lambda$processRecords$8(ConsumerLease.java:322)
logs1/nifi-app_2017-08-28_16.0.log- at
java.util.HashMap$KeySpliterator.forEachRemaining(HashMap.java:1548)
logs1/nifi-app_2017-08-28_16.0.log- at
java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580)
logs1/nifi-app_2017-08-28_16.0.log- at
org.apache.nifi.processors.kafka.pubsub.ConsumerLease.processRecords(ConsumerLease.java:307)
logs1/nifi-app_2017-08-28_16.0.log- at
org.apache.nifi.processors.kafka.pubsub.ConsumerLease.poll(ConsumerLease.java:168)
logs1/nifi-app_2017-08-28_16.0.log- at
org.apache.nifi.processors.kafka.pubsub.ConsumeKafka_0_10.onTrigger(ConsumeKafka_0_10.java:317)
logs1/nifi-app_2017-08-28_16.0.log- at
org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
logs1/nifi-app_2017-08-28_16.0.log- at
org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1120)
logs1/nifi-app_2017-08-28_16.0.log- at
org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)
logs1/nifi-app_2017-08-28_16.0.log- at
org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
logs1/nifi-app_2017-08-28_16.0.log- at
org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132)
logs1/nifi-app_2017-08-28_16.0.log- at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
logs1/nifi-app_2017-08-28_16.0.log- at
java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
logs1/nifi-app_2017-08-28_16.0.log- at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
logs1/nifi-app_2017-08-28_16.0.log- at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
logs1/nifi-app_2017-08-28_16.0.log- at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
logs1/nifi-app_2017-08-28_16.0.log- at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
logs1/nifi-app_2017-08-28_16.0.log- at java.lang.Thread.run(Thread.java:745)
Thanks
Re: NPE at ConsumeKafka_0_10
Posted by Juan Pablo Gardella <ga...@gmail.com>.
Thanks a lot!
On Tue, 29 Aug 2017 at 10:23 Mark Payne <ma...@hotmail.com> wrote:
> Juan,
>
> From looking at the source code, I *think* the issue is that you've got a
> record in the Kafka topic that
> has a null value. To be honest, I didn't realize that this was even
> possible, but Kafka's JavaDocs do
> imply that it is. I created a JIRA [1] to address this.
>
> Thanks
> -Mark
>
> [1] https://issues.apache.org/jira/browse/NIFI-4330
>
>
> On Aug 29, 2017, at 9:04 AM, Juan Pablo Gardella <
> gardellajuanpablo@gmail.com> wrote:
>
> Sure:
>
>
> <image.png>
>
>
> On Tue, 29 Aug 2017 at 10:00 Pierre Villard <pi...@gmail.com>
> wrote:
>
>> Hi Juan,
>>
>> Could you provide your processor configuration?
>>
>> Thanks!
>>
>> 2017-08-29 14:41 GMT+02:00 Juan Pablo Gardella <
>> gardellajuanpablo@gmail.com>:
>>
>>> Hi all,
>>>
>>> I was using ConsumerKafka_0_10 processor and yesterday I saw the
>>> following error, the gist
>>> <https://gist.githubusercontent.com/gardellajuanpablo/941a19dd11786cf1758f49ba0fdaeaf8/raw/506a3943c0492cef6f4ff9093475c8c04b35965a/gistfile1.txt>is
>>> here for the log. The issue prevents consume data.
>>>
>>> logs1/nifi-app_2017-08-28_16.0.log:2017-08-28 16:52:11,379 ERROR [Timer-Driven Process Thread-3] o.a.n.p.kafka.pubsub.ConsumeKafka_0_10 ConsumeKafka_0_10[id=8d493045-3a66-146a-9581-5b01d5575
>>> 186] Exception while processing data from kafka so will close the lease org.apache.nifi.processors.kafka.pubsub.ConsumerPool$SimpleConsumerLease@3c3de236 due to java.lang.NullPointerExceptio
>>> n: java.lang.NullPointerException
>>> logs1/nifi-app_2017-08-28_16.0.log-java.lang.NullPointerException: null*logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.stream.io <http://org.apache.nifi.stream.io/>.ByteCountingOutputStream.write(ByteCountingOutputStream.java:44)
>>> *logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.repository.io.FlowFileAccessOutputStream.write(FlowFileAccessOutputStream.java:78)
>>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.lambda$writeData$9(ConsumerLease.java:382)
>>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.repository.StandardProcessSession.write(StandardProcessSession.java:2529)
>>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.writeData(ConsumerLease.java:381)
>>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.lambda$null$7(ConsumerLease.java:323)
>>> logs1/nifi-app_2017-08-28_16.0.log- at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1374)
>>> logs1/nifi-app_2017-08-28_16.0.log- at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580)
>>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.lambda$processRecords$8(ConsumerLease.java:322)
>>> logs1/nifi-app_2017-08-28_16.0.log- at java.util.HashMap$KeySpliterator.forEachRemaining(HashMap.java:1548)
>>> logs1/nifi-app_2017-08-28_16.0.log- at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580)
>>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.processRecords(ConsumerLease.java:307)
>>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.poll(ConsumerLease.java:168)
>>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumeKafka_0_10.onTrigger(ConsumeKafka_0_10.java:317)
>>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
>>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1120)
>>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)
>>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
>>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132)
>>> logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>>> logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
>>> logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
>>> logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
>>> logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>> logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>> logs1/nifi-app_2017-08-28_16.0.log- at java.lang.Thread.run(Thread.java:745)
>>>
>>> Thanks
>>>
>>>
>>
Re: NPE at ConsumeKafka_0_10
Posted by Mark Payne <ma...@hotmail.com>.
Juan,
From looking at the source code, I *think* the issue is that you've got a record in the Kafka topic that
has a null value. To be honest, I didn't realize that this was even possible, but Kafka's JavaDocs do
imply that it is. I created a JIRA [1] to address this.
Thanks
-Mark
[1] https://issues.apache.org/jira/browse/NIFI-4330
On Aug 29, 2017, at 9:04 AM, Juan Pablo Gardella <ga...@gmail.com>> wrote:
Sure:
<image.png>
On Tue, 29 Aug 2017 at 10:00 Pierre Villard <pi...@gmail.com>> wrote:
Hi Juan,
Could you provide your processor configuration?
Thanks!
2017-08-29 14:41 GMT+02:00 Juan Pablo Gardella <ga...@gmail.com>>:
Hi all,
I was using ConsumerKafka_0_10 processor and yesterday I saw the following error, the gist <https://gist.githubusercontent.com/gardellajuanpablo/941a19dd11786cf1758f49ba0fdaeaf8/raw/506a3943c0492cef6f4ff9093475c8c04b35965a/gistfile1.txt> is here for the log. The issue prevents consume data.
logs1/nifi-app_2017-08-28_16.0.log:2017-08-28 16:52:11,379 ERROR [Timer-Driven Process Thread-3] o.a.n.p.kafka.pubsub.ConsumeKafka_0_10 ConsumeKafka_0_10[id=8d493045-3a66-146a-9581-5b01d5575
186] Exception while processing data from kafka so will close the lease org.apache.nifi.processors.kafka.pubsub.ConsumerPool$SimpleConsumerLease@3c3de236 due to java.lang.NullPointerExceptio
n: java.lang.NullPointerException
logs1/nifi-app_2017-08-28_16.0.log-java.lang.NullPointerException: null
logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.stream.io<http://org.apache.nifi.stream.io/>.ByteCountingOutputStream.write(ByteCountingOutputStream.java:44)
logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.repository.io<http://repository.io/>.FlowFileAccessOutputStream.write(FlowFileAccessOutputStream.java:78)
logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.lambda$writeData$9(ConsumerLease.java:382)
logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.repository.StandardProcessSession.write(StandardProcessSession.java:2529)
logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.writeData(ConsumerLease.java:381)
logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.lambda$null$7(ConsumerLease.java:323)
logs1/nifi-app_2017-08-28_16.0.log- at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1374)
logs1/nifi-app_2017-08-28_16.0.log- at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580)
logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.lambda$processRecords$8(ConsumerLease.java:322)
logs1/nifi-app_2017-08-28_16.0.log- at java.util.HashMap$KeySpliterator.forEachRemaining(HashMap.java:1548)
logs1/nifi-app_2017-08-28_16.0.log- at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580)
logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.processRecords(ConsumerLease.java:307)
logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.poll(ConsumerLease.java:168)
logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumeKafka_0_10.onTrigger(ConsumeKafka_0_10.java:317)
logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1120)
logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)
logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132)
logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
logs1/nifi-app_2017-08-28_16.0.log- at java.lang.Thread.run(Thread.java:745)
Thanks
Re: NPE at ConsumeKafka_0_10
Posted by Juan Pablo Gardella <ga...@gmail.com>.
Sure:
[image: image.png]
On Tue, 29 Aug 2017 at 10:00 Pierre Villard <pi...@gmail.com>
wrote:
> Hi Juan,
>
> Could you provide your processor configuration?
>
> Thanks!
>
> 2017-08-29 14:41 GMT+02:00 Juan Pablo Gardella <
> gardellajuanpablo@gmail.com>:
>
>> Hi all,
>>
>> I was using ConsumerKafka_0_10 processor and yesterday I saw the
>> following error, the gist
>> <https://gist.githubusercontent.com/gardellajuanpablo/941a19dd11786cf1758f49ba0fdaeaf8/raw/506a3943c0492cef6f4ff9093475c8c04b35965a/gistfile1.txt>is
>> here for the log. The issue prevents consume data.
>>
>> logs1/nifi-app_2017-08-28_16.0.log:2017-08-28 16:52:11,379 ERROR [Timer-Driven Process Thread-3] o.a.n.p.kafka.pubsub.ConsumeKafka_0_10 ConsumeKafka_0_10[id=8d493045-3a66-146a-9581-5b01d5575
>> 186] Exception while processing data from kafka so will close the lease org.apache.nifi.processors.kafka.pubsub.ConsumerPool$SimpleConsumerLease@3c3de236 due to java.lang.NullPointerExceptio
>> n: java.lang.NullPointerException
>> logs1/nifi-app_2017-08-28_16.0.log-java.lang.NullPointerException: null*logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.stream.io <http://org.apache.nifi.stream.io>.ByteCountingOutputStream.write(ByteCountingOutputStream.java:44)
>> *logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.repository.io.FlowFileAccessOutputStream.write(FlowFileAccessOutputStream.java:78)
>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.lambda$writeData$9(ConsumerLease.java:382)
>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.repository.StandardProcessSession.write(StandardProcessSession.java:2529)
>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.writeData(ConsumerLease.java:381)
>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.lambda$null$7(ConsumerLease.java:323)
>> logs1/nifi-app_2017-08-28_16.0.log- at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1374)
>> logs1/nifi-app_2017-08-28_16.0.log- at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580)
>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.lambda$processRecords$8(ConsumerLease.java:322)
>> logs1/nifi-app_2017-08-28_16.0.log- at java.util.HashMap$KeySpliterator.forEachRemaining(HashMap.java:1548)
>> logs1/nifi-app_2017-08-28_16.0.log- at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580)
>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.processRecords(ConsumerLease.java:307)
>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.poll(ConsumerLease.java:168)
>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumeKafka_0_10.onTrigger(ConsumeKafka_0_10.java:317)
>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1120)
>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)
>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
>> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132)
>> logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>> logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
>> logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
>> logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
>> logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>> logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>> logs1/nifi-app_2017-08-28_16.0.log- at java.lang.Thread.run(Thread.java:745)
>>
>> Thanks
>>
>>
>
Re: NPE at ConsumeKafka_0_10
Posted by Pierre Villard <pi...@gmail.com>.
Hi Juan,
Could you provide your processor configuration?
Thanks!
2017-08-29 14:41 GMT+02:00 Juan Pablo Gardella <ga...@gmail.com>
:
> Hi all,
>
> I was using ConsumerKafka_0_10 processor and yesterday I saw the following
> error, the gist
> <https://gist.githubusercontent.com/gardellajuanpablo/941a19dd11786cf1758f49ba0fdaeaf8/raw/506a3943c0492cef6f4ff9093475c8c04b35965a/gistfile1.txt>is
> here for the log. The issue prevents consume data.
>
> logs1/nifi-app_2017-08-28_16.0.log:2017-08-28 16:52:11,379 ERROR [Timer-Driven Process Thread-3] o.a.n.p.kafka.pubsub.ConsumeKafka_0_10 ConsumeKafka_0_10[id=8d493045-3a66-146a-9581-5b01d5575
> 186] Exception while processing data from kafka so will close the lease org.apache.nifi.processors.kafka.pubsub.ConsumerPool$SimpleConsumerLease@3c3de236 due to java.lang.NullPointerExceptio
> n: java.lang.NullPointerException
> logs1/nifi-app_2017-08-28_16.0.log-java.lang.NullPointerException: null*logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.stream.io <http://org.apache.nifi.stream.io>.ByteCountingOutputStream.write(ByteCountingOutputStream.java:44)
> *logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.repository.io.FlowFileAccessOutputStream.write(FlowFileAccessOutputStream.java:78)
> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.lambda$writeData$9(ConsumerLease.java:382)
> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.repository.StandardProcessSession.write(StandardProcessSession.java:2529)
> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.writeData(ConsumerLease.java:381)
> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.lambda$null$7(ConsumerLease.java:323)
> logs1/nifi-app_2017-08-28_16.0.log- at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1374)
> logs1/nifi-app_2017-08-28_16.0.log- at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580)
> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.lambda$processRecords$8(ConsumerLease.java:322)
> logs1/nifi-app_2017-08-28_16.0.log- at java.util.HashMap$KeySpliterator.forEachRemaining(HashMap.java:1548)
> logs1/nifi-app_2017-08-28_16.0.log- at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580)
> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.processRecords(ConsumerLease.java:307)
> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumerLease.poll(ConsumerLease.java:168)
> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processors.kafka.pubsub.ConsumeKafka_0_10.onTrigger(ConsumeKafka_0_10.java:317)
> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1120)
> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)
> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
> logs1/nifi-app_2017-08-28_16.0.log- at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132)
> logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
> logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> logs1/nifi-app_2017-08-28_16.0.log- at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> logs1/nifi-app_2017-08-28_16.0.log- at java.lang.Thread.run(Thread.java:745)
>
> Thanks
>
>