You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by "Mckee, Justin B." <Ju...@gd-ms.com> on 2015/05/05 13:32:11 UTC

Having trouble pushing files to HDFS

Good Morning,

I have created a Nifi flow to grab zip files from a directory, unpack them and then push them to HDFS. I am fairly certain that my configuration of the putHDFS processor is correct, however, when I run the flow I get an error message on the putHDFS processor. The error is listed below. Any ideas as to what could be causing this?

PutHDFS[id=c1e7a37c-9a3c-47ae-bac1-e46ec6859d76] failed to invoke @OnScheduled method due to java.lang.NullPointerException; processor will not be scheduled to run: java.lang.NullPointerException

Any help would be greatly appreciated.

Thanks,

Justin McKee

Re: Having trouble pushing files to HDFS

Posted by Matt Gilman <ma...@gmail.com>.
Justin,

It appears the NPE was address in NIFI-491 [1]. This is currently available
on the develop branch if you want to build a SNAPSHOT locally and will be
included in our 0.1.0-incubating release. It looks as though the NPE is
masking the actual error that is happening here. Unfortunately, without
first running with NIFI-491 applied we don't know what that is (it may be a
simple configuration issue). Let me know if you have any other questions.

Matt

[1] https://issues.apache.org/jira/browse/NIFI-491

On Tue, May 5, 2015 at 8:53 AM, Mckee, Justin B. <Ju...@gd-ms.com>
wrote:

>  Joe,
>
>
>
> Yeah those are never fun to see. I have included the stacktrace that I got
> from that log file below.
>
>
>
> 2015-05-05 06:26:38,430 ERROR [pool-19-thread-16]
> o.a.n.c.s.StandardProcessScheduler Failed to invoke @OnScheduled method due
> to java.lang.NullPointerException
>
>
>
> java.lang.NullPointerException: null
>
>
>
>                 at
> org.apache.nifi.processor.SimpleProcessLogger.addProcessorAndThrowable(SimpleProcessLogger.java:246)
> ~[nifi-framework-core-0.0.1-incubating.jar:0.0.1-incubating]
>
>
>
>                 at
> org.apache.nifi.processor.SimpleProcessLogger.error(SimpleProcessLogger.java:253)
> ~[nifi-framework-core-0.0.1-incubating.jar:0.0.1-incubating]
>
>
>
>                 at
> org.apache.nifi.controller.scheduling.StandardProcessScheduler$4.run(StandardProcessScheduler.java:310)
> ~[nifi-framework-core-0.0.1-incubating.jar:0.0.1-incubating]
>
>
>
>                 at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> [na:1.7.0_45]
>
>
>
>                 at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> [na:1.7.0_45]
>
>
>
>                 at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
>
>
>
> Thanks,
>
>
>
> Justin
>
>
>
> *From:* Joe Witt [mailto:joe.witt@gmail.com]
> *Sent:* Tuesday, May 05, 2015 8:08 AM
> *To:* users@nifi.incubator.apache.org
> *Subject:* Re: Having trouble pushing files to HDFS
>
>
>
> Justin
>
> Seeing a nullpointer is a bug no matter what so thanks for sending this.
> Can you check in the logs directory of nifi to see if the nifi-app.log has
> the full stacktrace and if so send that.
>
> Thanks
> Joe
>
> On May 5, 2015 6:33 AM, "Mckee, Justin B." <Ju...@gd-ms.com> wrote:
>
> Good Morning,
>
>
>
> I have created a Nifi flow to grab zip files from a directory, unpack them
> and then push them to HDFS. I am fairly certain that my configuration of
> the putHDFS processor is correct, however, when I run the flow I get an
> error message on the putHDFS processor. The error is listed below. Any
> ideas as to what could be causing this?
>
>
>
> PutHDFS[id=c1e7a37c-9a3c-47ae-bac1-e46ec6859d76] failed to invoke
> @OnScheduled method due to java.lang.NullPointerException; processor will
> not be scheduled to run: java.lang.NullPointerException
>
>
>
> Any help would be greatly appreciated.
>
>
>
> Thanks,
>
>
>
> Justin McKee
>
>
>

RE: Having trouble pushing files to HDFS

Posted by "Mckee, Justin B." <Ju...@gd-ms.com>.
Joe,

Yeah those are never fun to see. I have included the stacktrace that I got from that log file below.

2015-05-05 06:26:38,430 ERROR [pool-19-thread-16] o.a.n.c.s.StandardProcessScheduler Failed to invoke @OnScheduled method due to java.lang.NullPointerException

java.lang.NullPointerException: null

                at org.apache.nifi.processor.SimpleProcessLogger.addProcessorAndThrowable(SimpleProcessLogger.java:246) ~[nifi-framework-core-0.0.1-incubating.jar:0.0.1-incubating]

                at org.apache.nifi.processor.SimpleProcessLogger.error(SimpleProcessLogger.java:253) ~[nifi-framework-core-0.0.1-incubating.jar:0.0.1-incubating]

                at org.apache.nifi.controller.scheduling.StandardProcessScheduler$4.run(StandardProcessScheduler.java:310) ~[nifi-framework-core-0.0.1-incubating.jar:0.0.1-incubating]

                at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_45]

                at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_45]

                at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]

Thanks,

Justin

From: Joe Witt [mailto:joe.witt@gmail.com]
Sent: Tuesday, May 05, 2015 8:08 AM
To: users@nifi.incubator.apache.org
Subject: Re: Having trouble pushing files to HDFS


Justin

Seeing a nullpointer is a bug no matter what so thanks for sending this.  Can you check in the logs directory of nifi to see if the nifi-app.log has the full stacktrace and if so send that.

Thanks
Joe
On May 5, 2015 6:33 AM, "Mckee, Justin B." <Ju...@gd-ms.com>> wrote:
Good Morning,

I have created a Nifi flow to grab zip files from a directory, unpack them and then push them to HDFS. I am fairly certain that my configuration of the putHDFS processor is correct, however, when I run the flow I get an error message on the putHDFS processor. The error is listed below. Any ideas as to what could be causing this?

PutHDFS[id=c1e7a37c-9a3c-47ae-bac1-e46ec6859d76] failed to invoke @OnScheduled method due to java.lang.NullPointerException; processor will not be scheduled to run: java.lang.NullPointerException

Any help would be greatly appreciated.

Thanks,

Justin McKee

Re: Having trouble pushing files to HDFS

Posted by Joe Witt <jo...@gmail.com>.
Justin

Seeing a nullpointer is a bug no matter what so thanks for sending this.
Can you check in the logs directory of nifi to see if the nifi-app.log has
the full stacktrace and if so send that.

Thanks
Joe
On May 5, 2015 6:33 AM, "Mckee, Justin B." <Ju...@gd-ms.com> wrote:

>  Good Morning,
>
>
>
> I have created a Nifi flow to grab zip files from a directory, unpack them
> and then push them to HDFS. I am fairly certain that my configuration of
> the putHDFS processor is correct, however, when I run the flow I get an
> error message on the putHDFS processor. The error is listed below. Any
> ideas as to what could be causing this?
>
>
>
> PutHDFS[id=c1e7a37c-9a3c-47ae-bac1-e46ec6859d76] failed to invoke
> @OnScheduled method due to java.lang.NullPointerException; processor will
> not be scheduled to run: java.lang.NullPointerException
>
>
>
> Any help would be greatly appreciated.
>
>
>
> Thanks,
>
>
>
> Justin McKee
>
>
>