You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nifi.apache.org by Chakrader Dewaragatla <Ch...@lifelock.com> on 2016/01/21 00:23:51 UTC
Httplistener processor exception
Hi – We are seeing the following exception on https listener processor. Below stacks are from a custom processor (GetDataSet) which use httplistener snip of code to listen. Any insight on this ?
Custom processor Stack :
2016-01-20 23:13:57,287 ERROR [Timer-Driven Process Thread-7] c.l.d.e.nifi.processors.GetDataSet GetDataSet[id=284813ac-9247-4442-a312-d67856a41ac3] [com.lifelock.dataplatform.commons.datareader.HttpsListenerDataReader.getNextDataRecord(HttpsListenerDataReader.java:214), com.lifelock.dataacquisition.executor.nifi.processors.GetDataSet.onTriggerImpl(GetDataSet.java:163), com.lifelock.dataacquisition.executor.nifi.processors.LLDataPlatformAbstractProcessor.onTrigger(LLDataPlatformAbstractProcessor.java:51), org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27), org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1146), org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:139), org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:49), org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:119), java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471), java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304), java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178), java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293), java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145), java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615), java.lang.Thread.run(Thread.java:745)]
Httphandler processor stack:
2016-01-15 20:18:39,257 WARN [Timer-Driven Process Thread-8] org.eclipse.jetty.io.FillInterest Read pending for AC.ReadCB@3dab9888{HttpConnection@3dab9888{FILLING_INTERESTED_CALLBACK(FILL_INTERESTED)}} prevented org.eclipse.jetty.io.AbstractConnection$FillingInterestedCallback$1@4cab2859
2016-01-15 20:18:39,258 WARN [Timer-Driven Process Thread-8] o.e.jetty.util.SharedBlockingCallback Blocker not complete Blocker@48c0dc49{null}
2016-01-15 20:18:39,258 ERROR [Timer-Driven Process Thread-8] o.a.n.p.standard.HandleHttpRequest HandleHttpRequest[id=c3de05b5-a978-4860-b1b8-6ad179ccb556] HandleHttpRequest[id=c3de05b5-a978-4860-b1b8-6ad179ccb556] failed to process due to org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import data from HttpInputOverHTTP@6dbe61ef for StandardFlowFileRecord[uuid=ba0d75ea-61ae-43c7-8b63-33455811c499,claim=,offset=0,name=7533831837998,size=0] due to java.nio.channels.ReadPendingException; rolling back session: org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import data from HttpInputOverHTTP@6dbe61ef for StandardFlowFileRecord[uuid=ba0d75ea-61ae-43c7-8b63-33455811c499,claim=,offset=0,name=7533831837998,size=0] due to java.nio.channels.ReadPendingException
2016-01-15 20:18:39,258 ERROR [Timer-Driven Process Thread-8] o.a.n.p.standard.HandleHttpRequest HandleHttpRequest[id=c3de05b5-a978-4860-b1b8-6ad179ccb556] HandleHttpRequest[id=c3de05b5-a978-4860-b1b8-6ad179ccb556] failed to process session due to org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import data from HttpInputOverHTTP@6dbe61ef for StandardFlowFileRecord[uuid=ba0d75ea-61ae-43c7-8b63-33455811c499,claim=,offset=0,name=7533831837998,size=0] due to java.nio.channels.ReadPendingException: org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import data from HttpInputOverHTTP@6dbe61ef for StandardFlowFileRecord[uuid=ba0d75ea-61ae-43c7-8b63-33455811c499,claim=,offset=0,name=7533831837998,size=0] due to java.nio.channels.ReadPendingException
2016-01-15 20:18:39,258 WARN [Timer-Driven Process Thread-8] o.a.n.p.standard.HandleHttpRequest HandleHttpRequest[id=c3de05b5-a978-4860-b1b8-6ad179ccb556] Processor Administratively Yielded for 1 sec due to processing failure
2016-01-15 20:18:39,258 WARN [Timer-Driven Process Thread-8] o.a.n.c.t.ContinuallyRunProcessorTask Administratively Yielding HandleHttpRequest[id=c3de05b5-a978-4860-b1b8-6ad179ccb556] due to uncaught Exception: org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import data from HttpInputOverHTTP@6dbe61ef for StandardFlowFileRecord[uuid=ba0d75ea-61ae-43c7-8b63-33455811c499,claim=,offset=0,name=7533831837998,size=0] due to java.nio.channels.ReadPendingException
2016-01-15 20:18:39,259 WARN [Timer-Driven Process Thread-8] o.a.n.c.t.ContinuallyRunProcessorTask
org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import data from HttpInputOverHTTP@6dbe61ef for StandardFlowFileRecord[uuid=ba0d75ea-61ae-43c7-8b63-33455811c499,claim=,offset=0,name=7533831837998,size=0] due to java.nio.channels.ReadPendingException
at org.apache.nifi.controller.repository.StandardProcessSession.importFrom(StandardProcessSession.java:2280) ~[nifi-framework-core-0.4.1.jar:0.4.1]
at org.apache.nifi.processors.standard.HandleHttpRequest.onTrigger(HandleHttpRequest.java:485) ~[na:na]
at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27) ~[nifi-api-0.4.1.jar:0.4.1]
at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1146) ~[nifi-framework-core-0.4.1.jar:0.4.1]
at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:139) [nifi-framework-core-0.4.1.jar:0.4.1]
at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:49) [nifi-framework-core-0.4.1.jar:0.4.1]
at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:119) [nifi-framework-core-0.4.1.jar:0.4.1]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [na:1.7.0_60]
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) [na:1.7.0_60]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) [na:1.7.0_60]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [na:1.7.0_60]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_60]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_60]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_60]
Caused by: java.nio.channels.ReadPendingException: null
at org.eclipse.jetty.io.FillInterest.register(FillInterest.java:62) ~[jetty-io-9.2.11.v20150529.jar:9.2.11.v20150529]
at org.eclipse.jetty.io.AbstractEndPoint.fillInterested(AbstractEndPoint.java:123) ~[jetty-io-9.2.11.v20150529.jar:9.2.11.v20150529]
at org.eclipse.jetty.io.AbstractConnection$FillingInterestedCallback.onEnter(AbstractConnection.java:529) ~[jetty-io-9.2.11.v20150529.jar:9.2.11.v20150529]
at org.eclipse.jetty.io.AbstractConnection.next(AbstractConnection.java:273) ~[jetty-io-9.2.11.v20150529.jar:9.2.11.v20150529]
at org.eclipse.jetty.io.AbstractConnection.fillInterested(AbstractConnection.java:150) ~[jetty-io-9.2.11.v20150529.jar:9.2.11.v20150529]
at org.eclipse.jetty.server.HttpInputOverHTTP.blockForContent(HttpInputOverHTTP.java:63) ~[jetty-server-9.2.11.v20150529.jar:9.2.11.v20150529]
at org.eclipse.jetty.server.HttpInput$1.waitForContent(HttpInput.java:476) ~[jetty-server-9.2.11.v20150529.jar:9.2.11.v20150529]
at org.eclipse.jetty.server.HttpInput.read(HttpInput.java:121) ~[jetty-server-9.2.11.v20150529.jar:9.2.11.v20150529]
at java.io.InputStream.read(InputStream.java:101) ~[na:1.7.0_60]
at org.apache.nifi.stream.io.StreamUtils.copy(StreamUtils.java:35) ~[nifi-utils-0.4.1.jar:0.4.1]
at org.apache.nifi.controller.repository.FileSystemRepository.importFrom(FileSystemRepository.java:698) ~[nifi-framework-core-0.4.1.jar:0.4.1]
at org.apache.nifi.controller.repository.StandardProcessSession.importFrom(StandardProcessSession.java:2270) ~[nifi-framework-core-0.4.1.jar:0.4.1]
... 13 common frames omitted
Thanks,
-Chakri
________________________________
The information contained in this transmission may contain privileged and confidential information. It is intended only for the use of the person(s) named above. If you are not the intended recipient, you are hereby notified that any review, dissemination, distribution or duplication of this communication is strictly prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message.
________________________________
Re: Httplistener processor exception
Posted by Joe Witt <jo...@gmail.com>.
Chakri
I believe it would be tough to provide specific assistance without
seeing the code for the custom processor. However, this exception
'ReadPendingException' implies to me there are multiple read attempts
happening on the same stream [1].
[1] https://docs.oracle.com/javase/7/docs/api/java/nio/channels/ReadPendingException.html
Perhaps check if there are threading/object reuse issues.
Thanks
Joe
On Wed, Jan 20, 2016 at 6:23 PM, Chakrader Dewaragatla
<Ch...@lifelock.com> wrote:
>
> Hi – We are seeing the following exception on https listener processor. Below stacks are from a custom processor (GetDataSet) which use httplistener snip of code to listen. Any insight on this ?
>
>
> Custom processor Stack :
>
> 2016-01-20 23:13:57,287 ERROR [Timer-Driven Process Thread-7] c.l.d.e.nifi.processors.GetDataSet GetDataSet[id=284813ac-9247-4442-a312-d67856a41ac3] [com.lifelock.dataplatform.commons.datareader.HttpsListenerDataReader.getNextDataRecord(HttpsListenerDataReader.java:214), com.lifelock.dataacquisition.executor.nifi.processors.GetDataSet.onTriggerImpl(GetDataSet.java:163), com.lifelock.dataacquisition.executor.nifi.processors.LLDataPlatformAbstractProcessor.onTrigger(LLDataPlatformAbstractProcessor.java:51), org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27), org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1146), org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:139), org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:49), org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:119), java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471), java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304), java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178), java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293), java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145), java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615), java.lang.Thread.run(Thread.java:745)]
>
>
>
> Httphandler processor stack:
>
>
> 2016-01-15 20:18:39,257 WARN [Timer-Driven Process Thread-8] org.eclipse.jetty.io.FillInterest Read pending for AC.ReadCB@3dab9888{HttpConnection@3dab9888{FILLING_INTERESTED_CALLBACK(FILL_INTERESTED)}} prevented org.eclipse.jetty.io.AbstractConnection$FillingInterestedCallback$1@4cab2859
>
> 2016-01-15 20:18:39,258 WARN [Timer-Driven Process Thread-8] o.e.jetty.util.SharedBlockingCallback Blocker not complete Blocker@48c0dc49{null}
>
> 2016-01-15 20:18:39,258 ERROR [Timer-Driven Process Thread-8] o.a.n.p.standard.HandleHttpRequest HandleHttpRequest[id=c3de05b5-a978-4860-b1b8-6ad179ccb556] HandleHttpRequest[id=c3de05b5-a978-4860-b1b8-6ad179ccb556] failed to process due to org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import data from HttpInputOverHTTP@6dbe61ef for StandardFlowFileRecord[uuid=ba0d75ea-61ae-43c7-8b63-33455811c499,claim=,offset=0,name=7533831837998,size=0] due to java.nio.channels.ReadPendingException; rolling back session: org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import data from HttpInputOverHTTP@6dbe61ef for StandardFlowFileRecord[uuid=ba0d75ea-61ae-43c7-8b63-33455811c499,claim=,offset=0,name=7533831837998,size=0] due to java.nio.channels.ReadPendingException
>
> 2016-01-15 20:18:39,258 ERROR [Timer-Driven Process Thread-8] o.a.n.p.standard.HandleHttpRequest HandleHttpRequest[id=c3de05b5-a978-4860-b1b8-6ad179ccb556] HandleHttpRequest[id=c3de05b5-a978-4860-b1b8-6ad179ccb556] failed to process session due to org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import data from HttpInputOverHTTP@6dbe61ef for StandardFlowFileRecord[uuid=ba0d75ea-61ae-43c7-8b63-33455811c499,claim=,offset=0,name=7533831837998,size=0] due to java.nio.channels.ReadPendingException: org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import data from HttpInputOverHTTP@6dbe61ef for StandardFlowFileRecord[uuid=ba0d75ea-61ae-43c7-8b63-33455811c499,claim=,offset=0,name=7533831837998,size=0] due to java.nio.channels.ReadPendingException
>
> 2016-01-15 20:18:39,258 WARN [Timer-Driven Process Thread-8] o.a.n.p.standard.HandleHttpRequest HandleHttpRequest[id=c3de05b5-a978-4860-b1b8-6ad179ccb556] Processor Administratively Yielded for 1 sec due to processing failure
>
> 2016-01-15 20:18:39,258 WARN [Timer-Driven Process Thread-8] o.a.n.c.t.ContinuallyRunProcessorTask Administratively Yielding HandleHttpRequest[id=c3de05b5-a978-4860-b1b8-6ad179ccb556] due to uncaught Exception: org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import data from HttpInputOverHTTP@6dbe61ef for StandardFlowFileRecord[uuid=ba0d75ea-61ae-43c7-8b63-33455811c499,claim=,offset=0,name=7533831837998,size=0] due to java.nio.channels.ReadPendingException
>
> 2016-01-15 20:18:39,259 WARN [Timer-Driven Process Thread-8] o.a.n.c.t.ContinuallyRunProcessorTask
>
> org.apache.nifi.processor.exception.FlowFileAccessException: Failed to import data from HttpInputOverHTTP@6dbe61ef for StandardFlowFileRecord[uuid=ba0d75ea-61ae-43c7-8b63-33455811c499,claim=,offset=0,name=7533831837998,size=0] due to java.nio.channels.ReadPendingException
>
> at org.apache.nifi.controller.repository.StandardProcessSession.importFrom(StandardProcessSession.java:2280) ~[nifi-framework-core-0.4.1.jar:0.4.1]
>
> at org.apache.nifi.processors.standard.HandleHttpRequest.onTrigger(HandleHttpRequest.java:485) ~[na:na]
>
> at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27) ~[nifi-api-0.4.1.jar:0.4.1]
>
> at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1146) ~[nifi-framework-core-0.4.1.jar:0.4.1]
>
> at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:139) [nifi-framework-core-0.4.1.jar:0.4.1]
>
> at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:49) [nifi-framework-core-0.4.1.jar:0.4.1]
>
> at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:119) [nifi-framework-core-0.4.1.jar:0.4.1]
>
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [na:1.7.0_60]
>
> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) [na:1.7.0_60]
>
> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) [na:1.7.0_60]
>
> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [na:1.7.0_60]
>
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_60]
>
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_60]
>
> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_60]
>
> Caused by: java.nio.channels.ReadPendingException: null
>
> at org.eclipse.jetty.io.FillInterest.register(FillInterest.java:62) ~[jetty-io-9.2.11.v20150529.jar:9.2.11.v20150529]
>
> at org.eclipse.jetty.io.AbstractEndPoint.fillInterested(AbstractEndPoint.java:123) ~[jetty-io-9.2.11.v20150529.jar:9.2.11.v20150529]
>
> at org.eclipse.jetty.io.AbstractConnection$FillingInterestedCallback.onEnter(AbstractConnection.java:529) ~[jetty-io-9.2.11.v20150529.jar:9.2.11.v20150529]
>
> at org.eclipse.jetty.io.AbstractConnection.next(AbstractConnection.java:273) ~[jetty-io-9.2.11.v20150529.jar:9.2.11.v20150529]
>
> at org.eclipse.jetty.io.AbstractConnection.fillInterested(AbstractConnection.java:150) ~[jetty-io-9.2.11.v20150529.jar:9.2.11.v20150529]
>
> at org.eclipse.jetty.server.HttpInputOverHTTP.blockForContent(HttpInputOverHTTP.java:63) ~[jetty-server-9.2.11.v20150529.jar:9.2.11.v20150529]
>
> at org.eclipse.jetty.server.HttpInput$1.waitForContent(HttpInput.java:476) ~[jetty-server-9.2.11.v20150529.jar:9.2.11.v20150529]
>
> at org.eclipse.jetty.server.HttpInput.read(HttpInput.java:121) ~[jetty-server-9.2.11.v20150529.jar:9.2.11.v20150529]
>
> at java.io.InputStream.read(InputStream.java:101) ~[na:1.7.0_60]
>
> at org.apache.nifi.stream.io.StreamUtils.copy(StreamUtils.java:35) ~[nifi-utils-0.4.1.jar:0.4.1]
>
> at org.apache.nifi.controller.repository.FileSystemRepository.importFrom(FileSystemRepository.java:698) ~[nifi-framework-core-0.4.1.jar:0.4.1]
>
> at org.apache.nifi.controller.repository.StandardProcessSession.importFrom(StandardProcessSession.java:2270) ~[nifi-framework-core-0.4.1.jar:0.4.1]
>
> ... 13 common frames omitted
>
>
> Thanks,
>
> -Chakri
>
> ________________________________
> The information contained in this transmission may contain privileged and confidential information. It is intended only for the use of the person(s) named above. If you are not the intended recipient, you are hereby notified that any review, dissemination, distribution or duplication of this communication is strictly prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message.
> ________________________________