You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by indus well <in...@gmail.com> on 2016/12/09 16:54:00 UTC
PutAzureEventHub Errors in NiFi 1.1.0
Hello All:
I tested the PutAzureEventHub processor in NiFi 1.1.0 and kept getting the
following errors:
2016-12-09 10:41:05,435 WARN [StandardProcessScheduler Thread-8]
o.a.n.controller.StandardProcessorNode Timed out while waiting for
OnScheduled of 'PutAzureEventHub' processor to finish. An attempt is made
to cancel the task via Thread.interrupt(). However it does not guarantee
that the task will be canceled since the code inside current OnScheduled
operation may have been written to ignore interrupts which may result in a
runaway thread. This could lead to more issues, eventually requiring NiFi
to be restarted. This is usually a bug in the target Processor
'PutAzureEventHub[id=4d6fe16b-b252-48de-4fd1-88ed63c335ea]' that needs to
be documented, reported and eventually fixed.
2016-12-09 10:41:05,435 ERROR [StandardProcessScheduler Thread-4]
o.a.n.p.azure.eventhub.PutAzureEventHub
PutAzureEventHub[id=4d6fe16b-b252-48de-4fd1-88ed63c335ea] Failed to create
EventHubClient due to java.lang.InterruptedException
2016-12-09 10:41:05,435 ERROR [StandardProcessScheduler Thread-8]
o.a.n.p.azure.eventhub.PutAzureEventHub
PutAzureEventHub[id=4d6fe16b-b252-48de-4fd1-88ed63c335ea]
PutAzureEventHub[id=4d6fe16b-b252-48de-4fd1-88ed63c335ea] failed to invoke
@OnScheduled method due to java.lang.RuntimeException: Timed out while
executing one of processor's OnScheduled task.; processor will not be
scheduled to run for 30 seconds: java.lang.RuntimeException: Timed out
while executing one of processor's OnScheduled task.
2016-12-09 10:41:05,436 ERROR [StandardProcessScheduler Thread-4]
o.a.n.p.azure.eventhub.PutAzureEventHub
java.lang.InterruptedException: null
at
java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:347)
~[na:1.8.0_74]
at
java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895)
~[na:1.8.0_74]
at
org.apache.nifi.processors.azure.eventhub.PutAzureEventHub.createEventHubClient(PutAzureEventHub.java:185)
[nifi-azure-processors-1.1.0.jar:1.1.0]
at
org.apache.nifi.processors.azure.eventhub.PutAzureEventHub.setupClient(PutAzureEventHub.java:141)
[nifi-azure-processors-1.1.0.jar:1.1.0]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
~[na:1.8.0_74]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[na:1.8.0_74]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[na:1.8.0_74]
at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_74]
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:137)
[nifi-framework-core-1.1.0.jar:1.1.0]
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:125)
[nifi-framework-core-1.1.0.jar:1.1.0]
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:70)
[nifi-framework-core-1.1.0.jar:1.1.0]
at
org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotation(ReflectionUtils.java:47)
[nifi-framework-core-1.1.0.jar:1.1.0]
at
org.apache.nifi.controller.StandardProcessorNode$1$1.call(StandardProcessorNode.java:1279)
[nifi-framework-core-1.1.0.jar:1.1.0]
at
org.apache.nifi.controller.StandardProcessorNode$1$1.call(StandardProcessorNode.java:1275)
[nifi-framework-core-1.1.0.jar:1.1.0]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[na:1.8.0_74]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
[na:1.8.0_74]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
[na:1.8.0_74]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[na:1.8.0_74]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_74]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_74]
2016-12-09 10:41:05,436 ERROR [StandardProcessScheduler Thread-8]
o.a.n.p.azure.eventhub.PutAzureEventHub
java.lang.RuntimeException: Timed out while executing one of processor's
OnScheduled task.
at
org.apache.nifi.controller.StandardProcessorNode.invokeTaskAsCancelableFuture(StandardProcessorNode.java:1447)
~[na:na]
at
org.apache.nifi.controller.StandardProcessorNode.access$100(StandardProcessorNode.java:100)
~[na:na]
at
org.apache.nifi.controller.StandardProcessorNode$1.run(StandardProcessorNode.java:1275)
~[na:na]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[na:1.8.0_74]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[na:1.8.0_74]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
[na:1.8.0_74]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
[na:1.8.0_74]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[na:1.8.0_74]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_74]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_74]
Caused by: java.util.concurrent.TimeoutException: null
at java.util.concurrent.FutureTask.get(FutureTask.java:205)
[na:1.8.0_74]
at
org.apache.nifi.controller.StandardProcessorNode.invokeTaskAsCancelableFuture(StandardProcessorNode.java:1432)
~[na:na]
... 9 common frames omitted
2016-12-09 10:41:05,437 ERROR [StandardProcessScheduler Thread-8]
o.a.n.controller.StandardProcessorNode Failed to invoke @OnScheduled method
due to java.lang.RuntimeException: Timed out while executing one of
processor's OnScheduled task.
java.lang.RuntimeException: Timed out while executing one of processor's
OnScheduled task.
at
org.apache.nifi.controller.StandardProcessorNode.invokeTaskAsCancelableFuture(StandardProcessorNode.java:1447)
~[na:na]
at
org.apache.nifi.controller.StandardProcessorNode.access$100(StandardProcessorNode.java:100)
~[na:na]
at
org.apache.nifi.controller.StandardProcessorNode$1.run(StandardProcessorNode.java:1275)
~[na:na]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[na:1.8.0_74]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[na:1.8.0_74]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
[na:1.8.0_74]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
[na:1.8.0_74]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[na:1.8.0_74]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_74]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_74]
Caused by: java.util.concurrent.TimeoutException: null
at java.util.concurrent.FutureTask.get(FutureTask.java:205)
[na:1.8.0_74]
at
org.apache.nifi.controller.StandardProcessorNode.invokeTaskAsCancelableFuture(StandardProcessorNode.java:1432)
~[na:na]
... 9 common frames omitted
2016-12-09 10:41:08,576 WARN [Thread-242] servicebus.trace
Connection.onTransportError: hostname[
eventhubtestns.servicebus.windows.net:5671], error[connection aborted]
Please help.
Indus
Re: PutAzureEventHub Errors in NiFi 1.1.0
Posted by Joey Frazee <jo...@icloud.com>.
Indus, does this happen after a loss of network connectivity or all the time? Do you ever get a connection to EventHubs? If not, can you verify (with telnet or nectar) you have access to port 5671 on that servicebus.windows.net host in your stack trace?
There was a bug in the underlying library that lead to this same behavior after network interruptions but that was (should have been) fixed in NIFI-3061 [1].
-joey
1. https://issues.apache.org/jira/browse/NIFI-3061
> On Dec 9, 2016, at 10:54 AM, indus well <in...@gmail.com> wrote:
>
> Hello All:
>
> I tested the PutAzureEventHub processor in NiFi 1.1.0 and kept getting the following errors:
>
> 2016-12-09 10:41:05,435 WARN [StandardProcessScheduler Thread-8] o.a.n.controller.StandardProcessorNode Timed out while waiting for OnScheduled of 'PutAzureEventHub' processor to finish. An attempt is made to cancel the task via Thread.interrupt(). However it does not guarantee that the task will be canceled since the code inside current OnScheduled operation may have been written to ignore interrupts which may result in a runaway thread. This could lead to more issues, eventually requiring NiFi to be restarted. This is usually a bug in the target Processor 'PutAzureEventHub[id=4d6fe16b-b252-48de-4fd1-88ed63c335ea]' that needs to be documented, reported and eventually fixed.
> 2016-12-09 10:41:05,435 ERROR [StandardProcessScheduler Thread-4] o.a.n.p.azure.eventhub.PutAzureEventHub PutAzureEventHub[id=4d6fe16b-b252-48de-4fd1-88ed63c335ea] Failed to create EventHubClient due to java.lang.InterruptedException
> 2016-12-09 10:41:05,435 ERROR [StandardProcessScheduler Thread-8] o.a.n.p.azure.eventhub.PutAzureEventHub PutAzureEventHub[id=4d6fe16b-b252-48de-4fd1-88ed63c335ea] PutAzureEventHub[id=4d6fe16b-b252-48de-4fd1-88ed63c335ea] failed to invoke @OnScheduled method due to java.lang.RuntimeException: Timed out while executing one of processor's OnScheduled task.; processor will not be scheduled to run for 30 seconds: java.lang.RuntimeException: Timed out while executing one of processor's OnScheduled task.
> 2016-12-09 10:41:05,436 ERROR [StandardProcessScheduler Thread-4] o.a.n.p.azure.eventhub.PutAzureEventHub
> java.lang.InterruptedException: null
> at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:347) ~[na:1.8.0_74]
> at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895) ~[na:1.8.0_74]
> at org.apache.nifi.processors.azure.eventhub.PutAzureEventHub.createEventHubClient(PutAzureEventHub.java:185) [nifi-azure-processors-1.1.0.jar:1.1.0]
> at org.apache.nifi.processors.azure.eventhub.PutAzureEventHub.setupClient(PutAzureEventHub.java:141) [nifi-azure-processors-1.1.0.jar:1.1.0]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_74]
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_74]
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_74]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_74]
> at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:137) [nifi-framework-core-1.1.0.jar:1.1.0]
> at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:125) [nifi-framework-core-1.1.0.jar:1.1.0]
> at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:70) [nifi-framework-core-1.1.0.jar:1.1.0]
> at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotation(ReflectionUtils.java:47) [nifi-framework-core-1.1.0.jar:1.1.0]
> at org.apache.nifi.controller.StandardProcessorNode$1$1.call(StandardProcessorNode.java:1279) [nifi-framework-core-1.1.0.jar:1.1.0]
> at org.apache.nifi.controller.StandardProcessorNode$1$1.call(StandardProcessorNode.java:1275) [nifi-framework-core-1.1.0.jar:1.1.0]
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_74]
> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_74]
> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [na:1.8.0_74]
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_74]
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_74]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_74]
> 2016-12-09 10:41:05,436 ERROR [StandardProcessScheduler Thread-8] o.a.n.p.azure.eventhub.PutAzureEventHub
> java.lang.RuntimeException: Timed out while executing one of processor's OnScheduled task.
> at org.apache.nifi.controller.StandardProcessorNode.invokeTaskAsCancelableFuture(StandardProcessorNode.java:1447) ~[na:na]
> at org.apache.nifi.controller.StandardProcessorNode.access$100(StandardProcessorNode.java:100) ~[na:na]
> at org.apache.nifi.controller.StandardProcessorNode$1.run(StandardProcessorNode.java:1275) ~[na:na]
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_74]
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_74]
> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_74]
> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [na:1.8.0_74]
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_74]
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_74]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_74]
> Caused by: java.util.concurrent.TimeoutException: null
> at java.util.concurrent.FutureTask.get(FutureTask.java:205) [na:1.8.0_74]
> at org.apache.nifi.controller.StandardProcessorNode.invokeTaskAsCancelableFuture(StandardProcessorNode.java:1432) ~[na:na]
> ... 9 common frames omitted
> 2016-12-09 10:41:05,437 ERROR [StandardProcessScheduler Thread-8] o.a.n.controller.StandardProcessorNode Failed to invoke @OnScheduled method due to java.lang.RuntimeException: Timed out while executing one of processor's OnScheduled task.
> java.lang.RuntimeException: Timed out while executing one of processor's OnScheduled task.
> at org.apache.nifi.controller.StandardProcessorNode.invokeTaskAsCancelableFuture(StandardProcessorNode.java:1447) ~[na:na]
> at org.apache.nifi.controller.StandardProcessorNode.access$100(StandardProcessorNode.java:100) ~[na:na]
> at org.apache.nifi.controller.StandardProcessorNode$1.run(StandardProcessorNode.java:1275) ~[na:na]
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_74]
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_74]
> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_74]
> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [na:1.8.0_74]
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_74]
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_74]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_74]
> Caused by: java.util.concurrent.TimeoutException: null
> at java.util.concurrent.FutureTask.get(FutureTask.java:205) [na:1.8.0_74]
> at org.apache.nifi.controller.StandardProcessorNode.invokeTaskAsCancelableFuture(StandardProcessorNode.java:1432) ~[na:na]
> ... 9 common frames omitted
> 2016-12-09 10:41:08,576 WARN [Thread-242] servicebus.trace Connection.onTransportError: hostname[eventhubtestns.servicebus.windows.net:5671], error[connection aborted]
>
> Please help.
>
> Indus
>