You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by Chico Qi <qi...@gmail.com> on 2017/02/13 04:43:09 UTC
the zombie NiFi
Hi all,
I am struggling in an infinite loop. I want to install a new NiFi on the
same machine because the old NiFi was corrupted. But even though I install
from an original file from NiFi website. There are always same logs as
bellow. I guess some file was locked and the new NiFi are trying to
recover from the error status.
2017-02-13 11:32:46,255 INFO [main] o.a.n.c.repository.FileSystemRepository
Maximum Threshold for Container default set to 4346167787 bytes; if volume
exceeds this size, archived data will be deleted until it no longer exceeds
this size
2017-02-13 11:32:46,256 INFO [main] o.a.n.c.repository.FileSystemRepository
Initializing FileSystemRepository with 'Always Sync' set to false
2017-02-13 11:32:46,366 INFO [main] org.wali.MinimalLockingWriteAheadLog
org.wali.MinimalLockingWriteAheadLog@4e8b36af finished recovering records.
Performing Checkpoint to ensure proper state of Partitions before updates
2017-02-13 11:32:46,366 INFO [main] org.wali.MinimalLockingWriteAheadLog
Successfully recovered 0 records in 6 milliseconds
2017-02-13 11:32:46,372 INFO [main] org.wali.MinimalLockingWriteAheadLog
org.wali.MinimalLockingWriteAheadLog@4e8b36af checkpointed with 0 Records
and 0 Swap Files in 5 milliseconds (Stop-the-world time = 3 milliseconds,
Clear Edit Logs time = 1 millis), max Transaction ID -1
2017-02-13 11:32:46,398 INFO [main] o.apache.nifi.controller.FlowController
Not enabling RAW Socket Site-to-Site functionality because
nifi.remote.input.socket.port is not set
2017-02-13 11:32:46,418 INFO [main]
o.a.n.w.c.ApplicationStartupContextListener Starting Flow Controller...
2017-02-13 11:32:46,458 INFO [main] o.apache.nifi.controller.FlowController
Successfully synchronized controller with proposed flow
2017-02-13 11:32:46,835 INFO [main] org.wali.MinimalLockingWriteAheadLog
org.wali.MinimalLockingWriteAheadLog@6c0bf8f4 finished recovering records.
Performing Checkpoint to ensure proper state of Partitions before updates
2017-02-13 11:32:46,835 INFO [main] org.wali.MinimalLockingWriteAheadLog
Successfully recovered 0 records in 184 milliseconds
2017-02-13 11:32:46,879 INFO [main] org.wali.MinimalLockingWriteAheadLog
org.wali.MinimalLockingWriteAheadLog@6c0bf8f4 checkpointed with 0 Records
and 0 Swap Files in 43 milliseconds (Stop-the-world time = 26 milliseconds,
Clear Edit Logs time = 16 millis), max Transaction ID -1
2017-02-13 11:32:46,879 INFO [main] o.a.n.c.r.WriteAheadFlowFileRepository
Successfully restored 0 FlowFiles
2017-02-13 11:32:46,896 INFO [main] o.apache.nifi.controller.FlowController
Starting 0 processors/ports/funnels
2017-02-13 11:32:46,896 INFO [main] o.apache.nifi.controller.FlowController
Started 0 Remote Group Ports transmitting
2017-02-13 11:32:46,896 INFO [main]
o.a.n.w.c.ApplicationStartupContextListener Flow Controller started
successfully.
2017-02-13 11:32:46,903 INFO [main] o.e.jetty.server.handler.ContextHandler
Started o.e.j.w.WebAppContext@48614fb3
{/nifi-api,file:///dev/shm/nifi-1.1.1/work/jetty/nifi-web-api-1.1.1.war/webapp/,AVAILABLE}{./work/nar/framework/nifi-framework-nar-1.1.1.nar-unpacked/META-INF/bundled-dependencies/nifi-web-api-1.1.1.war}
2017-02-13 11:32:47,457 INFO [main] /nifi-content-viewer No Spring
WebApplicationInitializer types detected on classpath
2017-02-13 11:32:47,463 INFO [main] o.e.jetty.server.handler.ContextHandler
Started o.e.j.w.WebAppContext@439b0198
{/nifi-content-viewer,file:///dev/shm/nifi-1.1.1/work/jetty/nifi-web-content-viewer-1.1.1.war/webapp/,AVAILABLE}{./work/nar/framework/nifi-framework-nar-1.1.1.nar-unpacked/META-INF/bundled-dependencies/nifi-web-content-viewer-1.1.1.war}
2017-02-13 11:32:47,464 INFO [main] o.e.jetty.server.handler.ContextHandler
Started o.e.j.s.h.ContextHandler@29088d3d{/nifi-docs,null,AVAILABLE}
2017-02-13 11:32:47,499 INFO [main] /nifi-docs No Spring
WebApplicationInitializer types detected on classpath
2017-02-13 11:32:47,524 INFO [main] o.e.jetty.server.handler.ContextHandler
Started o.e.j.w.WebAppContext@3284de45
{/nifi-docs,file:///dev/shm/nifi-1.1.1/work/jetty/nifi-web-docs-1.1.1.war/webapp/,AVAILABLE}{./work/nar/framework/nifi-framework-nar-1.1.1.nar-unpacked/META-INF/bundled-dependencies/nifi-web-docs-1.1.1.war}
2017-02-13 11:32:47,585 INFO [main] / No Spring WebApplicationInitializer
types detected on classpath
2017-02-13 11:32:47,590 INFO [main] o.e.jetty.server.handler.ContextHandler
Started o.e.j.w.WebAppContext@7962a364
{/,file:///dev/shm/nifi-1.1.1/work/jetty/nifi-web-error-1.1.1.war/webapp/,AVAILABLE}{./work/nar/framework/nifi-framework-nar-1.1.1.nar-unpacked/META-INF/bundled-dependencies/nifi-web-error-1.1.1.war}
2017-02-13 11:32:47,605 INFO [main]
o.eclipse.jetty.server.AbstractConnector Started ServerConnector@30ce78e3
{HTTP/1.1,[http/1.1]}{172.23.51.151:8080}
2017-02-13 11:32:47,605 INFO [main] org.eclipse.jetty.server.Server Started
@201871ms
2017-02-13 11:32:48,081 INFO [main] org.apache.nifi.web.server.JettyServer
NiFi has started. The UI is available at the following URLs:
2017-02-13 11:32:48,082 INFO [main] org.apache.nifi.web.server.JettyServer
http://172.23.51.151:8080/nifi
2017-02-13 11:32:48,083 INFO [main] org.apache.nifi.BootstrapListener
Successfully initiated communication with Bootstrap
2017-02-13 11:32:48,083 INFO [main] org.apache.nifi.NiFi Controller
initialization took 157612801054 nanoseconds.
2017-02-13 11:34:46,376 INFO [Write-Ahead Local State Provider Maintenance]
org.wali.MinimalLockingWriteAheadLog
org.wali.MinimalLockingWriteAheadLog@4e8b36af checkpointed with 0 Records
and 0 Swap Files in 3 milliseconds (Stop-the-world time = 0 milliseconds,
Clear Edit Logs time = 0 millis), max Transaction ID -1
2017-02-13 11:34:46,880 INFO [pool-8-thread-1]
o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile
Repository
2017-02-13 11:34:46,915 INFO [pool-8-thread-1]
org.wali.MinimalLockingWriteAheadLog
org.wali.MinimalLockingWriteAheadLog@6c0bf8f4 checkpointed with 0 Records
and 0 Swap Files in 34 milliseconds (Stop-the-world time = 21 milliseconds,
Clear Edit Logs time = 10 millis), max Transaction ID -1
2017-02-13 11:34:46,915 INFO [pool-8-thread-1]
o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed FlowFile
Repository with 0 records in 34 milliseconds
2017-02-13 11:36:46,378 INFO [Write-Ahead Local State Provider Maintenance]
org.wali.MinimalLockingWriteAheadLog
org.wali.MinimalLockingWriteAheadLog@4e8b36af checkpointed with 0 Records
and 0 Swap Files in 1 milliseconds (Stop-the-world time = 1 milliseconds,
Clear Edit Logs time = 0 millis), max Transaction ID -1
2017-02-13 11:36:46,915 INFO [pool-8-thread-1]
o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile
Repository
2017-02-13 11:36:46,947 INFO [pool-8-thread-1]
org.wali.MinimalLockingWriteAheadLog
org.wali.MinimalLockingWriteAheadLog@6c0bf8f4 checkpointed with 0 Records
and 0 Swap Files in 31 milliseconds (Stop-the-world time = 21 milliseconds,
Clear Edit Logs time = 9 millis), max Transaction ID -1
2017-02-13 11:36:46,947 INFO [pool-8-thread-1]
o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed FlowFile
Repository with 0 records in 31 milliseconds
Thank you.
Cheers,
Chico
Re: the zombie NiFi
Posted by Koji Kawamura <ij...@gmail.com>.
Hi Chico,
Although it looks longer to get started, but the log shows NiFi has started:
> 2017-02-13 11:32:48,081 INFO [main] org.apache.nifi.web.server.JettyServer NiFi has started. The UI is available at the following URLs:
> 2017-02-13 11:32:48,082 INFO [main] org.apache.nifi.web.server.JettyServer http://172.23.51.151:8080/nifi
> 2017-02-13 11:32:48,083 INFO [main] org.apache.nifi.BootstrapListener Successfully initiated communication with Bootstrap
> 2017-02-13 11:32:48,083 INFO [main] org.apache.nifi.NiFi Controller initialization took 157612801054 nanoseconds.
Are you having trouble of logging into NiFi Web UI? Or are you
worrying about the messages MinimalLockingWriteAheadLog logged?
To describe what MinimalLockingWriteAheadLog does, this wiki might be
informative:
https://cwiki.apache.org/confluence/display/NIFI/NiFi's+Write-Ahead+Log+Implementation
Sorry in advance if I'm missing something important in your log.
Please elaborate about the issue in that case.
Thanks,
Koji
On Mon, Feb 13, 2017 at 1:43 PM, Chico Qi <qi...@gmail.com> wrote:
> Hi all,
>
> I am struggling in an infinite loop. I want to install a new NiFi on the
> same machine because the old NiFi was corrupted. But even though I install
> from an original file from NiFi website. There are always same logs as
> bellow. I guess some file was locked and the new NiFi are trying to recover
> from the error status.
>
>
> 2017-02-13 11:32:46,255 INFO [main] o.a.n.c.repository.FileSystemRepository
> Maximum Threshold for Container default set to 4346167787 bytes; if volume
> exceeds this size, archived data will be deleted until it no longer exceeds
> this size
> 2017-02-13 11:32:46,256 INFO [main] o.a.n.c.repository.FileSystemRepository
> Initializing FileSystemRepository with 'Always Sync' set to false
> 2017-02-13 11:32:46,366 INFO [main] org.wali.MinimalLockingWriteAheadLog
> org.wali.MinimalLockingWriteAheadLog@4e8b36af finished recovering records.
> Performing Checkpoint to ensure proper state of Partitions before updates
> 2017-02-13 11:32:46,366 INFO [main] org.wali.MinimalLockingWriteAheadLog
> Successfully recovered 0 records in 6 milliseconds
> 2017-02-13 11:32:46,372 INFO [main] org.wali.MinimalLockingWriteAheadLog
> org.wali.MinimalLockingWriteAheadLog@4e8b36af checkpointed with 0 Records
> and 0 Swap Files in 5 milliseconds (Stop-the-world time = 3 milliseconds,
> Clear Edit Logs time = 1 millis), max Transaction ID -1
> 2017-02-13 11:32:46,398 INFO [main] o.apache.nifi.controller.FlowController
> Not enabling RAW Socket Site-to-Site functionality because
> nifi.remote.input.socket.port is not set
> 2017-02-13 11:32:46,418 INFO [main]
> o.a.n.w.c.ApplicationStartupContextListener Starting Flow Controller...
> 2017-02-13 11:32:46,458 INFO [main] o.apache.nifi.controller.FlowController
> Successfully synchronized controller with proposed flow
> 2017-02-13 11:32:46,835 INFO [main] org.wali.MinimalLockingWriteAheadLog
> org.wali.MinimalLockingWriteAheadLog@6c0bf8f4 finished recovering records.
> Performing Checkpoint to ensure proper state of Partitions before updates
> 2017-02-13 11:32:46,835 INFO [main] org.wali.MinimalLockingWriteAheadLog
> Successfully recovered 0 records in 184 milliseconds
> 2017-02-13 11:32:46,879 INFO [main] org.wali.MinimalLockingWriteAheadLog
> org.wali.MinimalLockingWriteAheadLog@6c0bf8f4 checkpointed with 0 Records
> and 0 Swap Files in 43 milliseconds (Stop-the-world time = 26 milliseconds,
> Clear Edit Logs time = 16 millis), max Transaction ID -1
> 2017-02-13 11:32:46,879 INFO [main] o.a.n.c.r.WriteAheadFlowFileRepository
> Successfully restored 0 FlowFiles
> 2017-02-13 11:32:46,896 INFO [main] o.apache.nifi.controller.FlowController
> Starting 0 processors/ports/funnels
> 2017-02-13 11:32:46,896 INFO [main] o.apache.nifi.controller.FlowController
> Started 0 Remote Group Ports transmitting
> 2017-02-13 11:32:46,896 INFO [main]
> o.a.n.w.c.ApplicationStartupContextListener Flow Controller started
> successfully.
> 2017-02-13 11:32:46,903 INFO [main] o.e.jetty.server.handler.ContextHandler
> Started
> o.e.j.w.WebAppContext@48614fb3{/nifi-api,file:///dev/shm/nifi-1.1.1/work/jetty/nifi-web-api-1.1.1.war/webapp/,AVAILABLE}{./work/nar/framework/nifi-framework-nar-1.1.1.nar-unpacked/META-INF/bundled-dependencies/nifi-web-api-1.1.1.war}
> 2017-02-13 11:32:47,457 INFO [main] /nifi-content-viewer No Spring
> WebApplicationInitializer types detected on classpath
> 2017-02-13 11:32:47,463 INFO [main] o.e.jetty.server.handler.ContextHandler
> Started
> o.e.j.w.WebAppContext@439b0198{/nifi-content-viewer,file:///dev/shm/nifi-1.1.1/work/jetty/nifi-web-content-viewer-1.1.1.war/webapp/,AVAILABLE}{./work/nar/framework/nifi-framework-nar-1.1.1.nar-unpacked/META-INF/bundled-dependencies/nifi-web-content-viewer-1.1.1.war}
> 2017-02-13 11:32:47,464 INFO [main] o.e.jetty.server.handler.ContextHandler
> Started o.e.j.s.h.ContextHandler@29088d3d{/nifi-docs,null,AVAILABLE}
> 2017-02-13 11:32:47,499 INFO [main] /nifi-docs No Spring
> WebApplicationInitializer types detected on classpath
> 2017-02-13 11:32:47,524 INFO [main] o.e.jetty.server.handler.ContextHandler
> Started
> o.e.j.w.WebAppContext@3284de45{/nifi-docs,file:///dev/shm/nifi-1.1.1/work/jetty/nifi-web-docs-1.1.1.war/webapp/,AVAILABLE}{./work/nar/framework/nifi-framework-nar-1.1.1.nar-unpacked/META-INF/bundled-dependencies/nifi-web-docs-1.1.1.war}
> 2017-02-13 11:32:47,585 INFO [main] / No Spring WebApplicationInitializer
> types detected on classpath
> 2017-02-13 11:32:47,590 INFO [main] o.e.jetty.server.handler.ContextHandler
> Started
> o.e.j.w.WebAppContext@7962a364{/,file:///dev/shm/nifi-1.1.1/work/jetty/nifi-web-error-1.1.1.war/webapp/,AVAILABLE}{./work/nar/framework/nifi-framework-nar-1.1.1.nar-unpacked/META-INF/bundled-dependencies/nifi-web-error-1.1.1.war}
> 2017-02-13 11:32:47,605 INFO [main] o.eclipse.jetty.server.AbstractConnector
> Started ServerConnector@30ce78e3{HTTP/1.1,[http/1.1]}{172.23.51.151:8080}
> 2017-02-13 11:32:47,605 INFO [main] org.eclipse.jetty.server.Server Started
> @201871ms
> 2017-02-13 11:32:48,081 INFO [main] org.apache.nifi.web.server.JettyServer
> NiFi has started. The UI is available at the following URLs:
> 2017-02-13 11:32:48,082 INFO [main] org.apache.nifi.web.server.JettyServer
> http://172.23.51.151:8080/nifi
> 2017-02-13 11:32:48,083 INFO [main] org.apache.nifi.BootstrapListener
> Successfully initiated communication with Bootstrap
> 2017-02-13 11:32:48,083 INFO [main] org.apache.nifi.NiFi Controller
> initialization took 157612801054 nanoseconds.
> 2017-02-13 11:34:46,376 INFO [Write-Ahead Local State Provider Maintenance]
> org.wali.MinimalLockingWriteAheadLog
> org.wali.MinimalLockingWriteAheadLog@4e8b36af checkpointed with 0 Records
> and 0 Swap Files in 3 milliseconds (Stop-the-world time = 0 milliseconds,
> Clear Edit Logs time = 0 millis), max Transaction ID -1
> 2017-02-13 11:34:46,880 INFO [pool-8-thread-1]
> o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile
> Repository
> 2017-02-13 11:34:46,915 INFO [pool-8-thread-1]
> org.wali.MinimalLockingWriteAheadLog
> org.wali.MinimalLockingWriteAheadLog@6c0bf8f4 checkpointed with 0 Records
> and 0 Swap Files in 34 milliseconds (Stop-the-world time = 21 milliseconds,
> Clear Edit Logs time = 10 millis), max Transaction ID -1
> 2017-02-13 11:34:46,915 INFO [pool-8-thread-1]
> o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed FlowFile
> Repository with 0 records in 34 milliseconds
> 2017-02-13 11:36:46,378 INFO [Write-Ahead Local State Provider Maintenance]
> org.wali.MinimalLockingWriteAheadLog
> org.wali.MinimalLockingWriteAheadLog@4e8b36af checkpointed with 0 Records
> and 0 Swap Files in 1 milliseconds (Stop-the-world time = 1 milliseconds,
> Clear Edit Logs time = 0 millis), max Transaction ID -1
> 2017-02-13 11:36:46,915 INFO [pool-8-thread-1]
> o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile
> Repository
> 2017-02-13 11:36:46,947 INFO [pool-8-thread-1]
> org.wali.MinimalLockingWriteAheadLog
> org.wali.MinimalLockingWriteAheadLog@6c0bf8f4 checkpointed with 0 Records
> and 0 Swap Files in 31 milliseconds (Stop-the-world time = 21 milliseconds,
> Clear Edit Logs time = 9 millis), max Transaction ID -1
> 2017-02-13 11:36:46,947 INFO [pool-8-thread-1]
> o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed FlowFile
> Repository with 0 records in 31 milliseconds
>
> Thank you.
>
> Cheers,
> Chico
Re: the zombie NiFi
Posted by Chico Qi <qi...@gmail.com>.
Hi Matt,
Please skip this thread. I had figured out the reason because somebody
closed the iptables. I was misled by the above logs.
Best,
Chico
On 14 February 2017 at 10:30, Chico Qi <qi...@gmail.com> wrote:
> Hi Matt,
>
> Could you look at this issue? Thank you.
>
>
> "Cleanup Archive for default" Id=40 RUNNABLE
> at sun.nio.fs.UnixNativeDispatcher.access0(Native Method)
> at sun.nio.fs.UnixNativeDispatcher.access(
> UnixNativeDispatcher.java:449)
> at sun.nio.fs.UnixFileSystemProvider.checkAccess(
> UnixFileSystemProvider.java:306)
> at java.nio.file.Files.exists(Files.java:2385)
> at org.apache.nifi.controller.repository.FileSystemRepository.
> destroyExpiredArchives(FileSystemRepository.java:1300)
> at org.apache.nifi.controller.repository.
> FileSystemRepository.access$1600(FileSystemRepository.java:83)
> at org.apache.nifi.controller.repository.FileSystemRepository$
> DestroyExpiredArchiveClaims.run(FileSystemRepository.java:1537)
> at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Number of Locked Synchronizers: 1
> - java.util.concurrent.ThreadPoolExecutor$Worker@48dc9950
>
> "DestroyJavaVM" Id=60 RUNNABLE
>
> "Event-Driven Process Thread-1" Id=42 TIMED_WAITING on
> java.lang.Object@4d70e3d2
> at java.lang.Object.wait(Native Method)
> at org.apache.nifi.controller.EventDrivenWorkerQueue.poll(
> EventDrivenWorkerQueue.java:70)
> at org.apache.nifi.controller.scheduling.
> EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent.
> java:166)
> at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Number of Locked Synchronizers: 1
> - java.util.concurrent.ThreadPoolExecutor$Worker@433362e0
>
> "Event-Driven Process Thread-2" Id=43 TIMED_WAITING on
> java.lang.Object@4d70e3d2
> at java.lang.Object.wait(Native Method)
> at org.apache.nifi.controller.EventDrivenWorkerQueue.poll(
> EventDrivenWorkerQueue.java:70)
> at org.apache.nifi.controller.scheduling.
> EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent.
> java:166)
> at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Number of Locked Synchronizers: 1
> - java.util.concurrent.ThreadPoolExecutor$Worker@425a5c2e
>
> "Event-Driven Process Thread-3" Id=44 TIMED_WAITING on
> java.lang.Object@4d70e3d2
> at java.lang.Object.wait(Native Method)
> at org.apache.nifi.controller.EventDrivenWorkerQueue.poll(
> EventDrivenWorkerQueue.java:70)
> at org.apache.nifi.controller.scheduling.
> EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent.
> java:166)
> at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Number of Locked Synchronizers: 1
> - java.util.concurrent.ThreadPoolExecutor$Worker@58cd6088
>
> "Event-Driven Process Thread-4" Id=45 TIMED_WAITING on
> java.lang.Object@4d70e3d2
> at java.lang.Object.wait(Native Method)
> at org.apache.nifi.controller.EventDrivenWorkerQueue.poll(
> EventDrivenWorkerQueue.java:70)
> at org.apache.nifi.controller.scheduling.
> EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent.
> java:166)
> at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Number of Locked Synchronizers: 1
> - java.util.concurrent.ThreadPoolExecutor$Worker@44a7661d
>
> "Event-Driven Process Thread-5" Id=46 TIMED_WAITING on
> java.lang.Object@4d70e3d2
> at java.lang.Object.wait(Native Method)
> at org.apache.nifi.controller.EventDrivenWorkerQueue.poll(
> EventDrivenWorkerQueue.java:70)
> at org.apache.nifi.controller.scheduling.
> EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent.
> java:166)
> at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Number of Locked Synchronizers: 1
> - java.util.concurrent.ThreadPoolExecutor$Worker@1cdb280b
>
> "FileSystemRepository Workers Thread-1" Id=38 TIMED_WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@9d6b30
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "FileSystemRepository Workers Thread-2" Id=39 WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@9d6b30
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "FileSystemRepository Workers Thread-3" Id=56 WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@9d6b30
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "FileSystemRepository Workers Thread-4" Id=57 WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@9d6b30
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "Finalizer" Id=3 WAITING on java.lang.ref.ReferenceQueue$Lock@3839e381
> at java.lang.Object.wait(Native Method)
> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
> at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
>
> "Flow Service Tasks Thread-1" Id=49 WAITING on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@3f0a2366
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> "Flow Service Tasks Thread-2" Id=50 TIMED_WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@3f0a2366
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "Framework Task Thread Thread-1" Id=47 WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@74644b72
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "Framework Task Thread Thread-2" Id=61 WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@74644b72
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "Framework Task Thread Thread-3" Id=63 WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@74644b72
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "Framework Task Thread Thread-4" Id=66 TIMED_WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@74644b72
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "H2 File Lock Watchdog /data/test/nifi-1.1.1/
> database_repository/nifi-flow-audit.lock.db" Id=31 TIMED_WAITING on null
> at java.lang.Thread.sleep(Native Method)
> at org.h2.store.FileLock.run(FileLock.java:517)
> at java.lang.Thread.run(Thread.java:745)
>
> "H2 File Lock Watchdog /data/test/nifi-1.1.1/
> database_repository/nifi-user-keys.lock.db" Id=29 TIMED_WAITING on null
> at java.lang.Thread.sleep(Native Method)
> at org.h2.store.FileLock.run(FileLock.java:517)
> at java.lang.Thread.run(Thread.java:745)
>
> "H2 Log Writer NIFI-FLOW-AUDIT" Id=32 TIMED_WAITING on
> org.h2.store.WriterThread@db4db79
> at java.lang.Object.wait(Native Method)
> at org.h2.store.WriterThread.run(WriterThread.java:103)
> at java.lang.Thread.run(Thread.java:745)
>
> "H2 Log Writer NIFI-USER-KEYS" Id=30 TIMED_WAITING on
> org.h2.store.WriterThread@609725db
> at java.lang.Object.wait(Native Method)
> at org.h2.store.WriterThread.run(WriterThread.java:103)
> at java.lang.Thread.run(Thread.java:745)
>
> "Http Site-to-Site Transaction Maintenance" Id=52 TIMED_WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@514924d5
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "Listen to Bootstrap" Id=11 RUNNABLE (in native code)
> at java.net.PlainSocketImpl.socketAccept(Native Method)
> at java.net.AbstractPlainSocketImpl.accept(
> AbstractPlainSocketImpl.java:409)
> at java.net.ServerSocket.implAccept(ServerSocket.java:545)
> at java.net.ServerSocket.accept(ServerSocket.java:513)
> at org.apache.nifi.BootstrapListener$Listener.
> run(BootstrapListener.java:158)
> at java.lang.Thread.run(Thread.java:745)
>
> "NiFi Web Server-14" Id=14 TIMED_WAITING on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@1debbe8b
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> at org.eclipse.jetty.util.BlockingArrayQueue.poll(
> BlockingArrayQueue.java:392)
> at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(
> QueuedThreadPool.java:563)
> at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(
> QueuedThreadPool.java:48)
> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> QueuedThreadPool.java:626)
> at java.lang.Thread.run(Thread.java:745)
>
> "NiFi Web Server-15-acceptor-0@4b066838-ServerConnector@258291de{HTTP/
> 1.1,[http/1.1]}{172.23.51.151:8080}" Id=15 RUNNABLE (in native code)
> at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
> at sun.nio.ch.ServerSocketChannelImpl.accept(
> ServerSocketChannelImpl.java:422)
> at sun.nio.ch.ServerSocketChannelImpl.accept(
> ServerSocketChannelImpl.java:250)
> - waiting on java.lang.Object@581cd433
> at org.eclipse.jetty.server.ServerConnector.accept(
> ServerConnector.java:373)
> at org.eclipse.jetty.server.AbstractConnector$Acceptor.
> run(AbstractConnector.java:593)
> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(
> QueuedThreadPool.java:671)
> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> QueuedThreadPool.java:589)
> at java.lang.Thread.run(Thread.java:745)
>
> "NiFi Web Server-16" Id=16 TIMED_WAITING on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@1debbe8b
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> at org.eclipse.jetty.util.BlockingArrayQueue.poll(
> BlockingArrayQueue.java:392)
> at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(
> QueuedThreadPool.java:563)
> at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(
> QueuedThreadPool.java:48)
> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> QueuedThreadPool.java:626)
> at java.lang.Thread.run(Thread.java:745)
>
> "NiFi Web Server-17" Id=17 TIMED_WAITING on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@1debbe8b
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> at org.eclipse.jetty.util.BlockingArrayQueue.poll(
> BlockingArrayQueue.java:392)
> at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(
> QueuedThreadPool.java:563)
> at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(
> QueuedThreadPool.java:48)
> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> QueuedThreadPool.java:626)
> at java.lang.Thread.run(Thread.java:745)
>
> "NiFi Web Server-18" Id=18 TIMED_WAITING on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@1debbe8b
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> at org.eclipse.jetty.util.BlockingArrayQueue.poll(
> BlockingArrayQueue.java:392)
> at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(
> QueuedThreadPool.java:563)
> at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(
> QueuedThreadPool.java:48)
> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> QueuedThreadPool.java:626)
> at java.lang.Thread.run(Thread.java:745)
>
> "NiFi Web Server-19" Id=19 RUNNABLE (in native code)
> at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
> at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
> at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.
> java:93)
> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
> - waiting on sun.nio.ch.Util$2@1d0fb948
> - waiting on java.util.Collections$UnmodifiableSet@1c0182ea
> - waiting on sun.nio.ch.EPollSelectorImpl@18c33e46
> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
> at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(
> ManagedSelector.java:243)
> at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(
> ManagedSelector.java:191)
> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.
> executeProduceConsume(ExecuteProduceConsume.java:249)
> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.
> produceConsume(ExecuteProduceConsume.java:148)
> at org.eclipse.jetty.util.thread.strategy.
> ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
> at org.eclipse.jetty.io.ManagedSelector.run(
> ManagedSelector.java:147)
> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(
> QueuedThreadPool.java:671)
> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> QueuedThreadPool.java:589)
> at java.lang.Thread.run(Thread.java:745)
>
> "NiFi Web Server-20" Id=20 TIMED_WAITING on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@1debbe8b
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> at org.eclipse.jetty.util.BlockingArrayQueue.poll(
> BlockingArrayQueue.java:392)
> at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(
> QueuedThreadPool.java:563)
> at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(
> QueuedThreadPool.java:48)
> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> QueuedThreadPool.java:626)
> at java.lang.Thread.run(Thread.java:745)
>
> "NiFi Web Server-21" Id=21 TIMED_WAITING on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@1debbe8b
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> at org.eclipse.jetty.util.BlockingArrayQueue.poll(
> BlockingArrayQueue.java:392)
> at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(
> QueuedThreadPool.java:563)
> at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(
> QueuedThreadPool.java:48)
> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> QueuedThreadPool.java:626)
> at java.lang.Thread.run(Thread.java:745)
>
> "org.eclipse.jetty.server.session.HashSessionManager@2a738d47Timer" Id=59
> TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@3166db9a
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "org.eclipse.jetty.server.session.HashSessionManager@35b38986Timer" Id=55
> TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@56748f8a
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "org.eclipse.jetty.server.session.HashSessionManager@469a7575Timer" Id=26
> TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@76c4adba
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "org.eclipse.jetty.server.session.HashSessionManager@4c19d42eTimer" Id=24
> TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@4e0808e
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "org.eclipse.jetty.server.session.HashSessionManager@664632e9Timer" Id=23
> TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@15b287a4
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "org.eclipse.jetty.server.session.HashSessionManager@69f2cb04Timer" Id=27
> TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@37e4d4f2
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "org.eclipse.jetty.server.session.HashSessionManager@7c369270Timer" Id=22
> TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@46c851d5
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "org.eclipse.jetty.server.session.HashSessionManager@fd413fbTimer" Id=25
> TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@5d00cf08
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "pool-1-thread-1" Id=71 RUNNABLE
> at java.net.Socket.close(Socket.java:1491)
> - waiting on java.net.Socket@60de3224
> at org.apache.nifi.BootstrapListener$Listener$1.
> run(BootstrapListener.java:203)
> at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Number of Locked Synchronizers: 1
> - java.util.concurrent.ThreadPoolExecutor$Worker@701e624
>
> "pool-1-thread-2" Id=72 RUNNABLE
> at sun.management.ThreadImpl.dumpThreads0(Native Method)
> at sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:454)
> at org.apache.nifi.BootstrapListener.writeDump(
> BootstrapListener.java:221)
> at org.apache.nifi.BootstrapListener.access$500(
> BootstrapListener.java:49)
> at org.apache.nifi.BootstrapListener$Listener$1.
> run(BootstrapListener.java:196)
> at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Number of Locked Synchronizers: 1
> - java.util.concurrent.ThreadPoolExecutor$Worker@420378a0
>
> "pool-8-thread-1" Id=51 TIMED_WAITING on java.util.concurrent.locks.
> AbstractQueuedSynchronizer$ConditionObject@54250639
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "Provenance Maintenance Thread-1" Id=34 TIMED_WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@4790ce2a
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "Provenance Maintenance Thread-2" Id=35 WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@4790ce2a
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "Provenance Maintenance Thread-3" Id=36 WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@4790ce2a
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "Reference Handler" Id=2 WAITING on java.lang.ref.Reference$Lock@283f30be
> at java.lang.Object.wait(Native Method)
> at java.lang.Object.wait(Object.java:502)
> at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
> at java.lang.ref.Reference$ReferenceHandler.run(
> Reference.java:153)
>
> "Signal Dispatcher" Id=5 RUNNABLE
>
> "Timer-Driven Process Thread-1" Id=48 WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@705bd1a1
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "Timer-Driven Process Thread-10" Id=70 WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@705bd1a1
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "Timer-Driven Process Thread-2" Id=53 TIMED_WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@705bd1a1
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "Timer-Driven Process Thread-3" Id=54 WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@705bd1a1
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "Timer-Driven Process Thread-4" Id=62 WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@705bd1a1
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "Timer-Driven Process Thread-5" Id=64 WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@705bd1a1
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "Timer-Driven Process Thread-6" Id=65 WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@705bd1a1
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "Timer-Driven Process Thread-7" Id=67 WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@705bd1a1
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "Timer-Driven Process Thread-8" Id=68 WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@705bd1a1
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "Timer-Driven Process Thread-9" Id=69 WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@705bd1a1
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
> "Write-Ahead Local State Provider Maintenance" Id=41 TIMED_WAITING on
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject@55071925
> at sun.misc.Unsafe.park(Native Method)
> at java.util.concurrent.locks.LockSupport.parkNanos(
> LockSupport.java:215)
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> at java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1067)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1127)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
>
> On 13 February 2017 at 17:43, Chico Qi <qi...@gmail.com> wrote:
>
>> Hi all,
>>
>> I am struggling in an infinite loop. I want to install a new NiFi on the
>> same machine because the old NiFi was corrupted. But even though I install
>> from an original file from NiFi website. There are always same logs as
>> bellow. I guess some file was locked and the new NiFi are trying to
>> recover from the error status.
>>
>>
>> 2017-02-13 11:32:46,255 INFO [main] o.a.n.c.repository.FileSystemRepository
>> Maximum Threshold for Container default set to 4346167787
>> <(434)%20616-7787> bytes; if volume exceeds this size, archived data
>> will be deleted until it no longer exceeds this size
>> 2017-02-13 11:32:46,256 INFO [main] o.a.n.c.repository.FileSystemRepository
>> Initializing FileSystemRepository with 'Always Sync' set to false
>> 2017-02-13 11:32:46,366 INFO [main] org.wali.MinimalLockingWriteAheadLog
>> org.wali.MinimalLockingWriteAheadLog@4e8b36af finished recovering
>> records. Performing Checkpoint to ensure proper state of Partitions before
>> updates
>> 2017-02-13 11:32:46,366 INFO [main] org.wali.MinimalLockingWriteAheadLog
>> Successfully recovered 0 records in 6 milliseconds
>> 2017-02-13 11:32:46,372 INFO [main] org.wali.MinimalLockingWriteAheadLog
>> org.wali.MinimalLockingWriteAheadLog@4e8b36af checkpointed with 0
>> Records and 0 Swap Files in 5 milliseconds (Stop-the-world time = 3
>> milliseconds, Clear Edit Logs time = 1 millis), max Transaction ID -1
>> 2017-02-13 11:32:46,398 INFO [main] o.apache.nifi.controller.FlowController
>> Not enabling RAW Socket Site-to-Site functionality because
>> nifi.remote.input.socket.port is not set
>> 2017-02-13 11:32:46,418 INFO [main] o.a.n.w.c.ApplicationStartupContextListener
>> Starting Flow Controller...
>> 2017-02-13 11:32:46,458 INFO [main] o.apache.nifi.controller.FlowController
>> Successfully synchronized controller with proposed flow
>> 2017-02-13 11:32:46,835 INFO [main] org.wali.MinimalLockingWriteAheadLog
>> org.wali.MinimalLockingWriteAheadLog@6c0bf8f4 finished recovering
>> records. Performing Checkpoint to ensure proper state of Partitions before
>> updates
>> 2017-02-13 11:32:46,835 INFO [main] org.wali.MinimalLockingWriteAheadLog
>> Successfully recovered 0 records in 184 milliseconds
>> 2017-02-13 11:32:46,879 INFO [main] org.wali.MinimalLockingWriteAheadLog
>> org.wali.MinimalLockingWriteAheadLog@6c0bf8f4 checkpointed with 0
>> Records and 0 Swap Files in 43 milliseconds (Stop-the-world time = 26
>> milliseconds, Clear Edit Logs time = 16 millis), max Transaction ID -1
>> 2017-02-13 11:32:46,879 INFO [main] o.a.n.c.r.WriteAheadFlowFileRepository
>> Successfully restored 0 FlowFiles
>> 2017-02-13 11:32:46,896 INFO [main] o.apache.nifi.controller.FlowController
>> Starting 0 processors/ports/funnels
>> 2017-02-13 11:32:46,896 INFO [main] o.apache.nifi.controller.FlowController
>> Started 0 Remote Group Ports transmitting
>> 2017-02-13 11:32:46,896 INFO [main] o.a.n.w.c.ApplicationStartupContextListener
>> Flow Controller started successfully.
>> 2017-02-13 11:32:46,903 INFO [main] o.e.jetty.server.handler.ContextHandler
>> Started o.e.j.w.WebAppContext@48614fb3{/nifi-api,file:///dev/shm/nif
>> i-1.1.1/work/jetty/nifi-web-api-1.1.1.war/webapp/,AVAILABL
>> E}{./work/nar/framework/nifi-framework-nar-1.1.1.nar-
>> unpacked/META-INF/bundled-dependencies/nifi-web-api-1.1.1.war}
>> 2017-02-13 11:32:47,457 INFO [main] /nifi-content-viewer No Spring
>> WebApplicationInitializer types detected on classpath
>> 2017-02-13 11:32:47,463 INFO [main] o.e.jetty.server.handler.ContextHandler
>> Started o.e.j.w.WebAppContext@439b0198{/nifi-content-viewer,file:///
>> dev/shm/nifi-1.1.1/work/jetty/nifi-web-content-viewer-1.1.1.
>> war/webapp/,AVAILABLE}{./work/nar/framework/nifi-framework-n
>> ar-1.1.1.nar-unpacked/META-INF/bundled-dependencies/nifi-web
>> -content-viewer-1.1.1.war}
>> 2017-02-13 11:32:47,464 INFO [main] o.e.jetty.server.handler.ContextHandler
>> Started o.e.j.s.h.ContextHandler@29088d3d{/nifi-docs,null,AVAILABLE}
>> 2017-02-13 11:32:47,499 INFO [main] /nifi-docs No Spring
>> WebApplicationInitializer types detected on classpath
>> 2017-02-13 11:32:47,524 INFO [main] o.e.jetty.server.handler.ContextHandler
>> Started o.e.j.w.WebAppContext@3284de45{/nifi-docs,file:///dev/shm/ni
>> fi-1.1.1/work/jetty/nifi-web-docs-1.1.1.war/webapp/,AVAILAB
>> LE}{./work/nar/framework/nifi-framework-nar-1.1.1.nar-
>> unpacked/META-INF/bundled-dependencies/nifi-web-docs-1.1.1.war}
>> 2017-02-13 11:32:47,585 INFO [main] / No Spring WebApplicationInitializer
>> types detected on classpath
>> 2017-02-13 11:32:47,590 INFO [main] o.e.jetty.server.handler.ContextHandler
>> Started o.e.j.w.WebAppContext@7962a364{/,file:///dev/shm/nifi-1.1.1/
>> work/jetty/nifi-web-error-1.1.1.war/webapp/,AVAILABLE}{./wor
>> k/nar/framework/nifi-framework-nar-1.1.1.nar-unpacked/META-
>> INF/bundled-dependencies/nifi-web-error-1.1.1.war}
>> 2017-02-13 11:32:47,605 INFO [main] o.eclipse.jetty.server.AbstractConnector
>> Started ServerConnector@30ce78e3{HTTP/1.1,[http/1.1]}{172.23.51.151:8080}
>> 2017-02-13 11:32:47,605 INFO [main] org.eclipse.jetty.server.Server
>> Started @201871ms
>> 2017-02-13 11:32:48,081 INFO [main] org.apache.nifi.web.server.JettyServer
>> NiFi has started. The UI is available at the following URLs:
>> 2017-02-13 11:32:48,082 INFO [main] org.apache.nifi.web.server.JettyServer
>> http://172.23.51.151:8080/nifi
>> 2017-02-13 11:32:48,083 INFO [main] org.apache.nifi.BootstrapListener
>> Successfully initiated communication with Bootstrap
>> 2017-02-13 11:32:48,083 INFO [main] org.apache.nifi.NiFi Controller
>> initialization took 157612801054 nanoseconds.
>> 2017-02-13 11:34:46,376 INFO [Write-Ahead Local State Provider
>> Maintenance] org.wali.MinimalLockingWriteAheadLog
>> org.wali.MinimalLockingWriteAheadLog@4e8b36af checkpointed with 0
>> Records and 0 Swap Files in 3 milliseconds (Stop-the-world time = 0
>> milliseconds, Clear Edit Logs time = 0 millis), max Transaction ID -1
>> 2017-02-13 11:34:46,880 INFO [pool-8-thread-1]
>> o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile
>> Repository
>> 2017-02-13 11:34:46,915 INFO [pool-8-thread-1]
>> org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAh
>> eadLog@6c0bf8f4 checkpointed with 0 Records and 0 Swap Files in 34
>> milliseconds (Stop-the-world time = 21 milliseconds, Clear Edit Logs time =
>> 10 millis), max Transaction ID -1
>> 2017-02-13 11:34:46,915 INFO [pool-8-thread-1]
>> o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed
>> FlowFile Repository with 0 records in 34 milliseconds
>> 2017-02-13 11:36:46,378 INFO [Write-Ahead Local State Provider
>> Maintenance] org.wali.MinimalLockingWriteAheadLog
>> org.wali.MinimalLockingWriteAheadLog@4e8b36af checkpointed with 0
>> Records and 0 Swap Files in 1 milliseconds (Stop-the-world time = 1
>> milliseconds, Clear Edit Logs time = 0 millis), max Transaction ID -1
>> 2017-02-13 11:36:46,915 INFO [pool-8-thread-1]
>> o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile
>> Repository
>> 2017-02-13 11:36:46,947 INFO [pool-8-thread-1]
>> org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAh
>> eadLog@6c0bf8f4 checkpointed with 0 Records and 0 Swap Files in 31
>> milliseconds (Stop-the-world time = 21 milliseconds, Clear Edit Logs time =
>> 9 millis), max Transaction ID -1
>> 2017-02-13 11:36:46,947 INFO [pool-8-thread-1]
>> o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed
>> FlowFile Repository with 0 records in 31 milliseconds
>>
>> Thank you.
>>
>> Cheers,
>> Chico
>>
>
>
Re: the zombie NiFi
Posted by Chico Qi <qi...@gmail.com>.
Hi Matt,
Could you look at this issue? Thank you.
"Cleanup Archive for default" Id=40 RUNNABLE
at sun.nio.fs.UnixNativeDispatcher.access0(Native Method)
at
sun.nio.fs.UnixNativeDispatcher.access(UnixNativeDispatcher.java:449)
at
sun.nio.fs.UnixFileSystemProvider.checkAccess(UnixFileSystemProvider.java:306)
at java.nio.file.Files.exists(Files.java:2385)
at
org.apache.nifi.controller.repository.FileSystemRepository.destroyExpiredArchives(FileSystemRepository.java:1300)
at
org.apache.nifi.controller.repository.FileSystemRepository.access$1600(FileSystemRepository.java:83)
at
org.apache.nifi.controller.repository.FileSystemRepository$DestroyExpiredArchiveClaims.run(FileSystemRepository.java:1537)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Number of Locked Synchronizers: 1
- java.util.concurrent.ThreadPoolExecutor$Worker@48dc9950
"DestroyJavaVM" Id=60 RUNNABLE
"Event-Driven Process Thread-1" Id=42 TIMED_WAITING on
java.lang.Object@4d70e3d2
at java.lang.Object.wait(Native Method)
at
org.apache.nifi.controller.EventDrivenWorkerQueue.poll(EventDrivenWorkerQueue.java:70)
at
org.apache.nifi.controller.scheduling.EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent.java:166)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Number of Locked Synchronizers: 1
- java.util.concurrent.ThreadPoolExecutor$Worker@433362e0
"Event-Driven Process Thread-2" Id=43 TIMED_WAITING on
java.lang.Object@4d70e3d2
at java.lang.Object.wait(Native Method)
at
org.apache.nifi.controller.EventDrivenWorkerQueue.poll(EventDrivenWorkerQueue.java:70)
at
org.apache.nifi.controller.scheduling.EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent.java:166)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Number of Locked Synchronizers: 1
- java.util.concurrent.ThreadPoolExecutor$Worker@425a5c2e
"Event-Driven Process Thread-3" Id=44 TIMED_WAITING on
java.lang.Object@4d70e3d2
at java.lang.Object.wait(Native Method)
at
org.apache.nifi.controller.EventDrivenWorkerQueue.poll(EventDrivenWorkerQueue.java:70)
at
org.apache.nifi.controller.scheduling.EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent.java:166)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Number of Locked Synchronizers: 1
- java.util.concurrent.ThreadPoolExecutor$Worker@58cd6088
"Event-Driven Process Thread-4" Id=45 TIMED_WAITING on
java.lang.Object@4d70e3d2
at java.lang.Object.wait(Native Method)
at
org.apache.nifi.controller.EventDrivenWorkerQueue.poll(EventDrivenWorkerQueue.java:70)
at
org.apache.nifi.controller.scheduling.EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent.java:166)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Number of Locked Synchronizers: 1
- java.util.concurrent.ThreadPoolExecutor$Worker@44a7661d
"Event-Driven Process Thread-5" Id=46 TIMED_WAITING on
java.lang.Object@4d70e3d2
at java.lang.Object.wait(Native Method)
at
org.apache.nifi.controller.EventDrivenWorkerQueue.poll(EventDrivenWorkerQueue.java:70)
at
org.apache.nifi.controller.scheduling.EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent.java:166)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Number of Locked Synchronizers: 1
- java.util.concurrent.ThreadPoolExecutor$Worker@1cdb280b
"FileSystemRepository Workers Thread-1" Id=38 TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@9d6b30
at sun.misc.Unsafe.park(Native Method)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"FileSystemRepository Workers Thread-2" Id=39 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@9d6b30
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"FileSystemRepository Workers Thread-3" Id=56 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@9d6b30
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"FileSystemRepository Workers Thread-4" Id=57 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@9d6b30
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"Finalizer" Id=3 WAITING on java.lang.ref.ReferenceQueue$Lock@3839e381
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
"Flow Service Tasks Thread-1" Id=49 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3f0a2366
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"Flow Service Tasks Thread-2" Id=50 TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3f0a2366
at sun.misc.Unsafe.park(Native Method)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"Framework Task Thread Thread-1" Id=47 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@74644b72
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"Framework Task Thread Thread-2" Id=61 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@74644b72
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"Framework Task Thread Thread-3" Id=63 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@74644b72
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"Framework Task Thread Thread-4" Id=66 TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@74644b72
at sun.misc.Unsafe.park(Native Method)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"H2 File Lock Watchdog
/data/test/nifi-1.1.1/database_repository/nifi-flow-audit.lock.db" Id=31
TIMED_WAITING on null
at java.lang.Thread.sleep(Native Method)
at org.h2.store.FileLock.run(FileLock.java:517)
at java.lang.Thread.run(Thread.java:745)
"H2 File Lock Watchdog
/data/test/nifi-1.1.1/database_repository/nifi-user-keys.lock.db" Id=29
TIMED_WAITING on null
at java.lang.Thread.sleep(Native Method)
at org.h2.store.FileLock.run(FileLock.java:517)
at java.lang.Thread.run(Thread.java:745)
"H2 Log Writer NIFI-FLOW-AUDIT" Id=32 TIMED_WAITING on
org.h2.store.WriterThread@db4db79
at java.lang.Object.wait(Native Method)
at org.h2.store.WriterThread.run(WriterThread.java:103)
at java.lang.Thread.run(Thread.java:745)
"H2 Log Writer NIFI-USER-KEYS" Id=30 TIMED_WAITING on
org.h2.store.WriterThread@609725db
at java.lang.Object.wait(Native Method)
at org.h2.store.WriterThread.run(WriterThread.java:103)
at java.lang.Thread.run(Thread.java:745)
"Http Site-to-Site Transaction Maintenance" Id=52 TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@514924d5
at sun.misc.Unsafe.park(Native Method)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"Listen to Bootstrap" Id=11 RUNNABLE (in native code)
at java.net.PlainSocketImpl.socketAccept(Native Method)
at
java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
at java.net.ServerSocket.implAccept(ServerSocket.java:545)
at java.net.ServerSocket.accept(ServerSocket.java:513)
at
org.apache.nifi.BootstrapListener$Listener.run(BootstrapListener.java:158)
at java.lang.Thread.run(Thread.java:745)
"NiFi Web Server-14" Id=14 TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1debbe8b
at sun.misc.Unsafe.park(Native Method)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at
org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:745)
"NiFi Web Server-15-acceptor-0@4b066838-ServerConnector
@258291de{HTTP/1.1,[http/1.1]}{172.23.51.151:8080}" Id=15 RUNNABLE (in
native code)
at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
at
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)
at
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)
- waiting on java.lang.Object@581cd433
at
org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:373)
at
org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:593)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:745)
"NiFi Web Server-16" Id=16 TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1debbe8b
at sun.misc.Unsafe.park(Native Method)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at
org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:745)
"NiFi Web Server-17" Id=17 TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1debbe8b
at sun.misc.Unsafe.park(Native Method)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at
org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:745)
"NiFi Web Server-18" Id=18 TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1debbe8b
at sun.misc.Unsafe.park(Native Method)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at
org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:745)
"NiFi Web Server-19" Id=19 RUNNABLE (in native code)
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
- waiting on sun.nio.ch.Util$2@1d0fb948
- waiting on java.util.Collections$UnmodifiableSet@1c0182ea
- waiting on sun.nio.ch.EPollSelectorImpl@18c33e46
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at
org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
at
org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
at
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
at
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
at
org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:745)
"NiFi Web Server-20" Id=20 TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1debbe8b
at sun.misc.Unsafe.park(Native Method)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at
org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:745)
"NiFi Web Server-21" Id=21 TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1debbe8b
at sun.misc.Unsafe.park(Native Method)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at
org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:745)
"org.eclipse.jetty.server.session.HashSessionManager@2a738d47Timer" Id=59
TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3166db9a
at sun.misc.Unsafe.park(Native Method)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"org.eclipse.jetty.server.session.HashSessionManager@35b38986Timer" Id=55
TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@56748f8a
at sun.misc.Unsafe.park(Native Method)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"org.eclipse.jetty.server.session.HashSessionManager@469a7575Timer" Id=26
TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@76c4adba
at sun.misc.Unsafe.park(Native Method)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"org.eclipse.jetty.server.session.HashSessionManager@4c19d42eTimer" Id=24
TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4e0808e
at sun.misc.Unsafe.park(Native Method)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"org.eclipse.jetty.server.session.HashSessionManager@664632e9Timer" Id=23
TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@15b287a4
at sun.misc.Unsafe.park(Native Method)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"org.eclipse.jetty.server.session.HashSessionManager@69f2cb04Timer" Id=27
TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@37e4d4f2
at sun.misc.Unsafe.park(Native Method)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"org.eclipse.jetty.server.session.HashSessionManager@7c369270Timer" Id=22
TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@46c851d5
at sun.misc.Unsafe.park(Native Method)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"org.eclipse.jetty.server.session.HashSessionManager@fd413fbTimer" Id=25
TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@5d00cf08
at sun.misc.Unsafe.park(Native Method)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"pool-1-thread-1" Id=71 RUNNABLE
at java.net.Socket.close(Socket.java:1491)
- waiting on java.net.Socket@60de3224
at
org.apache.nifi.BootstrapListener$Listener$1.run(BootstrapListener.java:203)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Number of Locked Synchronizers: 1
- java.util.concurrent.ThreadPoolExecutor$Worker@701e624
"pool-1-thread-2" Id=72 RUNNABLE
at sun.management.ThreadImpl.dumpThreads0(Native Method)
at sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:454)
at
org.apache.nifi.BootstrapListener.writeDump(BootstrapListener.java:221)
at
org.apache.nifi.BootstrapListener.access$500(BootstrapListener.java:49)
at
org.apache.nifi.BootstrapListener$Listener$1.run(BootstrapListener.java:196)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Number of Locked Synchronizers: 1
- java.util.concurrent.ThreadPoolExecutor$Worker@420378a0
"pool-8-thread-1" Id=51 TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@54250639
at sun.misc.Unsafe.park(Native Method)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"Provenance Maintenance Thread-1" Id=34 TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4790ce2a
at sun.misc.Unsafe.park(Native Method)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"Provenance Maintenance Thread-2" Id=35 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4790ce2a
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"Provenance Maintenance Thread-3" Id=36 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4790ce2a
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"Reference Handler" Id=2 WAITING on java.lang.ref.Reference$Lock@283f30be
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)
"Signal Dispatcher" Id=5 RUNNABLE
"Timer-Driven Process Thread-1" Id=48 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@705bd1a1
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"Timer-Driven Process Thread-10" Id=70 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@705bd1a1
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"Timer-Driven Process Thread-2" Id=53 TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@705bd1a1
at sun.misc.Unsafe.park(Native Method)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"Timer-Driven Process Thread-3" Id=54 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@705bd1a1
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"Timer-Driven Process Thread-4" Id=62 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@705bd1a1
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"Timer-Driven Process Thread-5" Id=64 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@705bd1a1
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"Timer-Driven Process Thread-6" Id=65 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@705bd1a1
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"Timer-Driven Process Thread-7" Id=67 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@705bd1a1
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"Timer-Driven Process Thread-8" Id=68 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@705bd1a1
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"Timer-Driven Process Thread-9" Id=69 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@705bd1a1
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
"Write-Ahead Local State Provider Maintenance" Id=41 TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@55071925
at sun.misc.Unsafe.park(Native Method)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
On 13 February 2017 at 17:43, Chico Qi <qi...@gmail.com> wrote:
> Hi all,
>
> I am struggling in an infinite loop. I want to install a new NiFi on the
> same machine because the old NiFi was corrupted. But even though I install
> from an original file from NiFi website. There are always same logs as
> bellow. I guess some file was locked and the new NiFi are trying to
> recover from the error status.
>
>
> 2017-02-13 11:32:46,255 INFO [main] o.a.n.c.repository.FileSystemRepository
> Maximum Threshold for Container default set to 4346167787
> <(434)%20616-7787> bytes; if volume exceeds this size, archived data will
> be deleted until it no longer exceeds this size
> 2017-02-13 11:32:46,256 INFO [main] o.a.n.c.repository.FileSystemRepository
> Initializing FileSystemRepository with 'Always Sync' set to false
> 2017-02-13 11:32:46,366 INFO [main] org.wali.MinimalLockingWriteAheadLog
> org.wali.MinimalLockingWriteAheadLog@4e8b36af finished recovering
> records. Performing Checkpoint to ensure proper state of Partitions before
> updates
> 2017-02-13 11:32:46,366 INFO [main] org.wali.MinimalLockingWriteAheadLog
> Successfully recovered 0 records in 6 milliseconds
> 2017-02-13 11:32:46,372 INFO [main] org.wali.MinimalLockingWriteAheadLog
> org.wali.MinimalLockingWriteAheadLog@4e8b36af checkpointed with 0 Records
> and 0 Swap Files in 5 milliseconds (Stop-the-world time = 3 milliseconds,
> Clear Edit Logs time = 1 millis), max Transaction ID -1
> 2017-02-13 11:32:46,398 INFO [main] o.apache.nifi.controller.FlowController
> Not enabling RAW Socket Site-to-Site functionality because
> nifi.remote.input.socket.port is not set
> 2017-02-13 11:32:46,418 INFO [main] o.a.n.w.c.
> ApplicationStartupContextListener Starting Flow Controller...
> 2017-02-13 11:32:46,458 INFO [main] o.apache.nifi.controller.FlowController
> Successfully synchronized controller with proposed flow
> 2017-02-13 11:32:46,835 INFO [main] org.wali.MinimalLockingWriteAheadLog
> org.wali.MinimalLockingWriteAheadLog@6c0bf8f4 finished recovering
> records. Performing Checkpoint to ensure proper state of Partitions before
> updates
> 2017-02-13 11:32:46,835 INFO [main] org.wali.MinimalLockingWriteAheadLog
> Successfully recovered 0 records in 184 milliseconds
> 2017-02-13 11:32:46,879 INFO [main] org.wali.MinimalLockingWriteAheadLog
> org.wali.MinimalLockingWriteAheadLog@6c0bf8f4 checkpointed with 0 Records
> and 0 Swap Files in 43 milliseconds (Stop-the-world time = 26 milliseconds,
> Clear Edit Logs time = 16 millis), max Transaction ID -1
> 2017-02-13 11:32:46,879 INFO [main] o.a.n.c.r.WriteAheadFlowFileRepository
> Successfully restored 0 FlowFiles
> 2017-02-13 11:32:46,896 INFO [main] o.apache.nifi.controller.FlowController
> Starting 0 processors/ports/funnels
> 2017-02-13 11:32:46,896 INFO [main] o.apache.nifi.controller.FlowController
> Started 0 Remote Group Ports transmitting
> 2017-02-13 11:32:46,896 INFO [main] o.a.n.w.c.
> ApplicationStartupContextListener Flow Controller started successfully.
> 2017-02-13 11:32:46,903 INFO [main] o.e.jetty.server.handler.ContextHandler
> Started o.e.j.w.WebAppContext@48614fb3{/nifi-api,file:///dev/shm/
> nifi-1.1.1/work/jetty/nifi-web-api-1.1.1.war/webapp/,
> AVAILABLE}{./work/nar/framework/nifi-framework-nar-
> 1.1.1.nar-unpacked/META-INF/bundled-dependencies/nifi-web-api-1.1.1.war}
> 2017-02-13 11:32:47,457 INFO [main] /nifi-content-viewer No Spring
> WebApplicationInitializer types detected on classpath
> 2017-02-13 11:32:47,463 INFO [main] o.e.jetty.server.handler.ContextHandler
> Started o.e.j.w.WebAppContext@439b0198{/nifi-content-viewer,file:///
> dev/shm/nifi-1.1.1/work/jetty/nifi-web-content-viewer-1.1.1.
> war/webapp/,AVAILABLE}{./work/nar/framework/nifi-framework-
> nar-1.1.1.nar-unpacked/META-INF/bundled-dependencies/nifi-
> web-content-viewer-1.1.1.war}
> 2017-02-13 11:32:47,464 INFO [main] o.e.jetty.server.handler.ContextHandler
> Started o.e.j.s.h.ContextHandler@29088d3d{/nifi-docs,null,AVAILABLE}
> 2017-02-13 11:32:47,499 INFO [main] /nifi-docs No Spring
> WebApplicationInitializer types detected on classpath
> 2017-02-13 11:32:47,524 INFO [main] o.e.jetty.server.handler.ContextHandler
> Started o.e.j.w.WebAppContext@3284de45{/nifi-docs,file:///dev/shm/
> nifi-1.1.1/work/jetty/nifi-web-docs-1.1.1.war/webapp/,
> AVAILABLE}{./work/nar/framework/nifi-framework-nar-
> 1.1.1.nar-unpacked/META-INF/bundled-dependencies/nifi-web-docs-1.1.1.war}
> 2017-02-13 11:32:47,585 INFO [main] / No Spring WebApplicationInitializer
> types detected on classpath
> 2017-02-13 11:32:47,590 INFO [main] o.e.jetty.server.handler.ContextHandler
> Started o.e.j.w.WebAppContext@7962a364{/,file:///dev/shm/nifi-1.1.1/
> work/jetty/nifi-web-error-1.1.1.war/webapp/,AVAILABLE}{./
> work/nar/framework/nifi-framework-nar-1.1.1.nar-unpacked/META-INF/bundled-
> dependencies/nifi-web-error-1.1.1.war}
> 2017-02-13 11:32:47,605 INFO [main] o.eclipse.jetty.server.AbstractConnector
> Started ServerConnector@30ce78e3{HTTP/1.1,[http/1.1]}{172.23.51.151:8080}
> 2017-02-13 11:32:47,605 INFO [main] org.eclipse.jetty.server.Server
> Started @201871ms
> 2017-02-13 11:32:48,081 INFO [main] org.apache.nifi.web.server.JettyServer
> NiFi has started. The UI is available at the following URLs:
> 2017-02-13 11:32:48,082 INFO [main] org.apache.nifi.web.server.JettyServer
> http://172.23.51.151:8080/nifi
> 2017-02-13 11:32:48,083 INFO [main] org.apache.nifi.BootstrapListener
> Successfully initiated communication with Bootstrap
> 2017-02-13 11:32:48,083 INFO [main] org.apache.nifi.NiFi Controller
> initialization took 157612801054 nanoseconds.
> 2017-02-13 11:34:46,376 INFO [Write-Ahead Local State Provider
> Maintenance] org.wali.MinimalLockingWriteAheadLog org.wali.
> MinimalLockingWriteAheadLog@4e8b36af checkpointed with 0 Records and 0
> Swap Files in 3 milliseconds (Stop-the-world time = 0 milliseconds, Clear
> Edit Logs time = 0 millis), max Transaction ID -1
> 2017-02-13 11:34:46,880 INFO [pool-8-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository
> Initiating checkpoint of FlowFile Repository
> 2017-02-13 11:34:46,915 INFO [pool-8-thread-1] org.wali.MinimalLockingWriteAheadLog
> org.wali.MinimalLockingWriteAheadLog@6c0bf8f4 checkpointed with 0 Records
> and 0 Swap Files in 34 milliseconds (Stop-the-world time = 21 milliseconds,
> Clear Edit Logs time = 10 millis), max Transaction ID -1
> 2017-02-13 11:34:46,915 INFO [pool-8-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository
> Successfully checkpointed FlowFile Repository with 0 records in 34
> milliseconds
> 2017-02-13 11:36:46,378 INFO [Write-Ahead Local State Provider
> Maintenance] org.wali.MinimalLockingWriteAheadLog org.wali.
> MinimalLockingWriteAheadLog@4e8b36af checkpointed with 0 Records and 0
> Swap Files in 1 milliseconds (Stop-the-world time = 1 milliseconds, Clear
> Edit Logs time = 0 millis), max Transaction ID -1
> 2017-02-13 11:36:46,915 INFO [pool-8-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository
> Initiating checkpoint of FlowFile Repository
> 2017-02-13 11:36:46,947 INFO [pool-8-thread-1] org.wali.MinimalLockingWriteAheadLog
> org.wali.MinimalLockingWriteAheadLog@6c0bf8f4 checkpointed with 0 Records
> and 0 Swap Files in 31 milliseconds (Stop-the-world time = 21 milliseconds,
> Clear Edit Logs time = 9 millis), max Transaction ID -1
> 2017-02-13 11:36:46,947 INFO [pool-8-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository
> Successfully checkpointed FlowFile Repository with 0 records in 31
> milliseconds
>
> Thank you.
>
> Cheers,
> Chico
>