You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@geronimo.apache.org by "Forrest Xia (JIRA)" <ji...@apache.org> on 2012/10/10 16:03:09 UTC

[jira] [Updated] (GERONIMO-5554) blueprint deadlock during server start

     [ https://issues.apache.org/jira/browse/GERONIMO-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Forrest Xia updated GERONIMO-5554:
----------------------------------

    Fix Version/s:     (was: 3.0.0)
                   3.0.1
    
> blueprint deadlock during server start
> --------------------------------------
>
>                 Key: GERONIMO-5554
>                 URL: https://issues.apache.org/jira/browse/GERONIMO-5554
>             Project: Geronimo
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: Aries
>    Affects Versions: 3.0.0
>            Reporter: Kevan Miller
>             Fix For: 3.0.1
>
>
> I stumbled upon a deadlock during server startup. Only seen it once. Was running 'JAVA_OPTS=-verbosegc ./geronimo run --long', but doubt that makes a significant difference. Setting JAVA_OPTS would mean we're running with Java heap/permgen defaults, not the Geronimo defaults.
> Looked like we were loading rmi-naming. Here's the last console output:
> Module  2/34 org.apache.geronimo.framework/rmi-naming/3.0-SNAPSHOT/car              [GC 49143K->34248K(83008K), 0.0153521 secs]
> [GC 34257K(83008K), 0.0029171 secs]
> [GC 34267K(83008K), 0.0015866 secs]
> Here are the thread dumps from SIGQUIT:
> Full thread dump Java HotSpot(TM) 64-Bit Server VM (16.3-b01-279 mixed mode):
> "Blueprint Event Dispatcher: 1" daemon prio=5 tid=11ce57800 nid=0x119b19000 waiting on condition [119b18000]
>    java.lang.Thread.State: WAITING (parking)
> 	at sun.misc.Unsafe.park(Native Method)
> 	- parking to wait for  <1080c97f8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
> 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
> 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
> 	at java.lang.Thread.run(Thread.java:637)
> "JMX OSGi Agent" daemon prio=5 tid=101e60000 nid=0x11996c000 waiting on condition [11996b000]
>    java.lang.Thread.State: WAITING (parking)
> 	at sun.misc.Unsafe.park(Native Method)
> 	- parking to wait for  <1078b00a8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
> 	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
> 	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
> 	at java.lang.Thread.run(Thread.java:637)
> "Timer-2" daemon prio=5 tid=11b82b000 nid=0x117a14000 in Object.wait() [117a13000]
>    java.lang.Thread.State: WAITING (on object monitor)
> 	at java.lang.Object.wait(Native Method)
> 	- waiting on <108fcf068> (a java.util.TaskQueue)
> 	at java.lang.Object.wait(Object.java:485)
> 	at java.util.TimerThread.mainLoop(Timer.java:483)
> 	- locked <108fcf068> (a java.util.TaskQueue)
> 	at java.util.TimerThread.run(Timer.java:462)
> "gogo shell pipe thread" daemon prio=5 tid=102aca800 nid=0x11961a000 runnable [119619000]
>    java.lang.Thread.State: RUNNABLE
> 	at java.io.FileInputStream.readBytes(Native Method)
> 	at java.io.FileInputStream.read(FileInputStream.java:199)
> 	at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
> 	at java.io.BufferedInputStream.read(BufferedInputStream.java:237)
> 	- locked <107e652e0> (a java.io.BufferedInputStream)
> 	at jline.Terminal.readCharacter(Terminal.java:99)
> 	at org.apache.felix.karaf.shell.console.jline.Console$Pipe.run(Console.java:386)
> 	at java.lang.Thread.run(Thread.java:637)
> "Karaf Shell Console Thread" daemon prio=5 tid=11ca14800 nid=0x118f55000 waiting on condition [118f54000]
>    java.lang.Thread.State: WAITING (parking)
> 	at sun.misc.Unsafe.park(Native Method)
> 	- parking to wait for  <108b6ac38> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
> 	at java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:317)
> 	at org.apache.felix.karaf.shell.console.jline.Console$ConsoleInputStream.read(Console.java:324)
> 	at org.apache.felix.karaf.shell.console.jline.Console$ConsoleInputStream.read(Console.java:341)
> 	at jline.Terminal.readCharacter(Terminal.java:99)
> 	at jline.UnixTerminal.readVirtualKey(UnixTerminal.java:144)
> 	at jline.ConsoleReader.readVirtualKey(ConsoleReader.java:1504)
> 	at jline.ConsoleReader.readBinding(ConsoleReader.java:674)
> 	at jline.ConsoleReader.readLine(ConsoleReader.java:514)
> 	at jline.ConsoleReader.readLine(ConsoleReader.java:468)
> 	at org.apache.felix.karaf.shell.console.jline.Console.run(Console.java:174)
> 	at java.lang.Thread.run(Thread.java:637)
> "Bundle File Closer" daemon prio=5 tid=101e70000 nid=0x1191ee000 in Object.wait() [1191ed000]
>    java.lang.Thread.State: WAITING (on object monitor)
> 	at java.lang.Object.wait(Native Method)
> 	- waiting on <10835c9b0> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
> 	at java.lang.Object.wait(Object.java:485)
> 	at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:393)
> 	- locked <10835c9b0> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
> 	at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)
> "fileinstall-/Users/kevan/geronimo/server/trunk/assemblies/geronimo-tomcat7-javaee6-web/target/geronimo-tomcat7-javaee6-web-3.0-SNAPSHOT/deploy" daemon prio=5 tid=1028ef000 nid=0x118d0d000 in Object.wait() [118d0c000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
> 	at java.lang.Object.wait(Native Method)
> 	- waiting on <108137c48> (a org.apache.felix.fileinstall.internal.DirectoryWatcher)
> 	at org.apache.felix.fileinstall.internal.DirectoryWatcher.run(DirectoryWatcher.java:242)
> 	- locked <108137c48> (a org.apache.felix.fileinstall.internal.DirectoryWatcher)
> "Blueprint Extender: 3" daemon prio=5 tid=101b5a800 nid=0x119869000 waiting for monitor entry [119867000]
>    java.lang.Thread.State: BLOCKED (on object monitor)
> 	at org.apache.aries.blueprint.container.ReferenceListRecipe.track(ReferenceListRecipe.java:107)
> 	- waiting to lock <1081f0e30> (a java.lang.Object)
> 	at org.apache.aries.blueprint.container.AbstractServiceReferenceRecipe.serviceAdded(AbstractServiceReferenceRecipe.java:365)
> 	at org.apache.aries.blueprint.container.AbstractServiceReferenceRecipe.serviceChanged(AbstractServiceReferenceRecipe.java:349)
> 	at org.eclipse.osgi.internal.serviceregistry.FilteredServiceListener.serviceChanged(FilteredServiceListener.java:104)
> 	at org.eclipse.osgi.framework.internal.core.BundleContextImpl.dispatchEvent(BundleContextImpl.java:933)
> 	at org.eclipse.osgi.framework.eventmgr.EventManager.dispatchEvent(EventManager.java:227)
> 	at org.eclipse.osgi.framework.eventmgr.ListenerQueue.dispatchEventSynchronous(ListenerQueue.java:149)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.publishServiceEventPrivileged(ServiceRegistry.java:755)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.publishServiceEvent(ServiceRegistry.java:710)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceRegistrationImpl.register(ServiceRegistrationImpl.java:129)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.registerService(ServiceRegistry.java:206)
> 	at org.eclipse.osgi.framework.internal.core.BundleContextImpl.registerService(BundleContextImpl.java:507)
> 	at org.apache.aries.blueprint.container.BlueprintContainerImpl.registerService(BlueprintContainerImpl.java:388)
> 	at org.apache.aries.blueprint.container.ServiceRecipe.register(ServiceRecipe.java:165)
> 	at org.apache.aries.blueprint.container.BlueprintContainerImpl.registerServices(BlueprintContainerImpl.java:646)
> 	at org.apache.aries.blueprint.container.BlueprintContainerImpl.doRun(BlueprintContainerImpl.java:314)
> 	at org.apache.aries.blueprint.container.BlueprintContainerImpl.run(BlueprintContainerImpl.java:213)
> 	- locked <1080a4e48> (a java.util.concurrent.atomic.AtomicBoolean)
> 	- locked <1080a4e30> (a java.util.concurrent.atomic.AtomicBoolean)
> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:98)
> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:207)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> 	at java.lang.Thread.run(Thread.java:637)
> "Blueprint Extender: 2" daemon prio=5 tid=101a87000 nid=0x119517000 waiting for monitor entry [119515000]
>    java.lang.Thread.State: BLOCKED (on object monitor)
> 	at org.apache.aries.blueprint.container.ServiceRecipe.internalGetService(ServiceRecipe.java:228)
> 	- waiting to lock <108b6ae78> (a java.lang.Object)
> 	at org.apache.aries.blueprint.container.ServiceRecipe.getService(ServiceRecipe.java:308)
> 	- locked <108b6ae90> (a org.apache.aries.blueprint.container.ServiceRecipe)
> 	at org.apache.aries.blueprint.container.ServiceRecipe$TriggerServiceFactory.getService(ServiceRecipe.java:366)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceUse$1.run(ServiceUse.java:120)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceUse.getService(ServiceUse.java:118)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceRegistrationImpl.getService(ServiceRegistrationImpl.java:447)
> 	- locked <108b6af98> (a org.eclipse.osgi.internal.serviceregistry.ServiceUse)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.getService(ServiceRegistry.java:430)
> 	at org.eclipse.osgi.framework.internal.core.BundleContextImpl.getService(BundleContextImpl.java:667)
> 	at org.apache.felix.karaf.shell.console.completer.CommandsCompleter.register(CommandsCompleter.java:51)
> 	at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.aries.blueprint.utils.ReflectionUtils.invoke(ReflectionUtils.java:221)
> 	at org.apache.aries.blueprint.container.AbstractServiceReferenceRecipe$Listener.invokeMethods(AbstractServiceReferenceRecipe.java:528)
> 	at org.apache.aries.blueprint.container.AbstractServiceReferenceRecipe$Listener.bind(AbstractServiceReferenceRecipe.java:518)
> 	at org.apache.aries.blueprint.container.AbstractServiceReferenceRecipe.bind(AbstractServiceReferenceRecipe.java:415)
> 	at org.apache.aries.blueprint.container.ReferenceListRecipe.track(ReferenceListRecipe.java:135)
> 	- locked <1081f0e30> (a java.lang.Object)
> 	at org.apache.aries.blueprint.container.ReferenceListRecipe.retrack(ReferenceListRecipe.java:89)
> 	at org.apache.aries.blueprint.container.AbstractServiceReferenceRecipe.updateListeners(AbstractServiceReferenceRecipe.java:407)
> 	at org.apache.aries.blueprint.container.ReferenceListRecipe.internalCreate(ReferenceListRecipe.java:75)
> 	at org.apache.aries.blueprint.di.AbstractRecipe.create(AbstractRecipe.java:64)
> 	- locked <108231b20> (a java.lang.Object)
> 	at org.apache.aries.blueprint.container.BlueprintRepository.createInstances(BlueprintRepository.java:219)
> 	- locked <108231b20> (a java.lang.Object)
> 	at org.apache.aries.blueprint.container.BlueprintRepository.createAll(BlueprintRepository.java:147)
> 	at org.apache.aries.blueprint.container.BlueprintContainerImpl.instantiateEagerComponents(BlueprintContainerImpl.java:624)
> 	at org.apache.aries.blueprint.container.BlueprintContainerImpl.doRun(BlueprintContainerImpl.java:315)
> 	at org.apache.aries.blueprint.container.BlueprintContainerImpl.run(BlueprintContainerImpl.java:213)
> 	- locked <10807b850> (a java.util.concurrent.atomic.AtomicBoolean)
> 	- locked <10807b838> (a java.util.concurrent.atomic.AtomicBoolean)
> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:98)
> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:207)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> 	at java.lang.Thread.run(Thread.java:637)
> "Blueprint Extender: 1" daemon prio=5 tid=102e1f800 nid=0x118e10000 waiting for monitor entry [118e0e000]
>    java.lang.Thread.State: BLOCKED (on object monitor)
> 	at org.apache.aries.blueprint.container.ServiceRecipe.getService(ServiceRecipe.java:305)
> 	- waiting to lock <108b6ae90> (a org.apache.aries.blueprint.container.ServiceRecipe)
> 	at org.apache.aries.blueprint.container.ServiceRecipe$TriggerServiceFactory.getService(ServiceRecipe.java:366)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceUse$1.run(ServiceUse.java:120)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceUse.getService(ServiceUse.java:118)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceRegistrationImpl.getService(ServiceRegistrationImpl.java:447)
> 	- locked <108c10c98> (a org.eclipse.osgi.internal.serviceregistry.ServiceUse)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.getService(ServiceRegistry.java:430)
> 	at org.eclipse.osgi.framework.internal.core.BundleContextImpl.getService(BundleContextImpl.java:667)
> 	at org.apache.felix.karaf.shell.console.completer.CommandsCompleter.register(CommandsCompleter.java:51)
> 	at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.aries.blueprint.utils.ReflectionUtils.invoke(ReflectionUtils.java:221)
> 	at org.apache.aries.blueprint.container.AbstractServiceReferenceRecipe$Listener.invokeMethods(AbstractServiceReferenceRecipe.java:528)
> 	at org.apache.aries.blueprint.container.AbstractServiceReferenceRecipe$Listener.bind(AbstractServiceReferenceRecipe.java:518)
> 	at org.apache.aries.blueprint.container.AbstractServiceReferenceRecipe.bind(AbstractServiceReferenceRecipe.java:415)
> 	at org.apache.aries.blueprint.container.ReferenceListRecipe.track(ReferenceListRecipe.java:135)
> 	- locked <108c19070> (a java.lang.Object)
> 	at org.apache.aries.blueprint.container.ReferenceListRecipe.retrack(ReferenceListRecipe.java:89)
> 	at org.apache.aries.blueprint.container.AbstractServiceReferenceRecipe.updateListeners(AbstractServiceReferenceRecipe.java:407)
> 	at org.apache.aries.blueprint.container.ReferenceListRecipe.internalCreate(ReferenceListRecipe.java:75)
> 	at org.apache.aries.blueprint.di.AbstractRecipe.create(AbstractRecipe.java:64)
> 	- locked <108b6ae78> (a java.lang.Object)
> 	at org.apache.aries.blueprint.container.BlueprintRepository.createInstances(BlueprintRepository.java:219)
> 	- locked <108b6ae78> (a java.lang.Object)
> 	at org.apache.aries.blueprint.container.BlueprintRepository.createAll(BlueprintRepository.java:147)
> 	at org.apache.aries.blueprint.container.BlueprintContainerImpl.instantiateEagerComponents(BlueprintContainerImpl.java:624)
> 	at org.apache.aries.blueprint.container.BlueprintContainerImpl.doRun(BlueprintContainerImpl.java:315)
> 	at org.apache.aries.blueprint.container.BlueprintContainerImpl.run(BlueprintContainerImpl.java:213)
> 	- locked <1080a4c98> (a java.util.concurrent.atomic.AtomicBoolean)
> 	- locked <1080a4c80> (a java.util.concurrent.atomic.AtomicBoolean)
> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:98)
> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:207)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> 	at java.lang.Thread.run(Thread.java:637)
> "fileinstall-/Users/kevan/geronimo/server/trunk/assemblies/geronimo-tomcat7-javaee6-web/target/geronimo-tomcat7-javaee6-web-3.0-SNAPSHOT/etc" daemon prio=5 tid=102a6b800 nid=0x118c0a000 in Object.wait() [118c09000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
> 	at java.lang.Object.wait(Native Method)
> 	- waiting on <107ff4070> (a org.apache.felix.fileinstall.internal.DirectoryWatcher)
> 	at org.apache.felix.fileinstall.internal.DirectoryWatcher.run(DirectoryWatcher.java:242)
> 	- locked <107ff4070> (a org.apache.felix.fileinstall.internal.DirectoryWatcher)
> "Timer-1" daemon prio=5 tid=102a68800 nid=0x118b07000 in Object.wait() [118b06000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
> 	at java.lang.Object.wait(Native Method)
> 	- waiting on <1080d5650> (a java.util.TaskQueue)
> 	at java.util.TimerThread.mainLoop(Timer.java:509)
> 	- locked <1080d5650> (a java.util.TaskQueue)
> 	at java.util.TimerThread.run(Timer.java:462)
> "Configuration Updater" daemon prio=5 tid=102952800 nid=0x118901000 in Object.wait() [118900000]
>    java.lang.Thread.State: WAITING (on object monitor)
> 	at java.lang.Object.wait(Native Method)
> 	- waiting on <107f6def8> (a java.util.LinkedList)
> 	at java.lang.Object.wait(Object.java:485)
> 	at org.apache.felix.cm.impl.UpdateThread.run(UpdateThread.java:67)
> 	- locked <107f6def8> (a java.util.LinkedList)
> "Start Level Event Dispatcher" daemon prio=5 tid=102951800 nid=0x117f16000 in Object.wait() [117f15000]
>    java.lang.Thread.State: WAITING (on object monitor)
> 	at java.lang.Object.wait(Native Method)
> 	- waiting on <107d5e810> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
> 	at java.lang.Object.wait(Object.java:485)
> 	at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:393)
> 	- locked <107d5e810> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
> 	at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)
> "Framework Event Dispatcher" daemon prio=5 tid=1029a4000 nid=0x117d10000 in Object.wait() [117d0f000]
>    java.lang.Thread.State: WAITING (on object monitor)
> 	at java.lang.Object.wait(Native Method)
> 	- waiting on <107d5e8d0> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
> 	at java.lang.Object.wait(Object.java:485)
> 	at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.getNextEvent(EventManager.java:393)
> 	- locked <107d5e8d0> (a org.eclipse.osgi.framework.eventmgr.EventManager$EventThread)
> 	at org.eclipse.osgi.framework.eventmgr.EventManager$EventThread.run(EventManager.java:333)
> "State Data Manager" daemon prio=5 tid=102fd4800 nid=0x117c0d000 waiting on condition [117c0c000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
> 	at java.lang.Thread.sleep(Native Method)
> 	at org.eclipse.osgi.internal.baseadaptor.StateManager.run(StateManager.java:306)
> 	at java.lang.Thread.run(Thread.java:637)
> "Framework Active Thread" prio=5 tid=102a6f800 nid=0x11782a000 in Object.wait() [117829000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
> 	at java.lang.Object.wait(Native Method)
> 	- waiting on <107d41aa8> (a org.eclipse.osgi.framework.internal.core.Framework)
> 	at org.eclipse.osgi.framework.internal.core.Framework.run(Framework.java:1654)
> 	- locked <107d41aa8> (a org.eclipse.osgi.framework.internal.core.Framework)
> 	at java.lang.Thread.run(Thread.java:637)
> "Poller SunPKCS11-Darwin" daemon prio=1 tid=102953800 nid=0x117548000 waiting on condition [117547000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
> 	at java.lang.Thread.sleep(Native Method)
> 	at sun.security.pkcs11.SunPKCS11$TokenPoller.run(SunPKCS11.java:692)
> 	at java.lang.Thread.run(Thread.java:637)
> "Low Memory Detector" daemon prio=5 tid=1018ae800 nid=0x117190000 runnable [00000000]
>    java.lang.Thread.State: RUNNABLE
> "CompilerThread1" daemon prio=9 tid=1018ae000 nid=0x11708d000 waiting on condition [00000000]
>    java.lang.Thread.State: RUNNABLE
> "CompilerThread0" daemon prio=9 tid=1018ad000 nid=0x116f8a000 waiting on condition [00000000]
>    java.lang.Thread.State: RUNNABLE
> "Signal Dispatcher" daemon prio=9 tid=101882800 nid=0x116e87000 waiting on condition [00000000]
>    java.lang.Thread.State: RUNNABLE
> "Surrogate Locker Thread (CMS)" daemon prio=5 tid=101881800 nid=0x116d84000 waiting on condition [00000000]
>    java.lang.Thread.State: RUNNABLE
> "Finalizer" daemon prio=8 tid=102826800 nid=0x116a0f000 in Object.wait() [116a0e000]
>    java.lang.Thread.State: WAITING (on object monitor)
> 	at java.lang.Object.wait(Native Method)
> 	- waiting on <107cd0018> (a java.lang.ref.ReferenceQueue$Lock)
> 	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
> 	- locked <107cd0018> (a java.lang.ref.ReferenceQueue$Lock)
> 	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
> 	at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
> "Reference Handler" daemon prio=10 tid=102826000 nid=0x11690c000 in Object.wait() [11690b000]
>    java.lang.Thread.State: WAITING (on object monitor)
> 	at java.lang.Object.wait(Native Method)
> 	- waiting on <107cd4f48> (a java.lang.ref.Reference$Lock)
> 	at java.lang.Object.wait(Object.java:485)
> 	at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
> 	- locked <107cd4f48> (a java.lang.ref.Reference$Lock)
> "main" prio=5 tid=101801000 nid=0x100501000 waiting on condition [1004ff000]
>    java.lang.Thread.State: WAITING (parking)
> 	at sun.misc.Unsafe.park(Native Method)
> 	- parking to wait for  <1078b0300> (a java.util.concurrent.CountDownLatch$Sync)
> 	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:747)
> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:905)
> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1217)
> 	at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:207)
> 	at org.apache.geronimo.blueprint.WaitForBlueprintGBean.<init>(WaitForBlueprintGBean.java:69)
> 	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> 	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> 	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> 	at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> 	at org.apache.xbean.recipe.ReflectionUtil$ConstructorFactory.create(ReflectionUtil.java:952)
> 	at org.apache.xbean.recipe.ObjectRecipe.internalCreate(ObjectRecipe.java:276)
> 	at org.apache.xbean.recipe.AbstractRecipe.create(AbstractRecipe.java:96)
> 	at org.apache.xbean.recipe.AbstractRecipe.create(AbstractRecipe.java:61)
> 	at org.apache.geronimo.gbean.runtime.GBeanInstance.createInstance(GBeanInstance.java:933)
> 	at org.apache.geronimo.gbean.runtime.GBeanInstanceState.attemptFullStart(GBeanInstanceState.java:269)
> 	at org.apache.geronimo.gbean.runtime.GBeanInstanceState.start(GBeanInstanceState.java:103)
> 	at org.apache.geronimo.gbean.runtime.GBeanInstanceState.startRecursive(GBeanInstanceState.java:125)
> 	at org.apache.geronimo.gbean.runtime.GBeanInstance.startRecursive(GBeanInstance.java:560)
> 	at org.apache.geronimo.kernel.basic.BasicKernel.startRecursiveGBean(BasicKernel.java:386)
> 	at org.apache.geronimo.kernel.config.ConfigurationUtil.startConfigurationGBeans(ConfigurationUtil.java:460)
> 	at org.apache.geronimo.kernel.config.KernelConfigurationManager.start(KernelConfigurationManager.java:224)
> 	at org.apache.geronimo.kernel.config.SimpleConfigurationManager.startConfiguration(SimpleConfigurationManager.java:698)
> 	- locked <10a0c3b88> (a org.apache.geronimo.kernel.config.EditableKernelConfigurationManager)
> 	at org.apache.geronimo.system.main.EmbeddedDaemon.doStartup(EmbeddedDaemon.java:189)
> 	at org.apache.geronimo.system.main.EmbeddedDaemon.execute(EmbeddedDaemon.java:88)
> 	at org.apache.geronimo.system.osgi.BootActivator$1.execute(BootActivator.java:107)
> 	at org.apache.geronimo.main.Bootstrapper.execute(Bootstrapper.java:65)
> 	at org.apache.geronimo.cli.AbstractCLI.executeMain(AbstractCLI.java:65)
> 	at org.apache.geronimo.cli.daemon.DaemonCLI.main(DaemonCLI.java:32)
> "VM Thread" prio=9 tid=102823800 nid=0x116809000 runnable 
> "Gang worker#0 (Parallel GC Threads)" prio=9 tid=101802800 nid=0x102201000 runnable 
> "Gang worker#1 (Parallel GC Threads)" prio=9 tid=101803000 nid=0x102304000 runnable 
> "Concurrent Mark-Sweep GC Thread" prio=9 tid=101842800 nid=0x116511000 runnable 
> "VM Periodic Task Thread" prio=10 tid=1018c0000 nid=0x117293000 waiting on condition 
> "Exception Catcher Thread" prio=10 tid=101801800 nid=0x10171b000 runnable 
> JNI global references: 771
> Found one Java-level deadlock:
> =============================
> "Blueprint Extender: 3":
>   waiting to lock monitor 1008a42b8 (object 1081f0e30, a java.lang.Object),
>   which is held by "Blueprint Extender: 2"
> "Blueprint Extender: 2":
>   waiting to lock monitor 10308f288 (object 108b6ae78, a java.lang.Object),
>   which is held by "Blueprint Extender: 1"
> "Blueprint Extender: 1":
>   waiting to lock monitor 1030908d8 (object 108b6ae90, a org.apache.aries.blueprint.container.ServiceRecipe),
>   which is held by "Blueprint Extender: 2"
> Java stack information for the threads listed above:
> ===================================================
> "Blueprint Extender: 3":
> 	at org.apache.aries.blueprint.container.ReferenceListRecipe.track(ReferenceListRecipe.java:107)
> 	- waiting to lock <1081f0e30> (a java.lang.Object)
> 	at org.apache.aries.blueprint.container.AbstractServiceReferenceRecipe.serviceAdded(AbstractServiceReferenceRecipe.java:365)
> 	at org.apache.aries.blueprint.container.AbstractServiceReferenceRecipe.serviceChanged(AbstractServiceReferenceRecipe.java:349)
> 	at org.eclipse.osgi.internal.serviceregistry.FilteredServiceListener.serviceChanged(FilteredServiceListener.java:104)
> 	at org.eclipse.osgi.framework.internal.core.BundleContextImpl.dispatchEvent(BundleContextImpl.java:933)
> 	at org.eclipse.osgi.framework.eventmgr.EventManager.dispatchEvent(EventManager.java:227)
> 	at org.eclipse.osgi.framework.eventmgr.ListenerQueue.dispatchEventSynchronous(ListenerQueue.java:149)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.publishServiceEventPrivileged(ServiceRegistry.java:755)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.publishServiceEvent(ServiceRegistry.java:710)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceRegistrationImpl.register(ServiceRegistrationImpl.java:129)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.registerService(ServiceRegistry.java:206)
> 	at org.eclipse.osgi.framework.internal.core.BundleContextImpl.registerService(BundleContextImpl.java:507)
> 	at org.apache.aries.blueprint.container.BlueprintContainerImpl.registerService(BlueprintContainerImpl.java:388)
> 	at org.apache.aries.blueprint.container.ServiceRecipe.register(ServiceRecipe.java:165)
> 	at org.apache.aries.blueprint.container.BlueprintContainerImpl.registerServices(BlueprintContainerImpl.java:646)
> 	at org.apache.aries.blueprint.container.BlueprintContainerImpl.doRun(BlueprintContainerImpl.java:314)
> 	at org.apache.aries.blueprint.container.BlueprintContainerImpl.run(BlueprintContainerImpl.java:213)
> 	- locked <1080a4e48> (a java.util.concurrent.atomic.AtomicBoolean)
> 	- locked <1080a4e30> (a java.util.concurrent.atomic.AtomicBoolean)
> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:98)
> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:207)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> 	at java.lang.Thread.run(Thread.java:637)
> "Blueprint Extender: 2":
> 	at org.apache.aries.blueprint.container.ServiceRecipe.internalGetService(ServiceRecipe.java:228)
> 	- waiting to lock <108b6ae78> (a java.lang.Object)
> 	at org.apache.aries.blueprint.container.ServiceRecipe.getService(ServiceRecipe.java:308)
> 	- locked <108b6ae90> (a org.apache.aries.blueprint.container.ServiceRecipe)
> 	at org.apache.aries.blueprint.container.ServiceRecipe$TriggerServiceFactory.getService(ServiceRecipe.java:366)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceUse$1.run(ServiceUse.java:120)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceUse.getService(ServiceUse.java:118)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceRegistrationImpl.getService(ServiceRegistrationImpl.java:447)
> 	- locked <108b6af98> (a org.eclipse.osgi.internal.serviceregistry.ServiceUse)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.getService(ServiceRegistry.java:430)
> 	at org.eclipse.osgi.framework.internal.core.BundleContextImpl.getService(BundleContextImpl.java:667)
> 	at org.apache.felix.karaf.shell.console.completer.CommandsCompleter.register(CommandsCompleter.java:51)
> 	at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.aries.blueprint.utils.ReflectionUtils.invoke(ReflectionUtils.java:221)
> 	at org.apache.aries.blueprint.container.AbstractServiceReferenceRecipe$Listener.invokeMethods(AbstractServiceReferenceRecipe.java:528)
> 	at org.apache.aries.blueprint.container.AbstractServiceReferenceRecipe$Listener.bind(AbstractServiceReferenceRecipe.java:518)
> 	at org.apache.aries.blueprint.container.AbstractServiceReferenceRecipe.bind(AbstractServiceReferenceRecipe.java:415)
> 	at org.apache.aries.blueprint.container.ReferenceListRecipe.track(ReferenceListRecipe.java:135)
> 	- locked <1081f0e30> (a java.lang.Object)
> 	at org.apache.aries.blueprint.container.ReferenceListRecipe.retrack(ReferenceListRecipe.java:89)
> 	at org.apache.aries.blueprint.container.AbstractServiceReferenceRecipe.updateListeners(AbstractServiceReferenceRecipe.java:407)
> 	at org.apache.aries.blueprint.container.ReferenceListRecipe.internalCreate(ReferenceListRecipe.java:75)
> 	at org.apache.aries.blueprint.di.AbstractRecipe.create(AbstractRecipe.java:64)
> 	- locked <108231b20> (a java.lang.Object)
> 	at org.apache.aries.blueprint.container.BlueprintRepository.createInstances(BlueprintRepository.java:219)
> 	- locked <108231b20> (a java.lang.Object)
> 	at org.apache.aries.blueprint.container.BlueprintRepository.createAll(BlueprintRepository.java:147)
> 	at org.apache.aries.blueprint.container.BlueprintContainerImpl.instantiateEagerComponents(BlueprintContainerImpl.java:624)
> 	at org.apache.aries.blueprint.container.BlueprintContainerImpl.doRun(BlueprintContainerImpl.java:315)
> 	at org.apache.aries.blueprint.container.BlueprintContainerImpl.run(BlueprintContainerImpl.java:213)
> 	- locked <10807b850> (a java.util.concurrent.atomic.AtomicBoolean)
> 	- locked <10807b838> (a java.util.concurrent.atomic.AtomicBoolean)
> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:98)
> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:207)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> 	at java.lang.Thread.run(Thread.java:637)
> "Blueprint Extender: 1":
> 	at org.apache.aries.blueprint.container.ServiceRecipe.getService(ServiceRecipe.java:305)
> 	- waiting to lock <108b6ae90> (a org.apache.aries.blueprint.container.ServiceRecipe)
> 	at org.apache.aries.blueprint.container.ServiceRecipe$TriggerServiceFactory.getService(ServiceRecipe.java:366)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceUse$1.run(ServiceUse.java:120)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceUse.getService(ServiceUse.java:118)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceRegistrationImpl.getService(ServiceRegistrationImpl.java:447)
> 	- locked <108c10c98> (a org.eclipse.osgi.internal.serviceregistry.ServiceUse)
> 	at org.eclipse.osgi.internal.serviceregistry.ServiceRegistry.getService(ServiceRegistry.java:430)
> 	at org.eclipse.osgi.framework.internal.core.BundleContextImpl.getService(BundleContextImpl.java:667)
> 	at org.apache.felix.karaf.shell.console.completer.CommandsCompleter.register(CommandsCompleter.java:51)
> 	at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.aries.blueprint.utils.ReflectionUtils.invoke(ReflectionUtils.java:221)
> 	at org.apache.aries.blueprint.container.AbstractServiceReferenceRecipe$Listener.invokeMethods(AbstractServiceReferenceRecipe.java:528)
> 	at org.apache.aries.blueprint.container.AbstractServiceReferenceRecipe$Listener.bind(AbstractServiceReferenceRecipe.java:518)
> 	at org.apache.aries.blueprint.container.AbstractServiceReferenceRecipe.bind(AbstractServiceReferenceRecipe.java:415)
> 	at org.apache.aries.blueprint.container.ReferenceListRecipe.track(ReferenceListRecipe.java:135)
> 	- locked <108c19070> (a java.lang.Object)
> 	at org.apache.aries.blueprint.container.ReferenceListRecipe.retrack(ReferenceListRecipe.java:89)
> 	at org.apache.aries.blueprint.container.AbstractServiceReferenceRecipe.updateListeners(AbstractServiceReferenceRecipe.java:407)
> 	at org.apache.aries.blueprint.container.ReferenceListRecipe.internalCreate(ReferenceListRecipe.java:75)
> 	at org.apache.aries.blueprint.di.AbstractRecipe.create(AbstractRecipe.java:64)
> 	- locked <108b6ae78> (a java.lang.Object)
> 	at org.apache.aries.blueprint.container.BlueprintRepository.createInstances(BlueprintRepository.java:219)
> 	- locked <108b6ae78> (a java.lang.Object)
> 	at org.apache.aries.blueprint.container.BlueprintRepository.createAll(BlueprintRepository.java:147)
> 	at org.apache.aries.blueprint.container.BlueprintContainerImpl.instantiateEagerComponents(BlueprintContainerImpl.java:624)
> 	at org.apache.aries.blueprint.container.BlueprintContainerImpl.doRun(BlueprintContainerImpl.java:315)
> 	at org.apache.aries.blueprint.container.BlueprintContainerImpl.run(BlueprintContainerImpl.java:213)
> 	- locked <1080a4c98> (a java.util.concurrent.atomic.AtomicBoolean)
> 	- locked <1080a4c80> (a java.util.concurrent.atomic.AtomicBoolean)
> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:98)
> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:207)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> 	at java.lang.Thread.run(Thread.java:637)
> Found 1 deadlock.
> Heap
>  par new generation   total 19136K, used 8268K [106810000, 107cd0000, 107cd0000)
>   eden space 17024K,  36% used [106810000, 106e13048, 1078b0000)
>   from space 2112K,  99% used [1078b0000, 107abffe0, 107ac0000)
>   to   space 2112K,   0% used [107ac0000, 107ac0000, 107cd0000)
>  concurrent mark-sweep generation total 63872K, used 24654K [107cd0000, 10bb30000, 10e610000)
>  concurrent-mark-sweep perm gen total 44100K, used 26465K [10e610000, 111121000, 113a10000)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira