Send blocks waiting for response. Broker appears to be idle

[tridonic_koz <da...@tridonic.com>]

- Running embedded broker version 5.15.4
- One openwire connector over tcp
- There are storage limits set but sendFailIfNoSpace is true and queues are
nowhere near limits
- Everything else is set to defaults, persistent queue

Very intermittent problem where producer gets stuck and never sends message.  

The app running the embedded broker is minimal, just a Spring Boot app
wrapping the broker.

Stack trace of app running embedded broker:

msg-server-dump.txt
<http://activemq.2283324.n4.nabble.com/file/t379130/msg-server-dump.txt>  

This is the stack trace on the client producer is below.

Client and broker are running in docker containers in same docker instance. 
Runs for many days, millions of messages, before issue appears.  

Problem goes away when broker app is restarted.

Thanks for any help,

- Koz

"XNIO-5 I/O-1" #25 prio=5 os_prio=0 tid=0x00007fd6741a7000 nid=0x22 waiting
on condition [0x00007fd628ffd000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000fda11640> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403)
        at
org.apache.activemq.transport.FutureResponse.getResult(FutureResponse.java:48)
        at
org.apache.activemq.transport.ResponseCorrelator.request(ResponseCorrelator.java:87)
        at
org.apache.activemq.ActiveMQConnection.syncSendPacket(ActiveMQConnection.java:1388)
        at
org.apache.activemq.ActiveMQConnection.syncSendPacket(ActiveMQConnection.java:1428)
        at
org.apache.activemq.ActiveMQConnection.syncSendPacket(ActiveMQConnection.java:1323)
        at
org.apache.activemq.ActiveMQSession.send(ActiveMQSession.java:1967)
        - locked <0x00000000f4e379d0> (a java.lang.Object)
        at
org.apache.activemq.ActiveMQMessageProducer.send(ActiveMQMessageProducer.java:288)
        at
org.apache.activemq.ActiveMQMessageProducer.send(ActiveMQMessageProducer.java:223)
        at
org.apache.activemq.ActiveMQMessageProducerSupport.send(ActiveMQMessageProducerSupport.java:241)
        at
tridonic.n4m.connector.messaging.impl.ConnectServerPublisher.publish(ConnectServerPublisher.java:126)
        - locked <0x00000000f13b8680> (a
tridonic.n4m.connector.messaging.impl.ConnectServerPublisher)
        at
tridonic.n4m.connector.messaging.impl.ConnectServerPublisher.publish(ConnectServerPublisher.java:75)
        - locked <0x00000000f13b8680> (a
tridonic.n4m.connector.messaging.impl.ConnectServerPublisher)
        at
tridonic.n4m.connector.linkserver.impl.LinkServer.sendUpstream(LinkServer.java:338)



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html