You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@activemq.apache.org by "Jean-Baptiste Onofré (Jira)" <ji...@apache.org> on 2020/12/02 10:29:00 UTC

[jira] [Assigned] (AMQ-8034) Client connection get blocked at ensureConnectionInfoSent

     [ https://issues.apache.org/jira/browse/AMQ-8034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jean-Baptiste Onofré reassigned AMQ-8034:
-----------------------------------------

    Assignee: Jean-Baptiste Onofré

> Client connection get blocked at ensureConnectionInfoSent
> ---------------------------------------------------------
>
>                 Key: AMQ-8034
>                 URL: https://issues.apache.org/jira/browse/AMQ-8034
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: JMS client
>    Affects Versions: 5.15.11
>            Reporter: Rajan Arul
>            Assignee: Jean-Baptiste Onofré
>            Priority: Major
>
> The activemq client seems to get blocked forever on the application side.   We analyzed the thread dump and the most of the threads are stuck here 
>  
> {code:java}
> org.apache.activemq.ActiveMQConnection.ensureConnectionInfoSent(ActiveMQConnection.java:1479)
> org.apache.activemq.ActiveMQConnection.createSession(ActiveMQConnection.java:329)
> org.apache.activemq.jms.pool.ConnectionPool.makeSession(ConnectionPool.java:112)
> org.apache.activemq.jms.pool.ConnectionPool$1.makeObject(ConnectionPool.java:82)
> org.apache.activemq.jms.pool.ConnectionPool$1.makeObject(ConnectionPool.java:78)
> org.apache.commons.pool2.impl.GenericKeyedObjectPool.create(GenericKeyedObjectPool.java:1041)
> org.apache.commons.pool2.impl.GenericKeyedObjectPool.borrowObject(GenericKeyedObjectPool.java:342)
> org.apache.commons.pool2.impl.GenericKeyedObjectPool.borrowObject(GenericKeyedObjectPool.java:265)
> org.apache.activemq.jms.pool.ConnectionPool.createSession(ConnectionPool.java:144)
> org.apache.activemq.jms.pool.PooledConnection.createSession(PooledConnection.java:167)
> org.springframework.jms.support.JmsAccessor.createSession(JmsAccessor.java:208)
> org.springframework.jms.core.JmsTemplate.execute(JmsTemplate.java:495)
> org.apache.camel.component.jms.JmsConfiguration$CamelJmsTemplate.send(JmsConfiguration.java:526)
> org.apache.camel.component.jms.JmsProducer.doSend(JmsProducer.java:440)
> org.apache.camel.component.jms.JmsProducer.processInOnly(JmsProducer.java:394)
> org.apache.camel.component.jms.JmsProducer.process(JmsProducer.java:157)
> org.apache.camel.processor.SendProcessor.process(SendProcessor.java:148)
> org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:201)
> org.apache.camel.processor.Pipeline.process(Pipeline.java:138)
> org.apache.camel.processor.Pipeline.process(Pipeline.java:101)
> {code}
> The above threads were blocked by other thread which has progressed further and was stuck here
>  
> {code:java}
>     java.lang.Thread.State: WAITING (parking)               at jdk.internal.misc.Unsafe.park(java.base@11.0.6/Native Method)               - parking to wait for   (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)               at java.util.concurrent.locks.LockSupport.park(java.base@11.0.6/LockSupport.java:194)               at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@11.0.6/AbstractQueuedSynchronizer.java:2081)               at java.util.concurrent.ArrayBlockingQueue.take(java.base@11.0.6/ArrayBlockingQueue.java:417)               at org.apache.activemq.transport.FutureResponse.getResult(FutureResponse.java:48)               at org.apache.activemq.transport.ResponseCorrelator.request(ResponseCorrelator.java:87)               at org.apache.activemq.ActiveMQConnection.syncSendPacket(ActiveMQConnection.java:1392)               at org.apache.activemq.ActiveMQConnection.syncSendPacket(ActiveMQConnection.java:1436)               at org.apache.activemq.AdvisoryConsumer.(AdvisoryConsumer.java:51)               at org.apache.activemq.ActiveMQConnection.ensureConnectionInfoSent(ActiveMQConnection.java:1495)               - locked  (a java.lang.Object)               at org.apache.activemq.ActiveMQConnection.createSession(ActiveMQConnection.java:329)               at org.apache.activemq.jms.pool.ConnectionPool.makeSession(ConnectionPool.java:112)               at org.apache.activemq.jms.pool.ConnectionPool$1.makeObject(ConnectionPool.java:82)               at org.apache.activemq.jms.pool.ConnectionPool$1.makeObject(ConnectionPool.java:78)               at org.apache.commons.pool2.impl.GenericKeyedObjectPool.create(GenericKeyedObjectPool.java:1041)               at org.apache.commons.pool2.impl.GenericKeyedObjectPool.borrowObject(GenericKeyedObjectPool.java:342)               at org.apache.commons.pool2.impl.GenericKeyedObjectPool.borrowObject(GenericKeyedObjectPool.java:265)               at org.apache.activemq.jms.pool.ConnectionPool.createSession(ConnectionPool.java:144)               at org.apache.activemq.jms.pool.PooledConnection.createSession(PooledConnection.java:167)               at org.springframework.jms.support.JmsAccessor.createSession(JmsAccessor.java:208)               at org.springframework.jms.core.JmsTemplate.execute(JmsTemplate.java:495)               at org.apache.camel.component.jms.JmsConfiguration$CamelJmsTemplate.send(JmsConfiguration.java:526)               at org.apache.camel.component.jms.JmsProducer.doSend(JmsProducer.java:440)               at org.apache.camel.component.jms.JmsProducer.processInOnly(JmsProducer.java:394)               at org.apache.camel.component.jms.JmsProducer.process(JmsProducer.java:157)
> {code}
>  
> This issue seems to happen only on clustered (master/slave) environments .  We have not seen this on a single node environment.  
>  
> Based on code analysis so far, the client seems to be sending an advisory message back to the server and it seem to get stuck forever and never recovers. 
> I am not super familiar with this code base but I think adding a timeout to the syncSendPack in this code might help  see comments in  ==> in the code section below. 
> {code:java}
> public AdvisoryConsumer(ActiveMQConnection connection, ConsumerId consumerId) throws JMSException {
>     this.connection = connection;
>     info = new ConsumerInfo(consumerId);
>     info.setDestination(AdvisorySupport.TEMP_DESTINATION_COMPOSITE_ADVISORY_TOPIC);
>     info.setPrefetchSize(1000);
>     info.setNoLocal(true);
>     info.setDispatchAsync(true);
>     this.connection.addDispatcher(info.getConsumerId(), this);
>     this.connection.syncSendPacket(this.info);  ======>  Use the syncSendPacket method with timeout option 
> }
> {code}
> Please review and let me know if this change will help.
>  
>  
>  
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)