You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@activemq.apache.org by KRISHNADASANTS <kr...@geojit.com> on 2011/03/07 12:53:55 UTC

Re: Message stuck on queue

hi,

this is an immediate update.From monitoring from jmx we could see that
enqueueCount is 1 less than dequecount and dispatchcount always. It is not
make sense right?. Usually enquecount will be equal to dequecount or it can
be a higher value, but never a lower value.Or my understanding may be wrong.

Thanks
Krishnadasan T S 

--
View this message in context: http://activemq.2283324.n4.nabble.com/Message-stuck-on-queue-tp3338786p3338803.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.

Re: Message stuck on queue : Same Issue Both 5.2.0 and 5.4.2

Posted by KRISHNADASANTS <kr...@geojit.com>.
Hi Gary,

 I am trying to generate the same in a test application but still not
succeeded.But by looking into the production log i noticed that there is one
error comming as follows.

javax.jms.JMSException: Cannot remove a producer that had not been
registered: ID:flipultimate-53739-1299579015550-0:1:44:2
        at
org.apache.activemq.util.JMSExceptionSupport.create(JMSExceptionSupport.java:49)
        at
org.apache.activemq.ActiveMQConnection.onAsyncException(ActiveMQConnection.java:1833)
        at
org.apache.activemq.ActiveMQConnection$2$1.run(ActiveMQConnection.java:1754)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:619)
Caused by: java.lang.IllegalStateException: Cannot remove a producer that
had not been registered: ID:flipultimate-53739-1299579015550-0:1:44:2
        at
org.apache.activemq.broker.TransportConnection.processRemoveProducer(TransportConnection.java:532)
        at org.apache.activemq.command.RemoveInfo.visit(RemoveInfo.java:78)
        at
org.apache.activemq.broker.TransportConnection.service(TransportConnection.java:311)
        at
org.apache.activemq.broker.TransportConnection$1.onCommand(TransportConnection.java:185)
        at
org.apache.activemq.transport.TransportFilter.onCommand(TransportFilter.java:69)
        at
org.apache.activemq.transport.WireFormatNegotiator.onCommand(WireFormatNegotiator.java:113)
        at
org.apache.activemq.transport.InactivityMonitor.onCommand(InactivityMonitor.java:228)
        at
org.apache.activemq.transport.TransportSupport.doConsume(TransportSupport.java:83)
        at
org.apache.activemq.transport.tcp.TcpTransport.doRun(TcpTransport.java:220)
        at
org.apache.activemq.transport.tcp.TcpTransport.run(TcpTransport.java:202)


We are creating and starting DefaultMessagelistener from code not from
spring xml file.Can it have any relation with DefaultMessagelistener.

Thanks
Krishnadasan T S



--
View this message in context: http://activemq.2283324.n4.nabble.com/Message-stuck-on-queue-tp3338786p3341354.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.

RE: Message stuck on queue : Providing test Case

Posted by nnprasad <NN...@dwd.IN.gov>.
ActiveMQ 5.2.0, Persistent, Failover transport over tcp, Oracle 10g, windows
2003 server R2 SP2.

Test Program, non persistent, windows xp sp 3.


Explaining the scenario in short:

1. message -1067 was posted to master ActiveMQ to 61716 Consumer was
listening on Master ActivveMQ

2. Something happened to Master ActiveMQ..Failover kicked in and Slave Came
Up. Picked that message-1067

3. consumer got connect exception to connect to ActiveMQ 61716.

4. Consumer Listening on Slave ActiveMQ 61916, Message was there in that
"UIMJobQueueCIBenefits", Consumer could not get that.

5. Test Program sent a "NNP Message" to that same Queue, Test Consumer did
not receive any thing..Message can be seen in Queue browser Active MQ Admin.

6. Test Program was ran 4 times ...but no messages was received.



MESSAGE WAS STRUCK ON QUEUE.

this has been in 5.2.0 and recently KRISHNA reported this in 5.4.2.....It is
becoming a serious issue now.

Some one please help.

Thank You,
Nag.

--
View this message in context: http://activemq.2283324.n4.nabble.com/Message-stuck-on-queue-tp3338786p3354797.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.

RE: Message stuck on queue : Providing test Case

Posted by nnprasad <NN...@dwd.IN.gov>.
To give more clear clarity explanation I am attaching my scenario in a word
file and uploading to this post
http://activemq.2283324.n4.nabble.com/file/n3354761/Message_Struck_-_Scenario.doc
Message_Struck_-_Scenario.doc 

Thank You,
Nag.

--
View this message in context: http://activemq.2283324.n4.nabble.com/Message-stuck-on-queue-tp3338786p3354761.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.

RE: Message stuck on queue : Same Issue Both 5.2.0 and 5.4.2

Posted by "Nakarikanti, Nageswara" <NN...@dwd.IN.gov>.
Hi Gary,

I already  attached some useful resources (.java, .log) and some explanation on some same issue I found in JIRA.

We can not provide a 100% reproduceable test case as this scenario is not happening always with a program.

We could not expect when it is really happening (some one posted in the issue - "after some days of continuous running")

I did hit that queue with my program when it was struck and not releasing messages, the same happened to my consumer program too.

It didn't get any message. Please have a look at...


Link : https://issues.apache.org/jira/browse/AMQ-1751

Thanking You,
Nag.

-----Original Message-----
From: Gary Tully [mailto:gary.tully@gmail.com] 
Sent: Tuesday, March 08, 2011 6:18 AM
To: users@activemq.apache.org
Subject: Re: Message stuck on queue : Same Issue Both 5.2.0 and 5.4.2

The most important thing for any issue resolution is a good test case that can reproduce the problematic behavior.
Typically a fix results in a new junit test in activemq-core, so it you can produce a failing test in that form it would be excellent.
Often, the process of generating a test case; requiring all of the variables to be accessed and understood can expedite the resolution process by eliminating parts of the system that just produce noise.

If you can generate such a test, then validate it with the current 5.5-SNAPSHOT, as this contains all of the known fixes to date.


On 7 March 2011 16:44, nnprasad <NN...@dwd.in.gov> wrote:
>
> Hi Krishna,
>
> your first post was still pending, hope with no reason
>
> Even I am facing the same Issue, But with ActiveMQ 5.2.0, Windows 2003 
> Server R2 SP2, Persistent with Oracle 10g.
>
> Not you are facing it in Active MQ 5.4.2, I am suggesting an upgrade 
> to my project to 5.4.2 because of this issue.
>
> I am really afraid now. this is going to be a serious problem, as 
> crucial batches are holding on messages for days with no reason because of activeMQ.
>
> I pity myself, no one looked at my POST / Issue created 
> http://activemq.2283324.n4.nabble.com/Strange-Issue-Particular-Queue-N
> ot-sending-Msgs-to-Consumer-td3331634.html
> http://activemq.2283324.n4.nabble.com/Strange-Issue-Particular-Queue-N
> ot-sending-Msgs-to-Consumer-td3331634.html
>
>
> It has been already Late Late Late..we reached 5.4.2
>
> Some one from ActiveMQ must addrres this issue...praying GOD!
>
> Thank You
> NN Prasad
>
> --
> View this message in context: 
> http://activemq.2283324.n4.nabble.com/Message-stuck-on-queue-tp3338786
> p3339422.html Sent from the ActiveMQ - User mailing list archive at 
> Nabble.com.
>



--
http://blog.garytully.com
http://fusesource.com

Re: Message stuck on queue : Same Issue Both 5.2.0 and 5.4.2

Posted by Gary Tully <ga...@gmail.com>.
The most important thing for any issue resolution is a good test case
that can reproduce the problematic behavior.
Typically a fix results in a new junit test in activemq-core, so it
you can produce a failing test in that form it would be excellent.
Often, the process of generating a test case; requiring all of the
variables to be accessed and understood can expedite the resolution
process by eliminating parts of the system that just produce noise.

If you can generate such a test, then validate it with the current
5.5-SNAPSHOT, as this contains all of the known fixes to date.


On 7 March 2011 16:44, nnprasad <NN...@dwd.in.gov> wrote:
>
> Hi Krishna,
>
> your first post was still pending, hope with no reason
>
> Even I am facing the same Issue, But with ActiveMQ 5.2.0, Windows 2003
> Server R2 SP2, Persistent with Oracle 10g.
>
> Not you are facing it in Active MQ 5.4.2, I am suggesting an upgrade to my
> project to 5.4.2 because of this issue.
>
> I am really afraid now. this is going to be a serious problem, as crucial
> batches are holding on messages for days with no reason because of activeMQ.
>
> I pity myself, no one looked at my POST / Issue created
> http://activemq.2283324.n4.nabble.com/Strange-Issue-Particular-Queue-Not-sending-Msgs-to-Consumer-td3331634.html
> http://activemq.2283324.n4.nabble.com/Strange-Issue-Particular-Queue-Not-sending-Msgs-to-Consumer-td3331634.html
>
>
> It has been already Late Late Late..we reached 5.4.2
>
> Some one from ActiveMQ must addrres this issue...praying GOD!
>
> Thank You
> NN Prasad
>
> --
> View this message in context: http://activemq.2283324.n4.nabble.com/Message-stuck-on-queue-tp3338786p3339422.html
> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>



-- 
http://blog.garytully.com
http://fusesource.com

Re: Message stuck on queue : Same Issue Both 5.2.0 and 5.4.2

Posted by KRISHNADASANTS <kr...@geojit.com>.
 hi ,

 Yes prasad. I already posted a similar thread and still it is pending. what
i noticed is that the problem in my system is related with an application
restart.when we restart an application in between incoming requests,
sometimes consumers are not registering.there is no error in application
log.but when we look into jmx console there may not be any consumer for some
queues. It is a random behavior.  We are using spring
defaultmessagelistenercontainer and jmstemplate. It can be a problem related
to that also. We noticed two things some time messages becomes slow(30 - 60
seconds) and some time messages are not processed at all. I think both has
some relation to application restart. If we start an application, when there
is no incoming message flow, there will not be any problem. But if there is
message flow then activemq shows strange behavior. 

can anybody give some clue to this problem.

Prasad, is your issue related to application restart? 

Thanks
Krishnadasan T S 





--
View this message in context: http://activemq.2283324.n4.nabble.com/Message-stuck-on-queue-tp3338786p3340638.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.

Re: Message stuck on queue : Same Issue Both 5.2.0 and 5.4.2

Posted by nnprasad <NN...@dwd.IN.gov>.
Hi Krishna,

your first post was still pending, hope with no reason

Even I am facing the same Issue, But with ActiveMQ 5.2.0, Windows 2003
Server R2 SP2, Persistent with Oracle 10g.

Not you are facing it in Active MQ 5.4.2, I am suggesting an upgrade to my
project to 5.4.2 because of this issue.

I am really afraid now. this is going to be a serious problem, as crucial
batches are holding on messages for days with no reason because of activeMQ.

I pity myself, no one looked at my POST / Issue created 
http://activemq.2283324.n4.nabble.com/Strange-Issue-Particular-Queue-Not-sending-Msgs-to-Consumer-td3331634.html
http://activemq.2283324.n4.nabble.com/Strange-Issue-Particular-Queue-Not-sending-Msgs-to-Consumer-td3331634.html 


It has been already Late Late Late..we reached 5.4.2

Some one from ActiveMQ must addrres this issue...praying GOD!

Thank You
NN Prasad

--
View this message in context: http://activemq.2283324.n4.nabble.com/Message-stuck-on-queue-tp3338786p3339422.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.