You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@activemq.apache.org by andymorris <an...@gmail.com> on 2009/03/31 13:23:00 UTC
Re: Messages getting Stuck
Hi guys/gals
I know this is a fairly old post but I am experiencing exactly the same
problem as described using version 5.2, so any bug may not have been fixed.
After failover a load of messages (have seen up to 7000) get stuck, if I
then restart the dead node and kill the new master (so switching back) then
some of the messages get consumed, however this is only a few hundred or
thousand and it gets stuck again. I keep switching broker node by restarting
the dead one and killing the master and it tends to get through the
remainding messages, but it tends to get to a few hundred left and no more
restarting helps.
My setup is:
ActiveMQ 5.2 HA with two nodes master and slave.
Java 6
Spring 2.5
Jencks to provide pooled connections (inbound and outbound)
JmsTemplate
Running from jar file (no appserver in this environment)
FYI our company has used ActiveMQ for the last few years and has had quite a
few problems (some their fault like putting 50mb files in messages!) and I'm
meant to be looking at alternatives. I'd like to prove that if we use it
properly and upgrade to the latest version that there'd be no/less
significant problems.
Any help would be greatly appreciated.
andy
rajdavies wrote:
>
> Hi Vivek,
>
> do you get the same behaviour with the default store (AMQ) ? You can
> set this by commenting out the persistence option from your
> configuration
>
> cheers,
>
> Rob
> On 15 Sep 2008, at 10:40, krv wrote:
>
>>
>> Ok, now I tried the latest version (5.2.0-SNAPSHOT) and faced the
>> issue at a
>> very early stage. Also the GUI was not showing number of messages
>> enqueued/dequeued properly. The counts were wrong.
>>
>> Please post if you have got any relevant information.
>>
>> Thanks in advance.
>>
>> Regards,
>> Vivek
>>
>>
>> krv wrote:
>>>
>>> Hi Rob,
>>>
>>> Thanks for the advice. I tried using 5.1.0 but the issue was still
>>> there.
>>> I hope my configuration is correct -
>>> http://www.nabble.com/file/p19449362/activemq.xml activemq.xml and
>>> did
>>> not miss any configuration.
>>>
>>> Please let me know if you get anything. I'll also be trying the
>>> latest
>>> SNAPSHOT, but I don't think I can wait for long for the stable
>>> version.
>>>
>>> Regards,
>>> Vivek
>>>
>>>
>>> rajdavies wrote:
>>>>
>>>> Hi Vivek,
>>>>
>>>> this could well be a known bug - can you use 5.1 - or 5.2 (due out
>>>> soon)
>>>>
>>>> thanks,
>>>>
>>>> Rob
>>>> On 11 Sep 2008, at 16:31, krv wrote:
>>>>
>>>>>
>>>>> Hi,
>>>>>
>>>>> Sorry for posting this again, but I did not find any solution to
>>>>> the
>>>>> problem
>>>>> in the threads posted for the similar problem.
>>>>>
>>>>> I'm using using ActiveMQ 5.0.0. I have a single enqueuer which
>>>>> enqueues say
>>>>> about 100 messages for a request. I have multiple (threaded)
>>>>> dequeuers
>>>>> running on different machines which poll Amq for messages.
>>>>>
>>>>> After about 2k-3k messages (or probably time) I see messages
>>>>> getting
>>>>> stuck
>>>>> in the AMQ store (I'm using pure JDBC persistence using mysql). I
>>>>> can see
>>>>> the messages in the DB but the consumers do not get it. If I
>>>>> restart
>>>>> ActiveMQ the messages are delivered. I've attached my file -
>>>>> http://www.nabble.com/file/p19437217/activemq.xml activemq.xml .
>>>>>
>>>>> Any kind of help is greatly appreciated.
>>>>>
>>>>> Regards,
>>>>> Vivek
>>>>> --
>>>>> View this message in context:
>>>>> http://www.nabble.com/Messages-getting-Stuck-tp19437217p19437217.html
>>>>> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>>>>>
>>>>
>>>>
>>>>
>>>
>>>
>>
>> --
>> View this message in context:
>> http://www.nabble.com/Messages-getting-Stuck-tp19437217p19489877.html
>> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>>
>
>
>
--
View this message in context: http://www.nabble.com/Messages-getting-Stuck-tp19437217p22803094.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.
Re: Messages getting Stuck
Posted by Michael Gottschalk <MG...@gmx.net>.
Hi Andy,
we also had similar problems with ActiveMQ 5.2 (see AMQ-2161).
This is apparently fixed in fuse 5.3.0.0, so we switched to fuse.
However, even with fuse, we had some additional problems, which we had to
patch ourselves (namely an out-of-memory problem and a problem with
interruptions). Our patches are available in the activemq JIRA (AMQ-2178 and
AMQ-2191).
We still have one other problem (it occurred in activemq 5.2 and
5.3.0.0-fuse): the camel processors were very slow in some cases when using
JMS transactions and they just stopped polling messages when using XA
transactions in some cases.
We could only fix that problem by replacing all camel processors by custom
code that implements routing and polling directly with Spring JmsTemplates.
Cheers,
Michael
Am Dienstag 31 März 2009 17:48:56 schrieb andymorris:
> Oh that's a shame. Have been trying OpenMQ but had some probs (namely
> http://forums.sun.com/thread.jspa?threadID=5377354&tstart=0) but I really
> can't believe there isn't a workaround for this - ActiveMQ is held in quite
> a high regard and is used quite a lot of commercial environments.
>
> Hmm, thanks for your reply, has anyone else experienced this (and hopefully
> solved it!)?
>
> krv wrote:
> > Hi Andy,
> >
> > Even after doing some research and tries I didn't succeed in my original
> > problem which is when I started looking for alternate solutions. OpenMQ
> > seem to suite our needs and helped us overcome this particular problem.
> > So, we went ahead with OpenMQ.
> >
> > But not sure if OpenMQ offers the features that you require. You can
> > check out its features and give it a try if it suits you.
> >
> > Again here, no offence to ActiveMQ users.
> >
> > Regards,
> > Vivek
> >
> > andymorris wrote:
> >> Hi guys/gals
> >>
> >> I know this is a fairly old post but I am experiencing exactly the same
> >> problem as described using version 5.2, so any bug may not have been
> >> fixed.
> >>
> >> After failover a load of messages (have seen up to 7000) get stuck, if I
> >> then restart the dead node and kill the new master (so switching back)
> >> then some of the messages get consumed, however this is only a few
> >> hundred or thousand and it gets stuck again. I keep switching broker
> >> node by restarting the dead one and killing the master and it tends to
> >> get through the remainding messages, but it tends to get to a few
> >> hundred left and no more restarting helps.
> >>
> >> My setup is:
> >> ActiveMQ 5.2 HA with two nodes master and slave.
> >> Java 6
> >> Spring 2.5
> >> Jencks to provide pooled connections (inbound and outbound)
> >> JmsTemplate
> >> Running from jar file (no appserver in this environment)
> >>
> >> FYI our company has used ActiveMQ for the last few years and has had
> >> quite a few problems (some their fault like putting 50mb files in
> >> messages!) and I'm meant to be looking at alternatives. I'd like to
> >> prove that if we use it properly and upgrade to the latest version that
> >> there'd be no/less significant problems.
> >>
> >> Any help would be greatly appreciated.
> >>
> >> andy
> [...]
Re: Messages getting Stuck
Posted by Rob Davies <ra...@gmail.com>.
We do try to fix issues as soon as we can - so I'd recommend try and
use the latest snapshot if you have an issue in a particular version.
We tend to have a long release cycle, simply because the release
process in general is quite painful. However - if you need a stable
version - try out a Fuse Message Broker version - its free, Apache
licensed and built from Apache ActiveMQ (and any issues fixed by FUSE
go back into Apache ActiveMQ too).
If you still have problems - just shout louder :)
cheers,
Rob
Rob Davies
http://fusesource.com
http://rajdavies.blogspot.com/
On 31 Mar 2009, at 14:00, krv wrote:
>
> Hi Andy,
>
> Even after doing some research and tries I didn't succeed in my
> original
> problem which is when I started looking for alternate solutions.
> OpenMQ seem
> to suite our needs and helped us overcome this particular problem.
> So, we
> went ahead with OpenMQ.
>
> But not sure if OpenMQ offers the features that you require. You can
> check
> out its features and give it a try if it suits you.
>
> Again here, no offence to ActiveMQ users.
>
> Regards,
> Vivek
>
> andymorris wrote:
>>
>> Hi guys/gals
>>
>> I know this is a fairly old post but I am experiencing exactly the
>> same
>> problem as described using version 5.2, so any bug may not have been
>> fixed.
>>
>> After failover a load of messages (have seen up to 7000) get stuck,
>> if I
>> then restart the dead node and kill the new master (so switching
>> back)
>> then some of the messages get consumed, however this is only a few
>> hundred
>> or thousand and it gets stuck again. I keep switching broker node by
>> restarting the dead one and killing the master and it tends to get
>> through
>> the remainding messages, but it tends to get to a few hundred left
>> and no
>> more restarting helps.
>>
>> My setup is:
>> ActiveMQ 5.2 HA with two nodes master and slave.
>> Java 6
>> Spring 2.5
>> Jencks to provide pooled connections (inbound and outbound)
>> JmsTemplate
>> Running from jar file (no appserver in this environment)
>>
>> FYI our company has used ActiveMQ for the last few years and has
>> had quite
>> a few problems (some their fault like putting 50mb files in
>> messages!) and
>> I'm meant to be looking at alternatives. I'd like to prove that if
>> we use
>> it properly and upgrade to the latest version that there'd be no/less
>> significant problems.
>>
>> Any help would be greatly appreciated.
>>
>> andy
>>
>>
>> rajdavies wrote:
>>>
>>> Hi Vivek,
>>>
>>> do you get the same behaviour with the default store (AMQ) ? You can
>>> set this by commenting out the persistence option from your
>>> configuration
>>>
>>> cheers,
>>>
>>> Rob
>>> On 15 Sep 2008, at 10:40, krv wrote:
>>>
>>>>
>>>> Ok, now I tried the latest version (5.2.0-SNAPSHOT) and faced the
>>>> issue at a
>>>> very early stage. Also the GUI was not showing number of messages
>>>> enqueued/dequeued properly. The counts were wrong.
>>>>
>>>> Please post if you have got any relevant information.
>>>>
>>>> Thanks in advance.
>>>>
>>>> Regards,
>>>> Vivek
>>>>
>>>>
>>>> krv wrote:
>>>>>
>>>>> Hi Rob,
>>>>>
>>>>> Thanks for the advice. I tried using 5.1.0 but the issue was still
>>>>> there.
>>>>> I hope my configuration is correct -
>>>>> http://www.nabble.com/file/p19449362/activemq.xml activemq.xml
>>>>> and
>>>>> did
>>>>> not miss any configuration.
>>>>>
>>>>> Please let me know if you get anything. I'll also be trying the
>>>>> latest
>>>>> SNAPSHOT, but I don't think I can wait for long for the stable
>>>>> version.
>>>>>
>>>>> Regards,
>>>>> Vivek
>>>>>
>>>>>
>>>>> rajdavies wrote:
>>>>>>
>>>>>> Hi Vivek,
>>>>>>
>>>>>> this could well be a known bug - can you use 5.1 - or 5.2 (due
>>>>>> out
>>>>>> soon)
>>>>>>
>>>>>> thanks,
>>>>>>
>>>>>> Rob
>>>>>> On 11 Sep 2008, at 16:31, krv wrote:
>>>>>>
>>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> Sorry for posting this again, but I did not find any solution to
>>>>>>> the
>>>>>>> problem
>>>>>>> in the threads posted for the similar problem.
>>>>>>>
>>>>>>> I'm using using ActiveMQ 5.0.0. I have a single enqueuer which
>>>>>>> enqueues say
>>>>>>> about 100 messages for a request. I have multiple (threaded)
>>>>>>> dequeuers
>>>>>>> running on different machines which poll Amq for messages.
>>>>>>>
>>>>>>> After about 2k-3k messages (or probably time) I see messages
>>>>>>> getting
>>>>>>> stuck
>>>>>>> in the AMQ store (I'm using pure JDBC persistence using
>>>>>>> mysql). I
>>>>>>> can see
>>>>>>> the messages in the DB but the consumers do not get it. If I
>>>>>>> restart
>>>>>>> ActiveMQ the messages are delivered. I've attached my file -
>>>>>>> http://www.nabble.com/file/p19437217/activemq.xml activemq.xml .
>>>>>>>
>>>>>>> Any kind of help is greatly appreciated.
>>>>>>>
>>>>>>> Regards,
>>>>>>> Vivek
>>>>>>> --
>>>>>>> View this message in context:
>>>>>>> http://www.nabble.com/Messages-getting-Stuck-tp19437217p19437217.html
>>>>>>> Sent from the ActiveMQ - User mailing list archive at
>>>>>>> Nabble.com.
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>> --
>>>> View this message in context:
>>>> http://www.nabble.com/Messages-getting-Stuck-tp19437217p19489877.html
>>>> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>>>>
>>>
>>>
>>>
>>
>>
>
> --
> View this message in context: http://www.nabble.com/Messages-getting-Stuck-tp19437217p22804687.html
> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>
Re: Messages getting Stuck
Posted by andymorris <an...@gmail.com>.
Oh that's a shame. Have been trying OpenMQ but had some probs (namely
http://forums.sun.com/thread.jspa?threadID=5377354&tstart=0) but I really
can't believe there isn't a workaround for this - ActiveMQ is held in quite
a high regard and is used quite a lot of commercial environments.
Hmm, thanks for your reply, has anyone else experienced this (and hopefully
solved it!)?
krv wrote:
>
> Hi Andy,
>
> Even after doing some research and tries I didn't succeed in my original
> problem which is when I started looking for alternate solutions. OpenMQ
> seem to suite our needs and helped us overcome this particular problem.
> So, we went ahead with OpenMQ.
>
> But not sure if OpenMQ offers the features that you require. You can check
> out its features and give it a try if it suits you.
>
> Again here, no offence to ActiveMQ users.
>
> Regards,
> Vivek
>
> andymorris wrote:
>>
>> Hi guys/gals
>>
>> I know this is a fairly old post but I am experiencing exactly the same
>> problem as described using version 5.2, so any bug may not have been
>> fixed.
>>
>> After failover a load of messages (have seen up to 7000) get stuck, if I
>> then restart the dead node and kill the new master (so switching back)
>> then some of the messages get consumed, however this is only a few
>> hundred or thousand and it gets stuck again. I keep switching broker node
>> by restarting the dead one and killing the master and it tends to get
>> through the remainding messages, but it tends to get to a few hundred
>> left and no more restarting helps.
>>
>> My setup is:
>> ActiveMQ 5.2 HA with two nodes master and slave.
>> Java 6
>> Spring 2.5
>> Jencks to provide pooled connections (inbound and outbound)
>> JmsTemplate
>> Running from jar file (no appserver in this environment)
>>
>> FYI our company has used ActiveMQ for the last few years and has had
>> quite a few problems (some their fault like putting 50mb files in
>> messages!) and I'm meant to be looking at alternatives. I'd like to prove
>> that if we use it properly and upgrade to the latest version that there'd
>> be no/less significant problems.
>>
>> Any help would be greatly appreciated.
>>
>> andy
>>
>>
>> rajdavies wrote:
>>>
>>> Hi Vivek,
>>>
>>> do you get the same behaviour with the default store (AMQ) ? You can
>>> set this by commenting out the persistence option from your
>>> configuration
>>>
>>> cheers,
>>>
>>> Rob
>>> On 15 Sep 2008, at 10:40, krv wrote:
>>>
>>>>
>>>> Ok, now I tried the latest version (5.2.0-SNAPSHOT) and faced the
>>>> issue at a
>>>> very early stage. Also the GUI was not showing number of messages
>>>> enqueued/dequeued properly. The counts were wrong.
>>>>
>>>> Please post if you have got any relevant information.
>>>>
>>>> Thanks in advance.
>>>>
>>>> Regards,
>>>> Vivek
>>>>
>>>>
>>>> krv wrote:
>>>>>
>>>>> Hi Rob,
>>>>>
>>>>> Thanks for the advice. I tried using 5.1.0 but the issue was still
>>>>> there.
>>>>> I hope my configuration is correct -
>>>>> http://www.nabble.com/file/p19449362/activemq.xml activemq.xml and
>>>>> did
>>>>> not miss any configuration.
>>>>>
>>>>> Please let me know if you get anything. I'll also be trying the
>>>>> latest
>>>>> SNAPSHOT, but I don't think I can wait for long for the stable
>>>>> version.
>>>>>
>>>>> Regards,
>>>>> Vivek
>>>>>
>>>>>
>>>>> rajdavies wrote:
>>>>>>
>>>>>> Hi Vivek,
>>>>>>
>>>>>> this could well be a known bug - can you use 5.1 - or 5.2 (due out
>>>>>> soon)
>>>>>>
>>>>>> thanks,
>>>>>>
>>>>>> Rob
>>>>>> On 11 Sep 2008, at 16:31, krv wrote:
>>>>>>
>>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> Sorry for posting this again, but I did not find any solution to
>>>>>>> the
>>>>>>> problem
>>>>>>> in the threads posted for the similar problem.
>>>>>>>
>>>>>>> I'm using using ActiveMQ 5.0.0. I have a single enqueuer which
>>>>>>> enqueues say
>>>>>>> about 100 messages for a request. I have multiple (threaded)
>>>>>>> dequeuers
>>>>>>> running on different machines which poll Amq for messages.
>>>>>>>
>>>>>>> After about 2k-3k messages (or probably time) I see messages
>>>>>>> getting
>>>>>>> stuck
>>>>>>> in the AMQ store (I'm using pure JDBC persistence using mysql). I
>>>>>>> can see
>>>>>>> the messages in the DB but the consumers do not get it. If I
>>>>>>> restart
>>>>>>> ActiveMQ the messages are delivered. I've attached my file -
>>>>>>> http://www.nabble.com/file/p19437217/activemq.xml activemq.xml .
>>>>>>>
>>>>>>> Any kind of help is greatly appreciated.
>>>>>>>
>>>>>>> Regards,
>>>>>>> Vivek
>>>>>>> --
>>>>>>> View this message in context:
>>>>>>> http://www.nabble.com/Messages-getting-Stuck-tp19437217p19437217.html
>>>>>>> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>> --
>>>> View this message in context:
>>>> http://www.nabble.com/Messages-getting-Stuck-tp19437217p19489877.html
>>>> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>>>>
>>>
>>>
>>>
>>
>>
>
>
--
View this message in context: http://www.nabble.com/Messages-getting-Stuck-tp19437217p22805036.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.
Re: Messages getting Stuck
Posted by krv <vi...@onmobile.com>.
Hi Andy,
Even after doing some research and tries I didn't succeed in my original
problem which is when I started looking for alternate solutions. OpenMQ seem
to suite our needs and helped us overcome this particular problem. So, we
went ahead with OpenMQ.
But not sure if OpenMQ offers the features that you require. You can check
out its features and give it a try if it suits you.
Again here, no offence to ActiveMQ users.
Regards,
Vivek
andymorris wrote:
>
> Hi guys/gals
>
> I know this is a fairly old post but I am experiencing exactly the same
> problem as described using version 5.2, so any bug may not have been
> fixed.
>
> After failover a load of messages (have seen up to 7000) get stuck, if I
> then restart the dead node and kill the new master (so switching back)
> then some of the messages get consumed, however this is only a few hundred
> or thousand and it gets stuck again. I keep switching broker node by
> restarting the dead one and killing the master and it tends to get through
> the remainding messages, but it tends to get to a few hundred left and no
> more restarting helps.
>
> My setup is:
> ActiveMQ 5.2 HA with two nodes master and slave.
> Java 6
> Spring 2.5
> Jencks to provide pooled connections (inbound and outbound)
> JmsTemplate
> Running from jar file (no appserver in this environment)
>
> FYI our company has used ActiveMQ for the last few years and has had quite
> a few problems (some their fault like putting 50mb files in messages!) and
> I'm meant to be looking at alternatives. I'd like to prove that if we use
> it properly and upgrade to the latest version that there'd be no/less
> significant problems.
>
> Any help would be greatly appreciated.
>
> andy
>
>
> rajdavies wrote:
>>
>> Hi Vivek,
>>
>> do you get the same behaviour with the default store (AMQ) ? You can
>> set this by commenting out the persistence option from your
>> configuration
>>
>> cheers,
>>
>> Rob
>> On 15 Sep 2008, at 10:40, krv wrote:
>>
>>>
>>> Ok, now I tried the latest version (5.2.0-SNAPSHOT) and faced the
>>> issue at a
>>> very early stage. Also the GUI was not showing number of messages
>>> enqueued/dequeued properly. The counts were wrong.
>>>
>>> Please post if you have got any relevant information.
>>>
>>> Thanks in advance.
>>>
>>> Regards,
>>> Vivek
>>>
>>>
>>> krv wrote:
>>>>
>>>> Hi Rob,
>>>>
>>>> Thanks for the advice. I tried using 5.1.0 but the issue was still
>>>> there.
>>>> I hope my configuration is correct -
>>>> http://www.nabble.com/file/p19449362/activemq.xml activemq.xml and
>>>> did
>>>> not miss any configuration.
>>>>
>>>> Please let me know if you get anything. I'll also be trying the
>>>> latest
>>>> SNAPSHOT, but I don't think I can wait for long for the stable
>>>> version.
>>>>
>>>> Regards,
>>>> Vivek
>>>>
>>>>
>>>> rajdavies wrote:
>>>>>
>>>>> Hi Vivek,
>>>>>
>>>>> this could well be a known bug - can you use 5.1 - or 5.2 (due out
>>>>> soon)
>>>>>
>>>>> thanks,
>>>>>
>>>>> Rob
>>>>> On 11 Sep 2008, at 16:31, krv wrote:
>>>>>
>>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> Sorry for posting this again, but I did not find any solution to
>>>>>> the
>>>>>> problem
>>>>>> in the threads posted for the similar problem.
>>>>>>
>>>>>> I'm using using ActiveMQ 5.0.0. I have a single enqueuer which
>>>>>> enqueues say
>>>>>> about 100 messages for a request. I have multiple (threaded)
>>>>>> dequeuers
>>>>>> running on different machines which poll Amq for messages.
>>>>>>
>>>>>> After about 2k-3k messages (or probably time) I see messages
>>>>>> getting
>>>>>> stuck
>>>>>> in the AMQ store (I'm using pure JDBC persistence using mysql). I
>>>>>> can see
>>>>>> the messages in the DB but the consumers do not get it. If I
>>>>>> restart
>>>>>> ActiveMQ the messages are delivered. I've attached my file -
>>>>>> http://www.nabble.com/file/p19437217/activemq.xml activemq.xml .
>>>>>>
>>>>>> Any kind of help is greatly appreciated.
>>>>>>
>>>>>> Regards,
>>>>>> Vivek
>>>>>> --
>>>>>> View this message in context:
>>>>>> http://www.nabble.com/Messages-getting-Stuck-tp19437217p19437217.html
>>>>>> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>
>>> --
>>> View this message in context:
>>> http://www.nabble.com/Messages-getting-Stuck-tp19437217p19489877.html
>>> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>>>
>>
>>
>>
>
>
--
View this message in context: http://www.nabble.com/Messages-getting-Stuck-tp19437217p22804687.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.