You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@activemq.apache.org by "Jason Morawski (JIRA)" <ji...@apache.org> on 2016/02/22 16:50:18 UTC
[jira] [Created] (AMQ-6179) Broker crashes after a few minutes of
reading and writing messages
Jason Morawski created AMQ-6179:
-----------------------------------
Summary: Broker crashes after a few minutes of reading and writing messages
Key: AMQ-6179
URL: https://issues.apache.org/jira/browse/AMQ-6179
Project: ActiveMQ
Issue Type: Bug
Components: activemq-leveldb-store
Affects Versions: 5.13.1
Environment: RHEL6
Reporter: Jason Morawski
Priority: Critical
I am using a Replicated Level DB setup of ActiveMQ 5.13.1
The cluster starts successfully, however the broker crashes after a few minutes of reading and writing messages. The log contains either one of the following two stack traces:
2016-02-19 13:56:18,320 [eption handler.] INFO DefaultIOExceptionHandler - Stopping BrokerService[localhost] due to exception, java.io.IOExce
ption: Unexpected locator type: null
java.io.IOException: Unexpected locator type: null
at org.apache.activemq.util.IOExceptionSupport.create(IOExceptionSupport.java:39)
at org.apache.activemq.leveldb.LevelDBClient.might_fail(LevelDBClient.scala:552)
at org.apache.activemq.leveldb.LevelDBClient.might_fail_using_index(LevelDBClient.scala:1044)
at org.apache.activemq.leveldb.LevelDBClient.store(LevelDBClient.scala:1390)
at org.apache.activemq.leveldb.DBManager$$anonfun$drainFlushes$1.apply$mcV$sp(DBManager.scala:627)
at org.fusesource.hawtdispatch.package$$anon$4.run(hawtdispatch.scala:330)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Unexpected locator type: null
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1$$anonfun$apply$28$$anonfun$apply$29.apply(LevelDBClient.scala:1444)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1$$anonfun$apply$28$$anonfun$apply$29.apply(LevelDBClient.scala:1436)
at scala.collection.immutable.List.foreach(List.scala:383)
at scala.collection.generic.TraversableForwarder$class.foreach(TraversableForwarder.scala:35)
at scala.collection.mutable.ListBuffer.foreach(ListBuffer.scala:45)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1$$anonfun$apply$28.apply(LevelDBClient.scala:1436)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1$$anonfun$apply$28.apply(LevelDBClient.scala:1419)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1.apply(LevelDBClient.scala:1419)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1.apply(LevelDBClient.scala:1418)
at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186)
at org.apache.activemq.leveldb.LevelDBClient.write_uows(LevelDBClient.scala:1418)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1$$anonfun$apply$mcV$sp$14$$anonfun$5.apply(LevelDBClient.scala:1393)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1$$anonfun$apply$mcV$sp$14$$anonfun$5.apply(LevelDBClient.scala:1392)
at org.apache.activemq.leveldb.LevelDBClient$RichDB.write(LevelDBClient.scala:230)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1$$anonfun$apply$mcV$sp$14.apply(LevelDBClient.scala:1392)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1$$anonfun$apply$mcV$sp$14.apply(LevelDBClient.scala:1391)
at org.apache.activemq.leveldb.RecordLog$$anonfun$appender$1.apply(RecordLog.scala:569)
at org.apache.activemq.leveldb.util.TimeMetric.apply(TimeMetric.scala:43)
at org.apache.activemq.leveldb.RecordLog.appender(RecordLog.scala:568)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1.apply$mcV$sp(LevelDBClient.scala:1391)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1.apply(LevelDBClient.scala:1390)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1.apply(LevelDBClient.scala:1390)
at org.apache.activemq.leveldb.LevelDBClient.usingIndex(LevelDBClient.scala:1038)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$might_fail_using_index$1.apply(LevelDBClient.scala:1044)
at org.apache.activemq.leveldb.LevelDBClient.might_fail(LevelDBClient.scala:549)
... 7 more
or
2016-02-19 13:59:53,886 [eption handler.] INFO DefaultIOExceptionHandler - Stopping BrokerService[localhost] due to exception, java.io.IOException
java.io.IOException
at org.apache.activemq.util.IOExceptionSupport.create(IOExceptionSupport.java:39)
at org.apache.activemq.leveldb.LevelDBClient.might_fail(LevelDBClient.scala:552)
at org.apache.activemq.leveldb.LevelDBClient.might_fail_using_index(LevelDBClient.scala:1044)
at org.apache.activemq.leveldb.LevelDBClient.store(LevelDBClient.scala:1390)
at org.apache.activemq.leveldb.DBManager$$anonfun$drainFlushes$1.apply$mcV$sp(DBManager.scala:627)
at org.fusesource.hawtdispatch.package$$anon$4.run(hawtdispatch.scala:330)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1$$anonfun$apply$28$$anonfun$apply$29.apply(LevelDBClient.scala:1452)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1$$anonfun$apply$28$$anonfun$apply$29.apply(LevelDBClient.scala:1436)
at scala.collection.immutable.List.foreach(List.scala:383)
at scala.collection.generic.TraversableForwarder$class.foreach(TraversableForwarder.scala:35)
at scala.collection.mutable.ListBuffer.foreach(ListBuffer.scala:45)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1$$anonfun$apply$28.apply(LevelDBClient.scala:1436)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1$$anonfun$apply$28.apply(LevelDBClient.scala:1419)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1.apply(LevelDBClient.scala:1419)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1.apply(LevelDBClient.scala:1418)
at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186)
at org.apache.activemq.leveldb.LevelDBClient.write_uows(LevelDBClient.scala:1418)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1$$anonfun$apply$mcV$sp$14$$anonfun$5.apply(LevelDBClient.scala:1393)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1$$anonfun$apply$mcV$sp$14$$anonfun$5.apply(LevelDBClient.scala:1392)
at org.apache.activemq.leveldb.LevelDBClient$RichDB.write(LevelDBClient.scala:230)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1$$anonfun$apply$mcV$sp$14.apply(LevelDBClient.scala:1392)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1$$anonfun$apply$mcV$sp$14.apply(LevelDBClient.scala:1391)
at org.apache.activemq.leveldb.RecordLog$$anonfun$appender$1.apply(RecordLog.scala:569)
at org.apache.activemq.leveldb.util.TimeMetric.apply(TimeMetric.scala:43)
at org.apache.activemq.leveldb.RecordLog.appender(RecordLog.scala:568)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1.apply$mcV$sp(LevelDBClient.scala:1391)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1.apply(LevelDBClient.scala:1390)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1.apply(LevelDBClient.scala:1390)
at org.apache.activemq.leveldb.LevelDBClient.usingIndex(LevelDBClient.scala:1038)
at org.apache.activemq.leveldb.LevelDBClient$$anonfun$might_fail_using_index$1.apply(LevelDBClient.scala:1044)
at org.apache.activemq.leveldb.LevelDBClient.might_fail(LevelDBClient.scala:549)
... 7 more
I did not experience this issue on ActiveMQ 5.10.0, which was the previous version I was using. This issue has forced me to rollback to that version. I would like to use the new version since it provides fixes for a number of issues, particularly WebSocket stability.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)