You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@activemq.apache.org by "Timothy Bish (JIRA)" <ji...@apache.org> on 2016/02/23 21:55:18 UTC
[jira] [Commented] (AMQ-6179) Broker crashes after a few minutes of
reading and writing messages
[ https://issues.apache.org/jira/browse/AMQ-6179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15159634#comment-15159634 ]
Timothy Bish commented on AMQ-6179:
-----------------------------------
Can you try and create a unit test that reproduces the issue and attach it here, that would make it easier for someone to investigate the issue.
> Broker crashes after a few minutes of reading and writing messages
> ------------------------------------------------------------------
>
> Key: AMQ-6179
> URL: https://issues.apache.org/jira/browse/AMQ-6179
> Project: ActiveMQ
> Issue Type: Bug
> Components: activemq-leveldb-store
> Affects Versions: 5.13.1
> Environment: RHEL6
> Reporter: Jason Morawski
> Priority: Critical
>
> I am using a Replicated Level DB setup of ActiveMQ 5.13.1
> The cluster starts successfully, however the broker crashes after a few minutes of reading and writing messages. The log contains either one of the following two stack traces:
> 2016-02-19 13:56:18,320 [eption handler.] INFO DefaultIOExceptionHandler - Stopping BrokerService[localhost] due to exception, java.io.IOExce
> ption: Unexpected locator type: null
> java.io.IOException: Unexpected locator type: null
> at org.apache.activemq.util.IOExceptionSupport.create(IOExceptionSupport.java:39)
> at org.apache.activemq.leveldb.LevelDBClient.might_fail(LevelDBClient.scala:552)
> at org.apache.activemq.leveldb.LevelDBClient.might_fail_using_index(LevelDBClient.scala:1044)
> at org.apache.activemq.leveldb.LevelDBClient.store(LevelDBClient.scala:1390)
> at org.apache.activemq.leveldb.DBManager$$anonfun$drainFlushes$1.apply$mcV$sp(DBManager.scala:627)
> at org.fusesource.hawtdispatch.package$$anon$4.run(hawtdispatch.scala:330)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.RuntimeException: Unexpected locator type: null
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1$$anonfun$apply$28$$anonfun$apply$29.apply(LevelDBClient.scala:1444)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1$$anonfun$apply$28$$anonfun$apply$29.apply(LevelDBClient.scala:1436)
> at scala.collection.immutable.List.foreach(List.scala:383)
> at scala.collection.generic.TraversableForwarder$class.foreach(TraversableForwarder.scala:35)
> at scala.collection.mutable.ListBuffer.foreach(ListBuffer.scala:45)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1$$anonfun$apply$28.apply(LevelDBClient.scala:1436)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1$$anonfun$apply$28.apply(LevelDBClient.scala:1419)
> at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
> at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
> at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1.apply(LevelDBClient.scala:1419)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1.apply(LevelDBClient.scala:1418)
> at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
> at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186)
> at org.apache.activemq.leveldb.LevelDBClient.write_uows(LevelDBClient.scala:1418)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1$$anonfun$apply$mcV$sp$14$$anonfun$5.apply(LevelDBClient.scala:1393)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1$$anonfun$apply$mcV$sp$14$$anonfun$5.apply(LevelDBClient.scala:1392)
> at org.apache.activemq.leveldb.LevelDBClient$RichDB.write(LevelDBClient.scala:230)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1$$anonfun$apply$mcV$sp$14.apply(LevelDBClient.scala:1392)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1$$anonfun$apply$mcV$sp$14.apply(LevelDBClient.scala:1391)
> at org.apache.activemq.leveldb.RecordLog$$anonfun$appender$1.apply(RecordLog.scala:569)
> at org.apache.activemq.leveldb.util.TimeMetric.apply(TimeMetric.scala:43)
> at org.apache.activemq.leveldb.RecordLog.appender(RecordLog.scala:568)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1.apply$mcV$sp(LevelDBClient.scala:1391)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1.apply(LevelDBClient.scala:1390)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1.apply(LevelDBClient.scala:1390)
> at org.apache.activemq.leveldb.LevelDBClient.usingIndex(LevelDBClient.scala:1038)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$might_fail_using_index$1.apply(LevelDBClient.scala:1044)
> at org.apache.activemq.leveldb.LevelDBClient.might_fail(LevelDBClient.scala:549)
> ... 7 more
> or
> 2016-02-19 13:59:53,886 [eption handler.] INFO DefaultIOExceptionHandler - Stopping BrokerService[localhost] due to exception, java.io.IOException
> java.io.IOException
> at org.apache.activemq.util.IOExceptionSupport.create(IOExceptionSupport.java:39)
> at org.apache.activemq.leveldb.LevelDBClient.might_fail(LevelDBClient.scala:552)
> at org.apache.activemq.leveldb.LevelDBClient.might_fail_using_index(LevelDBClient.scala:1044)
> at org.apache.activemq.leveldb.LevelDBClient.store(LevelDBClient.scala:1390)
> at org.apache.activemq.leveldb.DBManager$$anonfun$drainFlushes$1.apply$mcV$sp(DBManager.scala:627)
> at org.fusesource.hawtdispatch.package$$anon$4.run(hawtdispatch.scala:330)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NullPointerException
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1$$anonfun$apply$28$$anonfun$apply$29.apply(LevelDBClient.scala:1452)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1$$anonfun$apply$28$$anonfun$apply$29.apply(LevelDBClient.scala:1436)
> at scala.collection.immutable.List.foreach(List.scala:383)
> at scala.collection.generic.TraversableForwarder$class.foreach(TraversableForwarder.scala:35)
> at scala.collection.mutable.ListBuffer.foreach(ListBuffer.scala:45)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1$$anonfun$apply$28.apply(LevelDBClient.scala:1436)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1$$anonfun$apply$28.apply(LevelDBClient.scala:1419)
> at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
> at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
> at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1.apply(LevelDBClient.scala:1419)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$write_uows$1.apply(LevelDBClient.scala:1418)
> at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
> at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186)
> at org.apache.activemq.leveldb.LevelDBClient.write_uows(LevelDBClient.scala:1418)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1$$anonfun$apply$mcV$sp$14$$anonfun$5.apply(LevelDBClient.scala:1393)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1$$anonfun$apply$mcV$sp$14$$anonfun$5.apply(LevelDBClient.scala:1392)
> at org.apache.activemq.leveldb.LevelDBClient$RichDB.write(LevelDBClient.scala:230)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1$$anonfun$apply$mcV$sp$14.apply(LevelDBClient.scala:1392)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1$$anonfun$apply$mcV$sp$14.apply(LevelDBClient.scala:1391)
> at org.apache.activemq.leveldb.RecordLog$$anonfun$appender$1.apply(RecordLog.scala:569)
> at org.apache.activemq.leveldb.util.TimeMetric.apply(TimeMetric.scala:43)
> at org.apache.activemq.leveldb.RecordLog.appender(RecordLog.scala:568)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1.apply$mcV$sp(LevelDBClient.scala:1391)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1.apply(LevelDBClient.scala:1390)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$store$1.apply(LevelDBClient.scala:1390)
> at org.apache.activemq.leveldb.LevelDBClient.usingIndex(LevelDBClient.scala:1038)
> at org.apache.activemq.leveldb.LevelDBClient$$anonfun$might_fail_using_index$1.apply(LevelDBClient.scala:1044)
> at org.apache.activemq.leveldb.LevelDBClient.might_fail(LevelDBClient.scala:549)
> ... 7 more
> I did not experience this issue on ActiveMQ 5.10.0, which was the previous version I was using. This issue has forced me to rollback to that version. I would like to use the new version since it provides fixes for a number of issues, particularly WebSocket stability.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)