You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@activemq.apache.org by "Rajib Rashid (JIRA)" <ji...@apache.org> on 2012/06/29 23:46:44 UTC
[jira] [Created] (AMQ-3906) repeated error message regarding chunk
stream logged
Rajib Rashid created AMQ-3906:
---------------------------------
Summary: repeated error message regarding chunk stream logged
Key: AMQ-3906
URL: https://issues.apache.org/jira/browse/AMQ-3906
Project: ActiveMQ
Issue Type: Bug
Components: Broker
Affects Versions: 5.6.0
Environment: ActiveMQ 5.6.0 running on Linux FC10 x86
Reporter: Rajib Rashid
Attachments: activemq.xml
after running normally for ~24 hours, warning messages/errors like below are logged every 30 seconds:
{code}
2012-06-27 14:33:31,532 org.apache.activemq.broker.region.Topic[ActiveMQ Broker[ZyrionMessageBus] Scheduler]: (WARN) Failed to browse Topic: remoteUpdateP2PTopic
java.io.EOFException: Chunk stream does not exist, page: 50 is marked free
at org.apache.kahadb.page.Transaction$2.readPage(Transaction.java:460)
at org.apache.kahadb.page.Transaction$2.<init>(Transaction.java:437)
at org.apache.kahadb.page.Transaction.openInputStream(Transaction.java:434)
at org.apache.kahadb.page.Transaction.load(Transaction.java:410)
at org.apache.kahadb.page.Transaction.load(Transaction.java:367)
at org.apache.kahadb.index.BTreeIndex.loadNode(BTreeIndex.java:262)
at org.apache.kahadb.index.BTreeIndex.getRoot(BTreeIndex.java:174)
at org.apache.kahadb.index.BTreeIndex.iterator(BTreeIndex.java:232)
at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex$MessageOrderIterator.<init>(MessageDatabase.java:2714)
at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex.iterator(MessageDatabase.java:2696)
at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore$3.execute(KahaDBStore.java:525)
at org.apache.kahadb.page.Transaction.execute(Transaction.java:769)
at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore.recover(KahaDBStore.java:521)
at org.apache.activemq.store.ProxyTopicMessageStore.recover(ProxyTopicMessageStore.java:62)
at org.apache.activemq.broker.region.Topic.doBrowse(Topic.java:559)
at org.apache.activemq.broker.region.Topic.access$100(Topic.java:62)
at org.apache.activemq.broker.region.Topic$6.run(Topic.java:684)
at org.apache.activemq.thread.SchedulerTimerTask.run(SchedulerTimerTask.java:33)
at java.util.TimerThread.mainLoop(Timer.java:512)
at java.util.TimerThread.run(Timer.java:462)
{code}
since then the warning has been logged 6000+ times. not sure if this is due to the fact that we have enabled expiration of queued messages for offline subscribers.
{code}
% ls -l apps/activemq/data/kahadb/
total 32068
-rw-r--r-- 1 root root 33030144 2012-06-29 14:44 db-14.log
-rw-r--r-- 1 root root 339968 2012-06-29 14:44 db.data
-rw-r--r-- 1 root root 196984 2012-06-29 14:44 db.redo
-rw-r--r-- 1 root root 0 2012-06-26 16:40 lock
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AMQ-3906) repeated error message regarding
chunk stream logged
Posted by "Rajib Rashid (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AMQ-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13498486#comment-13498486 ]
Rajib Rashid commented on AMQ-3906:
-----------------------------------
Gary, I am not noticing the kahadb error with 5.8 SNAPSHOT (2012.11.10), so that's good news. However, I am noticing problems starting the broker using the configuration that was attached before. It will only start with using activemq-core-5.6.0.jar which I found out accidentally. With pure 5.8 libraries, I get this error:
{code}
Java Runtime: Sun Microsystems Inc. 1.6.0_18 /usr/local/emerald/apps/jre
Heap sizes: current=30784k free=24366k max=699072k
JVM args: -Xmx768m -Djava.ext.dirs=/usr/local/emerald/apps/jre/lib:/usr/local/emerald/apps/activemq/lib:/usr/local/emerald/webapp/WEB-INF/lib -Dactivemq.home=/usr/local/emerald/apps/activemq -Dactivemq.base=/usr/local/emerald/apps/activemq -Dactivemq.conf= -Djavax.net.ssl.keyStorePassword=password -Djavax.net.ssl.trustStorePassword=password -Djavax.net.ssl.keyStore=/usr/local/emerald/apps/activemq/conf/broker.ks -Djavax.net.ssl.trustStore=/usr/local/emerald/apps/activemq/conf/broker.ts -Dorg.apache.activemq.store.kahadb.LOG_SLOW_ACCESS_TIME=15000 -Dderby.storage.fileSyncTransactionLog=true -Dlogback.configurationFile=file:///usr/local/emerald/etc/logback.xml -Dtraverse.logging.context=jms -Djava.net.preferIPv4Stack=true -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.port=7697 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false
Extensions classpath:
[]
ACTIVEMQ_HOME: /usr/local/emerald/apps/activemq
ACTIVEMQ_BASE: /usr/local/emerald/apps/activemq
ACTIVEMQ_CONF:
ACTIVEMQ_DATA: /usr/local/emerald/apps/activemq/data
Loading message broker from: xbean:file:/usr/local/emerald/etc/activemq.xml
ERROR: java.lang.RuntimeException: Failed to execute start task. Reason: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org.apache.activemq.xbean.XBeanBrokerService#0' defined in URL [file:/usr/local/emerald/etc/activemq.xml]: Cannot create inner bean '(inner bean)' of type [org.apache.activemq.store.kahadb.KahaDBPersistenceAdapter] while setting bean property 'persistenceAdapter'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name '(inner bean)#5' defined in URL [file:/usr/local/emerald/etc/activemq.xml]: Instantiation of bean failed; nested exception is org.springframework.beans.BeanInstantiationException: Could not instantiate bean class [org.apache.activemq.store.kahadb.KahaDBPersistenceAdapter]: Constructor threw exception; nested exception is java.lang.IllegalArgumentException: Invalid version: 6, could not load org.apache.activemq.openwire.v6.MarshallerFactory
java.lang.RuntimeException: Failed to execute start task. Reason: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org.apache.activemq.xbean.XBeanBrokerService#0' defined in URL [file:/usr/local/emerald/etc/activemq.xml]: Cannot create inner bean '(inner bean)' of type [org.apache.activemq.store.kahadb.KahaDBPersistenceAdapter] while setting bean property 'persistenceAdapter'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name '(inner bean)#5' defined in URL [file:/usr/local/emerald/etc/activemq.xml]: Instantiation of bean failed; nested exception is org.springframework.beans.BeanInstantiationException: Could not instantiate bean class [org.apache.activemq.store.kahadb.KahaDBPersistenceAdapter]: Constructor threw exception; nested exception is java.lang.IllegalArgumentException: Invalid version: 6, could not load org.apache.activemq.openwire.v6.MarshallerFactory
at org.apache.activemq.console.command.StartCommand.runTask(StartCommand.java:108)
at org.apache.activemq.console.command.AbstractCommand.execute(AbstractCommand.java:57)
at org.apache.activemq.console.command.ShellCommand.runTask(ShellCommand.java:150)
at org.apache.activemq.console.command.AbstractCommand.execute(AbstractCommand.java:57)
at org.apache.activemq.console.command.ShellCommand.main(ShellCommand.java:104)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.activemq.console.Main.runTaskClass(Main.java:262)
at org.apache.activemq.console.Main.main(Main.java:115)
Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org.apache.activemq.xbean.XBeanBrokerService#0' defined in URL
[file:/usr/local/emerald/etc/activemq.xml]: Cannot create inner bean '(inner bean)' of type [org.apache.activemq.store.kahadb.KahaDBPersistenceAdapter] while setting bean property 'persistenceAdapter'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name '(inner bean)#5' defined in URL [file:/usr/local/emerald/etc/activemq.xml]: Instantiation of bean failed; nested exception is org.springframework.beans.BeanInstantiationException: Could not instantiate bean class [org.apache.activemq.store.kahadb.KahaDBPersistenceAdapter]: Constructor threw exception; nested exception is java.lang.IllegalArgumentException: Invalid version: 6, could not load org.apache.activemq.openwire.v6.MarshallerFactory
at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveInnerBean(BeanDefinitionValueResolver.java:281)
at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:125)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1360)
[...]
{code}
So effectively I'm running ActiveMQ 5.6.0 with KahaDB 5.8?
> repeated error message regarding chunk stream logged
> ----------------------------------------------------
>
> Key: AMQ-3906
> URL: https://issues.apache.org/jira/browse/AMQ-3906
> Project: ActiveMQ
> Issue Type: Bug
> Components: Broker
> Affects Versions: 5.6.0
> Environment: ActiveMQ 5.6.0 running on Linux FC10 x86
> Reporter: Rajib Rashid
> Attachments: activemq.xml, kahadb.zip
>
>
> after running normally for ~24 hours, warning messages/errors like below are logged every 30 seconds:
> {code}
> 2012-06-27 14:33:31,532 org.apache.activemq.broker.region.Topic[ActiveMQ Broker[ZyrionMessageBus] Scheduler]: (WARN) Failed to browse Topic: remoteUpdateP2PTopic
> java.io.EOFException: Chunk stream does not exist, page: 50 is marked free
> at org.apache.kahadb.page.Transaction$2.readPage(Transaction.java:460)
> at org.apache.kahadb.page.Transaction$2.<init>(Transaction.java:437)
> at org.apache.kahadb.page.Transaction.openInputStream(Transaction.java:434)
> at org.apache.kahadb.page.Transaction.load(Transaction.java:410)
> at org.apache.kahadb.page.Transaction.load(Transaction.java:367)
> at org.apache.kahadb.index.BTreeIndex.loadNode(BTreeIndex.java:262)
> at org.apache.kahadb.index.BTreeIndex.getRoot(BTreeIndex.java:174)
> at org.apache.kahadb.index.BTreeIndex.iterator(BTreeIndex.java:232)
> at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex$MessageOrderIterator.<init>(MessageDatabase.java:2714)
> at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex.iterator(MessageDatabase.java:2696)
> at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore$3.execute(KahaDBStore.java:525)
> at org.apache.kahadb.page.Transaction.execute(Transaction.java:769)
> at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore.recover(KahaDBStore.java:521)
> at org.apache.activemq.store.ProxyTopicMessageStore.recover(ProxyTopicMessageStore.java:62)
> at org.apache.activemq.broker.region.Topic.doBrowse(Topic.java:559)
> at org.apache.activemq.broker.region.Topic.access$100(Topic.java:62)
> at org.apache.activemq.broker.region.Topic$6.run(Topic.java:684)
> at org.apache.activemq.thread.SchedulerTimerTask.run(SchedulerTimerTask.java:33)
> at java.util.TimerThread.mainLoop(Timer.java:512)
> at java.util.TimerThread.run(Timer.java:462)
> {code}
> since then the warning has been logged 6000+ times. not sure if this is due to the fact that we have enabled expiration of queued messages for offline subscribers.
> {code}
> % ls -l apps/activemq/data/kahadb/
> total 32068
> -rw-r--r-- 1 root root 33030144 2012-06-29 14:44 db-14.log
> -rw-r--r-- 1 root root 339968 2012-06-29 14:44 db.data
> -rw-r--r-- 1 root root 196984 2012-06-29 14:44 db.redo
> -rw-r--r-- 1 root root 0 2012-06-26 16:40 lock
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AMQ-3906) repeated error message regarding
chunk stream logged
Posted by "Gary Tully (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AMQ-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13509682#comment-13509682 ]
Gary Tully commented on AMQ-3906:
---------------------------------
@Rajib - we are targeting the end of this month for the 5.8 release - so you could plan for late janurary.
Can we close of this issue based on your validation of the 5.8 snapshot?
> repeated error message regarding chunk stream logged
> ----------------------------------------------------
>
> Key: AMQ-3906
> URL: https://issues.apache.org/jira/browse/AMQ-3906
> Project: ActiveMQ
> Issue Type: Bug
> Components: Broker
> Affects Versions: 5.6.0
> Environment: ActiveMQ 5.6.0 running on Linux FC10 x86
> Reporter: Rajib Rashid
> Attachments: activemq.xml, kahadb.zip
>
>
> after running normally for ~24 hours, warning messages/errors like below are logged every 30 seconds:
> {code}
> 2012-06-27 14:33:31,532 org.apache.activemq.broker.region.Topic[ActiveMQ Broker[ZyrionMessageBus] Scheduler]: (WARN) Failed to browse Topic: remoteUpdateP2PTopic
> java.io.EOFException: Chunk stream does not exist, page: 50 is marked free
> at org.apache.kahadb.page.Transaction$2.readPage(Transaction.java:460)
> at org.apache.kahadb.page.Transaction$2.<init>(Transaction.java:437)
> at org.apache.kahadb.page.Transaction.openInputStream(Transaction.java:434)
> at org.apache.kahadb.page.Transaction.load(Transaction.java:410)
> at org.apache.kahadb.page.Transaction.load(Transaction.java:367)
> at org.apache.kahadb.index.BTreeIndex.loadNode(BTreeIndex.java:262)
> at org.apache.kahadb.index.BTreeIndex.getRoot(BTreeIndex.java:174)
> at org.apache.kahadb.index.BTreeIndex.iterator(BTreeIndex.java:232)
> at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex$MessageOrderIterator.<init>(MessageDatabase.java:2714)
> at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex.iterator(MessageDatabase.java:2696)
> at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore$3.execute(KahaDBStore.java:525)
> at org.apache.kahadb.page.Transaction.execute(Transaction.java:769)
> at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore.recover(KahaDBStore.java:521)
> at org.apache.activemq.store.ProxyTopicMessageStore.recover(ProxyTopicMessageStore.java:62)
> at org.apache.activemq.broker.region.Topic.doBrowse(Topic.java:559)
> at org.apache.activemq.broker.region.Topic.access$100(Topic.java:62)
> at org.apache.activemq.broker.region.Topic$6.run(Topic.java:684)
> at org.apache.activemq.thread.SchedulerTimerTask.run(SchedulerTimerTask.java:33)
> at java.util.TimerThread.mainLoop(Timer.java:512)
> at java.util.TimerThread.run(Timer.java:462)
> {code}
> since then the warning has been logged 6000+ times. not sure if this is due to the fact that we have enabled expiration of queued messages for offline subscribers.
> {code}
> % ls -l apps/activemq/data/kahadb/
> total 32068
> -rw-r--r-- 1 root root 33030144 2012-06-29 14:44 db-14.log
> -rw-r--r-- 1 root root 339968 2012-06-29 14:44 db.data
> -rw-r--r-- 1 root root 196984 2012-06-29 14:44 db.redo
> -rw-r--r-- 1 root root 0 2012-06-26 16:40 lock
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AMQ-3906) repeated error message regarding
chunk stream logged
Posted by "Rajib Rashid (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AMQ-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13509141#comment-13509141 ]
Rajib Rashid commented on AMQ-3906:
-----------------------------------
Hi Gary, can you share how close you are to officially releasing 5.8? We don't mind using a snapshot release as long as it is stable for production use. But this particular issue has been caused some major headaches and we would like to make one big push to update all the deployments. Thanks
> repeated error message regarding chunk stream logged
> ----------------------------------------------------
>
> Key: AMQ-3906
> URL: https://issues.apache.org/jira/browse/AMQ-3906
> Project: ActiveMQ
> Issue Type: Bug
> Components: Broker
> Affects Versions: 5.6.0
> Environment: ActiveMQ 5.6.0 running on Linux FC10 x86
> Reporter: Rajib Rashid
> Attachments: activemq.xml, kahadb.zip
>
>
> after running normally for ~24 hours, warning messages/errors like below are logged every 30 seconds:
> {code}
> 2012-06-27 14:33:31,532 org.apache.activemq.broker.region.Topic[ActiveMQ Broker[ZyrionMessageBus] Scheduler]: (WARN) Failed to browse Topic: remoteUpdateP2PTopic
> java.io.EOFException: Chunk stream does not exist, page: 50 is marked free
> at org.apache.kahadb.page.Transaction$2.readPage(Transaction.java:460)
> at org.apache.kahadb.page.Transaction$2.<init>(Transaction.java:437)
> at org.apache.kahadb.page.Transaction.openInputStream(Transaction.java:434)
> at org.apache.kahadb.page.Transaction.load(Transaction.java:410)
> at org.apache.kahadb.page.Transaction.load(Transaction.java:367)
> at org.apache.kahadb.index.BTreeIndex.loadNode(BTreeIndex.java:262)
> at org.apache.kahadb.index.BTreeIndex.getRoot(BTreeIndex.java:174)
> at org.apache.kahadb.index.BTreeIndex.iterator(BTreeIndex.java:232)
> at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex$MessageOrderIterator.<init>(MessageDatabase.java:2714)
> at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex.iterator(MessageDatabase.java:2696)
> at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore$3.execute(KahaDBStore.java:525)
> at org.apache.kahadb.page.Transaction.execute(Transaction.java:769)
> at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore.recover(KahaDBStore.java:521)
> at org.apache.activemq.store.ProxyTopicMessageStore.recover(ProxyTopicMessageStore.java:62)
> at org.apache.activemq.broker.region.Topic.doBrowse(Topic.java:559)
> at org.apache.activemq.broker.region.Topic.access$100(Topic.java:62)
> at org.apache.activemq.broker.region.Topic$6.run(Topic.java:684)
> at org.apache.activemq.thread.SchedulerTimerTask.run(SchedulerTimerTask.java:33)
> at java.util.TimerThread.mainLoop(Timer.java:512)
> at java.util.TimerThread.run(Timer.java:462)
> {code}
> since then the warning has been logged 6000+ times. not sure if this is due to the fact that we have enabled expiration of queued messages for offline subscribers.
> {code}
> % ls -l apps/activemq/data/kahadb/
> total 32068
> -rw-r--r-- 1 root root 33030144 2012-06-29 14:44 db-14.log
> -rw-r--r-- 1 root root 339968 2012-06-29 14:44 db.data
> -rw-r--r-- 1 root root 196984 2012-06-29 14:44 db.redo
> -rw-r--r-- 1 root root 0 2012-06-26 16:40 lock
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AMQ-3906) repeated error message regarding
chunk stream logged
Posted by "Manfred Koch (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AMQ-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13495132#comment-13495132 ]
Manfred Koch commented on AMQ-3906:
-----------------------------------
I have tried the SNAPSHOT from 07-Nov-2012 and got the same error.
{noformat}
INFO | jvm 1 | 2012/11/11 03:01:51 | 03:01:51,232[ActiveMQ Transport: tcp:///10.71.157.60:49184@61646] ERROR MessageDatabase:419 - KahaDB failed to store to Journal
INFO | jvm 1 | 2012/11/11 03:01:51 | java.io.EOFException: Chunk stream does not exist, page: 30 is marked free
{noformat}
> repeated error message regarding chunk stream logged
> ----------------------------------------------------
>
> Key: AMQ-3906
> URL: https://issues.apache.org/jira/browse/AMQ-3906
> Project: ActiveMQ
> Issue Type: Bug
> Components: Broker
> Affects Versions: 5.6.0
> Environment: ActiveMQ 5.6.0 running on Linux FC10 x86
> Reporter: Rajib Rashid
> Attachments: activemq.xml
>
>
> after running normally for ~24 hours, warning messages/errors like below are logged every 30 seconds:
> {code}
> 2012-06-27 14:33:31,532 org.apache.activemq.broker.region.Topic[ActiveMQ Broker[ZyrionMessageBus] Scheduler]: (WARN) Failed to browse Topic: remoteUpdateP2PTopic
> java.io.EOFException: Chunk stream does not exist, page: 50 is marked free
> at org.apache.kahadb.page.Transaction$2.readPage(Transaction.java:460)
> at org.apache.kahadb.page.Transaction$2.<init>(Transaction.java:437)
> at org.apache.kahadb.page.Transaction.openInputStream(Transaction.java:434)
> at org.apache.kahadb.page.Transaction.load(Transaction.java:410)
> at org.apache.kahadb.page.Transaction.load(Transaction.java:367)
> at org.apache.kahadb.index.BTreeIndex.loadNode(BTreeIndex.java:262)
> at org.apache.kahadb.index.BTreeIndex.getRoot(BTreeIndex.java:174)
> at org.apache.kahadb.index.BTreeIndex.iterator(BTreeIndex.java:232)
> at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex$MessageOrderIterator.<init>(MessageDatabase.java:2714)
> at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex.iterator(MessageDatabase.java:2696)
> at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore$3.execute(KahaDBStore.java:525)
> at org.apache.kahadb.page.Transaction.execute(Transaction.java:769)
> at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore.recover(KahaDBStore.java:521)
> at org.apache.activemq.store.ProxyTopicMessageStore.recover(ProxyTopicMessageStore.java:62)
> at org.apache.activemq.broker.region.Topic.doBrowse(Topic.java:559)
> at org.apache.activemq.broker.region.Topic.access$100(Topic.java:62)
> at org.apache.activemq.broker.region.Topic$6.run(Topic.java:684)
> at org.apache.activemq.thread.SchedulerTimerTask.run(SchedulerTimerTask.java:33)
> at java.util.TimerThread.mainLoop(Timer.java:512)
> at java.util.TimerThread.run(Timer.java:462)
> {code}
> since then the warning has been logged 6000+ times. not sure if this is due to the fact that we have enabled expiration of queued messages for offline subscribers.
> {code}
> % ls -l apps/activemq/data/kahadb/
> total 32068
> -rw-r--r-- 1 root root 33030144 2012-06-29 14:44 db-14.log
> -rw-r--r-- 1 root root 339968 2012-06-29 14:44 db.data
> -rw-r--r-- 1 root root 196984 2012-06-29 14:44 db.redo
> -rw-r--r-- 1 root root 0 2012-06-26 16:40 lock
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AMQ-3906) repeated error message regarding
chunk stream logged
Posted by "Manfred Koch (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AMQ-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13490635#comment-13490635 ]
Manfred Koch commented on AMQ-3906:
-----------------------------------
We are using 5.7.0 on Windows 2008 R2 SP1 and have the same issue.
{noformat}
INFO | jvm 1 | 2012/11/02 04:48:58 | 04:48:58,808[ActiveMQ Durable Subscriber Cleanup Timer] INFO TopicRegion:296 - Destroying durable subscriber due to inactivity: DurableTopicSubscription-149f13f3-b548-4fc6-b343-3f5da174491d:0b071e2a-f281-4ce8-8a64-0b601d00c672, id=ID:host21-1354-1351827790937-1:1:3:1, active=false, destinations=1, total=0, pending=0, dispatched=0, inflight=0, prefetchExtension=0
INFO | jvm 1 | 2012/11/02 04:48:58 | 04:48:58,808[ActiveMQ Durable Subscriber Cleanup Timer] INFO TopicRegion:296 - Destroying durable subscriber due to inactivity: DurableTopicSubscription-149f13f3-b548-4fc6-b343-3f5da174491d:714ca25f-7ba8-420e-8e3f-6a4dff7c494c, id=ID:host21-1354-1351827790937-1:1:4:1, active=false, destinations=1, total=0, pending=0, dispatched=0, inflight=0, prefetchExtension=0
INFO | jvm 1 | 2012/11/02 04:48:58 | 04:48:58,824[ActiveMQ Durable Subscriber Cleanup Timer] INFO TopicRegion:296 - Destroying durable subscriber due to inactivity: DurableTopicSubscription-149f13f3-b548-4fc6-b343-3f5da174491d:09c8415f-ef48-45f3-a9db-a815498664d4, id=ID:host21-1354-1351827790937-1:1:7:1, active=false, destinations=1, total=0, pending=0, dispatched=0, inflight=0, prefetchExtension=0
INFO | jvm 1 | 2012/11/02 05:06:36 | 05:06:36,590[ActiveMQ Broker[localhost] Scheduler] ERROR MessageDatabase:419 - KahaDB failed to store to Journal
INFO | jvm 1 | 2012/11/02 05:06:36 | java.io.EOFException: Chunk stream does not exist, page: 3080 is marked free
INFO | jvm 1 | 2012/11/02 05:06:36 | at org.apache.kahadb.page.Transaction$2.readPage(Transaction.java:460)
INFO | jvm 1 | 2012/11/02 05:06:36 | at org.apache.kahadb.page.Transaction$2.<init>(Transaction.java:437)
{noformat}
> repeated error message regarding chunk stream logged
> ----------------------------------------------------
>
> Key: AMQ-3906
> URL: https://issues.apache.org/jira/browse/AMQ-3906
> Project: ActiveMQ
> Issue Type: Bug
> Components: Broker
> Affects Versions: 5.6.0
> Environment: ActiveMQ 5.6.0 running on Linux FC10 x86
> Reporter: Rajib Rashid
> Attachments: activemq.xml
>
>
> after running normally for ~24 hours, warning messages/errors like below are logged every 30 seconds:
> {code}
> 2012-06-27 14:33:31,532 org.apache.activemq.broker.region.Topic[ActiveMQ Broker[ZyrionMessageBus] Scheduler]: (WARN) Failed to browse Topic: remoteUpdateP2PTopic
> java.io.EOFException: Chunk stream does not exist, page: 50 is marked free
> at org.apache.kahadb.page.Transaction$2.readPage(Transaction.java:460)
> at org.apache.kahadb.page.Transaction$2.<init>(Transaction.java:437)
> at org.apache.kahadb.page.Transaction.openInputStream(Transaction.java:434)
> at org.apache.kahadb.page.Transaction.load(Transaction.java:410)
> at org.apache.kahadb.page.Transaction.load(Transaction.java:367)
> at org.apache.kahadb.index.BTreeIndex.loadNode(BTreeIndex.java:262)
> at org.apache.kahadb.index.BTreeIndex.getRoot(BTreeIndex.java:174)
> at org.apache.kahadb.index.BTreeIndex.iterator(BTreeIndex.java:232)
> at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex$MessageOrderIterator.<init>(MessageDatabase.java:2714)
> at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex.iterator(MessageDatabase.java:2696)
> at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore$3.execute(KahaDBStore.java:525)
> at org.apache.kahadb.page.Transaction.execute(Transaction.java:769)
> at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore.recover(KahaDBStore.java:521)
> at org.apache.activemq.store.ProxyTopicMessageStore.recover(ProxyTopicMessageStore.java:62)
> at org.apache.activemq.broker.region.Topic.doBrowse(Topic.java:559)
> at org.apache.activemq.broker.region.Topic.access$100(Topic.java:62)
> at org.apache.activemq.broker.region.Topic$6.run(Topic.java:684)
> at org.apache.activemq.thread.SchedulerTimerTask.run(SchedulerTimerTask.java:33)
> at java.util.TimerThread.mainLoop(Timer.java:512)
> at java.util.TimerThread.run(Timer.java:462)
> {code}
> since then the warning has been logged 6000+ times. not sure if this is due to the fact that we have enabled expiration of queued messages for offline subscribers.
> {code}
> % ls -l apps/activemq/data/kahadb/
> total 32068
> -rw-r--r-- 1 root root 33030144 2012-06-29 14:44 db-14.log
> -rw-r--r-- 1 root root 339968 2012-06-29 14:44 db.data
> -rw-r--r-- 1 root root 196984 2012-06-29 14:44 db.redo
> -rw-r--r-- 1 root root 0 2012-06-26 16:40 lock
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AMQ-3906) repeated error message regarding
chunk stream logged
Posted by "Gary Tully (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AMQ-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496146#comment-13496146 ]
Gary Tully commented on AMQ-3906:
---------------------------------
@Rajib - so you have confirmed that you can reproduce with a 5.8-SNAPSHOT, correct? In other words, this is not a case of https://issues.apache.org/jira/browse/AMQ-4118
The key to reproducing in a test case must be related to what the consumers/producers do before they are terminated.
The error is coming from a periodic task that browses the destination that is *already* corrupt by previous operations.
Do you think it is possible to codify what your broker clients do so we can build a test case?
> repeated error message regarding chunk stream logged
> ----------------------------------------------------
>
> Key: AMQ-3906
> URL: https://issues.apache.org/jira/browse/AMQ-3906
> Project: ActiveMQ
> Issue Type: Bug
> Components: Broker
> Affects Versions: 5.6.0
> Environment: ActiveMQ 5.6.0 running on Linux FC10 x86
> Reporter: Rajib Rashid
> Attachments: activemq.xml, kahadb.zip
>
>
> after running normally for ~24 hours, warning messages/errors like below are logged every 30 seconds:
> {code}
> 2012-06-27 14:33:31,532 org.apache.activemq.broker.region.Topic[ActiveMQ Broker[ZyrionMessageBus] Scheduler]: (WARN) Failed to browse Topic: remoteUpdateP2PTopic
> java.io.EOFException: Chunk stream does not exist, page: 50 is marked free
> at org.apache.kahadb.page.Transaction$2.readPage(Transaction.java:460)
> at org.apache.kahadb.page.Transaction$2.<init>(Transaction.java:437)
> at org.apache.kahadb.page.Transaction.openInputStream(Transaction.java:434)
> at org.apache.kahadb.page.Transaction.load(Transaction.java:410)
> at org.apache.kahadb.page.Transaction.load(Transaction.java:367)
> at org.apache.kahadb.index.BTreeIndex.loadNode(BTreeIndex.java:262)
> at org.apache.kahadb.index.BTreeIndex.getRoot(BTreeIndex.java:174)
> at org.apache.kahadb.index.BTreeIndex.iterator(BTreeIndex.java:232)
> at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex$MessageOrderIterator.<init>(MessageDatabase.java:2714)
> at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex.iterator(MessageDatabase.java:2696)
> at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore$3.execute(KahaDBStore.java:525)
> at org.apache.kahadb.page.Transaction.execute(Transaction.java:769)
> at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore.recover(KahaDBStore.java:521)
> at org.apache.activemq.store.ProxyTopicMessageStore.recover(ProxyTopicMessageStore.java:62)
> at org.apache.activemq.broker.region.Topic.doBrowse(Topic.java:559)
> at org.apache.activemq.broker.region.Topic.access$100(Topic.java:62)
> at org.apache.activemq.broker.region.Topic$6.run(Topic.java:684)
> at org.apache.activemq.thread.SchedulerTimerTask.run(SchedulerTimerTask.java:33)
> at java.util.TimerThread.mainLoop(Timer.java:512)
> at java.util.TimerThread.run(Timer.java:462)
> {code}
> since then the warning has been logged 6000+ times. not sure if this is due to the fact that we have enabled expiration of queued messages for offline subscribers.
> {code}
> % ls -l apps/activemq/data/kahadb/
> total 32068
> -rw-r--r-- 1 root root 33030144 2012-06-29 14:44 db-14.log
> -rw-r--r-- 1 root root 339968 2012-06-29 14:44 db.data
> -rw-r--r-- 1 root root 196984 2012-06-29 14:44 db.redo
> -rw-r--r-- 1 root root 0 2012-06-26 16:40 lock
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AMQ-3906) repeated error message regarding chunk
stream logged
Posted by "Rajib Rashid (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AMQ-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rajib Rashid updated AMQ-3906:
------------------------------
Attachment: kahadb.zip
> repeated error message regarding chunk stream logged
> ----------------------------------------------------
>
> Key: AMQ-3906
> URL: https://issues.apache.org/jira/browse/AMQ-3906
> Project: ActiveMQ
> Issue Type: Bug
> Components: Broker
> Affects Versions: 5.6.0
> Environment: ActiveMQ 5.6.0 running on Linux FC10 x86
> Reporter: Rajib Rashid
> Attachments: activemq.xml, kahadb.zip
>
>
> after running normally for ~24 hours, warning messages/errors like below are logged every 30 seconds:
> {code}
> 2012-06-27 14:33:31,532 org.apache.activemq.broker.region.Topic[ActiveMQ Broker[ZyrionMessageBus] Scheduler]: (WARN) Failed to browse Topic: remoteUpdateP2PTopic
> java.io.EOFException: Chunk stream does not exist, page: 50 is marked free
> at org.apache.kahadb.page.Transaction$2.readPage(Transaction.java:460)
> at org.apache.kahadb.page.Transaction$2.<init>(Transaction.java:437)
> at org.apache.kahadb.page.Transaction.openInputStream(Transaction.java:434)
> at org.apache.kahadb.page.Transaction.load(Transaction.java:410)
> at org.apache.kahadb.page.Transaction.load(Transaction.java:367)
> at org.apache.kahadb.index.BTreeIndex.loadNode(BTreeIndex.java:262)
> at org.apache.kahadb.index.BTreeIndex.getRoot(BTreeIndex.java:174)
> at org.apache.kahadb.index.BTreeIndex.iterator(BTreeIndex.java:232)
> at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex$MessageOrderIterator.<init>(MessageDatabase.java:2714)
> at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex.iterator(MessageDatabase.java:2696)
> at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore$3.execute(KahaDBStore.java:525)
> at org.apache.kahadb.page.Transaction.execute(Transaction.java:769)
> at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore.recover(KahaDBStore.java:521)
> at org.apache.activemq.store.ProxyTopicMessageStore.recover(ProxyTopicMessageStore.java:62)
> at org.apache.activemq.broker.region.Topic.doBrowse(Topic.java:559)
> at org.apache.activemq.broker.region.Topic.access$100(Topic.java:62)
> at org.apache.activemq.broker.region.Topic$6.run(Topic.java:684)
> at org.apache.activemq.thread.SchedulerTimerTask.run(SchedulerTimerTask.java:33)
> at java.util.TimerThread.mainLoop(Timer.java:512)
> at java.util.TimerThread.run(Timer.java:462)
> {code}
> since then the warning has been logged 6000+ times. not sure if this is due to the fact that we have enabled expiration of queued messages for offline subscribers.
> {code}
> % ls -l apps/activemq/data/kahadb/
> total 32068
> -rw-r--r-- 1 root root 33030144 2012-06-29 14:44 db-14.log
> -rw-r--r-- 1 root root 339968 2012-06-29 14:44 db.data
> -rw-r--r-- 1 root root 196984 2012-06-29 14:44 db.redo
> -rw-r--r-- 1 root root 0 2012-06-26 16:40 lock
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AMQ-3906) repeated error message regarding
chunk stream logged
Posted by "Timothy Bish (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AMQ-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13438065#comment-13438065 ]
Timothy Bish commented on AMQ-3906:
-----------------------------------
Recommend that you see if you can find a test case that reproduces this, also try testing with the latest 5.7-SNAPSHOT nightly build as there are many fixes in since the 5.6.0 release.
> repeated error message regarding chunk stream logged
> ----------------------------------------------------
>
> Key: AMQ-3906
> URL: https://issues.apache.org/jira/browse/AMQ-3906
> Project: ActiveMQ
> Issue Type: Bug
> Components: Broker
> Affects Versions: 5.6.0
> Environment: ActiveMQ 5.6.0 running on Linux FC10 x86
> Reporter: Rajib Rashid
> Attachments: activemq.xml
>
>
> after running normally for ~24 hours, warning messages/errors like below are logged every 30 seconds:
> {code}
> 2012-06-27 14:33:31,532 org.apache.activemq.broker.region.Topic[ActiveMQ Broker[ZyrionMessageBus] Scheduler]: (WARN) Failed to browse Topic: remoteUpdateP2PTopic
> java.io.EOFException: Chunk stream does not exist, page: 50 is marked free
> at org.apache.kahadb.page.Transaction$2.readPage(Transaction.java:460)
> at org.apache.kahadb.page.Transaction$2.<init>(Transaction.java:437)
> at org.apache.kahadb.page.Transaction.openInputStream(Transaction.java:434)
> at org.apache.kahadb.page.Transaction.load(Transaction.java:410)
> at org.apache.kahadb.page.Transaction.load(Transaction.java:367)
> at org.apache.kahadb.index.BTreeIndex.loadNode(BTreeIndex.java:262)
> at org.apache.kahadb.index.BTreeIndex.getRoot(BTreeIndex.java:174)
> at org.apache.kahadb.index.BTreeIndex.iterator(BTreeIndex.java:232)
> at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex$MessageOrderIterator.<init>(MessageDatabase.java:2714)
> at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex.iterator(MessageDatabase.java:2696)
> at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore$3.execute(KahaDBStore.java:525)
> at org.apache.kahadb.page.Transaction.execute(Transaction.java:769)
> at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore.recover(KahaDBStore.java:521)
> at org.apache.activemq.store.ProxyTopicMessageStore.recover(ProxyTopicMessageStore.java:62)
> at org.apache.activemq.broker.region.Topic.doBrowse(Topic.java:559)
> at org.apache.activemq.broker.region.Topic.access$100(Topic.java:62)
> at org.apache.activemq.broker.region.Topic$6.run(Topic.java:684)
> at org.apache.activemq.thread.SchedulerTimerTask.run(SchedulerTimerTask.java:33)
> at java.util.TimerThread.mainLoop(Timer.java:512)
> at java.util.TimerThread.run(Timer.java:462)
> {code}
> since then the warning has been logged 6000+ times. not sure if this is due to the fact that we have enabled expiration of queued messages for offline subscribers.
> {code}
> % ls -l apps/activemq/data/kahadb/
> total 32068
> -rw-r--r-- 1 root root 33030144 2012-06-29 14:44 db-14.log
> -rw-r--r-- 1 root root 339968 2012-06-29 14:44 db.data
> -rw-r--r-- 1 root root 196984 2012-06-29 14:44 db.redo
> -rw-r--r-- 1 root root 0 2012-06-26 16:40 lock
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AMQ-3906) repeated error message regarding
chunk stream logged
Posted by "Gary Tully (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AMQ-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13498740#comment-13498740 ]
Gary Tully commented on AMQ-3906:
---------------------------------
good news.
yeah, sorry about that startup issue. There has been a bunch of new modules introduced on trunk so the snapshots are in a bit of flux... but that issue has been resolved. The snapshot from last night (apache-activemq-5.8-20121116.041126-35-bin.tar.gz) should be fine.
> repeated error message regarding chunk stream logged
> ----------------------------------------------------
>
> Key: AMQ-3906
> URL: https://issues.apache.org/jira/browse/AMQ-3906
> Project: ActiveMQ
> Issue Type: Bug
> Components: Broker
> Affects Versions: 5.6.0
> Environment: ActiveMQ 5.6.0 running on Linux FC10 x86
> Reporter: Rajib Rashid
> Attachments: activemq.xml, kahadb.zip
>
>
> after running normally for ~24 hours, warning messages/errors like below are logged every 30 seconds:
> {code}
> 2012-06-27 14:33:31,532 org.apache.activemq.broker.region.Topic[ActiveMQ Broker[ZyrionMessageBus] Scheduler]: (WARN) Failed to browse Topic: remoteUpdateP2PTopic
> java.io.EOFException: Chunk stream does not exist, page: 50 is marked free
> at org.apache.kahadb.page.Transaction$2.readPage(Transaction.java:460)
> at org.apache.kahadb.page.Transaction$2.<init>(Transaction.java:437)
> at org.apache.kahadb.page.Transaction.openInputStream(Transaction.java:434)
> at org.apache.kahadb.page.Transaction.load(Transaction.java:410)
> at org.apache.kahadb.page.Transaction.load(Transaction.java:367)
> at org.apache.kahadb.index.BTreeIndex.loadNode(BTreeIndex.java:262)
> at org.apache.kahadb.index.BTreeIndex.getRoot(BTreeIndex.java:174)
> at org.apache.kahadb.index.BTreeIndex.iterator(BTreeIndex.java:232)
> at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex$MessageOrderIterator.<init>(MessageDatabase.java:2714)
> at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex.iterator(MessageDatabase.java:2696)
> at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore$3.execute(KahaDBStore.java:525)
> at org.apache.kahadb.page.Transaction.execute(Transaction.java:769)
> at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore.recover(KahaDBStore.java:521)
> at org.apache.activemq.store.ProxyTopicMessageStore.recover(ProxyTopicMessageStore.java:62)
> at org.apache.activemq.broker.region.Topic.doBrowse(Topic.java:559)
> at org.apache.activemq.broker.region.Topic.access$100(Topic.java:62)
> at org.apache.activemq.broker.region.Topic$6.run(Topic.java:684)
> at org.apache.activemq.thread.SchedulerTimerTask.run(SchedulerTimerTask.java:33)
> at java.util.TimerThread.mainLoop(Timer.java:512)
> at java.util.TimerThread.run(Timer.java:462)
> {code}
> since then the warning has been logged 6000+ times. not sure if this is due to the fact that we have enabled expiration of queued messages for offline subscribers.
> {code}
> % ls -l apps/activemq/data/kahadb/
> total 32068
> -rw-r--r-- 1 root root 33030144 2012-06-29 14:44 db-14.log
> -rw-r--r-- 1 root root 339968 2012-06-29 14:44 db.data
> -rw-r--r-- 1 root root 196984 2012-06-29 14:44 db.redo
> -rw-r--r-- 1 root root 0 2012-06-26 16:40 lock
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AMQ-3906) repeated error message regarding chunk
stream logged
Posted by "Rajib Rashid (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AMQ-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rajib Rashid updated AMQ-3906:
------------------------------
Attachment: activemq.xml
configuration file
> repeated error message regarding chunk stream logged
> ----------------------------------------------------
>
> Key: AMQ-3906
> URL: https://issues.apache.org/jira/browse/AMQ-3906
> Project: ActiveMQ
> Issue Type: Bug
> Components: Broker
> Affects Versions: 5.6.0
> Environment: ActiveMQ 5.6.0 running on Linux FC10 x86
> Reporter: Rajib Rashid
> Attachments: activemq.xml
>
>
> after running normally for ~24 hours, warning messages/errors like below are logged every 30 seconds:
> {code}
> 2012-06-27 14:33:31,532 org.apache.activemq.broker.region.Topic[ActiveMQ Broker[ZyrionMessageBus] Scheduler]: (WARN) Failed to browse Topic: remoteUpdateP2PTopic
> java.io.EOFException: Chunk stream does not exist, page: 50 is marked free
> at org.apache.kahadb.page.Transaction$2.readPage(Transaction.java:460)
> at org.apache.kahadb.page.Transaction$2.<init>(Transaction.java:437)
> at org.apache.kahadb.page.Transaction.openInputStream(Transaction.java:434)
> at org.apache.kahadb.page.Transaction.load(Transaction.java:410)
> at org.apache.kahadb.page.Transaction.load(Transaction.java:367)
> at org.apache.kahadb.index.BTreeIndex.loadNode(BTreeIndex.java:262)
> at org.apache.kahadb.index.BTreeIndex.getRoot(BTreeIndex.java:174)
> at org.apache.kahadb.index.BTreeIndex.iterator(BTreeIndex.java:232)
> at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex$MessageOrderIterator.<init>(MessageDatabase.java:2714)
> at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex.iterator(MessageDatabase.java:2696)
> at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore$3.execute(KahaDBStore.java:525)
> at org.apache.kahadb.page.Transaction.execute(Transaction.java:769)
> at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore.recover(KahaDBStore.java:521)
> at org.apache.activemq.store.ProxyTopicMessageStore.recover(ProxyTopicMessageStore.java:62)
> at org.apache.activemq.broker.region.Topic.doBrowse(Topic.java:559)
> at org.apache.activemq.broker.region.Topic.access$100(Topic.java:62)
> at org.apache.activemq.broker.region.Topic$6.run(Topic.java:684)
> at org.apache.activemq.thread.SchedulerTimerTask.run(SchedulerTimerTask.java:33)
> at java.util.TimerThread.mainLoop(Timer.java:512)
> at java.util.TimerThread.run(Timer.java:462)
> {code}
> since then the warning has been logged 6000+ times. not sure if this is due to the fact that we have enabled expiration of queued messages for offline subscribers.
> {code}
> % ls -l apps/activemq/data/kahadb/
> total 32068
> -rw-r--r-- 1 root root 33030144 2012-06-29 14:44 db-14.log
> -rw-r--r-- 1 root root 339968 2012-06-29 14:44 db.data
> -rw-r--r-- 1 root root 196984 2012-06-29 14:44 db.redo
> -rw-r--r-- 1 root root 0 2012-06-26 16:40 lock
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AMQ-3906) repeated error message regarding
chunk stream logged
Posted by "Rajib Rashid (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AMQ-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13495896#comment-13495896 ]
Rajib Rashid commented on AMQ-3906:
-----------------------------------
on a fresh install with only one client communicating with the server, the issue shows up almost instantaneously. using the server configuration previously attached and kahadb directory cleared (so that the database is initialized fresh) here are the startup log messages:
{noformat}
2012-11-12 16:43:54,493 o.a.a.x.XBeanBrokerFactory$1[main]: (INFO) Refreshing org.apache.activemq.xbean.XBeanBrokerFactory$1@1d8d39f: startup date [Mon Nov 12 16:43:54 PST 2012]; root of context hierarchy
2012-11-12 16:43:55,460 o.a.a.s.k.p.PListStore[main]: (INFO) PListStore:[/usr/local/emerald/apps/activemq/data/ZyrionMessageBus/tmp_storage ] started
2012-11-12 16:43:55,460 o.a.a.b.BrokerService[main]: (INFO) Using Persistence Adapter: KahaDBPersistenceAdapter[/usr/local/emerald/apps/activemq/data/kahadb]
2012-11-12 16:43:55,764 o.a.a.s.k.MessageDatabase[main]: (INFO) KahaDB is version 4
2012-11-12 16:43:55,793 o.a.a.s.k.MessageDatabase[main]: (INFO) Recovering from the journal ...
2012-11-12 16:43:55,793 o.a.a.s.k.MessageDatabase[main]: (INFO) Recovery replayed 1 operations from the journal in 0.013 seconds.
2012-11-12 16:43:55,805 o.a.a.b.BrokerService[main]: (INFO) ActiveMQ 5.6.0 JMS Message Broker (ZyrionMessageBus) is starting
2012-11-12 16:43:55,805 o.a.a.b.BrokerService[main]: (INFO) For help or more information please see: http://activemq.apache.org/
2012-11-12 16:43:56,010 o.a.a.t.TransportServerThreadSupport[main]: (INFO) Listening for connections at: nio://dev-runtime.enigma.local:7653?useQueueForAccept=false&wireFormat.stackTraceEnabled=false&wireFormat.cacheEnabled=false
2012-11-12 16:43:56,010 o.a.a.b.TransportConnector[main]: (INFO) Connector openwire Started
2012-11-12 16:43:56,012 o.a.a.b.BrokerService[main]: (INFO) ActiveMQ JMS Message Broker (ZyrionMessageBus, ID:dev-runtime.enigma.local-40393-1352767435812-0:1) started
{noformat}
next the client is started so that it attaches to several topics. once the client application is terminated (TERM/KILL signal), the next time the client starts following error is logged:
{noformat}
2012-11-12 16:45:01,016 o.a.a.b.r.Topic[ActiveMQ Broker[ZyrionMessageBus] Scheduler]: (WARN) Failed to browse Topic: netvigil_DGERequestTopic
java.io.EOFException: Chunk stream does not exist, page: 23 is marked free
at org.apache.kahadb.page.Transaction$2.readPage(Transaction.java:460) ~[kahadb-5.6.0.jar:5.6.0]
at org.apache.kahadb.page.Transaction$2.<init>(Transaction.java:437) ~[kahadb-5.6.0.jar:5.6.0]
at org.apache.kahadb.page.Transaction.openInputStream(Transaction.java:434) ~[kahadb-5.6.0.jar:5.6.0]
at org.apache.kahadb.page.Transaction.load(Transaction.java:410) ~[kahadb-5.6.0.jar:5.6.0]
at org.apache.kahadb.page.Transaction.load(Transaction.java:367) ~[kahadb-5.6.0.jar:5.6.0]
at org.apache.kahadb.index.BTreeIndex.loadNode(BTreeIndex.java:262) ~[kahadb-5.6.0.jar:5.6.0]
at org.apache.kahadb.index.BTreeIndex.getRoot(BTreeIndex.java:174) ~[kahadb-5.6.0.jar:5.6.0]
at org.apache.kahadb.index.BTreeIndex.iterator(BTreeIndex.java:232) ~[kahadb-5.6.0.jar:5.6.0]
at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex$MessageOrderIterator.<init>(MessageDatabase.java:2714) ~[activemq-core-5.6.0.jar:5.6.0]
at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex.iterator(MessageDatabase.java:2696) ~[activemq-core-5.6.0.jar:5.6.0]
at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore$3.execute(KahaDBStore.java:525) ~[activemq-core-5.6.0.jar:5.6.0]
at org.apache.kahadb.page.Transaction.execute(Transaction.java:769) ~[kahadb-5.6.0.jar:5.6.0]
at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore.recover(KahaDBStore.java:521) ~[activemq-core-5.6.0.jar:5.6.0]
at org.apache.activemq.store.ProxyTopicMessageStore.recover(ProxyTopicMessageStore.java:62) ~[activemq-core-5.6.0.jar:5.6.0]
at org.apache.activemq.broker.region.Topic.doBrowse(Topic.java:559) [activemq-core-5.6.0.jar:5.6.0]
at org.apache.activemq.broker.region.Topic.access$100(Topic.java:62) [activemq-core-5.6.0.jar:5.6.0]
at org.apache.activemq.broker.region.Topic$6.run(Topic.java:684) [activemq-core-5.6.0.jar:5.6.0]
at org.apache.activemq.thread.SchedulerTimerTask.run(SchedulerTimerTask.java:33) [activemq-core-5.6.0.jar:5.6.0]
at java.util.TimerThread.mainLoop(Timer.java:512) [na:1.6.0_18]
at java.util.TimerThread.run(Timer.java:462) [na:1.6.0_18]
2012-11-12 16:45:31,012 o.a.a.b.r.Topic[ActiveMQ Broker[ZyrionMessageBus] Scheduler]: (WARN) Failed to browse Topic: netvigil_DGERequestTopic
java.io.EOFException: Chunk stream does not exist, page: 23 is marked free
at org.apache.kahadb.page.Transaction$2.readPage(Transaction.java:460) ~[kahadb-5.6.0.jar:5.6.0]
at org.apache.kahadb.page.Transaction$2.<init>(Transaction.java:437) ~[kahadb-5.6.0.jar:5.6.0]
at org.apache.kahadb.page.Transaction.openInputStream(Transaction.java:434) ~[kahadb-5.6.0.jar:5.6.0]
at org.apache.kahadb.page.Transaction.load(Transaction.java:410) ~[kahadb-5.6.0.jar:5.6.0]
at org.apache.kahadb.page.Transaction.load(Transaction.java:367) ~[kahadb-5.6.0.jar:5.6.0]
at org.apache.kahadb.index.BTreeIndex.loadNode(BTreeIndex.java:262) ~[kahadb-5.6.0.jar:5.6.0]
at org.apache.kahadb.index.BTreeIndex.getRoot(BTreeIndex.java:174) ~[kahadb-5.6.0.jar:5.6.0]
at org.apache.kahadb.index.BTreeIndex.iterator(BTreeIndex.java:232) ~[kahadb-5.6.0.jar:5.6.0]
at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex$MessageOrderIterator.<init>(MessageDatabase.java:2714) ~[activemq-core-5.6.0.jar:5.6.0]
at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex.iterator(MessageDatabase.java:2696) ~[activemq-core-5.6.0.jar:5.6.0]
at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore$3.execute(KahaDBStore.java:525) ~[activemq-core-5.6.0.jar:5.6.0]
at org.apache.kahadb.page.Transaction.execute(Transaction.java:769) ~[kahadb-5.6.0.jar:5.6.0]
at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore.recover(KahaDBStore.java:521) ~[activemq-core-5.6.0.jar:5.6.0]
at org.apache.activemq.store.ProxyTopicMessageStore.recover(ProxyTopicMessageStore.java:62) ~[activemq-core-5.6.0.jar:5.6.0]
at org.apache.activemq.broker.region.Topic.doBrowse(Topic.java:559) [activemq-core-5.6.0.jar:5.6.0]
at org.apache.activemq.broker.region.Topic.access$100(Topic.java:62) [activemq-core-5.6.0.jar:5.6.0]
at org.apache.activemq.broker.region.Topic$6.run(Topic.java:684) [activemq-core-5.6.0.jar:5.6.0]
at org.apache.activemq.thread.SchedulerTimerTask.run(SchedulerTimerTask.java:33) [activemq-core-5.6.0.jar:5.6.0]
at java.util.TimerThread.mainLoop(Timer.java:512) [na:1.6.0_18]
at java.util.TimerThread.run(Timer.java:462) [na:1.6.0_18]
{noformat}
i'm also attaching the contents of kahadb directory in case it helps. i have to say that it's becoming increasingly difficult to use activemq in production environment. this issue was reported with 5.6.0 less than 6 months ago. as a solution, i was asked to run 5.7 snapshot will continued to exhibit the problem. now that 5.7.0 is has been released (and presumably the "stable" release), i have to again resort to using the 5.8 snapshot release. had it not been for the automatic expiration of idle consumers, we would have stuck to 5.3.2 or 5.5.
> repeated error message regarding chunk stream logged
> ----------------------------------------------------
>
> Key: AMQ-3906
> URL: https://issues.apache.org/jira/browse/AMQ-3906
> Project: ActiveMQ
> Issue Type: Bug
> Components: Broker
> Affects Versions: 5.6.0
> Environment: ActiveMQ 5.6.0 running on Linux FC10 x86
> Reporter: Rajib Rashid
> Attachments: activemq.xml, kahadb.zip
>
>
> after running normally for ~24 hours, warning messages/errors like below are logged every 30 seconds:
> {code}
> 2012-06-27 14:33:31,532 org.apache.activemq.broker.region.Topic[ActiveMQ Broker[ZyrionMessageBus] Scheduler]: (WARN) Failed to browse Topic: remoteUpdateP2PTopic
> java.io.EOFException: Chunk stream does not exist, page: 50 is marked free
> at org.apache.kahadb.page.Transaction$2.readPage(Transaction.java:460)
> at org.apache.kahadb.page.Transaction$2.<init>(Transaction.java:437)
> at org.apache.kahadb.page.Transaction.openInputStream(Transaction.java:434)
> at org.apache.kahadb.page.Transaction.load(Transaction.java:410)
> at org.apache.kahadb.page.Transaction.load(Transaction.java:367)
> at org.apache.kahadb.index.BTreeIndex.loadNode(BTreeIndex.java:262)
> at org.apache.kahadb.index.BTreeIndex.getRoot(BTreeIndex.java:174)
> at org.apache.kahadb.index.BTreeIndex.iterator(BTreeIndex.java:232)
> at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex$MessageOrderIterator.<init>(MessageDatabase.java:2714)
> at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex.iterator(MessageDatabase.java:2696)
> at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore$3.execute(KahaDBStore.java:525)
> at org.apache.kahadb.page.Transaction.execute(Transaction.java:769)
> at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore.recover(KahaDBStore.java:521)
> at org.apache.activemq.store.ProxyTopicMessageStore.recover(ProxyTopicMessageStore.java:62)
> at org.apache.activemq.broker.region.Topic.doBrowse(Topic.java:559)
> at org.apache.activemq.broker.region.Topic.access$100(Topic.java:62)
> at org.apache.activemq.broker.region.Topic$6.run(Topic.java:684)
> at org.apache.activemq.thread.SchedulerTimerTask.run(SchedulerTimerTask.java:33)
> at java.util.TimerThread.mainLoop(Timer.java:512)
> at java.util.TimerThread.run(Timer.java:462)
> {code}
> since then the warning has been logged 6000+ times. not sure if this is due to the fact that we have enabled expiration of queued messages for offline subscribers.
> {code}
> % ls -l apps/activemq/data/kahadb/
> total 32068
> -rw-r--r-- 1 root root 33030144 2012-06-29 14:44 db-14.log
> -rw-r--r-- 1 root root 339968 2012-06-29 14:44 db.data
> -rw-r--r-- 1 root root 196984 2012-06-29 14:44 db.redo
> -rw-r--r-- 1 root root 0 2012-06-26 16:40 lock
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira