You are viewing a plain text version of this content. The canonical link for it is here.
Posted to server-user@james.apache.org by Valentin Munteanu <va...@gmail.com> on 2012/09/17 03:29:48 UTC
Page Size overflow: pageSize is 1024 trying to write 1031
Hi,
I ran a load testing on a james-3.0-beta3 and at some point I started
seeing a lot of "Page Size overflow: pageSize is 1024 trying to write
1031" warnings in the logs. Full stack trace bellow. As far as I can
tell it still accepts messages but nothing is delivered. Do you guys
have any hints on how I troubleshoot this?
Thanks.
---------------------------------------------
Thu Sep 06 23:00:00 2012 UTC <HOST_NAME> [WARN] (AMQPersistenceAdaptor
Task) org.apache.activemq.store.amq.AMQMessageStore: Message could not
be added to long term store: java.io.IOException: Page Size overflow:
pageSize is 1024 trying to write 1031
java.lang.RuntimeException: java.io.IOException: Page Size overflow:
pageSize is 1024 trying to write 1031
at org.apache.activemq.kaha.impl.container.MapContainerImpl.containsKey(MapContainerImpl.java:198)
at org.apache.activemq.store.kahadaptor.KahaReferenceStore.isDuplicate(KahaReferenceStore.java:176)
at org.apache.activemq.store.kahadaptor.KahaReferenceStore.addMessageReference(KahaReferenceStore.java:160)
at org.apache.activemq.store.amq.AMQMessageStore$4.execute(AMQMessageStore.java:387)
at org.apache.activemq.util.TransactionTemplate.run(TransactionTemplate.java:44)
at org.apache.activemq.store.amq.AMQMessageStore.doAsyncWrite(AMQMessageStore.java:377)
at org.apache.activemq.store.amq.AMQMessageStore.asyncWrite(AMQMessageStore.java:343)
at org.apache.activemq.store.amq.AMQMessageStore$1.iterate(AMQMessageStore.java:91)
at org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
at org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.io.IOException: Page Size overflow: pageSize is 1024
trying to write 1031
at org.apache.activemq.kaha.impl.index.hash.HashIndex.writeFullPage(HashIndex.java:394)
at org.apache.activemq.kaha.impl.index.hash.HashPageInfo.end(HashPageInfo.java:103)
at org.apache.activemq.kaha.impl.index.hash.HashBin.end(HashBin.java:337)
at org.apache.activemq.kaha.impl.index.hash.HashBin.find(HashBin.java:123)
at org.apache.activemq.kaha.impl.index.hash.HashIndex.get(HashIndex.java:294)
at org.apache.activemq.kaha.impl.index.hash.HashIndex.containsKey(HashIndex.java:319)
at org.apache.activemq.kaha.impl.container.MapContainerImpl.containsKey(MapContainerImpl.java:195)
... 12 more
Thu Sep 06 23:00:00 2012 UTC <HOST_NAME> [ERROR]
(AMQPersistenceAdaptor Task)
org.apache.activemq.kaha.impl.container.MapContainerImpl: Failed
trying to find key: ID:<HOST_NAME>-40879-1346962262285-3:1:2773:1:2
java.io.IOException: Page Size overflow: pageSize is 1024 trying to write 1031
at org.apache.activemq.kaha.impl.index.hash.HashIndex.writeFullPage(HashIndex.java:394)
at org.apache.activemq.kaha.impl.index.hash.HashPageInfo.end(HashPageInfo.java:103)
at org.apache.activemq.kaha.impl.index.hash.HashBin.end(HashBin.java:337)
at org.apache.activemq.kaha.impl.index.hash.HashBin.find(HashBin.java:123)
at org.apache.activemq.kaha.impl.index.hash.HashIndex.get(HashIndex.java:294)
at org.apache.activemq.kaha.impl.index.hash.HashIndex.containsKey(HashIndex.java:319)
at org.apache.activemq.kaha.impl.container.MapContainerImpl.containsKey(MapContainerImpl.java:195)
at org.apache.activemq.store.kahadaptor.KahaReferenceStore.isDuplicate(KahaReferenceStore.java:176)
at org.apache.activemq.store.kahadaptor.KahaReferenceStore.addMessageReference(KahaReferenceStore.java:160)
at org.apache.activemq.store.amq.AMQMessageStore$4.execute(AMQMessageStore.java:387)
at org.apache.activemq.util.TransactionTemplate.run(TransactionTemplate.java:44)
at org.apache.activemq.store.amq.AMQMessageStore.doAsyncWrite(AMQMessageStore.java:377)
at org.apache.activemq.store.amq.AMQMessageStore.asyncWrite(AMQMessageStore.java:343)
at org.apache.activemq.store.amq.AMQMessageStore$1.iterate(AMQMessageStore.java:91)
at org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
at org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
---------------------------------------------------------------------
To unsubscribe, e-mail: server-user-unsubscribe@james.apache.org
For additional commands, e-mail: server-user-help@james.apache.org
Re: Page Size overflow: pageSize is 1024 trying to write 1031
Posted by Valentin Munteanu <va...@gmail.com>.
Hi Eric,
Sorry for not replying earlier. Unfortunately the rules in place at my
current employer make the process of submitting patches to open source
project very complicated, it will take a long time to get that patch
out.
-Valentin
On Thu, Sep 20, 2012 at 5:47 AM, Eric Charles <er...@apache.org> wrote:
> Thx, I am just wondering if our custom blobTransferPolicy is still working
> with that config.
>
> Could you open a JIRA and provide a patch so we can track down this?
>
> Thx, Eric
>
>
>
> On 20/09/2012 00:38, Valentin Munteanu wrote:
>>
>> Eric,
>>
>> My James instance is pretty lite; it has only the SMTP server, no
>> user/mailbox, no JMX. For using the KahaDB datastore I changed the
>> <amq:persistenceAdapter> section in james-server.xml, replacing the
>> <amq:amqPersistenceAdapter/> line with <amq:kahaDB
>> directory="filesystem=file://var/store/activemq/brokers/KahaDB"
>> journalMaxFileLength="64mb" indexCacheSize="50000"/>. I also replaced
>> the activeio-core, activemq-core and kahadb jars with the ones from
>> the ActiveMQ-5.6.0 distribution.
>>
>> Numbers bellow. I only measured the inbound pipeline, so the "tps"
>> value represent how many messages were enqueued per second. The
>> numbers in the square brackets tell how many concurrent threads were
>> hammering the James instance during that test iteration. Each
>> iteration consisted in 5k requests. Please take them with a grain of
>> salt.
>>
>> Hardware where James ran:
>> Hardware: Xen: VirtualHost
>> CPU: 1 x Intel(R) Xeon(R) CPU E5507 @ 2.27GHz
>> RAM: 1900MB
>>
>> The code that generated the load was run on a different box.
>>
>> [5]avg=8.551, tps=116.9453865045024, errors=0, msg_size=4kilos
>> [10]avg=7.8336, tps=127.65522875816994, errors=0, msg_size=4kilos
>> [15]avg=5.556, tps=179.98560115190784, errors=0, msg_size=4kilos
>> [20]avg=6.69, tps=149.47683109118086, errors=0, msg_size=4kilos
>> [25]avg=7.6082, tps=131.43713361899006, errors=0, msg_size=4kilos
>>
>> [5]avg=10.4, tps=96.15384615384616, errors=0, msg_size=8kilos
>> [10]avg=7.8588, tps=127.24588995775437, errors=0, msg_size=8kilos
>> [15]avg=8.4324, tps=118.59019970589631, errors=0, msg_size=8kilos
>> [20]avg=8.28, tps=120.77294685990339, errors=0, msg_size=8kilos
>> [25]avg=6.6016, tps=151.47842947164324, errors=0, msg_size=8kilos
>>
>> [5]avg=17.6774, tps=56.56940500299818, errors=0, msg_size=12kilos
>> [10]avg=9.8692, tps=101.32533538686013, errors=0, msg_size=12kilos
>> [15]avg=9.2196, tps=108.46457546965162, errors=0, msg_size=12kilos
>> [20]avg=8.6836, tps=115.15961122115252, errors=0, msg_size=12kilos
>> [25]avg=7.4592, tps=134.06263406263406, errors=0, msg_size=12kilos
>>
>> [5]avg=21.606, tps=46.28343978524484, errors=0, msg_size=16kilos
>> [10]avg=10.8896, tps=91.83073758448428, errors=0, msg_size=16kilos
>> [15]avg=9.8158, tps=101.87656635220766, errors=0, msg_size=16kilos
>> [20]avg=8.7852, tps=113.82780130219004, errors=0, msg_size=16kilos
>> [25]avg=8.2, tps=121.95121951219512, errors=0, msg_size=16kilos
>>
>> [5]avg=20.4012, tps=49.01672450640159, errors=0, msg_size=20kilos
>> [10]avg=11.452, tps=87.32099196646874, errors=0, msg_size=20kilos
>> [15]avg=10.204, tps=98.00078400627204, errors=0, msg_size=20kilos
>> [20]avg=9.5742, tps=104.44736897077563, errors=0, msg_size=20kilos
>> [25]avg=9.4026, tps=106.35356178078405, errors=0, msg_size=20kilos
>>
>>
>> -Valentin
>>
>> On Wed, Sep 19, 2012 at 4:35 AM, Eric Charles <er...@apache.org> wrote:
>>>
>>> Hi Valentin,
>>>
>>> That's good news!
>>> Any patch or performance figures you could provide?
>>>
>>> Thx, Eric
>>>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: server-user-unsubscribe@james.apache.org
>> For additional commands, e-mail: server-user-help@james.apache.org
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: server-user-unsubscribe@james.apache.org
> For additional commands, e-mail: server-user-help@james.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-user-unsubscribe@james.apache.org
For additional commands, e-mail: server-user-help@james.apache.org
Re: Page Size overflow: pageSize is 1024 trying to write 1031
Posted by Eric Charles <er...@apache.org>.
Thx, I am just wondering if our custom blobTransferPolicy is still
working with that config.
Could you open a JIRA and provide a patch so we can track down this?
Thx, Eric
On 20/09/2012 00:38, Valentin Munteanu wrote:
> Eric,
>
> My James instance is pretty lite; it has only the SMTP server, no
> user/mailbox, no JMX. For using the KahaDB datastore I changed the
> <amq:persistenceAdapter> section in james-server.xml, replacing the
> <amq:amqPersistenceAdapter/> line with <amq:kahaDB
> directory="filesystem=file://var/store/activemq/brokers/KahaDB"
> journalMaxFileLength="64mb" indexCacheSize="50000"/>. I also replaced
> the activeio-core, activemq-core and kahadb jars with the ones from
> the ActiveMQ-5.6.0 distribution.
>
> Numbers bellow. I only measured the inbound pipeline, so the "tps"
> value represent how many messages were enqueued per second. The
> numbers in the square brackets tell how many concurrent threads were
> hammering the James instance during that test iteration. Each
> iteration consisted in 5k requests. Please take them with a grain of
> salt.
>
> Hardware where James ran:
> Hardware: Xen: VirtualHost
> CPU: 1 x Intel(R) Xeon(R) CPU E5507 @ 2.27GHz
> RAM: 1900MB
>
> The code that generated the load was run on a different box.
>
> [5]avg=8.551, tps=116.9453865045024, errors=0, msg_size=4kilos
> [10]avg=7.8336, tps=127.65522875816994, errors=0, msg_size=4kilos
> [15]avg=5.556, tps=179.98560115190784, errors=0, msg_size=4kilos
> [20]avg=6.69, tps=149.47683109118086, errors=0, msg_size=4kilos
> [25]avg=7.6082, tps=131.43713361899006, errors=0, msg_size=4kilos
>
> [5]avg=10.4, tps=96.15384615384616, errors=0, msg_size=8kilos
> [10]avg=7.8588, tps=127.24588995775437, errors=0, msg_size=8kilos
> [15]avg=8.4324, tps=118.59019970589631, errors=0, msg_size=8kilos
> [20]avg=8.28, tps=120.77294685990339, errors=0, msg_size=8kilos
> [25]avg=6.6016, tps=151.47842947164324, errors=0, msg_size=8kilos
>
> [5]avg=17.6774, tps=56.56940500299818, errors=0, msg_size=12kilos
> [10]avg=9.8692, tps=101.32533538686013, errors=0, msg_size=12kilos
> [15]avg=9.2196, tps=108.46457546965162, errors=0, msg_size=12kilos
> [20]avg=8.6836, tps=115.15961122115252, errors=0, msg_size=12kilos
> [25]avg=7.4592, tps=134.06263406263406, errors=0, msg_size=12kilos
>
> [5]avg=21.606, tps=46.28343978524484, errors=0, msg_size=16kilos
> [10]avg=10.8896, tps=91.83073758448428, errors=0, msg_size=16kilos
> [15]avg=9.8158, tps=101.87656635220766, errors=0, msg_size=16kilos
> [20]avg=8.7852, tps=113.82780130219004, errors=0, msg_size=16kilos
> [25]avg=8.2, tps=121.95121951219512, errors=0, msg_size=16kilos
>
> [5]avg=20.4012, tps=49.01672450640159, errors=0, msg_size=20kilos
> [10]avg=11.452, tps=87.32099196646874, errors=0, msg_size=20kilos
> [15]avg=10.204, tps=98.00078400627204, errors=0, msg_size=20kilos
> [20]avg=9.5742, tps=104.44736897077563, errors=0, msg_size=20kilos
> [25]avg=9.4026, tps=106.35356178078405, errors=0, msg_size=20kilos
>
>
> -Valentin
>
> On Wed, Sep 19, 2012 at 4:35 AM, Eric Charles <er...@apache.org> wrote:
>> Hi Valentin,
>>
>> That's good news!
>> Any patch or performance figures you could provide?
>>
>> Thx, Eric
>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: server-user-unsubscribe@james.apache.org
> For additional commands, e-mail: server-user-help@james.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-user-unsubscribe@james.apache.org
For additional commands, e-mail: server-user-help@james.apache.org
Re: Page Size overflow: pageSize is 1024 trying to write 1031
Posted by Valentin Munteanu <va...@gmail.com>.
Eric,
My James instance is pretty lite; it has only the SMTP server, no
user/mailbox, no JMX. For using the KahaDB datastore I changed the
<amq:persistenceAdapter> section in james-server.xml, replacing the
<amq:amqPersistenceAdapter/> line with <amq:kahaDB
directory="filesystem=file://var/store/activemq/brokers/KahaDB"
journalMaxFileLength="64mb" indexCacheSize="50000"/>. I also replaced
the activeio-core, activemq-core and kahadb jars with the ones from
the ActiveMQ-5.6.0 distribution.
Numbers bellow. I only measured the inbound pipeline, so the "tps"
value represent how many messages were enqueued per second. The
numbers in the square brackets tell how many concurrent threads were
hammering the James instance during that test iteration. Each
iteration consisted in 5k requests. Please take them with a grain of
salt.
Hardware where James ran:
Hardware: Xen: VirtualHost
CPU: 1 x Intel(R) Xeon(R) CPU E5507 @ 2.27GHz
RAM: 1900MB
The code that generated the load was run on a different box.
[5]avg=8.551, tps=116.9453865045024, errors=0, msg_size=4kilos
[10]avg=7.8336, tps=127.65522875816994, errors=0, msg_size=4kilos
[15]avg=5.556, tps=179.98560115190784, errors=0, msg_size=4kilos
[20]avg=6.69, tps=149.47683109118086, errors=0, msg_size=4kilos
[25]avg=7.6082, tps=131.43713361899006, errors=0, msg_size=4kilos
[5]avg=10.4, tps=96.15384615384616, errors=0, msg_size=8kilos
[10]avg=7.8588, tps=127.24588995775437, errors=0, msg_size=8kilos
[15]avg=8.4324, tps=118.59019970589631, errors=0, msg_size=8kilos
[20]avg=8.28, tps=120.77294685990339, errors=0, msg_size=8kilos
[25]avg=6.6016, tps=151.47842947164324, errors=0, msg_size=8kilos
[5]avg=17.6774, tps=56.56940500299818, errors=0, msg_size=12kilos
[10]avg=9.8692, tps=101.32533538686013, errors=0, msg_size=12kilos
[15]avg=9.2196, tps=108.46457546965162, errors=0, msg_size=12kilos
[20]avg=8.6836, tps=115.15961122115252, errors=0, msg_size=12kilos
[25]avg=7.4592, tps=134.06263406263406, errors=0, msg_size=12kilos
[5]avg=21.606, tps=46.28343978524484, errors=0, msg_size=16kilos
[10]avg=10.8896, tps=91.83073758448428, errors=0, msg_size=16kilos
[15]avg=9.8158, tps=101.87656635220766, errors=0, msg_size=16kilos
[20]avg=8.7852, tps=113.82780130219004, errors=0, msg_size=16kilos
[25]avg=8.2, tps=121.95121951219512, errors=0, msg_size=16kilos
[5]avg=20.4012, tps=49.01672450640159, errors=0, msg_size=20kilos
[10]avg=11.452, tps=87.32099196646874, errors=0, msg_size=20kilos
[15]avg=10.204, tps=98.00078400627204, errors=0, msg_size=20kilos
[20]avg=9.5742, tps=104.44736897077563, errors=0, msg_size=20kilos
[25]avg=9.4026, tps=106.35356178078405, errors=0, msg_size=20kilos
-Valentin
On Wed, Sep 19, 2012 at 4:35 AM, Eric Charles <er...@apache.org> wrote:
> Hi Valentin,
>
> That's good news!
> Any patch or performance figures you could provide?
>
> Thx, Eric
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-user-unsubscribe@james.apache.org
For additional commands, e-mail: server-user-help@james.apache.org
Re: Page Size overflow: pageSize is 1024 trying to write 1031
Posted by Eric Charles <er...@apache.org>.
Hi Valentin,
That's good news!
Any patch or performance figures you could provide?
Thx, Eric
On 18/09/2012 22:31, Valentin Munteanu wrote:
> Hi Eric,
>
> I ended up updating the ActiveMQ libraries to the latest ones, 5.6.0,
> and changing the broker to use the KahaDB persistence engine instead
> of the AMQ one. It has worked fine so far, it did not crash during the
> load test.
>
> -Valentin
>
> On Tue, Sep 18, 2012 at 1:22 AM, Eric Charles <er...@apache.org> wrote:
>> Hi,
>>
>> Thx for stressing James :)
>>
>> This is an issue related to ActiveMQ queues. Can be its configuration, or
>> the way we use it...
>>
>> I had a quick look, but didn't find anything relevant for now. Could you
>> please open a JIRA for this.
>>
>> Alternatively, would you be interested in testing with a file based queuing
>> system which should better perform.
>>
>> Thx, Eric
>>
>>
>>
>> On 17/09/2012 02:29, Valentin Munteanu wrote:
>>>
>>> Hi,
>>>
>>> I ran a load testing on a james-3.0-beta3 and at some point I started
>>> seeing a lot of "Page Size overflow: pageSize is 1024 trying to write
>>> 1031" warnings in the logs. Full stack trace bellow. As far as I can
>>> tell it still accepts messages but nothing is delivered. Do you guys
>>> have any hints on how I troubleshoot this?
>>>
>>> Thanks.
>>>
>>>
>>>
>>> ---------------------------------------------
>>>
>>> Thu Sep 06 23:00:00 2012 UTC <HOST_NAME> [WARN] (AMQPersistenceAdaptor
>>> Task) org.apache.activemq.store.amq.AMQMessageStore: Message could not
>>> be added to long term store: java.io.IOException: Page Size overflow:
>>> pageSize is 1024 trying to write 1031
>>> java.lang.RuntimeException: java.io.IOException: Page Size overflow:
>>> pageSize is 1024 trying to write 1031
>>> at
>>> org.apache.activemq.kaha.impl.container.MapContainerImpl.containsKey(MapContainerImpl.java:198)
>>> at
>>> org.apache.activemq.store.kahadaptor.KahaReferenceStore.isDuplicate(KahaReferenceStore.java:176)
>>> at
>>> org.apache.activemq.store.kahadaptor.KahaReferenceStore.addMessageReference(KahaReferenceStore.java:160)
>>> at
>>> org.apache.activemq.store.amq.AMQMessageStore$4.execute(AMQMessageStore.java:387)
>>> at
>>> org.apache.activemq.util.TransactionTemplate.run(TransactionTemplate.java:44)
>>> at
>>> org.apache.activemq.store.amq.AMQMessageStore.doAsyncWrite(AMQMessageStore.java:377)
>>> at
>>> org.apache.activemq.store.amq.AMQMessageStore.asyncWrite(AMQMessageStore.java:343)
>>> at
>>> org.apache.activemq.store.amq.AMQMessageStore$1.iterate(AMQMessageStore.java:91)
>>> at
>>> org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
>>> at
>>> org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>>> at java.lang.Thread.run(Thread.java:662)
>>> Caused by: java.io.IOException: Page Size overflow: pageSize is 1024
>>> trying to write 1031
>>> at
>>> org.apache.activemq.kaha.impl.index.hash.HashIndex.writeFullPage(HashIndex.java:394)
>>> at
>>> org.apache.activemq.kaha.impl.index.hash.HashPageInfo.end(HashPageInfo.java:103)
>>> at
>>> org.apache.activemq.kaha.impl.index.hash.HashBin.end(HashBin.java:337)
>>> at
>>> org.apache.activemq.kaha.impl.index.hash.HashBin.find(HashBin.java:123)
>>> at
>>> org.apache.activemq.kaha.impl.index.hash.HashIndex.get(HashIndex.java:294)
>>> at
>>> org.apache.activemq.kaha.impl.index.hash.HashIndex.containsKey(HashIndex.java:319)
>>> at
>>> org.apache.activemq.kaha.impl.container.MapContainerImpl.containsKey(MapContainerImpl.java:195)
>>> ... 12 more
>>> Thu Sep 06 23:00:00 2012 UTC <HOST_NAME> [ERROR]
>>> (AMQPersistenceAdaptor Task)
>>> org.apache.activemq.kaha.impl.container.MapContainerImpl: Failed
>>> trying to find key: ID:<HOST_NAME>-40879-1346962262285-3:1:2773:1:2
>>> java.io.IOException: Page Size overflow: pageSize is 1024 trying to write
>>> 1031
>>> at
>>> org.apache.activemq.kaha.impl.index.hash.HashIndex.writeFullPage(HashIndex.java:394)
>>> at
>>> org.apache.activemq.kaha.impl.index.hash.HashPageInfo.end(HashPageInfo.java:103)
>>> at
>>> org.apache.activemq.kaha.impl.index.hash.HashBin.end(HashBin.java:337)
>>> at
>>> org.apache.activemq.kaha.impl.index.hash.HashBin.find(HashBin.java:123)
>>> at
>>> org.apache.activemq.kaha.impl.index.hash.HashIndex.get(HashIndex.java:294)
>>> at
>>> org.apache.activemq.kaha.impl.index.hash.HashIndex.containsKey(HashIndex.java:319)
>>> at
>>> org.apache.activemq.kaha.impl.container.MapContainerImpl.containsKey(MapContainerImpl.java:195)
>>> at
>>> org.apache.activemq.store.kahadaptor.KahaReferenceStore.isDuplicate(KahaReferenceStore.java:176)
>>> at
>>> org.apache.activemq.store.kahadaptor.KahaReferenceStore.addMessageReference(KahaReferenceStore.java:160)
>>> at
>>> org.apache.activemq.store.amq.AMQMessageStore$4.execute(AMQMessageStore.java:387)
>>> at
>>> org.apache.activemq.util.TransactionTemplate.run(TransactionTemplate.java:44)
>>> at
>>> org.apache.activemq.store.amq.AMQMessageStore.doAsyncWrite(AMQMessageStore.java:377)
>>> at
>>> org.apache.activemq.store.amq.AMQMessageStore.asyncWrite(AMQMessageStore.java:343)
>>> at
>>> org.apache.activemq.store.amq.AMQMessageStore$1.iterate(AMQMessageStore.java:91)
>>> at
>>> org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
>>> at
>>> org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>>> at java.lang.Thread.run(Thread.java:662)
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: server-user-unsubscribe@james.apache.org
>>> For additional commands, e-mail: server-user-help@james.apache.org
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: server-user-unsubscribe@james.apache.org
>> For additional commands, e-mail: server-user-help@james.apache.org
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: server-user-unsubscribe@james.apache.org
> For additional commands, e-mail: server-user-help@james.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-user-unsubscribe@james.apache.org
For additional commands, e-mail: server-user-help@james.apache.org
Re: Page Size overflow: pageSize is 1024 trying to write 1031
Posted by Valentin Munteanu <va...@gmail.com>.
Hi Eric,
I ended up updating the ActiveMQ libraries to the latest ones, 5.6.0,
and changing the broker to use the KahaDB persistence engine instead
of the AMQ one. It has worked fine so far, it did not crash during the
load test.
-Valentin
On Tue, Sep 18, 2012 at 1:22 AM, Eric Charles <er...@apache.org> wrote:
> Hi,
>
> Thx for stressing James :)
>
> This is an issue related to ActiveMQ queues. Can be its configuration, or
> the way we use it...
>
> I had a quick look, but didn't find anything relevant for now. Could you
> please open a JIRA for this.
>
> Alternatively, would you be interested in testing with a file based queuing
> system which should better perform.
>
> Thx, Eric
>
>
>
> On 17/09/2012 02:29, Valentin Munteanu wrote:
>>
>> Hi,
>>
>> I ran a load testing on a james-3.0-beta3 and at some point I started
>> seeing a lot of "Page Size overflow: pageSize is 1024 trying to write
>> 1031" warnings in the logs. Full stack trace bellow. As far as I can
>> tell it still accepts messages but nothing is delivered. Do you guys
>> have any hints on how I troubleshoot this?
>>
>> Thanks.
>>
>>
>>
>> ---------------------------------------------
>>
>> Thu Sep 06 23:00:00 2012 UTC <HOST_NAME> [WARN] (AMQPersistenceAdaptor
>> Task) org.apache.activemq.store.amq.AMQMessageStore: Message could not
>> be added to long term store: java.io.IOException: Page Size overflow:
>> pageSize is 1024 trying to write 1031
>> java.lang.RuntimeException: java.io.IOException: Page Size overflow:
>> pageSize is 1024 trying to write 1031
>> at
>> org.apache.activemq.kaha.impl.container.MapContainerImpl.containsKey(MapContainerImpl.java:198)
>> at
>> org.apache.activemq.store.kahadaptor.KahaReferenceStore.isDuplicate(KahaReferenceStore.java:176)
>> at
>> org.apache.activemq.store.kahadaptor.KahaReferenceStore.addMessageReference(KahaReferenceStore.java:160)
>> at
>> org.apache.activemq.store.amq.AMQMessageStore$4.execute(AMQMessageStore.java:387)
>> at
>> org.apache.activemq.util.TransactionTemplate.run(TransactionTemplate.java:44)
>> at
>> org.apache.activemq.store.amq.AMQMessageStore.doAsyncWrite(AMQMessageStore.java:377)
>> at
>> org.apache.activemq.store.amq.AMQMessageStore.asyncWrite(AMQMessageStore.java:343)
>> at
>> org.apache.activemq.store.amq.AMQMessageStore$1.iterate(AMQMessageStore.java:91)
>> at
>> org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
>> at
>> org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>> at java.lang.Thread.run(Thread.java:662)
>> Caused by: java.io.IOException: Page Size overflow: pageSize is 1024
>> trying to write 1031
>> at
>> org.apache.activemq.kaha.impl.index.hash.HashIndex.writeFullPage(HashIndex.java:394)
>> at
>> org.apache.activemq.kaha.impl.index.hash.HashPageInfo.end(HashPageInfo.java:103)
>> at
>> org.apache.activemq.kaha.impl.index.hash.HashBin.end(HashBin.java:337)
>> at
>> org.apache.activemq.kaha.impl.index.hash.HashBin.find(HashBin.java:123)
>> at
>> org.apache.activemq.kaha.impl.index.hash.HashIndex.get(HashIndex.java:294)
>> at
>> org.apache.activemq.kaha.impl.index.hash.HashIndex.containsKey(HashIndex.java:319)
>> at
>> org.apache.activemq.kaha.impl.container.MapContainerImpl.containsKey(MapContainerImpl.java:195)
>> ... 12 more
>> Thu Sep 06 23:00:00 2012 UTC <HOST_NAME> [ERROR]
>> (AMQPersistenceAdaptor Task)
>> org.apache.activemq.kaha.impl.container.MapContainerImpl: Failed
>> trying to find key: ID:<HOST_NAME>-40879-1346962262285-3:1:2773:1:2
>> java.io.IOException: Page Size overflow: pageSize is 1024 trying to write
>> 1031
>> at
>> org.apache.activemq.kaha.impl.index.hash.HashIndex.writeFullPage(HashIndex.java:394)
>> at
>> org.apache.activemq.kaha.impl.index.hash.HashPageInfo.end(HashPageInfo.java:103)
>> at
>> org.apache.activemq.kaha.impl.index.hash.HashBin.end(HashBin.java:337)
>> at
>> org.apache.activemq.kaha.impl.index.hash.HashBin.find(HashBin.java:123)
>> at
>> org.apache.activemq.kaha.impl.index.hash.HashIndex.get(HashIndex.java:294)
>> at
>> org.apache.activemq.kaha.impl.index.hash.HashIndex.containsKey(HashIndex.java:319)
>> at
>> org.apache.activemq.kaha.impl.container.MapContainerImpl.containsKey(MapContainerImpl.java:195)
>> at
>> org.apache.activemq.store.kahadaptor.KahaReferenceStore.isDuplicate(KahaReferenceStore.java:176)
>> at
>> org.apache.activemq.store.kahadaptor.KahaReferenceStore.addMessageReference(KahaReferenceStore.java:160)
>> at
>> org.apache.activemq.store.amq.AMQMessageStore$4.execute(AMQMessageStore.java:387)
>> at
>> org.apache.activemq.util.TransactionTemplate.run(TransactionTemplate.java:44)
>> at
>> org.apache.activemq.store.amq.AMQMessageStore.doAsyncWrite(AMQMessageStore.java:377)
>> at
>> org.apache.activemq.store.amq.AMQMessageStore.asyncWrite(AMQMessageStore.java:343)
>> at
>> org.apache.activemq.store.amq.AMQMessageStore$1.iterate(AMQMessageStore.java:91)
>> at
>> org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
>> at
>> org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>> at java.lang.Thread.run(Thread.java:662)
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: server-user-unsubscribe@james.apache.org
>> For additional commands, e-mail: server-user-help@james.apache.org
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: server-user-unsubscribe@james.apache.org
> For additional commands, e-mail: server-user-help@james.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-user-unsubscribe@james.apache.org
For additional commands, e-mail: server-user-help@james.apache.org
Re: Page Size overflow: pageSize is 1024 trying to write 1031
Posted by Eric Charles <er...@apache.org>.
Hi,
Thx for stressing James :)
This is an issue related to ActiveMQ queues. Can be its configuration,
or the way we use it...
I had a quick look, but didn't find anything relevant for now. Could you
please open a JIRA for this.
Alternatively, would you be interested in testing with a file based
queuing system which should better perform.
Thx, Eric
On 17/09/2012 02:29, Valentin Munteanu wrote:
> Hi,
>
> I ran a load testing on a james-3.0-beta3 and at some point I started
> seeing a lot of "Page Size overflow: pageSize is 1024 trying to write
> 1031" warnings in the logs. Full stack trace bellow. As far as I can
> tell it still accepts messages but nothing is delivered. Do you guys
> have any hints on how I troubleshoot this?
>
> Thanks.
>
>
>
> ---------------------------------------------
>
> Thu Sep 06 23:00:00 2012 UTC <HOST_NAME> [WARN] (AMQPersistenceAdaptor
> Task) org.apache.activemq.store.amq.AMQMessageStore: Message could not
> be added to long term store: java.io.IOException: Page Size overflow:
> pageSize is 1024 trying to write 1031
> java.lang.RuntimeException: java.io.IOException: Page Size overflow:
> pageSize is 1024 trying to write 1031
> at org.apache.activemq.kaha.impl.container.MapContainerImpl.containsKey(MapContainerImpl.java:198)
> at org.apache.activemq.store.kahadaptor.KahaReferenceStore.isDuplicate(KahaReferenceStore.java:176)
> at org.apache.activemq.store.kahadaptor.KahaReferenceStore.addMessageReference(KahaReferenceStore.java:160)
> at org.apache.activemq.store.amq.AMQMessageStore$4.execute(AMQMessageStore.java:387)
> at org.apache.activemq.util.TransactionTemplate.run(TransactionTemplate.java:44)
> at org.apache.activemq.store.amq.AMQMessageStore.doAsyncWrite(AMQMessageStore.java:377)
> at org.apache.activemq.store.amq.AMQMessageStore.asyncWrite(AMQMessageStore.java:343)
> at org.apache.activemq.store.amq.AMQMessageStore$1.iterate(AMQMessageStore.java:91)
> at org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
> at org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.io.IOException: Page Size overflow: pageSize is 1024
> trying to write 1031
> at org.apache.activemq.kaha.impl.index.hash.HashIndex.writeFullPage(HashIndex.java:394)
> at org.apache.activemq.kaha.impl.index.hash.HashPageInfo.end(HashPageInfo.java:103)
> at org.apache.activemq.kaha.impl.index.hash.HashBin.end(HashBin.java:337)
> at org.apache.activemq.kaha.impl.index.hash.HashBin.find(HashBin.java:123)
> at org.apache.activemq.kaha.impl.index.hash.HashIndex.get(HashIndex.java:294)
> at org.apache.activemq.kaha.impl.index.hash.HashIndex.containsKey(HashIndex.java:319)
> at org.apache.activemq.kaha.impl.container.MapContainerImpl.containsKey(MapContainerImpl.java:195)
> ... 12 more
> Thu Sep 06 23:00:00 2012 UTC <HOST_NAME> [ERROR]
> (AMQPersistenceAdaptor Task)
> org.apache.activemq.kaha.impl.container.MapContainerImpl: Failed
> trying to find key: ID:<HOST_NAME>-40879-1346962262285-3:1:2773:1:2
> java.io.IOException: Page Size overflow: pageSize is 1024 trying to write 1031
> at org.apache.activemq.kaha.impl.index.hash.HashIndex.writeFullPage(HashIndex.java:394)
> at org.apache.activemq.kaha.impl.index.hash.HashPageInfo.end(HashPageInfo.java:103)
> at org.apache.activemq.kaha.impl.index.hash.HashBin.end(HashBin.java:337)
> at org.apache.activemq.kaha.impl.index.hash.HashBin.find(HashBin.java:123)
> at org.apache.activemq.kaha.impl.index.hash.HashIndex.get(HashIndex.java:294)
> at org.apache.activemq.kaha.impl.index.hash.HashIndex.containsKey(HashIndex.java:319)
> at org.apache.activemq.kaha.impl.container.MapContainerImpl.containsKey(MapContainerImpl.java:195)
> at org.apache.activemq.store.kahadaptor.KahaReferenceStore.isDuplicate(KahaReferenceStore.java:176)
> at org.apache.activemq.store.kahadaptor.KahaReferenceStore.addMessageReference(KahaReferenceStore.java:160)
> at org.apache.activemq.store.amq.AMQMessageStore$4.execute(AMQMessageStore.java:387)
> at org.apache.activemq.util.TransactionTemplate.run(TransactionTemplate.java:44)
> at org.apache.activemq.store.amq.AMQMessageStore.doAsyncWrite(AMQMessageStore.java:377)
> at org.apache.activemq.store.amq.AMQMessageStore.asyncWrite(AMQMessageStore.java:343)
> at org.apache.activemq.store.amq.AMQMessageStore$1.iterate(AMQMessageStore.java:91)
> at org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
> at org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: server-user-unsubscribe@james.apache.org
> For additional commands, e-mail: server-user-help@james.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: server-user-unsubscribe@james.apache.org
For additional commands, e-mail: server-user-help@james.apache.org