You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@activemq.apache.org by vanyatka <ib...@gmail.com> on 2008/04/20 20:53:25 UTC
Re: Poort ActiveMQ Persistence Performance
Hi, Rob
I've been doing some testing with ActiveMQ 5.1, making it receive messages
as fast as possible. What I noticed was a steady slow down as the messages
kept coming to AMQ. I have to mention here that I intentionally didn't
consume messages from the queue (so it kept growing) to see the storage
capacity of AMQ.
Below are partial results of sending messages over 100MB network using
OpenWire to AMQ 5.1 running on FreeBSD.
The trend of performance decrease suggests a possible bottleneck in the
persistence module (which was Kaha by default). Obviously, I cannot assert
this for sure.
Even though Kaha is supposed to be the fastest storage mechanism supplied
with AMQ, are there any configuration options to fine-tune it for heavy
loads?
This is a part of the more broad issue "how to make AMQ accept more messages
per unit of time, thus reduce number of nodes in a cluster".
1000 msgs for 1516 msec. 659.0 msgs p/sec
2000 msgs for 2579 msec. 775.0 msgs p/sec
3000 msgs for 3657 msec. 820.0 msgs p/sec
4000 msgs for 4735 msec. 844.0 msgs p/sec
5000 msgs for 5875 msec. 851.0 msgs p/sec
6000 msgs for 8032 msec. 747.0 msgs p/sec
7000 msgs for 9110 msec. 768.0 msgs p/sec
8000 msgs for 10204 msec. 784.0 msgs p/sec
9000 msgs for 11360 msec. 792.0 msgs p/sec
10000 msgs for 12454 msec. 802.0 msgs p/sec
11000 msgs for 13579 msec. 810.0 msgs p/sec
12000 msgs for 14688 msec. 816.0 msgs p/sec
13000 msgs for 15875 msec. 818.0 msgs p/sec
14000 msgs for 17282 msec. 810.0 msgs p/sec
15000 msgs for 18500 msec. 810.0 msgs p/sec
16000 msgs for 19735 msec. 810.0 msgs p/sec
17000 msgs for 20922 msec. 812.0 msgs p/sec
18000 msgs for 22172 msec. 811.0 msgs p/sec
19000 msgs for 23391 msec. 812.0 msgs p/sec
20000 msgs for 24750 msec. 808.0 msgs p/sec
21000 msgs for 25954 msec. 809.0 msgs p/sec
22000 msgs for 28125 msec. 782.0 msgs p/sec
23000 msgs for 29282 msec. 785.0 msgs p/sec
24000 msgs for 30750 msec. 780.0 msgs p/sec
25000 msgs for 31969 msec. 782.0 msgs p/sec
26000 msgs for 33172 msec. 783.0 msgs p/sec
27000 msgs for 34454 msec. 783.0 msgs p/sec
28000 msgs for 35875 msec. 780.0 msgs p/sec
29000 msgs for 37235 msec. 778.0 msgs p/sec
30000 msgs for 39875 msec. 752.0 msgs p/sec
31000 msgs for 41250 msec. 751.0 msgs p/sec
32000 msgs for 42547 msec. 752.0 msgs p/sec
33000 msgs for 43813 msec. 753.0 msgs p/sec
34000 msgs for 45297 msec. 750.0 msgs p/sec
35000 msgs for 46610 msec. 750.0 msgs p/sec
36000 msgs for 48329 msec. 744.0 msgs p/sec
37000 msgs for 49672 msec. 744.0 msgs p/sec
38000 msgs for 51000 msec. 745.0 msgs p/sec
39000 msgs for 52688 msec. 740.0 msgs p/sec
40000 msgs for 54422 msec. 734.0 msgs p/sec
41000 msgs for 56047 msec. 731.0 msgs p/sec
42000 msgs for 57391 msec. 731.0 msgs p/sec
43000 msgs for 60719 msec. 708.0 msgs p/sec
44000 msgs for 61907 msec. 710.0 msgs p/sec
45000 msgs for 63422 msec. 709.0 msgs p/sec
46000 msgs for 64766 msec. 710.0 msgs p/sec
47000 msgs for 66360 msec. 708.0 msgs p/sec
48000 msgs for 67813 msec. 707.0 msgs p/sec
49000 msgs for 71563 msec. 684.0 msgs p/sec
50000 msgs for 72750 msec. 687.0 msgs p/sec
51000 msgs for 74204 msec. 687.0 msgs p/sec
52000 msgs for 75704 msec. 686.0 msgs p/sec
53000 msgs for 77266 msec. 685.0 msgs p/sec
54000 msgs for 78563 msec. 687.0 msgs p/sec
55000 msgs for 80125 msec. 686.0 msgs p/sec
56000 msgs for 82016 msec. 682.0 msgs p/sec
57000 msgs for 83500 msec. 682.0 msgs p/sec
58000 msgs for 85047 msec. 681.0 msgs p/sec
59000 msgs for 86516 msec. 681.0 msgs p/sec
60000 msgs for 90422 msec. 663.0 msgs p/sec
61000 msgs for 91641 msec. 665.0 msgs p/sec
62000 msgs for 93032 msec. 666.0 msgs p/sec
63000 msgs for 94579 msec. 666.0 msgs p/sec
64000 msgs for 95782 msec. 668.0 msgs p/sec
rajdavies wrote:
>
>
> So long story short - use the default message store (AMQ) in version 5!
>
>
--
View this message in context: http://www.nabble.com/Poort-ActiveMQ-Persistence-Performance-tp12945570s2354p16797097.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.
Re: Poort ActiveMQ Persistence Performance
Posted by vanyatka <ib...@gmail.com>.
Thanks, Rob
I'll try to play with those parameters, here is what I got so far:
<persistenceAdapter>
<amqPersistenceAdapter
directory="activemq-data"
maxFileLength="32mb"
indexBinSize="8192"
indexPageSize="128kb"
/>
</persistenceAdapter>
1000 msgs for 1282 msec. 780.0 msgs p/sec
2000 msgs for 2391 msec. 836.0 msgs p/sec
3000 msgs for 3844 msec. 780.0 msgs p/sec
4000 msgs for 4875 msec. 820.0 msgs p/sec
5000 msgs for 7016 msec. 712.0 msgs p/sec
6000 msgs for 9125 msec. 657.0 msgs p/sec
7000 msgs for 11438 msec. 611.0 msgs p/sec
8000 msgs for 13485 msec. 593.0 msgs p/sec
9000 msgs for 16235 msec. 554.0 msgs p/sec
10000 msgs for 19157 msec. 522.0 msgs p/sec
11000 msgs for 21907 msec. 502.0 msgs p/sec
12000 msgs for 24782 msec. 484.0 msgs p/sec
13000 msgs for 28391 msec. 457.0 msgs p/sec
14000 msgs for 29969 msec. 467.0 msgs p/sec
15000 msgs for 34969 msec. 428.0 msgs p/sec
16000 msgs for 35844 msec. 446.0 msgs p/sec
17000 msgs for 37703 msec. 450.0 msgs p/sec
18000 msgs for 40907 msec. 440.0 msgs p/sec
19000 msgs for 44532 msec. 426.0 msgs p/sec
20000 msgs for 48282 msec. 414.0 msgs p/sec
21000 msgs for 51797 msec. 405.0 msgs p/sec
22000 msgs for 56235 msec. 391.0 msgs p/sec
23000 msgs for 59985 msec. 383.0 msgs p/sec
24000 msgs for 65578 msec. 365.0 msgs p/sec
25000 msgs for 66485 msec. 376.0 msgs p/sec
26000 msgs for 69172 msec. 375.0 msgs p/sec
27000 msgs for 74172 msec. 364.0 msgs p/sec
28000 msgs for 77516 msec. 361.0 msgs p/sec
29000 msgs for 81594 msec. 355.0 msgs p/sec
30000 msgs for 86891 msec. 345.0 msgs p/sec
rajdavies wrote:
>
>
> I'd recommend looking at the AMQStore documentation -
> http://activemq.apache.org/amq-message-store.html
> parameters to look at increasing would be the indexPageSize and
> particularly the indexBinSize - as I suspect the bottle neck is the
> persistent index.
>
> cheers,
>
> Rob
>
> On 20 Apr 2008, at 19:53, vanyatka wrote:
>
>>
>>
>> Hi, Rob
>>
>> I've been doing some testing with ActiveMQ 5.1, making it receive
>> messages
>> as fast as possible. What I noticed was a steady slow down as the
>> messages
>> kept coming to AMQ. I have to mention here that I intentionally didn't
>> consume messages from the queue (so it kept growing) to see the
>> storage
>> capacity of AMQ.
>>
>> Below are partial results of sending messages over 100MB network using
>> OpenWire to AMQ 5.1 running on FreeBSD.
>>
>> The trend of performance decrease suggests a possible bottleneck in
>> the
>> persistence module (which was Kaha by default). Obviously, I cannot
>> assert
>> this for sure.
>>
>> Even though Kaha is supposed to be the fastest storage mechanism
>> supplied
>> with AMQ, are there any configuration options to fine-tune it for
>> heavy
>> loads?
>>
>> This is a part of the more broad issue "how to make AMQ accept more
>> messages
>> per unit of time, thus reduce number of nodes in a cluster".
>>
>> 1000 msgs for 1516 msec. 659.0 msgs p/sec
>> 2000 msgs for 2579 msec. 775.0 msgs p/sec
>> 3000 msgs for 3657 msec. 820.0 msgs p/sec
>> 4000 msgs for 4735 msec. 844.0 msgs p/sec
>> 5000 msgs for 5875 msec. 851.0 msgs p/sec
>> 6000 msgs for 8032 msec. 747.0 msgs p/sec
>> 7000 msgs for 9110 msec. 768.0 msgs p/sec
>> 8000 msgs for 10204 msec. 784.0 msgs p/sec
>> 9000 msgs for 11360 msec. 792.0 msgs p/sec
>> 10000 msgs for 12454 msec. 802.0 msgs p/sec
>> 11000 msgs for 13579 msec. 810.0 msgs p/sec
>> 12000 msgs for 14688 msec. 816.0 msgs p/sec
>> 13000 msgs for 15875 msec. 818.0 msgs p/sec
>> 14000 msgs for 17282 msec. 810.0 msgs p/sec
>> 15000 msgs for 18500 msec. 810.0 msgs p/sec
>> 16000 msgs for 19735 msec. 810.0 msgs p/sec
>> 17000 msgs for 20922 msec. 812.0 msgs p/sec
>> 18000 msgs for 22172 msec. 811.0 msgs p/sec
>> 19000 msgs for 23391 msec. 812.0 msgs p/sec
>> 20000 msgs for 24750 msec. 808.0 msgs p/sec
>> 21000 msgs for 25954 msec. 809.0 msgs p/sec
>> 22000 msgs for 28125 msec. 782.0 msgs p/sec
>> 23000 msgs for 29282 msec. 785.0 msgs p/sec
>> 24000 msgs for 30750 msec. 780.0 msgs p/sec
>> 25000 msgs for 31969 msec. 782.0 msgs p/sec
>> 26000 msgs for 33172 msec. 783.0 msgs p/sec
>> 27000 msgs for 34454 msec. 783.0 msgs p/sec
>> 28000 msgs for 35875 msec. 780.0 msgs p/sec
>> 29000 msgs for 37235 msec. 778.0 msgs p/sec
>> 30000 msgs for 39875 msec. 752.0 msgs p/sec
>> 31000 msgs for 41250 msec. 751.0 msgs p/sec
>> 32000 msgs for 42547 msec. 752.0 msgs p/sec
>> 33000 msgs for 43813 msec. 753.0 msgs p/sec
>> 34000 msgs for 45297 msec. 750.0 msgs p/sec
>> 35000 msgs for 46610 msec. 750.0 msgs p/sec
>> 36000 msgs for 48329 msec. 744.0 msgs p/sec
>> 37000 msgs for 49672 msec. 744.0 msgs p/sec
>> 38000 msgs for 51000 msec. 745.0 msgs p/sec
>> 39000 msgs for 52688 msec. 740.0 msgs p/sec
>> 40000 msgs for 54422 msec. 734.0 msgs p/sec
>> 41000 msgs for 56047 msec. 731.0 msgs p/sec
>> 42000 msgs for 57391 msec. 731.0 msgs p/sec
>> 43000 msgs for 60719 msec. 708.0 msgs p/sec
>> 44000 msgs for 61907 msec. 710.0 msgs p/sec
>> 45000 msgs for 63422 msec. 709.0 msgs p/sec
>> 46000 msgs for 64766 msec. 710.0 msgs p/sec
>> 47000 msgs for 66360 msec. 708.0 msgs p/sec
>> 48000 msgs for 67813 msec. 707.0 msgs p/sec
>> 49000 msgs for 71563 msec. 684.0 msgs p/sec
>> 50000 msgs for 72750 msec. 687.0 msgs p/sec
>> 51000 msgs for 74204 msec. 687.0 msgs p/sec
>> 52000 msgs for 75704 msec. 686.0 msgs p/sec
>> 53000 msgs for 77266 msec. 685.0 msgs p/sec
>> 54000 msgs for 78563 msec. 687.0 msgs p/sec
>> 55000 msgs for 80125 msec. 686.0 msgs p/sec
>> 56000 msgs for 82016 msec. 682.0 msgs p/sec
>> 57000 msgs for 83500 msec. 682.0 msgs p/sec
>> 58000 msgs for 85047 msec. 681.0 msgs p/sec
>> 59000 msgs for 86516 msec. 681.0 msgs p/sec
>> 60000 msgs for 90422 msec. 663.0 msgs p/sec
>> 61000 msgs for 91641 msec. 665.0 msgs p/sec
>> 62000 msgs for 93032 msec. 666.0 msgs p/sec
>> 63000 msgs for 94579 msec. 666.0 msgs p/sec
>> 64000 msgs for 95782 msec. 668.0 msgs p/sec
>>
>>
>> rajdavies wrote:
>>>
>>>
>>> So long story short - use the default message store (AMQ) in
>>> version 5!
>>>
>>>
>>
>> --
>> View this message in context:
>> http://www.nabble.com/Poort-ActiveMQ-Persistence-Performance-tp12945570s2354p16797097.html
>> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>>
>
>
>
--
View this message in context: http://www.nabble.com/Poort-ActiveMQ-Persistence-Performance-tp12945570s2354p16806479.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.
Re: Poort ActiveMQ Persistence Performance
Posted by vanyatka <ib...@gmail.com>.
Here are more tests with *default* AMQ 5.1 configuration.
The broker URL is BROKER_URL =
tcp://myhost:61616?wireFormat.tcpNoDelayEnabled=true&wireFormat.cacheEnabled=true&wireFormat.cacheSize=4096&wireFormat.tightEncodingEnabled=false
Clearly the performance of persistency store is suffering
1000 msgs for 172 msec. 5813.0 msgs p/sec
2000 msgs for 594 msec. 3367.0 msgs p/sec
3000 msgs for 1156 msec. 2595.0 msgs p/sec
4000 msgs for 1828 msec. 2188.0 msgs p/sec
5000 msgs for 2453 msec. 2038.0 msgs p/sec
6000 msgs for 3016 msec. 1989.0 msgs p/sec
7000 msgs for 3625 msec. 1931.0 msgs p/sec
8000 msgs for 4203 msec. 1903.0 msgs p/sec
9000 msgs for 4813 msec. 1869.0 msgs p/sec
10000 msgs for 5516 msec. 1812.0 msgs p/sec
11000 msgs for 6110 msec. 1800.0 msgs p/sec
12000 msgs for 6719 msec. 1785.0 msgs p/sec
13000 msgs for 7469 msec. 1740.0 msgs p/sec
14000 msgs for 8172 msec. 1713.0 msgs p/sec
15000 msgs for 8875 msec. 1690.0 msgs p/sec
16000 msgs for 9547 msec. 1675.0 msgs p/sec
17000 msgs for 10281 msec. 1653.0 msgs p/sec
18000 msgs for 11016 msec. 1633.0 msgs p/sec
19000 msgs for 11781 msec. 1612.0 msgs p/sec
20000 msgs for 12563 msec. 1591.0 msgs p/sec
21000 msgs for 13313 msec. 1577.0 msgs p/sec
22000 msgs for 14063 msec. 1564.0 msgs p/sec
23000 msgs for 14828 msec. 1551.0 msgs p/sec
24000 msgs for 15391 msec. 1559.0 msgs p/sec
25000 msgs for 17047 msec. 1466.0 msgs p/sec
26000 msgs for 17813 msec. 1459.0 msgs p/sec
27000 msgs for 18594 msec. 1452.0 msgs p/sec
28000 msgs for 19422 msec. 1441.0 msgs p/sec
29000 msgs for 20188 msec. 1436.0 msgs p/sec
30000 msgs for 21031 msec. 1426.0 msgs p/sec
31000 msgs for 21938 msec. 1413.0 msgs p/sec
32000 msgs for 22781 msec. 1404.0 msgs p/sec
33000 msgs for 23594 msec. 1398.0 msgs p/sec
34000 msgs for 24516 msec. 1386.0 msgs p/sec
35000 msgs for 25500 msec. 1372.0 msgs p/sec
36000 msgs for 26344 msec. 1366.0 msgs p/sec
37000 msgs for 27219 msec. 1359.0 msgs p/sec
38000 msgs for 28188 msec. 1348.0 msgs p/sec
39000 msgs for 29125 msec. 1339.0 msgs p/sec
40000 msgs for 30078 msec. 1329.0 msgs p/sec
41000 msgs for 30985 msec. 1323.0 msgs p/sec
42000 msgs for 31953 msec. 1314.0 msgs p/sec
43000 msgs for 32922 msec. 1306.0 msgs p/sec
44000 msgs for 33891 msec. 1298.0 msgs p/sec
45000 msgs for 34844 msec. 1291.0 msgs p/sec
46000 msgs for 35891 msec. 1281.0 msgs p/sec
47000 msgs for 36735 msec. 1279.0 msgs p/sec
48000 msgs for 37766 msec. 1270.0 msgs p/sec
49000 msgs for 38735 msec. 1265.0 msgs p/sec
50000 msgs for 39797 msec. 1256.0 msgs p/sec
51000 msgs for 40797 msec. 1250.0 msgs p/sec
52000 msgs for 41813 msec. 1243.0 msgs p/sec
53000 msgs for 42922 msec. 1234.0 msgs p/sec
54000 msgs for 43985 msec. 1227.0 msgs p/sec
55000 msgs for 44985 msec. 1222.0 msgs p/sec
56000 msgs for 46125 msec. 1214.0 msgs p/sec
57000 msgs for 47188 msec. 1207.0 msgs p/sec
58000 msgs for 48844 msec. 1187.0 msgs p/sec
59000 msgs for 50000 msec. 1180.0 msgs p/sec
60000 msgs for 51016 msec. 1176.0 msgs p/sec
61000 msgs for 52188 msec. 1168.0 msgs p/sec
62000 msgs for 53219 msec. 1164.0 msgs p/sec
63000 msgs for 54453 msec. 1156.0 msgs p/sec
64000 msgs for 55656 msec. 1149.0 msgs p/sec
65000 msgs for 56797 msec. 1144.0 msgs p/sec
66000 msgs for 57922 msec. 1139.0 msgs p/sec
67000 msgs for 59110 msec. 1133.0 msgs p/sec
68000 msgs for 60328 msec. 1127.0 msgs p/sec
69000 msgs for 61485 msec. 1122.0 msgs p/sec
70000 msgs for 62672 msec. 1116.0 msgs p/sec
71000 msgs for 63875 msec. 1111.0 msgs p/sec
72000 msgs for 65110 msec. 1105.0 msgs p/sec
73000 msgs for 66297 msec. 1101.0 msgs p/sec
74000 msgs for 67531 msec. 1095.0 msgs p/sec
75000 msgs for 68922 msec. 1088.0 msgs p/sec
76000 msgs for 70125 msec. 1083.0 msgs p/sec
77000 msgs for 71391 msec. 1078.0 msgs p/sec
78000 msgs for 72578 msec. 1074.0 msgs p/sec
79000 msgs for 73906 msec. 1068.0 msgs p/sec
80000 msgs for 75219 msec. 1063.0 msgs p/sec
81000 msgs for 76547 msec. 1058.0 msgs p/sec
82000 msgs for 77875 msec. 1052.0 msgs p/sec
83000 msgs for 79938 msec. 1038.0 msgs p/sec
84000 msgs for 81172 msec. 1034.0 msgs p/sec
85000 msgs for 82516 msec. 1030.0 msgs p/sec
86000 msgs for 83953 msec. 1024.0 msgs p/sec
87000 msgs for 85328 msec. 1019.0 msgs p/sec
88000 msgs for 86625 msec. 1015.0 msgs p/sec
89000 msgs for 88047 msec. 1010.0 msgs p/sec
90000 msgs for 89391 msec. 1006.0 msgs p/sec
91000 msgs for 90860 msec. 1001.0 msgs p/sec
92000 msgs for 92281 msec. 996.0 msgs p/sec
93000 msgs for 93672 msec. 992.0 msgs p/sec
94000 msgs for 95047 msec. 988.0 msgs p/sec
95000 msgs for 96516 msec. 984.0 msgs p/sec
96000 msgs for 97922 msec. 980.0 msgs p/sec
97000 msgs for 99406 msec. 975.0 msgs p/sec
98000 msgs for 101063 msec. 969.0 msgs p/sec
99000 msgs for 102453 msec. 966.0 msgs p/sec
100000 msgs for 105360 msec. 949.0 msgs p/sec
finished = Tue Apr 22 23:19:59 MSD 2008. Total test time: 105.36 sec
3 users
Load 1.06 0.71 0.37
Going to send 100000 messages ...
Test started at = Tue Apr 22 23:20:36 MSD 2008
1000 msgs for 234 msec. 4273.0 msgs p/sec
2000 msgs for 1703 msec. 1174.0 msgs p/sec
3000 msgs for 3172 msec. 945.0 msgs p/sec
4000 msgs for 4594 msec. 870.0 msgs p/sec
5000 msgs for 6172 msec. 810.0 msgs p/sec
6000 msgs for 7750 msec. 774.0 msgs p/sec
7000 msgs for 9281 msec. 754.0 msgs p/sec
8000 msgs for 10719 msec. 746.0 msgs p/sec
9000 msgs for 12281 msec. 732.0 msgs p/sec
10000 msgs for 13875 msec. 720.0 msgs p/sec
11000 msgs for 15500 msec. 709.0 msgs p/sec
12000 msgs for 16984 msec. 706.0 msgs p/sec
13000 msgs for 18562 msec. 700.0 msgs p/sec
14000 msgs for 20140 msec. 695.0 msgs p/sec
15000 msgs for 21719 msec. 690.0 msgs p/sec
16000 msgs for 23484 msec. 681.0 msgs p/sec
17000 msgs for 25078 msec. 677.0 msgs p/sec
18000 msgs for 26703 msec. 674.0 msgs p/sec
19000 msgs for 28328 msec. 670.0 msgs p/sec
20000 msgs for 30109 msec. 664.0 msgs p/sec
21000 msgs for 32453 msec. 647.0 msgs p/sec
22000 msgs for 34156 msec. 644.0 msgs p/sec
23000 msgs for 35797 msec. 642.0 msgs p/sec
24000 msgs for 37515 msec. 639.0 msgs p/sec
25000 msgs for 39297 msec. 636.0 msgs p/sec
26000 msgs for 41078 msec. 632.0 msgs p/sec
27000 msgs for 42703 msec. 632.0 msgs p/sec
28000 msgs for 44562 msec. 628.0 msgs p/sec
29000 msgs for 46406 msec. 624.0 msgs p/sec
30000 msgs for 48156 msec. 622.0 msgs p/sec
31000 msgs for 50047 msec. 619.0 msgs p/sec
32000 msgs for 51890 msec. 616.0 msgs p/sec
33000 msgs for 53703 msec. 614.0 msgs p/sec
34000 msgs for 55640 msec. 611.0 msgs p/sec
35000 msgs for 57469 msec. 609.0 msgs p/sec
36000 msgs for 59297 msec. 607.0 msgs p/sec
37000 msgs for 61344 msec. 603.0 msgs p/sec
38000 msgs for 64531 msec. 588.0 msgs p/sec
39000 msgs for 66312 msec. 588.0 msgs p/sec
40000 msgs for 68437 msec. 584.0 msgs p/sec
41000 msgs for 70328 msec. 582.0 msgs p/sec
42000 msgs for 72297 msec. 580.0 msgs p/sec
43000 msgs for 74234 msec. 579.0 msgs p/sec
44000 msgs for 76281 msec. 576.0 msgs p/sec
45000 msgs for 78219 msec. 575.0 msgs p/sec
46000 msgs for 80359 msec. 572.0 msgs p/sec
47000 msgs for 82437 msec. 570.0 msgs p/sec
48000 msgs for 84844 msec. 565.0 msgs p/sec
49000 msgs for 86734 msec. 564.0 msgs p/sec
50000 msgs for 89172 msec. 560.0 msgs p/sec
51000 msgs for 91250 msec. 558.0 msgs p/sec
52000 msgs for 95344 msec. 545.0 msgs p/sec
53000 msgs for 97234 msec. 545.0 msgs p/sec
54000 msgs for 99156 msec. 544.0 msgs p/sec
55000 msgs for 101203 msec. 543.0 msgs p/sec
56000 msgs for 103234 msec. 542.0 msgs p/sec
57000 msgs for 105453 msec. 540.0 msgs p/sec
58000 msgs for 107531 msec. 539.0 msgs p/sec
59000 msgs for 109765 msec. 537.0 msgs p/sec
60000 msgs for 111922 msec. 536.0 msgs p/sec
61000 msgs for 114015 msec. 535.0 msgs p/sec
62000 msgs for 116203 msec. 533.0 msgs p/sec
63000 msgs for 118390 msec. 532.0 msgs p/sec
64000 msgs for 119969 msec. 533.0 msgs p/sec
65000 msgs for 122344 msec. 531.0 msgs p/sec
66000 msgs for 124265 msec. 531.0 msgs p/sec
67000 msgs for 128453 msec. 521.0 msgs p/sec
68000 msgs for 130484 msec. 521.0 msgs p/sec
69000 msgs for 132422 msec. 521.0 msgs p/sec
70000 msgs for 134359 msec. 520.0 msgs p/sec
71000 msgs for 136422 msec. 520.0 msgs p/sec
72000 msgs for 138359 msec. 520.0 msgs p/sec
73000 msgs for 140437 msec. 519.0 msgs p/sec
74000 msgs for 142390 msec. 519.0 msgs p/sec
75000 msgs for 144469 msec. 519.0 msgs p/sec
76000 msgs for 146531 msec. 518.0 msgs p/sec
77000 msgs for 148484 msec. 518.0 msgs p/sec
78000 msgs for 150578 msec. 518.0 msgs p/sec
79000 msgs for 152719 msec. 517.0 msgs p/sec
80000 msgs for 154797 msec. 516.0 msgs p/sec
81000 msgs for 156890 msec. 516.0 msgs p/sec
82000 msgs for 161062 msec. 509.0 msgs p/sec
83000 msgs for 163156 msec. 508.0 msgs p/sec
84000 msgs for 165265 msec. 508.0 msgs p/sec
85000 msgs for 167344 msec. 507.0 msgs p/sec
86000 msgs for 169453 msec. 507.0 msgs p/sec
87000 msgs for 171578 msec. 507.0 msgs p/sec
88000 msgs for 173812 msec. 506.0 msgs p/sec
89000 msgs for 175937 msec. 505.0 msgs p/sec
90000 msgs for 178078 msec. 505.0 msgs p/sec
91000 msgs for 180203 msec. 504.0 msgs p/sec
92000 msgs for 182437 msec. 504.0 msgs p/sec
93000 msgs for 184578 msec. 503.0 msgs p/sec
94000 msgs for 186828 msec. 503.0 msgs p/sec
95000 msgs for 188984 msec. 502.0 msgs p/sec
96000 msgs for 193234 msec. 496.0 msgs p/sec
97000 msgs for 195500 msec. 496.0 msgs p/sec
98000 msgs for 197750 msec. 495.0 msgs p/sec
99000 msgs for 199906 msec. 495.0 msgs p/sec
100000 msgs for 204281 msec. 489.0 msgs p/sec
--
View this message in context: http://www.nabble.com/Poort-ActiveMQ-Persistence-Performance-tp12945570s2354p16825636.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.
Re: Poort ActiveMQ Persistence Performance
Posted by Rob Davies <ra...@gmail.com>.
I'd recommend looking at the AMQStore documentation - http://activemq.apache.org/amq-message-store.html
parameters to look at increasing would be the indexPageSize and
particularly the indexBinSize - as I suspect the bottle neck is the
persistent index.
cheers,
Rob
On 20 Apr 2008, at 19:53, vanyatka wrote:
>
>
> Hi, Rob
>
> I've been doing some testing with ActiveMQ 5.1, making it receive
> messages
> as fast as possible. What I noticed was a steady slow down as the
> messages
> kept coming to AMQ. I have to mention here that I intentionally didn't
> consume messages from the queue (so it kept growing) to see the
> storage
> capacity of AMQ.
>
> Below are partial results of sending messages over 100MB network using
> OpenWire to AMQ 5.1 running on FreeBSD.
>
> The trend of performance decrease suggests a possible bottleneck in
> the
> persistence module (which was Kaha by default). Obviously, I cannot
> assert
> this for sure.
>
> Even though Kaha is supposed to be the fastest storage mechanism
> supplied
> with AMQ, are there any configuration options to fine-tune it for
> heavy
> loads?
>
> This is a part of the more broad issue "how to make AMQ accept more
> messages
> per unit of time, thus reduce number of nodes in a cluster".
>
> 1000 msgs for 1516 msec. 659.0 msgs p/sec
> 2000 msgs for 2579 msec. 775.0 msgs p/sec
> 3000 msgs for 3657 msec. 820.0 msgs p/sec
> 4000 msgs for 4735 msec. 844.0 msgs p/sec
> 5000 msgs for 5875 msec. 851.0 msgs p/sec
> 6000 msgs for 8032 msec. 747.0 msgs p/sec
> 7000 msgs for 9110 msec. 768.0 msgs p/sec
> 8000 msgs for 10204 msec. 784.0 msgs p/sec
> 9000 msgs for 11360 msec. 792.0 msgs p/sec
> 10000 msgs for 12454 msec. 802.0 msgs p/sec
> 11000 msgs for 13579 msec. 810.0 msgs p/sec
> 12000 msgs for 14688 msec. 816.0 msgs p/sec
> 13000 msgs for 15875 msec. 818.0 msgs p/sec
> 14000 msgs for 17282 msec. 810.0 msgs p/sec
> 15000 msgs for 18500 msec. 810.0 msgs p/sec
> 16000 msgs for 19735 msec. 810.0 msgs p/sec
> 17000 msgs for 20922 msec. 812.0 msgs p/sec
> 18000 msgs for 22172 msec. 811.0 msgs p/sec
> 19000 msgs for 23391 msec. 812.0 msgs p/sec
> 20000 msgs for 24750 msec. 808.0 msgs p/sec
> 21000 msgs for 25954 msec. 809.0 msgs p/sec
> 22000 msgs for 28125 msec. 782.0 msgs p/sec
> 23000 msgs for 29282 msec. 785.0 msgs p/sec
> 24000 msgs for 30750 msec. 780.0 msgs p/sec
> 25000 msgs for 31969 msec. 782.0 msgs p/sec
> 26000 msgs for 33172 msec. 783.0 msgs p/sec
> 27000 msgs for 34454 msec. 783.0 msgs p/sec
> 28000 msgs for 35875 msec. 780.0 msgs p/sec
> 29000 msgs for 37235 msec. 778.0 msgs p/sec
> 30000 msgs for 39875 msec. 752.0 msgs p/sec
> 31000 msgs for 41250 msec. 751.0 msgs p/sec
> 32000 msgs for 42547 msec. 752.0 msgs p/sec
> 33000 msgs for 43813 msec. 753.0 msgs p/sec
> 34000 msgs for 45297 msec. 750.0 msgs p/sec
> 35000 msgs for 46610 msec. 750.0 msgs p/sec
> 36000 msgs for 48329 msec. 744.0 msgs p/sec
> 37000 msgs for 49672 msec. 744.0 msgs p/sec
> 38000 msgs for 51000 msec. 745.0 msgs p/sec
> 39000 msgs for 52688 msec. 740.0 msgs p/sec
> 40000 msgs for 54422 msec. 734.0 msgs p/sec
> 41000 msgs for 56047 msec. 731.0 msgs p/sec
> 42000 msgs for 57391 msec. 731.0 msgs p/sec
> 43000 msgs for 60719 msec. 708.0 msgs p/sec
> 44000 msgs for 61907 msec. 710.0 msgs p/sec
> 45000 msgs for 63422 msec. 709.0 msgs p/sec
> 46000 msgs for 64766 msec. 710.0 msgs p/sec
> 47000 msgs for 66360 msec. 708.0 msgs p/sec
> 48000 msgs for 67813 msec. 707.0 msgs p/sec
> 49000 msgs for 71563 msec. 684.0 msgs p/sec
> 50000 msgs for 72750 msec. 687.0 msgs p/sec
> 51000 msgs for 74204 msec. 687.0 msgs p/sec
> 52000 msgs for 75704 msec. 686.0 msgs p/sec
> 53000 msgs for 77266 msec. 685.0 msgs p/sec
> 54000 msgs for 78563 msec. 687.0 msgs p/sec
> 55000 msgs for 80125 msec. 686.0 msgs p/sec
> 56000 msgs for 82016 msec. 682.0 msgs p/sec
> 57000 msgs for 83500 msec. 682.0 msgs p/sec
> 58000 msgs for 85047 msec. 681.0 msgs p/sec
> 59000 msgs for 86516 msec. 681.0 msgs p/sec
> 60000 msgs for 90422 msec. 663.0 msgs p/sec
> 61000 msgs for 91641 msec. 665.0 msgs p/sec
> 62000 msgs for 93032 msec. 666.0 msgs p/sec
> 63000 msgs for 94579 msec. 666.0 msgs p/sec
> 64000 msgs for 95782 msec. 668.0 msgs p/sec
>
>
> rajdavies wrote:
>>
>>
>> So long story short - use the default message store (AMQ) in
>> version 5!
>>
>>
>
> --
> View this message in context: http://www.nabble.com/Poort-ActiveMQ-Persistence-Performance-tp12945570s2354p16797097.html
> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>