You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@activemq.apache.org by "H B (JIRA)" <ji...@apache.org> on 2009/02/21 22:52:59 UTC

[jira] Created: (AMQ-2136) Reply queue performance hit upgrading to 5.2

Reply queue performance hit upgrading to 5.2
--------------------------------------------

                 Key: AMQ-2136
                 URL: https://issues.apache.org/activemq/browse/AMQ-2136
             Project: ActiveMQ
          Issue Type: Bug
          Components: Performance Test
    Affects Versions: 5.2.0
         Environment: Windows Vista, JDK 1.6
            Reporter: H B
            Priority: Critical


When upgrading to AMQ 5.2, my application gets 10x slower. This is traced to the usage of reply queue. I have written a test case (will be attached.)

In 5.1,
sender: 16.0 seconds spent for sending 8000 times, avg. 500.0msg/s

In 5.2:
sender: 432.0 seconds spent for sending 10000 times, avg. 23.148148msg/s

I have tried arrange the steps a bit (see commented out line,) no help.


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (AMQ-2136) Reply queue performance hit upgrading to 5.2

Posted by "H B (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/activemq/browse/AMQ-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=49861#action_49861 ] 

H B commented on AMQ-2136:
--------------------------

OK, I found out the direct cause. The default amqPersistence store somehow slows to a hell.

After I change the persistence adaptor to

        <persistenceAdapter>
	    <kahaPersistenceAdapter directory="activemq-data" maxDataFileLength="33554432"/>
            <!--amqPersistenceAdapter syncOnWrite="false" directory="${activemq.base}/data" maxFileLength="20 mb"/-->
        </persistenceAdapter>

The performance number goes up to the roof -- 1000 msg/s.

cleaning out the old data/ directory content wouldn't help the poor amq persistence store either.

> Reply queue performance hit upgrading to 5.2
> --------------------------------------------
>
>                 Key: AMQ-2136
>                 URL: https://issues.apache.org/activemq/browse/AMQ-2136
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Performance Test
>    Affects Versions: 5.2.0
>         Environment: Windows Vista, JDK 1.6
>            Reporter: H B
>            Priority: Critical
>         Attachments: test.java
>
>
> When upgrading to AMQ 5.2, my application gets 10x slower. This is traced to the usage of reply queue. I have written a test case (will be attached.)
> In 5.1,
> sender: 16.0 seconds spent for sending 8000 times, avg. 500.0msg/s
> In 5.2:
> sender: 432.0 seconds spent for sending 10000 times, avg. 23.148148msg/s
> I have tried arrange the steps a bit (see commented out line,) no help.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (AMQ-2136) Reply queue performance hit upgrading to 5.2

Posted by "Rob Davies (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/activemq/browse/AMQ-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rob Davies resolved AMQ-2136.
-----------------------------

       Resolution: Fixed
    Fix Version/s:     (was: 5.4.0)
                   5.3.0
         Assignee: Rob Davies

Ran test case against 5.3 - got throughput of 615.38464msg/s

> Reply queue performance hit upgrading to 5.2
> --------------------------------------------
>
>                 Key: AMQ-2136
>                 URL: https://issues.apache.org/activemq/browse/AMQ-2136
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Performance Test
>    Affects Versions: 5.2.0
>         Environment: Windows Vista, JDK 1.6
>            Reporter: H B
>            Assignee: Rob Davies
>            Priority: Critical
>             Fix For: 5.3.0
>
>         Attachments: test.java
>
>
> When upgrading to AMQ 5.2, my application gets 10x slower. This is traced to the usage of reply queue. I have written a test case (will be attached.)
> In 5.1,
> sender: 16.0 seconds spent for sending 8000 times, avg. 500.0msg/s
> In 5.2:
> sender: 432.0 seconds spent for sending 10000 times, avg. 23.148148msg/s
> I have tried arrange the steps a bit (see commented out line,) no help.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (AMQ-2136) Reply queue performance hit upgrading to 5.2

Posted by "H B (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/activemq/browse/AMQ-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=49860#action_49860 ] 

H B commented on AMQ-2136:
--------------------------

BTW it seems the problem is with transacted and CLIENT_ACK. With non-transacted session, it gets to 500 msg/s. But I don't understand why.


> Reply queue performance hit upgrading to 5.2
> --------------------------------------------
>
>                 Key: AMQ-2136
>                 URL: https://issues.apache.org/activemq/browse/AMQ-2136
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Performance Test
>    Affects Versions: 5.2.0
>         Environment: Windows Vista, JDK 1.6
>            Reporter: H B
>            Priority: Critical
>         Attachments: test.java
>
>
> When upgrading to AMQ 5.2, my application gets 10x slower. This is traced to the usage of reply queue. I have written a test case (will be attached.)
> In 5.1,
> sender: 16.0 seconds spent for sending 8000 times, avg. 500.0msg/s
> In 5.2:
> sender: 432.0 seconds spent for sending 10000 times, avg. 23.148148msg/s
> I have tried arrange the steps a bit (see commented out line,) no help.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (AMQ-2136) Reply queue performance hit upgrading to 5.2

Posted by "H B (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/activemq/browse/AMQ-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=50883#action_50883 ] 

H B commented on AMQ-2136:
--------------------------

Any comment and feedback on this bug?

> Reply queue performance hit upgrading to 5.2
> --------------------------------------------
>
>                 Key: AMQ-2136
>                 URL: https://issues.apache.org/activemq/browse/AMQ-2136
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Performance Test
>    Affects Versions: 5.2.0
>         Environment: Windows Vista, JDK 1.6
>            Reporter: H B
>            Priority: Critical
>         Attachments: test.java
>
>
> When upgrading to AMQ 5.2, my application gets 10x slower. This is traced to the usage of reply queue. I have written a test case (will be attached.)
> In 5.1,
> sender: 16.0 seconds spent for sending 8000 times, avg. 500.0msg/s
> In 5.2:
> sender: 432.0 seconds spent for sending 10000 times, avg. 23.148148msg/s
> I have tried arrange the steps a bit (see commented out line,) no help.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (AMQ-2136) Reply queue performance hit upgrading to 5.2

Posted by "H B (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/activemq/browse/AMQ-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

H B updated AMQ-2136:
---------------------

    Attachment: test.java

Note: two classes in the file

> Reply queue performance hit upgrading to 5.2
> --------------------------------------------
>
>                 Key: AMQ-2136
>                 URL: https://issues.apache.org/activemq/browse/AMQ-2136
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Performance Test
>    Affects Versions: 5.2.0
>         Environment: Windows Vista, JDK 1.6
>            Reporter: H B
>            Priority: Critical
>         Attachments: test.java
>
>
> When upgrading to AMQ 5.2, my application gets 10x slower. This is traced to the usage of reply queue. I have written a test case (will be attached.)
> In 5.1,
> sender: 16.0 seconds spent for sending 8000 times, avg. 500.0msg/s
> In 5.2:
> sender: 432.0 seconds spent for sending 10000 times, avg. 23.148148msg/s
> I have tried arrange the steps a bit (see commented out line,) no help.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (AMQ-2136) Reply queue performance hit upgrading to 5.2

Posted by "Rob Davies (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/activemq/browse/AMQ-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rob Davies updated AMQ-2136:
----------------------------

    Fix Version/s: 5.4.0

> Reply queue performance hit upgrading to 5.2
> --------------------------------------------
>
>                 Key: AMQ-2136
>                 URL: https://issues.apache.org/activemq/browse/AMQ-2136
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Performance Test
>    Affects Versions: 5.2.0
>         Environment: Windows Vista, JDK 1.6
>            Reporter: H B
>            Priority: Critical
>             Fix For: 5.4.0
>
>         Attachments: test.java
>
>
> When upgrading to AMQ 5.2, my application gets 10x slower. This is traced to the usage of reply queue. I have written a test case (will be attached.)
> In 5.1,
> sender: 16.0 seconds spent for sending 8000 times, avg. 500.0msg/s
> In 5.2:
> sender: 432.0 seconds spent for sending 10000 times, avg. 23.148148msg/s
> I have tried arrange the steps a bit (see commented out line,) no help.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (AMQ-2136) Reply queue performance hit upgrading to 5.2

Posted by "H B (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/activemq/browse/AMQ-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=49929#action_49929 ] 

H B commented on AMQ-2136:
--------------------------

Transaction is needed if several messages are sent together. 

But why does the Kaha store (w/ 5.2) work much faster? In any case, 23 msg/s in transact mode seems too slow.  A database can beat it easily.




> Reply queue performance hit upgrading to 5.2
> --------------------------------------------
>
>                 Key: AMQ-2136
>                 URL: https://issues.apache.org/activemq/browse/AMQ-2136
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Performance Test
>    Affects Versions: 5.2.0
>         Environment: Windows Vista, JDK 1.6
>            Reporter: H B
>            Priority: Critical
>         Attachments: test.java
>
>
> When upgrading to AMQ 5.2, my application gets 10x slower. This is traced to the usage of reply queue. I have written a test case (will be attached.)
> In 5.1,
> sender: 16.0 seconds spent for sending 8000 times, avg. 500.0msg/s
> In 5.2:
> sender: 432.0 seconds spent for sending 10000 times, avg. 23.148148msg/s
> I have tried arrange the steps a bit (see commented out line,) no help.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (AMQ-2136) Reply queue performance hit upgrading to 5.2

Posted by "Gary Tully (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/activemq/browse/AMQ-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=49883#action_49883 ] 

Gary Tully commented on AMQ-2136:
---------------------------------

use of a transaction has an impact because a transaction boundary needs to be accompanied with a disk write and disk sync. 5.1 did not honor the need to do a disk sync on a transaction boundary and hence it is faster in this regard. 5.2 does the right thing.
Transactions will help if you do batch updates, but the overhead of transaction demarcation is noticeable when there is a a small amount of activity (like one message send or consume) in the transaction.

> Reply queue performance hit upgrading to 5.2
> --------------------------------------------
>
>                 Key: AMQ-2136
>                 URL: https://issues.apache.org/activemq/browse/AMQ-2136
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Performance Test
>    Affects Versions: 5.2.0
>         Environment: Windows Vista, JDK 1.6
>            Reporter: H B
>            Priority: Critical
>         Attachments: test.java
>
>
> When upgrading to AMQ 5.2, my application gets 10x slower. This is traced to the usage of reply queue. I have written a test case (will be attached.)
> In 5.1,
> sender: 16.0 seconds spent for sending 8000 times, avg. 500.0msg/s
> In 5.2:
> sender: 432.0 seconds spent for sending 10000 times, avg. 23.148148msg/s
> I have tried arrange the steps a bit (see commented out line,) no help.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (AMQ-2136) Reply queue performance hit upgrading to 5.2

Posted by "Thomas Schöftner (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/activemq/browse/AMQ-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=50894#action_50894 ] 

Thomas Schöftner commented on AMQ-2136:
---------------------------------------

I have a similar performance problem using ActiveMQ via Spring 2.5.6.
Due to performance issues, I created a load-test for evaluation of the messaging performance:

The test basically sends 1000 messages which are later retrieved by 100 simultaneous consumers.
Each consumer waits 1 sec before returning the acknowledgement - every 10th consumer waits 10 secs.

Theoretically, all messges should be successfully handled in ~20secs.
With ActiveMQ 5.1, it takes ~50secs, but with 5.2 it's even slower (90secs).

This is strange because the server and consumer configuration has not changed.
Switching from AmqPersistance to KahaPersistance has no effect either.
BTW, currently there is no TransactionManager used.

Any ideas where to start looking? - Thx.


> Reply queue performance hit upgrading to 5.2
> --------------------------------------------
>
>                 Key: AMQ-2136
>                 URL: https://issues.apache.org/activemq/browse/AMQ-2136
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Performance Test
>    Affects Versions: 5.2.0
>         Environment: Windows Vista, JDK 1.6
>            Reporter: H B
>            Priority: Critical
>         Attachments: test.java
>
>
> When upgrading to AMQ 5.2, my application gets 10x slower. This is traced to the usage of reply queue. I have written a test case (will be attached.)
> In 5.1,
> sender: 16.0 seconds spent for sending 8000 times, avg. 500.0msg/s
> In 5.2:
> sender: 432.0 seconds spent for sending 10000 times, avg. 23.148148msg/s
> I have tried arrange the steps a bit (see commented out line,) no help.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.