You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@activemq.apache.org by "armgong (JIRA)" <ji...@apache.org> on 2008/06/03 15:10:00 UTC

[jira] Created: (AMQ-1764) strange slower consumer and borker problem,make slow consumer application and broker memory grow very fast

strange slower consumer and borker problem,make slow consumer application and broker memory grow very fast
----------------------------------------------------------------------------------------------------------

                 Key: AMQ-1764
                 URL: https://issues.apache.org/activemq/browse/AMQ-1764
             Project: ActiveMQ
          Issue Type: Bug
          Components: Broker
    Affects Versions: 5.1.0
         Environment: win2003sp2 , activemq 5.10 ,jdk6.0update6
            Reporter: armgong
         Attachments: test.zip

I write a fast producer(produce a message take 1 ms) and a slow consumer(consumer a message take 10 seconds) application,and config standalone activemq through activemq.xml,in the activemq.xml I config constantPendingMessageLimitStrategy limit="10",and in the slow consumer i config connection url is "tcp://127.0.0.1:61616?jms.prefetchPolicy.queuePrefetch=50".
 but the strange problem happends when i want send 200k 512 bytes size messages to borker through fast producer. 
when producer send  messages start,the borker and the slow consumer memory useage grow very fast,after send 120k messages, the slow consumer take 80MB memory from at application start 18MB memory,and borker take 140MB memory, then borker slowing down,and totaly freeze.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (AMQ-1764) strange slower consumer and borker problem,make slow consumer application and broker memory grow very fast

Posted by "armgong (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/activemq/browse/AMQ-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

armgong updated AMQ-1764:
-------------------------

    Attachment:     (was: test.zip)

> strange slower consumer and borker problem,make slow consumer application and broker memory grow very fast
> ----------------------------------------------------------------------------------------------------------
>
>                 Key: AMQ-1764
>                 URL: https://issues.apache.org/activemq/browse/AMQ-1764
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Broker
>    Affects Versions: 5.1.0
>         Environment: win2003sp2 , activemq 5.10 ,jdk6.0update6
>            Reporter: armgong
>
> I write a fast producer(produce a message take 1 ms) and a slow consumer(consumer a message take 10 seconds) application,and config standalone activemq through activemq.xml,in the activemq.xml I config constantPendingMessageLimitStrategy limit="10",and in the slow consumer i config connection url is "tcp://127.0.0.1:61616?jms.prefetchPolicy.queuePrefetch=50".
>  but the strange problem happends when i want send 200k 512 bytes size messages to borker through fast producer. 
> when producer send  messages start,the borker and the slow consumer memory useage grow very fast,after send 120k messages, the slow consumer take 80MB memory from at application start 18MB memory,and borker take 140MB memory, then borker slowing down,and totaly freeze.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Issue Comment Edited: (AMQ-1764) strange slower consumer and borker problem,make slow consumer application and broker memory grow very fast

Posted by "armgong (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/activemq/browse/AMQ-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=43188#action_43188 ] 

armgong edited comment on AMQ-1764 at 6/4/08 5:44 PM:
------------------------------------------------------

it seems https://issues.apache.org/activemq/browse/AMQ-1136

btw the attach file is includes the activemq config file activemq.xml and producer (in producer dir )and slow consumer application (in slow dir). the two applications user none_durable topic "chatTopic.chatMessage"
if configured in activemq as following :
<destinations>         
         <topic physicalName="chatTopic.chatMessage" />
       </destinations>
        <!-- Destination specific policies using destination names or wildcards -->
        <destinationPolicy>
            <policyMap>
                <policyEntries>
                    <policyEntry queue=">" memoryLimit="20mb"/>
                    <policyEntry topic="chatTopic.chatMessage" memoryLimit="64mb">
                        <dispatchPolicy>
                            <strictOrderDispatchPolicy/>
                        </dispatchPolicy>
                        <subscriptionRecoveryPolicy>
                            <lastImageSubscriptionRecoveryPolicy/>
                        </subscriptionRecoveryPolicy>
                       <!--slow consumer policy-->
                       <pendingMessageLimitStrategy>   
                          <constantPendingMessageLimitStrategy limit="10"/>   
                       </pendingMessageLimitStrategy>  
                    </policyEntry>
                </policyEntries>
            </policyMap>
        </destinationPolicy>

      was (Author: armgong):
    btw the attach file is includes the activemq config file activemq.xml and producer (in producer dir )and slow consumer application (in slow dir). the two applications user none_durable topic "chatTopic.chatMessage"
if configured in activemq as following :
<destinations>         
         <topic physicalName="chatTopic.chatMessage" />
       </destinations>
        <!-- Destination specific policies using destination names or wildcards -->
        <destinationPolicy>
            <policyMap>
                <policyEntries>
                    <policyEntry queue=">" memoryLimit="20mb"/>
                    <policyEntry topic="chatTopic.chatMessage" memoryLimit="64mb">
                        <dispatchPolicy>
                            <strictOrderDispatchPolicy/>
                        </dispatchPolicy>
                        <subscriptionRecoveryPolicy>
                            <lastImageSubscriptionRecoveryPolicy/>
                        </subscriptionRecoveryPolicy>
                       <!--slow consumer policy-->
                       <pendingMessageLimitStrategy>   
                          <constantPendingMessageLimitStrategy limit="10"/>   
                       </pendingMessageLimitStrategy>  
                    </policyEntry>
                </policyEntries>
            </policyMap>
        </destinationPolicy>
  
> strange slower consumer and borker problem,make slow consumer application and broker memory grow very fast
> ----------------------------------------------------------------------------------------------------------
>
>                 Key: AMQ-1764
>                 URL: https://issues.apache.org/activemq/browse/AMQ-1764
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Broker
>    Affects Versions: 5.1.0
>         Environment: win2003sp2 , activemq 5.10 ,jdk6.0update6
>            Reporter: armgong
>         Attachments: test.zip
>
>
> I write a fast producer(produce a message take 1 ms) and a slow consumer(consumer a message take 10 seconds) application,and config standalone activemq through activemq.xml,in the activemq.xml I config constantPendingMessageLimitStrategy limit="10",and in the slow consumer i config connection url is "tcp://127.0.0.1:61616?jms.prefetchPolicy.queuePrefetch=50".
>  but the strange problem happends when i want send 200k 512 bytes size messages to borker through fast producer. 
> when producer send  messages start,the borker and the slow consumer memory useage grow very fast,after send 120k messages, the slow consumer take 80MB memory from at application start 18MB memory,and borker take 140MB memory, then borker slowing down,and totaly freeze.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (AMQ-1764) strange slower consumer and borker problem,make slow consumer application and broker memory grow very fast

Posted by "armgong (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/activemq/browse/AMQ-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

armgong updated AMQ-1764:
-------------------------

    Attachment: test.zip

oh, i make a mistak in slow consumer application,make wrong url
"tcp://127.0.0.1:61616?jms.prefetchPolicy.queuePrefetch=50"
now i change it to 
"tcp://127.0.0.1:61616?jms.prefetchPolicy.topicPrefetch=50"
run test again ,prolem still happened
and  also try change it to
"tcp://127.0.0.1:61616?jms.prefetchPolicy.all=50"
run test again ,prolem still happened
the new attach file is use
"tcp://127.0.0.1:61616?jms.prefetchPolicy.topicPrefetch=50"


> strange slower consumer and borker problem,make slow consumer application and broker memory grow very fast
> ----------------------------------------------------------------------------------------------------------
>
>                 Key: AMQ-1764
>                 URL: https://issues.apache.org/activemq/browse/AMQ-1764
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Broker
>    Affects Versions: 5.1.0
>         Environment: win2003sp2 , activemq 5.10 ,jdk6.0update6
>            Reporter: armgong
>         Attachments: test.zip
>
>
> I write a fast producer(produce a message take 1 ms) and a slow consumer(consumer a message take 10 seconds) application,and config standalone activemq through activemq.xml,in the activemq.xml I config constantPendingMessageLimitStrategy limit="10",and in the slow consumer i config connection url is "tcp://127.0.0.1:61616?jms.prefetchPolicy.queuePrefetch=50".
>  but the strange problem happends when i want send 200k 512 bytes size messages to borker through fast producer. 
> when producer send  messages start,the borker and the slow consumer memory useage grow very fast,after send 120k messages, the slow consumer take 80MB memory from at application start 18MB memory,and borker take 140MB memory, then borker slowing down,and totaly freeze.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (AMQ-1764) strange slower consumer and borker problem,make slow consumer application and broker memory grow very fast

Posted by "armgong (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/activemq/browse/AMQ-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=43188#action_43188 ] 

armgong commented on AMQ-1764:
------------------------------

btw the attach file is includes the activemq config file activemq.xml and producer (in producer dir )and slow consumer application (in slow dir). the two applications user none_durable topic "chatTopic.chatMessage"
if configured in activemq as following :
<destinations>         
         <topic physicalName="chatTopic.chatMessage" />
       </destinations>
        <!-- Destination specific policies using destination names or wildcards -->
        <destinationPolicy>
            <policyMap>
                <policyEntries>
                    <policyEntry queue=">" memoryLimit="20mb"/>
                    <policyEntry topic="chatTopic.chatMessage" memoryLimit="64mb">
                        <dispatchPolicy>
                            <strictOrderDispatchPolicy/>
                        </dispatchPolicy>
                        <subscriptionRecoveryPolicy>
                            <lastImageSubscriptionRecoveryPolicy/>
                        </subscriptionRecoveryPolicy>
                       <!--slow consumer policy-->
                       <pendingMessageLimitStrategy>   
                          <constantPendingMessageLimitStrategy limit="10"/>   
                       </pendingMessageLimitStrategy>  
                    </policyEntry>
                </policyEntries>
            </policyMap>
        </destinationPolicy>

> strange slower consumer and borker problem,make slow consumer application and broker memory grow very fast
> ----------------------------------------------------------------------------------------------------------
>
>                 Key: AMQ-1764
>                 URL: https://issues.apache.org/activemq/browse/AMQ-1764
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Broker
>    Affects Versions: 5.1.0
>         Environment: win2003sp2 , activemq 5.10 ,jdk6.0update6
>            Reporter: armgong
>         Attachments: test.zip
>
>
> I write a fast producer(produce a message take 1 ms) and a slow consumer(consumer a message take 10 seconds) application,and config standalone activemq through activemq.xml,in the activemq.xml I config constantPendingMessageLimitStrategy limit="10",and in the slow consumer i config connection url is "tcp://127.0.0.1:61616?jms.prefetchPolicy.queuePrefetch=50".
>  but the strange problem happends when i want send 200k 512 bytes size messages to borker through fast producer. 
> when producer send  messages start,the borker and the slow consumer memory useage grow very fast,after send 120k messages, the slow consumer take 80MB memory from at application start 18MB memory,and borker take 140MB memory, then borker slowing down,and totaly freeze.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.