You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@activemq.apache.org by "Taras Tielkes (JIRA)" <ji...@apache.org> on 2010/03/24 21:19:08 UTC

[jira] Created: (AMQ-2668) Allow setting storeUsage limit per individual queue/topic

Allow setting storeUsage limit per individual queue/topic
---------------------------------------------------------

                 Key: AMQ-2668
                 URL: https://issues.apache.org/activemq/browse/AMQ-2668
             Project: ActiveMQ
          Issue Type: New Feature
          Components: Broker
    Affects Versions: 5.3.1
            Reporter: Taras Tielkes


At the moment it's only possible to configure a storeLimit per broker.

In some cases, you want to set an upper bound for an individual queue, to guarantee that there will be storage available for other queues.
For example, consider a setup with a request queue, and a response queue, where both request and response messages are huge.

In that situation, we want to set an overall store limit, to prevent flooding the filesystem.
At the same time, we don't want to allow the request queue to consume 100% of the broker store.

For example, we'd like to define:
total broker store limit: 20 GB
queue "request_queue" store limit: 15 GB
queue "response_queue" store limit: 5 GB


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (AMQ-2668) Allow setting storeUsage limit per individual queue/topic

Posted by "Gary Tully (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/activemq/browse/AMQ-2668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gary Tully reassigned AMQ-2668:
-------------------------------

    Assignee: Gary Tully

> Allow setting storeUsage limit per individual queue/topic
> ---------------------------------------------------------
>
>                 Key: AMQ-2668
>                 URL: https://issues.apache.org/activemq/browse/AMQ-2668
>             Project: ActiveMQ
>          Issue Type: New Feature
>          Components: Broker
>    Affects Versions: 5.3.1
>            Reporter: Taras Tielkes
>            Assignee: Gary Tully
>
> At the moment it's only possible to configure a storeLimit per broker.
> In some cases, you want to set an upper bound for an individual queue, to guarantee that there will be storage available for other queues.
> For example, consider a setup with a request queue, and a response queue, where both request and response messages are huge.
> In that situation, we want to set an overall store limit, to prevent flooding the filesystem.
> At the same time, we don't want to allow the request queue to consume 100% of the broker store.
> For example, we'd like to define:
> total broker store limit: 20 GB
> queue "request_queue" store limit: 15 GB
> queue "response_queue" store limit: 5 GB

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/activemq/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (AMQ-2668) Allow setting storeUsage limit per individual queue/topic

Posted by "Gary Tully (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/activemq/browse/AMQ-2668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=58436#action_58436 ] 

Gary Tully commented on AMQ-2668:
---------------------------------

individual store limits may not be possible as the store is shared, but possibly a precent store usage usage metric would work.

request queue could block on 70% full and response queue could block on 100% full.

This approach is already uses by the cursors via the cursorMemoryHighWaterMark.

Do you think that would satisfy your use case?

> Allow setting storeUsage limit per individual queue/topic
> ---------------------------------------------------------
>
>                 Key: AMQ-2668
>                 URL: https://issues.apache.org/activemq/browse/AMQ-2668
>             Project: ActiveMQ
>          Issue Type: New Feature
>          Components: Broker
>    Affects Versions: 5.3.1
>            Reporter: Taras Tielkes
>
> At the moment it's only possible to configure a storeLimit per broker.
> In some cases, you want to set an upper bound for an individual queue, to guarantee that there will be storage available for other queues.
> For example, consider a setup with a request queue, and a response queue, where both request and response messages are huge.
> In that situation, we want to set an overall store limit, to prevent flooding the filesystem.
> At the same time, we don't want to allow the request queue to consume 100% of the broker store.
> For example, we'd like to define:
> total broker store limit: 20 GB
> queue "request_queue" store limit: 15 GB
> queue "response_queue" store limit: 5 GB

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (AMQ-2668) Allow setting storeUsage limit per individual queue/topic

Posted by "Gary Tully (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/activemq/browse/AMQ-2668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gary Tully resolved AMQ-2668.
-----------------------------

    Fix Version/s: 5.4.0
       Resolution: Fixed

on trunk with r934352

new destination PolicyEntry storeUsageHighWaterMark with a default value of 100%

> Allow setting storeUsage limit per individual queue/topic
> ---------------------------------------------------------
>
>                 Key: AMQ-2668
>                 URL: https://issues.apache.org/activemq/browse/AMQ-2668
>             Project: ActiveMQ
>          Issue Type: New Feature
>          Components: Broker
>    Affects Versions: 5.3.1
>            Reporter: Taras Tielkes
>            Assignee: Gary Tully
>             Fix For: 5.4.0
>
>
> At the moment it's only possible to configure a storeLimit per broker.
> In some cases, you want to set an upper bound for an individual queue, to guarantee that there will be storage available for other queues.
> For example, consider a setup with a request queue, and a response queue, where both request and response messages are huge.
> In that situation, we want to set an overall store limit, to prevent flooding the filesystem.
> At the same time, we don't want to allow the request queue to consume 100% of the broker store.
> For example, we'd like to define:
> total broker store limit: 20 GB
> queue "request_queue" store limit: 15 GB
> queue "response_queue" store limit: 5 GB

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/activemq/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Commented: (AMQ-2668) Allow setting storeUsage limit per individual queue/topic

Posted by "Taras Tielkes (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/activemq/browse/AMQ-2668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=58437#action_58437 ] 

Taras Tielkes commented on AMQ-2668:
------------------------------------

Gary, that would perfectly fit our scenario.

> Allow setting storeUsage limit per individual queue/topic
> ---------------------------------------------------------
>
>                 Key: AMQ-2668
>                 URL: https://issues.apache.org/activemq/browse/AMQ-2668
>             Project: ActiveMQ
>          Issue Type: New Feature
>          Components: Broker
>    Affects Versions: 5.3.1
>            Reporter: Taras Tielkes
>
> At the moment it's only possible to configure a storeLimit per broker.
> In some cases, you want to set an upper bound for an individual queue, to guarantee that there will be storage available for other queues.
> For example, consider a setup with a request queue, and a response queue, where both request and response messages are huge.
> In that situation, we want to set an overall store limit, to prevent flooding the filesystem.
> At the same time, we don't want to allow the request queue to consume 100% of the broker store.
> For example, we'd like to define:
> total broker store limit: 20 GB
> queue "request_queue" store limit: 15 GB
> queue "response_queue" store limit: 5 GB

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.