You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@qpid.apache.org by Zhemzhitsky Sergey <Se...@troika.ru> on 2011/06/22 14:22:32 UTC
flow-to-disk limit policy does not work
Hi there,
I'm using qpid 0.8 and I'm trying to configure queue to use the limit-policy parameter without luck.
Here is the command to create a queue
qpid-config add queue myQueue --durable --file-size=256 --file-count=96 --max-queue-count=100 --limit-policy=flow-to-disk
Here is output of the top command after qpid starts
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
28146 qpidd 19 0 123m 5596 4104 S 0.0 0.3 0:00.00 qpidd
As you can see it uses ~5.6mb of memory.
After I start to send non-persistent messages (size of each message is 32 bytes) without consumption the output of the top command is the following:
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
28146 qpidd 16 0 2541m 1.8g 3520 S 49.0 94.1 0:41.75 qpidd
Now qpid consumes 1.8Gb and it continues to consume more.
I'm wondering why so? How to make the queue to use the limit-policy parameter correctly?
Best Regards,
Sergey Zhemzhitsky
_______________________________________________________
The information contained in this message may be privileged and conf idential and protected from disclosure. If you are not the original intended recipient, you are hereby notified that any review, retransmission, dissemination, or other use of, or taking of any action in reliance upon, this information is prohibited. If you have received this communication in error, please notify the sender immediately by replying to this message and delete it from your computer. Thank you for your cooperation. Troika Dialog, Russia.
If you need assistance please contact our Contact Center (+7495) 258 0500 or go to www.troika.ru/eng/Contacts/system.wbp
Re: flow-to-disk limit policy does not work
Posted by Gordon Sim <gs...@redhat.com>.
On 06/22/2011 02:24 PM, Zhemzhitsky Sergey wrote:
> Thanks a lot for the information.
> I have raise the JIRA issue: https://issues.apache.org/jira/browse/QPID-3316
Thanks!
> By the way, are there any plans to implement any paging solution you have mentioned, to make qpidd to consume more hdd space rather than memory?
Depends what you mean ;-)
It is certainly something that has come up before and is widely seen as
useful and desirable. However I haven't got the time to focus on it at
present and as far as I'm aware there is no work on it actually
scheduled yet. Might make an interesting project for a new contributor.
---------------------------------------------------------------------
Apache Qpid - AMQP Messaging Implementation
Project: http://qpid.apache.org
Use/Interact: mailto:users-subscribe@qpid.apache.org
RE: flow-to-disk limit policy does not work
Posted by Zhemzhitsky Sergey <Se...@troika.ru>.
Hi Gordon,
Thanks a lot for the information.
I have raise the JIRA issue: https://issues.apache.org/jira/browse/QPID-3316
By the way, are there any plans to implement any paging solution you have mentioned, to make qpidd to consume more hdd space rather than memory?
Best Regards,
Sergey Zhemzhitsky
-----Original Message-----
From: Gordon Sim [mailto:gsim@redhat.com]
Sent: Wednesday, June 22, 2011 4:33 PM
To: users@qpid.apache.org
Subject: Re: flow-to-disk limit policy does not work
On 06/22/2011 01:22 PM, Zhemzhitsky Sergey wrote:
> Hi there,
>
> I'm using qpid 0.8 and I'm trying to configure queue to use the limit-policy parameter without luck.
>
> Here is the command to create a queue
>
> qpid-config add queue myQueue --durable --file-size=256
> --file-count=96 --max-queue-count=100 --limit-policy=flow-to-disk
>
> Here is output of the top command after qpid starts
>
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
> 28146 qpidd 19 0 123m 5596 4104 S 0.0 0.3 0:00.00 qpidd
>
> As you can see it uses ~5.6mb of memory.
>
> After I start to send non-persistent messages (size of each message is 32 bytes) without consumption the output of the top command is the following:
>
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
> 28146 qpidd 16 0 2541m 1.8g 3520 S 49.0 94.1 0:41.75 qpidd
>
> Now qpid consumes 1.8Gb and it continues to consume more.
>
> I'm wondering why so? How to make the queue to use the limit-policy parameter correctly?
That policy allows the body of the message to be released from memory, but the headers etc will still be held in memory. For small messages (such as the 32 byte message you are sending), this policy will not really do anything useful.
Your use case really requires a proper paging solution which qpidd does not yet support.
---------------------------------------------------------------------
Apache Qpid - AMQP Messaging Implementation
Project: http://qpid.apache.org
Use/Interact: mailto:users-subscribe@qpid.apache.org
_______________________________________________________
The information contained in this message may be privileged and conf idential and protected from disclosure. If you are not the original intended recipient, you are hereby notified that any review, retransmission, dissemination, or other use of, or taking of any action in reliance upon, this information is prohibited. If you have received this communication in error, please notify the sender immediately by replying to this message and delete it from your computer. Thank you for your cooperation. Troika Dialog, Russia.
If you need assistance please contact our Contact Center (+7495) 258 0500 or go to www.troika.ru/eng/Contacts/system.wbp
---------------------------------------------------------------------
Apache Qpid - AMQP Messaging Implementation
Project: http://qpid.apache.org
Use/Interact: mailto:users-subscribe@qpid.apache.org
Re: flow-to-disk limit policy does not work
Posted by Gordon Sim <gs...@redhat.com>.
On 06/22/2011 01:22 PM, Zhemzhitsky Sergey wrote:
> Hi there,
>
> I'm using qpid 0.8 and I'm trying to configure queue to use the limit-policy parameter without luck.
>
> Here is the command to create a queue
>
> qpid-config add queue myQueue --durable --file-size=256 --file-count=96 --max-queue-count=100 --limit-policy=flow-to-disk
>
> Here is output of the top command after qpid starts
>
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
> 28146 qpidd 19 0 123m 5596 4104 S 0.0 0.3 0:00.00 qpidd
>
> As you can see it uses ~5.6mb of memory.
>
> After I start to send non-persistent messages (size of each message is 32 bytes) without consumption the output of the top command is the following:
>
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
> 28146 qpidd 16 0 2541m 1.8g 3520 S 49.0 94.1 0:41.75 qpidd
>
> Now qpid consumes 1.8Gb and it continues to consume more.
>
> I'm wondering why so? How to make the queue to use the limit-policy parameter correctly?
That policy allows the body of the message to be released from memory,
but the headers etc will still be held in memory. For small messages
(such as the 32 byte message you are sending), this policy will not
really do anything useful.
Your use case really requires a proper paging solution which qpidd does
not yet support.
---------------------------------------------------------------------
Apache Qpid - AMQP Messaging Implementation
Project: http://qpid.apache.org
Use/Interact: mailto:users-subscribe@qpid.apache.org