You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@activemq.apache.org by Allan Wax <al...@ad.net> on 2016/05/02 19:08:33 UTC

Separate persistence provider per queue

Is it possible to configure a broker to use a different persistence provider
for a particular queue.  The situation is that I have a bunch of queues
whose persistence is on a remote broker but I want to have a vm queue whose
persistence is local.  If this is possible, a sample of how to do it would
be appreciated.



--
View this message in context: http://activemq.2283324.n4.nabble.com/Separate-persistence-provider-per-queue-tp4711444.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.

Re: Separate persistence provider per queue

Posted by Allan Wax <al...@ad.net>.
Thanks for the info.  The reason for doing it this way is that the
information must stay local to the machine and has nothing to do with the
other queues.  The persistence is needed in case the local processing that
goes elsewhere on the machine fails and we need to recover later.  I'm
trying hard to not create another broker just for this but it appears there
is no other way.



--
View this message in context: http://activemq.2283324.n4.nabble.com/Separate-persistence-provider-per-queue-tp4711444p4711585.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.

Re: Separate persistence provider per queue

Posted by Tim Bain <tb...@alumni.duke.edu>.
I agree, from my very quick search it doesn't look like there's a way to do
what you want.

Would you really want to, even if you could?  I assume the network share is
to allow this broker to be part of a master-slave grouping.  If one queue
is persisted to a location the others can't access, then when a slave takes
over for a failed master it will have a different set of messages for that
queue.  Would you really want that?

Tim
On May 3, 2016 12:59 PM, "Allan Wax" <al...@ad.net> wrote:

> To be clear, this is with ActiveMQ 5.x.
>
> The setup is that there is a single broker on a particular host whose
> purpose is to forward on messages from several queues to another host which
> is shared by multiple other hosts.  The dataDirectory for the broker is a
> network location which is shared by multiple other hosts.  I want to add a
> new VM queue that persists in a different location, on the local host.
>
> There are connection parameters to prevent the queue from going out to the
> network dataDir but no aparent parameters to assign a persistence directory
> per queue.
>
>
>
> --
> View this message in context:
> http://activemq.2283324.n4.nabble.com/Separate-persistence-provider-per-queue-tp4711444p4711523.html
> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>

Re: Separate persistence provider per queue

Posted by Allan Wax <al...@ad.net>.
To be clear, this is with ActiveMQ 5.x.

The setup is that there is a single broker on a particular host whose
purpose is to forward on messages from several queues to another host which
is shared by multiple other hosts.  The dataDirectory for the broker is a
network location which is shared by multiple other hosts.  I want to add a
new VM queue that persists in a different location, on the local host.

There are connection parameters to prevent the queue from going out to the
network dataDir but no aparent parameters to assign a persistence directory
per queue.



--
View this message in context: http://activemq.2283324.n4.nabble.com/Separate-persistence-provider-per-queue-tp4711444p4711523.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.

Re: Separate persistence provider per queue

Posted by Tim Bain <tb...@alumni.duke.edu>.
What does it mean (to you) for a queue's persistence to be local or to be
on a remote broker?  Those phrases don't mean anything to me, so unless
they mean something to someone else, your question's unlikely to get
answered as it's currently written.  Please clarify what you mean, and
someone may be able to help.

BTW, I should ask: are you talking about ActiveMQ 5.x, or about ActiveMQ
Artemis?  Maybe those words mean something in the Artemis world; my
comments apply only to classic ActiveMQ.

Tim

On Mon, May 2, 2016 at 11:08 AM, Allan Wax <al...@ad.net> wrote:

> Is it possible to configure a broker to use a different persistence
> provider
> for a particular queue.  The situation is that I have a bunch of queues
> whose persistence is on a remote broker but I want to have a vm queue whose
> persistence is local.  If this is possible, a sample of how to do it would
> be appreciated.
>
>
>
> --
> View this message in context:
> http://activemq.2283324.n4.nabble.com/Separate-persistence-provider-per-queue-tp4711444.html
> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>

Re: Separate persistence provider per queue

Posted by Allan Wax <al...@ad.net>.
Thanks for the info.  I have decided to go with a separae broker.  It'll be
easier than a more complex setup.



--
View this message in context: http://activemq.2283324.n4.nabble.com/Separate-persistence-provider-per-queue-tp4711444p4711713.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.

Re: Separate persistence provider per queue

Posted by Tim Bain <tb...@gmail.com>.
Using the local broker as a facade for the remote broker will work, as long
as it's OK for the messages from the remote broker to be stored on the
local broker.  (OK both from the standpoints of "allowable" and from the
standpoint of having enough disk space, performance, etc.)  If that isn't
OK, then you need to use two entirely unconnected brokers.

Tim
On May 6, 2016 1:12 PM, "Matt Pavlovich" <ma...@gmail.com> wrote:

> Allan-
>
> Have you looked into a store-and-forward architecture? This would allow
> you to store to the local broker, then the broker would forward to the
> remote broker. Same queue names, the brokers just handle everything for you.
>
> -Matt Pavlovich
>
> On 5/2/16 12:08 PM, Allan Wax wrote:
>
>> Is it possible to configure a broker to use a different persistence
>> provider
>> for a particular queue.  The situation is that I have a bunch of queues
>> whose persistence is on a remote broker but I want to have a vm queue
>> whose
>> persistence is local.  If this is possible, a sample of how to do it would
>> be appreciated.
>>
>>
>>
>> --
>> View this message in context:
>> http://activemq.2283324.n4.nabble.com/Separate-persistence-provider-per-queue-tp4711444.html
>> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>>
>
>

Re: Separate persistence provider per queue

Posted by Allan Wax <al...@ad.net>.
Actually, if you read the rest of the posts, I'm trying to do the exact
opposite.  Not store and forward but just persist locally on the machine
separate from the other store and forward queues that forward to another
host.  Store and forward to the same machine makes no sense to me.



--
View this message in context: http://activemq.2283324.n4.nabble.com/Separate-persistence-provider-per-queue-tp4711444p4711711.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.

Re: Separate persistence provider per queue

Posted by Matt Pavlovich <ma...@gmail.com>.
Allan-

Have you looked into a store-and-forward architecture? This would allow 
you to store to the local broker, then the broker would forward to the 
remote broker. Same queue names, the brokers just handle everything for you.

-Matt Pavlovich

On 5/2/16 12:08 PM, Allan Wax wrote:
> Is it possible to configure a broker to use a different persistence provider
> for a particular queue.  The situation is that I have a bunch of queues
> whose persistence is on a remote broker but I want to have a vm queue whose
> persistence is local.  If this is possible, a sample of how to do it would
> be appreciated.
>
>
>
> --
> View this message in context: http://activemq.2283324.n4.nabble.com/Separate-persistence-provider-per-queue-tp4711444.html
> Sent from the ActiveMQ - User mailing list archive at Nabble.com.