You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@qpid.apache.org by andi welchlin <an...@gmail.com> on 2017/11/08 17:00:16 UTC
HA Cluster using Qpid C++ Broker 1.36.0
Hello,
I would like to configure a HA cluster using the Qpid C++ message broker
1.36.0. In the handbook I read that rgmanager is neccessary.
When I try to install it on Ubuntu 16.04 it is not found. On a Fedora
installation it is also not found.
Is anyone here using the Qpid message broker in a cluster?
Are you using rgmanager or is there some other cluster manager usable on
Linux?
Any hints are welcome ... even if you say "noone uses the Qpid broker in a
cluster".
Kind Regards,
Andreas
Re: HA Cluster using Qpid C++ Broker 1.36.0
Posted by Alan Conway <ac...@redhat.com>.
So the general picture is as follows: qpid-ha manages data replication for
hot-standby in a single-primary, many-backup cluster. It does *not* manage
cluster membership: starting brokers, selecting a primary, promoting a
backup when the primary fails, and ensuring there is only one primary, even
in the event of a network partition. For all that it relies on a cluster
manager.
The interaction with the cluster manager involves:
1. Configuration to tell the cluster manager to run a cluster with 1
primary, N backups and failover
2. Provide scripts or triggers so the cluster manager can do the following
things:
- start a broker (always starts in backup mode)
- promote a backup broker to primary (run qpid-ha promote command)
- stop a broker
The rgmanager files are:
1. etc/cluster.conf-example.xml.in
2. etc/qpidd.in qpidd-primary.in
rgmanager uses a virtual IP for failover, and uses the qpidd.in and
qpidd-primary.in scripts to start/stop/promote brokers.
The rgmanager configuration is a little complicated because rgmanager does
not really support the notion of a "warm backup" cluster. To make it work
we pretend that primary and backup are different service types, so
rgmanager thinks it is keepi ng N qpidd services alive at all times and
exactly one qpidd-primary service. In fact the qpidd-primary service isn't
really a separate service, and it's scripts promote the existing backup
broker rather than starting a new broker. The fact that rgmanager doesn't
understand the relationship means the scripts and configuration need to do
a bunch of work to keep things straight.
I believe pacemaker does have native support for warm backups so the
configuation and scripts hopefully will be much simpler.
If you're interested in contributing this to the project, start a JIRA and
we can track it more easily. I can't dedicate a lot of time but hopefully I
can give you pointers to keep you on track.
On Fri, Nov 10, 2017 at 4:53 AM, andi welchlin <an...@gmail.com>
wrote:
> Hello Alan,
>
> thank you for your answer. I could install pacemaker using "apt-get install
> pacemaker".
>
> If you could give me some hints what to do to get it run it would be
> welcome.
>
> Thanks,
> Andreas
>
> On Wed, Nov 8, 2017 at 8:01 PM, Alan Conway <ac...@redhat.com> wrote:
>
> > rgmanager has been replaced by pacemaker on RHEL7, I'm not sure what is
> > available on Ubuntu. There is no out-of-the-box integration with
> pacemaker
> > or other cluster managers, but all that is needed is some configuration
> and
> > a couple of scripts to enable the cluster manager to start, stop and
> > promote Qpid brokers at the appropriate time - the cluster manager
> already
> > knows what the "appropriate time" is based on its liveness and membership
> > rules. If you're interested in trying to make it work, I can give you
> more
> > pointers on what is needed.
> >
> > On Wed, Nov 8, 2017 at 1:18 PM, Steve Huston <sh...@riverace.com>
> wrote:
> >
> > > I have used the qpid C++ broker in clusters. On RHEL 6. Works very
> well.
> > >
> > > > -----Original Message-----
> > > > From: andi welchlin [mailto:andi.welchlin@gmail.com]
> > > > Sent: Wednesday, November 08, 2017 12:00 PM
> > > > To: users@qpid.apache.org
> > > > Subject: HA Cluster using Qpid C++ Broker 1.36.0
> > > >
> > > > Hello,
> > > >
> > > > I would like to configure a HA cluster using the Qpid C++ message
> > broker
> > > > 1.36.0. In the handbook I read that rgmanager is neccessary.
> > > >
> > > > When I try to install it on Ubuntu 16.04 it is not found. On a Fedora
> > > installation
> > > > it is also not found.
> > > >
> > > > Is anyone here using the Qpid message broker in a cluster?
> > > >
> > > > Are you using rgmanager or is there some other cluster manager usable
> > on
> > > > Linux?
> > > >
> > > > Any hints are welcome ... even if you say "noone uses the Qpid broker
> > in
> > > a
> > > > cluster".
> > > >
> > > > Kind Regards,
> > > > Andreas
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
> > > For additional commands, e-mail: users-help@qpid.apache.org
> > >
> > >
> >
>
Re: HA Cluster using Qpid C++ Broker 1.36.0
Posted by andi welchlin <an...@gmail.com>.
Hello Chester,
thank you very much. I will look into this.
Kind Regards,
Andreas
On Mon, Nov 13, 2017 at 5:06 PM, Chester <kn...@gmail.com> wrote:
> https://www.clusterlabs.org/doc/en-US/Pacemaker/1.1-pcs/
> html/Clusters_from_Scratch/index.html
> will get you started with pacemaker. The DRBD walkthrough is easy enough to
> follow to start understanding the clustering system.
>
> For qpidd, you'll need the following resources:
>
> 1. qpidd service clone (1 running on each node) resource
> 2. cluster vip (service/cluster/VIP address) resource
> 3. qpidd-primary service resource
> 4. fence resources
>
> My config looks like this:
>
> [root@node-01 ~]# pcs status
>
> Cluster name: qpid_mgmt_broker_cluster
>
> Stack: corosync
>
> Current DC: node-01.subdomain.domain.com (version
> 1.1.15-11.el7_3.5-e174ec8) - partition with quorum
>
> Last updated: Mon Nov 13 11:01:38 2017 Last change: Thu Nov 9 17:42:21
> 2017 by root via crm_attribute on node-03.subdomain.domain.com
>
>
> 3 nodes and 8 resources configured
>
>
> Online: [ node-01.subdomain.domain.com node-02.subdomain.domain.com
> node-03.subdomain.domain.com ]
>
>
> Full list of resources:
>
>
> Clone Set: qpidd-service-clone [qpidd-service]
>
> Started: [ node-01.subdomain.domain.com node-02.subdomain.domain.com
> node-03.subdomain.domain.com ]
>
> cluster-vip (ocf::heartbeat:IPaddr2): Started
> node-01.subdomain.domain.com
>
> qpidd-primary-service (lsb:qpidd-primary): Started
> node-01.subdomain.domain.com
>
> node-01_fence_xvm (stonith:fence_xvm): Started
> node-02.subdomain.domain.com
>
> node-02_fence_xvm (stonith:fence_xvm): Started
> node-03.subdomain.domain.com
>
> node-03_fence_xvm (stonith:fence_xvm): Started
> node-02.subdomain.domain.com
>
>
> Daemon Status:
>
> corosync: active/enabled
>
> pacemaker: active/enabled
>
> pcsd: active/enabled
>
>
> https://qpid.apache.org/releases/qpid-cpp-1.36.0/cpp-
> broker/book/chapter-ha.html
> is good too.
>
> On Fri, Nov 10, 2017 at 4:53 AM, andi welchlin <an...@gmail.com>
> wrote:
>
> > Hello Alan,
> >
> > thank you for your answer. I could install pacemaker using "apt-get
> install
> > pacemaker".
> >
> > If you could give me some hints what to do to get it run it would be
> > welcome.
> >
> > Thanks,
> > Andreas
> >
> > On Wed, Nov 8, 2017 at 8:01 PM, Alan Conway <ac...@redhat.com> wrote:
> >
> > > rgmanager has been replaced by pacemaker on RHEL7, I'm not sure what is
> > > available on Ubuntu. There is no out-of-the-box integration with
> > pacemaker
> > > or other cluster managers, but all that is needed is some configuration
> > and
> > > a couple of scripts to enable the cluster manager to start, stop and
> > > promote Qpid brokers at the appropriate time - the cluster manager
> > already
> > > knows what the "appropriate time" is based on its liveness and
> membership
> > > rules. If you're interested in trying to make it work, I can give you
> > more
> > > pointers on what is needed.
> > >
> > > On Wed, Nov 8, 2017 at 1:18 PM, Steve Huston <sh...@riverace.com>
> > wrote:
> > >
> > > > I have used the qpid C++ broker in clusters. On RHEL 6. Works very
> > well.
> > > >
> > > > > -----Original Message-----
> > > > > From: andi welchlin [mailto:andi.welchlin@gmail.com]
> > > > > Sent: Wednesday, November 08, 2017 12:00 PM
> > > > > To: users@qpid.apache.org
> > > > > Subject: HA Cluster using Qpid C++ Broker 1.36.0
> > > > >
> > > > > Hello,
> > > > >
> > > > > I would like to configure a HA cluster using the Qpid C++ message
> > > broker
> > > > > 1.36.0. In the handbook I read that rgmanager is neccessary.
> > > > >
> > > > > When I try to install it on Ubuntu 16.04 it is not found. On a
> Fedora
> > > > installation
> > > > > it is also not found.
> > > > >
> > > > > Is anyone here using the Qpid message broker in a cluster?
> > > > >
> > > > > Are you using rgmanager or is there some other cluster manager
> usable
> > > on
> > > > > Linux?
> > > > >
> > > > > Any hints are welcome ... even if you say "noone uses the Qpid
> broker
> > > in
> > > > a
> > > > > cluster".
> > > > >
> > > > > Kind Regards,
> > > > > Andreas
> > > >
> > > > ------------------------------------------------------------
> ---------
> > > > To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
> > > > For additional commands, e-mail: users-help@qpid.apache.org
> > > >
> > > >
> > >
> >
>
Re: HA Cluster using Qpid C++ Broker 1.36.0
Posted by Chester <kn...@gmail.com>.
https://www.clusterlabs.org/doc/en-US/Pacemaker/1.1-pcs/html/Clusters_from_Scratch/index.html
will get you started with pacemaker. The DRBD walkthrough is easy enough to
follow to start understanding the clustering system.
For qpidd, you'll need the following resources:
1. qpidd service clone (1 running on each node) resource
2. cluster vip (service/cluster/VIP address) resource
3. qpidd-primary service resource
4. fence resources
My config looks like this:
[root@node-01 ~]# pcs status
Cluster name: qpid_mgmt_broker_cluster
Stack: corosync
Current DC: node-01.subdomain.domain.com (version
1.1.15-11.el7_3.5-e174ec8) - partition with quorum
Last updated: Mon Nov 13 11:01:38 2017 Last change: Thu Nov 9 17:42:21
2017 by root via crm_attribute on node-03.subdomain.domain.com
3 nodes and 8 resources configured
Online: [ node-01.subdomain.domain.com node-02.subdomain.domain.com
node-03.subdomain.domain.com ]
Full list of resources:
Clone Set: qpidd-service-clone [qpidd-service]
Started: [ node-01.subdomain.domain.com node-02.subdomain.domain.com
node-03.subdomain.domain.com ]
cluster-vip (ocf::heartbeat:IPaddr2): Started node-01.subdomain.domain.com
qpidd-primary-service (lsb:qpidd-primary): Started
node-01.subdomain.domain.com
node-01_fence_xvm (stonith:fence_xvm): Started
node-02.subdomain.domain.com
node-02_fence_xvm (stonith:fence_xvm): Started
node-03.subdomain.domain.com
node-03_fence_xvm (stonith:fence_xvm): Started
node-02.subdomain.domain.com
Daemon Status:
corosync: active/enabled
pacemaker: active/enabled
pcsd: active/enabled
https://qpid.apache.org/releases/qpid-cpp-1.36.0/cpp-broker/book/chapter-ha.html
is good too.
On Fri, Nov 10, 2017 at 4:53 AM, andi welchlin <an...@gmail.com>
wrote:
> Hello Alan,
>
> thank you for your answer. I could install pacemaker using "apt-get install
> pacemaker".
>
> If you could give me some hints what to do to get it run it would be
> welcome.
>
> Thanks,
> Andreas
>
> On Wed, Nov 8, 2017 at 8:01 PM, Alan Conway <ac...@redhat.com> wrote:
>
> > rgmanager has been replaced by pacemaker on RHEL7, I'm not sure what is
> > available on Ubuntu. There is no out-of-the-box integration with
> pacemaker
> > or other cluster managers, but all that is needed is some configuration
> and
> > a couple of scripts to enable the cluster manager to start, stop and
> > promote Qpid brokers at the appropriate time - the cluster manager
> already
> > knows what the "appropriate time" is based on its liveness and membership
> > rules. If you're interested in trying to make it work, I can give you
> more
> > pointers on what is needed.
> >
> > On Wed, Nov 8, 2017 at 1:18 PM, Steve Huston <sh...@riverace.com>
> wrote:
> >
> > > I have used the qpid C++ broker in clusters. On RHEL 6. Works very
> well.
> > >
> > > > -----Original Message-----
> > > > From: andi welchlin [mailto:andi.welchlin@gmail.com]
> > > > Sent: Wednesday, November 08, 2017 12:00 PM
> > > > To: users@qpid.apache.org
> > > > Subject: HA Cluster using Qpid C++ Broker 1.36.0
> > > >
> > > > Hello,
> > > >
> > > > I would like to configure a HA cluster using the Qpid C++ message
> > broker
> > > > 1.36.0. In the handbook I read that rgmanager is neccessary.
> > > >
> > > > When I try to install it on Ubuntu 16.04 it is not found. On a Fedora
> > > installation
> > > > it is also not found.
> > > >
> > > > Is anyone here using the Qpid message broker in a cluster?
> > > >
> > > > Are you using rgmanager or is there some other cluster manager usable
> > on
> > > > Linux?
> > > >
> > > > Any hints are welcome ... even if you say "noone uses the Qpid broker
> > in
> > > a
> > > > cluster".
> > > >
> > > > Kind Regards,
> > > > Andreas
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
> > > For additional commands, e-mail: users-help@qpid.apache.org
> > >
> > >
> >
>
Re: HA Cluster using Qpid C++ Broker 1.36.0
Posted by andi welchlin <an...@gmail.com>.
Hello Alan,
thank you for your answer. I could install pacemaker using "apt-get install
pacemaker".
If you could give me some hints what to do to get it run it would be
welcome.
Thanks,
Andreas
On Wed, Nov 8, 2017 at 8:01 PM, Alan Conway <ac...@redhat.com> wrote:
> rgmanager has been replaced by pacemaker on RHEL7, I'm not sure what is
> available on Ubuntu. There is no out-of-the-box integration with pacemaker
> or other cluster managers, but all that is needed is some configuration and
> a couple of scripts to enable the cluster manager to start, stop and
> promote Qpid brokers at the appropriate time - the cluster manager already
> knows what the "appropriate time" is based on its liveness and membership
> rules. If you're interested in trying to make it work, I can give you more
> pointers on what is needed.
>
> On Wed, Nov 8, 2017 at 1:18 PM, Steve Huston <sh...@riverace.com> wrote:
>
> > I have used the qpid C++ broker in clusters. On RHEL 6. Works very well.
> >
> > > -----Original Message-----
> > > From: andi welchlin [mailto:andi.welchlin@gmail.com]
> > > Sent: Wednesday, November 08, 2017 12:00 PM
> > > To: users@qpid.apache.org
> > > Subject: HA Cluster using Qpid C++ Broker 1.36.0
> > >
> > > Hello,
> > >
> > > I would like to configure a HA cluster using the Qpid C++ message
> broker
> > > 1.36.0. In the handbook I read that rgmanager is neccessary.
> > >
> > > When I try to install it on Ubuntu 16.04 it is not found. On a Fedora
> > installation
> > > it is also not found.
> > >
> > > Is anyone here using the Qpid message broker in a cluster?
> > >
> > > Are you using rgmanager or is there some other cluster manager usable
> on
> > > Linux?
> > >
> > > Any hints are welcome ... even if you say "noone uses the Qpid broker
> in
> > a
> > > cluster".
> > >
> > > Kind Regards,
> > > Andreas
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
> > For additional commands, e-mail: users-help@qpid.apache.org
> >
> >
>
Re: HA Cluster using Qpid C++ Broker 1.36.0
Posted by Alan Conway <ac...@redhat.com>.
rgmanager has been replaced by pacemaker on RHEL7, I'm not sure what is
available on Ubuntu. There is no out-of-the-box integration with pacemaker
or other cluster managers, but all that is needed is some configuration and
a couple of scripts to enable the cluster manager to start, stop and
promote Qpid brokers at the appropriate time - the cluster manager already
knows what the "appropriate time" is based on its liveness and membership
rules. If you're interested in trying to make it work, I can give you more
pointers on what is needed.
On Wed, Nov 8, 2017 at 1:18 PM, Steve Huston <sh...@riverace.com> wrote:
> I have used the qpid C++ broker in clusters. On RHEL 6. Works very well.
>
> > -----Original Message-----
> > From: andi welchlin [mailto:andi.welchlin@gmail.com]
> > Sent: Wednesday, November 08, 2017 12:00 PM
> > To: users@qpid.apache.org
> > Subject: HA Cluster using Qpid C++ Broker 1.36.0
> >
> > Hello,
> >
> > I would like to configure a HA cluster using the Qpid C++ message broker
> > 1.36.0. In the handbook I read that rgmanager is neccessary.
> >
> > When I try to install it on Ubuntu 16.04 it is not found. On a Fedora
> installation
> > it is also not found.
> >
> > Is anyone here using the Qpid message broker in a cluster?
> >
> > Are you using rgmanager or is there some other cluster manager usable on
> > Linux?
> >
> > Any hints are welcome ... even if you say "noone uses the Qpid broker in
> a
> > cluster".
> >
> > Kind Regards,
> > Andreas
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
> For additional commands, e-mail: users-help@qpid.apache.org
>
>
RE: HA Cluster using Qpid C++ Broker 1.36.0
Posted by Steve Huston <sh...@riverace.com>.
I have used the qpid C++ broker in clusters. On RHEL 6. Works very well.
> -----Original Message-----
> From: andi welchlin [mailto:andi.welchlin@gmail.com]
> Sent: Wednesday, November 08, 2017 12:00 PM
> To: users@qpid.apache.org
> Subject: HA Cluster using Qpid C++ Broker 1.36.0
>
> Hello,
>
> I would like to configure a HA cluster using the Qpid C++ message broker
> 1.36.0. In the handbook I read that rgmanager is neccessary.
>
> When I try to install it on Ubuntu 16.04 it is not found. On a Fedora installation
> it is also not found.
>
> Is anyone here using the Qpid message broker in a cluster?
>
> Are you using rgmanager or is there some other cluster manager usable on
> Linux?
>
> Any hints are welcome ... even if you say "noone uses the Qpid broker in a
> cluster".
>
> Kind Regards,
> Andreas
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
For additional commands, e-mail: users-help@qpid.apache.org