You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@qpid.apache.org by "lei.dai@airlink-software.com" <le...@airlink-software.com> on 2016/11/20 09:53:47 UTC
[Qpid C++ Broker][HA] How to configure the HA-cluster without rgmanager?
Hi,
I'm trying to configure the qpid HA-cluster without rgmanager but it doesn't work.
The version Infos:
---------------------------
CentOS 7.2
qpid-cpp-1.35.0
qpid-proton-0.14.0
---------------------------
I installed qpid-cpp and qpid-proton in according to the INSTALL.txt with default configurations on 3 CentOS VMs.
The IP addresses are: 172.16.28.231, 172.16.28.232, 172.16.23.233.
Started qpid on every VM with command:
$qpidd --auth no --ha-cluster yes --ha-brokers-url 172.16.28.231,172.16.28.232,172.16.28.233
But when I use qpid-ha to show the status of the cluster, all nodes are in joining status.
It means the nodes didn't connect to each other?
Did I have some mistakes in the configurations or the usage?
I read the documents on the qpid site. It says that rgmanager can manage the cluster and set the primary node by calling qpidd-primary script.
But I didn't find the qpidd-primary script in my system.
Is the rgmanager necessary to use HA-cluster?
Regards,
Lei Dai
Re: Re: [Qpid C++ Broker][HA] How to configure the HA-cluster without rgmanager?
Posted by "lei.dai@airlink-software.com" <le...@airlink-software.com>.
Oh, really sad news ......
I'm now considering to try the CONSUL from HashiCorp.
It seems that it can run on Windows and do some health checks for cluster by calling customized scripts.
Regards,
Lei Dai
From: Steve Huston
Date: 2016-11-23 11:07
To: users@qpid.apache.org
Subject: Re: [Qpid C++ Broker][HA] How to configure the HA-cluster without rgmanager?
I don't think anyone has done the work to manage availability on Windows so I don't think you can run a qpid cluster on Windows at this time.
-Steve
> On Nov 22, 2016, at 10:03 PM, "lei.dai@airlink-software.com" <le...@airlink-software.com> wrote:
>
> Thank you for your reply.
> In fact at the end I must use qpid on windows, so maybe I should find a substitute for rgmanager.
>
> Regards,
>
>
> Lei Dai
>
> From: Steve Huston
> Date: 2016-11-21 21:56
> To: users@qpid.apache.org
> Subject: RE: [Qpid C++ Broker][HA] How to configure the HA-cluster without rgmanager?
> I am not an expert in all cluster things, but the only way I have seen qpid C++ brokers in a cluster is using rgmanager. It takes care of managing the need to move the cluster primary around. It also manages the virtual IP address assigned to the broker cluster - you didn't mention a virtual IP in your question, but you will need it to use rgmanager for qpid HA.
>
> -Steve
>
>> -----Original Message-----
>> From: lei.dai@airlink-software.com [mailto:lei.dai@airlink-software.com]
>> Sent: Sunday, November 20, 2016 4:54 AM
>> To: users <us...@qpid.apache.org>
>> Subject: [Qpid C++ Broker][HA] How to configure the HA-cluster without
>> rgmanager?
>>
>> Hi,
>>
>> I'm trying to configure the qpid HA-cluster without rgmanager but it doesn't
>> work.
>>
>> The version Infos:
>> ---------------------------
>> CentOS 7.2
>> qpid-cpp-1.35.0
>> qpid-proton-0.14.0
>> ---------------------------
>>
>> I installed qpid-cpp and qpid-proton in according to the INSTALL.txt with
>> default configurations on 3 CentOS VMs.
>> The IP addresses are: 172.16.28.231, 172.16.28.232, 172.16.23.233.
>>
>> Started qpid on every VM with command:
>> $qpidd --auth no --ha-cluster yes --ha-brokers-url
>> 172.16.28.231,172.16.28.232,172.16.28.233
>>
>> But when I use qpid-ha to show the status of the cluster, all nodes are in
>> joining status.
>> It means the nodes didn't connect to each other?
>>
>> Did I have some mistakes in the configurations or the usage?
>> I read the documents on the qpid site. It says that rgmanager can manage
>> the cluster and set the primary node by calling qpidd-primary script.
>> But I didn't find the qpidd-primary script in my system.
>> Is the rgmanager necessary to use HA-cluster?
>>
>> Regards,
>>
>>
>> Lei Dai
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
> For additional commands, e-mail: users-help@qpid.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
For additional commands, e-mail: users-help@qpid.apache.org
Re: [Qpid C++ Broker][HA] How to configure the HA-cluster without
rgmanager?
Posted by Alan Conway <ac...@redhat.com>.
On Wed, 2016-11-23 at 03:07 +0000, Steve Huston wrote:
> I don't think anyone has done the work to manage availability on
> Windows so I don't think you can run a qpid cluster on Windows at
> this time.�
Not out of the box, but if you can find a windows-based cluster manager
then you just need to write the equivalent of the qpidd and qpidd-
primary scripts. There are not a lot of actions to support: stop,
start, restart, status and promote. Qpid HA was designed to be easy to
integrate with alternative cluster managers (although it hasn't
happened yet.)
The qpidd scripts are a little complicated because rgmanager does not
directly support "warm standby" clusters, you have to pretend that
backup and primary are different services even though they're the same
process. Modern CMs have the notion of warm standby and promotion built
in so the scripts might be simpler.
Mail the list or me direct if you decide to do this, I don't work full-
time on HA anymore but I can give you tips.
>
> -Steve
>
> >
> > On Nov 22, 2016, at 10:03 PM, "lei.dai@airlink-software.com" <lei.d
> > ai@airlink-software.com> wrote:
> >
> > Thank you for your reply.
> > In fact at the end I must use qpid on windows, so maybe I should
> > find a substitute for rgmanager.
> >
> > Regards,
> >
> >
> > Lei Dai
> >
> > From: Steve Huston
> > Date: 2016-11-21 21:56
> > To: users@qpid.apache.org
> > Subject: RE: [Qpid C++ Broker][HA] How to configure the HA-cluster
> > without rgmanager?
> > I am not an expert in all cluster things, but the only way I have
> > seen qpid C++ brokers in a cluster is using rgmanager. It takes
> > care of managing the need to move the cluster primary around. It
> > also manages the virtual IP address assigned to the broker cluster
> > - you didn't mention a virtual IP in your question, but you will
> > need it to use rgmanager for qpid HA.
> >
> > -Steve
> >
> > >
> > > -----Original Message-----
> > > From: lei.dai@airlink-software.com [mailto:lei.dai@airlink-softwa
> > > re.com]
> > > Sent: Sunday, November 20, 2016 4:54 AM
> > > To: users <us...@qpid.apache.org>
> > > Subject: [Qpid C++ Broker][HA] How to configure the HA-cluster
> > > without
> > > rgmanager?
> > >
> > > Hi,
> > >
> > > I'm trying to configure the qpid HA-cluster without rgmanager but
> > > it doesn't
> > > work.
> > >
> > > The version Infos:
> > > ---------------------------
> > > CentOS 7.2
> > > qpid-cpp-1.35.0
> > > qpid-proton-0.14.0
> > > ---------------------------
> > >
> > > I installed qpid-cpp and qpid-proton in according to the
> > > INSTALL.txt with
> > > default configurations on 3 CentOS VMs.
> > > The IP addresses are: 172.16.28.231, 172.16.28.232,
> > > 172.16.23.233.
> > >
> > > Started qpid on every VM with command:
> > > $qpidd --auth no --ha-cluster yes --ha-brokers-url
> > > 172.16.28.231,172.16.28.232,172.16.28.233
> > >
> > > But when I use qpid-ha to show the status of the cluster, all
> > > nodes are in
> > > joining status.
> > > It means the nodes didn't connect to each other?
> > >
> > > Did I have some mistakes in the configurations or the usage?
> > > I read the documents on the qpid site. It says that rgmanager can
> > > manage
> > > the cluster and set the primary node by calling qpidd-primary
> > > script.
> > > But I didn't find the qpidd-primary script in my system.
> > > Is the rgmanager necessary to use HA-cluster?
> > >
> > > Regards,
> > >
> > >
> > > Lei Dai
> >
> > -----------------------------------------------------------------
> > ----
> > To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
> > For additional commands, e-mail: users-help@qpid.apache.org
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
> For additional commands, e-mail: users-help@qpid.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
For additional commands, e-mail: users-help@qpid.apache.org
Re: [Qpid C++ Broker][HA] How to configure the HA-cluster without
rgmanager?
Posted by Steve Huston <sh...@riverace.com>.
I don't think anyone has done the work to manage availability on Windows so I don't think you can run a qpid cluster on Windows at this time.
-Steve
> On Nov 22, 2016, at 10:03 PM, "lei.dai@airlink-software.com" <le...@airlink-software.com> wrote:
>
> Thank you for your reply.
> In fact at the end I must use qpid on windows, so maybe I should find a substitute for rgmanager.
>
> Regards,
>
>
> Lei Dai
>
> From: Steve Huston
> Date: 2016-11-21 21:56
> To: users@qpid.apache.org
> Subject: RE: [Qpid C++ Broker][HA] How to configure the HA-cluster without rgmanager?
> I am not an expert in all cluster things, but the only way I have seen qpid C++ brokers in a cluster is using rgmanager. It takes care of managing the need to move the cluster primary around. It also manages the virtual IP address assigned to the broker cluster - you didn't mention a virtual IP in your question, but you will need it to use rgmanager for qpid HA.
>
> -Steve
>
>> -----Original Message-----
>> From: lei.dai@airlink-software.com [mailto:lei.dai@airlink-software.com]
>> Sent: Sunday, November 20, 2016 4:54 AM
>> To: users <us...@qpid.apache.org>
>> Subject: [Qpid C++ Broker][HA] How to configure the HA-cluster without
>> rgmanager?
>>
>> Hi,
>>
>> I'm trying to configure the qpid HA-cluster without rgmanager but it doesn't
>> work.
>>
>> The version Infos:
>> ---------------------------
>> CentOS 7.2
>> qpid-cpp-1.35.0
>> qpid-proton-0.14.0
>> ---------------------------
>>
>> I installed qpid-cpp and qpid-proton in according to the INSTALL.txt with
>> default configurations on 3 CentOS VMs.
>> The IP addresses are: 172.16.28.231, 172.16.28.232, 172.16.23.233.
>>
>> Started qpid on every VM with command:
>> $qpidd --auth no --ha-cluster yes --ha-brokers-url
>> 172.16.28.231,172.16.28.232,172.16.28.233
>>
>> But when I use qpid-ha to show the status of the cluster, all nodes are in
>> joining status.
>> It means the nodes didn't connect to each other?
>>
>> Did I have some mistakes in the configurations or the usage?
>> I read the documents on the qpid site. It says that rgmanager can manage
>> the cluster and set the primary node by calling qpidd-primary script.
>> But I didn't find the qpidd-primary script in my system.
>> Is the rgmanager necessary to use HA-cluster?
>>
>> Regards,
>>
>>
>> Lei Dai
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
> For additional commands, e-mail: users-help@qpid.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
For additional commands, e-mail: users-help@qpid.apache.org
Re: RE: [Qpid C++ Broker][HA] How to configure the HA-cluster without rgmanager?
Posted by "lei.dai@airlink-software.com" <le...@airlink-software.com>.
Thank you for your reply.
In fact at the end I must use qpid on windows, so maybe I should find a substitute for rgmanager.
Regards,
Lei Dai
From: Steve Huston
Date: 2016-11-21 21:56
To: users@qpid.apache.org
Subject: RE: [Qpid C++ Broker][HA] How to configure the HA-cluster without rgmanager?
I am not an expert in all cluster things, but the only way I have seen qpid C++ brokers in a cluster is using rgmanager. It takes care of managing the need to move the cluster primary around. It also manages the virtual IP address assigned to the broker cluster - you didn't mention a virtual IP in your question, but you will need it to use rgmanager for qpid HA.
-Steve
> -----Original Message-----
> From: lei.dai@airlink-software.com [mailto:lei.dai@airlink-software.com]
> Sent: Sunday, November 20, 2016 4:54 AM
> To: users <us...@qpid.apache.org>
> Subject: [Qpid C++ Broker][HA] How to configure the HA-cluster without
> rgmanager?
>
> Hi,
>
> I'm trying to configure the qpid HA-cluster without rgmanager but it doesn't
> work.
>
> The version Infos:
> ---------------------------
> CentOS 7.2
> qpid-cpp-1.35.0
> qpid-proton-0.14.0
> ---------------------------
>
> I installed qpid-cpp and qpid-proton in according to the INSTALL.txt with
> default configurations on 3 CentOS VMs.
> The IP addresses are: 172.16.28.231, 172.16.28.232, 172.16.23.233.
>
> Started qpid on every VM with command:
> $qpidd --auth no --ha-cluster yes --ha-brokers-url
> 172.16.28.231,172.16.28.232,172.16.28.233
>
> But when I use qpid-ha to show the status of the cluster, all nodes are in
> joining status.
> It means the nodes didn't connect to each other?
>
> Did I have some mistakes in the configurations or the usage?
> I read the documents on the qpid site. It says that rgmanager can manage
> the cluster and set the primary node by calling qpidd-primary script.
> But I didn't find the qpidd-primary script in my system.
> Is the rgmanager necessary to use HA-cluster?
>
> Regards,
>
>
> Lei Dai
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
For additional commands, e-mail: users-help@qpid.apache.org
RE: [Qpid C++ Broker][HA] How to configure the HA-cluster without
rgmanager?
Posted by Steve Huston <sh...@riverace.com>.
I am not an expert in all cluster things, but the only way I have seen qpid C++ brokers in a cluster is using rgmanager. It takes care of managing the need to move the cluster primary around. It also manages the virtual IP address assigned to the broker cluster - you didn't mention a virtual IP in your question, but you will need it to use rgmanager for qpid HA.
-Steve
> -----Original Message-----
> From: lei.dai@airlink-software.com [mailto:lei.dai@airlink-software.com]
> Sent: Sunday, November 20, 2016 4:54 AM
> To: users <us...@qpid.apache.org>
> Subject: [Qpid C++ Broker][HA] How to configure the HA-cluster without
> rgmanager?
>
> Hi,
>
> I'm trying to configure the qpid HA-cluster without rgmanager but it doesn't
> work.
>
> The version Infos:
> ---------------------------
> CentOS 7.2
> qpid-cpp-1.35.0
> qpid-proton-0.14.0
> ---------------------------
>
> I installed qpid-cpp and qpid-proton in according to the INSTALL.txt with
> default configurations on 3 CentOS VMs.
> The IP addresses are: 172.16.28.231, 172.16.28.232, 172.16.23.233.
>
> Started qpid on every VM with command:
> $qpidd --auth no --ha-cluster yes --ha-brokers-url
> 172.16.28.231,172.16.28.232,172.16.28.233
>
> But when I use qpid-ha to show the status of the cluster, all nodes are in
> joining status.
> It means the nodes didn't connect to each other?
>
> Did I have some mistakes in the configurations or the usage?
> I read the documents on the qpid site. It says that rgmanager can manage
> the cluster and set the primary node by calling qpidd-primary script.
> But I didn't find the qpidd-primary script in my system.
> Is the rgmanager necessary to use HA-cluster?
>
> Regards,
>
>
> Lei Dai
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
For additional commands, e-mail: users-help@qpid.apache.org
Re: Re: [Qpid C++ Broker][HA] How to configure the HA-cluster without rgmanager?
Posted by "lei.dai@airlink-software.com" <le...@airlink-software.com>.
Oh, yes, finally I found the qpidd-primary in /usr/local/etc/rc.d/init.d.
Now I can set the primary node by calling "qpid-ha promote --cluster-manager" with a -b parameter to specify the IP address.
But indeed if the primary node dead, the cluster cannot elect new primary automatically without rgmanager or other cluster-managers.
In fact, I will have to use qpid on windows, so maybe I must find a substitute for rgmanager.
Thanks.
Regards,
Lei Dai
From: Alan Conway
Date: 2016-11-22 06:20
To: users@qpid.apache.org
Subject: Re: [Qpid C++ Broker][HA] How to configure the HA-cluster without rgmanager?
On Sun, 2016-11-20 at 17:53 +0800, lei.dai@airlink-software.com wrote:
> Hi,
>
> I'm trying to configure the qpid HA-cluster without rgmanager but it
> doesn't work.
>
> The version Infos:
> ---------------------------
> CentOS 7.2
> qpid-cpp-1.35.0
> qpid-proton-0.14.0
> ---------------------------
>
> I installed qpid-cpp and qpid-proton in according to the INSTALL.txt
> with default configurations on 3 CentOS VMs.
> The IP addresses are: 172.16.28.231, 172.16.28.232, 172.16.23.233.
>
> Started qpid on every VM with command:
> $qpidd --auth no --ha-cluster yes --ha-brokers-url
> 172.16.28.231,172.16.28.232,172.16.28.233
>
> But when I use qpid-ha to show the status of the cluster, all nodes
> are in joining status.
> It means the nodes didn't connect to each other?
rgmanager is the thing that promotes the initial primary, and promotes
a new primary if that fails. The brokers are waiting for something to
promote one of them.
> Did I have some mistakes in the configurations or the usage?
> I read the documents on the qpid site. It says that rgmanager can
> manage the cluster and set the primary node by calling qpidd-primary
> script.
> But I didn't find the qpidd-primary script in my system.
Looks like it has been converted to a systemd script:
/usr/lib/systemd/system/qpidd-primary.service
It simply calls `qpid-ha promote`
> Is the rgmanager necessary to use HA-cluster?
You need something to do the basic cluster-management tasks:
- detect primary failure, choose a backup to promote
- ensure exactly one primary is running at all times
- enforce quorum
Qpid HA is designed so that you can use something other than rgmanager
(e.g. pacemaker) but only scripts for rgmanager are provided. If you
want to use something else you'd need to write your own scripts.
Cheers,
Alan.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
For additional commands, e-mail: users-help@qpid.apache.org
Re: [Qpid C++ Broker][HA] How to configure the HA-cluster without
rgmanager?
Posted by Alan Conway <ac...@redhat.com>.
On Sun, 2016-11-20 at 17:53 +0800, lei.dai@airlink-software.com wrote:
> Hi,
>
> I'm trying to configure the qpid HA-cluster without rgmanager but it
> doesn't work.
>
> The version Infos:
> ---------------------------
> CentOS 7.2
> qpid-cpp-1.35.0
> qpid-proton-0.14.0
> ---------------------------
>
> I installed qpid-cpp and qpid-proton in according to the INSTALL.txt
> with default configurations on 3 CentOS VMs.
> The IP addresses are: 172.16.28.231, 172.16.28.232, 172.16.23.233.
>
> Started qpid on every VM with command:
> $qpidd --auth no --ha-cluster yes --ha-brokers-url
> 172.16.28.231,172.16.28.232,172.16.28.233
>
> But when I use qpid-ha to show the status of the cluster, all nodes
> are in joining status.
> It means the nodes didn't connect to each other?
rgmanager is the thing that promotes the initial primary, and promotes
a new primary if that fails. The brokers are waiting for something to
promote one of them.
> Did I have some mistakes in the configurations or the usage?
> I read the documents on the qpid site. It says that rgmanager can
> manage the cluster and set the primary node by calling qpidd-primary
> script.
> But I didn't find the qpidd-primary script in my system.
Looks like it has been converted to a systemd script:
� �/usr/lib/systemd/system/qpidd-primary.service
It simply calls `qpid-ha promote`
> Is the rgmanager necessary to use HA-cluster?
You need something to do the basic cluster-management tasks:
- detect primary failure, choose a backup to promote
- ensure exactly one primary is running at all times
- enforce quorum
Qpid HA is designed so that you can use something other than rgmanager
(e.g. pacemaker) but only scripts for rgmanager are provided. If you
want to use something else you'd need to write your own scripts.
Cheers,
Alan.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
For additional commands, e-mail: users-help@qpid.apache.org