You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@qpid.apache.org by An Yang <an...@waycooler.co> on 2014/10/06 19:00:52 UTC
How to enable rdma protocol between qpid-ha internal cluster?
Hi all,
In infiniband env, if ha-brokers-url = 20.0.10.1, 20.0.10.2, 20.0.10.3, qpid-primary service will use the default tcp protocol to pass replicate data.
How can I use the rdma protocol between primary server and the backup severs?
Bests,
An Yang
Re: How to enable rdma protocol between qpid-ha internal cluster?
Posted by An Yang <an...@waycooler.co>.
Hi Chuck,
If I start qpidd daemon without any argument, the rdma module will be auto loaded;
If I start qpidd with --load-module /usr/lib64/qpid/daemon/rdma.so, qpidd got segment fault with the following error:
qpidd: /builddir/build/BUILD/qpid-0.22/cpp/src/qpid/sys/rdma/rdma_wrap.h:82: Void Rdma::Buffer::dataount(int 32_t): Assertion 's <= bufferSize + reservered' failed.
------------------ Original ------------------
From: "Chuck Rolke"<cr...@redhat.com>;
Date: Wed, Oct 8, 2014 02:07 AM
To: "users"<us...@qpid.apache.org>;
Subject: Re: How to enable rdma protocol between qpid-ha internal cluster?
According to the 0.22 docs at http://qpid.apache.org/releases/qpid-0.22/cpp-broker/book/chapter-ha.html section 1.11.3 your addresses should work. Are you loading the rdma module when the broker starts?
----- Original Message -----
> From: "An Yang" <an...@waycooler.co>
> To: "users" <us...@qpid.apache.org>
> Sent: Monday, October 6, 2014 10:05:48 PM
> Subject: Re: How to enable rdma protocol between qpid-ha internal cluster?
>
> Hi Chuck,
>
> I got the following errors:
> Daemon startup failed: Invalid URL: rdma:20.0.1.1,rdma:20.0.1.2,rdma:20.0.1.3
> (builddir/build/BUILD/qpid-0.22/cpp/src/qpid/Url.cpp:246)
>
> I'm using qpid-0.22, and rdma transport works fine in standalone qpidd
> server, did I miss something?
>
>
> ------------------ Original ------------------
> From: "Chuck Rolke"<cr...@redhat.com>;
> Date: Tue, Oct 7, 2014 02:03 AM
> To: "users"<us...@qpid.apache.org>;
>
> Subject: Re: How to enable rdma protocol between qpid-ha internal cluster?
>
>
> Try specifying the rdma transport for the addresses you need.
>
> rdma:20.0.10.1, rdma:20.0.10.2, rdma:20.0.10.3
>
> using 'rdma' instead of the default 'tcp'.
>
> -Chuck
>
> ----- Original Message -----
> > From: "An Yang" <an...@waycooler.co>
> > To: "users" <us...@qpid.apache.org>
> > Sent: Monday, October 6, 2014 1:00:52 PM
> > Subject: How to enable rdma protocol between qpid-ha internal cluster?
> >
> > Hi all,
> >
> > In infiniband env, if ha-brokers-url = 20.0.10.1, 20.0.10.2, 20.0.10.3,
> > qpid-primary service will use the default tcp protocol to pass replicate
> > data.
> > How can I use the rdma protocol between primary server and the backup
> > severs?
> >
> > Bests,
> > An Yang
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
> For additional commands, e-mail: users-help@qpid.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
For additional commands, e-mail: users-help@qpid.apache.org
Re: How to enable rdma protocol between qpid-ha internal cluster?
Posted by Chuck Rolke <cr...@redhat.com>.
According to the 0.22 docs at http://qpid.apache.org/releases/qpid-0.22/cpp-broker/book/chapter-ha.html section 1.11.3 your addresses should work. Are you loading the rdma module when the broker starts?
----- Original Message -----
> From: "An Yang" <an...@waycooler.co>
> To: "users" <us...@qpid.apache.org>
> Sent: Monday, October 6, 2014 10:05:48 PM
> Subject: Re: How to enable rdma protocol between qpid-ha internal cluster?
>
> Hi Chuck,
>
> I got the following errors:
> Daemon startup failed: Invalid URL: rdma:20.0.1.1,rdma:20.0.1.2,rdma:20.0.1.3
> (builddir/build/BUILD/qpid-0.22/cpp/src/qpid/Url.cpp:246)
>
> I'm using qpid-0.22, and rdma transport works fine in standalone qpidd
> server, did I miss something?
>
>
> ------------------ Original ------------------
> From: "Chuck Rolke"<cr...@redhat.com>;
> Date: Tue, Oct 7, 2014 02:03 AM
> To: "users"<us...@qpid.apache.org>;
>
> Subject: Re: How to enable rdma protocol between qpid-ha internal cluster?
>
>
> Try specifying the rdma transport for the addresses you need.
>
> rdma:20.0.10.1, rdma:20.0.10.2, rdma:20.0.10.3
>
> using 'rdma' instead of the default 'tcp'.
>
> -Chuck
>
> ----- Original Message -----
> > From: "An Yang" <an...@waycooler.co>
> > To: "users" <us...@qpid.apache.org>
> > Sent: Monday, October 6, 2014 1:00:52 PM
> > Subject: How to enable rdma protocol between qpid-ha internal cluster?
> >
> > Hi all,
> >
> > In infiniband env, if ha-brokers-url = 20.0.10.1, 20.0.10.2, 20.0.10.3,
> > qpid-primary service will use the default tcp protocol to pass replicate
> > data.
> > How can I use the rdma protocol between primary server and the backup
> > severs?
> >
> > Bests,
> > An Yang
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
> For additional commands, e-mail: users-help@qpid.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
For additional commands, e-mail: users-help@qpid.apache.org
Re: How to enable rdma protocol between qpid-ha internal cluster?
Posted by An Yang <an...@waycooler.co>.
Hi Chuck,
I got the following errors:
Daemon startup failed: Invalid URL: rdma:20.0.1.1,rdma:20.0.1.2,rdma:20.0.1.3 (builddir/build/BUILD/qpid-0.22/cpp/src/qpid/Url.cpp:246)
I'm using qpid-0.22, and rdma transport works fine in standalone qpidd server, did I miss something?
------------------ Original ------------------
From: "Chuck Rolke"<cr...@redhat.com>;
Date: Tue, Oct 7, 2014 02:03 AM
To: "users"<us...@qpid.apache.org>;
Subject: Re: How to enable rdma protocol between qpid-ha internal cluster?
Try specifying the rdma transport for the addresses you need.
rdma:20.0.10.1, rdma:20.0.10.2, rdma:20.0.10.3
using 'rdma' instead of the default 'tcp'.
-Chuck
----- Original Message -----
> From: "An Yang" <an...@waycooler.co>
> To: "users" <us...@qpid.apache.org>
> Sent: Monday, October 6, 2014 1:00:52 PM
> Subject: How to enable rdma protocol between qpid-ha internal cluster?
>
> Hi all,
>
> In infiniband env, if ha-brokers-url = 20.0.10.1, 20.0.10.2, 20.0.10.3,
> qpid-primary service will use the default tcp protocol to pass replicate
> data.
> How can I use the rdma protocol between primary server and the backup severs?
>
> Bests,
> An Yang
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
For additional commands, e-mail: users-help@qpid.apache.org
Re: How to enable rdma protocol between qpid-ha internal cluster?
Posted by Chuck Rolke <cr...@redhat.com>.
Try specifying the rdma transport for the addresses you need.
rdma:20.0.10.1, rdma:20.0.10.2, rdma:20.0.10.3
using 'rdma' instead of the default 'tcp'.
-Chuck
----- Original Message -----
> From: "An Yang" <an...@waycooler.co>
> To: "users" <us...@qpid.apache.org>
> Sent: Monday, October 6, 2014 1:00:52 PM
> Subject: How to enable rdma protocol between qpid-ha internal cluster?
>
> Hi all,
>
> In infiniband env, if ha-brokers-url = 20.0.10.1, 20.0.10.2, 20.0.10.3,
> qpid-primary service will use the default tcp protocol to pass replicate
> data.
> How can I use the rdma protocol between primary server and the backup severs?
>
> Bests,
> An Yang
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@qpid.apache.org
For additional commands, e-mail: users-help@qpid.apache.org