You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@qpid.apache.org by gregory james marsh <ma...@cse.ohio-state.edu> on 2008/10/30 20:44:39 UTC

Qpid broker federation use case info?


Hello,

I'm experimenting with Qpid broker federation functionality.  I've noticed
that there are a number of concepts and scenarios listed on the following
page:

http://cwiki.apache.org/qpid/using-broker-federation.html

However, there are no links with details for each item on the list.  Does
anybody have any references/links to further information about these
scenarios.

Thanks,

Greg Marsh




Re: Qpid broker federation use case info?

Posted by Carl Trieloff <cc...@redhat.com>.
mark yoffe wrote:
> Hi
>
> can anyone explain the benefits of federation
>
> and the proposed use scenario's
>
> furthermore it is supproted in M3
> and in Trunk?


difference between federation and cluster is probably the first thing to 
comment on.

Clustering give HA, Federation allows you to build networks of brokers.

These networks can be used in many ways, some examples are

multi data center ( have broker in one data center  A and another one in 
data center B). All the
clients can connect to the local broker, and can consume from client 
publishing in the remote
data center.

Load distribution, tree type patterns a can be configured for such cases..

abstraction/scaling - federation can be used to domain or scale a 
deployment.

Basically, you can build any tree, mesh or hub-spoke model with federation.

I think of it as follows: When you use qpid-route, the links are like 
wiring machines
together with network cable. How are the connections patched.

Then, in M3 you can create static routes, like static IP tables. In M4 
(trunk) you can setup
routes to be fully dynamic (lot easier to admin)

easiest is to just start a few brokers on your local machine with 
different ports and wire a few
cases together.

Carl.









Re: Qpid broker federation use case info?

Posted by Carl Trieloff <cc...@redhat.com>.
mark yoffe wrote:
> Hi
>
> can anyone explain the benefits of federation
>
> and the proposed use scenario's
>
> furthermore it is supproted in M3
> and in Trunk?


difference between federation and cluster is probably the first thing to 
comment on.

Clustering give HA, Federation allows you to build networks of brokers.

These networks can be used in many ways, some examples are

multi data center ( have broker in one data center  A and another one in 
data center B). All the
clients can connect to the local broker, and can consume from client 
publishing in the remote
data center.

Load distribution, tree type patterns a can be configured for such cases..

abstraction/scaling - federation can be used to domain or scale a 
deployment.

Basically, you can build any tree, mesh or hub-spoke model with federation.

I think of it as follows: When you use qpid-route, the links are like 
wiring machines
together with network cable. How are the connections patched.

Then, in M3 you can create static routes, like static IP tables. In M4 
(trunk) you can setup
routes to be fully dynamic (lot easier to admin)

easiest is to just start a few brokers on your local machine with 
different ports and wire a few
cases together.

Carl.









Re: Qpid broker federation use case info?

Posted by mark yoffe <ma...@gmail.com>.
Hi

can anyone explain the benefits of federation

and the proposed use scenario's

furthermore it is supproted in M3
and in Trunk?

On Thu, Oct 30, 2008 at 10:06 PM, Ted Ross <tr...@redhat.com> wrote:

>  gregory james marsh wrote:
>
>> Hello,
>>
>> I'm experimenting with Qpid broker federation functionality.  I've noticed
>> that there are a number of concepts and scenarios listed on the following
>> page:
>>
>> http://cwiki.apache.org/qpid/using-broker-federation.html
>>
>> However, there are no links with details for each item on the list.  Does
>> anybody have any references/links to further information about these
>> scenarios.
>>
>> Thanks,
>>
>> Greg Marsh
>>
>>
>>
>>
>>
> Hi Greg,
>
> I'm planning to start fleshing out that Wiki page starting next week.
>  There are some new federation features that make it much easier to
> configure that need to be written up.  These features are in place on the
> Subversion trunk and will be included in the soon-to-be-released M4 release.
>  They are implemented only on the C++ broker at present.
>
> In the mean time, I'd be happy to help get you started and answer any
> questions you'd like to ask on the mailing list.
>
> Do you have a particular use-case in mind?
>
> I'll send out some setup scripts that illustrate various federation
> topologies.
>
> Regards,
>
> -Ted
>
>

Re: Qpid broker federation use case info?

Posted by mark yoffe <ma...@gmail.com>.
Hi

can anyone explain the benefits of federation

and the proposed use scenario's

furthermore it is supproted in M3
and in Trunk?

On Thu, Oct 30, 2008 at 10:06 PM, Ted Ross <tr...@redhat.com> wrote:

>  gregory james marsh wrote:
>
>> Hello,
>>
>> I'm experimenting with Qpid broker federation functionality.  I've noticed
>> that there are a number of concepts and scenarios listed on the following
>> page:
>>
>> http://cwiki.apache.org/qpid/using-broker-federation.html
>>
>> However, there are no links with details for each item on the list.  Does
>> anybody have any references/links to further information about these
>> scenarios.
>>
>> Thanks,
>>
>> Greg Marsh
>>
>>
>>
>>
>>
> Hi Greg,
>
> I'm planning to start fleshing out that Wiki page starting next week.
>  There are some new federation features that make it much easier to
> configure that need to be written up.  These features are in place on the
> Subversion trunk and will be included in the soon-to-be-released M4 release.
>  They are implemented only on the C++ broker at present.
>
> In the mean time, I'd be happy to help get you started and answer any
> questions you'd like to ask on the mailing list.
>
> Do you have a particular use-case in mind?
>
> I'll send out some setup scripts that illustrate various federation
> topologies.
>
> Regards,
>
> -Ted
>
>

Re: Release info

Posted by Carl Trieloff <cc...@redhat.com>.
Steve Huston wrote:
> Hi Carl,
>
>   
>> I updated this page to answer a question that was directed at 
>> me. please 
>> help fill in the feature list for the M3 / M4 release. I 
>> expect it will help our users and then we
>> can link doc to each item in the list over time.
>>
>> http://cwiki.apache.org/confluence/display/qpid/roadmap
>>     
>
> The Windows port is for C++ client and broker.
>
> -Steve
>
>   

updated

RE: Release info

Posted by Steve Huston <sh...@riverace.com>.
Hi Carl,

> I updated this page to answer a question that was directed at 
> me. please 
> help fill in the feature list for the M3 / M4 release. I 
> expect it will help our users and then we
> can link doc to each item in the list over time.
> 
> http://cwiki.apache.org/confluence/display/qpid/roadmap

The Windows port is for C++ client and broker.

-Steve


Release info

Posted by Carl Trieloff <cc...@redhat.com>.
all,

I updated this page to answer a question that was directed at me. please 
help fill in the feature list for the M3 / M4 release. I expect it will 
help our users and then we
can link doc to each item in the list over time.

http://cwiki.apache.org/confluence/display/qpid/roadmap

Carl.

Re: Qpid broker federation use case info?

Posted by Ted Ross <tr...@redhat.com>.
gregory james marsh wrote:
> On Thu, 30 Oct 2008, Ted Ross wrote:
>
>   
>> Hi Greg,
>>
>> I'm planning to start fleshing out that Wiki page starting next week.
>> There are some new federation features that make it much easier to
>> configure that need to be written up.  These features are in place on
>> the Subversion trunk and will be included in the soon-to-be-released M4
>> release.  They are implemented only on the C++ broker at present.
>>
>> In the mean time, I'd be happy to help get you started and answer any
>> questions you'd like to ask on the mailing list.
>>
>> Do you have a particular use-case in mind?
>>
>> I'll send out some setup scripts that illustrate various federation
>> topologies.
>>
>> Regards,
>>
>> -Ted
>>
>>     
>
>
>
> Hi Ted,
>
> Thank you for the prompt reply.
>
> My group is planning performance and scalability studies with the broker
> federation concept on our cluster.  We'd be very interested in learning
> about any use cases oriented toward these ends.
>
> Thanks,
>
> Greg
>
>
>
>   
Greg,

Here's a link to the current draft for federation.  There are still some 
missing sections.

http://cwiki.apache.org/confluence/display/qpid/Using+Broker+Federation

I'm hoping to have it complete by tomorrow.  Feedback is always welcome.

Regards,

-Ted


Re: Qpid broker federation use case info?

Posted by Carl Trieloff <cc...@redhat.com>.
gregory james marsh wrote:
> On Thu, 30 Oct 2008, Ted Ross wrote:
>
>   
>> Hi Greg,
>>
>> I'm planning to start fleshing out that Wiki page starting next week.
>> There are some new federation features that make it much easier to
>> configure that need to be written up.  These features are in place on
>> the Subversion trunk and will be included in the soon-to-be-released M4
>> release.  They are implemented only on the C++ broker at present.
>>
>> In the mean time, I'd be happy to help get you started and answer any
>> questions you'd like to ask on the mailing list.
>>
>> Do you have a particular use-case in mind?
>>
>> I'll send out some setup scripts that illustrate various federation
>> topologies.
>>
>> Regards,
>>
>> -Ted
>>
>>     
>
>
>
> Hi Ted,
>
> Thank you for the prompt reply.
>
> My group is planning performance and scalability studies with the broker
> federation concept on our cluster.  We'd be very interested in learning
> about any use cases oriented toward these ends.
>
> Thanks,
>
> Greg
>
>   

Great, from my tests, Federation does not impose much penalty. please 
post your finding back to the
list. You might also want to play with RDMA on the federation links, if 
you have gear for that.

Carl.



>
>   


Re: Qpid broker federation use case info?

Posted by gregory james marsh <ma...@cse.ohio-state.edu>.

On Thu, 30 Oct 2008, Ted Ross wrote:

> Hi Greg,
>
> I'm planning to start fleshing out that Wiki page starting next week.
> There are some new federation features that make it much easier to
> configure that need to be written up.  These features are in place on
> the Subversion trunk and will be included in the soon-to-be-released M4
> release.  They are implemented only on the C++ broker at present.
>
> In the mean time, I'd be happy to help get you started and answer any
> questions you'd like to ask on the mailing list.
>
> Do you have a particular use-case in mind?
>
> I'll send out some setup scripts that illustrate various federation
> topologies.
>
> Regards,
>
> -Ted
>



Hi Ted,

Thank you for the prompt reply.

My group is planning performance and scalability studies with the broker
federation concept on our cluster.  We'd be very interested in learning
about any use cases oriented toward these ends.

Thanks,

Greg




Re: Qpid broker federation use case info?

Posted by Ted Ross <tr...@redhat.com>.
gregory james marsh wrote:
> Hello,
>
> I'm experimenting with Qpid broker federation functionality.  I've noticed
> that there are a number of concepts and scenarios listed on the following
> page:
>
> http://cwiki.apache.org/qpid/using-broker-federation.html
>
> However, there are no links with details for each item on the list.  Does
> anybody have any references/links to further information about these
> scenarios.
>
> Thanks,
>
> Greg Marsh
>
>
>
>   
Hi Greg,

I'm planning to start fleshing out that Wiki page starting next week.  
There are some new federation features that make it much easier to 
configure that need to be written up.  These features are in place on 
the Subversion trunk and will be included in the soon-to-be-released M4 
release.  They are implemented only on the C++ broker at present.

In the mean time, I'd be happy to help get you started and answer any 
questions you'd like to ask on the mailing list.

Do you have a particular use-case in mind?

I'll send out some setup scripts that illustrate various federation 
topologies.

Regards,

-Ted


Re: Qpid broker federation use case info?

Posted by Ted Ross <tr...@redhat.com>.
gregory james marsh wrote:
> Hello,
>
> I'm experimenting with Qpid broker federation functionality.  I've noticed
> that there are a number of concepts and scenarios listed on the following
> page:
>
> http://cwiki.apache.org/qpid/using-broker-federation.html
>
> However, there are no links with details for each item on the list.  Does
> anybody have any references/links to further information about these
> scenarios.
>
> Thanks,
>
> Greg Marsh
>
>
>
>   
Hi Greg,

I'm planning to start fleshing out that Wiki page starting next week.  
There are some new federation features that make it much easier to 
configure that need to be written up.  These features are in place on 
the Subversion trunk and will be included in the soon-to-be-released M4 
release.  They are implemented only on the C++ broker at present.

In the mean time, I'd be happy to help get you started and answer any 
questions you'd like to ask on the mailing list.

Do you have a particular use-case in mind?

I'll send out some setup scripts that illustrate various federation 
topologies.

Regards,

-Ted