You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@qpid.apache.org by Robert Godfrey <ro...@gmail.com> on 2010/01/12 15:12:20 UTC

Queue State Replication / Event Generation

Should *someone* wish to implement the Queue State Replication that the C++
broker implements[1], is there any documentation around how the underlying
communication of enqueues/dequeues occurs between brokers (I have only found
documentation targeted at users so far)?

Cheers,
Rob

[1] http://cwiki.apache.org/confluence/display/qpid/queue+state+replication

Re: Queue State Replication / Event Generation

Posted by Gordon Sim <gs...@redhat.com>.
On 01/12/2010 02:43 PM, Robert Godfrey wrote:
> Thanks Gordon...
>
> it may be a little while before I get round to implementing it in the
> Java... need to finish of the QMF/Federation piece first and then I'll
> probably do Ring Queues, LVQ, etc...

There are some shortcomings with this scheme as well, so would be worth 
some discussion at some point on how best to address them.

One issue is that its not possible to start and stop replication. 
Another is that there is no effective flow control that prevents the 
replication queue expanding too much.

It would also be nice to be able to (perhaps optionally) tie replication 
success to completion status of the original command. Also some scheme 
for coalescing redundant events would be good (i.e. where you enqueue 
and dequeue rapidly and raise bothe events before either has actually 
been transmitted to the remote site).


>
> Cheers,
> Rob
>
> 2010/1/12 Gordon Sim<gs...@redhat.com>
>
>> On 01/12/2010 02:12 PM, Robert Godfrey wrote:
>>
>>> Should *someone* wish to implement the Queue State Replication that the
>>> C++
>>> broker implements[1], is there any documentation around how the underlying
>>> communication of enqueues/dequeues occurs between brokers (I have only
>>> found
>>> documentation targeted at users so far)?
>>>
>>
>> Not in any detail. The design was posted on the jira[1] and comments
>> requested on the dev list[2] but there is no specification level document
>> I'm afraid, we will have to reverse engineer that out from the source.
>>
>> [1]
>> http://issues.apache.org/jira/browse/QPID-1567?page=com.atlassian.jira.plugin.system.issuetabpanels%3Aall-tabpanel
>>
>> [2] http://markmail.org/message/wcip7eer7u2pwz2k
>>
>> ---------------------------------------------------------------------
>> Apache Qpid - AMQP Messaging Implementation
>> Project:      http://qpid.apache.org
>> Use/Interact: mailto:dev-subscribe@qpid.apache.org
>>
>>
>


---------------------------------------------------------------------
Apache Qpid - AMQP Messaging Implementation
Project:      http://qpid.apache.org
Use/Interact: mailto:dev-subscribe@qpid.apache.org


Re: Queue State Replication / Event Generation

Posted by Robert Godfrey <ro...@gmail.com>.
Thanks Gordon...

it may be a little while before I get round to implementing it in the
Java... need to finish of the QMF/Federation piece first and then I'll
probably do Ring Queues, LVQ, etc...

Cheers,
Rob

2010/1/12 Gordon Sim <gs...@redhat.com>

> On 01/12/2010 02:12 PM, Robert Godfrey wrote:
>
>> Should *someone* wish to implement the Queue State Replication that the
>> C++
>> broker implements[1], is there any documentation around how the underlying
>> communication of enqueues/dequeues occurs between brokers (I have only
>> found
>> documentation targeted at users so far)?
>>
>
> Not in any detail. The design was posted on the jira[1] and comments
> requested on the dev list[2] but there is no specification level document
> I'm afraid, we will have to reverse engineer that out from the source.
>
> [1]
> http://issues.apache.org/jira/browse/QPID-1567?page=com.atlassian.jira.plugin.system.issuetabpanels%3Aall-tabpanel
>
> [2] http://markmail.org/message/wcip7eer7u2pwz2k
>
> ---------------------------------------------------------------------
> Apache Qpid - AMQP Messaging Implementation
> Project:      http://qpid.apache.org
> Use/Interact: mailto:dev-subscribe@qpid.apache.org
>
>

Re: Queue State Replication / Event Generation

Posted by Gordon Sim <gs...@redhat.com>.
On 01/12/2010 02:12 PM, Robert Godfrey wrote:
> Should *someone* wish to implement the Queue State Replication that the C++
> broker implements[1], is there any documentation around how the underlying
> communication of enqueues/dequeues occurs between brokers (I have only found
> documentation targeted at users so far)?

Not in any detail. The design was posted on the jira[1] and comments 
requested on the dev list[2] but there is no specification level 
document I'm afraid, we will have to reverse engineer that out from the 
source.

[1] 
http://issues.apache.org/jira/browse/QPID-1567?page=com.atlassian.jira.plugin.system.issuetabpanels%3Aall-tabpanel

[2] http://markmail.org/message/wcip7eer7u2pwz2k

---------------------------------------------------------------------
Apache Qpid - AMQP Messaging Implementation
Project:      http://qpid.apache.org
Use/Interact: mailto:dev-subscribe@qpid.apache.org