You are viewing a plain text version of this content. The canonical link for it is here.
Posted to distributedlog-dev@bookkeeper.apache.org by Jay Juma <ja...@gmail.com> on 2016/12/15 02:21:49 UTC
ZK subscription store
Hi,
Currently there is a zookeeper based subscription store in DL. Why can't DL
store it using a log segment (ledger) and offer this capability in
distributedlog service?
- Jay
Re: ZK subscription store
Posted by Jay Juma <ja...@gmail.com>.
Sijie,
Thank you for your reply.
I created a proposal about using log segment to store the subscription
updates for the subscription store.
https://cwiki.apache.org/confluence/display/DL/DP-7+-+LogSegment+based+subscription+store
Let me know if you have any suggestions.
- Jay
On Thu, Dec 15, 2016 at 11:34 AM, Sijie Guo <si...@twitter.com> wrote:
> Hmm, this is a good idea. yes, we can use a log segment to store the DLSN
> changes for the subscription store. And I think that's basically how Pulsar
> is doing with its cursors.
>
> beside this, I had a brief discussion with Matteo Merli (who is the TL of
> Pulsar) about distributedlog and managedledger in Pulsar to see if we can
> standardize the 'log stream' representation over BookKeeper, so that Pulsar
> and the DL proxy services can use the same 'log stream' representation.
> However It requires more discussions between DL and Pulsar.
>
> If you are going to implement this, you might check pulsar's managedledger.
>
> - Sijie
>
>
> On Wed, Dec 14, 2016 at 6:21 PM, Jay Juma <ja...@gmail.com> wrote:
>
>> Hi,
>>
>> Currently there is a zookeeper based subscription store in DL. Why can't
>> DL store it using a log segment (ledger) and offer this capability in
>> distributedlog service?
>>
>> - Jay
>>
>
>
Re: ZK subscription store
Posted by Jay Juma <ja...@gmail.com>.
Sijie,
Thank you for your reply.
I created a proposal about using log segment to store the subscription
updates for the subscription store.
https://cwiki.apache.org/confluence/display/DL/DP-7+-+LogSegment+based+subscription+store
Let me know if you have any suggestions.
- Jay
On Thu, Dec 15, 2016 at 11:34 AM, Sijie Guo <si...@twitter.com> wrote:
> Hmm, this is a good idea. yes, we can use a log segment to store the DLSN
> changes for the subscription store. And I think that's basically how Pulsar
> is doing with its cursors.
>
> beside this, I had a brief discussion with Matteo Merli (who is the TL of
> Pulsar) about distributedlog and managedledger in Pulsar to see if we can
> standardize the 'log stream' representation over BookKeeper, so that Pulsar
> and the DL proxy services can use the same 'log stream' representation.
> However It requires more discussions between DL and Pulsar.
>
> If you are going to implement this, you might check pulsar's managedledger.
>
> - Sijie
>
>
> On Wed, Dec 14, 2016 at 6:21 PM, Jay Juma <ja...@gmail.com> wrote:
>
>> Hi,
>>
>> Currently there is a zookeeper based subscription store in DL. Why can't
>> DL store it using a log segment (ledger) and offer this capability in
>> distributedlog service?
>>
>> - Jay
>>
>
>
Re: ZK subscription store
Posted by Sijie Guo <si...@twitter.com.INVALID>.
Hmm, this is a good idea. yes, we can use a log segment to store the DLSN
changes for the subscription store. And I think that's basically how Pulsar
is doing with its cursors.
beside this, I had a brief discussion with Matteo Merli (who is the TL of
Pulsar) about distributedlog and managedledger in Pulsar to see if we can
standardize the 'log stream' representation over BookKeeper, so that Pulsar
and the DL proxy services can use the same 'log stream' representation.
However It requires more discussions between DL and Pulsar.
If you are going to implement this, you might check pulsar's managedledger.
- Sijie
On Wed, Dec 14, 2016 at 6:21 PM, Jay Juma <ja...@gmail.com> wrote:
> Hi,
>
> Currently there is a zookeeper based subscription store in DL. Why can't
> DL store it using a log segment (ledger) and offer this capability in
> distributedlog service?
>
> - Jay
>
Re: ZK subscription store
Posted by Sijie Guo <si...@twitter.com>.
Hmm, this is a good idea. yes, we can use a log segment to store the DLSN
changes for the subscription store. And I think that's basically how Pulsar
is doing with its cursors.
beside this, I had a brief discussion with Matteo Merli (who is the TL of
Pulsar) about distributedlog and managedledger in Pulsar to see if we can
standardize the 'log stream' representation over BookKeeper, so that Pulsar
and the DL proxy services can use the same 'log stream' representation.
However It requires more discussions between DL and Pulsar.
If you are going to implement this, you might check pulsar's managedledger.
- Sijie
On Wed, Dec 14, 2016 at 6:21 PM, Jay Juma <ja...@gmail.com> wrote:
> Hi,
>
> Currently there is a zookeeper based subscription store in DL. Why can't
> DL store it using a log segment (ledger) and offer this capability in
> distributedlog service?
>
> - Jay
>