You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bookkeeper.apache.org by Sijie Guo <si...@apache.org> on 2015/09/16 04:51:35 UTC
DistributedLog, a high-performance replicated log service built over BookKeeper
Hello bookkeepers,
FYI. We published a blog post on DistributedLog, a replicated log service
built on Apache BookKeeper. The replicated log service has been used in
production for years, powering tier-0 services from transaction log for
distributed database, search ingestion pipeline to self-serve pub/sub
system.
Please check it out :
https://blog.twitter.com/2015/building-distributedlog-twitter-s-high-performance-replicated-log-service
And we'd like to share our experiences at the meetup on 9/21. Come and join
us!
- Sijie
Re: DistributedLog, a high-performance replicated log service built over BookKeeper
Posted by Flavio Junqueira <fp...@apache.org>.
I'm definitely not missing it!
-Flavio
> On 16 Sep 2015, at 03:26, Ivan Kelly <iv...@apache.org> wrote:
>
> This is excellent work Sijie :D It's a pity I can't make the meetup. Will it be recorded?
>
> -Ivan
>
> On Wed, Sep 16, 2015 at 4:51 AM Sijie Guo <sijie@apache.org <ma...@apache.org>> wrote:
> Hello bookkeepers,
>
> FYI. We published a blog post on DistributedLog, a replicated log service built on Apache BookKeeper. The replicated log service has been used in production for years, powering tier-0 services from transaction log for distributed database, search ingestion pipeline to self-serve pub/sub system.
>
> Please check it out : https://blog.twitter.com/2015/building-distributedlog-twitter-s-high-performance-replicated-log-service <https://blog.twitter.com/2015/building-distributedlog-twitter-s-high-performance-replicated-log-service>
>
> And we'd like to share our experiences at the meetup on 9/21. Come and join us!
>
> - Sijie
Re: DistributedLog, a high-performance replicated log service built
over BookKeeper
Posted by Venkateswara Rao Jujjuri <ju...@gmail.com>.
Awesome. I can't make it but love to have the recording. :-D
On Wed, Sep 16, 2015 at 9:33 AM, Sijie Guo <si...@apache.org> wrote:
> Thanks. Yup, we will record it, and also try periscope it.
>
> - Sijie
>
> On Wed, Sep 16, 2015 at 1:26 AM, Ivan Kelly <iv...@apache.org> wrote:
>
> > This is excellent work Sijie :D It's a pity I can't make the meetup. Will
> > it be recorded?
> >
> > -Ivan
> >
> > On Wed, Sep 16, 2015 at 4:51 AM Sijie Guo <si...@apache.org> wrote:
> >
> >> Hello bookkeepers,
> >>
> >> FYI. We published a blog post on DistributedLog, a replicated log
> service
> >> built on Apache BookKeeper. The replicated log service has been used in
> >> production for years, powering tier-0 services from transaction log for
> >> distributed database, search ingestion pipeline to self-serve pub/sub
> >> system.
> >>
> >> Please check it out :
> >>
> https://blog.twitter.com/2015/building-distributedlog-twitter-s-high-performance-replicated-log-service
> >>
> >> And we'd like to share our experiences at the meetup on 9/21. Come and
> >> join us!
> >>
> >> - Sijie
> >>
> >
>
--
Jvrao
---
First they ignore you, then they laugh at you, then they fight you, then
you win. - Mahatma Gandhi
Re: DistributedLog, a high-performance replicated log service built
over BookKeeper
Posted by Sijie Guo <si...@apache.org>.
Slides and video are public now.
- Slides are public now:
*
http://www.slideshare.net/MessagingMeetup/building-distributedlog-a-highperformance-replicated-log-service
*
http://www.slideshare.net/MessagingMeetup/the-many-faces-of-apache-kafka-leveraging-realtime-data-at-scale-53134996
*
http://www.slideshare.net/MessagingMeetup/cloud-messaging-service-technical-overview
- Video: https://www.youtube.com/watch?v=QW1OEQxcjZc
- Sijie
On Tue, Sep 22, 2015 at 12:51 AM, Sijie Guo <si...@apache.org> wrote:
> We did periscope during the event. We also have recorded a high-quality
> version, will publish them soon.
>
> Here the periscope links: (the phone die in the middle of the event. So
> there is some part missing in the second talk).
>
> https://www.periscope.tv/w/1vOxwnbzongJB (first part)
> https://www.periscope.tv/w/1YpKkXOadpXGj (second part)
>
> - Sijie
>
> On Wed, Sep 16, 2015 at 9:33 AM, Sijie Guo <si...@apache.org> wrote:
>
>> Thanks. Yup, we will record it, and also try periscope it.
>>
>> - Sijie
>>
>> On Wed, Sep 16, 2015 at 1:26 AM, Ivan Kelly <iv...@apache.org> wrote:
>>
>>> This is excellent work Sijie :D It's a pity I can't make the meetup.
>>> Will it be recorded?
>>>
>>> -Ivan
>>>
>>> On Wed, Sep 16, 2015 at 4:51 AM Sijie Guo <si...@apache.org> wrote:
>>>
>>>> Hello bookkeepers,
>>>>
>>>> FYI. We published a blog post on DistributedLog, a replicated log
>>>> service built on Apache BookKeeper. The replicated log service has been
>>>> used in production for years, powering tier-0 services from transaction log
>>>> for distributed database, search ingestion pipeline to self-serve pub/sub
>>>> system.
>>>>
>>>> Please check it out :
>>>> https://blog.twitter.com/2015/building-distributedlog-twitter-s-high-performance-replicated-log-service
>>>>
>>>> And we'd like to share our experiences at the meetup on 9/21. Come and
>>>> join us!
>>>>
>>>> - Sijie
>>>>
>>>
>>
>
Re: DistributedLog, a high-performance replicated log service built
over BookKeeper
Posted by Jia Zhai <zh...@gmail.com>.
Awesome
On Tue, Sep 22, 2015 at 3:51 PM, Sijie Guo <si...@apache.org> wrote:
> We did periscope during the event. We also have recorded a high-quality
> version, will publish them soon.
>
> Here the periscope links: (the phone die in the middle of the event. So
> there is some part missing in the second talk).
>
> https://www.periscope.tv/w/1vOxwnbzongJB (first part)
> https://www.periscope.tv/w/1YpKkXOadpXGj (second part)
>
> - Sijie
>
> On Wed, Sep 16, 2015 at 9:33 AM, Sijie Guo <si...@apache.org> wrote:
>
>> Thanks. Yup, we will record it, and also try periscope it.
>>
>> - Sijie
>>
>> On Wed, Sep 16, 2015 at 1:26 AM, Ivan Kelly <iv...@apache.org> wrote:
>>
>>> This is excellent work Sijie :D It's a pity I can't make the meetup.
>>> Will it be recorded?
>>>
>>> -Ivan
>>>
>>> On Wed, Sep 16, 2015 at 4:51 AM Sijie Guo <si...@apache.org> wrote:
>>>
>>>> Hello bookkeepers,
>>>>
>>>> FYI. We published a blog post on DistributedLog, a replicated log
>>>> service built on Apache BookKeeper. The replicated log service has been
>>>> used in production for years, powering tier-0 services from transaction log
>>>> for distributed database, search ingestion pipeline to self-serve pub/sub
>>>> system.
>>>>
>>>> Please check it out :
>>>> https://blog.twitter.com/2015/building-distributedlog-twitter-s-high-performance-replicated-log-service
>>>>
>>>> And we'd like to share our experiences at the meetup on 9/21. Come and
>>>> join us!
>>>>
>>>> - Sijie
>>>>
>>>
>>
>
Re: DistributedLog, a high-performance replicated log service built
over BookKeeper
Posted by Jia Zhai <zh...@gmail.com>.
Awesome
On Tue, Sep 22, 2015 at 3:51 PM, Sijie Guo <si...@apache.org> wrote:
> We did periscope during the event. We also have recorded a high-quality
> version, will publish them soon.
>
> Here the periscope links: (the phone die in the middle of the event. So
> there is some part missing in the second talk).
>
> https://www.periscope.tv/w/1vOxwnbzongJB (first part)
> https://www.periscope.tv/w/1YpKkXOadpXGj (second part)
>
> - Sijie
>
> On Wed, Sep 16, 2015 at 9:33 AM, Sijie Guo <si...@apache.org> wrote:
>
>> Thanks. Yup, we will record it, and also try periscope it.
>>
>> - Sijie
>>
>> On Wed, Sep 16, 2015 at 1:26 AM, Ivan Kelly <iv...@apache.org> wrote:
>>
>>> This is excellent work Sijie :D It's a pity I can't make the meetup.
>>> Will it be recorded?
>>>
>>> -Ivan
>>>
>>> On Wed, Sep 16, 2015 at 4:51 AM Sijie Guo <si...@apache.org> wrote:
>>>
>>>> Hello bookkeepers,
>>>>
>>>> FYI. We published a blog post on DistributedLog, a replicated log
>>>> service built on Apache BookKeeper. The replicated log service has been
>>>> used in production for years, powering tier-0 services from transaction log
>>>> for distributed database, search ingestion pipeline to self-serve pub/sub
>>>> system.
>>>>
>>>> Please check it out :
>>>> https://blog.twitter.com/2015/building-distributedlog-twitter-s-high-performance-replicated-log-service
>>>>
>>>> And we'd like to share our experiences at the meetup on 9/21. Come and
>>>> join us!
>>>>
>>>> - Sijie
>>>>
>>>
>>
>
Re: DistributedLog, a high-performance replicated log service built
over BookKeeper
Posted by Sijie Guo <si...@apache.org>.
Slides and video are public now.
- Slides are public now:
*
http://www.slideshare.net/MessagingMeetup/building-distributedlog-a-highperformance-replicated-log-service
*
http://www.slideshare.net/MessagingMeetup/the-many-faces-of-apache-kafka-leveraging-realtime-data-at-scale-53134996
*
http://www.slideshare.net/MessagingMeetup/cloud-messaging-service-technical-overview
- Video: https://www.youtube.com/watch?v=QW1OEQxcjZc
- Sijie
On Tue, Sep 22, 2015 at 12:51 AM, Sijie Guo <si...@apache.org> wrote:
> We did periscope during the event. We also have recorded a high-quality
> version, will publish them soon.
>
> Here the periscope links: (the phone die in the middle of the event. So
> there is some part missing in the second talk).
>
> https://www.periscope.tv/w/1vOxwnbzongJB (first part)
> https://www.periscope.tv/w/1YpKkXOadpXGj (second part)
>
> - Sijie
>
> On Wed, Sep 16, 2015 at 9:33 AM, Sijie Guo <si...@apache.org> wrote:
>
>> Thanks. Yup, we will record it, and also try periscope it.
>>
>> - Sijie
>>
>> On Wed, Sep 16, 2015 at 1:26 AM, Ivan Kelly <iv...@apache.org> wrote:
>>
>>> This is excellent work Sijie :D It's a pity I can't make the meetup.
>>> Will it be recorded?
>>>
>>> -Ivan
>>>
>>> On Wed, Sep 16, 2015 at 4:51 AM Sijie Guo <si...@apache.org> wrote:
>>>
>>>> Hello bookkeepers,
>>>>
>>>> FYI. We published a blog post on DistributedLog, a replicated log
>>>> service built on Apache BookKeeper. The replicated log service has been
>>>> used in production for years, powering tier-0 services from transaction log
>>>> for distributed database, search ingestion pipeline to self-serve pub/sub
>>>> system.
>>>>
>>>> Please check it out :
>>>> https://blog.twitter.com/2015/building-distributedlog-twitter-s-high-performance-replicated-log-service
>>>>
>>>> And we'd like to share our experiences at the meetup on 9/21. Come and
>>>> join us!
>>>>
>>>> - Sijie
>>>>
>>>
>>
>
Re: DistributedLog, a high-performance replicated log service built
over BookKeeper
Posted by Venkateswara Rao Jujjuri <ju...@gmail.com>.
These links now say, expired. Do we have more permanent/high-quality links?
On Tue, Sep 22, 2015 at 12:51 AM, Sijie Guo <si...@apache.org> wrote:
> We did periscope during the event. We also have recorded a high-quality
> version, will publish them soon.
>
> Here the periscope links: (the phone die in the middle of the event. So
> there is some part missing in the second talk).
>
> https://www.periscope.tv/w/1vOxwnbzongJB (first part)
> https://www.periscope.tv/w/1YpKkXOadpXGj (second part)
>
> - Sijie
>
> On Wed, Sep 16, 2015 at 9:33 AM, Sijie Guo <si...@apache.org> wrote:
>
> > Thanks. Yup, we will record it, and also try periscope it.
> >
> > - Sijie
> >
> > On Wed, Sep 16, 2015 at 1:26 AM, Ivan Kelly <iv...@apache.org> wrote:
> >
> >> This is excellent work Sijie :D It's a pity I can't make the meetup.
> Will
> >> it be recorded?
> >>
> >> -Ivan
> >>
> >> On Wed, Sep 16, 2015 at 4:51 AM Sijie Guo <si...@apache.org> wrote:
> >>
> >>> Hello bookkeepers,
> >>>
> >>> FYI. We published a blog post on DistributedLog, a replicated log
> >>> service built on Apache BookKeeper. The replicated log service has been
> >>> used in production for years, powering tier-0 services from
> transaction log
> >>> for distributed database, search ingestion pipeline to self-serve
> pub/sub
> >>> system.
> >>>
> >>> Please check it out :
> >>>
> https://blog.twitter.com/2015/building-distributedlog-twitter-s-high-performance-replicated-log-service
> >>>
> >>> And we'd like to share our experiences at the meetup on 9/21. Come and
> >>> join us!
> >>>
> >>> - Sijie
> >>>
> >>
> >
>
--
Jvrao
---
First they ignore you, then they laugh at you, then they fight you, then
you win. - Mahatma Gandhi
Re: DistributedLog, a high-performance replicated log service built
over BookKeeper
Posted by Sijie Guo <si...@apache.org>.
We did periscope during the event. We also have recorded a high-quality
version, will publish them soon.
Here the periscope links: (the phone die in the middle of the event. So
there is some part missing in the second talk).
https://www.periscope.tv/w/1vOxwnbzongJB (first part)
https://www.periscope.tv/w/1YpKkXOadpXGj (second part)
- Sijie
On Wed, Sep 16, 2015 at 9:33 AM, Sijie Guo <si...@apache.org> wrote:
> Thanks. Yup, we will record it, and also try periscope it.
>
> - Sijie
>
> On Wed, Sep 16, 2015 at 1:26 AM, Ivan Kelly <iv...@apache.org> wrote:
>
>> This is excellent work Sijie :D It's a pity I can't make the meetup. Will
>> it be recorded?
>>
>> -Ivan
>>
>> On Wed, Sep 16, 2015 at 4:51 AM Sijie Guo <si...@apache.org> wrote:
>>
>>> Hello bookkeepers,
>>>
>>> FYI. We published a blog post on DistributedLog, a replicated log
>>> service built on Apache BookKeeper. The replicated log service has been
>>> used in production for years, powering tier-0 services from transaction log
>>> for distributed database, search ingestion pipeline to self-serve pub/sub
>>> system.
>>>
>>> Please check it out :
>>> https://blog.twitter.com/2015/building-distributedlog-twitter-s-high-performance-replicated-log-service
>>>
>>> And we'd like to share our experiences at the meetup on 9/21. Come and
>>> join us!
>>>
>>> - Sijie
>>>
>>
>
Re: DistributedLog, a high-performance replicated log service built
over BookKeeper
Posted by Sijie Guo <si...@apache.org>.
We did periscope during the event. We also have recorded a high-quality
version, will publish them soon.
Here the periscope links: (the phone die in the middle of the event. So
there is some part missing in the second talk).
https://www.periscope.tv/w/1vOxwnbzongJB (first part)
https://www.periscope.tv/w/1YpKkXOadpXGj (second part)
- Sijie
On Wed, Sep 16, 2015 at 9:33 AM, Sijie Guo <si...@apache.org> wrote:
> Thanks. Yup, we will record it, and also try periscope it.
>
> - Sijie
>
> On Wed, Sep 16, 2015 at 1:26 AM, Ivan Kelly <iv...@apache.org> wrote:
>
>> This is excellent work Sijie :D It's a pity I can't make the meetup. Will
>> it be recorded?
>>
>> -Ivan
>>
>> On Wed, Sep 16, 2015 at 4:51 AM Sijie Guo <si...@apache.org> wrote:
>>
>>> Hello bookkeepers,
>>>
>>> FYI. We published a blog post on DistributedLog, a replicated log
>>> service built on Apache BookKeeper. The replicated log service has been
>>> used in production for years, powering tier-0 services from transaction log
>>> for distributed database, search ingestion pipeline to self-serve pub/sub
>>> system.
>>>
>>> Please check it out :
>>> https://blog.twitter.com/2015/building-distributedlog-twitter-s-high-performance-replicated-log-service
>>>
>>> And we'd like to share our experiences at the meetup on 9/21. Come and
>>> join us!
>>>
>>> - Sijie
>>>
>>
>
Re: DistributedLog, a high-performance replicated log service built
over BookKeeper
Posted by Sijie Guo <si...@apache.org>.
Thanks. Yup, we will record it, and also try periscope it.
- Sijie
On Wed, Sep 16, 2015 at 1:26 AM, Ivan Kelly <iv...@apache.org> wrote:
> This is excellent work Sijie :D It's a pity I can't make the meetup. Will
> it be recorded?
>
> -Ivan
>
> On Wed, Sep 16, 2015 at 4:51 AM Sijie Guo <si...@apache.org> wrote:
>
>> Hello bookkeepers,
>>
>> FYI. We published a blog post on DistributedLog, a replicated log service
>> built on Apache BookKeeper. The replicated log service has been used in
>> production for years, powering tier-0 services from transaction log for
>> distributed database, search ingestion pipeline to self-serve pub/sub
>> system.
>>
>> Please check it out :
>> https://blog.twitter.com/2015/building-distributedlog-twitter-s-high-performance-replicated-log-service
>>
>> And we'd like to share our experiences at the meetup on 9/21. Come and
>> join us!
>>
>> - Sijie
>>
>
Re: DistributedLog, a high-performance replicated log service built
over BookKeeper
Posted by Sijie Guo <si...@apache.org>.
Thanks. Yup, we will record it, and also try periscope it.
- Sijie
On Wed, Sep 16, 2015 at 1:26 AM, Ivan Kelly <iv...@apache.org> wrote:
> This is excellent work Sijie :D It's a pity I can't make the meetup. Will
> it be recorded?
>
> -Ivan
>
> On Wed, Sep 16, 2015 at 4:51 AM Sijie Guo <si...@apache.org> wrote:
>
>> Hello bookkeepers,
>>
>> FYI. We published a blog post on DistributedLog, a replicated log service
>> built on Apache BookKeeper. The replicated log service has been used in
>> production for years, powering tier-0 services from transaction log for
>> distributed database, search ingestion pipeline to self-serve pub/sub
>> system.
>>
>> Please check it out :
>> https://blog.twitter.com/2015/building-distributedlog-twitter-s-high-performance-replicated-log-service
>>
>> And we'd like to share our experiences at the meetup on 9/21. Come and
>> join us!
>>
>> - Sijie
>>
>
Re: DistributedLog, a high-performance replicated log service built over BookKeeper
Posted by Flavio Junqueira <fp...@apache.org>.
I'm definitely not missing it!
-Flavio
> On 16 Sep 2015, at 03:26, Ivan Kelly <iv...@apache.org> wrote:
>
> This is excellent work Sijie :D It's a pity I can't make the meetup. Will it be recorded?
>
> -Ivan
>
> On Wed, Sep 16, 2015 at 4:51 AM Sijie Guo <sijie@apache.org <ma...@apache.org>> wrote:
> Hello bookkeepers,
>
> FYI. We published a blog post on DistributedLog, a replicated log service built on Apache BookKeeper. The replicated log service has been used in production for years, powering tier-0 services from transaction log for distributed database, search ingestion pipeline to self-serve pub/sub system.
>
> Please check it out : https://blog.twitter.com/2015/building-distributedlog-twitter-s-high-performance-replicated-log-service <https://blog.twitter.com/2015/building-distributedlog-twitter-s-high-performance-replicated-log-service>
>
> And we'd like to share our experiences at the meetup on 9/21. Come and join us!
>
> - Sijie
Re: DistributedLog, a high-performance replicated log service built
over BookKeeper
Posted by Ivan Kelly <iv...@apache.org>.
This is excellent work Sijie :D It's a pity I can't make the meetup. Will
it be recorded?
-Ivan
On Wed, Sep 16, 2015 at 4:51 AM Sijie Guo <si...@apache.org> wrote:
> Hello bookkeepers,
>
> FYI. We published a blog post on DistributedLog, a replicated log service
> built on Apache BookKeeper. The replicated log service has been used in
> production for years, powering tier-0 services from transaction log for
> distributed database, search ingestion pipeline to self-serve pub/sub
> system.
>
> Please check it out :
> https://blog.twitter.com/2015/building-distributedlog-twitter-s-high-performance-replicated-log-service
>
> And we'd like to share our experiences at the meetup on 9/21. Come and
> join us!
>
> - Sijie
>
Re: DistributedLog, a high-performance replicated log service built
over BookKeeper
Posted by Ivan Kelly <iv...@apache.org>.
This is excellent work Sijie :D It's a pity I can't make the meetup. Will
it be recorded?
-Ivan
On Wed, Sep 16, 2015 at 4:51 AM Sijie Guo <si...@apache.org> wrote:
> Hello bookkeepers,
>
> FYI. We published a blog post on DistributedLog, a replicated log service
> built on Apache BookKeeper. The replicated log service has been used in
> production for years, powering tier-0 services from transaction log for
> distributed database, search ingestion pipeline to self-serve pub/sub
> system.
>
> Please check it out :
> https://blog.twitter.com/2015/building-distributedlog-twitter-s-high-performance-replicated-log-service
>
> And we'd like to share our experiences at the meetup on 9/21. Come and
> join us!
>
> - Sijie
>