RE: Replication Follow-up

[Andrew Psaltis <An...@Webtrends.com>]

Jun,
I would be interested in participating in the replication skype call and helping out where possible.

Thanks,
Andrew

-----Original Message-----
From: Jun Rao [mailto:junrao@gmail.com] 
Sent: Thursday, December 29, 2011 10:05 AM
To: kafka-users@incubator.apache.org
Subject: Re: Replication Follow-up

Hi, Joe,

Thanks for your interest. We haven't started coding replication yet. There
is a bit more discussion on dependency in kafka-50 and some details in
kafka-47. Also, as part of the replication work, we have been discussing
wire format changes (
https://cwiki.apache.org/confluence/display/KAFKA/New+Wire+Format+Proposal).

To get things started, my thinking is to do kafka-47 first, followed by
another jira that makes use of the new data structures in ZK, but only
supports replication factor 1 (basically making partitions logical and
global within the cluster).

We plan to start coding the replication feature in the new year. We can
setup a skype call in the first week of 2012. Anyone else is interested?

Thanks,

Jun

On Thu, Dec 29, 2011 at 7:09 AM, Joe Stein <cr...@gmail.com> wrote:

> Hello, hope everyone's holiday break was/is going well? (If you are lucky
> enough to have one).
>
> My busy season (mobile advertising) will start to ease up next week and I
> will get to have some down time.
>
> We use Kafka in production now and are looking to up it's usage but really
> need/want replication and outside of work it is an interesting problem to
> work on.
>
> So, I wanted to follow-up on the replication work and what I can do to
> help?  I was not sure where this had left off and if the work had already
> started or what.
>
> If not, is it good to have maybe have a conference call or something to go
> through it and divy things up?  If it has started let me know where I can
> jump in please.
>
> Thanks!!!
>
> /*
> Joe Stein
> http://www.linkedin.com/in/charmalloc
> Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> */
>

Re: Replication Follow-up

[Jay Kreps <ja...@gmail.com>]

Yeah it might be good to announce the replication discussion time in a
separate thread (when we have a time) so people can find it.

-Jay

On Tue, Jan 3, 2012 at 8:24 AM, Andrew Psaltis <Andrew.Psaltis@webtrends.com
> wrote:

> Jun,
> I would be interested in participating in the replication skype call and
> helping out where possible.
>
> Thanks,
> Andrew
>
> -----Original Message-----
> From: Jun Rao [mailto:junrao@gmail.com]
> Sent: Thursday, December 29, 2011 10:05 AM
> To: kafka-users@incubator.apache.org
> Subject: Re: Replication Follow-up
>
> Hi, Joe,
>
> Thanks for your interest. We haven't started coding replication yet. There
> is a bit more discussion on dependency in kafka-50 and some details in
> kafka-47. Also, as part of the replication work, we have been discussing
> wire format changes (
> https://cwiki.apache.org/confluence/display/KAFKA/New+Wire+Format+Proposal
> ).
>
> To get things started, my thinking is to do kafka-47 first, followed by
> another jira that makes use of the new data structures in ZK, but only
> supports replication factor 1 (basically making partitions logical and
> global within the cluster).
>
> We plan to start coding the replication feature in the new year. We can
> setup a skype call in the first week of 2012. Anyone else is interested?
>
> Thanks,
>
> Jun
>
> On Thu, Dec 29, 2011 at 7:09 AM, Joe Stein <cr...@gmail.com> wrote:
>
> > Hello, hope everyone's holiday break was/is going well? (If you are lucky
> > enough to have one).
> >
> > My busy season (mobile advertising) will start to ease up next week and I
> > will get to have some down time.
> >
> > We use Kafka in production now and are looking to up it's usage but
> really
> > need/want replication and outside of work it is an interesting problem to
> > work on.
> >
> > So, I wanted to follow-up on the replication work and what I can do to
> > help?  I was not sure where this had left off and if the work had already
> > started or what.
> >
> > If not, is it good to have maybe have a conference call or something to
> go
> > through it and divy things up?  If it has started let me know where I can
> > jump in please.
> >
> > Thanks!!!
> >
> > /*
> > Joe Stein
> > http://www.linkedin.com/in/charmalloc
> > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> > */
> >
>