You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@crunch.apache.org by Josh Wills <jw...@cloudera.com> on 2013/01/31 16:27:59 UTC
graduation/release schedule
Hey all,
I wanted to get opinions on two things that have been on my mind this week:
1) When to cut the 0.5.0 release, and
2) When to graduate from the incubator.
>From my perspective, I would like to solve the HBase join issue on Hadoop
2.x before the 0.5.0 release, but I don't have any other blockers.
For graduation, I'm personally ready to kick off the process now, although
I'm not sure we'll have made it through all of the ceremony stuff before
the next board meeting (which I think is on February 20th.) So we may still
end up cutting one more release in the incubator before we leave.
Thoughts on all this?
J
--
Director of Data Science
Cloudera <http://www.cloudera.com>
Twitter: @josh_wills <http://twitter.com/josh_wills>
Re: graduation/release schedule
Posted by Rahul Sharma <ra...@gmail.com>.
Hi,
It has been quite some time for 0.4 release and I see a lot of things have
gone into it. Unfortunately in this release I didn't had time at hand so
couldnt do anything but I would like to see the 0.5 versions released quite
soon.
As for graduation, I think that we should kick in the process.
regards
Rahul
On Thu, Jan 31, 2013 at 8:57 PM, Josh Wills <jw...@cloudera.com> wrote:
> Hey all,
>
> I wanted to get opinions on two things that have been on my mind this week:
>
> 1) When to cut the 0.5.0 release, and
> 2) When to graduate from the incubator.
>
> From my perspective, I would like to solve the HBase join issue on Hadoop
> 2.x before the 0.5.0 release, but I don't have any other blockers.
>
> For graduation, I'm personally ready to kick off the process now, although
> I'm not sure we'll have made it through all of the ceremony stuff before
> the next board meeting (which I think is on February 20th.) So we may still
> end up cutting one more release in the incubator before we leave.
>
> Thoughts on all this?
>
> J
>
> --
> Director of Data Science
> Cloudera <http://www.cloudera.com>
> Twitter: @josh_wills <http://twitter.com/josh_wills>
>
Re: graduation/release schedule
Posted by Gabriel Reid <ga...@gmail.com>.
On 31 Jan 2013, at 16:27, Josh Wills <jw...@cloudera.com> wrote:
> Hey all,
>
> I wanted to get opinions on two things that have been on my mind this week:
>
> 1) When to cut the 0.5.0 release, and
> 2) When to graduate from the incubator.
>
> From my perspective, I would like to solve the HBase join issue on Hadoop
> 2.x before the 0.5.0 release, but I don't have any other blockers.
I think it would be good to get CRUNCH-155 out of the way before 0.5.0, but
other than that I don't see anything else in the way.
>
> For graduation, I'm personally ready to kick off the process now, although
> I'm not sure we'll have made it through all of the ceremony stuff before
> the next board meeting (which I think is on February 20th.) So we may still
> end up cutting one more release in the incubator before we leave.
>
It looks like we're ready for graduation, so let's go for it. If it doesn't
happen in time for the next board meeting, it doesn't happen, but I'd
say that's no reason to hold back on getting things moving now.
- Gabriel
Re: graduation/release schedule
Posted by Patrick Hunt <ph...@apache.org>.
afaict you're ready for graduation. I checked the crunch status page
and it looks like everything is in place.
Patrick
On Thu, Jan 31, 2013 at 7:27 AM, Josh Wills <jw...@cloudera.com> wrote:
> Hey all,
>
> I wanted to get opinions on two things that have been on my mind this week:
>
> 1) When to cut the 0.5.0 release, and
> 2) When to graduate from the incubator.
>
> From my perspective, I would like to solve the HBase join issue on Hadoop
> 2.x before the 0.5.0 release, but I don't have any other blockers.
>
> For graduation, I'm personally ready to kick off the process now, although
> I'm not sure we'll have made it through all of the ceremony stuff before
> the next board meeting (which I think is on February 20th.) So we may still
> end up cutting one more release in the incubator before we leave.
>
> Thoughts on all this?
>
> J
>
> --
> Director of Data Science
> Cloudera <http://www.cloudera.com>
> Twitter: @josh_wills <http://twitter.com/josh_wills>
Re: graduation/release schedule
Posted by Victor Iacoban <vi...@gmail.com>.
sure, I'll try crackle against crunch 0.5
On Thu, Jan 31, 2013 at 2:43 PM, Josh Wills <jw...@cloudera.com> wrote:
> On Thu, Jan 31, 2013 at 11:36 AM, Victor Iacoban
> <vi...@gmail.com>wrote:
>
> > Hey,
> >
> > I'd like to mention my pain point.
> > In some places crunch API is too restrictive: package private classes or
> > missing constructors.
>
>
> > Would be nice if these decisions would get reviewed before graduation,
> just
> > in case there is crazy interest in Apache Crunch post graduation and ppl
> > start extending it.
> >
>
> We can roll those discussions into the 0.5.0 release. There's nothing about
> graduation that
> would require us to freeze the APIs, we just wanted to get most of the
> heavy lifting done in the 0.5.0 release.
>
> If you have a list of ones you need access to, let's start a discussion on
> crunch-dev about making them accessible
> and/or finding alternative ways of meeting crackle's needs.
>
>
> > Except this very nice job!
> >
> > -- victor
> >
> >
> > On Thu, Jan 31, 2013 at 1:29 PM, Matthias Friedrich <ma...@mafr.de>
> wrote:
> >
> > > Hi,
> > >
> > > On Thursday, 2013-01-31, Josh Wills wrote:
> > > > I wanted to get opinions on two things that have been on my mind this
> > > week:
> > > >
> > > > 1) When to cut the 0.5.0 release, and
> > > > 2) When to graduate from the incubator.
> > > >
> > > > From my perspective, I would like to solve the HBase join issue on
> > Hadoop
> > > > 2.x before the 0.5.0 release, but I don't have any other blockers.
> > >
> > > We've done a lot of refactoring after the 0.4.0 release and I think
> > > the package structure is in pretty good shape now. If there are things
> > > you (or anyone else) would like to improve, then it would be a good
> > > idea to do this before the 0.5.0 release. My time is extremely limited
> > > right now - and will be for a couple more weeks at least - so I won't
> > > be able to work on that front. I'd make time to help with the release
> > > process though whenever you decide to cut the release.
> > >
> > > > For graduation, I'm personally ready to kick off the process now,
> > > although
> > > > I'm not sure we'll have made it through all of the ceremony stuff
> > before
> > > > the next board meeting (which I think is on February 20th.) So we may
> > > still
> > > > end up cutting one more release in the incubator before we leave.
> > >
> > > I'd give it a try as soon as possible, perhaps we can still make it in
> > > time.
> > >
> > > In any way we still have to do our incubator report. I could post a
> > > draft this weekend if that isn't too late.
> > >
> > > Regards,
> > > Matthias
> > >
> >
>
>
>
> --
> Director of Data Science
> Cloudera <http://www.cloudera.com>
> Twitter: @josh_wills <http://twitter.com/josh_wills>
>
Re: graduation/release schedule
Posted by Josh Wills <jw...@cloudera.com>.
On Thu, Jan 31, 2013 at 11:36 AM, Victor Iacoban
<vi...@gmail.com>wrote:
> Hey,
>
> I'd like to mention my pain point.
> In some places crunch API is too restrictive: package private classes or
> missing constructors.
> Would be nice if these decisions would get reviewed before graduation, just
> in case there is crazy interest in Apache Crunch post graduation and ppl
> start extending it.
>
We can roll those discussions into the 0.5.0 release. There's nothing about
graduation that
would require us to freeze the APIs, we just wanted to get most of the
heavy lifting done in the 0.5.0 release.
If you have a list of ones you need access to, let's start a discussion on
crunch-dev about making them accessible
and/or finding alternative ways of meeting crackle's needs.
> Except this very nice job!
>
> -- victor
>
>
> On Thu, Jan 31, 2013 at 1:29 PM, Matthias Friedrich <ma...@mafr.de> wrote:
>
> > Hi,
> >
> > On Thursday, 2013-01-31, Josh Wills wrote:
> > > I wanted to get opinions on two things that have been on my mind this
> > week:
> > >
> > > 1) When to cut the 0.5.0 release, and
> > > 2) When to graduate from the incubator.
> > >
> > > From my perspective, I would like to solve the HBase join issue on
> Hadoop
> > > 2.x before the 0.5.0 release, but I don't have any other blockers.
> >
> > We've done a lot of refactoring after the 0.4.0 release and I think
> > the package structure is in pretty good shape now. If there are things
> > you (or anyone else) would like to improve, then it would be a good
> > idea to do this before the 0.5.0 release. My time is extremely limited
> > right now - and will be for a couple more weeks at least - so I won't
> > be able to work on that front. I'd make time to help with the release
> > process though whenever you decide to cut the release.
> >
> > > For graduation, I'm personally ready to kick off the process now,
> > although
> > > I'm not sure we'll have made it through all of the ceremony stuff
> before
> > > the next board meeting (which I think is on February 20th.) So we may
> > still
> > > end up cutting one more release in the incubator before we leave.
> >
> > I'd give it a try as soon as possible, perhaps we can still make it in
> > time.
> >
> > In any way we still have to do our incubator report. I could post a
> > draft this weekend if that isn't too late.
> >
> > Regards,
> > Matthias
> >
>
--
Director of Data Science
Cloudera <http://www.cloudera.com>
Twitter: @josh_wills <http://twitter.com/josh_wills>
Re: graduation/release schedule
Posted by Victor Iacoban <vi...@gmail.com>.
Hey,
I'd like to mention my pain point.
In some places crunch API is too restrictive: package private classes or
missing constructors.
Would be nice if these decisions would get reviewed before graduation, just
in case there is crazy interest in Apache Crunch post graduation and ppl
start extending it.
Except this very nice job!
-- victor
On Thu, Jan 31, 2013 at 1:29 PM, Matthias Friedrich <ma...@mafr.de> wrote:
> Hi,
>
> On Thursday, 2013-01-31, Josh Wills wrote:
> > I wanted to get opinions on two things that have been on my mind this
> week:
> >
> > 1) When to cut the 0.5.0 release, and
> > 2) When to graduate from the incubator.
> >
> > From my perspective, I would like to solve the HBase join issue on Hadoop
> > 2.x before the 0.5.0 release, but I don't have any other blockers.
>
> We've done a lot of refactoring after the 0.4.0 release and I think
> the package structure is in pretty good shape now. If there are things
> you (or anyone else) would like to improve, then it would be a good
> idea to do this before the 0.5.0 release. My time is extremely limited
> right now - and will be for a couple more weeks at least - so I won't
> be able to work on that front. I'd make time to help with the release
> process though whenever you decide to cut the release.
>
> > For graduation, I'm personally ready to kick off the process now,
> although
> > I'm not sure we'll have made it through all of the ceremony stuff before
> > the next board meeting (which I think is on February 20th.) So we may
> still
> > end up cutting one more release in the incubator before we leave.
>
> I'd give it a try as soon as possible, perhaps we can still make it in
> time.
>
> In any way we still have to do our incubator report. I could post a
> draft this weekend if that isn't too late.
>
> Regards,
> Matthias
>
Re: graduation/release schedule
Posted by Victor Iacoban <vi...@gmail.com>.
One more thing, would be nice if you could publish a set of jars built
against hadoop 2.
With a separate maven classifier or version.
Thanks
On Thu, Jan 31, 2013 at 2:33 PM, Josh Wills <jw...@cloudera.com> wrote:
> On Thu, Jan 31, 2013 at 10:29 AM, Matthias Friedrich <ma...@mafr.de> wrote:
>
> > Hi,
> >
> > On Thursday, 2013-01-31, Josh Wills wrote:
> > > I wanted to get opinions on two things that have been on my mind this
> > week:
> > >
> > > 1) When to cut the 0.5.0 release, and
> > > 2) When to graduate from the incubator.
> > >
> > > From my perspective, I would like to solve the HBase join issue on
> Hadoop
> > > 2.x before the 0.5.0 release, but I don't have any other blockers.
> >
> > We've done a lot of refactoring after the 0.4.0 release and I think
> > the package structure is in pretty good shape now. If there are things
> > you (or anyone else) would like to improve, then it would be a good
> > idea to do this before the 0.5.0 release. My time is extremely limited
> > right now - and will be for a couple more weeks at least - so I won't
> > be able to work on that front. I'd make time to help with the release
> > process though whenever you decide to cut the release.
> >
>
> Agree with you re: package structure and the 0.5.0 release. I don't have
> any other
> hotspots I wanted to hit, but I'll take another pass through the code this
> weekend.
>
>
> >
> > > For graduation, I'm personally ready to kick off the process now,
> > although
> > > I'm not sure we'll have made it through all of the ceremony stuff
> before
> > > the next board meeting (which I think is on February 20th.) So we may
> > still
> > > end up cutting one more release in the incubator before we leave.
> >
> > I'd give it a try as soon as possible, perhaps we can still make it in
> > time.
> >
>
> Okay, sounds good. I'm going to kick off a vote thread.
>
>
> >
> > In any way we still have to do our incubator report. I could post a
> > draft this weekend if that isn't too late.
> >
>
> No, not at all-- thanks!
>
>
> >
> > Regards,
> > Matthias
> >
>
>
>
> --
> Director of Data Science
> Cloudera <http://www.cloudera.com>
> Twitter: @josh_wills <http://twitter.com/josh_wills>
>
Re: graduation/release schedule
Posted by Josh Wills <jw...@cloudera.com>.
On Thu, Jan 31, 2013 at 10:29 AM, Matthias Friedrich <ma...@mafr.de> wrote:
> Hi,
>
> On Thursday, 2013-01-31, Josh Wills wrote:
> > I wanted to get opinions on two things that have been on my mind this
> week:
> >
> > 1) When to cut the 0.5.0 release, and
> > 2) When to graduate from the incubator.
> >
> > From my perspective, I would like to solve the HBase join issue on Hadoop
> > 2.x before the 0.5.0 release, but I don't have any other blockers.
>
> We've done a lot of refactoring after the 0.4.0 release and I think
> the package structure is in pretty good shape now. If there are things
> you (or anyone else) would like to improve, then it would be a good
> idea to do this before the 0.5.0 release. My time is extremely limited
> right now - and will be for a couple more weeks at least - so I won't
> be able to work on that front. I'd make time to help with the release
> process though whenever you decide to cut the release.
>
Agree with you re: package structure and the 0.5.0 release. I don't have
any other
hotspots I wanted to hit, but I'll take another pass through the code this
weekend.
>
> > For graduation, I'm personally ready to kick off the process now,
> although
> > I'm not sure we'll have made it through all of the ceremony stuff before
> > the next board meeting (which I think is on February 20th.) So we may
> still
> > end up cutting one more release in the incubator before we leave.
>
> I'd give it a try as soon as possible, perhaps we can still make it in
> time.
>
Okay, sounds good. I'm going to kick off a vote thread.
>
> In any way we still have to do our incubator report. I could post a
> draft this weekend if that isn't too late.
>
No, not at all-- thanks!
>
> Regards,
> Matthias
>
--
Director of Data Science
Cloudera <http://www.cloudera.com>
Twitter: @josh_wills <http://twitter.com/josh_wills>
Re: graduation/release schedule
Posted by Matthias Friedrich <ma...@mafr.de>.
Hi,
On Thursday, 2013-01-31, Josh Wills wrote:
> I wanted to get opinions on two things that have been on my mind this week:
>
> 1) When to cut the 0.5.0 release, and
> 2) When to graduate from the incubator.
>
> From my perspective, I would like to solve the HBase join issue on Hadoop
> 2.x before the 0.5.0 release, but I don't have any other blockers.
We've done a lot of refactoring after the 0.4.0 release and I think
the package structure is in pretty good shape now. If there are things
you (or anyone else) would like to improve, then it would be a good
idea to do this before the 0.5.0 release. My time is extremely limited
right now - and will be for a couple more weeks at least - so I won't
be able to work on that front. I'd make time to help with the release
process though whenever you decide to cut the release.
> For graduation, I'm personally ready to kick off the process now, although
> I'm not sure we'll have made it through all of the ceremony stuff before
> the next board meeting (which I think is on February 20th.) So we may still
> end up cutting one more release in the incubator before we leave.
I'd give it a try as soon as possible, perhaps we can still make it in
time.
In any way we still have to do our incubator report. I could post a
draft this weekend if that isn't too late.
Regards,
Matthias