You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by Steve Loughran <st...@apache.org> on 2011/09/06 17:15:00 UTC
versions of things
I'm just tracking this on email, so forgive me if I seem clueless
what versions of the artifacts are being targeted? Is it the 0.20.20x+
branch of Hadoop w/ things on top, or is it 0.23+ stuff? Is the goal to
target and test both?
-steve
Re: versions of things
Posted by Andrew Bayer <an...@gmail.com>.
0.22 should be comparatively easy to slide in, yeah.
A.
On Fri, Sep 9, 2011 at 3:49 AM, Steve Loughran <st...@apache.org> wrote:
> On 06/09/11 21:57, Andrew Bayer wrote:
>
>> Another qualifier is that Bigtop only incorporates released versions of
>> the
>> components - so until Hadoop releases 0.23, we can't incorporate it.
>> 0.20.x->0.23 is also going to particularly hairy due to the major build
>> changes - we'll have to modify how we're building Hadoop in such a way
>> that
>> it won't actually be possible to just drop 0.20.x back in in place of
>> 0.23.
>> We're going to have this same thing show up with Flume 0.94, which also
>> requires Thrift installed on the build boxes, hence me punting that til
>> 0.3.0, which should feature packages of Avro/Thrift/Forrest as well (i.e.,
>> the build tools).
>>
>>
> If a 0.22 release came out, what impact would that have. Certainly MRUnit
> would work with it
>
Re: versions of things
Posted by Roman Shaposhnik <rv...@apache.org>.
On Fri, Sep 9, 2011 at 3:49 AM, Steve Loughran <st...@apache.org> wrote:
> If a 0.22 release came out, what impact would that have. Certainly MRUnit
> would work with it
What's the expectation for 0.22 at this point? It definitely had a very spotted
history (being proposed way back in Jan, etc.) which worries me a little bit.
Anyway, I've just filed a JIRA to evaluate our options. My personal stake
in the ground at the moment is 0.20.204.0, but please do leave comments
on the JIRA if you want to suggest other alternatives:
https://issues.apache.org/jira/browse/BIGTOP-90
Thanks,
Roman.
Re: versions of things
Posted by Steve Loughran <st...@apache.org>.
On 06/09/11 21:57, Andrew Bayer wrote:
> Another qualifier is that Bigtop only incorporates released versions of the
> components - so until Hadoop releases 0.23, we can't incorporate it.
> 0.20.x->0.23 is also going to particularly hairy due to the major build
> changes - we'll have to modify how we're building Hadoop in such a way that
> it won't actually be possible to just drop 0.20.x back in in place of 0.23.
> We're going to have this same thing show up with Flume 0.94, which also
> requires Thrift installed on the build boxes, hence me punting that til
> 0.3.0, which should feature packages of Avro/Thrift/Forrest as well (i.e.,
> the build tools).
>
If a 0.22 release came out, what impact would that have. Certainly
MRUnit would work with it
Re: versions of things
Posted by Andrew Bayer <an...@gmail.com>.
Another qualifier is that Bigtop only incorporates released versions of the
components - so until Hadoop releases 0.23, we can't incorporate it.
0.20.x->0.23 is also going to particularly hairy due to the major build
changes - we'll have to modify how we're building Hadoop in such a way that
it won't actually be possible to just drop 0.20.x back in in place of 0.23.
We're going to have this same thing show up with Flume 0.94, which also
requires Thrift installed on the build boxes, hence me punting that til
0.3.0, which should feature packages of Avro/Thrift/Forrest as well (i.e.,
the build tools).
A.
On Tue, Sep 6, 2011 at 10:15 AM, Roman Shaposhnik <rv...@apache.org> wrote:
> On Tue, Sep 6, 2011 at 8:15 AM, Steve Loughran <st...@apache.org> wrote:
> > I'm just tracking this on email, so forgive me if I seem clueless
> >
> > what versions of the artifacts are being targeted?
>
> The complete bill of materials for Bigtop is always recorded in: bigtop.mk
> https://svn.apache.org/repos/asf/incubator/bigtop/trunk/bigtop.mk
>
> > Is it the 0.20.20x+ branch of Hadoop w/ things on top, or is it 0.23+
> stuff?
>
> For the Bigtop 0.1.0 release it was 0.20.2. We are currently figuring out
> what
> versions of components should we track in Bigtop 0.2.0. If you have any
> feedback
> for us, please don't hesitate to record it on this JIRA:
> https://issues.apache.org/jira/browse/BIGTOP-28
>
> Finally, we NEVER ever patch Apache releases:
>
> https://cwiki.apache.org/confluence/display/BIGTOP/Frequently+Asked+Questions+%28FAQ%29
>
> Speaking of which -- I remember this policy preventing us from picking
> up 0.20.203, since sadly enough the build there (native part of it) is
> broken.
>
> > Is the goal to target and test both?
>
> We do this release-by release.
>
> Thanks,
> Roman.
>
Re: versions of things
Posted by Roman Shaposhnik <rv...@apache.org>.
On Tue, Sep 6, 2011 at 8:15 AM, Steve Loughran <st...@apache.org> wrote:
> I'm just tracking this on email, so forgive me if I seem clueless
>
> what versions of the artifacts are being targeted?
The complete bill of materials for Bigtop is always recorded in: bigtop.mk
https://svn.apache.org/repos/asf/incubator/bigtop/trunk/bigtop.mk
> Is it the 0.20.20x+ branch of Hadoop w/ things on top, or is it 0.23+ stuff?
For the Bigtop 0.1.0 release it was 0.20.2. We are currently figuring out what
versions of components should we track in Bigtop 0.2.0. If you have any feedback
for us, please don't hesitate to record it on this JIRA:
https://issues.apache.org/jira/browse/BIGTOP-28
Finally, we NEVER ever patch Apache releases:
https://cwiki.apache.org/confluence/display/BIGTOP/Frequently+Asked+Questions+%28FAQ%29
Speaking of which -- I remember this policy preventing us from picking
up 0.20.203, since sadly enough the build there (native part of it) is broken.
> Is the goal to target and test both?
We do this release-by release.
Thanks,
Roman.