You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mrunit.apache.org by Steve Loughran <st...@apache.org> on 2011/05/09 15:07:06 UTC
checking out and compiling
Hi
I checked out trunk and tried to build mrunit, but got told off that
there was no contrib build.xml around
I know I could probably play with symlinks and properties to fix this,
but would recommend moving the file into mrunit/trunk, so that you get
control over its changes.
-steve
Re: checking out and compiling
Posted by Steve Loughran <st...@apache.org>.
On 09/05/11 22:57, Aaron Kimball wrote:
> Steve,
>
> We're actually hopefully moving to mvn
I'm sorry :(
Re: checking out and compiling
Posted by Steve Loughran <st...@apache.org>.
On 11/05/2011 19:38, Aaron Kimball wrote:
> Indeed, in theory :)
I just d/l'd the whole 0.21 release, which includes the JAR file. Easier
than getting things to build
Re: checking out and compiling
Posted by Aaron Kimball <ak...@gmail.com>.
Indeed, in theory :)
- A
On Wed, May 11, 2011 at 3:36 AM, Steve Loughran <st...@apache.org> wrote:
> On 10/05/2011 18:07, Aaron Kimball wrote:
>
>> Steve,
>>
>> The existing code in our repo was taken directly from trunk. But we're
>> waiting on a build system conversion...
>>
>>
> And trunk builds against 0.21+? So if I set up the right symlinks and built
> it, I'd probably get a 0.21 compatible release?
>
Re: checking out and compiling
Posted by Steve Loughran <st...@apache.org>.
On 10/05/2011 18:07, Aaron Kimball wrote:
> Steve,
>
> The existing code in our repo was taken directly from trunk. But we're
> waiting on a build system conversion...
>
And trunk builds against 0.21+? So if I set up the right symlinks and
built it, I'd probably get a 0.21 compatible release?
Re: checking out and compiling
Posted by Aaron Kimball <ak...@gmail.com>.
Steve,
The existing code in our repo was taken directly from trunk. But we're
waiting on a build system conversion...
If you want something that works on the 20 branch, you're honestly best off
grabbing a Hadoop tarball from Cloudera (http://archive.cloudera.com/cdh/3/)
-- that contains a backported version of MRUnit. But we felt like we should
start from the "canonical" mrunit @ apache for this repo...
- Aaron
On Tue, May 10, 2011 at 3:03 AM, Steve Loughran <st...@apache.org> wrote:
> On 09/05/11 23:37, Eric Sammer wrote:
>
>> I've been mega-bogged down in My Real Job(tm) but this is mostly finished.
>> The problem I ran into was that I can't find a release that contains
>> WrappedMapper (which is referenced in the head of mrunit's repo). Aaron,
>> do
>> you know anything about this? Was this a Hadoop trunk-ish feature?
>>
>>
> Is there a branch compatible with the forthcoming 20.203, as that's what
> I'd like to target (I am talking about Hadoop testing at berlin buzzwords)
> -if not, presumably there's a 0.21 compatible version somewhere that I can
> play with?
>
Re: checking out and compiling
Posted by Steve Loughran <st...@apache.org>.
On 09/05/11 23:37, Eric Sammer wrote:
> I've been mega-bogged down in My Real Job(tm) but this is mostly finished.
> The problem I ran into was that I can't find a release that contains
> WrappedMapper (which is referenced in the head of mrunit's repo). Aaron, do
> you know anything about this? Was this a Hadoop trunk-ish feature?
>
Is there a branch compatible with the forthcoming 20.203, as that's what
I'd like to target (I am talking about Hadoop testing at berlin
buzzwords) -if not, presumably there's a 0.21 compatible version
somewhere that I can play with?
Re: checking out and compiling
Posted by Aaron Kimball <ak...@gmail.com>.
I think the first version we ship should target Hadoop 0.20. If you
reverse-apply the relevant sections of MR-954, that should deal with the
worst of the build incompatibilities I think.
- A
On Mon, May 9, 2011 at 10:26 PM, Eric Sammer <es...@cloudera.com> wrote:
> OK, change of plans. I'm going to try and create a maven'ized mrunit minus
> MAPREDUCE-954 so it's not coupled to hadoop trunk. I'll create a branch to
> track trunk where we can reapply 954.
>
> me ----> :( O <--- rabbit hole.
>
> () ()
> . .
> ||
>
> ^ rabbit.
>
> On Mon, May 9, 2011 at 10:14 PM, Eric Sammer <es...@cloudera.com> wrote:
>
> > I just read through that JIRA and all I learned from it is that I have to
> > read it again. I didn't think something could be so complicated.
> >
> >
> > On Mon, May 9, 2011 at 4:11 PM, Aaron Kimball <akimball83@gmail.com
> >wrote:
> >
> >> https://issues.apache.org/jira/browse/mapreduce-954
> >> fixversion 0.21.0
> >>
> >> - Aaron
> >>
> >> On Mon, May 9, 2011 at 3:37 PM, Eric Sammer <es...@cloudera.com>
> wrote:
> >>
> >> > I've been mega-bogged down in My Real Job(tm) but this is mostly
> >> finished.
> >> > The problem I ran into was that I can't find a release that contains
> >> > WrappedMapper (which is referenced in the head of mrunit's repo).
> Aaron,
> >> do
> >> > you know anything about this? Was this a Hadoop trunk-ish feature?
> >> >
> >> > On Mon, May 9, 2011 at 2:57 PM, Aaron Kimball <ak...@gmail.com>
> >> > wrote:
> >> >
> >> > > Steve,
> >> > >
> >> > > We're actually hopefully moving to mvn... that entire build.xml
> should
> >> > > really be tossed. :\
> >> > > - Aaron
> >> > >
> >> > > On Mon, May 9, 2011 at 6:07 AM, Steve Loughran <st...@apache.org>
> >> > wrote:
> >> > >
> >> > > > Hi
> >> > > >
> >> > > > I checked out trunk and tried to build mrunit, but got told off
> that
> >> > > there
> >> > > > was no contrib build.xml around
> >> > > >
> >> > > > I know I could probably play with symlinks and properties to fix
> >> this,
> >> > > but
> >> > > > would recommend moving the file into mrunit/trunk, so that you get
> >> > > control
> >> > > > over its changes.
> >> > > >
> >> > > > -steve
> >> > > >
> >> > >
> >> >
> >> >
> >> >
> >> > --
> >> > Eric Sammer
> >> > twitter: esammer
> >> > data: www.cloudera.com
> >> >
> >>
> >
> >
> >
> > --
> > Eric Sammer
> > twitter: esammer
> > data: www.cloudera.com
> >
>
>
>
> --
> Eric Sammer
> twitter: esammer
> data: www.cloudera.com
>
Re: checking out and compiling
Posted by Eric Sammer <es...@cloudera.com>.
OK, change of plans. I'm going to try and create a maven'ized mrunit minus
MAPREDUCE-954 so it's not coupled to hadoop trunk. I'll create a branch to
track trunk where we can reapply 954.
me ----> :( O <--- rabbit hole.
() ()
. .
||
^ rabbit.
On Mon, May 9, 2011 at 10:14 PM, Eric Sammer <es...@cloudera.com> wrote:
> I just read through that JIRA and all I learned from it is that I have to
> read it again. I didn't think something could be so complicated.
>
>
> On Mon, May 9, 2011 at 4:11 PM, Aaron Kimball <ak...@gmail.com>wrote:
>
>> https://issues.apache.org/jira/browse/mapreduce-954
>> fixversion 0.21.0
>>
>> - Aaron
>>
>> On Mon, May 9, 2011 at 3:37 PM, Eric Sammer <es...@cloudera.com> wrote:
>>
>> > I've been mega-bogged down in My Real Job(tm) but this is mostly
>> finished.
>> > The problem I ran into was that I can't find a release that contains
>> > WrappedMapper (which is referenced in the head of mrunit's repo). Aaron,
>> do
>> > you know anything about this? Was this a Hadoop trunk-ish feature?
>> >
>> > On Mon, May 9, 2011 at 2:57 PM, Aaron Kimball <ak...@gmail.com>
>> > wrote:
>> >
>> > > Steve,
>> > >
>> > > We're actually hopefully moving to mvn... that entire build.xml should
>> > > really be tossed. :\
>> > > - Aaron
>> > >
>> > > On Mon, May 9, 2011 at 6:07 AM, Steve Loughran <st...@apache.org>
>> > wrote:
>> > >
>> > > > Hi
>> > > >
>> > > > I checked out trunk and tried to build mrunit, but got told off that
>> > > there
>> > > > was no contrib build.xml around
>> > > >
>> > > > I know I could probably play with symlinks and properties to fix
>> this,
>> > > but
>> > > > would recommend moving the file into mrunit/trunk, so that you get
>> > > control
>> > > > over its changes.
>> > > >
>> > > > -steve
>> > > >
>> > >
>> >
>> >
>> >
>> > --
>> > Eric Sammer
>> > twitter: esammer
>> > data: www.cloudera.com
>> >
>>
>
>
>
> --
> Eric Sammer
> twitter: esammer
> data: www.cloudera.com
>
--
Eric Sammer
twitter: esammer
data: www.cloudera.com
Re: checking out and compiling
Posted by Eric Sammer <es...@cloudera.com>.
I just read through that JIRA and all I learned from it is that I have to
read it again. I didn't think something could be so complicated.
On Mon, May 9, 2011 at 4:11 PM, Aaron Kimball <ak...@gmail.com> wrote:
> https://issues.apache.org/jira/browse/mapreduce-954
> fixversion 0.21.0
>
> - Aaron
>
> On Mon, May 9, 2011 at 3:37 PM, Eric Sammer <es...@cloudera.com> wrote:
>
> > I've been mega-bogged down in My Real Job(tm) but this is mostly
> finished.
> > The problem I ran into was that I can't find a release that contains
> > WrappedMapper (which is referenced in the head of mrunit's repo). Aaron,
> do
> > you know anything about this? Was this a Hadoop trunk-ish feature?
> >
> > On Mon, May 9, 2011 at 2:57 PM, Aaron Kimball <ak...@gmail.com>
> > wrote:
> >
> > > Steve,
> > >
> > > We're actually hopefully moving to mvn... that entire build.xml should
> > > really be tossed. :\
> > > - Aaron
> > >
> > > On Mon, May 9, 2011 at 6:07 AM, Steve Loughran <st...@apache.org>
> > wrote:
> > >
> > > > Hi
> > > >
> > > > I checked out trunk and tried to build mrunit, but got told off that
> > > there
> > > > was no contrib build.xml around
> > > >
> > > > I know I could probably play with symlinks and properties to fix
> this,
> > > but
> > > > would recommend moving the file into mrunit/trunk, so that you get
> > > control
> > > > over its changes.
> > > >
> > > > -steve
> > > >
> > >
> >
> >
> >
> > --
> > Eric Sammer
> > twitter: esammer
> > data: www.cloudera.com
> >
>
--
Eric Sammer
twitter: esammer
data: www.cloudera.com
Re: checking out and compiling
Posted by Aaron Kimball <ak...@gmail.com>.
https://issues.apache.org/jira/browse/mapreduce-954
fixversion 0.21.0
- Aaron
On Mon, May 9, 2011 at 3:37 PM, Eric Sammer <es...@cloudera.com> wrote:
> I've been mega-bogged down in My Real Job(tm) but this is mostly finished.
> The problem I ran into was that I can't find a release that contains
> WrappedMapper (which is referenced in the head of mrunit's repo). Aaron, do
> you know anything about this? Was this a Hadoop trunk-ish feature?
>
> On Mon, May 9, 2011 at 2:57 PM, Aaron Kimball <ak...@gmail.com>
> wrote:
>
> > Steve,
> >
> > We're actually hopefully moving to mvn... that entire build.xml should
> > really be tossed. :\
> > - Aaron
> >
> > On Mon, May 9, 2011 at 6:07 AM, Steve Loughran <st...@apache.org>
> wrote:
> >
> > > Hi
> > >
> > > I checked out trunk and tried to build mrunit, but got told off that
> > there
> > > was no contrib build.xml around
> > >
> > > I know I could probably play with symlinks and properties to fix this,
> > but
> > > would recommend moving the file into mrunit/trunk, so that you get
> > control
> > > over its changes.
> > >
> > > -steve
> > >
> >
>
>
>
> --
> Eric Sammer
> twitter: esammer
> data: www.cloudera.com
>
Re: checking out and compiling
Posted by Eric Sammer <es...@cloudera.com>.
I've been mega-bogged down in My Real Job(tm) but this is mostly finished.
The problem I ran into was that I can't find a release that contains
WrappedMapper (which is referenced in the head of mrunit's repo). Aaron, do
you know anything about this? Was this a Hadoop trunk-ish feature?
On Mon, May 9, 2011 at 2:57 PM, Aaron Kimball <ak...@gmail.com> wrote:
> Steve,
>
> We're actually hopefully moving to mvn... that entire build.xml should
> really be tossed. :\
> - Aaron
>
> On Mon, May 9, 2011 at 6:07 AM, Steve Loughran <st...@apache.org> wrote:
>
> > Hi
> >
> > I checked out trunk and tried to build mrunit, but got told off that
> there
> > was no contrib build.xml around
> >
> > I know I could probably play with symlinks and properties to fix this,
> but
> > would recommend moving the file into mrunit/trunk, so that you get
> control
> > over its changes.
> >
> > -steve
> >
>
--
Eric Sammer
twitter: esammer
data: www.cloudera.com
Re: checking out and compiling
Posted by Aaron Kimball <ak...@gmail.com>.
Steve,
We're actually hopefully moving to mvn... that entire build.xml should
really be tossed. :\
- Aaron
On Mon, May 9, 2011 at 6:07 AM, Steve Loughran <st...@apache.org> wrote:
> Hi
>
> I checked out trunk and tried to build mrunit, but got told off that there
> was no contrib build.xml around
>
> I know I could probably play with symlinks and properties to fix this, but
> would recommend moving the file into mrunit/trunk, so that you get control
> over its changes.
>
> -steve
>