You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@crunch.apache.org by Victor Iacoban <vi...@gmail.com> on 2013/01/18 02:50:12 UTC

crunch hadoop compatibility

Hi,

What version of hadoop is crunch 0.4 compatible with?
I've just upgraded to cdh4 from cdh3 and I'm getting errors like this:

IncompatibleClassChangeError Found interface
org.apache.hadoop.mapreduce.JobContext, but class was expected
org.apache.crunch.hadoop.mapreduce.lib.output.CrunchMultipleOutputs.getNamedOutputsList
(CrunchMultipleOutputs.java:210)

Would I have to build crunch against my version of hadoop to make this work?

Thanks,
victor

Re: crunch hadoop compatibility

Posted by Josh Wills <jo...@gmail.com>.

Yep. Same API.
On Jan 17, 2013 9:09 PM, "Victor Iacoban" <vi...@gmail.com> wrote:

> Thanks Josh,
>
> Even for cdh4 with mr1?
>
> -- victor
>
>
> On Thu, Jan 17, 2013 at 9:06 PM, Josh Wills <jo...@gmail.com> wrote:
>
> > Building crunch with the hadoop.platform=2 option will do the trick.
> > On Jan 17, 2013 8:50 PM, "Victor Iacoban" <vi...@gmail.com>
> > wrote:
> >
> > > Hi,
> > >
> > > What version of hadoop is crunch 0.4 compatible with?
> > > I've just upgraded to cdh4 from cdh3 and I'm getting errors like this:
> > >
> > > IncompatibleClassChangeError Found interface
> > > org.apache.hadoop.mapreduce.JobContext, but class was expected
> > >
> > >
> >
> org.apache.crunch.hadoop.mapreduce.lib.output.CrunchMultipleOutputs.getNamedOutputsList
> > > (CrunchMultipleOutputs.java:210)
> > >
> > > Would I have to build crunch against my version of hadoop to make this
> > > work?
> > >
> > > Thanks,
> > > victor
> > >
> >
>

Re: crunch hadoop compatibility

Posted by Victor Iacoban <vi...@gmail.com>.

Thanks Josh,

Even for cdh4 with mr1?

-- victor


On Thu, Jan 17, 2013 at 9:06 PM, Josh Wills <jo...@gmail.com> wrote:

> Building crunch with the hadoop.platform=2 option will do the trick.
> On Jan 17, 2013 8:50 PM, "Victor Iacoban" <vi...@gmail.com>
> wrote:
>
> > Hi,
> >
> > What version of hadoop is crunch 0.4 compatible with?
> > I've just upgraded to cdh4 from cdh3 and I'm getting errors like this:
> >
> > IncompatibleClassChangeError Found interface
> > org.apache.hadoop.mapreduce.JobContext, but class was expected
> >
> >
> org.apache.crunch.hadoop.mapreduce.lib.output.CrunchMultipleOutputs.getNamedOutputsList
> > (CrunchMultipleOutputs.java:210)
> >
> > Would I have to build crunch against my version of hadoop to make this
> > work?
> >
> > Thanks,
> > victor
> >
>

Re: crunch hadoop compatibility

Posted by Josh Wills <jo...@gmail.com>.

Building crunch with the hadoop.platform=2 option will do the trick.
On Jan 17, 2013 8:50 PM, "Victor Iacoban" <vi...@gmail.com> wrote:

> Hi,
>
> What version of hadoop is crunch 0.4 compatible with?
> I've just upgraded to cdh4 from cdh3 and I'm getting errors like this:
>
> IncompatibleClassChangeError Found interface
> org.apache.hadoop.mapreduce.JobContext, but class was expected
>
> org.apache.crunch.hadoop.mapreduce.lib.output.CrunchMultipleOutputs.getNamedOutputsList
> (CrunchMultipleOutputs.java:210)
>
> Would I have to build crunch against my version of hadoop to make this
> work?
>
> Thanks,
> victor
>