You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Alberto Luengo Cabanillas <ca...@gmail.com> on 2009/10/01 01:07:06 UTC
QUESTION ABOUT PIG 0.4.0 AND HADOOP 0.20.1
Hi everyone! Recently, I updated my HDFS from 0.18.0 to 0.20.1 and installed
PigPen (0.04) for Eclipse Galileo under Windows. With the older version of
Hadoop (0.18) the plugin worked correctly and I was able to submit jobs to
the cluster, but with this new version I can´t. I also followed the
instructions in http://behemoth.strlen.net/~alex/hadoop20-pig-howto.txt, but
this is for 0.20.0 version. The question is: with the 0.20.1 version of
Hadoop and Pig 0.4.0 do I have to follow the same steps, or is not
necessary?
Thanks in advance.
--
Alberto
Re: QUESTION ABOUT PIG 0.4.0 AND HADOOP 0.20.1
Posted by Alberto Luengo Cabanillas <ca...@gmail.com>.
Thanks for the reply. I managed to get the plugin to work, applying
PIG_660_trunk2.patch instead PIG_660_4.patch. The rest was the same.
2009/10/1 Dmitriy Ryaboy <dv...@gmail.com>
> FYI, the current Cloudera CDH2 Pig packages run on both 18 and 20
> automagically.
>
> http://www.cloudera.com/blog/2009/09/30/cdh2-testing-release-now-with-pig-hive-and-hbase/
>
> You might have to muck about with them a bit to get them to see your
> hadoop config files, but it should work pretty cleanly once you get
> that going.
>
> -D
>
> On Wed, Sep 30, 2009 at 9:08 PM, Raghu Angadi <ra...@apache.org> wrote:
> > That should work. Instead of building hadoop20.jar as suggested there,
> you
> > could use hadoop20.jar from PIG trunk.
> >
> > Also you might have to apply a different patch from PIG-660 (try
> > 660_5.patch).
> >
> > Raghu.
> >
> > On Wed, Sep 30, 2009 at 4:07 PM, Alberto Luengo Cabanillas <
> > cabiwan@gmail.com> wrote:
> >
> >> Hi everyone! Recently, I updated my HDFS from 0.18.0 to 0.20.1 and
> >> installed
> >> PigPen (0.04) for Eclipse Galileo under Windows. With the older version
> of
> >> Hadoop (0.18) the plugin worked correctly and I was able to submit jobs
> to
> >> the cluster, but with this new version I can´t. I also followed the
> >> instructions in http://behemoth.strlen.net/~alex/hadoop20-pig-howto.txt<http://behemoth.strlen.net/%7Ealex/hadoop20-pig-howto.txt>
> <http://behemoth.strlen.net/%7Ealex/hadoop20-pig-howto.txt>,
> >> but
> >> this is for 0.20.0 version. The question is: with the 0.20.1 version of
> >> Hadoop and Pig 0.4.0 do I have to follow the same steps, or is not
> >> necessary?
> >> Thanks in advance.
> >>
> >> --
> >> Alberto
> >>
> >
>
--
Alberto
Re: QUESTION ABOUT PIG 0.4.0 AND HADOOP 0.20.1
Posted by Dmitriy Ryaboy <dv...@gmail.com>.
FYI, the current Cloudera CDH2 Pig packages run on both 18 and 20 automagically.
http://www.cloudera.com/blog/2009/09/30/cdh2-testing-release-now-with-pig-hive-and-hbase/
You might have to muck about with them a bit to get them to see your
hadoop config files, but it should work pretty cleanly once you get
that going.
-D
On Wed, Sep 30, 2009 at 9:08 PM, Raghu Angadi <ra...@apache.org> wrote:
> That should work. Instead of building hadoop20.jar as suggested there, you
> could use hadoop20.jar from PIG trunk.
>
> Also you might have to apply a different patch from PIG-660 (try
> 660_5.patch).
>
> Raghu.
>
> On Wed, Sep 30, 2009 at 4:07 PM, Alberto Luengo Cabanillas <
> cabiwan@gmail.com> wrote:
>
>> Hi everyone! Recently, I updated my HDFS from 0.18.0 to 0.20.1 and
>> installed
>> PigPen (0.04) for Eclipse Galileo under Windows. With the older version of
>> Hadoop (0.18) the plugin worked correctly and I was able to submit jobs to
>> the cluster, but with this new version I can´t. I also followed the
>> instructions in http://behemoth.strlen.net/~alex/hadoop20-pig-howto.txt<http://behemoth.strlen.net/%7Ealex/hadoop20-pig-howto.txt>,
>> but
>> this is for 0.20.0 version. The question is: with the 0.20.1 version of
>> Hadoop and Pig 0.4.0 do I have to follow the same steps, or is not
>> necessary?
>> Thanks in advance.
>>
>> --
>> Alberto
>>
>
Re: QUESTION ABOUT PIG 0.4.0 AND HADOOP 0.20.1
Posted by Raghu Angadi <ra...@apache.org>.
That should work. Instead of building hadoop20.jar as suggested there, you
could use hadoop20.jar from PIG trunk.
Also you might have to apply a different patch from PIG-660 (try
660_5.patch).
Raghu.
On Wed, Sep 30, 2009 at 4:07 PM, Alberto Luengo Cabanillas <
cabiwan@gmail.com> wrote:
> Hi everyone! Recently, I updated my HDFS from 0.18.0 to 0.20.1 and
> installed
> PigPen (0.04) for Eclipse Galileo under Windows. With the older version of
> Hadoop (0.18) the plugin worked correctly and I was able to submit jobs to
> the cluster, but with this new version I can´t. I also followed the
> instructions in http://behemoth.strlen.net/~alex/hadoop20-pig-howto.txt<http://behemoth.strlen.net/%7Ealex/hadoop20-pig-howto.txt>,
> but
> this is for 0.20.0 version. The question is: with the 0.20.1 version of
> Hadoop and Pig 0.4.0 do I have to follow the same steps, or is not
> necessary?
> Thanks in advance.
>
> --
> Alberto
>