You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by Latha <us...@gmail.com> on 2008/09/21 21:02:25 UTC
Facing issues Integrating PIG with Hadoop.
Hi All
Am a student trying to integrate PIG and Hadoop technologies to build a
custom application as a part of my MS project.
Am trying out a simple scenario where I have setup a single node hadoop
cluster and trying to execute the pig script "script1-*hadoop*.*pig" *mentioned
in the pig tutorial.
Am hitting several issues like "Failed to create data storage "etc.
Had posted same to the groups already.
http://www.nabble.com/Integration-of-pig-and-hadoop-fails-with-%22Failed-to-create-DataStorage%22-error.-td18931962.html
Could you please suggest me the proper steps to integrate pig and hadoop.
Right now, am following the below ones.
1) Have downloded latest source for hadoop and PIG
2) Compiled hadoop and started single node cluster
3) Compiled PIG and replaced the hadoop class files with the new ones from
step 2 in the pig.jar
4) executing the pig script by setting HADOOPSITEPATH
Please let me if the above steps needs are incorrect (or) should i use any
specific pig and hadoop versions? We are stuck up with the errors. Request
you to pls help in resolving the same.
Thankyou
Srilatha
Re: Facing issues Integrating PIG with Hadoop.
Posted by Alan Gates <ga...@yahoo-inc.com>.
Pig questions should be sent to pig-user@hadoop.apache.org.
The error you're getting usually means that you have a version of
hadoop that doesn't match your version of pig. If you downloaded
latest for hadoop, that will be the case, as pig currently supports
hadoop 0.18, but not 0.19 or top of trunk. Try running your pig
version with a released 0.18 version of hadoop and see if you get
better results.
Alan.
On Nov 24, 2008, at 10:09 AM, cutepooja54321 wrote:
>
> hi , i am also trying to do the same thing,,
> can u please help me if u managed to do it ,, pleassee.. i am also
> a student
>
> us latha wrote:
>>
>> Hi All
>>
>> Am a student trying to integrate PIG and Hadoop technologies to
>> build a
>> custom application as a part of my MS project.
>> Am trying out a simple scenario where I have setup a single node
>> hadoop
>> cluster and trying to execute the pig script "script1-*hadoop*.*pig"
>> *mentioned
>> in the pig tutorial.
>>
>> Am hitting several issues like "Failed to create data storage "etc.
>> Had posted same to the groups already.
>> http://www.nabble.com/Integration-of-pig-and-hadoop-fails-with-%
>> 22Failed-to-create-DataStorage%22-error.-td18931962.html
>>
>> Could you please suggest me the proper steps to integrate pig and
>> hadoop.
>> Right now, am following the below ones.
>>
>> 1) Have downloded latest source for hadoop and PIG
>> 2) Compiled hadoop and started single node cluster
>> 3) Compiled PIG and replaced the hadoop class files with the new
>> ones from
>> step 2 in the pig.jar
>> 4) executing the pig script by setting HADOOPSITEPATH
>>
>> Please let me if the above steps needs are incorrect (or) should i
>> use any
>> specific pig and hadoop versions? We are stuck up with the errors.
>> Request
>> you to pls help in resolving the same.
>>
>> Thankyou
>> Srilatha
>>
>>
>
> --
> View this message in context: http://www.nabble.com/Facing-issues-
> Integrating-PIG-with-Hadoop.-tp19597351p20666428.html
> Sent from the Hadoop core-user mailing list archive at Nabble.com.
>
Re: Facing issues Integrating PIG with Hadoop.
Posted by Alan Gates <ga...@yahoo-inc.com>.
Pig questions should be sent to pig-user@hadoop.apache.org.
The error you're getting usually means that you have a version of
hadoop that doesn't match your version of pig. If you downloaded
latest for hadoop, that will be the case, as pig currently supports
hadoop 0.18, but not 0.19 or top of trunk. Try running your pig
version with a released 0.18 version of hadoop and see if you get
better results.
Alan.
On Nov 24, 2008, at 10:09 AM, cutepooja54321 wrote:
>
> hi , i am also trying to do the same thing,,
> can u please help me if u managed to do it ,, pleassee.. i am also
> a student
>
> us latha wrote:
>>
>> Hi All
>>
>> Am a student trying to integrate PIG and Hadoop technologies to
>> build a
>> custom application as a part of my MS project.
>> Am trying out a simple scenario where I have setup a single node
>> hadoop
>> cluster and trying to execute the pig script "script1-*hadoop*.*pig"
>> *mentioned
>> in the pig tutorial.
>>
>> Am hitting several issues like "Failed to create data storage "etc.
>> Had posted same to the groups already.
>> http://www.nabble.com/Integration-of-pig-and-hadoop-fails-with-%
>> 22Failed-to-create-DataStorage%22-error.-td18931962.html
>>
>> Could you please suggest me the proper steps to integrate pig and
>> hadoop.
>> Right now, am following the below ones.
>>
>> 1) Have downloded latest source for hadoop and PIG
>> 2) Compiled hadoop and started single node cluster
>> 3) Compiled PIG and replaced the hadoop class files with the new
>> ones from
>> step 2 in the pig.jar
>> 4) executing the pig script by setting HADOOPSITEPATH
>>
>> Please let me if the above steps needs are incorrect (or) should i
>> use any
>> specific pig and hadoop versions? We are stuck up with the errors.
>> Request
>> you to pls help in resolving the same.
>>
>> Thankyou
>> Srilatha
>>
>>
>
> --
> View this message in context: http://www.nabble.com/Facing-issues-
> Integrating-PIG-with-Hadoop.-tp19597351p20666428.html
> Sent from the Hadoop core-user mailing list archive at Nabble.com.
>
Re: Facing issues Integrating PIG with Hadoop.
Posted by cutepooja54321 <cu...@yahoo.com>.
hi , i am also trying to do the same thing,,
can u please help me if u managed to do it ,, pleassee.. i am also a student
us latha wrote:
>
> Hi All
>
> Am a student trying to integrate PIG and Hadoop technologies to build a
> custom application as a part of my MS project.
> Am trying out a simple scenario where I have setup a single node hadoop
> cluster and trying to execute the pig script "script1-*hadoop*.*pig"
> *mentioned
> in the pig tutorial.
>
> Am hitting several issues like "Failed to create data storage "etc.
> Had posted same to the groups already.
> http://www.nabble.com/Integration-of-pig-and-hadoop-fails-with-%22Failed-to-create-DataStorage%22-error.-td18931962.html
>
> Could you please suggest me the proper steps to integrate pig and hadoop.
> Right now, am following the below ones.
>
> 1) Have downloded latest source for hadoop and PIG
> 2) Compiled hadoop and started single node cluster
> 3) Compiled PIG and replaced the hadoop class files with the new ones from
> step 2 in the pig.jar
> 4) executing the pig script by setting HADOOPSITEPATH
>
> Please let me if the above steps needs are incorrect (or) should i use any
> specific pig and hadoop versions? We are stuck up with the errors. Request
> you to pls help in resolving the same.
>
> Thankyou
> Srilatha
>
>
--
View this message in context: http://www.nabble.com/Facing-issues-Integrating-PIG-with-Hadoop.-tp19597351p20666428.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.
Re: Facing issues Integrating PIG with Hadoop.
Posted by Latha <us...@gmail.com>.
Hi All,
Thankyou for your input. Was using 0.18 version of hadoop with pig
0.1.0.which caused the errors.
Now pig 0.1.0 is working well with branch 0.17 .And the script1-hadoop.pig
example is getting executed properly.
Thankyou so much
Srilatha
On Mon, Sep 22, 2008 at 8:51 PM, Alan Gates <ga...@yahoo-inc.com> wrote:
> Which version of hadoop do you have? The latest hadoop at this moment is
> 0.18.1 I believe. The pig patch (
> https://issues.apache.org/jira/browse/PIG-253) to integrate with hadoop
> 0.18 was only checked in Sept 18. If you downloaded pig 0.1.0, it works
> with hadoop 0.17.x. Or, if you directly downloaded the source code before
> 9/18, it will work with hadoop 0.17.x.
>
> Alan.
>
>
> Latha wrote:
>
>> Hi All
>> Am a student trying to integrate PIG and Hadoop technologies to build a
>> custom application as a part of my MS project.
>> Am trying out a simple scenario where I have setup a single node hadoop
>> cluster and trying to execute the pig script "script1-*hadoop*.*pig"
>> *mentioned
>> in the pig tutorial.
>>
>> Am hitting several issues like "Failed to create data storage "etc.
>> Had posted same to the groups already.
>>
>> http://www.nabble.com/Integration-of-pig-and-hadoop-fails-with-%22Failed-to-create-DataStorage%22-error.-td18931962.html
>>
>> Could you please suggest me the proper steps to integrate pig and hadoop.
>> Right now, am following the below ones.
>>
>> 1) Have downloded latest source for hadoop and PIG
>> 2) Compiled hadoop and started single node cluster
>> 3) Compiled PIG and replaced the hadoop class files with the new ones from
>> step 2 in the pig.jar
>> 4) executing the pig script by setting HADOOPSITEPATH
>>
>> Please let me if the above steps needs are incorrect (or) should i use any
>> specific pig and hadoop versions? We are stuck up with the errors. Request
>> you to pls help in resolving the same.
>>
>> Thankyou
>> Srilatha
>>
>>
>>
>
Re: Facing issues Integrating PIG with Hadoop.
Posted by Alan Gates <ga...@yahoo-inc.com>.
Which version of hadoop do you have? The latest hadoop at this moment
is 0.18.1 I believe. The pig patch
(https://issues.apache.org/jira/browse/PIG-253) to integrate with hadoop
0.18 was only checked in Sept 18. If you downloaded pig 0.1.0, it works
with hadoop 0.17.x. Or, if you directly downloaded the source code
before 9/18, it will work with hadoop 0.17.x.
Alan.
Latha wrote:
> Hi All
> Am a student trying to integrate PIG and Hadoop technologies to build a
> custom application as a part of my MS project.
> Am trying out a simple scenario where I have setup a single node hadoop
> cluster and trying to execute the pig script "script1-*hadoop*.*pig" *mentioned
> in the pig tutorial.
>
> Am hitting several issues like "Failed to create data storage "etc.
> Had posted same to the groups already.
> http://www.nabble.com/Integration-of-pig-and-hadoop-fails-with-%22Failed-to-create-DataStorage%22-error.-td18931962.html
>
> Could you please suggest me the proper steps to integrate pig and hadoop.
> Right now, am following the below ones.
>
> 1) Have downloded latest source for hadoop and PIG
> 2) Compiled hadoop and started single node cluster
> 3) Compiled PIG and replaced the hadoop class files with the new ones from
> step 2 in the pig.jar
> 4) executing the pig script by setting HADOOPSITEPATH
>
> Please let me if the above steps needs are incorrect (or) should i use any
> specific pig and hadoop versions? We are stuck up with the errors. Request
> you to pls help in resolving the same.
>
> Thankyou
> Srilatha
>
>
Facing issues Integrating PIG with Hadoop.
Posted by Latha <us...@gmail.com>.
Hi All
Am a student trying to integrate PIG and Hadoop technologies to build a
custom application as a part of my MS project.
Am trying out a simple scenario where I have setup a single node hadoop
cluster and trying to execute the pig script "script1-*hadoop*.*pig" *mentioned
in the pig tutorial.
Am hitting several issues like "Failed to create data storage "etc.
Had posted same to the groups already.
http://www.nabble.com/Integration-of-pig-and-hadoop-fails-with-%22Failed-to-create-DataStorage%22-error.-td18931962.html
Could you please suggest me the proper steps to integrate pig and hadoop.
Right now, am following the below ones.
1) Have downloded latest source for hadoop and PIG
2) Compiled hadoop and started single node cluster
3) Compiled PIG and replaced the hadoop class files with the new ones from
step 2 in the pig.jar
4) executing the pig script by setting HADOOPSITEPATH
Please let me if the above steps needs are incorrect (or) should i use any
specific pig and hadoop versions? We are stuck up with the errors. Request
you to pls help in resolving the same.
Thankyou
Srilatha
RE: Facing issues Integrating PIG with Hadoop.
Posted by Olga Natkovich <ol...@yahoo-inc.com>.
The official release works with Hadoop 17. The latest trunk has been
covnerted to Hadoop 18 on Friday.
Olga
> -----Original Message-----
> From: Daniel [mailto:daijyc@gmail.com]
> Sent: Sunday, September 21, 2008 10:25 PM
> To: pig-user@incubator.apache.org
> Subject: Re: Facing issues Integrating PIG with Hadoop.
>
> Which version of hadoop are you using? Is that hadoop 18 as
> you said "the latest hadoop source"? If it is the case, try
> hadoop 17. Currently pig only works with hadoop 17 I think.
>
> Daniel
>
> ----- Original Message -----
> From: "Latha" <us...@gmail.com>
> To: <pi...@incubator.apache.org>;
> <co...@hadoop.apache.org>; <co...@hadoop.apache.org>
> Sent: Sunday, September 21, 2008 3:02 PM
> Subject: Facing issues Integrating PIG with Hadoop.
>
>
> > Hi All
> >
> > Am a student trying to integrate PIG and Hadoop
> technologies to build
> > a custom application as a part of my MS project.
> > Am trying out a simple scenario where I have setup a single node
> > hadoop cluster and trying to execute the pig script
> "script1-*hadoop*.*pig"
> > *mentioned
> > in the pig tutorial.
> >
> > Am hitting several issues like "Failed to create data storage "etc.
> > Had posted same to the groups already.
> >
> http://www.nabble.com/Integration-of-pig-and-hadoop-fails-with-%22Fail
> > ed-to-create-DataStorage%22-error.-td18931962.html
> >
> > Could you please suggest me the proper steps to integrate
> pig and hadoop.
> > Right now, am following the below ones.
> >
> > 1) Have downloded latest source for hadoop and PIG
> > 2) Compiled hadoop and started single node cluster
> > 3) Compiled PIG and replaced the hadoop class files with
> the new ones
> > from step 2 in the pig.jar
> > 4) executing the pig script by setting HADOOPSITEPATH
> >
> > Please let me if the above steps needs are incorrect (or)
> should i use
> > any specific pig and hadoop versions? We are stuck up with
> the errors.
> > Request you to pls help in resolving the same.
> >
> > Thankyou
> > Srilatha
> >
>
>
Re: Facing issues Integrating PIG with Hadoop.
Posted by Daniel <da...@gmail.com>.
Which version of hadoop are you using? Is that hadoop 18 as you said "the
latest hadoop source"? If it is the case, try hadoop 17. Currently pig only
works with hadoop 17 I think.
Daniel
----- Original Message -----
From: "Latha" <us...@gmail.com>
To: <pi...@incubator.apache.org>; <co...@hadoop.apache.org>;
<co...@hadoop.apache.org>
Sent: Sunday, September 21, 2008 3:02 PM
Subject: Facing issues Integrating PIG with Hadoop.
> Hi All
>
> Am a student trying to integrate PIG and Hadoop technologies to build a
> custom application as a part of my MS project.
> Am trying out a simple scenario where I have setup a single node hadoop
> cluster and trying to execute the pig script "script1-*hadoop*.*pig"
> *mentioned
> in the pig tutorial.
>
> Am hitting several issues like "Failed to create data storage "etc.
> Had posted same to the groups already.
> http://www.nabble.com/Integration-of-pig-and-hadoop-fails-with-%22Failed-to-create-DataStorage%22-error.-td18931962.html
>
> Could you please suggest me the proper steps to integrate pig and hadoop.
> Right now, am following the below ones.
>
> 1) Have downloded latest source for hadoop and PIG
> 2) Compiled hadoop and started single node cluster
> 3) Compiled PIG and replaced the hadoop class files with the new ones from
> step 2 in the pig.jar
> 4) executing the pig script by setting HADOOPSITEPATH
>
> Please let me if the above steps needs are incorrect (or) should i use any
> specific pig and hadoop versions? We are stuck up with the errors. Request
> you to pls help in resolving the same.
>
> Thankyou
> Srilatha
>