You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Iman Elghandour <ie...@yahoo.com> on 2009/02/23 06:10:54 UTC
Pigpen and Europa
Hi,
I have been trying to use the Pigpen plugin with Europa but it is not recognized. Is there a way to get it recognized?
I have followed the instructions and added the pigpen jar file in the plugins directory. I have also tried to do it through software update. But an error is generated and it does not work as well.
The plugin works with eclipse 3.2, but I want to use it in europa.
Thanks,
Iman
__________________________________________________________________
Yahoo! Canada Toolbar: Search from anywhere on the web, and bookmark your favourite sites. Download it now at
http://ca.toolbar.yahoo.com.
Pigpen fail to create job client + Could not connect to HOD
Posted by Iman Elghandour <ie...@yahoo.com>.
Hi,
I have been trying to run a query script using pigpen but I get these errors.
When, I use the "example generator", these are lines generated:
09/02/25 11:33:03 INFO executionengine.HExecutionEngine: Connecting to hadoop file system at: hdfs://nodeURL:54310
09/02/25 11:33:03 INFO executionengine.HExecutionEngine: Connecting to map-reduce job tracker at: nodeURL:54311
Exception in thread "Thread-33" java.lang.NullPointerException
at org.apache.pig.pigpen.editor.PLEditor.initPigServer(PLEditor.java:345)
at org.apache.pig.pigpen.util.ExampleGeneratorLauncher.run(ExampleGeneratorLauncher.java:159)
at java.lang.Thread.run(Thread.java:619)
>From the first two lines, I understand that it is able to connect to the hdfs.. But then the example generator will not start.
On eclipse console, the o/p is as follows:
Failed to create job client.
Please set the ConfigurationPath variable in pig preferences...
The ConfigurationPath is set probably, as I can see it was able to read the url and port numbers from hadoop-site.xml. I have not changed anything in the pig.properties though.
I think this is a related prolem too. When, I submit the script to the cluster, this errror is returned.
2009-02-25 11:29:16,132 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to HOD...
org.apache.pig.backend.executionengine.ExecException: Could not connect to HOD
at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.doHod(HExecutionEngine.java:405)
at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:145)
at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:132)
at org.apache.pig.impl.PigContext.connect(PigContext.java:172)
at org.apache.pig.PigServer.<init>(PigServer.java:137)
at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:43)
at org.apache.pig.Main.main(Main.java:241)
Caused by: org.apache.pig.backend.executionengine.ExecException: java.io.IOException: Cannot run program "hod": java.io.IOException: error=2, No such file or directory
at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.runCommand(HExecutionEngine.java:529)
at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.doHod(HExecutionEngine.java:350)
... 6 more
Caused by: java.io.IOException: Cannot run program "hod": java.io.IOException: error=2, No such file or directory
at java.lang.ProcessBuilder.start(ProcessBuilder.java:459)
at java.lang.Runtime.exec(Runtime.java:593)
at java.lang.Runtime.exec(Runtime.java:466)
at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.runCommand(HExecutionEngine.java:499)
... 7 more
Caused by: java.io.IOException: java.io.IOException: error=2, No such file or directory
at java.lang.UNIXProcess.<init>(UNIXProcess.java:148)
at java.lang.ProcessImpl.start(ProcessImpl.java:65)
at java.lang.ProcessBuilder.start(ProcessBuilder.java:452)
... 10 more
Any directions, how I can fix these errors.
Thanks,
Iman
__________________________________________________________________
Instant Messaging, free SMS, sharing photos and more... Try the new Yahoo! Canada Messenger at http://ca.beta.messenger.yahoo.com/
Re: Pigpen and Europa
Posted by Iman Elghandour <ie...@yahoo.com>.
Thank you Shubham. I tried the new jar file as you have explained in your email but the following error is generated:
PigPen (0.0.4) does not have a valid license agreement.
Thanks,
Iman
--- On Tue, 2/24/09, Shubham Chopra <sh...@yahoo-inc.com> wrote:
From: Shubham Chopra <sh...@yahoo-inc.com>
Subject: Re: Pigpen and Europa
To: pig-user@hadoop.apache.org, ielghandour@acm.org, "prasenjit mukherjee" <pr...@gmail.com>
Received: Tuesday, February 24, 2009, 9:55 AM
Hi,
I think the plugin is not recognized in case the dependencies are not
met. I have attached the update-site tar-ball to the JIRA. The same can
be downloaded from the following location:
https://issues.apache.org/jira/secure/attachment/12400858/PigPen.tgz
Untarring this to a suitable location and directing the install utility
of eclipse to use this should also pull all the dependencies from other
online repositories.
Also, I have tried the plugin with Eclipse 3.4 (Ganymede). I am not sure
if it would work well with older versions of eclipse.
Thanks,
Shubham.
Iman Elghandour wrote:
> I moved to linux. I have also used org.apache.pig.pigpen_0.0.1.jar instead
of the most recent jar file. Well, this worked for me.
> Iman
>
> --- On Mon, 2/23/09, prasenjit mukherjee <pr...@gmail.com>
wrote:
> From: prasenjit mukherjee <pr...@gmail.com>
> Subject: Re: Pigpen and Europa
> To: pig-user@hadoop.apache.org
> Received: Monday, February 23, 2009, 9:51 PM
>
> I too am facing the same problem. I dont see any error message in
> europa's log-directory though.
>
> On Tue, Feb 24, 2009 at 2:43 AM, Iman Elghandour
<ie...@yahoo.com>
> wrote:
>> I forgot to add the error that is returned when I use the Find and
Install
> tool. Here it is
>> "Selected archive does not contain an update site. Please select
> another archive"
>> I had problem using the Pigpen plugin when I was running eclipse on
> windows. I tried to setup everything on linux to see if the plugin will be
> recognized. Well, it was not. I have even tried different version of
eclipse
> (remember it worked with eclipse 3.2 on windows).
>> I have also tried putting the plugin in a separate directory and
manually
> adding an extention location. But this approach resulted in an error when
the
> pigpen jar file in the plugins directory.
>> any ideas?
>> Iman
>>
>> --- On Mon, 2/23/09, Iman Elghandour <ie...@yahoo.com> wrote:
>> From: Iman Elghandour <ie...@yahoo.com>
>> Subject: Pigpen and Europa
>> To: pig-user@hadoop.apache.org
>> Received: Monday, February 23, 2009, 12:10 AM
>>
>> Hi,
>> I have been trying to use the Pigpen plugin with Europa but it is not
>> recognized. Is there a way to get it recognized?
>> I have followed the instructions and added the pigpen jar file in the
> plugins
>> directory. I have also tried to do it through software update. But an
> error is
>> generated and it does not work as well.
>> The plugin works with eclipse 3.2, but I want to use it in europa.
>> Thanks,
>> Iman
>>
>>
>>
>>
__________________________________________________________________
>> Yahoo! Canada Toolbar: Search from anywhere on the web, and bookmark
your
>> favourite sites. Download it now at
>> http://ca.toolbar.yahoo.com.
>>
>>
>>
__________________________________________________________________
>> Instant Messaging, free SMS, sharing photos and more... Try the new
Yahoo!
> Canada Messenger at http://ca.beta.messenger.yahoo.com/
>
>
>
> __________________________________________________________________
> Connect with friends from any web browser - no download required. Try the
new Yahoo! Canada Messenger for the Web BETA at
http://ca.messenger.yahoo.com/webmessengerpromo.php
__________________________________________________________________
Be smarter than spam. See how smart SpamGuard is at giving junk email the boot with the All-new Yahoo! Mail. Click on Options in Mail and switch to New Mail today or register for free at http://mail.yahoo.ca
Re: Pigpen and Europa
Posted by Iman Elghandour <ie...@acm.org>.
Thank you Shubham. I tried the new jar file as you have explained in your email but the follwoing error is generated:
PigPen (0.0.4) does not have a valid license agreement.
Thanks,
Iman
--- On Tue, 2/24/09, Shubham Chopra <sh...@yahoo-inc.com> wrote:
From: Shubham Chopra <sh...@yahoo-inc.com>
Subject: Re: Pigpen and Europa
To: pig-user@hadoop.apache.org, ielghandour@acm.org, "prasenjit mukherjee" <pr...@gmail.com>
Received: Tuesday, February 24, 2009, 9:55 AM
Hi,
I think the plugin is not recognized in case the dependencies are not
met. I have attached the update-site tar-ball to the JIRA. The same can
be downloaded from the following location:
https://issues.apache.org/jira/secure/attachment/12400858/PigPen.tgz
Untarring this to a suitable location and directing the install utility
of eclipse to use this should also pull all the dependencies from other
online repositories.
Also, I have tried the plugin with Eclipse 3.4 (Ganymede). I am not sure
if it would work well with older versions of eclipse.
Thanks,
Shubham.
Iman Elghandour wrote:
> I moved to linux. I have also used org.apache.pig.pigpen_0.0.1.jar instead
of the most recent jar file. Well, this worked for me.
> Iman
>
> --- On Mon, 2/23/09, prasenjit mukherjee <pr...@gmail.com>
wrote:
> From: prasenjit mukherjee <pr...@gmail.com>
> Subject: Re: Pigpen and Europa
> To: pig-user@hadoop.apache.org
> Received: Monday, February 23, 2009, 9:51 PM
>
> I too am facing the same problem. I dont see any error message in
> europa's log-directory though.
>
> On Tue, Feb 24, 2009 at 2:43 AM, Iman Elghandour
<ie...@yahoo.com>
> wrote:
>> I forgot to add the error that is returned when I use the Find and
Install
> tool. Here it is
>> "Selected archive does not contain an update site. Please select
> another archive"
>> I had problem using the Pigpen plugin when I was running eclipse on
> windows. I tried to setup everything on linux to see if the plugin will be
> recognized. Well, it was not. I have even tried different version of
eclipse
> (remember it worked with eclipse 3.2 on windows).
>> I have also tried putting the plugin in a separate directory and
manually
> adding an extention location. But this approach resulted in an error when
the
> pigpen jar file in the plugins directory.
>> any ideas?
>> Iman
>>
>> --- On Mon, 2/23/09, Iman Elghandour <ie...@yahoo.com> wrote:
>> From: Iman Elghandour <ie...@yahoo.com>
>> Subject: Pigpen and Europa
>> To: pig-user@hadoop.apache.org
>> Received: Monday, February 23, 2009, 12:10 AM
>>
>> Hi,
>> I have been trying to use the Pigpen plugin with Europa but it is not
>> recognized. Is there a way to get it recognized?
>> I have followed the instructions and added the pigpen jar file in the
> plugins
>> directory. I have also tried to do it through software update. But an
> error is
>> generated and it does not work as well.
>> The plugin works with eclipse 3.2, but I want to use it in europa.
>> Thanks,
>> Iman
>>
>>
>>
>>
__________________________________________________________________
>> Yahoo! Canada Toolbar: Search from anywhere on the web, and bookmark
your
>> favourite sites. Download it now at
>> http://ca.toolbar.yahoo.com.
>>
>>
>>
__________________________________________________________________
>> Instant Messaging, free SMS, sharing photos and more... Try the new
Yahoo!
> Canada Messenger at http://ca.beta.messenger.yahoo.com/
>
>
>
> __________________________________________________________________
> Connect with friends from any web browser - no download required. Try the
new Yahoo! Canada Messenger for the Web BETA at
http://ca.messenger.yahoo.com/webmessengerpromo.php
__________________________________________________________________
Instant Messaging, free SMS, sharing photos and more... Try the new Yahoo! Canada Messenger at http://ca.beta.messenger.yahoo.com/
Re: Pigpen and Europa
Posted by Shubham Chopra <sh...@yahoo-inc.com>.
Hi,
I think the plugin is not recognized in case the dependencies are not
met. I have attached the update-site tar-ball to the JIRA. The same can
be downloaded from the following location:
https://issues.apache.org/jira/secure/attachment/12400858/PigPen.tgz
Untarring this to a suitable location and directing the install utility
of eclipse to use this should also pull all the dependencies from other
online repositories.
Also, I have tried the plugin with Eclipse 3.4 (Ganymede). I am not sure
if it would work well with older versions of eclipse.
Thanks,
Shubham.
Iman Elghandour wrote:
> I moved to linux. I have also used org.apache.pig.pigpen_0.0.1.jar instead of the most recent jar file. Well, this worked for me.
> Iman
>
> --- On Mon, 2/23/09, prasenjit mukherjee <pr...@gmail.com> wrote:
> From: prasenjit mukherjee <pr...@gmail.com>
> Subject: Re: Pigpen and Europa
> To: pig-user@hadoop.apache.org
> Received: Monday, February 23, 2009, 9:51 PM
>
> I too am facing the same problem. I dont see any error message in
> europa's log-directory though.
>
> On Tue, Feb 24, 2009 at 2:43 AM, Iman Elghandour <ie...@yahoo.com>
> wrote:
>> I forgot to add the error that is returned when I use the Find and Install
> tool. Here it is
>> "Selected archive does not contain an update site. Please select
> another archive"
>> I had problem using the Pigpen plugin when I was running eclipse on
> windows. I tried to setup everything on linux to see if the plugin will be
> recognized. Well, it was not. I have even tried different version of eclipse
> (remember it worked with eclipse 3.2 on windows).
>> I have also tried putting the plugin in a separate directory and manually
> adding an extention location. But this approach resulted in an error when the
> pigpen jar file in the plugins directory.
>> any ideas?
>> Iman
>>
>> --- On Mon, 2/23/09, Iman Elghandour <ie...@yahoo.com> wrote:
>> From: Iman Elghandour <ie...@yahoo.com>
>> Subject: Pigpen and Europa
>> To: pig-user@hadoop.apache.org
>> Received: Monday, February 23, 2009, 12:10 AM
>>
>> Hi,
>> I have been trying to use the Pigpen plugin with Europa but it is not
>> recognized. Is there a way to get it recognized?
>> I have followed the instructions and added the pigpen jar file in the
> plugins
>> directory. I have also tried to do it through software update. But an
> error is
>> generated and it does not work as well.
>> The plugin works with eclipse 3.2, but I want to use it in europa.
>> Thanks,
>> Iman
>>
>>
>>
>> __________________________________________________________________
>> Yahoo! Canada Toolbar: Search from anywhere on the web, and bookmark your
>> favourite sites. Download it now at
>> http://ca.toolbar.yahoo.com.
>>
>>
>> __________________________________________________________________
>> Instant Messaging, free SMS, sharing photos and more... Try the new Yahoo!
> Canada Messenger at http://ca.beta.messenger.yahoo.com/
>
>
>
> __________________________________________________________________
> Connect with friends from any web browser - no download required. Try the new Yahoo! Canada Messenger for the Web BETA at http://ca.messenger.yahoo.com/webmessengerpromo.php
Re: Pigpen and Europa
Posted by Iman Elghandour <ie...@yahoo.com>.
I moved to linux. I have also used org.apache.pig.pigpen_0.0.1.jar instead of the most recent jar file. Well, this worked for me.
Iman
--- On Mon, 2/23/09, prasenjit mukherjee <pr...@gmail.com> wrote:
From: prasenjit mukherjee <pr...@gmail.com>
Subject: Re: Pigpen and Europa
To: pig-user@hadoop.apache.org
Received: Monday, February 23, 2009, 9:51 PM
I too am facing the same problem. I dont see any error message in
europa's log-directory though.
On Tue, Feb 24, 2009 at 2:43 AM, Iman Elghandour <ie...@yahoo.com>
wrote:
> I forgot to add the error that is returned when I use the Find and Install
tool. Here it is
> "Selected archive does not contain an update site. Please select
another archive"
>
> I had problem using the Pigpen plugin when I was running eclipse on
windows. I tried to setup everything on linux to see if the plugin will be
recognized. Well, it was not. I have even tried different version of eclipse
(remember it worked with eclipse 3.2 on windows).
>
> I have also tried putting the plugin in a separate directory and manually
adding an extention location. But this approach resulted in an error when the
pigpen jar file in the plugins directory.
> any ideas?
> Iman
>
> --- On Mon, 2/23/09, Iman Elghandour <ie...@yahoo.com> wrote:
> From: Iman Elghandour <ie...@yahoo.com>
> Subject: Pigpen and Europa
> To: pig-user@hadoop.apache.org
> Received: Monday, February 23, 2009, 12:10 AM
>
> Hi,
> I have been trying to use the Pigpen plugin with Europa but it is not
> recognized. Is there a way to get it recognized?
> I have followed the instructions and added the pigpen jar file in the
plugins
> directory. I have also tried to do it through software update. But an
error is
> generated and it does not work as well.
> The plugin works with eclipse 3.2, but I want to use it in europa.
> Thanks,
> Iman
>
>
>
> __________________________________________________________________
> Yahoo! Canada Toolbar: Search from anywhere on the web, and bookmark your
> favourite sites. Download it now at
> http://ca.toolbar.yahoo.com.
>
>
> __________________________________________________________________
> Instant Messaging, free SMS, sharing photos and more... Try the new Yahoo!
Canada Messenger at http://ca.beta.messenger.yahoo.com/
__________________________________________________________________
Connect with friends from any web browser - no download required. Try the new Yahoo! Canada Messenger for the Web BETA at http://ca.messenger.yahoo.com/webmessengerpromo.php
Re: Pigpen and Europa
Posted by prasenjit mukherjee <pr...@gmail.com>.
I too am facing the same problem. I dont see any error message in
europa's log-directory though.
On Tue, Feb 24, 2009 at 2:43 AM, Iman Elghandour <ie...@yahoo.com> wrote:
> I forgot to add the error that is returned when I use the Find and Install tool. Here it is
> "Selected archive does not contain an update site. Please select another archive"
>
> I had problem using the Pigpen plugin when I was running eclipse on windows. I tried to setup everything on linux to see if the plugin will be recognized. Well, it was not. I have even tried different version of eclipse (remember it worked with eclipse 3.2 on windows).
>
> I have also tried putting the plugin in a separate directory and manually adding an extention location. But this approach resulted in an error when the pigpen jar file in the plugins directory.
> any ideas?
> Iman
>
> --- On Mon, 2/23/09, Iman Elghandour <ie...@yahoo.com> wrote:
> From: Iman Elghandour <ie...@yahoo.com>
> Subject: Pigpen and Europa
> To: pig-user@hadoop.apache.org
> Received: Monday, February 23, 2009, 12:10 AM
>
> Hi,
> I have been trying to use the Pigpen plugin with Europa but it is not
> recognized. Is there a way to get it recognized?
> I have followed the instructions and added the pigpen jar file in the plugins
> directory. I have also tried to do it through software update. But an error is
> generated and it does not work as well.
> The plugin works with eclipse 3.2, but I want to use it in europa.
> Thanks,
> Iman
>
>
>
> __________________________________________________________________
> Yahoo! Canada Toolbar: Search from anywhere on the web, and bookmark your
> favourite sites. Download it now at
> http://ca.toolbar.yahoo.com.
>
>
> __________________________________________________________________
> Instant Messaging, free SMS, sharing photos and more... Try the new Yahoo! Canada Messenger at http://ca.beta.messenger.yahoo.com/
Re: Pigpen and Europa
Posted by Iman Elghandour <ie...@yahoo.com>.
I forgot to add the error that is returned when I use the Find and Install tool. Here it is
"Selected archive does not contain an update site. Please select another archive"
I had problem using the Pigpen plugin when I was running eclipse on windows. I tried to setup everything on linux to see if the plugin will be recognized. Well, it was not. I have even tried different version of eclipse (remember it worked with eclipse 3.2 on windows).
I have also tried putting the plugin in a separate directory and manually adding an extention location. But this approach resulted in an error when the pigpen jar file in the plugins directory.
any ideas?
Iman
--- On Mon, 2/23/09, Iman Elghandour <ie...@yahoo.com> wrote:
From: Iman Elghandour <ie...@yahoo.com>
Subject: Pigpen and Europa
To: pig-user@hadoop.apache.org
Received: Monday, February 23, 2009, 12:10 AM
Hi,
I have been trying to use the Pigpen plugin with Europa but it is not
recognized. Is there a way to get it recognized?
I have followed the instructions and added the pigpen jar file in the plugins
directory. I have also tried to do it through software update. But an error is
generated and it does not work as well.
The plugin works with eclipse 3.2, but I want to use it in europa.
Thanks,
Iman
__________________________________________________________________
Yahoo! Canada Toolbar: Search from anywhere on the web, and bookmark your
favourite sites. Download it now at
http://ca.toolbar.yahoo.com.
__________________________________________________________________
Instant Messaging, free SMS, sharing photos and more... Try the new Yahoo! Canada Messenger at http://ca.beta.messenger.yahoo.com/