You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Iman Elghandour <ie...@yahoo.com> on 2009/02/23 06:10:54 UTC

Pigpen and Europa

Hi,
I have been trying to use the Pigpen plugin with Europa but it is not recognized. Is there a way to get it recognized?
I have followed the instructions and added the pigpen jar file in the plugins directory. I have also tried to do it through software update. But an error is generated and it does not work as well. 
The plugin works with eclipse 3.2, but I want to use it in europa. 
Thanks,
Iman



      __________________________________________________________________
Yahoo! Canada Toolbar: Search from anywhere on the web, and bookmark your favourite sites. Download it now at
http://ca.toolbar.yahoo.com.

Pigpen fail to create job client + Could not connect to HOD

Posted by Iman Elghandour <ie...@yahoo.com>.
Hi,
I have been trying to run a query script using pigpen but I get these errors.

When, I use the "example generator", these are lines generated:

09/02/25 11:33:03 INFO executionengine.HExecutionEngine: Connecting to hadoop file system at: hdfs://nodeURL:54310
09/02/25 11:33:03 INFO executionengine.HExecutionEngine: Connecting to map-reduce job tracker at: nodeURL:54311

Exception in thread "Thread-33" java.lang.NullPointerException
        at org.apache.pig.pigpen.editor.PLEditor.initPigServer(PLEditor.java:345)
        at org.apache.pig.pigpen.util.ExampleGeneratorLauncher.run(ExampleGeneratorLauncher.java:159)
        at java.lang.Thread.run(Thread.java:619)

>From the first two lines, I understand that it is able to connect to the hdfs.. But then the example generator will not start. 
On eclipse console, the o/p is as follows:

Failed to create job client.
Please set the ConfigurationPath variable in pig preferences...

The ConfigurationPath  is set probably, as I can see it was able to read the url and port numbers from hadoop-site.xml. I have not changed anything in the pig.properties though.

I think this is a related prolem too. When, I submit the script to the cluster, this errror is returned.

 2009-02-25 11:29:16,132 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to HOD...
org.apache.pig.backend.executionengine.ExecException: Could not connect to HOD
        at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.doHod(HExecutionEngine.java:405)
        at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:145)
        at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:132)
        at org.apache.pig.impl.PigContext.connect(PigContext.java:172)
        at org.apache.pig.PigServer.<init>(PigServer.java:137)
        at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:43)
        at org.apache.pig.Main.main(Main.java:241)
Caused by: org.apache.pig.backend.executionengine.ExecException: java.io.IOException: Cannot run program "hod": java.io.IOException: error=2, No such file or directory
        at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.runCommand(HExecutionEngine.java:529)
        at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.doHod(HExecutionEngine.java:350)
        ... 6 more
Caused by: java.io.IOException: Cannot run program "hod": java.io.IOException: error=2, No such file or directory
        at java.lang.ProcessBuilder.start(ProcessBuilder.java:459)
        at java.lang.Runtime.exec(Runtime.java:593)
        at java.lang.Runtime.exec(Runtime.java:466)
        at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.runCommand(HExecutionEngine.java:499)
        ... 7 more
Caused by: java.io.IOException: java.io.IOException: error=2, No such file or directory
        at java.lang.UNIXProcess.<init>(UNIXProcess.java:148)
        at java.lang.ProcessImpl.start(ProcessImpl.java:65)
        at java.lang.ProcessBuilder.start(ProcessBuilder.java:452)
        ... 10 more


Any directions, how I can fix these errors.

Thanks,
Iman




      __________________________________________________________________
Instant Messaging, free SMS, sharing photos and more... Try the new Yahoo! Canada Messenger at http://ca.beta.messenger.yahoo.com/

Re: Pigpen and Europa

Posted by Iman Elghandour <ie...@yahoo.com>.
Thank you Shubham. I tried the new jar file as you have explained in your email but the following error is generated:
 
    PigPen (0.0.4) does not have a valid license agreement.
    
Thanks,
Iman

--- On Tue, 2/24/09, Shubham Chopra <sh...@yahoo-inc.com> wrote:
From: Shubham Chopra <sh...@yahoo-inc.com>
Subject: Re: Pigpen and Europa
To: pig-user@hadoop.apache.org, ielghandour@acm.org, "prasenjit mukherjee" <pr...@gmail.com>
Received: Tuesday, February 24, 2009, 9:55 AM

Hi,

I think the plugin is not recognized in case the dependencies are not 
met. I have attached the update-site tar-ball to the JIRA. The same can 
be downloaded from the following location:
https://issues.apache.org/jira/secure/attachment/12400858/PigPen.tgz

Untarring this to a suitable location and directing the install utility 
of eclipse to use this should also pull all the dependencies from other 
online repositories.

Also, I have tried the plugin with Eclipse 3.4 (Ganymede). I am not sure 
if it would work well with older versions of eclipse.

Thanks,
Shubham.

Iman Elghandour wrote:
> I moved to linux. I have also used org.apache.pig.pigpen_0.0.1.jar instead
of the most recent jar file. Well, this worked for me.
> Iman
> 
> --- On Mon, 2/23/09, prasenjit mukherjee <pr...@gmail.com>
wrote:
> From: prasenjit mukherjee <pr...@gmail.com>
> Subject: Re: Pigpen and Europa
> To: pig-user@hadoop.apache.org
> Received: Monday, February 23, 2009, 9:51 PM
> 
> I too am facing the same problem. I dont see any error message in
> europa's log-directory though.
> 
> On Tue, Feb 24, 2009 at 2:43 AM, Iman Elghandour
<ie...@yahoo.com>
> wrote:
>> I forgot to add the error that is returned when I use the Find and
Install
> tool. Here it is
>> "Selected archive does not contain an update site. Please select
> another archive"
>> I had problem using the Pigpen plugin when I was running eclipse on
> windows. I tried to setup everything on linux to see if the plugin will be
> recognized. Well, it was not. I have even tried different version of
eclipse
> (remember it worked with eclipse 3.2 on windows).
>> I have also tried putting the plugin in a separate directory and
manually
> adding an extention location. But this approach resulted in an error when
the
> pigpen jar file in the plugins directory.
>> any ideas?
>> Iman
>>
>> --- On Mon, 2/23/09, Iman Elghandour <ie...@yahoo.com> wrote:
>> From: Iman Elghandour <ie...@yahoo.com>
>> Subject: Pigpen and Europa
>> To: pig-user@hadoop.apache.org
>> Received: Monday, February 23, 2009, 12:10 AM
>>
>> Hi,
>> I have been trying to use the Pigpen plugin with Europa but it is not
>> recognized. Is there a way to get it recognized?
>> I have followed the instructions and added the pigpen jar file in the
> plugins
>> directory. I have also tried to do it through software update. But an
> error is
>> generated and it does not work as well.
>> The plugin works with eclipse 3.2, but I want to use it in europa.
>> Thanks,
>> Iman
>>
>>
>>
>>     
__________________________________________________________________
>> Yahoo! Canada Toolbar: Search from anywhere on the web, and bookmark
your
>> favourite sites. Download it now at
>> http://ca.toolbar.yahoo.com.
>>
>>
>>     
__________________________________________________________________
>> Instant Messaging, free SMS, sharing photos and more... Try the new
Yahoo!
> Canada Messenger at http://ca.beta.messenger.yahoo.com/
> 
> 
> 
>       __________________________________________________________________
> Connect with friends from any web browser - no download required. Try the
new Yahoo! Canada Messenger for the Web BETA at
http://ca.messenger.yahoo.com/webmessengerpromo.php




      __________________________________________________________________
Be smarter than spam. See how smart SpamGuard is at giving junk email the boot with the All-new Yahoo! Mail.  Click on Options in Mail and switch to New Mail today or register for free at http://mail.yahoo.ca

Re: Pigpen and Europa

Posted by Iman Elghandour <ie...@acm.org>.
Thank you Shubham. I tried the new jar file as you have explained in your email but the follwoing error is generated:
 
    PigPen (0.0.4) does not have a valid license agreement.
    
Thanks,
Iman

--- On Tue, 2/24/09, Shubham Chopra <sh...@yahoo-inc.com> wrote:
From: Shubham Chopra <sh...@yahoo-inc.com>
Subject: Re: Pigpen and Europa
To: pig-user@hadoop.apache.org, ielghandour@acm.org, "prasenjit mukherjee" <pr...@gmail.com>
Received: Tuesday, February 24, 2009, 9:55 AM

Hi,

I think the plugin is not recognized in case the dependencies are not 
met. I have attached the update-site tar-ball to the JIRA. The same can 
be downloaded from the following location:
https://issues.apache.org/jira/secure/attachment/12400858/PigPen.tgz

Untarring this to a suitable location and directing the install utility 
of eclipse to use this should also pull all the dependencies from other 
online repositories.

Also, I have tried the plugin with Eclipse 3.4 (Ganymede). I am not sure 
if it would work well with older versions of eclipse.

Thanks,
Shubham.

Iman Elghandour wrote:
> I moved to linux. I have also used org.apache.pig.pigpen_0.0.1.jar instead
of the most recent jar file. Well, this worked for me.
> Iman
> 
> --- On Mon, 2/23/09, prasenjit mukherjee <pr...@gmail.com>
wrote:
> From: prasenjit mukherjee <pr...@gmail.com>
> Subject: Re: Pigpen and Europa
> To: pig-user@hadoop.apache.org
> Received: Monday, February 23, 2009, 9:51 PM
> 
> I too am facing the same problem. I dont see any error message in
> europa's log-directory though.
> 
> On Tue, Feb 24, 2009 at 2:43 AM, Iman Elghandour
<ie...@yahoo.com>
> wrote:
>> I forgot to add the error that is returned when I use the Find and
Install
> tool. Here it is
>> "Selected archive does not contain an update site. Please select
> another archive"
>> I had problem using the Pigpen plugin when I was running eclipse on
> windows. I tried to setup everything on linux to see if the plugin will be
> recognized. Well, it was not. I have even tried different version of
eclipse
> (remember it worked with eclipse 3.2 on windows).
>> I have also tried putting the plugin in a separate directory and
manually
> adding an extention location. But this approach resulted in an error when
the
> pigpen jar file in the plugins directory.
>> any ideas?
>> Iman
>>
>> --- On Mon, 2/23/09, Iman Elghandour <ie...@yahoo.com> wrote:
>> From: Iman Elghandour <ie...@yahoo.com>
>> Subject: Pigpen and Europa
>> To: pig-user@hadoop.apache.org
>> Received: Monday, February 23, 2009, 12:10 AM
>>
>> Hi,
>> I have been trying to use the Pigpen plugin with Europa but it is not
>> recognized. Is there a way to get it recognized?
>> I have followed the instructions and added the pigpen jar file in the
> plugins
>> directory. I have also tried to do it through software update. But an
> error is
>> generated and it does not work as well.
>> The plugin works with eclipse 3.2, but I want to use it in europa.
>> Thanks,
>> Iman
>>
>>
>>
>>     
__________________________________________________________________
>> Yahoo! Canada Toolbar: Search from anywhere on the web, and bookmark
your
>> favourite sites. Download it now at
>> http://ca.toolbar.yahoo.com.
>>
>>
>>     
__________________________________________________________________
>> Instant Messaging, free SMS, sharing photos and more... Try the new
Yahoo!
> Canada Messenger at http://ca.beta.messenger.yahoo.com/
> 
> 
> 
>       __________________________________________________________________
> Connect with friends from any web browser - no download required. Try the
new Yahoo! Canada Messenger for the Web BETA at
http://ca.messenger.yahoo.com/webmessengerpromo.php




      __________________________________________________________________
Instant Messaging, free SMS, sharing photos and more... Try the new Yahoo! Canada Messenger at http://ca.beta.messenger.yahoo.com/

Re: Pigpen and Europa

Posted by Shubham Chopra <sh...@yahoo-inc.com>.
Hi,

I think the plugin is not recognized in case the dependencies are not 
met. I have attached the update-site tar-ball to the JIRA. The same can 
be downloaded from the following location:
https://issues.apache.org/jira/secure/attachment/12400858/PigPen.tgz

Untarring this to a suitable location and directing the install utility 
of eclipse to use this should also pull all the dependencies from other 
online repositories.

Also, I have tried the plugin with Eclipse 3.4 (Ganymede). I am not sure 
if it would work well with older versions of eclipse.

Thanks,
Shubham.

Iman Elghandour wrote:
> I moved to linux. I have also used org.apache.pig.pigpen_0.0.1.jar instead of the most recent jar file. Well, this worked for me.
> Iman
> 
> --- On Mon, 2/23/09, prasenjit mukherjee <pr...@gmail.com> wrote:
> From: prasenjit mukherjee <pr...@gmail.com>
> Subject: Re: Pigpen and Europa
> To: pig-user@hadoop.apache.org
> Received: Monday, February 23, 2009, 9:51 PM
> 
> I too am facing the same problem. I dont see any error message in
> europa's log-directory though.
> 
> On Tue, Feb 24, 2009 at 2:43 AM, Iman Elghandour <ie...@yahoo.com>
> wrote:
>> I forgot to add the error that is returned when I use the Find and Install
> tool. Here it is
>> "Selected archive does not contain an update site. Please select
> another archive"
>> I had problem using the Pigpen plugin when I was running eclipse on
> windows. I tried to setup everything on linux to see if the plugin will be
> recognized. Well, it was not. I have even tried different version of eclipse
> (remember it worked with eclipse 3.2 on windows).
>> I have also tried putting the plugin in a separate directory and manually
> adding an extention location. But this approach resulted in an error when the
> pigpen jar file in the plugins directory.
>> any ideas?
>> Iman
>>
>> --- On Mon, 2/23/09, Iman Elghandour <ie...@yahoo.com> wrote:
>> From: Iman Elghandour <ie...@yahoo.com>
>> Subject: Pigpen and Europa
>> To: pig-user@hadoop.apache.org
>> Received: Monday, February 23, 2009, 12:10 AM
>>
>> Hi,
>> I have been trying to use the Pigpen plugin with Europa but it is not
>> recognized. Is there a way to get it recognized?
>> I have followed the instructions and added the pigpen jar file in the
> plugins
>> directory. I have also tried to do it through software update. But an
> error is
>> generated and it does not work as well.
>> The plugin works with eclipse 3.2, but I want to use it in europa.
>> Thanks,
>> Iman
>>
>>
>>
>>      __________________________________________________________________
>> Yahoo! Canada Toolbar: Search from anywhere on the web, and bookmark your
>> favourite sites. Download it now at
>> http://ca.toolbar.yahoo.com.
>>
>>
>>      __________________________________________________________________
>> Instant Messaging, free SMS, sharing photos and more... Try the new Yahoo!
> Canada Messenger at http://ca.beta.messenger.yahoo.com/
> 
> 
> 
>       __________________________________________________________________
> Connect with friends from any web browser - no download required. Try the new Yahoo! Canada Messenger for the Web BETA at http://ca.messenger.yahoo.com/webmessengerpromo.php


Re: Pigpen and Europa

Posted by Iman Elghandour <ie...@yahoo.com>.
I moved to linux. I have also used org.apache.pig.pigpen_0.0.1.jar instead of the most recent jar file. Well, this worked for me.
Iman

--- On Mon, 2/23/09, prasenjit mukherjee <pr...@gmail.com> wrote:
From: prasenjit mukherjee <pr...@gmail.com>
Subject: Re: Pigpen and Europa
To: pig-user@hadoop.apache.org
Received: Monday, February 23, 2009, 9:51 PM

I too am facing the same problem. I dont see any error message in
europa's log-directory though.

On Tue, Feb 24, 2009 at 2:43 AM, Iman Elghandour <ie...@yahoo.com>
wrote:
> I forgot to add the error that is returned when I use the Find and Install
tool. Here it is
> "Selected archive does not contain an update site. Please select
another archive"
>
> I had problem using the Pigpen plugin when I was running eclipse on
windows. I tried to setup everything on linux to see if the plugin will be
recognized. Well, it was not. I have even tried different version of eclipse
(remember it worked with eclipse 3.2 on windows).
>
> I have also tried putting the plugin in a separate directory and manually
adding an extention location. But this approach resulted in an error when the
pigpen jar file in the plugins directory.
> any ideas?
> Iman
>
> --- On Mon, 2/23/09, Iman Elghandour <ie...@yahoo.com> wrote:
> From: Iman Elghandour <ie...@yahoo.com>
> Subject: Pigpen and Europa
> To: pig-user@hadoop.apache.org
> Received: Monday, February 23, 2009, 12:10 AM
>
> Hi,
> I have been trying to use the Pigpen plugin with Europa but it is not
> recognized. Is there a way to get it recognized?
> I have followed the instructions and added the pigpen jar file in the
plugins
> directory. I have also tried to do it through software update. But an
error is
> generated and it does not work as well.
> The plugin works with eclipse 3.2, but I want to use it in europa.
> Thanks,
> Iman
>
>
>
>      __________________________________________________________________
> Yahoo! Canada Toolbar: Search from anywhere on the web, and bookmark your
> favourite sites. Download it now at
> http://ca.toolbar.yahoo.com.
>
>
>      __________________________________________________________________
> Instant Messaging, free SMS, sharing photos and more... Try the new Yahoo!
Canada Messenger at http://ca.beta.messenger.yahoo.com/



      __________________________________________________________________
Connect with friends from any web browser - no download required. Try the new Yahoo! Canada Messenger for the Web BETA at http://ca.messenger.yahoo.com/webmessengerpromo.php

Re: Pigpen and Europa

Posted by prasenjit mukherjee <pr...@gmail.com>.
I too am facing the same problem. I dont see any error message in
europa's log-directory though.

On Tue, Feb 24, 2009 at 2:43 AM, Iman Elghandour <ie...@yahoo.com> wrote:
> I forgot to add the error that is returned when I use the Find and Install tool. Here it is
> "Selected archive does not contain an update site. Please select another archive"
>
> I had problem using the Pigpen plugin when I was running eclipse on windows. I tried to setup everything on linux to see if the plugin will be recognized. Well, it was not. I have even tried different version of eclipse (remember it worked with eclipse 3.2 on windows).
>
> I have also tried putting the plugin in a separate directory and manually adding an extention location. But this approach resulted in an error when the pigpen jar file in the plugins directory.
> any ideas?
> Iman
>
> --- On Mon, 2/23/09, Iman Elghandour <ie...@yahoo.com> wrote:
> From: Iman Elghandour <ie...@yahoo.com>
> Subject: Pigpen and Europa
> To: pig-user@hadoop.apache.org
> Received: Monday, February 23, 2009, 12:10 AM
>
> Hi,
> I have been trying to use the Pigpen plugin with Europa but it is not
> recognized. Is there a way to get it recognized?
> I have followed the instructions and added the pigpen jar file in the plugins
> directory. I have also tried to do it through software update. But an error is
> generated and it does not work as well.
> The plugin works with eclipse 3.2, but I want to use it in europa.
> Thanks,
> Iman
>
>
>
>      __________________________________________________________________
> Yahoo! Canada Toolbar: Search from anywhere on the web, and bookmark your
> favourite sites. Download it now at
> http://ca.toolbar.yahoo.com.
>
>
>      __________________________________________________________________
> Instant Messaging, free SMS, sharing photos and more... Try the new Yahoo! Canada Messenger at http://ca.beta.messenger.yahoo.com/

Re: Pigpen and Europa

Posted by Iman Elghandour <ie...@yahoo.com>.
I forgot to add the error that is returned when I use the Find and Install tool. Here it is
"Selected archive does not contain an update site. Please select another archive" 

I had problem using the Pigpen plugin when I was running eclipse on windows. I tried to setup everything on linux to see if the plugin will be recognized. Well, it was not. I have even tried different version of eclipse (remember it worked with eclipse 3.2 on windows). 

I have also tried putting the plugin in a separate directory and manually adding an extention location. But this approach resulted in an error when the pigpen jar file in the plugins directory. 
any ideas?
Iman

--- On Mon, 2/23/09, Iman Elghandour <ie...@yahoo.com> wrote:
From: Iman Elghandour <ie...@yahoo.com>
Subject: Pigpen and Europa
To: pig-user@hadoop.apache.org
Received: Monday, February 23, 2009, 12:10 AM

Hi,
I have been trying to use the Pigpen plugin with Europa but it is not
recognized. Is there a way to get it recognized?
I have followed the instructions and added the pigpen jar file in the plugins
directory. I have also tried to do it through software update. But an error is
generated and it does not work as well. 
The plugin works with eclipse 3.2, but I want to use it in europa. 
Thanks,
Iman



      __________________________________________________________________
Yahoo! Canada Toolbar: Search from anywhere on the web, and bookmark your
favourite sites. Download it now at
http://ca.toolbar.yahoo.com.


      __________________________________________________________________
Instant Messaging, free SMS, sharing photos and more... Try the new Yahoo! Canada Messenger at http://ca.beta.messenger.yahoo.com/