You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Anupam Seth <an...@yahoo-inc.com> on 2011/09/16 19:13:52 UTC

Running latest Pig on top of latest Hadoop-0.23

Hi,

I am trying to install a  10-node cluster with the latest Pig (from trunk) working with the latest version of Hadoop-0.23. I was able to build the source successfully (although "ant test" fails).

But, when I try to run one of the tutorial scripts (script1-hadoop.pig), it fails with an exception as follows:

Any help would be appreciated.

Thanks,
Anupam

Pig Stack Trace
---------------
ERROR 2998: Unhandled internal error. org.apache.hadoop.mapred.jobcontrol.JobControl.addJob(Lorg/apache/hadoop/mapred/jobcontrol/Job;)Ljava/lang/String;

java.lang.NoSuchMethodError: org.apache.hadoop.mapred.jobcontrol.JobControl.addJob(Lorg/apache/hadoop/mapred/jobcontrol/Job;)Ljava/lang/String;
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:261)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:178)
        at org.apache.pig.PigServer.launchPlan(PigServer.java:1270)
        at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1255)
        at org.apache.pig.PigServer.execute(PigServer.java:1242)
        at org.apache.pig.PigServer.executeBatch(PigServer.java:361)
        at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:131)
        at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:192)
        at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
        at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
        at org.apache.pig.Main.run(Main.java:553)
        at org.apache.pig.Main.main(Main.java:108)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
================================================================================

Re: Running latest Pig on top of latest Hadoop-0.23

Posted by Daniel Dai <da...@hortonworks.com>.
Did you follow the steps in
https://issues.apache.org/jira/browse/PIG-2125?focusedCommentId=13069124&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13069124

Daniel

On Fri, Sep 16, 2011 at 10:13 AM, Anupam Seth <an...@yahoo-inc.com> wrote:
> Hi,
>
> I am trying to install a  10-node cluster with the latest Pig (from trunk) working with the latest version of Hadoop-0.23. I was able to build the source successfully (although "ant test" fails).
>
> But, when I try to run one of the tutorial scripts (script1-hadoop.pig), it fails with an exception as follows:
>
> Any help would be appreciated.
>
> Thanks,
> Anupam
>
> Pig Stack Trace
> ---------------
> ERROR 2998: Unhandled internal error. org.apache.hadoop.mapred.jobcontrol.JobControl.addJob(Lorg/apache/hadoop/mapred/jobcontrol/Job;)Ljava/lang/String;
>
> java.lang.NoSuchMethodError: org.apache.hadoop.mapred.jobcontrol.JobControl.addJob(Lorg/apache/hadoop/mapred/jobcontrol/Job;)Ljava/lang/String;
>        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:261)
>        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:178)
>        at org.apache.pig.PigServer.launchPlan(PigServer.java:1270)
>        at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1255)
>        at org.apache.pig.PigServer.execute(PigServer.java:1242)
>        at org.apache.pig.PigServer.executeBatch(PigServer.java:361)
>        at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:131)
>        at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:192)
>        at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
>        at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
>        at org.apache.pig.Main.run(Main.java:553)
>        at org.apache.pig.Main.main(Main.java:108)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
> ================================================================================
>