You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Anupam Seth <an...@yahoo-inc.com> on 2011/09/16 19:13:52 UTC
Running latest Pig on top of latest Hadoop-0.23
Hi,
I am trying to install a 10-node cluster with the latest Pig (from trunk) working with the latest version of Hadoop-0.23. I was able to build the source successfully (although "ant test" fails).
But, when I try to run one of the tutorial scripts (script1-hadoop.pig), it fails with an exception as follows:
Any help would be appreciated.
Thanks,
Anupam
Pig Stack Trace
---------------
ERROR 2998: Unhandled internal error. org.apache.hadoop.mapred.jobcontrol.JobControl.addJob(Lorg/apache/hadoop/mapred/jobcontrol/Job;)Ljava/lang/String;
java.lang.NoSuchMethodError: org.apache.hadoop.mapred.jobcontrol.JobControl.addJob(Lorg/apache/hadoop/mapred/jobcontrol/Job;)Ljava/lang/String;
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:261)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:178)
at org.apache.pig.PigServer.launchPlan(PigServer.java:1270)
at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1255)
at org.apache.pig.PigServer.execute(PigServer.java:1242)
at org.apache.pig.PigServer.executeBatch(PigServer.java:361)
at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:131)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:192)
at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
at org.apache.pig.Main.run(Main.java:553)
at org.apache.pig.Main.main(Main.java:108)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
================================================================================
Re: Running latest Pig on top of latest Hadoop-0.23
Posted by Daniel Dai <da...@hortonworks.com>.
Did you follow the steps in
https://issues.apache.org/jira/browse/PIG-2125?focusedCommentId=13069124&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13069124
Daniel
On Fri, Sep 16, 2011 at 10:13 AM, Anupam Seth <an...@yahoo-inc.com> wrote:
> Hi,
>
> I am trying to install a 10-node cluster with the latest Pig (from trunk) working with the latest version of Hadoop-0.23. I was able to build the source successfully (although "ant test" fails).
>
> But, when I try to run one of the tutorial scripts (script1-hadoop.pig), it fails with an exception as follows:
>
> Any help would be appreciated.
>
> Thanks,
> Anupam
>
> Pig Stack Trace
> ---------------
> ERROR 2998: Unhandled internal error. org.apache.hadoop.mapred.jobcontrol.JobControl.addJob(Lorg/apache/hadoop/mapred/jobcontrol/Job;)Ljava/lang/String;
>
> java.lang.NoSuchMethodError: org.apache.hadoop.mapred.jobcontrol.JobControl.addJob(Lorg/apache/hadoop/mapred/jobcontrol/Job;)Ljava/lang/String;
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:261)
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:178)
> at org.apache.pig.PigServer.launchPlan(PigServer.java:1270)
> at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1255)
> at org.apache.pig.PigServer.execute(PigServer.java:1242)
> at org.apache.pig.PigServer.executeBatch(PigServer.java:361)
> at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:131)
> at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:192)
> at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
> at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
> at org.apache.pig.Main.run(Main.java:553)
> at org.apache.pig.Main.main(Main.java:108)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:189)
> ================================================================================
>