You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Amol Kekre (Commented) (JIRA)" <ji...@apache.org> on 2012/01/03 23:26:39 UTC
[jira] [Commented] (PIG-2394) Streaming results in ERROR 2997:
Encountered IOException. Trying to get information for an absent
application
[ https://issues.apache.org/jira/browse/PIG-2394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13179079#comment-13179079 ]
Amol Kekre commented on PIG-2394:
---------------------------------
Daniel,
any updates?
> Streaming results in ERROR 2997: Encountered IOException. Trying to get information for an absent application
> --------------------------------------------------------------------------------------------------------------
>
> Key: PIG-2394
> URL: https://issues.apache.org/jira/browse/PIG-2394
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.9.2
> Environment: -bash-3.1$ hadoop version
> pHadoop 0.23.0.1111080202
> Subversion http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23.0/hadoop-common-project/hadoop-common -r 1196973
> Compiled by hadoopqa on Tue Nov 8 02:12:04 PST 2011
> From source with checksum 4e42b2d96c899a98a8ab8c7cc23f27ae
> -bash-3.1$ pig -version
> Apache Pig version 0.9.2.1111101150 (r1200499)
> Mapside tables are enabled, but some files are referenced with "views"
> Reporter: Araceli Henley
>
> define CMD `perl PigStreamingDepend.pl` input(stdin) ship('/homes/user1/pigtest/pigtest_next/pigharness/dist/pig_harness/libexec/PigTest/PigStreamingDepend.pl', '/homes/user1/pigtest/pigtest_next/pigharness/dist/pig_harness/libexec/PigTest/PigStreamingModule.pm');
> A = load 'viewfs://default/data1/singlefile/studenttab10k';
> B = stream A through `perl PigStreaming.pl`;
> C = stream B through CMD as (name, age, gpa);
> D = foreach C generate name, age;
> store D into '/user/user2/pig/out/user2.1322769085/dotNext_Streaming_8.out';
> Confirmed files exist on local file system:
> /homes/user1/pigtest/pigtest_next/pigharness/dist/pig_harness/libexec/PigTest/PigStreamingDepend.pl
> /homes/user1/pigtest/pigtest_next/pigharness/dist/pig_harness/libexec/PigTest/PigStreamingModule.pm
> Pig Stack Trace
> ---------------
> ERROR 2997: Encountered IOException. Trying to get information for an absent application application_1321041443489_3274
> RemoteTrace:
> at Local Trace:
> org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent application application_1321041443489_3274
> at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:151)
> at $Proxy9.getApplicationReport(Unknown Source)
> at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClientImpl.java:111)
> at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
> at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
> at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
> at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
> at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:431)
> at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
> at org.apache.hadoop.mapred.JobClient.getTaskReports(JobClient.java:626)
> at org.apache.hadoop.mapred.JobClient.getMapTaskReports(JobClient.java:621)
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher.getStats(Launcher.java:150)
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:343)
> at org.apache.pig.PigServer.launchPlan(PigServer.java:1314)
> at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1299)
> at org.apache.pig.PigServer.execute(PigServer.java:1286)
> at org.apache.pig.PigServer.executeBatch(PigServer.java:360)
> at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:131)
> at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:192)
> at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
> at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
> at org.apache.pig.Main.run(Main.java:561)
> at org.apache.pig.Main.main(Main.java:111)
> ================================================================================
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira