You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-issues@hadoop.apache.org by "Devaraj K (Created) (JIRA)" <ji...@apache.org> on 2011/11/04 13:31:00 UTC

[jira] [Created] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

mapred job -status fails to give info even if the job is present in History
---------------------------------------------------------------------------

                 Key: MAPREDUCE-3348
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
             Project: Hadoop Map/Reduce
          Issue Type: Bug
    Affects Versions: 0.24.0
            Reporter: Devaraj K
            Assignee: Devaraj K


It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.

{code}
11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
RemoteTrace:
 at LocalTrace:
        org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
        at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
        at $Proxy6.getApplicationReport(Unknown Source)
        at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
        at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
        at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
        at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
        at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
        at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
        at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
        at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
        at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
Exception in thread "main" RemoteTrace:
 at Local Trace:
        org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
        at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
        at $Proxy6.getApplicationReport(Unknown Source)
        at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
        at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
        at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
        at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
        at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
        at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
        at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
        at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
        at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)

{code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Devaraj K updated MAPREDUCE-3348:
---------------------------------

    Component/s: mrv2
    
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.24.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>         Attachments: MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226326#comment-13226326 ] 

Hudson commented on MAPREDUCE-3348:
-----------------------------------

Integrated in Hadoop-Hdfs-0.23-Commit #657 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/657/])
    MAPREDUCE-3348. Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app. Contributed by Devaraj K.
svn merge --ignore-ancestry -c 1298978 ../../trunk/ (Revision 1298979)

     Result = SUCCESS
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1298979
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestClientRMService.java

                
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3348-1.patch, MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226327#comment-13226327 ] 

Hudson commented on MAPREDUCE-3348:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk-Commit #1934 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1934/])
    MAPREDUCE-3348. Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app. Contributed by Devaraj K. (Revision 1298978)

     Result = SUCCESS
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1298978
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestClientRMService.java

                
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3348-1.patch, MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226845#comment-13226845 ] 

Hudson commented on MAPREDUCE-3348:
-----------------------------------

Integrated in Hadoop-Mapreduce-0.23-Build #221 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/221/])
    MAPREDUCE-3348. Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app. Contributed by Devaraj K.
svn merge --ignore-ancestry -c 1298978 ../../trunk/ (Revision 1298979)

     Result = FAILURE
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1298979
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestClientRMService.java

                
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3348-1.patch, MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Joseph Evans updated MAPREDUCE-3348:
-------------------------------------------

    Fix Version/s:     (was: 0.23.2)
                   0.23.3

Somehow this made it into trunk and branch-2, but not branch-0.23, so I put it in now.
                
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>             Fix For: 0.23.3
>
>         Attachments: MAPREDUCE-3348-1.patch, MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226334#comment-13226334 ] 

Hudson commented on MAPREDUCE-3348:
-----------------------------------

Integrated in Hadoop-Common-0.23-Commit #666 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/666/])
    MAPREDUCE-3348. Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app. Contributed by Devaraj K.
svn merge --ignore-ancestry -c 1298978 ../../trunk/ (Revision 1298979)

     Result = SUCCESS
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1298979
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestClientRMService.java

                
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3348-1.patch, MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226411#comment-13226411 ] 

Hudson commented on MAPREDUCE-3348:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #1868 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1868/])
    MAPREDUCE-3348. Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app. Contributed by Devaraj K. (Revision 1298978)

     Result = ABORTED
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1298978
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestClientRMService.java

                
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3348-1.patch, MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226856#comment-13226856 ] 

Hudson commented on MAPREDUCE-3348:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk #1015 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1015/])
    MAPREDUCE-3348. Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app. Contributed by Devaraj K. (Revision 1298978)

     Result = SUCCESS
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1298978
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestClientRMService.java

                
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3348-1.patch, MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Vinod Kumar Vavilapalli (Updated) (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vinod Kumar Vavilapalli updated MAPREDUCE-3348:
-----------------------------------------------

        Fix Version/s: 0.23.2
    Affects Version/s:     (was: 0.24.0)
                       0.23.0
               Status: Open  (was: Patch Available)

I don't like the fact that we have to rely on ApplicationReport being null, but can live with it for now. We should add different exceptions like NotFoundException, AccessControlException which we can then use for app, queue, node etc.

Looks good otherwise. Couple of minor nit:
 - Please add a comment to ClientRMService.getApplicationReport() when we return with null report. Also, clarify the same thing by adding a javadoc for this method.
 - Can you also change the two log statements "Could not get Job info from RM for job ..." in ClientServiceDelegate to INFO?
                
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Vinod Kumar Vavilapalli (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226304#comment-13226304 ] 

Vinod Kumar Vavilapalli commented on MAPREDUCE-3348:
----------------------------------------------------

okie, looks good, pushing this in.
                
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3348-1.patch, MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Vinod Kumar Vavilapalli (Updated) (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vinod Kumar Vavilapalli updated MAPREDUCE-3348:
-----------------------------------------------

      Resolution: Fixed
    Release Note: Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app.
    Hadoop Flags: Reviewed
          Status: Resolved  (was: Patch Available)

Just committed this to branch-0.23 and trunk, Thanks Devaraj K!

Will merge into 0.23.2 later.
                
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3348-1.patch, MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Devaraj K updated MAPREDUCE-3348:
---------------------------------

    Status: Patch Available  (was: Open)
    
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.24.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>         Attachments: MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226835#comment-13226835 ] 

Hudson commented on MAPREDUCE-3348:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk #980 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/980/])
    MAPREDUCE-3348. Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app. Contributed by Devaraj K. (Revision 1298978)

     Result = SUCCESS
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1298978
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestClientRMService.java

                
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3348-1.patch, MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13207851#comment-13207851 ] 

Hadoop QA commented on MAPREDUCE-3348:
--------------------------------------

+1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12514501/MAPREDUCE-3348.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 eclipse:eclipse.  The patch built with eclipse:eclipse.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed unit tests in .

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1853//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1853//console

This message is automatically generated.
                
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.24.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>         Attachments: MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226828#comment-13226828 ] 

Hudson commented on MAPREDUCE-3348:
-----------------------------------

Integrated in Hadoop-Hdfs-0.23-Build #193 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/193/])
    MAPREDUCE-3348. Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app. Contributed by Devaraj K.
svn merge --ignore-ancestry -c 1298978 ../../trunk/ (Revision 1298979)

     Result = UNSTABLE
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1298979
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestClientRMService.java

                
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3348-1.patch, MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226329#comment-13226329 ] 

Hudson commented on MAPREDUCE-3348:
-----------------------------------

Integrated in Hadoop-Common-trunk-Commit #1859 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1859/])
    MAPREDUCE-3348. Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app. Contributed by Devaraj K. (Revision 1298978)

     Result = SUCCESS
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1298978
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestClientRMService.java

                
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3348-1.patch, MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Vinod Kumar Vavilapalli (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13208905#comment-13208905 ] 

Vinod Kumar Vavilapalli commented on MAPREDUCE-3348:
----------------------------------------------------

Created MAPREDUCE-3865 for throwing different exceptions.
                
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Devaraj K updated MAPREDUCE-3348:
---------------------------------

    Attachment: MAPREDUCE-3348.patch
    
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 0.24.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>         Attachments: MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Closed] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy closed MAPREDUCE-3348.
------------------------------------

    
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>             Fix For: 0.23.3, 2.0.2-alpha
>
>         Attachments: MAPREDUCE-3348-1.patch, MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Hudson (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13414391#comment-13414391 ] 

Hudson commented on MAPREDUCE-3348:
-----------------------------------

Integrated in Hadoop-Hdfs-0.23-Build #313 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/313/])
    svn merge -c 1298978 FIXES:MAPREDUCE-3348. Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app. Contributed by Devaraj K. (Revision 1361385)

     Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1361385
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestClientRMService.java

                
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>             Fix For: 0.23.3
>
>         Attachments: MAPREDUCE-3348-1.patch, MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Devaraj K updated MAPREDUCE-3348:
---------------------------------

    Attachment: MAPREDUCE-3348-1.patch
    
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3348-1.patch, MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Devaraj K (Updated) (JIRA)" <ji...@apache.org>.

     [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Devaraj K updated MAPREDUCE-3348:
---------------------------------

    Status: Patch Available  (was: Open)

Thanks Vinod for taking a look into the patch. I have addressed the comments in the updated patch.

I'm sorry for the late response.
                
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3348-1.patch, MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226377#comment-13226377 ] 

Hudson commented on MAPREDUCE-3348:
-----------------------------------

Integrated in Hadoop-Mapreduce-0.23-Commit #674 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/674/])
    MAPREDUCE-3348. Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app. Contributed by Devaraj K.
svn merge --ignore-ancestry -c 1298978 ../../trunk/ (Revision 1298979)

     Result = ABORTED
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1298979
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestClientRMService.java

                
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3348-1.patch, MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-3348) mapred job -status fails to give info even if the job is present in History

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13225963#comment-13225963 ] 

Hadoop QA commented on MAPREDUCE-3348:
--------------------------------------

+1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12517690/MAPREDUCE-3348-1.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 eclipse:eclipse.  The patch built with eclipse:eclipse.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed unit tests in .

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2024//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2024//console

This message is automatically generated.
                
> mapred job -status fails to give info even if the job is present in History
> ---------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3348
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3348
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Devaraj K
>            Assignee: Devaraj K
>             Fix For: 0.23.2
>
>         Attachments: MAPREDUCE-3348-1.patch, MAPREDUCE-3348.patch
>
>
> It is trying to get the app report from the RM  for the job, RM throws exception when it doesn't find and then it is giving the same exception without trying from History Server.
> {code}
> 11/11/03 08:47:27 INFO ipc.HadoopYarnRPC: Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.mapred                                                                                  uce.v2.api.MRClientProtocol
> 11/11/03 08:47:28 WARN mapred.ClientServiceDelegate: Exception thrown by remote end.
> RemoteTrace:
>  at LocalTrace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> Exception in thread "main" RemoteTrace:
>  at Local Trace:
>         org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl: Trying to get information for an absent applicat                                                                                  ion application_1320278804241_0002
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:142)
>         at $Proxy6.getApplicationReport(Unknown Source)
>         at org.apache.hadoop.yarn.api.impl.pb.client.ClientRMProtocolPBClientImpl.getApplicationReport(ClientRMProtocolPBClie                                                                                  ntImpl.java:111)
>         at org.apache.hadoop.mapred.ResourceMgrDelegate.getApplicationReport(ResourceMgrDelegate.java:321)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getProxy(ClientServiceDelegate.java:137)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:273)
>         at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:353)
>         at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:429)
>         at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:186)
>         at org.apache.hadoop.mapreduce.tools.CLI.run(CLI.java:240)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
>         at org.apache.hadoop.mapred.JobClient.main(JobClient.java:1106)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira