You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Thomas Graves (JIRA)" <ji...@apache.org> on 2012/05/16 21:21:09 UTC
[jira] [Created] (MAPREDUCE-4264) Got ClassCastException when using
mapreduce.history.server.delegationtoken.required=true
Thomas Graves created MAPREDUCE-4264:
----------------------------------------
Summary: Got ClassCastException when using mapreduce.history.server.delegationtoken.required=true
Key: MAPREDUCE-4264
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4264
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.3
Reporter: Thomas Graves
Assignee: Thomas Graves
Priority: Blocker
Oozie fails to run on branch-0.23 with the following exception. This only affects branch-0.23 not branch-2 or trunk.
12/05/16 15:08:45 INFO mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/tgraves/.staging/job_1337177706246_0001java.lang.ClassCastException: org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker cannot be cast to org.apache.hadoop.ipc.RpcInvocationHandler at org.apache.hadoop.ipc.RPC.getConnectionIdForProxy(RPC.java:330) at org.apache.hadoop.ipc.RPC.getServerAddress(RPC.java:320) at org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl.getConnectAddress(MRClientProtocolPBClientImpl.java:108) at org.apache.hadoop.mapred.YARNRunner.getDelegationTokenFromHS(YARNRunner.java:195) at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:272) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:385) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1226) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1223) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)
Note that this is caused because oozie passes in the options: -Dmapreduce.history.server.delegationtoken.required=true -Dmapreduce.history.server.delegationtoken.renewer="mr token"
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4264) Got ClassCastException when
using mapreduce.history.server.delegationtoken.required=true
Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13277127#comment-13277127 ]
Thomas Graves commented on MAPREDUCE-4264:
------------------------------------------
I tested this manually by running wordcount with the -Dmapreduce.history.server.delegationtoken.required=true -Dmapreduce.history.server.delegationtoken.renewer="mr token" options. Without this fix you would get the cast exception above. I also verified that the IP put into the token file is correct - ie the one in the config file, in the case your host has IP aliasing turned on.
> Got ClassCastException when using mapreduce.history.server.delegationtoken.required=true
> ----------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4264
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4264
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.3
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Blocker
> Attachments: MAPREDUCE-4264-branch-0.23.patch
>
>
> Oozie fails to run on branch-0.23 with the following exception. This only affects branch-0.23 not branch-2 or trunk.
> 12/05/16 15:08:45 INFO mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/tgraves/.staging/job_1337177706246_0001java.lang.ClassCastException: org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker cannot be cast to org.apache.hadoop.ipc.RpcInvocationHandler at org.apache.hadoop.ipc.RPC.getConnectionIdForProxy(RPC.java:330) at org.apache.hadoop.ipc.RPC.getServerAddress(RPC.java:320) at org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl.getConnectAddress(MRClientProtocolPBClientImpl.java:108) at org.apache.hadoop.mapred.YARNRunner.getDelegationTokenFromHS(YARNRunner.java:195) at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:272) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:385) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1226) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1223) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)
> Note that this is caused because oozie passes in the options: -Dmapreduce.history.server.delegationtoken.required=true -Dmapreduce.history.server.delegationtoken.renewer="mr token"
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4264) Got ClassCastException when
using mapreduce.history.server.delegationtoken.required=true
Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13277100#comment-13277100 ]
Thomas Graves commented on MAPREDUCE-4264:
------------------------------------------
jenkins failed because it only applies to branch-0.23. Here is manual run:
-1 overall.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
-1 javadoc. The javadoc tool appears to have generated 18 warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version ) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
The javadoc warnings were not introduced by this jira - they are all pre-existing and have been fixed or excluded on trunk.
> Got ClassCastException when using mapreduce.history.server.delegationtoken.required=true
> ----------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4264
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4264
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.3
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Blocker
> Attachments: MAPREDUCE-4264-branch-0.23.patch
>
>
> Oozie fails to run on branch-0.23 with the following exception. This only affects branch-0.23 not branch-2 or trunk.
> 12/05/16 15:08:45 INFO mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/tgraves/.staging/job_1337177706246_0001java.lang.ClassCastException: org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker cannot be cast to org.apache.hadoop.ipc.RpcInvocationHandler at org.apache.hadoop.ipc.RPC.getConnectionIdForProxy(RPC.java:330) at org.apache.hadoop.ipc.RPC.getServerAddress(RPC.java:320) at org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl.getConnectAddress(MRClientProtocolPBClientImpl.java:108) at org.apache.hadoop.mapred.YARNRunner.getDelegationTokenFromHS(YARNRunner.java:195) at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:272) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:385) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1226) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1223) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)
> Note that this is caused because oozie passes in the options: -Dmapreduce.history.server.delegationtoken.required=true -Dmapreduce.history.server.delegationtoken.renewer="mr token"
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4264) Got ClassCastException when using
mapreduce.history.server.delegationtoken.required=true
Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans updated MAPREDUCE-4264:
-------------------------------------------
Resolution: Fixed
Fix Version/s: 0.23.3
Status: Resolved (was: Patch Available)
> Got ClassCastException when using mapreduce.history.server.delegationtoken.required=true
> ----------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4264
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4264
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.3
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Blocker
> Fix For: 0.23.3
>
> Attachments: MAPREDUCE-4264-branch-0.23.patch
>
>
> Oozie fails to run on branch-0.23 with the following exception. This only affects branch-0.23 not branch-2 or trunk.
> 12/05/16 15:08:45 INFO mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/tgraves/.staging/job_1337177706246_0001java.lang.ClassCastException: org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker cannot be cast to org.apache.hadoop.ipc.RpcInvocationHandler at org.apache.hadoop.ipc.RPC.getConnectionIdForProxy(RPC.java:330) at org.apache.hadoop.ipc.RPC.getServerAddress(RPC.java:320) at org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl.getConnectAddress(MRClientProtocolPBClientImpl.java:108) at org.apache.hadoop.mapred.YARNRunner.getDelegationTokenFromHS(YARNRunner.java:195) at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:272) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:385) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1226) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1223) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)
> Note that this is caused because oozie passes in the options: -Dmapreduce.history.server.delegationtoken.required=true -Dmapreduce.history.server.delegationtoken.renewer="mr token"
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Closed] (MAPREDUCE-4264) Got ClassCastException when using
mapreduce.history.server.delegationtoken.required=true
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy closed MAPREDUCE-4264.
------------------------------------
> Got ClassCastException when using mapreduce.history.server.delegationtoken.required=true
> ----------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4264
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4264
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.3
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Blocker
> Fix For: 0.23.3, 2.0.2-alpha
>
> Attachments: MAPREDUCE-4264-branch-0.23.patch
>
>
> Oozie fails to run on branch-0.23 with the following exception. This only affects branch-0.23 not branch-2 or trunk.
> 12/05/16 15:08:45 INFO mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/tgraves/.staging/job_1337177706246_0001java.lang.ClassCastException: org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker cannot be cast to org.apache.hadoop.ipc.RpcInvocationHandler at org.apache.hadoop.ipc.RPC.getConnectionIdForProxy(RPC.java:330) at org.apache.hadoop.ipc.RPC.getServerAddress(RPC.java:320) at org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl.getConnectAddress(MRClientProtocolPBClientImpl.java:108) at org.apache.hadoop.mapred.YARNRunner.getDelegationTokenFromHS(YARNRunner.java:195) at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:272) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:385) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1226) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1223) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)
> Note that this is caused because oozie passes in the options: -Dmapreduce.history.server.delegationtoken.required=true -Dmapreduce.history.server.delegationtoken.renewer="mr token"
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4264) Got ClassCastException when
using mapreduce.history.server.delegationtoken.required=true
Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13277037#comment-13277037 ]
Thomas Graves commented on MAPREDUCE-4264:
------------------------------------------
This appears to have been introduced by MAPREDUCE-4162 and HADOOP-8373 where a few of the Protobuf changes were pulled back from branch-2 to branch-0.23 to make the token changes easier. I believe it just missed one change needed in ProtoOverHadoopRpcEngine, which on the branch-2 is now common and renamed to be ProtobufRpcEngine. The Invoker class needs to implement RpcInvocationHandler instead of InvocationHandler.
> Got ClassCastException when using mapreduce.history.server.delegationtoken.required=true
> ----------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4264
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4264
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.3
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Blocker
>
> Oozie fails to run on branch-0.23 with the following exception. This only affects branch-0.23 not branch-2 or trunk.
> 12/05/16 15:08:45 INFO mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/tgraves/.staging/job_1337177706246_0001java.lang.ClassCastException: org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker cannot be cast to org.apache.hadoop.ipc.RpcInvocationHandler at org.apache.hadoop.ipc.RPC.getConnectionIdForProxy(RPC.java:330) at org.apache.hadoop.ipc.RPC.getServerAddress(RPC.java:320) at org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl.getConnectAddress(MRClientProtocolPBClientImpl.java:108) at org.apache.hadoop.mapred.YARNRunner.getDelegationTokenFromHS(YARNRunner.java:195) at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:272) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:385) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1226) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1223) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)
> Note that this is caused because oozie passes in the options: -Dmapreduce.history.server.delegationtoken.required=true -Dmapreduce.history.server.delegationtoken.renewer="mr token"
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4264) Got ClassCastException when
using mapreduce.history.server.delegationtoken.required=true
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13277064#comment-13277064 ]
Hadoop QA commented on MAPREDUCE-4264:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12527687/MAPREDUCE-4264-branch-0.23.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2390//console
This message is automatically generated.
> Got ClassCastException when using mapreduce.history.server.delegationtoken.required=true
> ----------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4264
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4264
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.3
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Blocker
> Attachments: MAPREDUCE-4264-branch-0.23.patch
>
>
> Oozie fails to run on branch-0.23 with the following exception. This only affects branch-0.23 not branch-2 or trunk.
> 12/05/16 15:08:45 INFO mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/tgraves/.staging/job_1337177706246_0001java.lang.ClassCastException: org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker cannot be cast to org.apache.hadoop.ipc.RpcInvocationHandler at org.apache.hadoop.ipc.RPC.getConnectionIdForProxy(RPC.java:330) at org.apache.hadoop.ipc.RPC.getServerAddress(RPC.java:320) at org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl.getConnectAddress(MRClientProtocolPBClientImpl.java:108) at org.apache.hadoop.mapred.YARNRunner.getDelegationTokenFromHS(YARNRunner.java:195) at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:272) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:385) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1226) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1223) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)
> Note that this is caused because oozie passes in the options: -Dmapreduce.history.server.delegationtoken.required=true -Dmapreduce.history.server.delegationtoken.renewer="mr token"
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4264) Got ClassCastException when
using mapreduce.history.server.delegationtoken.required=true
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13277766#comment-13277766 ]
Hudson commented on MAPREDUCE-4264:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #259 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/259/])
MAPREDUCE-4264. ClassCastException with oozie. (tgraves via bobby) (Revision 1339478)
Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1339478
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/ipc/ProtoOverHadoopRpcEngine.java
> Got ClassCastException when using mapreduce.history.server.delegationtoken.required=true
> ----------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4264
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4264
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.3
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Blocker
> Fix For: 0.23.3
>
> Attachments: MAPREDUCE-4264-branch-0.23.patch
>
>
> Oozie fails to run on branch-0.23 with the following exception. This only affects branch-0.23 not branch-2 or trunk.
> 12/05/16 15:08:45 INFO mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/tgraves/.staging/job_1337177706246_0001java.lang.ClassCastException: org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker cannot be cast to org.apache.hadoop.ipc.RpcInvocationHandler at org.apache.hadoop.ipc.RPC.getConnectionIdForProxy(RPC.java:330) at org.apache.hadoop.ipc.RPC.getServerAddress(RPC.java:320) at org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl.getConnectAddress(MRClientProtocolPBClientImpl.java:108) at org.apache.hadoop.mapred.YARNRunner.getDelegationTokenFromHS(YARNRunner.java:195) at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:272) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:385) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1226) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1223) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)
> Note that this is caused because oozie passes in the options: -Dmapreduce.history.server.delegationtoken.required=true -Dmapreduce.history.server.delegationtoken.renewer="mr token"
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4264) Got ClassCastException when using
mapreduce.history.server.delegationtoken.required=true
Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves updated MAPREDUCE-4264:
-------------------------------------
Status: Patch Available (was: Open)
> Got ClassCastException when using mapreduce.history.server.delegationtoken.required=true
> ----------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4264
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4264
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.3
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Blocker
> Attachments: MAPREDUCE-4264-branch-0.23.patch
>
>
> Oozie fails to run on branch-0.23 with the following exception. This only affects branch-0.23 not branch-2 or trunk.
> 12/05/16 15:08:45 INFO mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/tgraves/.staging/job_1337177706246_0001java.lang.ClassCastException: org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker cannot be cast to org.apache.hadoop.ipc.RpcInvocationHandler at org.apache.hadoop.ipc.RPC.getConnectionIdForProxy(RPC.java:330) at org.apache.hadoop.ipc.RPC.getServerAddress(RPC.java:320) at org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl.getConnectAddress(MRClientProtocolPBClientImpl.java:108) at org.apache.hadoop.mapred.YARNRunner.getDelegationTokenFromHS(YARNRunner.java:195) at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:272) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:385) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1226) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1223) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)
> Note that this is caused because oozie passes in the options: -Dmapreduce.history.server.delegationtoken.required=true -Dmapreduce.history.server.delegationtoken.renewer="mr token"
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4264) Got ClassCastException when
using mapreduce.history.server.delegationtoken.required=true
Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13277548#comment-13277548 ]
Robert Joseph Evans commented on MAPREDUCE-4264:
------------------------------------------------
The patch looks simple enough, and fixes the error. +1.
> Got ClassCastException when using mapreduce.history.server.delegationtoken.required=true
> ----------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4264
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4264
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.3
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Blocker
> Attachments: MAPREDUCE-4264-branch-0.23.patch
>
>
> Oozie fails to run on branch-0.23 with the following exception. This only affects branch-0.23 not branch-2 or trunk.
> 12/05/16 15:08:45 INFO mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/tgraves/.staging/job_1337177706246_0001java.lang.ClassCastException: org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker cannot be cast to org.apache.hadoop.ipc.RpcInvocationHandler at org.apache.hadoop.ipc.RPC.getConnectionIdForProxy(RPC.java:330) at org.apache.hadoop.ipc.RPC.getServerAddress(RPC.java:320) at org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl.getConnectAddress(MRClientProtocolPBClientImpl.java:108) at org.apache.hadoop.mapred.YARNRunner.getDelegationTokenFromHS(YARNRunner.java:195) at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:272) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:385) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1226) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1223) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)
> Note that this is caused because oozie passes in the options: -Dmapreduce.history.server.delegationtoken.required=true -Dmapreduce.history.server.delegationtoken.renewer="mr token"
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4264) Got ClassCastException when using
mapreduce.history.server.delegationtoken.required=true
Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves updated MAPREDUCE-4264:
-------------------------------------
Attachment: MAPREDUCE-4264-branch-0.23.patch
initial patch that passes manual tests.
> Got ClassCastException when using mapreduce.history.server.delegationtoken.required=true
> ----------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-4264
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4264
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.3
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Blocker
> Attachments: MAPREDUCE-4264-branch-0.23.patch
>
>
> Oozie fails to run on branch-0.23 with the following exception. This only affects branch-0.23 not branch-2 or trunk.
> 12/05/16 15:08:45 INFO mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/tgraves/.staging/job_1337177706246_0001java.lang.ClassCastException: org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker cannot be cast to org.apache.hadoop.ipc.RpcInvocationHandler at org.apache.hadoop.ipc.RPC.getConnectionIdForProxy(RPC.java:330) at org.apache.hadoop.ipc.RPC.getServerAddress(RPC.java:320) at org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl.getConnectAddress(MRClientProtocolPBClientImpl.java:108) at org.apache.hadoop.mapred.YARNRunner.getDelegationTokenFromHS(YARNRunner.java:195) at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:272) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:385) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1226) at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1223) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)
> Note that this is caused because oozie passes in the options: -Dmapreduce.history.server.delegationtoken.required=true -Dmapreduce.history.server.delegationtoken.renewer="mr token"
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira