You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Siddharth Seth (JIRA)" <ji...@apache.org> on 2011/08/12 07:18:27 UTC
[jira] [Created] (MAPREDUCE-2839) MR Jobs fail on a secure cluster
with viewfs
MR Jobs fail on a secure cluster with viewfs
--------------------------------------------
Key: MAPREDUCE-2839
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2839
Project: Hadoop Map/Reduce
Issue Type: Bug
Reporter: Siddharth Seth
Assignee: Siddharth Seth
Fix For: 0.23.0
TokenCache needs to use the new FileSystem.getDelegationTokens api for it to work with viewfs.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2839) MR Jobs fail on a secure
cluster with viewfs
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13085222#comment-13085222 ]
Hudson commented on MAPREDUCE-2839:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #742 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/742/])
MAPREDUCE-2839. Fixed TokenCache to get delegation tokens using both new and old apis. Contributed by Siddharth Seth.
acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1157420
Files :
* /hadoop/common/trunk/mapreduce/src/test/mapred/org/apache/hadoop/mapreduce/security/TestTokenCache.java
* /hadoop/common/trunk/mapreduce/CHANGES.txt
* /hadoop/common/trunk/mapreduce/src/java/org/apache/hadoop/mapreduce/security/TokenCache.java
> MR Jobs fail on a secure cluster with viewfs
> --------------------------------------------
>
> Key: MAPREDUCE-2839
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2839
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Siddharth Seth
> Assignee: Siddharth Seth
> Fix For: 0.23.0
>
> Attachments: MR2839_0.patch, MR2839_279_0.patch, MR2839_trunk_1.patch
>
>
> TokenCache needs to use the new FileSystem.getDelegationTokens api for it to work with viewfs.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2839) MR Jobs fail on a secure
cluster with viewfs
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13084714#comment-13084714 ]
Hudson commented on MAPREDUCE-2839:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #766 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/766/])
MAPREDUCE-2839. Fixed TokenCache to get delegation tokens using both new and old apis. Contributed by Siddharth Seth.
acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1157420
Files :
* /hadoop/common/trunk/mapreduce/src/test/mapred/org/apache/hadoop/mapreduce/security/TestTokenCache.java
* /hadoop/common/trunk/mapreduce/CHANGES.txt
* /hadoop/common/trunk/mapreduce/src/java/org/apache/hadoop/mapreduce/security/TokenCache.java
> MR Jobs fail on a secure cluster with viewfs
> --------------------------------------------
>
> Key: MAPREDUCE-2839
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2839
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Siddharth Seth
> Assignee: Siddharth Seth
> Fix For: 0.23.0
>
> Attachments: MR2839_0.patch, MR2839_279_0.patch, MR2839_trunk_1.patch
>
>
> TokenCache needs to use the new FileSystem.getDelegationTokens api for it to work with viewfs.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2839) MR Jobs fail on a secure cluster
with viewfs
Posted by "Siddharth Seth (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Siddharth Seth updated MAPREDUCE-2839:
--------------------------------------
Attachment: MR2839_trunk_1.patch
Updated patch to apply cleanly against trunk after yesterday's commits.
Two test failures - both not related to the patch.
TEST-org.apache.hadoop.cli.TestMRCLI.txt:Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 28.994 sec
TEST-org.apache.hadoop.mapred.TestCombineOutputCollector.txt:Tests run: 2, Failures: 2, Errors: 0, Time elapsed: 1.605 sec
1 new FindBug warning while running test-patch - not related.
Haven't been able to get ant binary-system (FI build) to work. Seems to pick up an old version of common without NetUtils.verifyHostnames
Will post a patch for the MR-279 branch shortly.
> MR Jobs fail on a secure cluster with viewfs
> --------------------------------------------
>
> Key: MAPREDUCE-2839
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2839
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Siddharth Seth
> Assignee: Siddharth Seth
> Fix For: 0.23.0
>
> Attachments: MR2839_0.patch, MR2839_trunk_1.patch
>
>
> TokenCache needs to use the new FileSystem.getDelegationTokens api for it to work with viewfs.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2839) MR Jobs fail on a secure
cluster with viewfs
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13084830#comment-13084830 ]
Hudson commented on MAPREDUCE-2839:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #754 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/754/])
MAPREDUCE-2839. Fixed TokenCache to get delegation tokens using both new and old apis. Contributed by Siddharth Seth.
acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1157420
Files :
* /hadoop/common/trunk/mapreduce/src/test/mapred/org/apache/hadoop/mapreduce/security/TestTokenCache.java
* /hadoop/common/trunk/mapreduce/CHANGES.txt
* /hadoop/common/trunk/mapreduce/src/java/org/apache/hadoop/mapreduce/security/TokenCache.java
> MR Jobs fail on a secure cluster with viewfs
> --------------------------------------------
>
> Key: MAPREDUCE-2839
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2839
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Siddharth Seth
> Assignee: Siddharth Seth
> Fix For: 0.23.0
>
> Attachments: MR2839_0.patch, MR2839_279_0.patch, MR2839_trunk_1.patch
>
>
> TokenCache needs to use the new FileSystem.getDelegationTokens api for it to work with viewfs.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2839) MR Jobs fail on a secure cluster
with viewfs
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-2839:
-------------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I just committed this to both trunk and MR-279. Thanks Sid!
> MR Jobs fail on a secure cluster with viewfs
> --------------------------------------------
>
> Key: MAPREDUCE-2839
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2839
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Siddharth Seth
> Assignee: Siddharth Seth
> Fix For: 0.23.0
>
> Attachments: MR2839_0.patch, MR2839_279_0.patch, MR2839_trunk_1.patch
>
>
> TokenCache needs to use the new FileSystem.getDelegationTokens api for it to work with viewfs.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2839) MR Jobs fail on a secure cluster
with viewfs
Posted by "Siddharth Seth (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Siddharth Seth updated MAPREDUCE-2839:
--------------------------------------
Status: Patch Available (was: Open)
the call to getDelegationToken is retained for now, for hftp to work. This will however end up getting the delegation token twice for other filesystem which implement both APIs.
> MR Jobs fail on a secure cluster with viewfs
> --------------------------------------------
>
> Key: MAPREDUCE-2839
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2839
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Siddharth Seth
> Assignee: Siddharth Seth
> Fix For: 0.23.0
>
> Attachments: MR2839_0.patch
>
>
> TokenCache needs to use the new FileSystem.getDelegationTokens api for it to work with viewfs.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2839) MR Jobs fail on a secure cluster
with viewfs
Posted by "Siddharth Seth (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Siddharth Seth updated MAPREDUCE-2839:
--------------------------------------
Attachment: MR2839_0.patch
> MR Jobs fail on a secure cluster with viewfs
> --------------------------------------------
>
> Key: MAPREDUCE-2839
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2839
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Siddharth Seth
> Assignee: Siddharth Seth
> Fix For: 0.23.0
>
> Attachments: MR2839_0.patch
>
>
> TokenCache needs to use the new FileSystem.getDelegationTokens api for it to work with viewfs.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2839) MR Jobs fail on a secure cluster
with viewfs
Posted by "Siddharth Seth (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Siddharth Seth updated MAPREDUCE-2839:
--------------------------------------
Attachment: MR2839_279_0.patch
Patch for the MR-279 branch.
> MR Jobs fail on a secure cluster with viewfs
> --------------------------------------------
>
> Key: MAPREDUCE-2839
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2839
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Siddharth Seth
> Assignee: Siddharth Seth
> Fix For: 0.23.0
>
> Attachments: MR2839_0.patch, MR2839_279_0.patch, MR2839_trunk_1.patch
>
>
> TokenCache needs to use the new FileSystem.getDelegationTokens api for it to work with viewfs.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira