You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Boris Shkolnik (JIRA)" <ji...@apache.org> on 2010/01/16 00:42:54 UTC
[jira] Created: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Allow storage and caching of delegation token.
----------------------------------------------
Key: MAPREDUCE-1383
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
Project: Hadoop Map/Reduce
Issue Type: New Feature
Reporter: Boris Shkolnik
Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated MAPREDUCE-1383:
--------------------------------------
Status: Patch Available (was: Open)
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated MAPREDUCE-1383:
--------------------------------------
Status: Patch Available (was: Open)
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated MAPREDUCE-1383:
--------------------------------------
Attachment: MAPREDUCE-1383-9.patch
addressed review comments.
changed ivy.xml in mamuk to include hdfs.jar
changed service field in the Delegation Token to "inet_addr:port"
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12805425#action_12805425 ]
Devaraj Das commented on MAPREDUCE-1383:
----------------------------------------
[exec] compile-aspects:
[exec] [echo] 1.6
[exec] [echo] Start weaving aspects in place
[exec] [iajc] /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h6.grid.sp2.yahoo.net/trunk/src/java/org/apache/hadoop/mapreduce/JobSubmitter.java:39 [error] The import org.apache.hadoop.hdfs cannot be resolved
[exec] [iajc] import org.apache.hadoop.hdfs.DistributedFileSystem;
[exec] [iajc] ^^^^^^^^^^^^^^^^^^^^^
[exec] [iajc] /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h6.grid.sp2.yahoo.net/trunk/src/java/org/apache/hadoop/mapreduce/JobSubmitter.java:40 [error] The import org.apache.hadoop.hdfs cannot be resolved
[exec] [iajc] import org.apache.hadoop.hdfs.security.token.DelegationTokenIdentifier;
[exec] [iajc] ^^^^^^^^^^^^^^^^^^^^^
[exec] [iajc] /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h6.grid.sp2.yahoo.net/trunk/src/java/org/apache/hadoop/mapreduce/JobSubmitter.java:41 [error] The import org.apache.hadoop.hdfs cannot be resolved
[exec] [iajc] import org.apache.hadoop.hdfs.server.namenode.NameNode;
[exec] [iajc] ^^^^^^^^^^^^^^^^^^^^^
[exec] [iajc] /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h6.grid.sp2.yahoo.net/trunk/src/java/org/apache/hadoop/mapreduce/security/TokenCache.java:32 [error] The import org.apache.hadoop.hdfs cannot be resolved
[exec] [iajc] import org.apache.hadoop.hdfs.DistributedFileSystem;
[exec] [iajc] ^^^^^^^^^^^^^^^^^^^^^
[exec] [iajc] /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h6.grid.sp2.yahoo.net/trunk/src/java/org/apache/hadoop/mapreduce/security/TokenCache.java:33 [error] The import org.apache.hadoop.hdfs cannot be resolved
[exec] [iajc] import org.apache.hadoop.hdfs.security.token.DelegationTokenIdentifier;
[exec] [iajc] ^^^^^^^^^^^^^^^^^^^^^
[exec] [iajc] /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h6.grid.sp2.yahoo.net/trunk/src/java/org/apache/hadoop/mapreduce/security/TokenCache.java:99 [error] DelegationTokenIdentifier cannot be resolved to a type
[exec] [iajc] public static Token<DelegationTokenIdentifier> getDelegationToken(String namenode) {
[exec] [iajc] ^^^^^^^^^^^^^^^^^^^^^^
[exec] [iajc] /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h6.grid.sp2.yahoo.net/trunk/src/java/org/apache/hadoop/mapreduce/security/TokenCache.java:181 [error] DistributedFileSystem cannot be resolved to a type
[exec] [iajc] if(fs instanceof DistributedFileSystem) {
[exec] [iajc] ^^^^^^^^^^^^^^
[exec] [iajc] /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h6.grid.sp2.yahoo.net/trunk/src/java/org/apache/hadoop/mapreduce/security/TokenCache.java:182 [error] DistributedFileSystem cannot be resolved to a type
[exec] [iajc] DistributedFileSystem dfs = (DistributedFileSystem)fs;
[exec] [iajc] ^^^^^^^^^^^^
[exec] [iajc] /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h6.grid.sp2.yahoo.net/trunk/src/java/org/apache/hadoop/mapreduce/security/TokenCache.java:182 [error] DistributedFileSystem cannot be resolved to a type
[exec] [iajc] DistributedFileSystem dfs = (DistributedFileSystem)fs;
[exec] [iajc] ^^^^^^^^^^^^
[exec] [iajc] /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h6.grid.sp2.yahoo.net/trunk/src/java/org/apache/hadoop/mapreduce/security/TokenCache.java:186 [error] DelegationTokenIdentifier cannot be resolved to a type
[exec] [iajc] Token<DelegationTokenIdentifier> token =
[exec] [iajc] ^^^^^^^^^^^^^^^^
[exec] [iajc] /grid/0/hudson/hudson-slave/workspace/Mapreduce-Patch-h6.grid.sp2.yahoo.net/trunk/src/java/org/apache/hadoop/mapreduce/security/TokenCache.java:187 [error] The method getDelegationToken(String) is undefined for the type TokenCache
[exec] [iajc] TokenCache.getDelegationToken(fs_uri);
[exec] [iajc] ^^^^^^^
[exec] [iajc]
[exec] [iajc] 11 errors
[exec]
[exec] BUILD FAILED
This is there is the log of the build. The reason for this is the hdfs jar is not present in the classpath when compile-aspects is running. Is there a way to avoid having to import hdfs.* in the patch.
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12806138#action_12806138 ]
Boris Shkolnik commented on MAPREDUCE-1383:
-------------------------------------------
Two following tests are failing:
TestTaskTrackerBlacklisting
org.apache.hadoop.streaming.TestLoadTypedBytes
I ran them manually and they worked fine.
There is a jira for TestTaskTrackerBlacklisting intermittent failure (MAPREDUCE-1412).
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12806092#action_12806092 ]
Hadoop QA commented on MAPREDUCE-1383:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12431687/MAPREDUCE-1383-9.patch
against trunk revision 903563.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 6 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/414/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/414/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/414/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/414/console
This message is automatically generated.
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated MAPREDUCE-1383:
--------------------------------------
Tags: security
Release Note: mapreduce.job.hdfs-servers - declares hdfs servers to be used by the job, so client can pre-fetch delegation tokens for thsese servers (comma separated list of NameNodes).
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Assignee: Boris Shkolnik
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, MAPREDUCE-1383-11.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch, MAPREDUCE-1383-BP20-3.patch, MAPREDUCE-1383-BP20-4.patch, MAPREDUCE-1383-BP20-5.patch, MAPREDUCE-1383-BP20-6.patch, MAPREDUCE-1383-BP20-7.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828024#action_12828024 ]
Devaraj Das commented on MAPREDUCE-1383:
----------------------------------------
The 0.20 patch has the TestTokenCache.java deleted. Please fix that and upload a new one. Other than that looks fine.
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Assignee: Boris Shkolnik
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, MAPREDUCE-1383-11.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch, MAPREDUCE-1383-BP20-3.patch, MAPREDUCE-1383-BP20-4.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated MAPREDUCE-1383:
--------------------------------------
Status: Patch Available (was: Open)
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated MAPREDUCE-1383:
--------------------------------------
Attachment: MAPREDUCE-1383-BP20-6.patch
merged backport
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Assignee: Boris Shkolnik
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, MAPREDUCE-1383-11.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch, MAPREDUCE-1383-BP20-3.patch, MAPREDUCE-1383-BP20-4.patch, MAPREDUCE-1383-BP20-5.patch, MAPREDUCE-1383-BP20-6.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated MAPREDUCE-1383:
--------------------------------------
Status: Open (was: Patch Available)
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12805757#action_12805757 ]
Devaraj Das commented on MAPREDUCE-1383:
----------------------------------------
And yes, as per the offline discussion with Kan you need to have host:port instead of URIs for the service field of the delegation tokens.
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated MAPREDUCE-1383:
--------------------------------------
Attachment: MAPREDUCE-1383-BP20-5.patch
backport. fixed a typo (append()=>sb.append) in TokenCache.java
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Assignee: Boris Shkolnik
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, MAPREDUCE-1383-11.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch, MAPREDUCE-1383-BP20-3.patch, MAPREDUCE-1383-BP20-4.patch, MAPREDUCE-1383-BP20-5.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12806218#action_12806218 ]
Devaraj Das commented on MAPREDUCE-1383:
----------------------------------------
The "/IP:PORT" looks odd. Please change the service to be <IP-ADDRESS-OF-HOST>:PORT. Other than that patch looks fine.
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated MAPREDUCE-1383:
--------------------------------------
Attachment: MAPREDUCE-1383-5.patch
preliminary patch
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated MAPREDUCE-1383:
--------------------------------------
Attachment: MAPREDUCE-1383-2.patch
changed DfsClient to DistributedFileSystem
changed references thru tokenStorage to TokenCache.
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12805754#action_12805754 ]
Devaraj Das commented on MAPREDUCE-1383:
----------------------------------------
Some comments:
1) Remove the LOG.info statements from TokenCache
2) Please add a method in TokenCache to load tokens from a file specified in the argument (rather than going indirectly through the conf). Then in Child.java, you can call that API directly rather than setting the file in conf.
3) Does it make sense to have a TokenCache.addPathsForGettingDelegationToken(Path[]) that's called from the places where you currently have TokenCache.obtainTokensForNamenodes. Then just before job submission you make one call to TokenCache.obtainTokensForNamenodes. That way we will be sure that there is not more than one per a namenode to get delegation tokens.
4) You define getDelegationTokens in TrackerDistributedCacheManager but don't invoke it. Also, you just need to pass the paths to the TokenCache.obtainTokensForNamenodes because that's already checking for duplicate entries.
We discussed offline that you need to fix the build so that the hdfs jars are in the classpath for the aspects compilation..
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12806695#action_12806695 ]
Hudson commented on MAPREDUCE-1383:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #221 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/221/])
. Automates fetching of delegation tokens in File*Formats Distributed Cache and Distcp. Also, provides a config mapreduce.job.hdfs-servers that the jobs can populate with a comma separated list of namenodes. The job client automatically fetches delegation tokens from those namenodes. Contributed by Boris Shkolnik.
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Assignee: Boris Shkolnik
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, MAPREDUCE-1383-11.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch, MAPREDUCE-1383-BP20-3.patch, MAPREDUCE-1383-BP20-4.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated MAPREDUCE-1383:
--------------------------------------
Attachment: MAPREDUCE-1383-BP20-4.patch
same change (ip:port) for backport.
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, MAPREDUCE-1383-11.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch, MAPREDUCE-1383-BP20-3.patch, MAPREDUCE-1383-BP20-4.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12806246#action_12806246 ]
Hadoop QA commented on MAPREDUCE-1383:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12431732/MAPREDUCE-1383-10.patch
against trunk revision 903563.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 6 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/415/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/415/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/415/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/415/console
This message is automatically generated.
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated MAPREDUCE-1383:
--------------------------------------
Attachment: MAPREDUCE-1383-10.patch
make sure DelegetionToken.setService() is "/IP:PORT"
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated MAPREDUCE-1383:
--------------------------------------
Status: Open (was: Patch Available)
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12803621#action_12803621 ]
Devaraj Das commented on MAPREDUCE-1383:
----------------------------------------
After a quick look at the patch, some comments:
1) The call to populateTokenCache should be done just before the submitJob call (so that we definitely have all the information to do with namenodes the job wishes to talk to at runtime, even those that are potentially added within calls to user's InputFormat.getSplits)
2) The configs mapreduce.job.hdfs-servers and mapreduce.job.kerberos.jtprinicipal could probably be defined in JobContext.java.
3) Also, though not directly related to this patch, but could you please move the JOB_TOKEN_FILE definition from JobContext.java to TokenStorage.java. Ditto for SecureShuffleUtils.JOB_TOKEN_FILENAME
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated MAPREDUCE-1383:
--------------------------------------
Attachment: MAPREDUCE-1383-BP20-3.patch
Patch for earlier version of Hadoop. Not for commit here.
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch, MAPREDUCE-1383-BP20-3.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12805360#action_12805360 ]
Hadoop QA commented on MAPREDUCE-1383:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12431493/MAPREDUCE-1383-6.patch
against trunk revision 903508.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 6 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
-1 javac. The patch appears to cause tar ant target to fail.
-1 findbugs. The patch appears to cause Findbugs to fail.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/409/testReport/
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/409/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/409/console
This message is automatically generated.
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828469#action_12828469 ]
Hudson commented on MAPREDUCE-1383:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #225 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/225/])
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Assignee: Boris Shkolnik
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, MAPREDUCE-1383-11.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch, MAPREDUCE-1383-BP20-3.patch, MAPREDUCE-1383-BP20-4.patch, MAPREDUCE-1383-BP20-5.patch, MAPREDUCE-1383-BP20-6.patch, MAPREDUCE-1383-BP20-7.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated MAPREDUCE-1383:
--------------------------------------
Attachment: MAPREDUCE-1383-BP20-7.patch
moved TestTokenCache.java from hadoop/security to hadoop/mapreduce/security
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Assignee: Boris Shkolnik
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, MAPREDUCE-1383-11.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch, MAPREDUCE-1383-BP20-3.patch, MAPREDUCE-1383-BP20-4.patch, MAPREDUCE-1383-BP20-5.patch, MAPREDUCE-1383-BP20-6.patch, MAPREDUCE-1383-BP20-7.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated MAPREDUCE-1383:
--------------------------------------
Attachment: MAPREDUCE-1383-1.patch
before submitting a job - contact all the namenodes (specified in the conf) to get their corresponding delegation token.
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated MAPREDUCE-1383:
--------------------------------------
Attachment: MAPREDUCE-1383-11.patch
bq.The "/IP:PORT" looks odd. Please change the service to be <IP-ADDRESS-OF-HOST>:PORT.
After discussion with Kan, we aggreed on "IP:PORT". Kan will match in his implementation.
here is my diff:
< - sb.append(NetUtils.normalizeHostName(uri.getHost())).append(":").append(port);
---
> + sb.append("/").append(NetUtils.normalizeHostName(uri.getHost())).append(":").append(port);
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, MAPREDUCE-1383-11.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch, MAPREDUCE-1383-BP20-3.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj Das updated MAPREDUCE-1383:
-----------------------------------
Resolution: Fixed
Fix Version/s: 0.22.0
Assignee: Boris Shkolnik
Status: Resolved (was: Patch Available)
I just committed this. Thanks, Boris!
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Assignee: Boris Shkolnik
> Fix For: 0.22.0
>
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-10.patch, MAPREDUCE-1383-11.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch, MAPREDUCE-1383-9.patch, MAPREDUCE-1383-BP20-3.patch, MAPREDUCE-1383-BP20-4.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1383) Allow storage and caching of
delegation token.
Posted by "Boris Shkolnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boris Shkolnik updated MAPREDUCE-1383:
--------------------------------------
Attachment: MAPREDUCE-1383-6.patch
> Allow storage and caching of delegation token.
> ----------------------------------------------
>
> Key: MAPREDUCE-1383
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1383
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Boris Shkolnik
> Attachments: MAPREDUCE-1383-1.patch, MAPREDUCE-1383-2.patch, MAPREDUCE-1383-5.patch, MAPREDUCE-1383-6.patch
>
>
> Client needs to obtain delegation tokens from all the NameNodes it is going to work with and pass it to the application.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.