You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Benoy Antony (JIRA)" <ji...@apache.org> on 2012/08/13 19:00:38 UTC
[jira] [Created] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Benoy Antony created MAPREDUCE-4554:
---------------------------------------
Summary: Job Credentials are not transmitted if security is turned off
Key: MAPREDUCE-4554
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: job submission, security
Reporter: Benoy Antony
Assignee: Benoy Antony
Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
These credentials get submitted during job submission and are made available to the task processes.
In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
In HADOOP 2 , these credentials are transmitted only when the security is turned on.
This should be changed for two reasons:
1) It is not backward compatible.
2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13471901#comment-13471901 ]
Hudson commented on MAPREDUCE-4554:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #2849 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2849/])
MAPREDUCE-4554. Job Credentials are not transmitted if security is turned off (Benoy Antony via bobby) (Revision 1395769)
Result = FAILURE
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1395769
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskAttemptImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestStagingCleanup.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/security/CredentialsTestJob.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/security/TestMRCredentials.java
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: 3.0.0, 2.0.3-alpha, 0.23.5
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13468649#comment-13468649 ]
Benoy Antony commented on MAPREDUCE-4554:
-----------------------------------------
Attached the patch which addresses Robert's comments in regards to sleep job related names and comments in the test class.
It also passed all the unit tests and received a +1 from Jenkins.
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Attachment: MR_4554_trunk.patch
Attaching latest patch after merging changes from trunk.
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Attachments: MR_4554_1_1.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk_testonly.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Attachment: (was: MR_4554_trunk_testonly.patch)
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13468577#comment-13468577 ]
Hadoop QA commented on MAPREDUCE-4554:
--------------------------------------
{color:green}+1 overall{color}. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12547532/MR_4554_trunk.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author tags.
{color:green}+1 tests included{color}. The patch appears to include 3 new or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2904//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2904//console
This message is automatically generated.
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Attachment: (was: MR_4554_1_1.patch)
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13442537#comment-13442537 ]
Benoy Antony commented on MAPREDUCE-4554:
-----------------------------------------
It works in MR 1.0 , but coes not work in trunk as mentioned in description.
HADOOP-8225 did not introduce the problem mentioned in this issue.
HADOOP-8225 introduced the problem mentioned in HADOOP-8276 .
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Attachments: MR_4554_1_1.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk_testonly.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Joseph Evans updated MAPREDUCE-4554:
-------------------------------------------
Resolution: Fixed
Fix Version/s: (was: trunk)
0.23.5
2.0.3-alpha
3.0.0
Target Version/s: 0.23.5
Status: Resolved (was: Patch Available)
Thanks for the patch Benoy +1,
I put this into trunk, branch-2, and branch-0.23.
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: 3.0.0, 2.0.3-alpha, 0.23.5
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454952#comment-13454952 ]
Robert Joseph Evans commented on MAPREDUCE-4554:
------------------------------------------------
The changes look OK to me too for the most part, but the new files you have added are using tabs, and the spacing appears to be off a bit. Our style guide says that we should be using 2 spaces for each indentation, not tabs. Please fix it.
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Daryn Sharp (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13442489#comment-13442489 ]
Daryn Sharp commented on MAPREDUCE-4554:
----------------------------------------
bq. Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary.
I don't think passing secrets them via {{mapreduce.job.credentials.binary}} ever worked? MR code appears to explicitly pass only tokens.
Question: did HADOOP-8225 actually introduce these issues? As best as I can tell, these are additional bugs that also aren't handled? I presume this issue manifests only when an insecure cluster accesses a secure cluster?
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Attachments: MR_4554_1_1.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk_testonly.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13442546#comment-13442546 ]
Benoy Antony commented on MAPREDUCE-4554:
-----------------------------------------
The included test passes in 1.0 , but fails on trunk.
The attached patch for 1.1 is a test only patch.
The patch for trunk includes test plus the required fix.
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Attachments: MR_4554_1_1.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk_testonly.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Attachment: MR_4554_trunk.patch
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Affects Version/s: 2.0.0-alpha
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Attachments: MR_4554_1_1.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Status: Open (was: Patch Available)
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13471859#comment-13471859 ]
Hudson commented on MAPREDUCE-4554:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #2825 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2825/])
MAPREDUCE-4554. Job Credentials are not transmitted if security is turned off (Benoy Antony via bobby) (Revision 1395769)
Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1395769
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskAttemptImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestStagingCleanup.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/security/CredentialsTestJob.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/security/TestMRCredentials.java
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: 3.0.0, 2.0.3-alpha, 0.23.5
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13449143#comment-13449143 ]
Hadoop QA commented on MAPREDUCE-4554:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12543901/MR_4554_trunk.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 2 new or modified test files.
-1 javac. The applied patch generated 2061 javac compiler warnings (more than the trunk's current 2059 warnings).
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient:
org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2819//testReport/
Javac warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2819//artifact/trunk/patchprocess/diffJavacWarnings.txt
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2819//console
This message is automatically generated.
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13472403#comment-13472403 ]
Hudson commented on MAPREDUCE-4554:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #1221 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1221/])
MAPREDUCE-4554. Job Credentials are not transmitted if security is turned off (Benoy Antony via bobby) (Revision 1395769)
Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1395769
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskAttemptImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestStagingCleanup.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/security/CredentialsTestJob.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/security/TestMRCredentials.java
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: 3.0.0, 2.0.3-alpha, 0.23.5
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Attachment: MR_4554_trunk.patch
Suppressing the deprecation warning due to the use of MiniMRCluster
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Status: Patch Available (was: Open)
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433301#comment-13433301 ]
Benoy Antony commented on MAPREDUCE-4554:
-----------------------------------------
The patch adds a test case for 1.1 and 2.0 .
It also removes security on/off checks when transmitting credentials.
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Attachments: MR_4554_1_1.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13460629#comment-13460629 ]
Benoy Antony commented on MAPREDUCE-4554:
-----------------------------------------
Thanks Robert. I'll fix the tab issue.
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Daryn Sharp (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13468016#comment-13468016 ]
Daryn Sharp commented on MAPREDUCE-4554:
----------------------------------------
+1 After Bobby is satisfied. Great job!
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Work started] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Work on MAPREDUCE-4554 started by Benoy Antony.
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Attachments: MR_4554_1_1.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk_testonly.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Attachment: MR_4554_trunk.patch
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13467458#comment-13467458 ]
Hadoop QA commented on MAPREDUCE-4554:
--------------------------------------
{color:red}-1 overall{color}. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12547329/MR_4554_trunk.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author tags.
{color:green}+1 tests included{color}. The patch appears to include 3 new or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient:
org.apache.hadoop.mapreduce.v2.app.TestRecovery
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2899//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2899//console
This message is automatically generated.
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Attachment: MR_4554_trunk.patch
Attaching patch with the following changes
1) Fixed TestStagingCleanup to fix the test failures.
2) Fixed TestMRCredentials to fix the deprecation warnings
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13442551#comment-13442551 ]
Benoy Antony commented on MAPREDUCE-4554:
-----------------------------------------
A correction : HADOOP-8225 introduced the problem mentioned in HADOOP-8726 .
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Attachments: MR_4554_1_1.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk_testonly.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Status: Open (was: Patch Available)
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13467989#comment-13467989 ]
Robert Joseph Evans commented on MAPREDUCE-4554:
------------------------------------------------
I am not really sure what happened here with the test failure. The test passes for me when I run it myself. Looking more closely at the failures, two of them seem to be because the recovery could not find the jhist file to recover from. One of them appears to be a bit of a race, but I don't really know for sure. Either way I don't think they are caused by the patch. I think it is more likely that they are caused by two people running the tests at the same time on the same box. Local runner collides that way.
The patch looks OK to me for the most part. I would like to see the comments and class names in CredentialsTestJob updated, because they still refer to sleep, almost like they were copied and pasted from sleep job. But that is it.
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Status: Open (was: Patch Available)
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Attachment: MR_4554_trunk.patch
fixing the spacing issue on the new files
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Status: Open (was: Patch Available)
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Daryn Sharp (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446109#comment-13446109 ]
Daryn Sharp commented on MAPREDUCE-4554:
----------------------------------------
Minor suggestion, in {{TaskAttemptImpl}} you could replace {{addAll}} with {{taskCredentials = new Credentials(credentials);}}.
Otherwise, +1. Good job!
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Attachments: MR_4554_1_1.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk_testonly.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Status: Open (was: Patch Available)
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13472313#comment-13472313 ]
Hudson commented on MAPREDUCE-4554:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #399 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/399/])
svn merge -c 1395769 FIXES: MAPREDUCE-4554. Job Credentials are not transmitted if security is turned off (Benoy Antony via bobby) (Revision 1395774)
Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1395774
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskAttemptImpl.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestStagingCleanup.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/security/CredentialsTestJob.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/security/TestMRCredentials.java
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: 3.0.0, 2.0.3-alpha, 0.23.5
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13471858#comment-13471858 ]
Hudson commented on MAPREDUCE-4554:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #2887 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2887/])
MAPREDUCE-4554. Job Credentials are not transmitted if security is turned off (Benoy Antony via bobby) (Revision 1395769)
Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1395769
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskAttemptImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestStagingCleanup.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/security/CredentialsTestJob.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/security/TestMRCredentials.java
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: 3.0.0, 2.0.3-alpha, 0.23.5
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Daryn Sharp (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13470306#comment-13470306 ]
Daryn Sharp commented on MAPREDUCE-4554:
----------------------------------------
+1 Bobby is OOO for probably the next week. This is a joint +1 since he requested trivial changes.
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Attachment: MR_4554_trunk.patch
Attaching the new patch with Daryn's suggested improvement.
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Attachments: MR_4554_1_1.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk_testonly.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13448877#comment-13448877 ]
Hadoop QA commented on MAPREDUCE-4554:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12543333/MR_4554_trunk.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 2 new or modified test files.
-1 javac. The applied patch generated 2063 javac compiler warnings (more than the trunk's current 2059 warnings).
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient:
org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup
org.apache.hadoop.mapred.TestMiniMRClasspath
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2813//testReport/
Javac warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2813//artifact/trunk/patchprocess/diffJavacWarnings.txt
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2813//console
This message is automatically generated.
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Status: Patch Available (was: Open)
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Status: Patch Available (was: Open)
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13472346#comment-13472346 ]
Hudson commented on MAPREDUCE-4554:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #1190 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1190/])
MAPREDUCE-4554. Job Credentials are not transmitted if security is turned off (Benoy Antony via bobby) (Revision 1395769)
Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1395769
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskAttemptImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/TestStagingCleanup.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/security/CredentialsTestJob.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/security/TestMRCredentials.java
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: 3.0.0, 2.0.3-alpha, 0.23.5
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465789#comment-13465789 ]
Hadoop QA commented on MAPREDUCE-4554:
--------------------------------------
{color:red}-1 overall{color}. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12547009/MR_4554_trunk.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author tags.
{color:green}+1 tests included{color}. The patch appears to include 3 new or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient:
org.apache.hadoop.mapred.lib.aggregate.TestAggregates
org.apache.hadoop.mapreduce.lib.db.TestDataDrivenDBInputFormat
org.apache.hadoop.mapred.TestTaskCommit
org.apache.hadoop.mapred.TestFieldSelection
org.apache.hadoop.mapreduce.TestLocalRunner
org.apache.hadoop.mapred.TestUserDefinedCounters
org.apache.hadoop.mapred.TestSpecialCharactersInOutputPath
org.apache.hadoop.mapreduce.TestMROutputFormat
org.apache.hadoop.mapred.TestLineRecordReader
org.apache.hadoop.mapreduce.lib.fieldsel.TestMRFieldSelection
org.apache.hadoop.mapred.TestLocalMRNotification
org.apache.hadoop.mapreduce.lib.map.TestMultithreadedMapper
org.apache.hadoop.mapred.lib.TestChainMapReduce
org.apache.hadoop.mapreduce.TestMapReduce
org.apache.hadoop.mapreduce.lib.join.TestJoinDatamerge
org.apache.hadoop.mapred.lib.TestKeyFieldBasedComparator
org.apache.hadoop.mapred.lib.TestMultithreadedMapRunner
org.apache.hadoop.mapred.lib.TestMultipleOutputs
org.apache.hadoop.mapred.TestJavaSerialization
org.apache.hadoop.mapreduce.lib.input.TestLineRecordReader
org.apache.hadoop.mapreduce.lib.output.TestMRMultipleOutputs
org.apache.hadoop.mapred.TestCollect
org.apache.hadoop.fs.slive.TestSlive
org.apache.hadoop.mapred.join.TestDatamerge
org.apache.hadoop.mapreduce.TestMapCollection
org.apache.hadoop.fs.TestDFSIO
org.apache.hadoop.mapreduce.lib.aggregate.TestMapReduceAggregates
org.apache.hadoop.mapred.TestMapRed
org.apache.hadoop.mapred.TestFileOutputFormat
org.apache.hadoop.mapreduce.TestValueIterReset
org.apache.hadoop.mapred.TestMapOutputType
org.apache.hadoop.mapred.TestJobCounters
org.apache.hadoop.fs.TestFileSystem
org.apache.hadoop.conf.TestNoDefaultsJobConf
org.apache.hadoop.mapred.TestReporter
org.apache.hadoop.mapreduce.lib.partition.TestMRKeyFieldBasedComparator
org.apache.hadoop.mapreduce.lib.chain.TestChainErrors
org.apache.hadoop.mapreduce.lib.chain.TestSingleElementChain
org.apache.hadoop.mapreduce.lib.input.TestMultipleInputs
org.apache.hadoop.mapred.TestComparators
org.apache.hadoop.mapreduce.lib.chain.TestMapReduceChain
org.apache.hadoop.mapred.jobcontrol.TestLocalJobControl
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2889//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2889//console
This message is automatically generated.
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Status: Patch Available (was: Open)
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Fix Version/s: trunk
Hadoop Flags: Reviewed
Status: Patch Available (was: In Progress)
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13450908#comment-13450908 ]
Hadoop QA commented on MAPREDUCE-4554:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12544256/MR_4554_trunk.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified test files.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient.
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2832//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2832//console
This message is automatically generated.
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Status: Patch Available (was: Open)
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Attachment: MR_4554_1_1.patch
MR_4554_trunk.patch
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Attachments: MR_4554_1_1.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Status: Open (was: Patch Available)
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4554) Job Credentials are not
transmitted if security is turned off
Posted by "Benoy Antony (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Benoy Antony updated MAPREDUCE-4554:
------------------------------------
Status: Patch Available (was: Open)
> Job Credentials are not transmitted if security is turned off
> -------------------------------------------------------------
>
> Key: MAPREDUCE-4554
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4554
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: job submission, security
> Affects Versions: 2.0.0-alpha
> Reporter: Benoy Antony
> Assignee: Benoy Antony
> Fix For: trunk
>
> Attachments: MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch, MR_4554_trunk.patch
>
>
> Credentials (secret keys) can be passed to a job via mapreduce.job.credentials.json or mapreduce.job.credentials.binary .
> These credentials get submitted during job submission and are made available to the task processes.
> In HADOOP 1, these credentials get submitted and routed to task processes even if security was off.
> In HADOOP 2 , these credentials are transmitted only when the security is turned on.
> This should be changed for two reasons:
> 1) It is not backward compatible.
> 2) Credentials should be passed even if security is turned off .
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira