You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Vinay Kumar Thota (JIRA)" <ji...@apache.org> on 2010/07/02 16:52:52 UTC
[jira] Created: (MAPREDUCE-1913) [Herriot] Couple of issues
occurred while running the tests in a cluster with security enabled.
[Herriot] Couple of issues occurred while running the tests in a cluster with security enabled.
-----------------------------------------------------------------------------------------------
Key: MAPREDUCE-1913
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1913
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: test
Reporter: Vinay Kumar Thota
Assignee: Vinay Kumar Thota
1. New configuration directory is not cleaning up after resetting to default configuration directory in a pushconfig functionality. Because of this reason, it's giving permission denied problem for a folder, if other user tried running the tests in the same cluster with pushconfig functionality. I could see this issue while running the tests on a cluster with security enabled and different user.
I have added the functionality for above issue and attaching the patch
2. Throwing IOException and it says token is expired while running the tests. I could see this issue in a secure cluster.
This issue has been resolved by setting the following attribute in the configuration.
mapreduce.job.complete.cancel.delegation.tokens=false
adding/updating this attribute in the push configuration functionality while creating the new configuration.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1913) [Herriot] Couple of issues
occurred while running the tests in a cluster with security enabled.
Posted by "Iyappan Srinivasan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885406#action_12885406 ]
Iyappan Srinivasan commented on MAPREDUCE-1913:
-----------------------------------------------
+ if (props.get(MAPRED_DELEGATION_TOKEN) == null) {
+ initConf.setBoolean(MAPRED_DELEGATION_TOKEN, false);
+ }
- I think it should be, if the delegation token exists, then it should be set to false.
So, should not it be if (props.get(MAPRED_DELEGATION_TOKEN) != null) {
> [Herriot] Couple of issues occurred while running the tests in a cluster with security enabled.
> -----------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1913
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1913
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Attachments: 1913-ydist-security.patch, MAPREDUCE-1913.patch
>
>
> 1. New configuration directory is not cleaning up after resetting to default configuration directory in a pushconfig functionality. Because of this reason, it's giving permission denied problem for a folder, if other user tried running the tests in the same cluster with pushconfig functionality. I could see this issue while running the tests on a cluster with security enabled and different user.
> I have added the functionality for above issue and attaching the patch
> 2. Throwing IOException and it says token is expired while running the tests. I could see this issue in a secure cluster.
> This issue has been resolved by setting the following attribute in the configuration.
> mapreduce.job.complete.cancel.delegation.tokens=false
>
> adding/updating this attribute in the push configuration functionality while creating the new configuration.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1913) [Herriot] Couple of issues
occurred while running the tests in a cluster with security enabled.
Posted by "Vinay Kumar Thota (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinay Kumar Thota updated MAPREDUCE-1913:
-----------------------------------------
Attachment: 1913-ydist-security.patch
Initial patch for yahoo dist security branch.
> [Herriot] Couple of issues occurred while running the tests in a cluster with security enabled.
> -----------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1913
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1913
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Attachments: 1913-ydist-security.patch
>
>
> 1. New configuration directory is not cleaning up after resetting to default configuration directory in a pushconfig functionality. Because of this reason, it's giving permission denied problem for a folder, if other user tried running the tests in the same cluster with pushconfig functionality. I could see this issue while running the tests on a cluster with security enabled and different user.
> I have added the functionality for above issue and attaching the patch
> 2. Throwing IOException and it says token is expired while running the tests. I could see this issue in a secure cluster.
> This issue has been resolved by setting the following attribute in the configuration.
> mapreduce.job.complete.cancel.delegation.tokens=false
>
> adding/updating this attribute in the push configuration functionality while creating the new configuration.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1913) [Herriot] Couple of issues
occurred while running the tests in a cluster with security enabled.
Posted by "Iyappan Srinivasan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12886228#action_12886228 ]
Iyappan Srinivasan commented on MAPREDUCE-1913:
-----------------------------------------------
Ok.
> [Herriot] Couple of issues occurred while running the tests in a cluster with security enabled.
> -----------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1913
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1913
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Attachments: 1913-ydist-security.patch, MAPREDUCE-1913.patch
>
>
> 1. New configuration directory is not cleaning up after resetting to default configuration directory in a pushconfig functionality. Because of this reason, it's giving permission denied problem for a folder, if other user tried running the tests in the same cluster with pushconfig functionality. I could see this issue while running the tests on a cluster with security enabled and different user.
> I have added the functionality for above issue and attaching the patch
> 2. Throwing IOException and it says token is expired while running the tests. I could see this issue in a secure cluster.
> This issue has been resolved by setting the following attribute in the configuration.
> mapreduce.job.complete.cancel.delegation.tokens=false
>
> adding/updating this attribute in the push configuration functionality while creating the new configuration.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1913) [Herriot] Couple of issues
occurred while running the tests in a cluster with security enabled.
Posted by "Vinay Kumar Thota (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinay Kumar Thota updated MAPREDUCE-1913:
-----------------------------------------
Attachment: MAPREDUCE-1913.patch
Patch for trunk.
> [Herriot] Couple of issues occurred while running the tests in a cluster with security enabled.
> -----------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1913
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1913
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Attachments: 1913-ydist-security.patch, MAPREDUCE-1913.patch
>
>
> 1. New configuration directory is not cleaning up after resetting to default configuration directory in a pushconfig functionality. Because of this reason, it's giving permission denied problem for a folder, if other user tried running the tests in the same cluster with pushconfig functionality. I could see this issue while running the tests on a cluster with security enabled and different user.
> I have added the functionality for above issue and attaching the patch
> 2. Throwing IOException and it says token is expired while running the tests. I could see this issue in a secure cluster.
> This issue has been resolved by setting the following attribute in the configuration.
> mapreduce.job.complete.cancel.delegation.tokens=false
>
> adding/updating this attribute in the push configuration functionality while creating the new configuration.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1913) [Herriot] Couple of issues
occurred while running the tests in a cluster with security enabled.
Posted by "Vinay Kumar Thota (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885999#action_12885999 ]
Vinay Kumar Thota commented on MAPREDUCE-1913:
----------------------------------------------
bq. * I think it should be, if the delegation token exists, then it should be set to false. So, should not it be if (props.get(MAPRED_DELEGATION_TOKEN) != null) {
I think you thought that I am checking the DELEGATION_TOKEN with configuration.However I am not checking with the config. I am checking in the hashtable whether user has set the property are not in the test. If not, I am setting the default value false.
> [Herriot] Couple of issues occurred while running the tests in a cluster with security enabled.
> -----------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1913
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1913
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Attachments: 1913-ydist-security.patch, MAPREDUCE-1913.patch
>
>
> 1. New configuration directory is not cleaning up after resetting to default configuration directory in a pushconfig functionality. Because of this reason, it's giving permission denied problem for a folder, if other user tried running the tests in the same cluster with pushconfig functionality. I could see this issue while running the tests on a cluster with security enabled and different user.
> I have added the functionality for above issue and attaching the patch
> 2. Throwing IOException and it says token is expired while running the tests. I could see this issue in a secure cluster.
> This issue has been resolved by setting the following attribute in the configuration.
> mapreduce.job.complete.cancel.delegation.tokens=false
>
> adding/updating this attribute in the push configuration functionality while creating the new configuration.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1913) [Herriot] Couple of issues
occurred while running the tests in a cluster with security enabled.
Posted by "Konstantin Boudnik (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12885792#action_12885792 ]
Konstantin Boudnik commented on MAPREDUCE-1913:
-----------------------------------------------
- For trunk, the config key is already defined as in
{noformat}
src/java/org/apache/hadoop/mapreduce/MRJobConfig.java: public static final String JOB_CANCEL_DELEGATION_TOKEN = "mapreduce.job.complete.cancel.delegation.tokens";
{noformat}
- Also, please link if this JIRA to its blockers if any.
> [Herriot] Couple of issues occurred while running the tests in a cluster with security enabled.
> -----------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1913
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1913
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Attachments: 1913-ydist-security.patch, MAPREDUCE-1913.patch
>
>
> 1. New configuration directory is not cleaning up after resetting to default configuration directory in a pushconfig functionality. Because of this reason, it's giving permission denied problem for a folder, if other user tried running the tests in the same cluster with pushconfig functionality. I could see this issue while running the tests on a cluster with security enabled and different user.
> I have added the functionality for above issue and attaching the patch
> 2. Throwing IOException and it says token is expired while running the tests. I could see this issue in a secure cluster.
> This issue has been resolved by setting the following attribute in the configuration.
> mapreduce.job.complete.cancel.delegation.tokens=false
>
> adding/updating this attribute in the push configuration functionality while creating the new configuration.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.