You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Luke Lu (JIRA)" <ji...@apache.org> on 2012/07/05 11:59:34 UTC
[jira] [Created] (MAPREDUCE-4397) Introduce
HADOOP_SECURITY_CONF_DIR for task-controller
Luke Lu created MAPREDUCE-4397:
----------------------------------
Summary: Introduce HADOOP_SECURITY_CONF_DIR for task-controller
Key: MAPREDUCE-4397
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4397
Project: Hadoop Map/Reduce
Issue Type: Improvement
Components: task-controller
Reporter: Luke Lu
Assignee: Yu Gao
The linux task controller concurrently hard code the directory to look for its config file at compile time (via the HADOOP_CONF_DIR macro). Adding a new environment variable to look for task-controller's conf dir (with strict permission checks) would make installation much more flexible.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4397) Introduce
HADOOP_SECURITY_CONF_DIR for task-controller
Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13407125#comment-13407125 ]
Robert Joseph Evans commented on MAPREDUCE-4397:
------------------------------------------------
This is very similar work to what was done in MAPREDUCE-4219. MAPREDUCE-4219 was done for yarn and not branch-1 so you probably want to look at that first to reconcile the differences between the two approaches. Any changes being made to branch-1 in this respect would be nice to have ported to trunk and branch-2 for the container-executor because they are very similar still.
> Introduce HADOOP_SECURITY_CONF_DIR for task-controller
> ------------------------------------------------------
>
> Key: MAPREDUCE-4397
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4397
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: task-controller
> Reporter: Luke Lu
> Assignee: Yu Gao
>
> The linux task controller concurrently hard code the directory to look for its config file at compile time (via the HADOOP_CONF_DIR macro). Adding a new environment variable to look for task-controller's conf dir (with strict permission checks) would make installation much more flexible.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4397) Introduce
HADOOP_SECURITY_CONF_DIR for task-controller
Posted by "Yu Gao (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yu Gao updated MAPREDUCE-4397:
------------------------------
Attachment: mapreduce-4397-branch-1.patch
> Introduce HADOOP_SECURITY_CONF_DIR for task-controller
> ------------------------------------------------------
>
> Key: MAPREDUCE-4397
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4397
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: task-controller
> Reporter: Luke Lu
> Assignee: Yu Gao
> Attachments: mapreduce-4397-branch-1.patch
>
>
> The linux task controller concurrently hard code the directory to look for its config file at compile time (via the HADOOP_CONF_DIR macro). Adding a new environment variable to look for task-controller's conf dir (with strict permission checks) would make installation much more flexible.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4397) Introduce
HADOOP_SECURITY_CONF_DIR for task-controller
Posted by "Yu Gao (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yu Gao updated MAPREDUCE-4397:
------------------------------
Attachment: test-patch.result
> Introduce HADOOP_SECURITY_CONF_DIR for task-controller
> ------------------------------------------------------
>
> Key: MAPREDUCE-4397
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4397
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: task-controller
> Reporter: Luke Lu
> Assignee: Yu Gao
> Attachments: mapreduce-4397-branch-1.patch, test-patch.result
>
>
> The linux task controller concurrently hard code the directory to look for its config file at compile time (via the HADOOP_CONF_DIR macro). Adding a new environment variable to look for task-controller's conf dir (with strict permission checks) would make installation much more flexible.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4397) Introduce
HADOOP_SECURITY_CONF_DIR for task-controller
Posted by "Yu Gao (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13492801#comment-13492801 ]
Yu Gao commented on MAPREDUCE-4397:
-----------------------------------
Posted test-patch result. Here is the test result of test-task-controller:
[exec] Starting tests
[exec]
[exec] Testing get_user_directory()
[exec]
[exec] Testing get_job_directory()
[exec]
[exec] Testing get_attempt_directory()
[exec]
[exec] Testing get_task_launcher_file()
[exec]
[exec] Testing get_job_log_dir()
[exec]
[exec] Testing get_config_path
[exec]
[exec] Testing check_configuration_permissions
[exec] File /tmp/test-task-controller must be owned by root, but is owned by 500
[exec]
[exec] Testing get_task_log_dir()
[exec]
[exec] Testing delete_task()
[exec] Unreadable directory /tmp/test-task-controller/local-2/taskTracker/biadmin/jobcache/job_1/task_1/work/who/let, chmoding.
[exec]
[exec] Testing delete_job()
[exec] Unreadable directory /tmp/test-task-controller/local-2/taskTracker/biadmin/jobcache/job_2/task_1/work/who/let, chmoding.
[exec]
[exec] Testing delete_user
[exec]
[exec] Testing test_check_user
[exec] Requested user lp has id 4, which is below the minimum allowed 100
[exec] Running as root is not allowed
[exec] User mapred not found
[exec]
[exec] Testing test_create_log_directory
[exec]
[exec] Testing delete_log_directory
[exec]
[exec] Running test test_signal_task in child process
[exec]
[exec] Testing signal_task
[exec] Child task launched as 26548
[exec] Killing process 26548 with 3
[exec]
[exec] Running test test_signal_task_group in child process
[exec]
[exec] Testing group signal_task
[exec] Child task launched as 26550
[exec] Killing process group 26550 with 9
[exec]
[exec] Finished tests
[exec] PASS: test-task-controller
[exec] ==================
[exec] All 1 tests passed
[exec] ==================
> Introduce HADOOP_SECURITY_CONF_DIR for task-controller
> ------------------------------------------------------
>
> Key: MAPREDUCE-4397
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4397
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: task-controller
> Reporter: Luke Lu
> Assignee: Yu Gao
> Attachments: mapreduce-4397-branch-1.patch, test-patch.result
>
>
> The linux task controller concurrently hard code the directory to look for its config file at compile time (via the HADOOP_CONF_DIR macro). Adding a new environment variable to look for task-controller's conf dir (with strict permission checks) would make installation much more flexible.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4397) Introduce
HADOOP_SECURITY_CONF_DIR for task-controller
Posted by "Luke Lu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Luke Lu updated MAPREDUCE-4397:
-------------------------------
Target Version/s: 1.1.0
> Introduce HADOOP_SECURITY_CONF_DIR for task-controller
> ------------------------------------------------------
>
> Key: MAPREDUCE-4397
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4397
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: task-controller
> Reporter: Luke Lu
> Assignee: Yu Gao
>
> The linux task controller concurrently hard code the directory to look for its config file at compile time (via the HADOOP_CONF_DIR macro). Adding a new environment variable to look for task-controller's conf dir (with strict permission checks) would make installation much more flexible.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4397) Introduce
HADOOP_SECURITY_CONF_DIR for task-controller
Posted by "Luke Lu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13491902#comment-13491902 ]
Luke Lu commented on MAPREDUCE-4397:
------------------------------------
MAPREDUCE-4219 is actually orthogonal to this jira. The patch for branch-1 lgtm. Thanks Yu!
> Introduce HADOOP_SECURITY_CONF_DIR for task-controller
> ------------------------------------------------------
>
> Key: MAPREDUCE-4397
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4397
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: task-controller
> Reporter: Luke Lu
> Assignee: Yu Gao
> Attachments: mapreduce-4397-branch-1.patch
>
>
> The linux task controller concurrently hard code the directory to look for its config file at compile time (via the HADOOP_CONF_DIR macro). Adding a new environment variable to look for task-controller's conf dir (with strict permission checks) would make installation much more flexible.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira