You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Hemanth Yamijala (JIRA)" <ji...@apache.org> on 2008/11/21 05:56:44 UTC
[jira] Created: (HADOOP-4705) [HOD] Grant read permissions for
files/directories created by hod as part of provisioning hadoop clusters
[HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters
---------------------------------------------------------------------------------------------------------
Key: HADOOP-4705
URL: https://issues.apache.org/jira/browse/HADOOP-4705
Project: Hadoop Core
Issue Type: Improvement
Components: contrib/hod
Reporter: Hemanth Yamijala
When HOD creates the log, work and temp directories for Hadoop, it creates them with permissions 0700. This is too restrictive for applications like Chukwa which need access to files in this directory for generating Hadoop metrics. This is a request to allow read permissions to other applications.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4705) [HOD] Grant read permissions for
files/directories created by hod as part of provisioning hadoop clusters
Posted by "Hemanth Yamijala (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12653675#action_12653675 ]
Hemanth Yamijala commented on HADOOP-4705:
------------------------------------------
Following some offline discussions between Marco and others, we decided the following:
- It was OK to open up permissions for the job tracker history file to be group readable. There is no sensitive data there to be of a problem in shared clusters.
- This would require changes in both HOD and Hadoop. HOD creates the directories where the history files are created, and it should set the execute bit on them. Hadoop should create the history files with the right permissions.
In view of this, I've filed HADOOP-4782 for addressing this in HOD and HADOOP-4783 for addressing this in Hadoop.
> [HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters
> ---------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4705
> URL: https://issues.apache.org/jira/browse/HADOOP-4705
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/hod
> Reporter: Hemanth Yamijala
> Assignee: Hemanth Yamijala
> Fix For: 0.20.0
>
> Attachments: hadoop-4705-1.txt, hadoop-4705-2.txt, hadoop-4705-3.txt, hadoop-4705.txt
>
>
> When HOD creates the log, work and temp directories for Hadoop, it creates them with permissions 0700. This is too restrictive for applications like Chukwa which need access to files in this directory for generating Hadoop metrics. This is a request to allow read permissions to other applications.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4705) [HOD] Grant read permissions for
files/directories created by hod as part of provisioning hadoop clusters
Posted by "Hemanth Yamijala (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12651375#action_12651375 ]
Hemanth Yamijala commented on HADOOP-4705:
------------------------------------------
Test patch results:
[exec] -1 overall.
[exec] +1 @author. The patch does not contain any @author tags.
[exec] -1 tests included. The patch doesn't appear to include any new or modified tests.
[exec] Please justify why no tests are needed for this patch.
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
[exec] +1 Eclipse classpath. The patch retains Eclipse classpath integrity.
There are no tests in the patch because HOD testing is done manually.
> [HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters
> ---------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4705
> URL: https://issues.apache.org/jira/browse/HADOOP-4705
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/hod
> Reporter: Hemanth Yamijala
> Fix For: 0.20.0
>
> Attachments: hadoop-4705-1.txt, hadoop-4705-2.txt, hadoop-4705-3.txt, hadoop-4705.txt
>
>
> When HOD creates the log, work and temp directories for Hadoop, it creates them with permissions 0700. This is too restrictive for applications like Chukwa which need access to files in this directory for generating Hadoop metrics. This is a request to allow read permissions to other applications.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Issue Comment Edited: (HADOOP-4705) [HOD] Grant read
permissions for files/directories created by hod as part of provisioning
hadoop clusters
Posted by "Peeyush Bishnoi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12649655#action_12649655 ]
peeyushb edited comment on HADOOP-4705 at 12/1/08 3:25 AM:
------------------------------------------------------------------
HoD created temp directories are with permissions 0700 because pbsdsh process , whose umask(0077), launches hodring tasks on computes nodes , further this launched hodring's creates the files/directories inside the temp-dir and work-dirs on compute nodes with permission 0700.
As files/directories , inside temp-dir and work-dirs of HoD , having a permission of 0700 , it is not feasible for application like Chukwa to have access for files and directories inside this temp-dir for gathering hadoop metrics.
So this patch will explicitly set the umask(0022) on hodring process so as to create the files/directories inside temp-dir and work-dirs with permission 0755 .
---
was (Author: peeyushb):
HoD created temp directories are with permissions 0700 because pbsdsh process , whose umask(0077), launches hodring tasks on computes nodes , further this launched hodring's creates the temp-dir and work-dirs on compute nodes with permission 0700.
As temp-dir and work-dirs having a permission of 0700 , it is not feasible for application like Chukwa to have access for files and directories inside this temp-dir for gathering hadoop metrics.
So this patch will explicitly set the umask(0022) on hodring process so as to create the temp-dir and work-dirs with permission 0755 .
---
> [HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters
> ---------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4705
> URL: https://issues.apache.org/jira/browse/HADOOP-4705
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/hod
> Reporter: Hemanth Yamijala
> Assignee: Hemanth Yamijala
> Fix For: 0.20.0
>
> Attachments: hadoop-4705-1.txt, hadoop-4705-2.txt, hadoop-4705-3.txt, hadoop-4705.txt
>
>
> When HOD creates the log, work and temp directories for Hadoop, it creates them with permissions 0700. This is too restrictive for applications like Chukwa which need access to files in this directory for generating Hadoop metrics. This is a request to allow read permissions to other applications.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4705) [HOD] Grant read permissions for
files/directories created by hod as part of provisioning hadoop clusters
Posted by "Hemanth Yamijala (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12652675#action_12652675 ]
Hemanth Yamijala commented on HADOOP-4705:
------------------------------------------
A few clarifications. The world writable permissions are provided only for the root directory (hodring.tempdir) so that all users can create sub dirs under them. The user's sub dir is only world readable, not writable. There is no change to this due to the patch and has existed always. The history files being world readable is not HOD's doing either. Hadoop standalone exhibits the same behavior.
On investigation, we found that we weren't consciously setting the permissions to be only user readable. The resource management system was doing this automatically, and it was not clear that this was intended.
If being readable is not good, then the Chukwa team has to figure out how they will access the data, and we can revert the patch. I will wait for comments from the Chukwa team.
> [HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters
> ---------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4705
> URL: https://issues.apache.org/jira/browse/HADOOP-4705
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/hod
> Reporter: Hemanth Yamijala
> Assignee: Hemanth Yamijala
> Fix For: 0.20.0
>
> Attachments: hadoop-4705-1.txt, hadoop-4705-2.txt, hadoop-4705-3.txt, hadoop-4705.txt
>
>
> When HOD creates the log, work and temp directories for Hadoop, it creates them with permissions 0700. This is too restrictive for applications like Chukwa which need access to files in this directory for generating Hadoop metrics. This is a request to allow read permissions to other applications.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4705) [HOD] Grant read permissions for
files/directories created by hod as part of provisioning hadoop clusters
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12658563#action_12658563 ]
Hudson commented on HADOOP-4705:
--------------------------------
Integrated in Hadoop-trunk #698 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/698/])
> [HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters
> ---------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4705
> URL: https://issues.apache.org/jira/browse/HADOOP-4705
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/hod
> Reporter: Hemanth Yamijala
> Assignee: Peeyush Bishnoi
> Fix For: 0.20.0
>
> Attachments: hadoop-4705-1.txt, hadoop-4705-2.txt, hadoop-4705-3.txt, hadoop-4705.txt
>
>
> When HOD creates the log, work and temp directories for Hadoop, it creates them with permissions 0700. This is too restrictive for applications like Chukwa which need access to files in this directory for generating Hadoop metrics. This is a request to allow read permissions to other applications.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4705) [HOD] Grant read permissions for
files/directories created by hod as part of provisioning hadoop clusters
Posted by "Hemanth Yamijala (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12651496#action_12651496 ]
Hemanth Yamijala commented on HADOOP-4705:
------------------------------------------
Since the patch queue still is very long, I would be committing this patch.
> [HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters
> ---------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4705
> URL: https://issues.apache.org/jira/browse/HADOOP-4705
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/hod
> Reporter: Hemanth Yamijala
> Fix For: 0.20.0
>
> Attachments: hadoop-4705-1.txt, hadoop-4705-2.txt, hadoop-4705-3.txt, hadoop-4705.txt
>
>
> When HOD creates the log, work and temp directories for Hadoop, it creates them with permissions 0700. This is too restrictive for applications like Chukwa which need access to files in this directory for generating Hadoop metrics. This is a request to allow read permissions to other applications.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4705) [HOD] Grant read permissions for
files/directories created by hod as part of provisioning hadoop clusters
Posted by "Hemanth Yamijala (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hemanth Yamijala updated HADOOP-4705:
-------------------------------------
Assignee: Peeyush Bishnoi (was: Hemanth Yamijala)
> [HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters
> ---------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4705
> URL: https://issues.apache.org/jira/browse/HADOOP-4705
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/hod
> Reporter: Hemanth Yamijala
> Assignee: Peeyush Bishnoi
> Fix For: 0.20.0
>
> Attachments: hadoop-4705-1.txt, hadoop-4705-2.txt, hadoop-4705-3.txt, hadoop-4705.txt
>
>
> When HOD creates the log, work and temp directories for Hadoop, it creates them with permissions 0700. This is too restrictive for applications like Chukwa which need access to files in this directory for generating Hadoop metrics. This is a request to allow read permissions to other applications.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4705) [HOD] Grant read permissions for
files/directories created by hod as part of provisioning hadoop clusters
Posted by "Peeyush Bishnoi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Peeyush Bishnoi updated HADOOP-4705:
------------------------------------
Attachment: hadoop-4705-2.txt
> [HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters
> ---------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4705
> URL: https://issues.apache.org/jira/browse/HADOOP-4705
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/hod
> Reporter: Hemanth Yamijala
> Attachments: hadoop-4705-1.txt, hadoop-4705-2.txt, hadoop-4705.txt
>
>
> When HOD creates the log, work and temp directories for Hadoop, it creates them with permissions 0700. This is too restrictive for applications like Chukwa which need access to files in this directory for generating Hadoop metrics. This is a request to allow read permissions to other applications.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4705) [HOD] Grant read permissions for
files/directories created by hod as part of provisioning hadoop clusters
Posted by "Suman Sehgal (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12651971#action_12651971 ]
Suman Sehgal commented on HADOOP-4705:
--------------------------------------
Patch is working fine. temp-dir and all of its subdirectories including history are having 755 premissions while the files under history are having 777 permissions.
work-dirs are having permissions 777 and their subdirectories permissions are 755.
> [HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters
> ---------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4705
> URL: https://issues.apache.org/jira/browse/HADOOP-4705
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/hod
> Reporter: Hemanth Yamijala
> Assignee: Hemanth Yamijala
> Fix For: 0.20.0
>
> Attachments: hadoop-4705-1.txt, hadoop-4705-2.txt, hadoop-4705-3.txt, hadoop-4705.txt
>
>
> When HOD creates the log, work and temp directories for Hadoop, it creates them with permissions 0700. This is too restrictive for applications like Chukwa which need access to files in this directory for generating Hadoop metrics. This is a request to allow read permissions to other applications.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4705) [HOD] Grant read permissions for
files/directories created by hod as part of provisioning hadoop clusters
Posted by "Hemanth Yamijala (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hemanth Yamijala updated HADOOP-4705:
-------------------------------------
Fix Version/s: 0.20.0
Hadoop Flags: [Reviewed]
Status: Patch Available (was: Open)
> [HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters
> ---------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4705
> URL: https://issues.apache.org/jira/browse/HADOOP-4705
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/hod
> Reporter: Hemanth Yamijala
> Fix For: 0.20.0
>
> Attachments: hadoop-4705-1.txt, hadoop-4705-2.txt, hadoop-4705-3.txt, hadoop-4705.txt
>
>
> When HOD creates the log, work and temp directories for Hadoop, it creates them with permissions 0700. This is too restrictive for applications like Chukwa which need access to files in this directory for generating Hadoop metrics. This is a request to allow read permissions to other applications.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4705) [HOD] Grant read permissions for
files/directories created by hod as part of provisioning hadoop clusters
Posted by "Peeyush Bishnoi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Peeyush Bishnoi updated HADOOP-4705:
------------------------------------
Attachment: hadoop-4705.txt
HoD created temp directories are with permissions 0700 because pbsdsh process , whose umask(0077), launches hodring tasks on computes nodes , further this launched hodring's creates the temp-dir and work-dirs on compute nodes with permission 0700.
As temp-dir and work-dirs having a permission of 0700 , it is not feasible for application like Chukwa to have access for files and directories inside this temp-dir for gathering hadoop metrics.
So this patch will explicitly set the umask(0022) on hodring process so as to create the temp-dir and work-dirs with permission 0755 .
---
> [HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters
> ---------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4705
> URL: https://issues.apache.org/jira/browse/HADOOP-4705
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/hod
> Reporter: Hemanth Yamijala
> Attachments: hadoop-4705.txt
>
>
> When HOD creates the log, work and temp directories for Hadoop, it creates them with permissions 0700. This is too restrictive for applications like Chukwa which need access to files in this directory for generating Hadoop metrics. This is a request to allow read permissions to other applications.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4705) [HOD] Grant read permissions for
files/directories created by hod as part of provisioning hadoop clusters
Posted by "Marco Nicosia (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12652431#action_12652431 ]
Marco Nicosia commented on HADOOP-4705:
---------------------------------------
Sorry to arrive late to this party, but I am not clear that making user directories world-readable is a good idea, much less world-writable? Was user privacy considered when generating this patch? I am quite certain that world-writable directories is not a great idea.
bq. As files/directories, inside temp-dir and work-dirs of HoD, having a permission of 0700, it is not feasible for application like Chukwa to have access for files and directories inside this temp-dir for gathering hadoop metrics.
I am not sure I agree with this. If a monitoring or reporting process needs carte blanche access to all users' information, we should find a way for it to run (at least that part) as a privileged user, rather than making the data available to all.
> [HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters
> ---------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4705
> URL: https://issues.apache.org/jira/browse/HADOOP-4705
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/hod
> Reporter: Hemanth Yamijala
> Assignee: Hemanth Yamijala
> Fix For: 0.20.0
>
> Attachments: hadoop-4705-1.txt, hadoop-4705-2.txt, hadoop-4705-3.txt, hadoop-4705.txt
>
>
> When HOD creates the log, work and temp directories for Hadoop, it creates them with permissions 0700. This is too restrictive for applications like Chukwa which need access to files in this directory for generating Hadoop metrics. This is a request to allow read permissions to other applications.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4705) [HOD] Grant read permissions for
files/directories created by hod as part of provisioning hadoop clusters
Posted by "Hemanth Yamijala (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12651282#action_12651282 ]
Hemanth Yamijala commented on HADOOP-4705:
------------------------------------------
The patch is working as expected. However, I think it is safer to set the umask right at the beginning of the hodring process rather than later. IOW, I think we should set it in the main function in bin/hodring. Can you please make this change ?
> [HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters
> ---------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4705
> URL: https://issues.apache.org/jira/browse/HADOOP-4705
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/hod
> Reporter: Hemanth Yamijala
> Attachments: hadoop-4705.txt
>
>
> When HOD creates the log, work and temp directories for Hadoop, it creates them with permissions 0700. This is too restrictive for applications like Chukwa which need access to files in this directory for generating Hadoop metrics. This is a request to allow read permissions to other applications.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4705) [HOD] Grant read permissions for
files/directories created by hod as part of provisioning hadoop clusters
Posted by "Hemanth Yamijala (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hemanth Yamijala updated HADOOP-4705:
-------------------------------------
Resolution: Fixed
Assignee: Hemanth Yamijala
Status: Resolved (was: Patch Available)
I just committed this. Thanks, Peeyush !
> [HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters
> ---------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4705
> URL: https://issues.apache.org/jira/browse/HADOOP-4705
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/hod
> Reporter: Hemanth Yamijala
> Assignee: Hemanth Yamijala
> Fix For: 0.20.0
>
> Attachments: hadoop-4705-1.txt, hadoop-4705-2.txt, hadoop-4705-3.txt, hadoop-4705.txt
>
>
> When HOD creates the log, work and temp directories for Hadoop, it creates them with permissions 0700. This is too restrictive for applications like Chukwa which need access to files in this directory for generating Hadoop metrics. This is a request to allow read permissions to other applications.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4705) [HOD] Grant read permissions for
files/directories created by hod as part of provisioning hadoop clusters
Posted by "Peeyush Bishnoi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Peeyush Bishnoi updated HADOOP-4705:
------------------------------------
Attachment: hadoop-4705-1.txt
Thanks! Hemanth for reviewing the patch . I did necessary changes as per suggestion and attached again.
> [HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters
> ---------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4705
> URL: https://issues.apache.org/jira/browse/HADOOP-4705
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/hod
> Reporter: Hemanth Yamijala
> Attachments: hadoop-4705-1.txt, hadoop-4705.txt
>
>
> When HOD creates the log, work and temp directories for Hadoop, it creates them with permissions 0700. This is too restrictive for applications like Chukwa which need access to files in this directory for generating Hadoop metrics. This is a request to allow read permissions to other applications.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4705) [HOD] Grant read permissions for
files/directories created by hod as part of provisioning hadoop clusters
Posted by "Hemanth Yamijala (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12651372#action_12651372 ]
Hemanth Yamijala commented on HADOOP-4705:
------------------------------------------
Looks good. I just updated the comment to make it a bit more descriptive. The patch works as expected. +1. Running through hudson.
> [HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters
> ---------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4705
> URL: https://issues.apache.org/jira/browse/HADOOP-4705
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/hod
> Reporter: Hemanth Yamijala
> Attachments: hadoop-4705-1.txt, hadoop-4705-2.txt, hadoop-4705-3.txt, hadoop-4705.txt
>
>
> When HOD creates the log, work and temp directories for Hadoop, it creates them with permissions 0700. This is too restrictive for applications like Chukwa which need access to files in this directory for generating Hadoop metrics. This is a request to allow read permissions to other applications.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4705) [HOD] Grant read permissions for
files/directories created by hod as part of provisioning hadoop clusters
Posted by "Peeyush Bishnoi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12651358#action_12651358 ]
Peeyush Bishnoi commented on HADOOP-4705:
-----------------------------------------
In patch hadoop-4705-2.txt , umask has been applied to hod/bin/hodring instead of hod/hodlib/HodRing/hodRing.py
---
> [HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters
> ---------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4705
> URL: https://issues.apache.org/jira/browse/HADOOP-4705
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/hod
> Reporter: Hemanth Yamijala
> Attachments: hadoop-4705-1.txt, hadoop-4705-2.txt, hadoop-4705.txt
>
>
> When HOD creates the log, work and temp directories for Hadoop, it creates them with permissions 0700. This is too restrictive for applications like Chukwa which need access to files in this directory for generating Hadoop metrics. This is a request to allow read permissions to other applications.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4705) [HOD] Grant read permissions for
files/directories created by hod as part of provisioning hadoop clusters
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12649725#action_12649725 ]
Eric Yang commented on HADOOP-4705:
-----------------------------------
+1 Looks good.
> [HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters
> ---------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4705
> URL: https://issues.apache.org/jira/browse/HADOOP-4705
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/hod
> Reporter: Hemanth Yamijala
> Attachments: hadoop-4705.txt
>
>
> When HOD creates the log, work and temp directories for Hadoop, it creates them with permissions 0700. This is too restrictive for applications like Chukwa which need access to files in this directory for generating Hadoop metrics. This is a request to allow read permissions to other applications.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4705) [HOD] Grant read permissions for
files/directories created by hod as part of provisioning hadoop clusters
Posted by "Hemanth Yamijala (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hemanth Yamijala updated HADOOP-4705:
-------------------------------------
Attachment: hadoop-4705-3.txt
> [HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters
> ---------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-4705
> URL: https://issues.apache.org/jira/browse/HADOOP-4705
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/hod
> Reporter: Hemanth Yamijala
> Attachments: hadoop-4705-1.txt, hadoop-4705-2.txt, hadoop-4705-3.txt, hadoop-4705.txt
>
>
> When HOD creates the log, work and temp directories for Hadoop, it creates them with permissions 0700. This is too restrictive for applications like Chukwa which need access to files in this directory for generating Hadoop metrics. This is a request to allow read permissions to other applications.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.