You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "Roman Shaposhnik (JIRA)" <ji...@apache.org> on 2013/05/20 04:53:15 UTC
[jira] [Commented] (BIGTOP-846) The helper script introduced in
BIGTOP-547 doesn't create /user/$USER directories on HDFS
[ https://issues.apache.org/jira/browse/BIGTOP-846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13661715#comment-13661715 ]
Roman Shaposhnik commented on BIGTOP-846:
-----------------------------------------
A thought (in a form of Bruno pinging me ;-)) has just occurred to me: wouldn't it be better for each component to advertise how exactly it need to initialize the HDFS via a json/xml/txt file dropped into a predetermined location describing exactly what needs to happen. We can them have a very generic script that simply operates on that.
> The helper script introduced in BIGTOP-547 doesn't create /user/$USER directories on HDFS
> -----------------------------------------------------------------------------------------
>
> Key: BIGTOP-846
> URL: https://issues.apache.org/jira/browse/BIGTOP-846
> Project: Bigtop
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Mark Grover
> Assignee: Anatoli Fomenko
> Priority: Blocker
> Fix For: 0.6.0
>
> Attachments: 0001-BIGTOP-846.-The-helper-script-introduced-in-BIGTOP-5.patch, 0001-BIGTOP-846.-The-helper-script-introduced-in-BIGTOP-5.patch
>
>
> For BIGTOP-547, I had done my testing where I running the MR job as root.
> However, the helper script creates home directory for hard-coded set of users (root, jenkins, etc.) but not for other users. In particular, it doesn't create a directory for the user who is running the command.
> It should do that too (safely, in case the user is root).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira