You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "Roman Shaposhnik (JIRA)" <ji...@apache.org> on 2013/05/20 04:53:15 UTC

[jira] [Commented] (BIGTOP-846) The helper script introduced in BIGTOP-547 doesn't create /user/$USER directories on HDFS

    [ https://issues.apache.org/jira/browse/BIGTOP-846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13661715#comment-13661715 ] 

Roman Shaposhnik commented on BIGTOP-846:
-----------------------------------------

A thought (in a form of Bruno pinging me ;-)) has just occurred to me: wouldn't it be better for each component to advertise how exactly it need to initialize the HDFS via a json/xml/txt file dropped into a predetermined location describing exactly what needs to happen. We can them have a very generic script that simply operates on that.
                
> The helper script introduced in BIGTOP-547 doesn't create /user/$USER directories on HDFS
> -----------------------------------------------------------------------------------------
>
>                 Key: BIGTOP-846
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-846
>             Project: Bigtop
>          Issue Type: Bug
>    Affects Versions: 0.6.0
>            Reporter: Mark Grover
>            Assignee: Anatoli Fomenko
>            Priority: Blocker
>             Fix For: 0.6.0
>
>         Attachments: 0001-BIGTOP-846.-The-helper-script-introduced-in-BIGTOP-5.patch, 0001-BIGTOP-846.-The-helper-script-introduced-in-BIGTOP-5.patch
>
>
> For BIGTOP-547, I had done my testing where I running the MR job as root. 
> However, the helper script creates home directory for hard-coded set of users (root, jenkins, etc.) but not for other users. In particular, it doesn't create a directory for the user who is running the command.
> It should do that too (safely, in case the user is root).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira