[jira] [Commented] (BIGTOP-852) Improve HDFS helper script

["Bruno Mahé (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BIGTOP-852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13595700#comment-13595700 ] 

Bruno Mahé commented on BIGTOP-852:
-----------------------------------

Right now, as a first pass, I would rather just ensure yarn is setup correctly so we can unblock BIGOTP-637. We can always open another ticket or discussion regarding a better long term solution.

To pile on the others suggestions regarding a longer term solution:
* I don't want to have a jenkins user or some fancy magic to detect the current user. I just want to pass a list of users to that helper script. Maybe it should be a completely different script if easier.
* I don't want that script to set up all the services. I just want to pass a list of services to be initialized.
* As Cos suggested, we may want to use some language (groovy wouldn't be my first choice :p) instead of individual calls to the hadoop command

                
> Improve HDFS helper script
> --------------------------
>
>                 Key: BIGTOP-852
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-852
>             Project: Bigtop
>          Issue Type: Bug
>          Components: Deployment
>    Affects Versions: 0.6.0
>            Reporter: Mark Grover
>             Fix For: 0.6.0
>
>
> There are a few things that can be improved regarding the HDFS helper script introduced by BIGTOP-547. Some of these issues have been discussed in BIGTOP-637.
> 1. The script seems to create user directories for users "root" and "jenkins" but not the current user running the script. I think it will be a good idea to add in the script the commands to create the /user/$USER directory in HDFS. Of course, we should be careful in case the user running the command is root or jenkins, in that case a simple mkdir command would throw error given that those directories already exist.
> 2. The script uses sudo which requires login shell. However, login shells are not available for certain use cases like init scripts. Consequently, we should consider using su instead.
> 3. Look into how the helper script can be made faster
> Folks, please feel free to add/edit if there is something I missed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira