[jira] [Comment Edited] (BIGTOP-952) init-hdfs.sh is dog slow. Let's replace it with a single VM call and better layout management

["jay vyas (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BIGTOP-952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13899321#comment-13899321 ] 

jay vyas edited comment on BIGTOP-952 at 2/12/14 5:52 PM:
----------------------------------------------------------

sure [~rvs]... +1 for just getting this patch in to use *some* kind of model....  no need to couple it to any particular implementation.  If you want to push it out as is, I can do a second patch which updates it to use whatever we agree on in BIGTOP-1200 .

(created follow up JIRA: https://issues.apache.org/jira/browse/BIGTOP-1210)


was (Author: jayunit100):
sure [~rvs]... +1 for just getting this patch in to use *some* kind of model....  no need to couple it to any particular implementation.  If you want to push it out as is, I can do a second patch which updates it to use whatever we agree on in BIGTOP-1200 .

> init-hdfs.sh is dog slow. Let's replace it with a single VM call and better layout management
> ---------------------------------------------------------------------------------------------
>
>                 Key: BIGTOP-952
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-952
>             Project: Bigtop
>          Issue Type: Improvement
>          Components: Deployment
>    Affects Versions: 0.5.0
>            Reporter: Konstantin Boudnik
>            Assignee: Roman Shaposhnik
>            Priority: Blocker
>             Fix For: 0.8.0
>
>         Attachments: untar.groovy
>
>
> As has been proposed in [this patch|https://issues.apache.org/jira/secure/attachment/12575644/untarHdfs.groovy] by [~rvs] there's a very efficient way of creating layout in HDFS using a tarfile and Groovy script with direct call into DFS APIs. 
> Let's making it happen.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)