[jira] [Updated] (BIGTOP-952) init-hdfs.sh is dog slow. Let's replace it with a single VM call and better layout management

["jay vyas (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/BIGTOP-952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

jay vyas updated BIGTOP-952:
----------------------------

    Attachment: provision2.groovy

attached is the latest pass (provision2.groovy).  I've spot tested it and it appears to create the dirs correctly (/tmp/, /user/hive, ...).  

Any more feeback before i formalize patches for BIGTOP-1200 and this one?

> init-hdfs.sh is dog slow. Let's replace it with a single VM call and better layout management
> ---------------------------------------------------------------------------------------------
>
>                 Key: BIGTOP-952
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-952
>             Project: Bigtop
>          Issue Type: Improvement
>          Components: Deployment
>    Affects Versions: 0.5.0
>            Reporter: Konstantin Boudnik
>            Assignee: Roman Shaposhnik
>            Priority: Blocker
>             Fix For: 0.8.0
>
>         Attachments: provision2.groovy, untar.groovy
>
>
> As has been proposed in [this patch|https://issues.apache.org/jira/secure/attachment/12575644/untarHdfs.groovy] by [~rvs] there's a very efficient way of creating layout in HDFS using a tarfile and Groovy script with direct call into DFS APIs. 
> Let's making it happen.



--
This message was sent by Atlassian JIRA
(v6.2#6252)