[jira] [Comment Edited] (BIGTOP-1235) Combine BIGTOP-1200 and BIGTOP-952 with a few minor shell commands that will entirely replace init-hdfs.sh

["jay vyas (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BIGTOP-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14252803#comment-14252803 ] 

jay vyas edited comment on BIGTOP-1235 at 12/19/14 2:23 AM:
------------------------------------------------------------

hi [~cos] ... this is very close to being done :) 

- replacing  {{init-hdfs.sh}}  can be done easily, just by using the results of BIGTOP-952, which is already in bigtop.
- this patch, i was confused about the right way to to integrate groovy, modify spec files to package it, and so on.  now that i understand bigtop better, i think its really close to being done.   
- you're right, we *do* delete {{provision.groovy}} but i think thats b/c we are *copying  it* to {{init-hcfs.groovy}} for consistency
- *yes* not a bad idea to have {{init-hdfs.sh}} wrap {{init-hcfs.groovy}} with hdfs semantics.


was (Author: jayunit100):
hi [~cos] ... 

- replacing  {{init-hdfs.sh}}  can be done easily, just by using the results of BIGTOP-952, which is already in bigtop.
- this patch, i was confused about the right way to to integrate groovy, modify spec files to package it, and so on.  now that i understand bigtop better, i think its really close to being done.   
- we delete {{provision.groovy}} but i think thats b/c we are copying  it to {{init-hcfs.groovy}} for consistency
- *yes* not a bad idea to have {{init-hdfs.sh}} wrap {{init-hcfs.groovy}} with hdfs semantics.

> Combine BIGTOP-1200 and BIGTOP-952 with a few minor shell commands that will entirely replace init-hdfs.sh 
> -----------------------------------------------------------------------------------------------------------
>
>                 Key: BIGTOP-1235
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-1235
>             Project: Bigtop
>          Issue Type: Improvement
>          Components: general
>    Affects Versions: 0.7.0
>            Reporter: jay vyas
>            Assignee: jay vyas
>            Priority: Critical
>             Fix For: 0.9.0
>
>         Attachments: BIGTOP-1235.first.patch, BIGTOP-1235.patch
>
>
> BIGTOP-1200 provides file schema in JSON format, for any HCFS related tool to read. 
> BIGTOP-952 meanwhile give us fast provisioning by running in a single JVM (without multiple haoop fs -... commands_).
> Thus, when those two are finished, we can replace init-hdfs.sh (with the exception of a few extra shell commands in bottom of that script which still will need to be called).  
> So this JIRA  will: 
> - create a new init-hcfs.groovy script which calls provision.groovy in BIGTOP-952, with init-hcfs.json as input. 
> - add in the remaining straggler commands from init-hdfs.sh which dont fit into the generic json format as shell commands.
> - delete init-hdfs.sh entirely
> - update puppet scripts to use init-hcfs.groovy, calling them with the "hdfs" argument.   



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)