You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by "Konstantin Boudnik (JIRA)" <ji...@apache.org> on 2015/03/15 22:24:38 UTC
[jira] [Commented] (BIGTOP-1235) Speed-up init-hdfs.sh for complete
HCFS compliant provisioning
[ https://issues.apache.org/jira/browse/BIGTOP-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14362561#comment-14362561 ]
Konstantin Boudnik commented on BIGTOP-1235:
--------------------------------------------
Ah, I caught your drift now, Jay. Renamed the JIRA.
Thanks for the review [~evans_ye] - I will commit it shortly.
> Speed-up init-hdfs.sh for complete HCFS compliant provisioning
> --------------------------------------------------------------
>
> Key: BIGTOP-1235
> URL: https://issues.apache.org/jira/browse/BIGTOP-1235
> Project: Bigtop
> Issue Type: Improvement
> Components: general
> Affects Versions: 0.7.0
> Reporter: jay vyas
> Assignee: Konstantin Boudnik
> Priority: Critical
> Fix For: 0.9.0
>
> Attachments: 0001-BIGTOP-1235.-Combine-BIGTOP-1200-and-BIGTOP-952-to-s.patch, 0001-BIGTOP-1235.-Combine-BIGTOP-1200-and-BIGTOP-952-to-s.patch, 0001-BIGTOP-1235.-Combine-BIGTOP-1200-and-BIGTOP-952-to-s.patch, 0001-BIGTOP-1235.-Combine-BIGTOP-1200-and-BIGTOP-952-to-s.patch, 0001-BIGTOP-1235.-Combine-BIGTOP-1200-and-BIGTOP-952-to-s.patch, 0001-BIGTOP-1235.-Combine-BIGTOP-1200-and-BIGTOP-952-to-s.patch, 0001-BIGTOP-1235.-Combine-BIGTOP-1200-and-BIGTOP-952-to-s.patch, BIGTOP-1235.first.patch, BIGTOP-1235.patch
>
>
> BIGTOP-1200 provides file schema in JSON format, for any HCFS related tool to read.
> BIGTOP-952 meanwhile give us fast provisioning by running in a single JVM (without multiple haoop fs -... commands_).
> Thus, when those two are finished, we can replace init-hdfs.sh (with the exception of a few extra shell commands in bottom of that script which still will need to be called).
> So this JIRA will:
> - create a new init-hcfs.groovy script which calls provision.groovy in BIGTOP-952, with init-hcfs.json as input.
> - add in the remaining straggler commands from init-hdfs.sh which dont fit into the generic json format as shell commands.
> - delete init-hdfs.sh entirely
> - update puppet scripts to use init-hcfs.groovy, calling them with the "hdfs" argument.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)