You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Siddharth Seth (JIRA)" <ji...@apache.org> on 2017/02/02 03:48:51 UTC
[jira] [Commented] (HIVE-15688) LlapServiceDriver - an option to
get rid of run.sh
[ https://issues.apache.org/jira/browse/HIVE-15688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15849355#comment-15849355 ]
Siddharth Seth commented on HIVE-15688:
---------------------------------------
I don't think start should be the default. That breaks existing behaviour which a lot of people are likely used to.
Thought we'd be doing this by continuing to generate a run.sh - which invokes a single java binary (instead of the 4 slider commands), accepting parameters for whether a destroy is required etc. That still saves most of the time, and retains compatibility. Having a package sit around which can be invoked multiple times is really useful while debugging. Also serves as a history for what was started (think this may still be the case - except without the run.sh). Most of the code would remain unchanged - except for the run.sh generation which points to the slider command or the new Java launch.
> LlapServiceDriver - an option to get rid of run.sh
> --------------------------------------------------
>
> Key: HIVE-15688
> URL: https://issues.apache.org/jira/browse/HIVE-15688
> Project: Hive
> Issue Type: Bug
> Reporter: Sergey Shelukhin
> Assignee: Sergey Shelukhin
> Attachments: HIVE-15688.patch
>
>
> run.sh is very slow because it's 4 calls to slider, which means 4 JVMs, 4 connections to RM and other crap, for 2-5sec. of overhead per call, depending on the machine/cluster.
> What we need is a mode for llapservicedriver that would not generate run.sh, but would rather run the cluster immediately by calling the corresponding 4 slider APIs. Should probably be the default, too. For compat with scripts we might generate blank run.sh for now.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)