[jira] [Commented] (BIGTOP-2490) Spark in HA when Zookeeper is available

["ASF GitHub Bot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BIGTOP-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15417567#comment-15417567 ] 

ASF GitHub Bot commented on BIGTOP-2490:
----------------------------------------

GitHub user ktsakalozos opened a pull request:

    https://github.com/apache/bigtop/pull/139

    BIGTOP-2490: Spark in HA when Zookeeper is available

    

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/juju-solutions/bigtop BIGTOP-2490

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/bigtop/pull/139.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #139
    
----
commit 404d45ca7974f093cc3bfc5dde17c33483c886a5
Author: Konstantinos Tsakalozos <ko...@canonical.com>
Date:   2016-07-05T17:25:27Z

    BIGTOP-2490: Spark in HA when Zookeeper is available

----


> Spark in HA when Zookeeper is available 
> ----------------------------------------
>
>                 Key: BIGTOP-2490
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-2490
>             Project: Bigtop
>          Issue Type: Improvement
>          Components: spark
>    Affects Versions: 1.1.0
>            Reporter: Konstantinos Tsakalozos
>            Assignee: Konstantinos Tsakalozos
>            Priority: Minor
>              Labels: features
>
> Spark could work in HA mode as long as a Zookeeper deployment is available. In this improvement we add an option to the Spark configuration through which  we can set the Zookeeper ensemble string. This string is pushed down to Spark configs causing the Spark to function in HA mode.
> In HA mode Zookeeper is used to select the Spark leader and the workers need to ping all the potential leaders to pinpoint the current one. 
> You can monitor the progress of this work in: https://github.com/juju-solutions/bigtop/tree/BIGTOP-2490



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)