[jira] [Commented] (METRON-608) Mpack to install a single-node test cluster

["ASF GitHub Bot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/METRON-608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15794446#comment-15794446 ] 

ASF GitHub Bot commented on METRON-608:
---------------------------------------

GitHub user mattf-horton opened a pull request:

    https://github.com/apache/incubator-metron/pull/408

    METRON-608 Mpack to install a single-node test cluster

    This "metron-mpack-singlenode" is very similar to "metron-mpack", and can be usefully compared with it for code review, altho it also includes many bug fixes proposed in METRON-634.  As it says in the Jira, this is a short-term fix by providing a completely separate Mpack just for the single-node scenario, until we can work the bugs out of an mpack that works on all sizes of cluster.
    
    This was tested on a Centos7 VM with 16GB of RAM, and all prerequisites installed, including Python 2.7.11.  The usual install process was followed, with Ambari 2.4.2 and HDP stack 2.5.3.  After successful startup, a few thousand 'bro' packets were injected, and were seen to correctly propagate through parser, enricher, and indexer topologies, and finally into elasticsearch.
    
    An outstanding issue is that the configuration validator in the mpack doesn't work.  It fails with "unknown error" and must be ignored.  The multi-node mpack already had this problem, and I have run out of time to try to fix it here.  Consequently, my enhancement of trying to automatically flag the user if less than five Storm Supervisor Slots are allocated (commit 9ad8706), is untested.  I would like to open a new Jira for this issue, since it was pre-existing before these additions.
    Thanks,
    --Matt

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/mattf-horton/incubator-metron METRON-608

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-metron/pull/408.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #408
    
----
commit 05571b501222b91457bd2f1b2ccc096af015f4cb
Author: mattf-horton <mf...@hortonworks.com>
Date:   2016-12-08T05:31:40Z

    METRON-608 Mpack to install a single-node test cluster

commit f2245900cd94389bc1c004c60f1606a49ca6ea8c
Author: mattf-horton <mf...@hortonworks.com>
Date:   2016-12-10T01:01:41Z

    Add quicklinks to Elasticsearch Service page in Ambari, for health and indexes.

commit 542a6f01376a656b539040992e9fa727efd8a047
Author: mattf-horton <mf...@hortonworks.com>
Date:   2016-12-10T01:02:40Z

    METRON-608 fix several bugs, especially in METRON use of 'es_url'

commit fb646fdda345107b0debd8395743630cc99995e0
Author: mattf-horton <mf...@hortonworks.com>
Date:   2016-12-10T09:05:43Z

    update version to 0.3.0

commit 8e30344e0b50fdff0cf8a1a66e7f41868a384171
Author: mattf-horton <mf...@hortonworks.com>
Date:   2016-12-10T09:09:30Z

    Merge/rebase updates from 0.3.0

commit 9ad8706e5209ca9506710ca6498ac387e667ddf0
Author: mattf-horton <mf...@hortonworks.com>
Date:   2016-12-13T02:03:07Z

    METRON-608 add service_advisor validation for number of Storm slots, enhance README, and a couple bug fixes

commit d4c97e6de4838265b72139727a5fd1082388117b
Author: mattf-horton <mf...@hortonworks.com>
Date:   2016-12-13T05:48:22Z

    tweak pom.xml file

commit 95d83702ef844bc94c2ce54bccaebb7b7cb0513a
Author: mattf-horton <mf...@hortonworks.com>
Date:   2016-12-20T00:54:07Z

    METRON-608 multiple small bug fixes

commit b5b3a348527c03bc778a5fc5dd0d94ec3a00470b
Author: mattf-horton <mf...@hortonworks.com>
Date:   2016-12-20T01:39:37Z

    rebase to Dec 19, 2016

----


> Mpack to install a single-node test cluster
> -------------------------------------------
>
>                 Key: METRON-608
>                 URL: https://issues.apache.org/jira/browse/METRON-608
>             Project: Metron
>          Issue Type: Improvement
>    Affects Versions: 0.3.0
>         Environment: Linux, Ambari installation
>            Reporter: Matt Foley
>            Assignee: Matt Foley
>             Fix For: Next + 1
>
>
> The current Mpack for Ambari install of Metron fails to correctly install Elasticsearch if restricted to a single-node cluster.  Yet a single-node install of Elasticsearch is certainly feasible, as shown by our quick-dev environment.
> This is a short-term fix by providing a completely separate Mpack just for the single-node scenario.  I'm also opening METRON-609 to enhance the existing Mpack to handle the single-node and small-number-of-nodes scenario, but that one will require much deeper testing and is likely to take a while to complete.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)