You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@metron.apache.org by "Otto Fowler (JIRA)" <ji...@apache.org> on 2018/11/07 03:21:00 UTC
[jira] [Commented] (METRON-872) "Metron Enrichment Start" Fails in
Quick Dev
[ https://issues.apache.org/jira/browse/METRON-872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677606#comment-16677606 ]
Otto Fowler commented on METRON-872:
------------------------------------
We no longer have quick dev
> "Metron Enrichment Start" Fails in Quick Dev
> --------------------------------------------
>
> Key: METRON-872
> URL: https://issues.apache.org/jira/browse/METRON-872
> Project: Metron
> Issue Type: Bug
> Reporter: Nick Allen
> Priority: Major
>
> h3. Problem
> The "Quick Dev" deployment fails to complete deployment successfully for me. Ambari fails to launch the Enrichment topology with this error.
> {code}
> resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/metron/0.3.1/bin/zk_load_configs.sh --mode PUSH -i /usr/metron/0.3.1/config/zookeeper -z node1:2181' returned 127. /bin/bash: /usr/metron/0.3.1/bin/zk_load_configs.sh: No such file or directory
> {code}
> This is confusing to me because we should be on 0.4.0, so why is it referencing 0.3.1?
> h3. Steps to Reproduce
> First, I had to `install` the Metron libs (which I don't remember being a requirement before.) Then I was able to `vagrant up`.
> {code}
> cd incubator-metron
> mvn clean install -DskipTests -T 1C
> cd metron-deployment/vagrant/quick-dev-platform
> vagrant up
> {code}
> h3. Additional Clues
> When I login to the "Quick Dev" VM, I see that there are some 0.4.0 libs and some 0.3.1 libs.
> {code}
> [root@node1 metron]# ls -l /usr/metron/0.3.1/lib/
> total 167800
> -rw-r--r--. 1 root root 85332259 Apr 3 21:05 metron-api-0.3.1.jar
> -rw-r--r--. 1 root root 86490682 Mar 30 13:09 metron-pcap-backend-0.3.1.jar
> [root@node1 metron]# ls -l /usr/metron/0.4.0/lib/
> total 463428
> -rw-r--r--. 1 root root 48425098 Apr 21 13:45 metron-common-0.4.0.jar
> -rw-r--r--. 1 root root 124020704 Apr 21 13:50 metron-data-management-0.4.0.jar
> -rw-r--r--. 1 root root 114754821 Apr 21 13:50 metron-elasticsearch-0.4.0-uber.jar
> -rw-r--r--. 1 root root 93280994 Apr 21 13:48 metron-enrichment-0.4.0-uber.jar
> -rw-r--r--. 1 root root 94059479 Apr 21 13:50 metron-parsers-0.4.0-uber.jar
> {code}
> Where did those 0.3.1 libs come from? When I look in my local Maven repository on my build machine, I don't see any 0.3.1 libs at all, only 0.4.0
> {code}
> $ find ~/.m2/repository/org/apache/metron/ -name "0.3.1"
> $ find ~/.m2/repository/org/apache/metron/ -name "0.4.0"
> /Users/nallen/.m2/repository/org/apache/metron//elasticsearch-shaded/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//Metron/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-analytics/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-api/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-common/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-config/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-data-management/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-deployment/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-docker/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-elasticsearch/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-enrichment/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-hbase/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-indexing/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-integration-test/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-interface/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-maas-common/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-maas-service/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-management/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-parsers/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-pcap/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-pcap-backend/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-platform/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-profiler/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-profiler-client/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-profiler-common/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-rest/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-rest-client/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-solr/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-statistics/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-storm-kafka/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-test-utilities/0.4.0
> /Users/nallen/.m2/repository/org/apache/metron//metron-writer/0.4.0
> {code}
> I seem to have the latest "Quick Dev" box image.
> {code}
> $ vagrant box update
> Running with ansible-tags: ["quick_dev", "report"]
> ==> node1: Checking for updates to 'metron/quick_dev'
> node1: Latest installed version: 0.2.0
> node1: Version constraints:
> node1: Provider: virtualbox
> ==> node1: Box 'metron/quick_dev' (v0.2.0) is running the latest version.
> {code}
> And for good measure, here is what my environment looks-like.
> {code}
> $ ./metron-deployment/scripts/platform-info.sh
> Metron 0.4.0
> --
> * master
> --
> commit 41b5b1050cf29e5dcb5d0c36b5a9dbd1cafa745e
> Author: justinjleet <ju...@gmail.com>
> Date: Mon Apr 17 15:16:49 2017 -0400
> The MPack should function in a kerberized cluster (justinleet) closes apache/incubator-metron#518
> --
> --
> ansible 2.0.0.2
> config file =
> configured module search path = Default w/o overrides
> --
> Vagrant 1.8.1
> --
> Python 2.7.13
> --
> Apache Maven 3.3.9 (bb52d8502b132ec0a5a3f4c09453c07478323dc5; 2015-11-10T11:41:47-05:00)
> Maven home: /usr/local/Cellar/maven/3.3.9/libexec
> Java version: 1.8.0_66, vendor: Oracle Corporation
> Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0_66.jdk/Contents/Home/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "mac os x", version: "10.12.4", arch: "x86_64", family: "mac"
> --
> Darwin HW12402.local 16.5.0 Darwin Kernel Version 16.5.0: Fri Mar 3 16:52:33 PST 2017; root:xnu-3789.51.2~3/RELEASE_X86_64 x86_64
> --
> Total System Memory = 16384 MB
> Processor Model: Intel(R) Core(TM) i7-4870HQ CPU
> Processor Speed: 2.50GHz
> Total Physical Processors: 4
> Total cores: 4
> Disk information:
> /dev/disk1 465Gi 319Gi 145Gi 69% 2694524 4292272755 0% /
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)