You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@metron.apache.org by Shigenobu Koufugata <sh...@gmail.com> on 2017/02/04 03:20:23 UTC
[ASK] Java Error with Metron 0.3.0-rc1 on Nutanix
Hello all,
My client want to use Nutanix with Metron.
We (I and my colleague) would like to confirm that Metron 0.3.0-rc1 can
works on Nutanix or not.
So, we are using a project room of the vendor for making sure that
combination.
Avoiding the complexity of cluster, we settled up all Metron sensors and
topologies into one Virtual Machine.
Before this validation work, we was able to set up that same
configuration on Virtual Box on HP DL360 (with Vagrant). It looked
working well. No errors, Kibana dashboard looked so good and the pcap
data of HDFS looked good too.
And in the project room, we deployed Metron 0.3.0-rc1 using another
Ansible Virtul Machine( CentOS 7.3, Ansible 2.0.0.2, etc.) on Nutanix.
That deployment ended with success. But when rebooting that Metron, one
Java exception occurs in Enrichment topology and can not enrich sensor
data. In other hands, PCAP data is processed well.
The exception is following.
place：geoEnrichmentBolt、simpleHBaseEnrichmentBolt
java.lang.IllegalStateException: Could not initialize adapter... at
org.apache.metron.enrichment.bolt.GenericEnrichmentBolt.prepare(GenericEnrichmentBolt.java:153)
at
org.apache.storm.daemon.executor$fn__6573$fn__6586.invoke(executor.clj:798)
at org.apache.storm.util$async_loop$fn__554.invoke(util.clj:482) at
clojure.lang.AFn.run(AFn.java:22) at java.lang.Thread.run(Thread.java:745)
Hardware：
Nutanix model: NX-3060-G4
HYPERVISOR: AHV
VERSION: Nutanix 20160925.30
VM:
CPU 2, Core 2 (=4 Cores)
Memory: 32GB
Disk: 100GB
Sortware:
CentOS6.7
Apache Metron 0.3.0-rc1
The URL of the corresponding source code is line 153 of the following code
https://github.com/apache/incubator-metron/blob/master/metron-platform/metron-enrichment/src/main/java/org/apache/metron/enrichment/bolt/GenericEnrichmentBolt.java
It may not be a problem unique to Nutanix...
Any advice is welcome.
Best regards,
--
Shigenobu Koufugata
+81-47-343-5205
shigenobu.koufugata@gmail.com
Re: [ASK] Java Error with Metron 0.3.0-rc1 on Nutanix
Posted by Shigenobu Koufugata <sh...@gmail.com>.
Nick,
Thank you so much for your kindness to check my message.
Actually, I was at a loss, so it's very helpful.
I checked that MySQL is running, but I had an access error from
Enrichment Topology in worker.log under
/var/log/storm/workers-artifacts/enrichment-2-1486348266/6705/.
By changing /etc/hosts, the enriched data went through these topologies.
It looks good by now.
Many thanks,
--
Shigenobu Koufugata
+81-47-343-5205 <tel:%2B81-47-343-5205>
shigenobu.koufugata@gmail.com <ma...@gmail.com>
On 2017/02/05 2:48, Nick Allen wrote:
> The source code line from 0.3.0 RC1 may be different than what is in
> master now. Keep that in mind as you debug this issue.
>
> You did not send the entire stack trace, but if I had to guess, the
> geo enrichment bolt cannot connect to the geo database running in
> MySQL. Is MySQL running and accessible?
>
>
> On Sat, Feb 4, 2017 at 12:44 PM, Nick Allen <nick@nickallen.org
> <ma...@nickallen.org>> wrote:
>
> Any reason that you are using a release candidate? The latest
> release version is 0.3.0. See
> http://metron.incubator.apache.org/documentation/#releases
> <http://metron.incubator.apache.org/documentation/#releases>
>
>
>
> On Fri, Feb 3, 2017 at 10:20 PM, Shigenobu Koufugata
> <shigenobu.koufugata@gmail.com
> <ma...@gmail.com>> wrote:
>
> Hello all,
>
> My client want to use Nutanix with Metron.
> We (I and my colleague) would like to confirm that Metron
> 0.3.0-rc1 can works on Nutanix or not.
>
> So, we are using a project room of the vendor for making sure
> that combination.
> Avoiding the complexity of cluster, we settled up all Metron
> sensors and topologies into one Virtual Machine.
>
> Before this validation work, we was able to set up that same
> configuration on Virtual Box on HP DL360 (with Vagrant). It
> looked working well. No errors, Kibana dashboard looked so
> good and the pcap data of HDFS looked good too.
>
> And in the project room, we deployed Metron 0.3.0-rc1 using
> another Ansible Virtul Machine( CentOS 7.3, Ansible 2.0.0.2,
> etc.) on Nutanix.
> That deployment ended with success. But when rebooting that
> Metron, one Java exception occurs in Enrichment topology and
> can not enrich sensor data. In other hands, PCAP data is
> processed well.
>
> The exception is following.
>
> place\uff1ageoEnrichmentBolt\u3001simpleHBaseEnrichmentBolt
>
> java.lang.IllegalStateException: Could not initialize
> adapter... at
> org.apache.metron.enrichment.bolt.GenericEnrichmentBolt.prepare(GenericEnrichmentBolt.java:153)
> at
> org.apache.storm.daemon.executor$fn__6573$fn__6586.invoke(executor.clj:798)
> at
> org.apache.storm.util$async_loop$fn__554.invoke(util.clj:482)
> at clojure.lang.AFn.run(AFn.java:22) at
> java.lang.Thread.run(Thread.java:745)
>
> Hardware\uff1a
>
> Nutanix model: NX-3060-G4
> HYPERVISOR: AHV
> VERSION: Nutanix 20160925.30 <tel:20160925.30>
>
> VM:
> CPU 2, Core 2 (=4 Cores)
> Memory: 32GB
> Disk: 100GB
>
> Sortware:
> CentOS6.7
> Apache Metron 0.3.0-rc1
>
> The URL of the corresponding source code is line 153 of the
> following code
>
> https://github.com/apache/incubator-metron/blob/master/metron-platform/metron-enrichment/src/main/java/org/apache/metron/enrichment/bolt/GenericEnrichmentBolt.java
> <https://github.com/apache/incubator-metron/blob/master/metron-platform/metron-enrichment/src/main/java/org/apache/metron/enrichment/bolt/GenericEnrichmentBolt.java>
>
>
> It may not be a problem unique to Nutanix...
> Any advice is welcome.
>
> Best regards,
> --
> Shigenobu Koufugata
> +81-47-343-5205 <tel:%2B81-47-343-5205>
> shigenobu.koufugata@gmail.com
> <ma...@gmail.com>
>
>
>
Re: [ASK] Java Error with Metron 0.3.0-rc1 on Nutanix
Posted by Nick Allen <ni...@nickallen.org>.
The source code line from 0.3.0 RC1 may be different than what is in master
now. Keep that in mind as you debug this issue.
You did not send the entire stack trace, but if I had to guess, the geo
enrichment bolt cannot connect to the geo database running in MySQL. Is
MySQL running and accessible?
On Sat, Feb 4, 2017 at 12:44 PM, Nick Allen <ni...@nickallen.org> wrote:
> Any reason that you are using a release candidate? The latest release
> version is 0.3.0. See http://metron.incubator.apache.org/documentation/#
> releases
>
>
>
> On Fri, Feb 3, 2017 at 10:20 PM, Shigenobu Koufugata <
> shigenobu.koufugata@gmail.com> wrote:
>
>> Hello all,
>>
>> My client want to use Nutanix with Metron.
>> We (I and my colleague) would like to confirm that Metron 0.3.0-rc1 can
>> works on Nutanix or not.
>>
>> So, we are using a project room of the vendor for making sure that
>> combination.
>> Avoiding the complexity of cluster, we settled up all Metron sensors and
>> topologies into one Virtual Machine.
>>
>> Before this validation work, we was able to set up that same
>> configuration on Virtual Box on HP DL360 (with Vagrant). It looked working
>> well. No errors, Kibana dashboard looked so good and the pcap data of HDFS
>> looked good too.
>>
>> And in the project room, we deployed Metron 0.3.0-rc1 using another
>> Ansible Virtul Machine( CentOS 7.3, Ansible 2.0.0.2, etc.) on Nutanix.
>> That deployment ended with success. But when rebooting that Metron, one
>> Java exception occurs in Enrichment topology and can not enrich sensor
>> data. In other hands, PCAP data is processed well.
>>
>> The exception is following.
>>
>> place：geoEnrichmentBolt、simpleHBaseEnrichmentBolt
>>
>> java.lang.IllegalStateException: Could not initialize adapter... at
>> org.apache.metron.enrichment.bolt.GenericEnrichmentBolt.prep
>> are(GenericEnrichmentBolt.java:153) at org.apache.storm.daemon.execut
>> or$fn__6573$fn__6586.invoke(executor.clj:798) at
>> org.apache.storm.util$async_loop$fn__554.invoke(util.clj:482) at
>> clojure.lang.AFn.run(AFn.java:22) at java.lang.Thread.run(Thread.ja
>> va:745)
>>
>> Hardware：
>>
>> Nutanix model: NX-3060-G4
>> HYPERVISOR: AHV
>> VERSION: Nutanix 20160925.30
>>
>> VM:
>> CPU 2, Core 2 (=4 Cores)
>> Memory: 32GB
>> Disk: 100GB
>>
>> Sortware:
>> CentOS6.7
>> Apache Metron 0.3.0-rc1
>>
>> The URL of the corresponding source code is line 153 of the following code
>>
>> https://github.com/apache/incubator-metron/blob/master/metro
>> n-platform/metron-enrichment/src/main/java/org/apache/metron
>> /enrichment/bolt/GenericEnrichmentBolt.java
>>
>> It may not be a problem unique to Nutanix...
>> Any advice is welcome.
>>
>> Best regards,
>> --
>> Shigenobu Koufugata
>> +81-47-343-5205
>> shigenobu.koufugata@gmail.com
>>
>
>
Re: [ASK] Java Error with Metron 0.3.0-rc1 on Nutanix
Posted by Nick Allen <ni...@nickallen.org>.
Any reason that you are using a release candidate? The latest release
version is 0.3.0. See
http://metron.incubator.apache.org/documentation/#releases
On Fri, Feb 3, 2017 at 10:20 PM, Shigenobu Koufugata <
shigenobu.koufugata@gmail.com> wrote:
> Hello all,
>
> My client want to use Nutanix with Metron.
> We (I and my colleague) would like to confirm that Metron 0.3.0-rc1 can
> works on Nutanix or not.
>
> So, we are using a project room of the vendor for making sure that
> combination.
> Avoiding the complexity of cluster, we settled up all Metron sensors and
> topologies into one Virtual Machine.
>
> Before this validation work, we was able to set up that same configuration
> on Virtual Box on HP DL360 (with Vagrant). It looked working well. No
> errors, Kibana dashboard looked so good and the pcap data of HDFS looked
> good too.
>
> And in the project room, we deployed Metron 0.3.0-rc1 using another
> Ansible Virtul Machine( CentOS 7.3, Ansible 2.0.0.2, etc.) on Nutanix.
> That deployment ended with success. But when rebooting that Metron, one
> Java exception occurs in Enrichment topology and can not enrich sensor
> data. In other hands, PCAP data is processed well.
>
> The exception is following.
>
> place：geoEnrichmentBolt、simpleHBaseEnrichmentBolt
>
> java.lang.IllegalStateException: Could not initialize adapter... at
> org.apache.metron.enrichment.bolt.GenericEnrichmentBolt.prep
> are(GenericEnrichmentBolt.java:153) at org.apache.storm.daemon.execut
> or$fn__6573$fn__6586.invoke(executor.clj:798) at
> org.apache.storm.util$async_loop$fn__554.invoke(util.clj:482) at
> clojure.lang.AFn.run(AFn.java:22) at java.lang.Thread.run(Thread.java:745)
>
> Hardware：
>
> Nutanix model: NX-3060-G4
> HYPERVISOR: AHV
> VERSION: Nutanix 20160925.30
>
> VM:
> CPU 2, Core 2 (=4 Cores)
> Memory: 32GB
> Disk: 100GB
>
> Sortware:
> CentOS6.7
> Apache Metron 0.3.0-rc1
>
> The URL of the corresponding source code is line 153 of the following code
>
> https://github.com/apache/incubator-metron/blob/master/metro
> n-platform/metron-enrichment/src/main/java/org/apache/
> metron/enrichment/bolt/GenericEnrichmentBolt.java
>
> It may not be a problem unique to Nutanix...
> Any advice is welcome.
>
> Best regards,
> --
> Shigenobu Koufugata
> +81-47-343-5205
> shigenobu.koufugata@gmail.com
>