You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@metron.apache.org by "zhray (Jira)" <ji...@apache.org> on 2020/01/08 12:00:06 UTC
[jira] [Created] (METRON-2338) The PCAP topology doesn't work
zhray created METRON-2338:
-----------------------------
Summary: The PCAP topology doesn't work
Key: METRON-2338
URL: https://issues.apache.org/jira/browse/METRON-2338
Project: Metron
Issue Type: Bug
Environment: centos 7.7 + ambari 2.6.2 + HDP 2.6.5 + metron 0.7.2（e57a795）+ librdkafka-0.11.5
Reporter: zhray
I can process data in bro format normally, but the pcap topology will always report errors, even though the input source has not been set。
I followed this tutorial：[Metron 0.4.1 with HDP 2.5 bare-metal install on Centos 7 with MariaDB for Metron REST|https://cwiki.apache.org/confluence/display/METRON/Metron+0.4.1+with+HDP+2.5+bare-metal+install+on+Centos+7+with+MariaDB+for+Metron+REST]
{code:java}
2020-01-08 19:41:57.536 o.a.s.k.s.KafkaSpout Thread-6-kafkaSpout-executor[3 3] [INFO] Initialization complete
2020-01-08 19:41:57.568 o.a.s.util Thread-6-kafkaSpout-executor[3 3] [ERROR] Async loop died!
java.lang.IllegalArgumentException: Expected a key but none provided
at org.apache.metron.spout.pcap.deserializer.FromKeyDeserializer.deserializeKeyValue(FromKeyDeserializer.java:44) ~[stormjar.jar:?]
at org.apache.metron.spout.pcap.HDFSWriterCallback.apply(HDFSWriterCallback.java:104) ~[stormjar.jar:?]
at org.apache.storm.kafka.CallbackCollector.emit(CallbackCollector.java:59) ~[stormjar.jar:?]
at org.apache.storm.kafka.spout.KafkaSpout.emitOrRetryTuple(KafkaSpout.java:496) ~[stormjar.jar:?]
at org.apache.storm.kafka.spout.KafkaSpout.emitIfWaitingNotEmitted(KafkaSpout.java:440) ~[stormjar.jar:?]
at org.apache.storm.kafka.spout.KafkaSpout.nextTuple(KafkaSpout.java:308) ~[stormjar.jar:?]
at org.apache.metron.spout.pcap.KafkaToHDFSSpout.nextTuple(KafkaToHDFSSpout.java:76) ~[stormjar.jar:?]
at org.apache.storm.daemon.executor$fn__10125$fn__10140$fn__10173.invoke(executor.clj:652) ~[storm-core-1.1.0.2.6.5.0-292.jar:1.1.0.2.6.5.0-292]
at org.apache.storm.util$async_loop$fn__1221.invoke(util.clj:484) [storm-core-1.1.0.2.6.5.0-292.jar:1.1.0.2.6.5.0-292]
at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_112]
2020-01-08 19:41:57.574 o.a.s.d.executor Thread-6-kafkaSpout-executor[3 3] [ERROR]
java.lang.IllegalArgumentException: Expected a key but none provided
at org.apache.metron.spout.pcap.deserializer.FromKeyDeserializer.deserializeKeyValue(FromKeyDeserializer.java:44) ~[stormjar.jar:?]
at org.apache.metron.spout.pcap.HDFSWriterCallback.apply(HDFSWriterCallback.java:104) ~[stormjar.jar:?]
at org.apache.storm.kafka.CallbackCollector.emit(CallbackCollector.java:59) ~[stormjar.jar:?]
at org.apache.storm.kafka.spout.KafkaSpout.emitOrRetryTuple(KafkaSpout.java:496) ~[stormjar.jar:?]
at org.apache.storm.kafka.spout.KafkaSpout.emitIfWaitingNotEmitted(KafkaSpout.java:440) ~[stormjar.jar:?]
at org.apache.storm.kafka.spout.KafkaSpout.nextTuple(KafkaSpout.java:308) ~[stormjar.jar:?]
at org.apache.metron.spout.pcap.KafkaToHDFSSpout.nextTuple(KafkaToHDFSSpout.java:76) ~[stormjar.jar:?]
at org.apache.storm.daemon.executor$fn__10125$fn__10140$fn__10173.invoke(executor.clj:652) ~[storm-core-1.1.0.2.6.5.0-292.jar:1.1.0.2.6.5.0-292]
at org.apache.storm.util$async_loop$fn__1221.invoke(util.clj:484) [storm-core-1.1.0.2.6.5.0-292.jar:1.1.0.2.6.5.0-292]
at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_112]
2020-01-08 19:41:57.604 o.a.s.util Thread-6-kafkaSpout-executor[3 3] [ERROR] Halting process: ("Worker died")
java.lang.RuntimeException: ("Worker died")
at org.apache.storm.util$exit_process_BANG_.doInvoke(util.clj:341) [storm-core-1.1.0.2.6.5.0-292.jar:1.1.0.2.6.5.0-292]
at clojure.lang.RestFn.invoke(RestFn.java:423) [clojure-1.7.0.jar:?]
at org.apache.storm.daemon.worker$fn__10799$fn__10800.invoke(worker.clj:763) [storm-core-1.1.0.2.6.5.0-292.jar:1.1.0.2.6.5.0-292]
at org.apache.storm.daemon.executor$mk_executor_data$fn__10011$fn__10012.invoke(executor.clj:276) [storm-core-1.1.0.2.6.5.0-292.jar:1.1.0.2.6.5.0-292]
at org.apache.storm.util$async_loop$fn__1221.invoke(util.clj:494) [storm-core-1.1.0.2.6.5.0-292.jar:1.1.0.2.6.5.0-292]
at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_112]
2020-01-08 19:41:57.607 o.a.s.d.worker Thread-13 [INFO] Shutting down worker pcap-18-1577968006 7b03b065-884b-4961-a139-63f8f1ef531b 6701
2020-01-08 19:41:57.607 o.a.s.d.worker Thread-13 [INFO] Terminating messaging context
2020-01-08 19:41:57.608 o.a.s.d.worker Thread-13 [INFO] Shutting down executors
2020-01-08 19:41:57.608 o.a.s.d.executor Thread-13 [INFO] Shutting down executor __metricsorg.apache.hadoop.metrics2.sink.storm.StormTimelineMetricsSink:[2 2]
2020-01-08 19:41:57.609 o.a.s.util Thread-3-disruptor-executor[2 2]-send-queue [INFO] Async loop interrupted!
{code}
by the way，what are the passwords and users of Alerts UI and Management UI? The admin/admin and user/password are wrong!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)