You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@metron.apache.org by Keiko Murakami <k....@nanaroq.com> on 2016/07/31 03:29:20 UTC
Storm KafkaSpout uses well-known port
Hi all
I ‘ve been testing incubator metron 0.2.0BETA on CentOS 6.7 single server,
But I could not get snort incoming data in storm.
Would you please help this issue?
- All ambari component and all monit component are running normally
- snort imcomming data stored in /var/log/snort/alert.csv
- kafka-console-consumer.sh --zookeeper localhost:2181 --topic winevtlog --from-beginning
showed me current incoming data
- storm worker detected error followings.
I think it is bad using kafkaspout's port is well known(ex, 32) port in this case.
------
2016-07-31 12:23:42.357 o.a.s.c.f.i.CuratorFrameworkImpl [INFO] Starting
2016-07-31 12:23:42.383 o.a.s.z.ZooKeeper [INFO] Initiating client connection, connectString=nqsc08:2181 sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@7d3fb0ef
2016-07-31 12:23:42.572 o.a.s.z.ClientCnxn [INFO] Opening socket connection to server nqsc08/10.0.0.142:2181. Will not attempt to authenticate using SASL (unknown error)
2016-07-31 12:23:43.177 o.a.s.z.ClientCnxn [INFO] Socket connection established to nqsc08/10.0.0.142:2181, initiating session
2016-07-31 12:23:43.201 o.a.s.z.ClientCnxn [INFO] Session establishment complete on server nqsc08/10.0.0.142:2181, sessionid = 0x1563ee7c2be002e, negotiated timeout = 20000
2016-07-31 12:23:43.204 o.a.s.c.f.s.ConnectionStateManager [INFO] State change: CONNECTED
2016-07-31 12:23:43.206 b.s.zookeeper [INFO] Zookeeper state update: :connected:none
2016-07-31 12:23:43.267 o.a.s.z.ClientCnxn [INFO] EventThread shut down
2016-07-31 12:23:43.309 o.a.s.z.ZooKeeper [INFO] Session: 0x1563ee7c2be002e closed
2016-07-31 12:23:43.310 b.s.u.StormBoundedExponentialBackoffRetry [INFO] The baseSleepTimeMs [1000] the maxSleepTimeMs [30000] the maxRetries [5]
2016-07-31 12:23:43.311 o.a.s.c.f.i.CuratorFrameworkImpl [INFO] Starting
2016-07-31 12:23:43.324 o.a.s.z.ZooKeeper [INFO] Initiating client connection, connectString=nqsc08:2181/storm sessionTimeout=20000 watcher=org.apache.storm.curator.ConnectionState@7f93dd4e
2016-07-31 12:23:43.425 o.a.s.z.ClientCnxn [INFO] Opening socket connection to server nqsc08/10.0.0.142:2181. Will not attempt to authenticate using SASL (unknown error)
2016-07-31 12:23:43.425 o.a.s.z.ClientCnxn [INFO] Socket connection established to nqsc08/10.0.0.142:2181, initiating session
2016-07-31 12:23:43.427 o.a.s.z.ClientCnxn [INFO] Session establishment complete on server nqsc08/10.0.0.142:2181, sessionid = 0x1563ee7c2be002f, negotiated timeout = 20000
2016-07-31 12:23:43.428 o.a.s.c.f.s.ConnectionStateManager [INFO] State change: CONNECTED
2016-07-31 12:23:43.561 b.s.s.a.AuthUtils [INFO] Got AutoCreds []
2016-07-31 12:23:43.591 b.s.d.worker [INFO] Reading Assignments.
2016-07-31 12:23:43.870 b.s.m.TransportFactory [INFO] Storm peer transport plugin:backtype.storm.messaging.netty.Context
2016-07-31 12:23:44.247 b.s.m.n.Server [INFO] Create Netty Server Netty-server-localhost-32, buffer_size: 5242880, maxWorkers: 1
2016-07-31 12:23:44.375 b.s.d.worker [ERROR] Error on initialization of server mk-worker
org.apache.storm.netty.channel.ChannelException: Failed to bind to: 0.0.0.0/0.0.0.0:32
at org.apache.storm.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:272) ~[storm-core-0.10.0.2.3.6.0-3796.jar:0.10.0.2.3.6.0-3796]
at backtype.storm.messaging.netty.Server.<init>(Server.java:120) ~[storm-core-0.10.0.2.3.6.0-3796.jar:0.10.0.2.3.6.0-3796]
at backtype.storm.messaging.netty.Context.bind(Context.java:75) ~[storm-core-0.10.0.2.3.6.0-3796.jar:0.10.0.2.3.6.0-3796]
at backtype.storm.daemon.worker$worker_data$fn__8497.invoke(worker.clj:216) ~[storm-core-0.10.0.2.3.6.0-3796.jar:0.10.0.2.3.6.0-3796]
at backtype.storm.util$assoc_apply_self.invoke(util.clj:920) ~[storm-core-0.10.0.2.3.6.0-3796.jar:0.10.0.2.3.6.0-3796]
at backtype.storm.daemon.worker$worker_data.invoke(worker.clj:213) ~[storm-core-0.10.0.2.3.6.0-3796.jar:0.10.0.2.3.6.0-3796]
at backtype.storm.daemon.worker$fn__8735$exec_fn__3866__auto__$reify__8737.run(worker.clj:517) ~[storm-core-0.10.0.2.3.6.0-3796.jar:0.10.0.2.3.6.0-3796]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_40]
at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_40]
at backtype.storm.daemon.worker$fn__8735$exec_fn__3866__auto____8736.invoke(worker.clj:515) ~[storm-core-0.10.0.2.3.6.0-3796.jar:0.10.0.2.3.6.0-3796]
at clojure.lang.AFn.applyToHelper(AFn.java:178) ~[clojure-1.6.0.jar:?]
------