You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Alexandre Wilhelm <al...@gmail.com> on 2016/05/17 00:45:46 UTC

Storm Multilang: mixed message

Hi guys,

I’m facing an issue when using a topology in go with storm.

When running the topology with several workers (20) and parallelism (20) I can get mixed message in the console, for instance :

java.io.IOException: unable to parse: 449957326"],"command":"emit","need_task_ids":false,"tuple":["[{\"name\":\"syscall.write.count\",\"tags\":{\"priority\":\"minimum\",\"processID\":\"GPoEf\",\"serverID\":\"UUID\"},\"timestamp\":\"20160516173637\",\"value\":\"78\"},{\"name\":\"syscall.write.test\",\"tags\":{\"priority\":\"minimum\",\"processID\":\"GPoEf\",\"serverID\":\"UUID\"},\"timestamp\":\"20160516173637\",\"value\":\"62\"}]"]}
	at org.apache.storm.multilang.JsonSerializer.readMessage(JsonSerializer.java:173) ~[storm-core-1.0.1.jar:1.0.1]
	at org.apache.storm.multilang.JsonSerializer.readShellMsg(JsonSerializer.java:103) ~[storm-core-1.0.1.jar:1.0.1]
	at org.apache.storm.utils.ShellProcess.readShellMsg(ShellProcess.java:120) ~[storm-core-1.0.1.jar:1.0.1]
	at org.apache.storm.task.ShellBolt$BoltReaderRunnable.run(ShellBolt.java:333) [storm-core-1.0.1.jar:1.0.1]
	at java.lang.Thread.run(Thread.java:745) [?:1.8.0_20-ea]
177703 [Thread-124] ERROR o.a.s.d.executor - 

Here we can see the last chars of the previous message and a new message. The messages are randomly cut.

Is it normal as several processes are writing in the same console, or something is wrong with my setup ? This issue does not happen when not having parallelism and several workers.

Running on storm 1.0.1

Thanks and sorry if it’s not a relevant question. 
-- 
Alexandre Wilhelm