Submitting topologies with 0.9.0.1

["lajos@protulae.com" <la...@protulae.com>]

Hi all,


I have code like this for programmatically submitting a topology as part of an integration test:



System.setProperty("storm.jar", jarFile);

Map conf = new HashMap();

 conf.put(Config.TOPOLOGY_DEBUG, true);

  conf.put(Config.NIMBUS_HOST, "localhost");

  conf.put(Config.NIMBUS_THRIFT_PORT, 6627);

StormSubmitter.submitTopology(topologyName, conf, builder.createTopology());


That worked fine in 0.8.2. Now it throws a nice exception (below). Has something changed? Is there now a better way to do it? And yes, I have made sure to compile everything against 0.9.0.1 and I have 0.9.0.1 happily running somewhere.

 

 

4373 [Thread-5] INFO  backtype.storm.daemon.supervisor - Downloading code for storm id eventsTopology-1-1387217868 from /tmp/375197c8-1bc4-419a-a860-118f956e42f9/nimbus/stormdist/eventsTopology-1-1387217868
4869 [Thread-5] ERROR backtype.storm.event - Error when processing event
java.util.zip.ZipException: error in opening zip file
    at java.util.zip.ZipFile.open(Native Method) ~[na:1.6.0_24]
    at java.util.zip.ZipFile.<init>(ZipFile.java:127) ~[na:1.6.0_24]
    at java.util.zip.ZipFile.<init>(ZipFile.java:88) ~[na:1.6.0_24]
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[na:1.6.0_24]
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) ~[na:1.6.0_24]
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) ~[na:1.6.0_24]
    at java.lang.reflect.Constructor.newInstance(Constructor.java:513) ~[na:1.6.0_24]
    at clojure.lang.Reflector.invokeConstructor(Reflector.java:180) ~[events-storm-core-dep.jar:na]
    at backtype.storm.util$zip_contains_dir_QMARK_.invoke(util.clj:727) ~[storm-core-0.9.0.1.jar:na]
    at backtype.storm.daemon.supervisor$resources_jar$fn__6333.invoke(supervisor.clj:436) ~[storm-core-0.9.0.1.jar:na]
    at clojure.core$filter$fn__4106.invoke(core.clj:2480) ~[events-storm-core-dep.jar:na]
    at clojure.lang.LazySeq.sval(LazySeq.java:42) ~[events-storm-core-dep.jar:na]
    at clojure.lang.LazySeq.seq(LazySeq.java:67) ~[events-storm-core-dep.jar:na]
    at clojure.lang.LazySeq.first(LazySeq.java:82) ~[events-storm-core-dep.jar:na]
    at clojure.lang.RT.first(RT.java:566) ~[events-storm-core-dep.jar:na]
    at clojure.core$first.invoke(core.clj:55) ~[events-storm-core-dep.jar:na]
    at backtype.storm.daemon.supervisor$resources_jar.invoke(supervisor.clj:434) ~[storm-core-0.9.0.1.jar:na]
    at backtype.storm.daemon.supervisor$fn__6338.invoke(supervisor.clj:444) ~[storm-core-0.9.0.1.jar:na]
    at clojure.lang.MultiFn.invoke(MultiFn.java:172) ~[events-storm-core-dep.jar:na]
    at backtype.storm.daemon.supervisor$mk_synchronize_supervisor$this__6251.invoke(supervisor.clj:290) ~[storm-core-0.9.0.1.jar:na]
    at backtype.storm.event$event_manager$fn__3072.invoke(event.clj:24) ~[storm-core-0.9.0.1.jar:na]
    at clojure.lang.AFn.run(AFn.java:24) [events-storm-core-dep.jar:na]
    at java.lang.Thread.run(Thread.java:662) [na:1.6.0_24]
4878 [Thread-5] INFO  backtype.storm.util - Halting process: ("Error when processing an event")



Thanks,

Lajos