You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@storm.apache.org by "Edward Goslin (JIRA)" <ji...@apache.org> on 2015/01/22 10:41:36 UTC
[jira] [Commented] (STORM-99) Multitple topologies assigned to one
port
[ https://issues.apache.org/jira/browse/STORM-99?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14287171#comment-14287171 ]
Edward Goslin commented on STORM-99:
------------------------------------
Was this issue fixed by https://issues.apache.org/jira/browse/STORM-155 ?
We receive this error in 0.9.2
2015-01-22 06:25:45.138 b.s.event [][Thread-1][ERROR] Error when processing event
java.lang.RuntimeException: Should not have multiple topologies assigned to one port
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[na:1.8.0_11]
at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source) ~[na:1.8.0_11]
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source) ~[na:1.8.0_11]
at java.lang.reflect.Constructor.newInstance(Unknown Source) ~[na:1.8.0_11]
at clojure.lang.Reflector.invokeConstructor(Reflector.java:180) ~[clojure-1.5.1.jar:na]
at backtype.storm.util$throw_runtime.doInvoke(util.clj:753) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at clojure.lang.RestFn.invoke(RestFn.java:408) ~[clojure-1.5.1.jar:na]
at backtype.storm.daemon.supervisor$read_assignments$fn__6143.doInvoke(supervisor.clj:65) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at clojure.lang.RestFn.invoke(RestFn.java:421) ~[clojure-1.5.1.jar:na]
at clojure.core$merge_with$merge_entry__4279.invoke(core.clj:2698) ~[clojure-1.5.1.jar:na]
at clojure.core$reduce1.invoke(core.clj:896) ~[clojure-1.5.1.jar:na]
at clojure.core$merge_with$merge2__4281.invoke(core.clj:2701) ~[clojure-1.5.1.jar:na]
at clojure.core$reduce1.invoke(core.clj:896) ~[clojure-1.5.1.jar:na]
at clojure.core$reduce1.invoke(core.clj:887) ~[clojure-1.5.1.jar:na]
at clojure.core$merge_with.doInvoke(core.clj:2702) ~[clojure-1.5.1.jar:na]
at clojure.lang.RestFn.applyTo(RestFn.java:139) ~[clojure-1.5.1.jar:na]
at clojure.core$apply.invoke(core.clj:619) ~[clojure-1.5.1.jar:na]
at backtype.storm.daemon.supervisor$read_assignments.invoke(supervisor.clj:64) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at backtype.storm.daemon.supervisor$mk_synchronize_supervisor$this__6330.invoke(supervisor.clj:303) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at backtype.storm.event$event_manager$fn__2378.invoke(event.clj:39) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
at java.lang.Thread.run(Unknown Source) [na:1.8.0_11]
> Multitple topologies assigned to one port
> -----------------------------------------
>
> Key: STORM-99
> URL: https://issues.apache.org/jira/browse/STORM-99
> Project: Apache Storm
> Issue Type: Bug
> Reporter: James Xu
> Priority: Minor
>
> https://github.com/nathanmarz/storm/issues/586
> When I submitted a lot of topologies(about 15) to the storm cluster, one supervisor throw a runtime exception. I believe that the exception should not be thrown in the normal. The version of the storm is 0.8.1
> I tried to reproduce this exception, but failed and after review the nimbus.clj & supervisor.clj, I found nothing. Is it a known bug?
> Stack Info:
> 2013-06-06 14:55:00 supervisor [INFO] Shut down 212aa36c-81a0-4d4d-8104-759d9f128669:f66a0118-7267-4460-9f35-58435c92dc10
> 2013-06-06 14:55:00 supervisor [INFO] Shutting down and clearing state for id 8db35c17-9e69-49db-86c3-f7dc90fa42be. Current supervisor time: 1370501700. State: :disallowed, Heartbeat: #backtype.storm.daemon.common.WorkerHeartbeat{:time-secs 1370501699, :storm-id "case_10-537-1370488327", :executors #{[7 7] [14 14]}, :port 6708}
> 2013-06-06 14:55:00 supervisor [INFO] Shutting down 212aa36c-81a0-4d4d-8104-759d9f128669:8db35c17-9e69-49db-86c3-f7dc90fa42be
> 2013-06-06 14:55:00 supervisor [INFO] Shut down 212aa36c-81a0-4d4d-8104-759d9f128669:8db35c17-9e69-49db-86c3-f7dc90fa42be
> 2013-06-06 14:55:03 event [ERROR] Error when processing event
> java.lang.RuntimeException: Should not have multiple topologies assigned to one port
> at backtype.storm.daemon.supervisor$read_assignments$fn__4510.doInvoke(supervisor.clj:45)
> at clojure.lang.RestFn.invoke(RestFn.java:421)
> at clojure.core$merge_with$merge_entry__4159.invoke(core.clj:2645)
> at clojure.core$reduce1.invoke(core.clj:880)
> at clojure.core$merge_with$merge2__4161.invoke(core.clj:2648)
> at clojure.core$reduce1.invoke(core.clj:880)
> at clojure.core$reduce1.invoke(core.clj:871)
> at clojure.core$merge_with.doInvoke(core.clj:2649)
> at clojure.lang.RestFn.applyTo(RestFn.java:139)
> at clojure.core$apply.invoke(core.clj:603)
> at backtype.storm.daemon.supervisor$read_assignments.invoke(supervisor.clj:48)
> at backtype.storm.daemon.supervisor$mk_synchronize_supervisor$this__4692.invoke(supervisor.clj:270)
> at backtype.storm.event$event_manager$fn__2484.invoke(event.clj:24)
> at clojure.lang.AFn.run(AFn.java:24)
> at java.lang.Thread.run(Thread.java:679)
> 2013-06-06 14:55:03 util [INFO] Halting process: ("Error when processing an event")
> nimbus log within the crash time
> 2013-06-06 14:54:44 nimbus [INFO] Delaying event :remove for 0 secs for case_9-536-1370488243
> 2013-06-06 14:54:44 nimbus [INFO] Updated case_9-536-1370488243 with status {:type :killed, :kill-time-secs 0}
> 2013-06-06 14:54:45 nimbus [INFO] Killing topology: case_9-536-1370488243
> 2013-06-06 14:54:52 EvenScheduler [INFO] Available slots: (["212aa36c-81a0-4d4d-8104-759d9f128669" 6705] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6706] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6709] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6710] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6711])
> 2013-06-06 14:54:52 nimbus [INFO] Setting new assignment for topology id case_23-527-1370478607: #backtype.storm.daemon.common.Assignment{:master-code-dir "/home/admin/install/storm-local/nimbus/stormdist/case_23-527-1370478607", :node->host {"212aa36c-81a0-4d4d-8104-759d9f128669" "dev163015.sqa.cm6"}, :executor->node+port {[2 2] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6706], [3 3] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6709], [4 4] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6710], [5 5] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6711], [6 6] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6705], [7 7] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6706], [8 8] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6709], [9 9] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6710], [10 10] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6711], [11 11] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6705], [12 12] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6706], [13 13] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6709], [1 1] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6705]}, :executor->start-time-secs {[2 2] 1370501692, [3 3] 1370501692, [4 4] 1370501692, [5 5] 1370501692, [6 6] 1370501692, [7 7] 1370501692, [8 8] 1370501692, [9 9] 1370501692, [10 10] 1370501692, [11 11] 1370501692, [12 12] 1370501692, [13 13] 1370501692, [1 1] 1370501692}}
> 2013-06-06 14:54:52 nimbus [INFO] Cleaning up case_2-486-1370440841
> 2013-06-06 14:54:52 nimbus [INFO] Cleaning up case_9-536-1370488243
> 2013-06-06 14:54:52 nimbus [INFO] Cleaning up case_7-490-1370441170
> 2013-06-06 14:54:53 nimbus [INFO] Delaying event :remove for 0 secs for case_10-537-1370488327
> 2013-06-06 14:54:53 nimbus [INFO] Updated case_10-537-1370488327 with status {:type :killed, :kill-time-secs 0}
> 2013-06-06 14:54:53 nimbus [INFO] Killing topology: case_10-537-1370488327
> 2013-06-06 14:55:03 EvenScheduler [INFO] Available slots: (["212aa36c-81a0-4d4d-8104-759d9f128669" 6700] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6701] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6702] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6703] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6704] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6705] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6706] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6707] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6708] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6709])
> 2013-06-06 14:55:03 EvenScheduler [INFO] Available slots: (["212aa36c-81a0-4d4d-8104-759d9f128669" 6705] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6706] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6707] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6708] ["212aa36c-81a0-4d4d-8104-759d9f128669" 6709])
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)