Re: Storm cluster with nimbus and cluster in different host machines

[Manjunath Anand <ma...@gmail.com>]

>
> Hi team,
>
> I configured storm in cluster(with zookeeper cluster) mode and submitted a
> topology (new1) remotely using java code. Below is the observation:-
>
> Nimbus - 192.168.56.1
> Supervisor - 192.168.56.101
>
> 1) Nimbus log shows that the storm jar is uploaded to location
> "/home/iruve/Softwares/storm/data/storm-nimbus/nimbus/stormdist/new1-1-1442863219"
>  present in the 192.168.56.1 nimbus host machine.
> 2) The supervisor log shows that it is trying to download this storm jar
> from the same above mentioned path which is not present in the
> 192.168.56.101 as the above path refers to the directory structure present
> in the nimbus machine which corresponds to its data directory. The storm
> data directory is different for this supervisor node. This connectivity to
> the path is causing java.net.ConnectException.
>
> Kindly help me out to understand how should such scenario be handled where
> in the nimbus is in different machine with different storm data
> directory/path and the supervisors in a different machine with different
> storm data directory/path.
>
> Below are the details :-
>
> Nimbus log:-
> =========
> 2015-09-22 00:50:20.021 b.s.d.nimbus [INFO] Received topology submission
> for new1 with conf {"topology.max.task.parallelism" nil,
> "topology.submitter.principal" "", "topology.acker.executors" nil,
> "topology.environment" {"nimbus.host" "192.168.56.1", "nimbus.thrift.port"
> 6627, "storm.zookeeper.servers" ["192.168.56.1" "192.168.56.101"
> "192.168.56.102"]}, "topology.debug" true, "storm.zookeeper.superACL" nil,
> "topology.users" (), "topology.submitter.user" "", "topology.kryo.register"
> nil, "topology.kryo.decorators" (), "storm.id" "new1-1-1442863219", "
> topology.name" "new1"}
> 2015-09-22 00:50:20.073 b.s.d.nimbus [INFO] nimbus file
> location:/home/iruve/Softwares/storm/data/storm-nimbus/nimbus/stormdist/new1-1-1442863219
> 2015-09-22 00:50:20.091 b.s.d.nimbus [INFO] Activating new1:
> new1-1-1442863219
>
>
> Supervisor log:-
> ===========
> 2015-09-22 00:50:19.298 b.s.d.supervisor [INFO] Downloading code for storm
> id new1-1-1442863219 from
> /home/iruve/Softwares/storm/data/storm-nimbus/nimbus/stormdist/new1-1-1442863219
> 2015-09-22 00:50:19.356 b.s.u.StormBoundedExponentialBackoffRetry [INFO]
> The baseSleepTimeMs [2000] the maxSleepTimeMs [60000] the maxRetries [5]
> 2015-09-22 00:50:29.417 b.s.event [ERROR] Error when processing event
> java.lang.RuntimeException:
> org.apache.thrift7.transport.TTransportException:
> java.net.ConnectException: Connection refused
> at
> backtype.storm.security.auth.TBackoffConnect.retryNext(TBackoffConnect.java:59)
> ~[storm-core-0.10.0-beta1.jar:0.10.0-beta1]
>
> I have setup storm cluster with below configurations:-
>
> Storm version:-
>
> Nimbus (ubuntu host):-
> =================
> IP :- 192.168.56.1
>
> Nimbus yaml configuration:-
> ------------------------------------
> storm.local.dir: "/home/iruve/Softwares/storm/data/storm-nimbus"
> #storm.log4j2.conf.dir: "log4j2"
> storm.zookeeper.servers:
>      - "192.168.56.1"
>      - "192.168.56.101"
>      - "192.168.56.102"
> storm.zookeeper.port: 2181
> storm.zookeeper.root: "/storm"
> ...
> ...
> ### nimbus.* configs are for the master
> nimbus.seeds : ["192.168.56.1"]
> nimbus.thrift.port: 6627
> ...
> ...
>
>
> Supervisor (xubuntu installed in virtual box):-
> =================================
> IP :- 192.168.56.101
>
> Supervisor yaml configuration:-
> ---------------------------------------
> storm.local.dir: "/media/sf_Softwares/storm/data/storm-slave-01"
> #storm.log4j2.conf.dir: "log4j2"
> storm.zookeeper.servers:
>      - "192.168.56.1"
>      - "192.168.56.101"
>      - "192.168.56.102"
>
> storm.zookeeper.port: 2181
> storm.zookeeper.root: "/storm"
> ...
> ...
> nimbus.seeds : ["192.168.56.1"]
> nimbus.thrift.port: 6627
> ...
> ...
> supervisor.slots.ports:
>     - 6700
>     - 6701
>     - 6702
>     - 6703
> ...
> ...
>
> Regards,
> Manjunath Anand
>
>