You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Bilal Al Fartakh <al...@gmail.com> on 2014/04/17 17:46:09 UTC
Storm.yaml
Hey !
I have two servers
the first is where I installed *zookeeper*, and *nimbus *should be run
the second is the *Supervisor *one .
what modification should I do to *Storm.yaml* (nimbus , and supervisor )
so that I can run storm in a cluster mode ?
do I need other configuration to set up this cluster ?
any answer or comment would be appreciable .
--
*Al Fartakh Bilal*
Re: Storm.yaml
Posted by Bilal Al Fartakh <al...@gmail.com>.
finally it works and the supervisor is shown in the Storm UI :
-I modified the /etc/hosts file in each server
-and I stopped the iptables
2014-04-21 14:33 GMT+00:00 Bilal Al Fartakh <al...@gmail.com>:
> logs dir (storm ) are empty in both machines , yes in my nimbus server I
> have these
> 14814 CassandraDaemon
> 19669 Jps
> 29789 core
> 17659 nimbus
> 21083 QuorumPeerMain
>
> the supervisor is stopped automatically in its machine .
> what do you suggest me to do now ?
> (thank you so much @Abhishek and @Peasanna for taking pain on reading my
> message )
>
>
>
> 2014-04-18 18:42 GMT+00:00 Abhishek Bhattacharjee <
> abhishek.bhattacharjee11@gmail.com>:
>
> You can check the logs inside the logs dir. That is from the directory
>> where you are running storm there's a logs dir. Are you sure your zookeeper
>> is running ?? Run jps in the shell and see whether QuorumPeerMain is
>> showing.
>> On Apr 18, 2014 11:31 PM, "Bilal Al Fartakh" <al...@gmail.com>
>> wrote:
>>
>>> sorry for my ignorance , but where I can see this logs ? and I doubt too
>>> that the supervisor couldn't communicate with Zookeeper , what do you
>>> suggest me to do or to check ?
>>>
>>>
>>> 2014-04-18 17:50 GMT+00:00 Prasanna Padmanabhan <pr...@gmail.com>:
>>>
>>>> What do you see in the supervisor logs? I would think your supervisor
>>>> is not able to talk to Zookeeper for registration.
>>>>
>>>>
>>>> On Fri, Apr 18, 2014 at 10:19 AM, Bilal Al Fartakh <
>>>> alfartaj.bilal@gmail.com> wrote:
>>>>
>>>>> I have this in my Storm.yaml (supervisor ):
>>>>> storm.zookeeper.servers:
>>>>> - "88.198.22.226"
>>>>> # - "server2"
>>>>> #
>>>>> nimbus.host: "88.198.22.226"
>>>>> --------------------------------------
>>>>> and same thing in my nimbus :
>>>>> storm.zookeeper.servers:
>>>>> - "localhost"
>>>>> # - "server2"
>>>>> #
>>>>> nimbus.host: "localhost"
>>>>>
>>>>> when I run the supervisor with " nohup ~/src/storm-0.8.1/bin/storm
>>>>> supervisor & "
>>>>> the number of supervisors remains 0 (in UI ) and after a wile a get
>>>>> this message : [1]+ Exit 13 nohup
>>>>> ~/src/storm-0.8.1/bin/storm supervisor
>>>>>
>>>>> I'm lost guys what should I do to maintain the connection between my
>>>>> two servers ?
>>>>>
>>>>>
>>>>
>>>
>>>
>>> --
>>> *Al Fartakh Bilal*
>>>
>>
>
>
> --
> *Al Fartakh Bilal*
>
--
*Al Fartakh Bilal*
Re: Storm.yaml
Posted by Bilal Al Fartakh <al...@gmail.com>.
logs dir (storm ) are empty in both machines , yes in my nimbus server I
have these
14814 CassandraDaemon
19669 Jps
29789 core
17659 nimbus
21083 QuorumPeerMain
the supervisor is stopped automatically in its machine .
what do you suggest me to do now ?
(thank you so much @Abhishek and @Peasanna for taking pain on reading my
message )
2014-04-18 18:42 GMT+00:00 Abhishek Bhattacharjee <
abhishek.bhattacharjee11@gmail.com>:
> You can check the logs inside the logs dir. That is from the directory
> where you are running storm there's a logs dir. Are you sure your zookeeper
> is running ?? Run jps in the shell and see whether QuorumPeerMain is
> showing.
> On Apr 18, 2014 11:31 PM, "Bilal Al Fartakh" <al...@gmail.com>
> wrote:
>
>> sorry for my ignorance , but where I can see this logs ? and I doubt too
>> that the supervisor couldn't communicate with Zookeeper , what do you
>> suggest me to do or to check ?
>>
>>
>> 2014-04-18 17:50 GMT+00:00 Prasanna Padmanabhan <pr...@gmail.com>:
>>
>>> What do you see in the supervisor logs? I would think your supervisor is
>>> not able to talk to Zookeeper for registration.
>>>
>>>
>>> On Fri, Apr 18, 2014 at 10:19 AM, Bilal Al Fartakh <
>>> alfartaj.bilal@gmail.com> wrote:
>>>
>>>> I have this in my Storm.yaml (supervisor ):
>>>> storm.zookeeper.servers:
>>>> - "88.198.22.226"
>>>> # - "server2"
>>>> #
>>>> nimbus.host: "88.198.22.226"
>>>> --------------------------------------
>>>> and same thing in my nimbus :
>>>> storm.zookeeper.servers:
>>>> - "localhost"
>>>> # - "server2"
>>>> #
>>>> nimbus.host: "localhost"
>>>>
>>>> when I run the supervisor with " nohup ~/src/storm-0.8.1/bin/storm
>>>> supervisor & "
>>>> the number of supervisors remains 0 (in UI ) and after a wile a get
>>>> this message : [1]+ Exit 13 nohup
>>>> ~/src/storm-0.8.1/bin/storm supervisor
>>>>
>>>> I'm lost guys what should I do to maintain the connection between my
>>>> two servers ?
>>>>
>>>>
>>>
>>
>>
>> --
>> *Al Fartakh Bilal*
>>
>
--
*Al Fartakh Bilal*
Re: Storm.yaml
Posted by Abhishek Bhattacharjee <ab...@gmail.com>.
You can check the logs inside the logs dir. That is from the directory
where you are running storm there's a logs dir. Are you sure your zookeeper
is running ?? Run jps in the shell and see whether QuorumPeerMain is
showing.
On Apr 18, 2014 11:31 PM, "Bilal Al Fartakh" <al...@gmail.com>
wrote:
> sorry for my ignorance , but where I can see this logs ? and I doubt too
> that the supervisor couldn't communicate with Zookeeper , what do you
> suggest me to do or to check ?
>
>
> 2014-04-18 17:50 GMT+00:00 Prasanna Padmanabhan <pr...@gmail.com>:
>
>> What do you see in the supervisor logs? I would think your supervisor is
>> not able to talk to Zookeeper for registration.
>>
>>
>> On Fri, Apr 18, 2014 at 10:19 AM, Bilal Al Fartakh <
>> alfartaj.bilal@gmail.com> wrote:
>>
>>> I have this in my Storm.yaml (supervisor ):
>>> storm.zookeeper.servers:
>>> - "88.198.22.226"
>>> # - "server2"
>>> #
>>> nimbus.host: "88.198.22.226"
>>> --------------------------------------
>>> and same thing in my nimbus :
>>> storm.zookeeper.servers:
>>> - "localhost"
>>> # - "server2"
>>> #
>>> nimbus.host: "localhost"
>>>
>>> when I run the supervisor with " nohup ~/src/storm-0.8.1/bin/storm
>>> supervisor & "
>>> the number of supervisors remains 0 (in UI ) and after a wile a get this
>>> message : [1]+ Exit 13 nohup ~/src/storm-0.8.1/bin/storm
>>> supervisor
>>>
>>> I'm lost guys what should I do to maintain the connection between my two
>>> servers ?
>>>
>>>
>>
>
>
> --
> *Al Fartakh Bilal*
>
Re: Storm.yaml
Posted by Bilal Al Fartakh <al...@gmail.com>.
sorry for my ignorance , but where I can see this logs ? and I doubt too
that the supervisor couldn't communicate with Zookeeper , what do you
suggest me to do or to check ?
2014-04-18 17:50 GMT+00:00 Prasanna Padmanabhan <pr...@gmail.com>:
> What do you see in the supervisor logs? I would think your supervisor is
> not able to talk to Zookeeper for registration.
>
>
> On Fri, Apr 18, 2014 at 10:19 AM, Bilal Al Fartakh <
> alfartaj.bilal@gmail.com> wrote:
>
>> I have this in my Storm.yaml (supervisor ):
>> storm.zookeeper.servers:
>> - "88.198.22.226"
>> # - "server2"
>> #
>> nimbus.host: "88.198.22.226"
>> --------------------------------------
>> and same thing in my nimbus :
>> storm.zookeeper.servers:
>> - "localhost"
>> # - "server2"
>> #
>> nimbus.host: "localhost"
>>
>> when I run the supervisor with " nohup ~/src/storm-0.8.1/bin/storm
>> supervisor & "
>> the number of supervisors remains 0 (in UI ) and after a wile a get this
>> message : [1]+ Exit 13 nohup ~/src/storm-0.8.1/bin/storm
>> supervisor
>>
>> I'm lost guys what should I do to maintain the connection between my two
>> servers ?
>>
>>
>
--
*Al Fartakh Bilal*
Re: Storm.yaml
Posted by Prasanna Padmanabhan <pr...@gmail.com>.
What do you see in the supervisor logs? I would think your supervisor is
not able to talk to Zookeeper for registration.
On Fri, Apr 18, 2014 at 10:19 AM, Bilal Al Fartakh <alfartaj.bilal@gmail.com
> wrote:
> I have this in my Storm.yaml (supervisor ):
> storm.zookeeper.servers:
> - "88.198.22.226"
> # - "server2"
> #
> nimbus.host: "88.198.22.226"
> --------------------------------------
> and same thing in my nimbus :
> storm.zookeeper.servers:
> - "localhost"
> # - "server2"
> #
> nimbus.host: "localhost"
>
> when I run the supervisor with " nohup ~/src/storm-0.8.1/bin/storm
> supervisor & "
> the number of supervisors remains 0 (in UI ) and after a wile a get this
> message : [1]+ Exit 13 nohup ~/src/storm-0.8.1/bin/storm
> supervisor
>
> I'm lost guys what should I do to maintain the connection between my two
> servers ?
>
>
Re: Storm.yaml
Posted by Bilal Al Fartakh <al...@gmail.com>.
I have this in my Storm.yaml (supervisor ):
storm.zookeeper.servers:
- "88.198.22.226"
# - "server2"
#
nimbus.host: "88.198.22.226"
--------------------------------------
and same thing in my nimbus :
storm.zookeeper.servers:
- "localhost"
# - "server2"
#
nimbus.host: "localhost"
when I run the supervisor with " nohup ~/src/storm-0.8.1/bin/storm
supervisor & "
the number of supervisors remains 0 (in UI ) and after a wile a get this
message : [1]+ Exit 13 nohup ~/src/storm-0.8.1/bin/storm
supervisor
I'm lost guys what should I do to maintain the connection between my two
servers ?
Re: Storm.yaml
Posted by Abhishek Bhattacharjee <ab...@gmail.com>.
It should be present at both machines. ie both nimbus and supervisor
On Thu, Apr 17, 2014 at 10:05 PM, Bilal Al Fartakh <alfartaj.bilal@gmail.com
> wrote:
> Thanks Prasanna , but one more question where should I add this in the
> nimbus machine or in the supervisor ?
>
>
> 2014-04-17 15:51 GMT+00:00 Prasanna Padmanabhan <pr...@gmail.com>:
>
> At the least, set the values for the following attributes:
>>
>> storm.zookeeper.servers:
>> - "ZOOKER_HOST"
>> nimbus.host: "NIMBUS_HOST"
>> storm.local.dir: "DIR"
>> supervisor.slots.ports:
>> - 6700
>> - 6701
>> - 6702
>> - 6703
>> . . .
>>
>> The default values are specified here:
>> https://github.com/nathanmarz/storm/blob/master/conf/defaults.yaml
>>
>>
>> On Thu, Apr 17, 2014 at 8:46 AM, Bilal Al Fartakh <
>> alfartaj.bilal@gmail.com> wrote:
>>
>>> Hey !
>>> I have two servers
>>> the first is where I installed *zookeeper*, and *nimbus *should be run
>>> the second is the *Supervisor *one .
>>> what modification should I do to *Storm.yaml* (nimbus , and supervisor
>>> ) so that I can run storm in a cluster mode ?
>>> do I need other configuration to set up this cluster ?
>>> any answer or comment would be appreciable .
>>>
>>>
>>> --
>>> *Al Fartakh Bilal*
>>>
>>
>>
>
>
> --
> *Al Fartakh Bilal*
>
--
*Abhishek Bhattacharjee*
*Pune Institute of Computer Technology*
Re: Storm.yaml
Posted by Bilal Al Fartakh <al...@gmail.com>.
Thanks Prasanna , but one more question where should I add this in the
nimbus machine or in the supervisor ?
2014-04-17 15:51 GMT+00:00 Prasanna Padmanabhan <pr...@gmail.com>:
> At the least, set the values for the following attributes:
>
> storm.zookeeper.servers:
> - "ZOOKER_HOST"
> nimbus.host: "NIMBUS_HOST"
> storm.local.dir: "DIR"
> supervisor.slots.ports:
> - 6700
> - 6701
> - 6702
> - 6703
> . . .
>
> The default values are specified here:
> https://github.com/nathanmarz/storm/blob/master/conf/defaults.yaml
>
>
> On Thu, Apr 17, 2014 at 8:46 AM, Bilal Al Fartakh <
> alfartaj.bilal@gmail.com> wrote:
>
>> Hey !
>> I have two servers
>> the first is where I installed *zookeeper*, and *nimbus *should be run
>> the second is the *Supervisor *one .
>> what modification should I do to *Storm.yaml* (nimbus , and supervisor )
>> so that I can run storm in a cluster mode ?
>> do I need other configuration to set up this cluster ?
>> any answer or comment would be appreciable .
>>
>>
>> --
>> *Al Fartakh Bilal*
>>
>
>
--
*Al Fartakh Bilal*
Re: Storm.yaml
Posted by Prasanna Padmanabhan <pr...@gmail.com>.
At the least, set the values for the following attributes:
storm.zookeeper.servers:
- "ZOOKER_HOST"
nimbus.host: "NIMBUS_HOST"
storm.local.dir: "DIR"
supervisor.slots.ports:
- 6700
- 6701
- 6702
- 6703
. . .
The default values are specified here:
https://github.com/nathanmarz/storm/blob/master/conf/defaults.yaml
On Thu, Apr 17, 2014 at 8:46 AM, Bilal Al Fartakh
<al...@gmail.com>wrote:
> Hey !
> I have two servers
> the first is where I installed *zookeeper*, and *nimbus *should be run
> the second is the *Supervisor *one .
> what modification should I do to *Storm.yaml* (nimbus , and supervisor )
> so that I can run storm in a cluster mode ?
> do I need other configuration to set up this cluster ?
> any answer or comment would be appreciable .
>
>
> --
> *Al Fartakh Bilal*
>