You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@storm.apache.org by Tim Molter <ti...@gmail.com> on 2015/06/18 12:42:58 UTC
Newbie questions about deploying to cluster
1) Let's say I have 4 machines. One running zookeeper, one running
nimbus, and 2 running supervisor. Which host do I deploy the my topology
via `storm jar`? The nimbus host?
2) Can I run zookeeper, nimbus and manager all on one machine? Or is it
critical to separate certain ones on separate hosts?
Re: Newbie questions about deploying to cluster
Posted by Harsha <st...@harsha.io>.
Tim,
If its production cluster I highly recommend having zk cluster
with at least 3 nodes. So that your cluster survives in case of
zk nodes going down.
Thanks,
Harsha
On Thu, Jun 18, 2015, at 06:07 AM, Paul Poulosky wrote:
> The machine that you submit your topology from can be any of the machines
> running daemons, or you can set up a machine that has storm installed but
> no daemons running and submit your topology from there. All you need to
> do is make sure that all machines with storm installed, whether they are
> running daemons or not, have nimbus.host set to point to the machine
> where the nimbus daemon is running.
>
>
>
> On Thursday, June 18, 2015 6:58 AM, Matthias J. Sax
> <mj...@informatik.hu-berlin.de> wrote:
>
>
> Sure.
>
> On 06/18/2015 12:55 PM, Tim Molter wrote:
> > Thank you, Matthias.
> >
> > Can I run nimbus and a supervisor on one machine as well (assuming
> > low-load)?
> >
> > Thanks.
> >
> > On 2015_06_18 12:45 PM, Matthias J. Sax wrote:
> >> 1) yes. nimbus.
> >>
> >> 2) running zookeeper and nimbus on the same machine should not be a
> >> problem in general. if you have a high-load scenario this might become a
> >> problem (but it should be ok in most cases). If you have an increased
> >> fault-tolerance requirement, it is also critical to run on different
> >> machines (but again, it should be not required for most cases)
> >>
> >> -Matthias
> >>
> >>
> >> On 06/18/2015 12:42 PM, Tim Molter wrote:
> >>> 1) Let's say I have 4 machines. One running zookeeper, one running
> >>> nimbus, and 2 running supervisor. Which host do I deploy the my topology
> >>> via `storm jar`? The nimbus host?
> >>>
> >>> 2) Can I run zookeeper, nimbus and manager all on one machine? Or is it
> >>> critical to separate certain ones on separate hosts?
> >>>
> >>
> >
>
>
>
Re: Newbie questions about deploying to cluster
Posted by Paul Poulosky <pp...@yahoo-inc.com.INVALID>.
The machine that you submit your topology from can be any of the machines running daemons, or you can set up a machine that has storm installed but no daemons running and submit your topology from there. All you need to do is make sure that all machines with storm installed, whether they are running daemons or not, have nimbus.host set to point to the machine where the nimbus daemon is running.
On Thursday, June 18, 2015 6:58 AM, Matthias J. Sax <mj...@informatik.hu-berlin.de> wrote:
Sure.
On 06/18/2015 12:55 PM, Tim Molter wrote:
> Thank you, Matthias.
>
> Can I run nimbus and a supervisor on one machine as well (assuming
> low-load)?
>
> Thanks.
>
> On 2015_06_18 12:45 PM, Matthias J. Sax wrote:
>> 1) yes. nimbus.
>>
>> 2) running zookeeper and nimbus on the same machine should not be a
>> problem in general. if you have a high-load scenario this might become a
>> problem (but it should be ok in most cases). If you have an increased
>> fault-tolerance requirement, it is also critical to run on different
>> machines (but again, it should be not required for most cases)
>>
>> -Matthias
>>
>>
>> On 06/18/2015 12:42 PM, Tim Molter wrote:
>>> 1) Let's say I have 4 machines. One running zookeeper, one running
>>> nimbus, and 2 running supervisor. Which host do I deploy the my topology
>>> via `storm jar`? The nimbus host?
>>>
>>> 2) Can I run zookeeper, nimbus and manager all on one machine? Or is it
>>> critical to separate certain ones on separate hosts?
>>>
>>
>
Re: Newbie questions about deploying to cluster
Posted by "Matthias J. Sax" <mj...@informatik.hu-berlin.de>.
Sure.
On 06/18/2015 12:55 PM, Tim Molter wrote:
> Thank you, Matthias.
>
> Can I run nimbus and a supervisor on one machine as well (assuming
> low-load)?
>
> Thanks.
>
> On 2015_06_18 12:45 PM, Matthias J. Sax wrote:
>> 1) yes. nimbus.
>>
>> 2) running zookeeper and nimbus on the same machine should not be a
>> problem in general. if you have a high-load scenario this might become a
>> problem (but it should be ok in most cases). If you have an increased
>> fault-tolerance requirement, it is also critical to run on different
>> machines (but again, it should be not required for most cases)
>>
>> -Matthias
>>
>>
>> On 06/18/2015 12:42 PM, Tim Molter wrote:
>>> 1) Let's say I have 4 machines. One running zookeeper, one running
>>> nimbus, and 2 running supervisor. Which host do I deploy the my topology
>>> via `storm jar`? The nimbus host?
>>>
>>> 2) Can I run zookeeper, nimbus and manager all on one machine? Or is it
>>> critical to separate certain ones on separate hosts?
>>>
>>
>
Re: Newbie questions about deploying to cluster
Posted by Tim Molter <ti...@gmail.com>.
Thank you, Matthias.
Can I run nimbus and a supervisor on one machine as well (assuming
low-load)?
Thanks.
On 2015_06_18 12:45 PM, Matthias J. Sax wrote:
> 1) yes. nimbus.
>
> 2) running zookeeper and nimbus on the same machine should not be a
> problem in general. if you have a high-load scenario this might become a
> problem (but it should be ok in most cases). If you have an increased
> fault-tolerance requirement, it is also critical to run on different
> machines (but again, it should be not required for most cases)
>
> -Matthias
>
>
> On 06/18/2015 12:42 PM, Tim Molter wrote:
>> 1) Let's say I have 4 machines. One running zookeeper, one running
>> nimbus, and 2 running supervisor. Which host do I deploy the my topology
>> via `storm jar`? The nimbus host?
>>
>> 2) Can I run zookeeper, nimbus and manager all on one machine? Or is it
>> critical to separate certain ones on separate hosts?
>>
>
Re: Newbie questions about deploying to cluster
Posted by "Matthias J. Sax" <mj...@informatik.hu-berlin.de>.
1) yes. nimbus.
2) running zookeeper and nimbus on the same machine should not be a
problem in general. if you have a high-load scenario this might become a
problem (but it should be ok in most cases). If you have an increased
fault-tolerance requirement, it is also critical to run on different
machines (but again, it should be not required for most cases)
-Matthias
On 06/18/2015 12:42 PM, Tim Molter wrote:
> 1) Let's say I have 4 machines. One running zookeeper, one running
> nimbus, and 2 running supervisor. Which host do I deploy the my topology
> via `storm jar`? The nimbus host?
>
> 2) Can I run zookeeper, nimbus and manager all on one machine? Or is it
> critical to separate certain ones on separate hosts?
>