You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by howard chen <ho...@gmail.com> on 2014/04/08 15:27:50 UTC
storm.yml conflict, which one to use?
Hi,
I deployed storm into different machines
a. nimbus
b. ui
c. supervisor
Let say I want to set the "worker.childopts", if my value of this
setting in the nimbus' storm.yml and supervisor storm.yml are
different, which value will storm cluster use?
I ask this because I have seen that in the storm ui, it is showing the
nimbus value instead of the supervisor value, which is quite
unexpected.
Re: storm.yml conflict, which one to use?
Posted by Jason Jackson <ja...@gmail.com>.
The rule of thumb is to use the same storm.yaml file in both nimbus and
supervisors, you won't have any problems with this.
Some of the keys/vals are only read by supervisors e.g. (worker.childopts
as that's the one that launches the worker JVM), and some are only read by
nimbus (nimbus.thrift.port), some are read by both nimbus and supervisors
(zookeeper.servers). But if you follow the rule of thumb you won't need to
think about this.
On Tue, Apr 8, 2014 at 7:41 AM, David Crossland <da...@elastacloud.com>wrote:
> In that sense then fair enough, as you are only running UI in one
> location you probably need only configure that parameter on that node.
>
> You mentioned worker.childopts, I assume you have a worker on the same
> node as nimbus then? Even so I would expect this value to be consistent
> across all nodes.
>
> But tbh, you might as well duplicate the same yaml to all nodes, the
> node will ignore any parameters it doesn't need. And the values it does
> use will be consistent across all nodes.
>
> Again I reiterate I probably don't have a clue what I'm talking about.
> To make my life simpler I just duplicated the yaml file to all nodes. This
> stopped me having to manage multiple versions. I like to make things easy
> for myself where possible.....
> D
>
> *From:* howard chen <ho...@gmail.com>
> *Sent:* Tuesday, 8 April 2014 15:12
> *To:* user@storm.incubator.apache.org
>
> Hi
>
> Because it does not make sense to duplicate, for example, ui.childopts
> in supervisor'storm.yaml right?
>
> So I want to know how the storm.yaml is being used, so I can remove
> these duplicates if they are really dummy and not used.
>
> On Tue, Apr 8, 2014 at 9:38 PM, David Crossland <da...@elastacloud.com>
> wrote:
> > To my (rather limited) knowledge storm.yaml should be consistent across
> all
> > locations. It can be overridden in your topology jar.
> >
> > D
> >
> > From: howard chen
> > Sent: Tuesday, 8 April 2014 14:28
> > To: user@storm.incubator.apache.org
> >
> > Hi,
> >
> > I deployed storm into different machines
> >
> > a. nimbus
> > b. ui
> > c. supervisor
> >
> > Let say I want to set the "worker.childopts", if my value of this
> > setting in the nimbus' storm.yml and supervisor storm.yml are
> > different, which value will storm cluster use?
> >
> > I ask this because I have seen that in the storm ui, it is showing the
> > nimbus value instead of the supervisor value, which is quite
> > unexpected.
>
Re: storm.yml conflict, which one to use?
Posted by David Crossland <da...@elastacloud.com>.
In that sense then fair enough, as you are only running UI in one location you probably need only configure that parameter on that node.
You mentioned worker.childopts, I assume you have a worker on the same node as nimbus then? Even so I would expect this value to be consistent across all nodes.
But tbh, you might as well duplicate the same yaml to all nodes, the node will ignore any parameters it doesn't need. And the values it does use will be consistent across all nodes.
Again I reiterate I probably don't have a clue what I'm talking about. To make my life simpler I just duplicated the yaml file to all nodes. This stopped me having to manage multiple versions. I like to make things easy for myself where possible.....
D
From: howard chen<ma...@gmail.com>
Sent: ?Tuesday?, ?8? ?April? ?2014 ?15?:?12
To: user@storm.incubator.apache.org<ma...@storm.incubator.apache.org>
Hi
Because it does not make sense to duplicate, for example, ui.childopts
in supervisor'storm.yaml right?
So I want to know how the storm.yaml is being used, so I can remove
these duplicates if they are really dummy and not used.
On Tue, Apr 8, 2014 at 9:38 PM, David Crossland <da...@elastacloud.com> wrote:
> To my (rather limited) knowledge storm.yaml should be consistent across all
> locations. It can be overridden in your topology jar.
>
> D
>
> From: howard chen
> Sent: Tuesday, 8 April 2014 14:28
> To: user@storm.incubator.apache.org
>
> Hi,
>
> I deployed storm into different machines
>
> a. nimbus
> b. ui
> c. supervisor
>
> Let say I want to set the "worker.childopts", if my value of this
> setting in the nimbus' storm.yml and supervisor storm.yml are
> different, which value will storm cluster use?
>
> I ask this because I have seen that in the storm ui, it is showing the
> nimbus value instead of the supervisor value, which is quite
> unexpected.
Re: storm.yml conflict, which one to use?
Posted by howard chen <ho...@gmail.com>.
Hi
Because it does not make sense to duplicate, for example, ui.childopts
in supervisor'storm.yaml right?
So I want to know how the storm.yaml is being used, so I can remove
these duplicates if they are really dummy and not used.
On Tue, Apr 8, 2014 at 9:38 PM, David Crossland <da...@elastacloud.com> wrote:
> To my (rather limited) knowledge storm.yaml should be consistent across all
> locations. It can be overridden in your topology jar.
>
> D
>
> From: howard chen
> Sent: Tuesday, 8 April 2014 14:28
> To: user@storm.incubator.apache.org
>
> Hi,
>
> I deployed storm into different machines
>
> a. nimbus
> b. ui
> c. supervisor
>
> Let say I want to set the "worker.childopts", if my value of this
> setting in the nimbus' storm.yml and supervisor storm.yml are
> different, which value will storm cluster use?
>
> I ask this because I have seen that in the storm ui, it is showing the
> nimbus value instead of the supervisor value, which is quite
> unexpected.
Re: storm.yml conflict, which one to use?
Posted by David Crossland <da...@elastacloud.com>.
To my (rather limited) knowledge storm.yaml should be consistent across all locations. It can be overridden in your topology jar.
D
From: howard chen<ma...@gmail.com>
Sent: ?Tuesday?, ?8? ?April? ?2014 ?14?:?28
To: user@storm.incubator.apache.org<ma...@storm.incubator.apache.org>
Hi,
I deployed storm into different machines
a. nimbus
b. ui
c. supervisor
Let say I want to set the "worker.childopts", if my value of this
setting in the nimbus' storm.yml and supervisor storm.yml are
different, which value will storm cluster use?
I ask this because I have seen that in the storm ui, it is showing the
nimbus value instead of the supervisor value, which is quite
unexpected.