You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Sridhar G <Sr...@microland.com> on 2014/10/08 08:55:36 UTC

How to increase supervisor slots in apache storm 0.9.2

Hi All,

 

We are unable to increase the number of supervisor slots . We tried to
add following lines in storm.yaml file but did not work. Please suggest
us .

 

supervisor.slots.ports:

    - 6700

    - 6701

    - 6702

    - 6703

    - 6704

    - 6705

    - 6706

 

Regards,

Sridhar

Believe in the impossible and remove the improbable

 

The information contained in this transmission may contain privileged and confidential information of Microland Limited, including information protected by privacy laws. It is intended only for the use of Microland Limited. If you are not the intended recipient, you are hereby notified that any review, dissemination, distribution, or duplication of this communication is strictly prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. Although Microland has taken reasonable precautions to ensure no viruses are present in this email, Microland cannot accept responsibility for any loss or damage arising from the use of this email or attachments. Computer viruses can be transmitted via email. Recipient should check the email and any attachments for the presence of viruses before using them. Any views or opinions are solely those of the author and do not necessarily represent those of Microland. 



This email may be monitored.

Re: How to increase supervisor slots in apache storm 0.9.2

Posted by Jan Sipke van der Veen <ja...@gmail.com>.
Hello Sridhar,

I think adding that to your storm.yaml should suffice. Have you restarted
the supervisor afterwards? How much memory does your machine have? Each
slot is essentially a new Java virtual machine which takes up memory.

Best regards,
Jan Sipke van der Veen
On Oct 8, 2014 8:56 AM, "Sridhar G" <Sr...@microland.com> wrote:

> Hi All,
>
>
>
> We are unable to increase the number of supervisor slots . We tried to add
> following lines in storm.yaml file but did not work. Please suggest us .
>
>
>
> supervisor.slots.ports:
>
>     - 6700
>
>     - 6701
>
>     - 6702
>
>     - 6703
>
>     - 6704
>
>     - 6705
>
>     - 6706
>
>
>
> Regards,
>
> Sridhar
>
> *Believe in the impossible and remove the improbable*
>
>
>
> The information contained in this transmission may contain privileged and
> confidential information of Microland Limited, including information
> protected by privacy laws. It is intended only for the use of Microland
> Limited. If you are not the intended recipient, you are hereby notified
> that any review, dissemination, distribution, or duplication of this
> communication is strictly prohibited. If you are not the intended
> recipient, please contact the sender by reply email and destroy all copies
> of the original message. Although Microland has taken reasonable
> precautions to ensure no viruses are present in this email, Microland
> cannot accept responsibility for any loss or damage arising from the use of
> this email or attachments. Computer viruses can be transmitted via email.
> Recipient should check the email and any attachments for the presence of
> viruses before using them. Any views or opinions are solely those of the
> author and do not necessarily represent those of Microland.
>
>
> This email may be monitored.
>

RE: How to increase supervisor slots in apache storm 0.9.2

Posted by Sridhar G <Sr...@microland.com>.
I get following error when do storm rebalance 

 

 

Exception in thread "main" java.lang.IllegalArgumentException: Field
supervisor.slots.ports must be an Iterable of java.lang.Number

        at
backtype.storm.ConfigValidation$1.validateField(ConfigValidation.java:63
)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.jav
a:57)

        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessor
Impl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:606)

        at
clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93)

        at
clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28)

        at
backtype.storm.config$validate_configs_with_schemas.invoke(config.clj:11
7)

        at
backtype.storm.config$read_storm_config.invoke(config.clj:122)

        at
backtype.storm.command.rebalance$_main.doInvoke(rebalance.clj:43)

        at clojure.lang.RestFn.invoke(RestFn.java:397)

        at clojure.lang.AFn.applyToHelper(AFn.java:159)

        at clojure.lang.RestFn.applyTo(RestFn.java:132)

        at backtype.storm.command.rebalance.main(Unknown Source)

 

Regards,

Sridhar

Believe in the impossible and remove the improbable

 

From: Yuri Kostin [mailto:kostine@gmail.com] 
Sent: Wednesday, October 8, 2014 12:42 PM
To: user@storm.apache.org
Subject: Re: How to increase supervisor slots in apache storm 0.9.2

 

You might have an extra characters there, spaces, tabs, etc. Try
http://yamllint.com

 

On Oct 8, 2014, at 2:06 AM, Sridhar G <Sr...@microland.com> wrote:





Hi All,

 

Getting following error :

 

in 'reader', line 41, column 1:

    supervisor.slots.ports:

    ^

 

        at
org.yaml.snakeyaml.parser.ParserImpl$ParseDocumentStart.produce(ParserIm
pl.java:225)

        at
org.yaml.snakeyaml.parser.ParserImpl.peekEvent(ParserImpl.java:158)

        at
org.yaml.snakeyaml.parser.ParserImpl.checkEvent(ParserImpl.java:143)

        at
org.yaml.snakeyaml.composer.Composer.getSingleNode(Composer.java:108)

        at
org.yaml.snakeyaml.constructor.BaseConstructor.getSingleData(BaseConstru
ctor.java:120)

        at org.yaml.snakeyaml.Yaml.loadFromReader(Yaml.java:481)

        at org.yaml.snakeyaml.Yaml.load(Yaml.java:424)

        at
backtype.storm.utils.Utils.findAndReadConfigFile(Utils.java:148)

        at backtype.storm.utils.Utils.readStormConfig(Utils.java:195)

        at
backtype.storm.config$read_storm_config.invoke(config.clj:121)

        at
backtype.storm.command.config_value$_main.invoke(config_value.clj:22)

        at clojure.lang.AFn.applyToHelper(AFn.java:161)

        at clojure.lang.AFn.applyTo(AFn.java:151)

        at backtype.storm.command.config_value.main(Unknown Source)
Exception in thread "main" expected '<document start>', but found
BlockMappingStart

in 'reader', line 41, column 1:

    supervisor.slots.ports:

    ^

 

        at
org.yaml.snakeyaml.parser.ParserImpl$ParseDocumentStart.produce(ParserIm
pl.java:225)

        at
org.yaml.snakeyaml.parser.ParserImpl.peekEvent(ParserImpl.java:158)

        at
org.yaml.snakeyaml.parser.ParserImpl.checkEvent(ParserImpl.java:143)

        at
org.yaml.snakeyaml.composer.Composer.getSingleNode(Composer.java:108)

        at
org.yaml.snakeyaml.constructor.BaseConstructor.getSingleData(BaseConstru
ctor.java:120)

        at org.yaml.snakeyaml.Yaml.loadFromReader(Yaml.java:481)

        at org.yaml.snakeyaml.Yaml.load(Yaml.java:424)

        at
backtype.storm.utils.Utils.findAndReadConfigFile(Utils.java:148)

        at backtype.storm.utils.Utils.readStormConfig(Utils.java:195)

        at
backtype.storm.config$read_storm_config.invoke(config.clj:121)

        at
backtype.storm.command.config_value$_main.invoke(config_value.clj:22)

        at clojure.lang.AFn.applyToHelper(AFn.java:161)

        at clojure.lang.AFn.applyTo(AFn.java:151)

        at backtype.storm.command.config_value.main(Unknown Source)

 

Regards,

Sridhar

Believe in the impossible and remove the improbable

 

From: Dima Dragan [mailto:dima.dragan@belleron.net] 
Sent: Wednesday, October 8, 2014 12:36 PM
To: user@storm.apache.org
Subject: Re: How to increase supervisor slots in apache storm 0.9.2

 

Hi Sridhar,

I think you should make rebalancing after changing storm.yaml.

Check please:
http://www.michael-noll.com/tutorials/running-multi-node-storm-cluster/#
add-another-worker-node
<http://www.michael-noll.com/tutorials/running-multi-node-storm-cluster/
#add-another-worker-node> 

Best regards,
Dmytro Dragan

On Oct 8, 2014 9:56 AM, "Sridhar G" <SridharG@microland.com
<ma...@microland.com> > wrote:

Hi All,

 

We are unable to increase the number of supervisor slots . We tried to
add following lines in storm.yaml file but did not work. Please suggest
us .

 

supervisor.slots.ports:

    - 6700

    - 6701

    - 6702

    - 6703

    - 6704

    - 6705

    - 6706

 

Regards,

Sridhar

Believe in the impossible and remove the improbable

 

The information contained in this transmission may contain privileged
and confidential information of Microland Limited, including information
protected by privacy laws. It is intended only for the use of Microland
Limited. If you are not the intended recipient, you are hereby notified
that any review, dissemination, distribution, or duplication of this
communication is strictly prohibited. If you are not the intended
recipient, please contact the sender by reply email and destroy all
copies of the original message. Although Microland has taken reasonable
precautions to ensure no viruses are present in this email, Microland
cannot accept responsibility for any loss or damage arising from the use
of this email or attachments. Computer viruses can be transmitted via
email. Recipient should check the email and any attachments for the
presence of viruses before using them. Any views or opinions are solely
those of the author and do not necessarily represent those of Microland.


 

This email may be monitored.

Re: How to increase supervisor slots in apache storm 0.9.2

Posted by Yuri Kostin <ko...@gmail.com>.
You might have an extra characters there, spaces, tabs, etc. Try http://yamllint.com

On Oct 8, 2014, at 2:06 AM, Sridhar G <Sr...@microland.com> wrote:

> Hi All,
>  
> Getting following error :
>  
> in 'reader', line 41, column 1:
>     supervisor.slots.ports:
>     ^
>  
>         at org.yaml.snakeyaml.parser.ParserImpl$ParseDocumentStart.produce(ParserImpl.java:225)
>         at org.yaml.snakeyaml.parser.ParserImpl.peekEvent(ParserImpl.java:158)
>         at org.yaml.snakeyaml.parser.ParserImpl.checkEvent(ParserImpl.java:143)
>         at org.yaml.snakeyaml.composer.Composer.getSingleNode(Composer.java:108)
>         at org.yaml.snakeyaml.constructor.BaseConstructor.getSingleData(BaseConstructor.java:120)
>         at org.yaml.snakeyaml.Yaml.loadFromReader(Yaml.java:481)
>         at org.yaml.snakeyaml.Yaml.load(Yaml.java:424)
>         at backtype.storm.utils.Utils.findAndReadConfigFile(Utils.java:148)
>         at backtype.storm.utils.Utils.readStormConfig(Utils.java:195)
>         at backtype.storm.config$read_storm_config.invoke(config.clj:121)
>         at backtype.storm.command.config_value$_main.invoke(config_value.clj:22)
>         at clojure.lang.AFn.applyToHelper(AFn.java:161)
>         at clojure.lang.AFn.applyTo(AFn.java:151)
>         at backtype.storm.command.config_value.main(Unknown Source)                                                                Exception in thread "main" expected '<document start>', but found BlockMappingStart
> in 'reader', line 41, column 1:
>     supervisor.slots.ports:
>     ^
>  
>         at org.yaml.snakeyaml.parser.ParserImpl$ParseDocumentStart.produce(ParserImpl.java:225)
>         at org.yaml.snakeyaml.parser.ParserImpl.peekEvent(ParserImpl.java:158)
>         at org.yaml.snakeyaml.parser.ParserImpl.checkEvent(ParserImpl.java:143)
>         at org.yaml.snakeyaml.composer.Composer.getSingleNode(Composer.java:108)
>         at org.yaml.snakeyaml.constructor.BaseConstructor.getSingleData(BaseConstructor.java:120)
>         at org.yaml.snakeyaml.Yaml.loadFromReader(Yaml.java:481)
>         at org.yaml.snakeyaml.Yaml.load(Yaml.java:424)
>         at backtype.storm.utils.Utils.findAndReadConfigFile(Utils.java:148)
>         at backtype.storm.utils.Utils.readStormConfig(Utils.java:195)
>         at backtype.storm.config$read_storm_config.invoke(config.clj:121)
>         at backtype.storm.command.config_value$_main.invoke(config_value.clj:22)
>         at clojure.lang.AFn.applyToHelper(AFn.java:161)
>         at clojure.lang.AFn.applyTo(AFn.java:151)
>         at backtype.storm.command.config_value.main(Unknown Source)
>  
> Regards,
> Sridhar
> Believe in the impossible and remove the improbable
>  
> From: Dima Dragan [mailto:dima.dragan@belleron.net] 
> Sent: Wednesday, October 8, 2014 12:36 PM
> To: user@storm.apache.org
> Subject: Re: How to increase supervisor slots in apache storm 0.9.2
>  
> Hi Sridhar,
> 
> I think you should make rebalancing after changing storm.yaml.
> 
> Check please:
> http://www.michael-noll.com/tutorials/running-multi-node-storm-cluster/#add-another-worker-node
> 
> Best regards,
> Dmytro Dragan
> 
> On Oct 8, 2014 9:56 AM, "Sridhar G" <Sr...@microland.com> wrote:
> Hi All,
>  
> We are unable to increase the number of supervisor slots . We tried to add following lines in storm.yaml file but did not work. Please suggest us .
>  
> supervisor.slots.ports:
>     - 6700
>     - 6701
>     - 6702
>     - 6703
>     - 6704
>     - 6705
>     - 6706
>  
> Regards,
> Sridhar
> Believe in the impossible and remove the improbable
>  
> The information contained in this transmission may contain privileged and confidential information of Microland Limited, including information protected by privacy laws. It is intended only for the use of Microland Limited. If you are not the intended recipient, you are hereby notified that any review, dissemination, distribution, or duplication of this communication is strictly prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. Although Microland has taken reasonable precautions to ensure no viruses are present in this email, Microland cannot accept responsibility for any loss or damage arising from the use of this email or attachments. Computer viruses can be transmitted via email. Recipient should check the email and any attachments for the presence of viruses before using them. Any views or opinions are solely those of the author and do not necessarily represent those of Microland. 
> 
>  
> 
> This email may be monitored.
>

RE: How to increase supervisor slots in apache storm 0.9.2

Posted by Sridhar G <Sr...@microland.com>.
Hi All,

 

Getting following error :

 

in 'reader', line 41, column 1:

    supervisor.slots.ports:

    ^

 

        at org.yaml.snakeyaml.parser.ParserImpl$ParseDocumentStart.produce(ParserImpl.java:225)

        at org.yaml.snakeyaml.parser.ParserImpl.peekEvent(ParserImpl.java:158)

        at org.yaml.snakeyaml.parser.ParserImpl.checkEvent(ParserImpl.java:143)

        at org.yaml.snakeyaml.composer.Composer.getSingleNode(Composer.java:108)

        at org.yaml.snakeyaml.constructor.BaseConstructor.getSingleData(BaseConstructor.java:120)

        at org.yaml.snakeyaml.Yaml.loadFromReader(Yaml.java:481)

        at org.yaml.snakeyaml.Yaml.load(Yaml.java:424)

        at backtype.storm.utils.Utils.findAndReadConfigFile(Utils.java:148)

        at backtype.storm.utils.Utils.readStormConfig(Utils.java:195)

        at backtype.storm.config$read_storm_config.invoke(config.clj:121)

        at backtype.storm.command.config_value$_main.invoke(config_value.clj:22)

        at clojure.lang.AFn.applyToHelper(AFn.java:161)

        at clojure.lang.AFn.applyTo(AFn.java:151)

        at backtype.storm.command.config_value.main(Unknown Source)                                                                Exception in thread "main" expected '<document start>', but found BlockMappingStart

in 'reader', line 41, column 1:

    supervisor.slots.ports:

    ^

 

        at org.yaml.snakeyaml.parser.ParserImpl$ParseDocumentStart.produce(ParserImpl.java:225)

        at org.yaml.snakeyaml.parser.ParserImpl.peekEvent(ParserImpl.java:158)

        at org.yaml.snakeyaml.parser.ParserImpl.checkEvent(ParserImpl.java:143)

        at org.yaml.snakeyaml.composer.Composer.getSingleNode(Composer.java:108)

        at org.yaml.snakeyaml.constructor.BaseConstructor.getSingleData(BaseConstructor.java:120)

        at org.yaml.snakeyaml.Yaml.loadFromReader(Yaml.java:481)

        at org.yaml.snakeyaml.Yaml.load(Yaml.java:424)

        at backtype.storm.utils.Utils.findAndReadConfigFile(Utils.java:148)

        at backtype.storm.utils.Utils.readStormConfig(Utils.java:195)

        at backtype.storm.config$read_storm_config.invoke(config.clj:121)

        at backtype.storm.command.config_value$_main.invoke(config_value.clj:22)

        at clojure.lang.AFn.applyToHelper(AFn.java:161)

        at clojure.lang.AFn.applyTo(AFn.java:151)

        at backtype.storm.command.config_value.main(Unknown Source)

 

Regards,

Sridhar

Believe in the impossible and remove the improbable

 

From: Dima Dragan [mailto:dima.dragan@belleron.net] 
Sent: Wednesday, October 8, 2014 12:36 PM
To: user@storm.apache.org
Subject: Re: How to increase supervisor slots in apache storm 0.9.2

 

Hi Sridhar,

I think you should make rebalancing after changing storm.yaml.

Check please:
http://www.michael-noll.com/tutorials/running-multi-node-storm-cluster/#add-another-worker-node

Best regards,
Dmytro Dragan

On Oct 8, 2014 9:56 AM, "Sridhar G" <Sr...@microland.com> wrote:

Hi All,

 

We are unable to increase the number of supervisor slots . We tried to add following lines in storm.yaml file but did not work. Please suggest us .

 

supervisor.slots.ports:

    - 6700

    - 6701

    - 6702

    - 6703

    - 6704

    - 6705

    - 6706

 

Regards,

Sridhar

Believe in the impossible and remove the improbable

 

The information contained in this transmission may contain privileged and confidential information of Microland Limited, including information protected by privacy laws. It is intended only for the use of Microland Limited. If you are not the intended recipient, you are hereby notified that any review, dissemination, distribution, or duplication of this communication is strictly prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. Although Microland has taken reasonable precautions to ensure no viruses are present in this email, Microland cannot accept responsibility for any loss or damage arising from the use of this email or attachments. Computer viruses can be transmitted via email. Recipient should check the email and any attachments for the presence of viruses before using them. Any views or opinions are solely those of the author and do not necessarily represent those of Microland. 

 

This email may be monitored.

Re: How to increase supervisor slots in apache storm 0.9.2

Posted by Dima Dragan <di...@belleron.net>.
Hi Sridhar,

I think you should make rebalancing after changing storm.yaml.

Check please:
http://www.michael-noll.com/tutorials/running-multi-node-storm-cluster/#add-another-worker-node

Best regards,
Dmytro Dragan
On Oct 8, 2014 9:56 AM, "Sridhar G" <Sr...@microland.com> wrote:

> Hi All,
>
>
>
> We are unable to increase the number of supervisor slots . We tried to add
> following lines in storm.yaml file but did not work. Please suggest us .
>
>
>
> supervisor.slots.ports:
>
>     - 6700
>
>     - 6701
>
>     - 6702
>
>     - 6703
>
>     - 6704
>
>     - 6705
>
>     - 6706
>
>
>
> Regards,
>
> Sridhar
>
> *Believe in the impossible and remove the improbable*
>
>
>
> The information contained in this transmission may contain privileged and
> confidential information of Microland Limited, including information
> protected by privacy laws. It is intended only for the use of Microland
> Limited. If you are not the intended recipient, you are hereby notified
> that any review, dissemination, distribution, or duplication of this
> communication is strictly prohibited. If you are not the intended
> recipient, please contact the sender by reply email and destroy all copies
> of the original message. Although Microland has taken reasonable
> precautions to ensure no viruses are present in this email, Microland
> cannot accept responsibility for any loss or damage arising from the use of
> this email or attachments. Computer viruses can be transmitted via email.
> Recipient should check the email and any attachments for the presence of
> viruses before using them. Any views or opinions are solely those of the
> author and do not necessarily represent those of Microland.
>
>
> This email may be monitored.
>