WORKER IS SHOWING FOLLOWING ERROR

[Sai Dilip Reddy Kiralam <dk...@aadhya-analytics.com>]

java.lang.OutOfMemoryError: Java heap space at
java.util.Arrays.copyOf(Arrays.java:3332) at
java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:137)
at
java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:121)
at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:421)
at java.lang.StringBuilder.append(StringBuilder.java:136) at
ch.qos.logback.core.pattern.FormattingConverter.write(FormattingConverter.java:40)
at
ch.qos.logback.core.pattern.PatternLayoutBase.writeLoopOnConverters(PatternLayoutBase.java:119)
at ch.qos.logback.classic.PatternLayout.doLayout(PatternLayout.java:168) at
ch.qos.logback.classic.PatternLayout.doLayout(PatternLayout.java:59) at
ch.qos.logback.core.encoder.LayoutWrappingEncoder.doEncode(LayoutWrappingEncoder.java:134)
at
ch.qos.logback.core.OutputStreamAppender.writeOut(OutputStreamAppender.java:188)
at ch.qos.logback.core.FileAppender.writeOut(FileAppender.java:206) at
ch.qos.logback.core.OutputStreamAppender.subAppend(OutputStreamAppender.java:212)
at
ch.qos.logback.core.rolling.RollingFileAppender.subAppend(RollingFileAppender.java:175)
at
ch.qos.logback.core.OutputStreamAppender.append(OutputStreamAppender.java:103)
at
ch.qos.logback.core.UnsynchronizedAppenderBase.doAppend(UnsynchronizedAppenderBase.java:88)
at
ch.qos.logback.core.spi.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:48)
at ch.qos.logback.classic.Logger.appendLoopOnAppenders(Logger.java:272) at
ch.qos.logback.classic.Logger.callAppenders(Logger.java:259) at
ch.qos.logback.classic.Logger.buildLoggingEventAndAppend(Logger.java:441)
at ch.qos.logback.classic.Logger.filterAndLog_0_Or3Plus(Logger.java:395) at
ch.qos.logback.classic.Logger.info(Logger.java:615) at
clojure.tools.logging$eval1$fn__7.invoke(NO_SOURCE_FILE:0) at
clojure.tools.logging.impl$fn__14$G__7__25.invoke(impl.clj:16) at
clojure.tools.logging$log_STAR_.invoke(logging.clj:59) at
backtype.storm.daemon.task$mk_tasks_fn$fn__6307.invoke(task.clj:152) at
backtype.storm.daemon.executor$fn__6647$fn__6659$bolt_emit__6686.invoke(executor.clj:663)
at
backtype.storm.daemon.executor$fn__6647$fn$reify__6692.emit(executor.clj:698)
at backtype.storm.task.OutputCollector.emit(OutputCollector.java:203) at
backtype.storm.task.OutputCollector.emit(OutputCollector.java:49) at
backtype.storm.topology.BasicOutputCollector.emit(BasicOutputCollector.java:36)
at
backtype.storm.topology.BasicOutputCollector.emit(BasicOutputCollector.java:40)


WHAT SHOULD I DO ? DO I NEED TO INCREASE THE HEAP SIZE OF WORKER ? if yes !
How to do that?


*Best regards,*

*K.Sai Dilip Reddy.*

Re: WORKER IS SHOWING FOLLOWING ERROR

["Matthias J. Sax" <mj...@apache.org>]

You can specify worker JVM options either via storm.yaml (as default) or
the configuration you hand to your topology (ie, individual for each
topology).

The key is "worker.childopts". To increase memory, you use for example
-Xmx4g (set the memory to 4 GB)

in storm.yaml:

worker.childopts: "-Xmx4g"

in config:

config.put("worker.childopts", "-Xmx4g");



-Matthias

On 04/25/2016 01:54 PM, Sai Dilip Reddy Kiralam wrote:
> 
> java.lang.OutOfMemoryError: Java heap space at
> java.util.Arrays.copyOf(Arrays.java:3332) at
> java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:137)
> at
> java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:121)
> at
> java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:421)
> at java.lang.StringBuilder.append(StringBuilder.java:136) at
> ch.qos.logback.core.pattern.FormattingConverter.write(FormattingConverter.java:40)
> at
> ch.qos.logback.core.pattern.PatternLayoutBase.writeLoopOnConverters(PatternLayoutBase.java:119)
> at ch.qos.logback.classic.PatternLayout.doLayout(PatternLayout.java:168)
> at ch.qos.logback.classic.PatternLayout.doLayout(PatternLayout.java:59)
> at
> ch.qos.logback.core.encoder.LayoutWrappingEncoder.doEncode(LayoutWrappingEncoder.java:134)
> at
> ch.qos.logback.core.OutputStreamAppender.writeOut(OutputStreamAppender.java:188)
> at ch.qos.logback.core.FileAppender.writeOut(FileAppender.java:206) at
> ch.qos.logback.core.OutputStreamAppender.subAppend(OutputStreamAppender.java:212)
> at
> ch.qos.logback.core.rolling.RollingFileAppender.subAppend(RollingFileAppender.java:175)
> at
> ch.qos.logback.core.OutputStreamAppender.append(OutputStreamAppender.java:103)
> at
> ch.qos.logback.core.UnsynchronizedAppenderBase.doAppend(UnsynchronizedAppenderBase.java:88)
> at
> ch.qos.logback.core.spi.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:48)
> at ch.qos.logback.classic.Logger.appendLoopOnAppenders(Logger.java:272)
> at ch.qos.logback.classic.Logger.callAppenders(Logger.java:259) at
> ch.qos.logback.classic.Logger.buildLoggingEventAndAppend(Logger.java:441) at
> ch.qos.logback.classic.Logger.filterAndLog_0_Or3Plus(Logger.java:395) at
> ch.qos.logback.classic.Logger.info
> <http://ch.qos.logback.classic.Logger.info>(Logger.java:615) at
> clojure.tools.logging$eval1$fn__7.invoke(NO_SOURCE_FILE:0) at
> clojure.tools.logging.impl$fn__14$G__7__25.invoke(impl.clj:16) at
> clojure.tools.logging$log_STAR_.invoke(logging.clj:59) at
> backtype.storm.daemon.task$mk_tasks_fn$fn__6307.invoke(task.clj:152) at
> backtype.storm.daemon.executor$fn__6647$fn__6659$bolt_emit__6686.invoke(executor.clj:663)
> at
> backtype.storm.daemon.executor$fn__6647$fn$reify__6692.emit(executor.clj:698)
> at backtype.storm.task.OutputCollector.emit(OutputCollector.java:203) at
> backtype.storm.task.OutputCollector.emit(OutputCollector.java:49) at
> backtype.storm.topology.BasicOutputCollector.emit(BasicOutputCollector.java:36)
> at
> backtype.storm.topology.BasicOutputCollector.emit(BasicOutputCollector.java:40)
> 
> 
> WHAT SHOULD I DO ? DO I NEED TO INCREASE THE HEAP SIZE OF WORKER ? if
> yes ! How to do that? 
> 
> 
> *Best regards,*
> */K.Sai Dilip Reddy.
> /*