You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@storm.apache.org by Zhong Zheng <zh...@gmail.com> on 2016/01/12 19:34:02 UTC
storm-0.10.0 all worker log in supervisor.log
I didn't see worker-*.log, all logs are in supervisor.log.
Here is my cluster.xml:
<configuration monitorInterval="60">
<properties>
<property name="pattern">%d{yyyy-MM-dd HH:mm:ss.SSS} %c{5.}
[%p] %msg%n</property>
<property name="patternMetrics">%d %-8r %m%n</property>
</properties>
<appenders>
<RollingFile name="A1" immediateFlush="false"
fileName="${sys:storm.log.dir}/${sys:logfile.name}"
filePattern="${sys:storm.log.dir}/${sys:logfile.name}.%i.gz">
<PatternLayout>
<pattern>${pattern}</pattern>
</PatternLayout>
<Policies>
<SizeBasedTriggeringPolicy size="100 MB"/> <!-- Or
every 100 MB -->
</Policies>
<DefaultRolloverStrategy max="9"/>
</RollingFile>
<RollingFile name="THRIFT-ACCESS" immediateFlush="false"
fileName="${sys:storm.log.dir}/access-${sys:logfile.name}"
filePattern="${sys:storm.log.dir}/access-${sys:logfile.name}.%i.gz">
<PatternLayout>
<pattern>${pattern}</pattern>
</PatternLayout>
<Policies>
<SizeBasedTriggeringPolicy size="100 MB"/> <!-- Or
every 100 MB -->
</Policies>
<DefaultRolloverStrategy max="9"/>
</RollingFile>
<RollingFile name="METRICS" immediateFlush="false"
fileName="${sys:storm.log.dir}/metrics.log"
filePattern="${sys:storm.log.dir}/metrics.log.%i.gz">
<PatternLayout>
<pattern>${patternMetrics}</pattern>
</PatternLayout>
<Policies>
<SizeBasedTriggeringPolicy size="2 MB"/> <!-- Or every
100 MB -->
</Policies>
<DefaultRolloverStrategy max="9"/>
</RollingFile>
<Syslog name="syslog" format="RFC5424" charset="UTF-8"
host="localhost" port="514"
protocol="UDP" appName="[${sys:daemon.name}]"
mdcId="mdc" includeMDC="true"
facility="LOCAL5" enterpriseNumber="18060"
newLine="true" exceptionPattern="%rEx{full}"
messageId="[${sys:user.name}:S0]" id="storm"
immediateFlush="false" immediateFail="true"/>
</appenders>
<loggers>
<Logger name="storm.kafka.KafkaSpout" level="info" additivity="false">
<AppenderRef ref="THRIFT-ACCESS"/>
</Logger>
<Logger name="backtype.storm.metric.LoggingMetricsConsumer"
level="info">
<AppenderRef ref="METRICS"/>
</Logger>
<Logger name="storm.trident.tuple.TridentTuple" level="info"
additivity="false">
<AppenderRef ref="A1"/>
</Logger>
<root level="info"> <!-- We log everything -->
<appender-ref ref="A1"/>
</root>
</loggers>
</configuration>
And I got the log format pretty weird
2016-01-12 10:31:26.656 backt.storm.util [WARN] Worker Process
> fe85591f-a5b4-4620-9705-7d9c37450b0f:744425 [Thread-2] INFO STDERR -
> 743753 [Thread-21-b-6-netflow_stream] ERROR STDIO - at
> backtype.storm.daemon.executor$mk_task_receiver$fn__4456.invoke(executor.clj:436)
I don't want worker process part, I wanna my log start from INFO STDERR,
and the level should be ERROR instead of WARN.
Any idea to get my worker-*.log back?
--
Best,
Zhong
Re: storm-0.10.0 all worker log in supervisor.log
Posted by Bobby Evans <ev...@yahoo-inc.com.INVALID>.
The worker log is controlled by worker.xml not cluster.xml
- Bobby
On Tuesday, January 12, 2016 1:54 PM, Zhong Zheng <zh...@gmail.com> wrote:
I didn't see worker-*.log, all logs are in supervisor.log.
Here is my cluster.xml:
<configuration monitorInterval="60">
<properties>
<property name="pattern">%d{yyyy-MM-dd HH:mm:ss.SSS} %c{5.}
[%p] %msg%n</property>
<property name="patternMetrics">%d %-8r %m%n</property>
</properties>
<appenders>
<RollingFile name="A1" immediateFlush="false"
fileName="${sys:storm.log.dir}/${sys:logfile.name}"
filePattern="${sys:storm.log.dir}/${sys:logfile.name}.%i.gz">
<PatternLayout>
<pattern>${pattern}</pattern>
</PatternLayout>
<Policies>
<SizeBasedTriggeringPolicy size="100 MB"/> <!-- Or
every 100 MB -->
</Policies>
<DefaultRolloverStrategy max="9"/>
</RollingFile>
<RollingFile name="THRIFT-ACCESS" immediateFlush="false"
fileName="${sys:storm.log.dir}/access-${sys:logfile.name}"
filePattern="${sys:storm.log.dir}/access-${sys:logfile.name}.%i.gz">
<PatternLayout>
<pattern>${pattern}</pattern>
</PatternLayout>
<Policies>
<SizeBasedTriggeringPolicy size="100 MB"/> <!-- Or
every 100 MB -->
</Policies>
<DefaultRolloverStrategy max="9"/>
</RollingFile>
<RollingFile name="METRICS" immediateFlush="false"
fileName="${sys:storm.log.dir}/metrics.log"
filePattern="${sys:storm.log.dir}/metrics.log.%i.gz">
<PatternLayout>
<pattern>${patternMetrics}</pattern>
</PatternLayout>
<Policies>
<SizeBasedTriggeringPolicy size="2 MB"/> <!-- Or every
100 MB -->
</Policies>
<DefaultRolloverStrategy max="9"/>
</RollingFile>
<Syslog name="syslog" format="RFC5424" charset="UTF-8"
host="localhost" port="514"
protocol="UDP" appName="[${sys:daemon.name}]"
mdcId="mdc" includeMDC="true"
facility="LOCAL5" enterpriseNumber="18060"
newLine="true" exceptionPattern="%rEx{full}"
messageId="[${sys:user.name}:S0]" id="storm"
immediateFlush="false" immediateFail="true"/>
</appenders>
<loggers>
<Logger name="storm.kafka.KafkaSpout" level="info" additivity="false">
<AppenderRef ref="THRIFT-ACCESS"/>
</Logger>
<Logger name="backtype.storm.metric.LoggingMetricsConsumer"
level="info">
<AppenderRef ref="METRICS"/>
</Logger>
<Logger name="storm.trident.tuple.TridentTuple" level="info"
additivity="false">
<AppenderRef ref="A1"/>
</Logger>
<root level="info"> <!-- We log everything -->
<appender-ref ref="A1"/>
</root>
</loggers>
</configuration>
And I got the log format pretty weird
2016-01-12 10:31:26.656 backt.storm.util [WARN] Worker Process
> fe85591f-a5b4-4620-9705-7d9c37450b0f:744425 [Thread-2] INFO STDERR -
> 743753 [Thread-21-b-6-netflow_stream] ERROR STDIO - at
> backtype.storm.daemon.executor$mk_task_receiver$fn__4456.invoke(executor.clj:436)
I don't want worker process part, I wanna my log start from INFO STDERR,
and the level should be ERROR instead of WARN.
Any idea to get my worker-*.log back?
--
Best,
Zhong