You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@nutch.apache.org by Anton Potehin <an...@orbita1.ru> on 2006/04/19 15:27:20 UTC

jobtaraker and tasktracker

Tasktracker and job t     racker are started now using hadoop-daemon.sh
file. In this file log created as displayed below:

 

log=$HADOOP_LOG_DIR/`hostname`-$command.log

.......................

nohup bin/hadoop $command "$@" >& "$log" < /dev/null &

................

 

Are there any ways to rotate these logs ?

 

It is impossible to use logrotate because after start logrotate
recording to logs files is stoped.

 

Example logrotate conf:

 

"/spider/logs/*.log" {

size=10M

create

rotate 100

missingok

nomail

compress

postrotate

endscript

}

Re: jobtaraker and tasktracker

Posted by Doug Cutting <cu...@apache.org>.

Anton Potehin wrote:
> Are there any ways to rotate these logs ?

One way would be to configure the JVM to use a rolling FileHandler:

file:///home/cutting/local/jdk1.5-docs/api/java/util/logging/FileHandler.html

This should be possible by setting HADOOP_OPTS (in conf/hadoop-env.sh) 
and NUTCH_OPTS to include something like:

  -Djava.util.logging.config.file=myfile

The default logging config file is in your JVM, at 
jre/lib/logging.properties.

I have not in fact tried this.  If you do, please tell how it works.

Doug