You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Aji Janis <aj...@gmail.com> on 2013/06/25 14:47:37 UTC

log4j logging for mapreduce

I know hadoop uses log4 for logging and I was able to view the properties
in conf/log4j.properties to figure out where the existing log files are.
However, is there a way for me to direct the logs from a (hbase) mapreduce
job to a completely new file? Idea being, I have a job scheduled to run
nightly and I like to be able to log to /var/log/myjob.log for just this
job so that I can check that file for any errors/exceptions instead of
having to go through the jotrackter UI. Is this possible? If so, how? Also,
since the job will be submitted to the cluster so please advice if the log
file needs to be on HDFS or the regular (linux) platform. If on Linux then
should it be on all nodes or just the hadoop master?

Hadoop version in use: 0.20.2-cdh3u5,
30233064aaf5f2492bc687d61d72956876102109

Thank you for any suggestions.