You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-user@hadoop.apache.org by Gokulakannan M <go...@huawei.com> on 2010/06/17 19:32:34 UTC

logging difficulties in hadoop

 Hi,

 

            I wonder why the log level setting is not working when I set the
hadoop.root.logger to ERROR or WARN in hadoop/conf/log4j.properties file.
(probably it is set in  hadoop/bin/hadoop and hadoop-daemon.sh files)

 

            But if I export the HADOOP_ROOT_LOGGER property in
hadoop-env.sh, the change is seen in the logs. However a log*.out[num] file
is created each time I restart the cluster. I exported with ERROR and DRFA. 

 

            Any idea why the settings in log4j.properties is of no use
currently, inspite of the fact that it is mentioned everywhere in web for
hadoop logging????

 

            PS: setting hadoop.root.logger in /log4j.properties is working
fine if I take out the HADOOP_ROOT_LOGGER entries in hadoop/bin/hadoop and
hadoop-daemon.sh files

 

 Thanks,

  Gokul

Re: logging difficulties in hadoop

Posted by Friso van Vollenhoven <fv...@xebia.com>.

The HADOOP_ROOT_LOGGER (and HBASE_ROOT_LOGGER for HBase) is hard coded in the startup script (hadoop-daemon.sh). To make it work as an env var, you need to comment out that line in the script.

There is already a JIRA for this: https://issues.apache.org/jira/browse/HADOOP-5787


Friso


On Jun 17, 2010, at 7:32 PM, Gokulakannan M wrote:

 Hi,

            I wonder why the log level setting is not working when I set the hadoop.root.logger to ERROR or WARN in hadoop/conf/log4j.properties file. (probably it is set in  hadoop/bin/hadoop and hadoop-daemon.sh files)

            But if I export the HADOOP_ROOT_LOGGER property in hadoop-env.sh, the change is seen in the logs. However a log*.out[num] file is created each time I restart the cluster. I exported with ERROR and DRFA.

            Any idea why the settings in log4j.properties is of no use currently, inspite of the fact that it is mentioned everywhere in web for hadoop logging????

            PS: setting hadoop.root.logger in /log4j.properties is working fine if I take out the HADOOP_ROOT_LOGGER entries in hadoop/bin/hadoop and hadoop-daemon.sh files

 Thanks,
  Gokul