You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Nitzan Raanan <Ra...@comverse.com> on 2013/04/22 14:51:43 UTC
How to open DEBUG level for YARN application master ?
Hi
How do I open the DEBUG level for YARN application master process ?
I couldn't find the relevant configuration the set (probably need to add them somewhere).
ps -ef | grep java | grep yarn
yarn 12585 29113 0 15:33 ? 00:00:00 /bin/bash -c /usr/java/jre1.6/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.mapreduce.container.log.dir=/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001 -Dyarn.app.mapreduce.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stdout 2>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stderr
I'm using following YARN version
# rpm -qa | grep yarn
hadoop-yarn-nodemanager-2.0.0+922-1.cdh4.2.0.p0.12.el5
hadoop-yarn-nodemanager-2.0.0+88-1.cdh4.0.0.p0.26.el5
hadoop-yarn-2.0.0+922-1.cdh4.2.0.p0.12.el5
Thanks
Raanan Nitzan,
R&D Developer
Comverse
________________________________
"This e-mail message may contain confidential, commercial or privileged information that constitutes proprietary information of Comverse Technology or its subsidiaries. If you are not the intended recipient of this message, you are hereby notified that any review, use or distribution of this information is absolutely prohibited and we request that you delete all copies and contact us by e-mailing to: security@comverse.com. Thank You."
Re: How to open DEBUG level for YARN application master ?
Posted by Ted Yu <yu...@gmail.com>.
In hadoop-yarn-project/hadoop-yarn/bin/yarn , you can find:
YARN_OPTS="$YARN_OPTS
-Dhadoop.root.logger=${YARN_ROOT_LOGGER:-INFO,console}"
YARN_OPTS="$YARN_OPTS -Dyarn.root.logger=${YARN_ROOT_LOGGER:-INFO,console}"
Meaning you can override logger setting through YARN_ROOT_LOGGER
environment variable.
Cheers
On Mon, Apr 22, 2013 at 5:51 AM, Nitzan Raanan
<Ra...@comverse.com>wrote:
> Hi****
>
> ** **
>
> How do I open the DEBUG level for YARN application master process ?****
>
> I couldn’t find the relevant configuration the set (probably need to add
> them somewhere).****
>
> ** **
>
> *ps -ef | grep java | grep yarn*
>
> *yarn 12585 29113 0 15:33 ? 00:00:00 /bin/bash -c
> /usr/java/jre1.6/bin/java -Dlog4j.configuration=container-log4j.properties-Dyarn.app.mapreduce.container.log.dir=/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001
> -Dyarn.app.mapreduce.container.log.filesize=0
> -Dhadoop.root.logger=INFO,CLA -Xmx1024m
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> 1>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stdout
> 2>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stderr
> *
>
> ** **
>
> ** **
>
> I’m using following YARN version ****
>
> *# rpm -qa | grep yarn*
>
> *hadoop-yarn-nodemanager-2.0.0+922-1.cdh4.2.0.p0.12.el5*
>
> *hadoop-yarn-nodemanager-2.0.0+88-1.cdh4.0.0.p0.26.el5*
>
> *hadoop-yarn-2.0.0+922-1.cdh4.2.0.p0.12.el5*
>
> ** **
>
> Thanks****
>
> Raanan Nitzan,****
>
> R&D Developer****
>
> Comverse ****
>
> ** **
>
> ------------------------------
> “This e-mail message may contain confidential, commercial or privileged
> information that constitutes proprietary information of Comverse Technology
> or its subsidiaries. If you are not the intended recipient of this message,
> you are hereby notified that any review, use or distribution of this
> information is absolutely prohibited and we request that you delete all
> copies and contact us by e-mailing to: security@comverse.com. Thank You.”
>
RE: How to open DEBUG level for YARN application master ?
Posted by Nitzan Raanan <Ra...@comverse.com>.
Thanks
That worked !
BR
Raanan Nitzan
-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: Tuesday, April 23, 2013 9:42 AM
To: <us...@hadoop.apache.org>
Subject: Re: How to open DEBUG level for YARN application master ?
To change the MR AM's default log level from INFO, set the job config:
"yarn.app.mapreduce.am.log.level" to DEBUG or whatever level you
prefer.
On Mon, Apr 22, 2013 at 6:21 PM, Nitzan Raanan
<Ra...@comverse.com> wrote:
> Hi
>
>
>
> How do I open the DEBUG level for YARN application master process ?
>
> I couldn’t find the relevant configuration the set (probably need to add
> them somewhere).
>
>
>
> ps -ef | grep java | grep yarn
>
> yarn 12585 29113 0 15:33 ? 00:00:00 /bin/bash -c
> /usr/java/jre1.6/bin/java -Dlog4j.configuration=container-log4j.properties
> -Dyarn.app.mapreduce.container.log.dir=/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001
> -Dyarn.app.mapreduce.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA
> -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> 1>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stdout
> 2>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stderr
>
>
>
>
>
> I’m using following YARN version
>
> # rpm -qa | grep yarn
>
> hadoop-yarn-nodemanager-2.0.0+922-1.cdh4.2.0.p0.12.el5
>
> hadoop-yarn-nodemanager-2.0.0+88-1.cdh4.0.0.p0.26.el5
>
> hadoop-yarn-2.0.0+922-1.cdh4.2.0.p0.12.el5
>
>
>
> Thanks
>
> Raanan Nitzan,
>
> R&D Developer
>
> Comverse
>
>
>
>
> ________________________________
> “This e-mail message may contain confidential, commercial or privileged
> information that constitutes proprietary information of Comverse Technology
> or its subsidiaries. If you are not the intended recipient of this message,
> you are hereby notified that any review, use or distribution of this
> information is absolutely prohibited and we request that you delete all
> copies and contact us by e-mailing to: security@comverse.com. Thank You.”
--
Harsh J
“This e-mail message may contain confidential, commercial or privileged information that constitutes proprietary information of Comverse Technology or its subsidiaries. If you are not the intended recipient of this message, you are hereby notified that any review, use or distribution of this information is absolutely prohibited and we request that you delete all copies and contact us by e-mailing to: security@comverse.com. Thank You.”
RE: How to open DEBUG level for YARN application master ?
Posted by Nitzan Raanan <Ra...@comverse.com>.
Thanks
That worked !
BR
Raanan Nitzan
-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: Tuesday, April 23, 2013 9:42 AM
To: <us...@hadoop.apache.org>
Subject: Re: How to open DEBUG level for YARN application master ?
To change the MR AM's default log level from INFO, set the job config:
"yarn.app.mapreduce.am.log.level" to DEBUG or whatever level you
prefer.
On Mon, Apr 22, 2013 at 6:21 PM, Nitzan Raanan
<Ra...@comverse.com> wrote:
> Hi
>
>
>
> How do I open the DEBUG level for YARN application master process ?
>
> I couldn’t find the relevant configuration the set (probably need to add
> them somewhere).
>
>
>
> ps -ef | grep java | grep yarn
>
> yarn 12585 29113 0 15:33 ? 00:00:00 /bin/bash -c
> /usr/java/jre1.6/bin/java -Dlog4j.configuration=container-log4j.properties
> -Dyarn.app.mapreduce.container.log.dir=/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001
> -Dyarn.app.mapreduce.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA
> -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> 1>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stdout
> 2>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stderr
>
>
>
>
>
> I’m using following YARN version
>
> # rpm -qa | grep yarn
>
> hadoop-yarn-nodemanager-2.0.0+922-1.cdh4.2.0.p0.12.el5
>
> hadoop-yarn-nodemanager-2.0.0+88-1.cdh4.0.0.p0.26.el5
>
> hadoop-yarn-2.0.0+922-1.cdh4.2.0.p0.12.el5
>
>
>
> Thanks
>
> Raanan Nitzan,
>
> R&D Developer
>
> Comverse
>
>
>
>
> ________________________________
> “This e-mail message may contain confidential, commercial or privileged
> information that constitutes proprietary information of Comverse Technology
> or its subsidiaries. If you are not the intended recipient of this message,
> you are hereby notified that any review, use or distribution of this
> information is absolutely prohibited and we request that you delete all
> copies and contact us by e-mailing to: security@comverse.com. Thank You.”
--
Harsh J
“This e-mail message may contain confidential, commercial or privileged information that constitutes proprietary information of Comverse Technology or its subsidiaries. If you are not the intended recipient of this message, you are hereby notified that any review, use or distribution of this information is absolutely prohibited and we request that you delete all copies and contact us by e-mailing to: security@comverse.com. Thank You.”
RE: How to open DEBUG level for YARN application master ?
Posted by Nitzan Raanan <Ra...@comverse.com>.
Thanks
That worked !
BR
Raanan Nitzan
-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: Tuesday, April 23, 2013 9:42 AM
To: <us...@hadoop.apache.org>
Subject: Re: How to open DEBUG level for YARN application master ?
To change the MR AM's default log level from INFO, set the job config:
"yarn.app.mapreduce.am.log.level" to DEBUG or whatever level you
prefer.
On Mon, Apr 22, 2013 at 6:21 PM, Nitzan Raanan
<Ra...@comverse.com> wrote:
> Hi
>
>
>
> How do I open the DEBUG level for YARN application master process ?
>
> I couldn’t find the relevant configuration the set (probably need to add
> them somewhere).
>
>
>
> ps -ef | grep java | grep yarn
>
> yarn 12585 29113 0 15:33 ? 00:00:00 /bin/bash -c
> /usr/java/jre1.6/bin/java -Dlog4j.configuration=container-log4j.properties
> -Dyarn.app.mapreduce.container.log.dir=/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001
> -Dyarn.app.mapreduce.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA
> -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> 1>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stdout
> 2>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stderr
>
>
>
>
>
> I’m using following YARN version
>
> # rpm -qa | grep yarn
>
> hadoop-yarn-nodemanager-2.0.0+922-1.cdh4.2.0.p0.12.el5
>
> hadoop-yarn-nodemanager-2.0.0+88-1.cdh4.0.0.p0.26.el5
>
> hadoop-yarn-2.0.0+922-1.cdh4.2.0.p0.12.el5
>
>
>
> Thanks
>
> Raanan Nitzan,
>
> R&D Developer
>
> Comverse
>
>
>
>
> ________________________________
> “This e-mail message may contain confidential, commercial or privileged
> information that constitutes proprietary information of Comverse Technology
> or its subsidiaries. If you are not the intended recipient of this message,
> you are hereby notified that any review, use or distribution of this
> information is absolutely prohibited and we request that you delete all
> copies and contact us by e-mailing to: security@comverse.com. Thank You.”
--
Harsh J
“This e-mail message may contain confidential, commercial or privileged information that constitutes proprietary information of Comverse Technology or its subsidiaries. If you are not the intended recipient of this message, you are hereby notified that any review, use or distribution of this information is absolutely prohibited and we request that you delete all copies and contact us by e-mailing to: security@comverse.com. Thank You.”
RE: How to open DEBUG level for YARN application master ?
Posted by Nitzan Raanan <Ra...@comverse.com>.
Thanks
That worked !
BR
Raanan Nitzan
-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: Tuesday, April 23, 2013 9:42 AM
To: <us...@hadoop.apache.org>
Subject: Re: How to open DEBUG level for YARN application master ?
To change the MR AM's default log level from INFO, set the job config:
"yarn.app.mapreduce.am.log.level" to DEBUG or whatever level you
prefer.
On Mon, Apr 22, 2013 at 6:21 PM, Nitzan Raanan
<Ra...@comverse.com> wrote:
> Hi
>
>
>
> How do I open the DEBUG level for YARN application master process ?
>
> I couldn’t find the relevant configuration the set (probably need to add
> them somewhere).
>
>
>
> ps -ef | grep java | grep yarn
>
> yarn 12585 29113 0 15:33 ? 00:00:00 /bin/bash -c
> /usr/java/jre1.6/bin/java -Dlog4j.configuration=container-log4j.properties
> -Dyarn.app.mapreduce.container.log.dir=/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001
> -Dyarn.app.mapreduce.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA
> -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> 1>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stdout
> 2>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stderr
>
>
>
>
>
> I’m using following YARN version
>
> # rpm -qa | grep yarn
>
> hadoop-yarn-nodemanager-2.0.0+922-1.cdh4.2.0.p0.12.el5
>
> hadoop-yarn-nodemanager-2.0.0+88-1.cdh4.0.0.p0.26.el5
>
> hadoop-yarn-2.0.0+922-1.cdh4.2.0.p0.12.el5
>
>
>
> Thanks
>
> Raanan Nitzan,
>
> R&D Developer
>
> Comverse
>
>
>
>
> ________________________________
> “This e-mail message may contain confidential, commercial or privileged
> information that constitutes proprietary information of Comverse Technology
> or its subsidiaries. If you are not the intended recipient of this message,
> you are hereby notified that any review, use or distribution of this
> information is absolutely prohibited and we request that you delete all
> copies and contact us by e-mailing to: security@comverse.com. Thank You.”
--
Harsh J
“This e-mail message may contain confidential, commercial or privileged information that constitutes proprietary information of Comverse Technology or its subsidiaries. If you are not the intended recipient of this message, you are hereby notified that any review, use or distribution of this information is absolutely prohibited and we request that you delete all copies and contact us by e-mailing to: security@comverse.com. Thank You.”
Re: How to open DEBUG level for YARN application master ?
Posted by Harsh J <ha...@cloudera.com>.
To change the MR AM's default log level from INFO, set the job config:
"yarn.app.mapreduce.am.log.level" to DEBUG or whatever level you
prefer.
On Mon, Apr 22, 2013 at 6:21 PM, Nitzan Raanan
<Ra...@comverse.com> wrote:
> Hi
>
>
>
> How do I open the DEBUG level for YARN application master process ?
>
> I couldn’t find the relevant configuration the set (probably need to add
> them somewhere).
>
>
>
> ps -ef | grep java | grep yarn
>
> yarn 12585 29113 0 15:33 ? 00:00:00 /bin/bash -c
> /usr/java/jre1.6/bin/java -Dlog4j.configuration=container-log4j.properties
> -Dyarn.app.mapreduce.container.log.dir=/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001
> -Dyarn.app.mapreduce.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA
> -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> 1>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stdout
> 2>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stderr
>
>
>
>
>
> I’m using following YARN version
>
> # rpm -qa | grep yarn
>
> hadoop-yarn-nodemanager-2.0.0+922-1.cdh4.2.0.p0.12.el5
>
> hadoop-yarn-nodemanager-2.0.0+88-1.cdh4.0.0.p0.26.el5
>
> hadoop-yarn-2.0.0+922-1.cdh4.2.0.p0.12.el5
>
>
>
> Thanks
>
> Raanan Nitzan,
>
> R&D Developer
>
> Comverse
>
>
>
>
> ________________________________
> “This e-mail message may contain confidential, commercial or privileged
> information that constitutes proprietary information of Comverse Technology
> or its subsidiaries. If you are not the intended recipient of this message,
> you are hereby notified that any review, use or distribution of this
> information is absolutely prohibited and we request that you delete all
> copies and contact us by e-mailing to: security@comverse.com. Thank You.”
--
Harsh J
Re: How to open DEBUG level for YARN application master ?
Posted by Ted Yu <yu...@gmail.com>.
In hadoop-yarn-project/hadoop-yarn/bin/yarn , you can find:
YARN_OPTS="$YARN_OPTS
-Dhadoop.root.logger=${YARN_ROOT_LOGGER:-INFO,console}"
YARN_OPTS="$YARN_OPTS -Dyarn.root.logger=${YARN_ROOT_LOGGER:-INFO,console}"
Meaning you can override logger setting through YARN_ROOT_LOGGER
environment variable.
Cheers
On Mon, Apr 22, 2013 at 5:51 AM, Nitzan Raanan
<Ra...@comverse.com>wrote:
> Hi****
>
> ** **
>
> How do I open the DEBUG level for YARN application master process ?****
>
> I couldn’t find the relevant configuration the set (probably need to add
> them somewhere).****
>
> ** **
>
> *ps -ef | grep java | grep yarn*
>
> *yarn 12585 29113 0 15:33 ? 00:00:00 /bin/bash -c
> /usr/java/jre1.6/bin/java -Dlog4j.configuration=container-log4j.properties-Dyarn.app.mapreduce.container.log.dir=/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001
> -Dyarn.app.mapreduce.container.log.filesize=0
> -Dhadoop.root.logger=INFO,CLA -Xmx1024m
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> 1>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stdout
> 2>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stderr
> *
>
> ** **
>
> ** **
>
> I’m using following YARN version ****
>
> *# rpm -qa | grep yarn*
>
> *hadoop-yarn-nodemanager-2.0.0+922-1.cdh4.2.0.p0.12.el5*
>
> *hadoop-yarn-nodemanager-2.0.0+88-1.cdh4.0.0.p0.26.el5*
>
> *hadoop-yarn-2.0.0+922-1.cdh4.2.0.p0.12.el5*
>
> ** **
>
> Thanks****
>
> Raanan Nitzan,****
>
> R&D Developer****
>
> Comverse ****
>
> ** **
>
> ------------------------------
> “This e-mail message may contain confidential, commercial or privileged
> information that constitutes proprietary information of Comverse Technology
> or its subsidiaries. If you are not the intended recipient of this message,
> you are hereby notified that any review, use or distribution of this
> information is absolutely prohibited and we request that you delete all
> copies and contact us by e-mailing to: security@comverse.com. Thank You.”
>
Re: How to open DEBUG level for YARN application master ?
Posted by Harsh J <ha...@cloudera.com>.
To change the MR AM's default log level from INFO, set the job config:
"yarn.app.mapreduce.am.log.level" to DEBUG or whatever level you
prefer.
On Mon, Apr 22, 2013 at 6:21 PM, Nitzan Raanan
<Ra...@comverse.com> wrote:
> Hi
>
>
>
> How do I open the DEBUG level for YARN application master process ?
>
> I couldn’t find the relevant configuration the set (probably need to add
> them somewhere).
>
>
>
> ps -ef | grep java | grep yarn
>
> yarn 12585 29113 0 15:33 ? 00:00:00 /bin/bash -c
> /usr/java/jre1.6/bin/java -Dlog4j.configuration=container-log4j.properties
> -Dyarn.app.mapreduce.container.log.dir=/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001
> -Dyarn.app.mapreduce.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA
> -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> 1>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stdout
> 2>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stderr
>
>
>
>
>
> I’m using following YARN version
>
> # rpm -qa | grep yarn
>
> hadoop-yarn-nodemanager-2.0.0+922-1.cdh4.2.0.p0.12.el5
>
> hadoop-yarn-nodemanager-2.0.0+88-1.cdh4.0.0.p0.26.el5
>
> hadoop-yarn-2.0.0+922-1.cdh4.2.0.p0.12.el5
>
>
>
> Thanks
>
> Raanan Nitzan,
>
> R&D Developer
>
> Comverse
>
>
>
>
> ________________________________
> “This e-mail message may contain confidential, commercial or privileged
> information that constitutes proprietary information of Comverse Technology
> or its subsidiaries. If you are not the intended recipient of this message,
> you are hereby notified that any review, use or distribution of this
> information is absolutely prohibited and we request that you delete all
> copies and contact us by e-mailing to: security@comverse.com. Thank You.”
--
Harsh J
Re: How to open DEBUG level for YARN application master ?
Posted by Ted Yu <yu...@gmail.com>.
In hadoop-yarn-project/hadoop-yarn/bin/yarn , you can find:
YARN_OPTS="$YARN_OPTS
-Dhadoop.root.logger=${YARN_ROOT_LOGGER:-INFO,console}"
YARN_OPTS="$YARN_OPTS -Dyarn.root.logger=${YARN_ROOT_LOGGER:-INFO,console}"
Meaning you can override logger setting through YARN_ROOT_LOGGER
environment variable.
Cheers
On Mon, Apr 22, 2013 at 5:51 AM, Nitzan Raanan
<Ra...@comverse.com>wrote:
> Hi****
>
> ** **
>
> How do I open the DEBUG level for YARN application master process ?****
>
> I couldn’t find the relevant configuration the set (probably need to add
> them somewhere).****
>
> ** **
>
> *ps -ef | grep java | grep yarn*
>
> *yarn 12585 29113 0 15:33 ? 00:00:00 /bin/bash -c
> /usr/java/jre1.6/bin/java -Dlog4j.configuration=container-log4j.properties-Dyarn.app.mapreduce.container.log.dir=/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001
> -Dyarn.app.mapreduce.container.log.filesize=0
> -Dhadoop.root.logger=INFO,CLA -Xmx1024m
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> 1>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stdout
> 2>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stderr
> *
>
> ** **
>
> ** **
>
> I’m using following YARN version ****
>
> *# rpm -qa | grep yarn*
>
> *hadoop-yarn-nodemanager-2.0.0+922-1.cdh4.2.0.p0.12.el5*
>
> *hadoop-yarn-nodemanager-2.0.0+88-1.cdh4.0.0.p0.26.el5*
>
> *hadoop-yarn-2.0.0+922-1.cdh4.2.0.p0.12.el5*
>
> ** **
>
> Thanks****
>
> Raanan Nitzan,****
>
> R&D Developer****
>
> Comverse ****
>
> ** **
>
> ------------------------------
> “This e-mail message may contain confidential, commercial or privileged
> information that constitutes proprietary information of Comverse Technology
> or its subsidiaries. If you are not the intended recipient of this message,
> you are hereby notified that any review, use or distribution of this
> information is absolutely prohibited and we request that you delete all
> copies and contact us by e-mailing to: security@comverse.com. Thank You.”
>
Re: How to open DEBUG level for YARN application master ?
Posted by Harsh J <ha...@cloudera.com>.
To change the MR AM's default log level from INFO, set the job config:
"yarn.app.mapreduce.am.log.level" to DEBUG or whatever level you
prefer.
On Mon, Apr 22, 2013 at 6:21 PM, Nitzan Raanan
<Ra...@comverse.com> wrote:
> Hi
>
>
>
> How do I open the DEBUG level for YARN application master process ?
>
> I couldn’t find the relevant configuration the set (probably need to add
> them somewhere).
>
>
>
> ps -ef | grep java | grep yarn
>
> yarn 12585 29113 0 15:33 ? 00:00:00 /bin/bash -c
> /usr/java/jre1.6/bin/java -Dlog4j.configuration=container-log4j.properties
> -Dyarn.app.mapreduce.container.log.dir=/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001
> -Dyarn.app.mapreduce.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA
> -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> 1>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stdout
> 2>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stderr
>
>
>
>
>
> I’m using following YARN version
>
> # rpm -qa | grep yarn
>
> hadoop-yarn-nodemanager-2.0.0+922-1.cdh4.2.0.p0.12.el5
>
> hadoop-yarn-nodemanager-2.0.0+88-1.cdh4.0.0.p0.26.el5
>
> hadoop-yarn-2.0.0+922-1.cdh4.2.0.p0.12.el5
>
>
>
> Thanks
>
> Raanan Nitzan,
>
> R&D Developer
>
> Comverse
>
>
>
>
> ________________________________
> “This e-mail message may contain confidential, commercial or privileged
> information that constitutes proprietary information of Comverse Technology
> or its subsidiaries. If you are not the intended recipient of this message,
> you are hereby notified that any review, use or distribution of this
> information is absolutely prohibited and we request that you delete all
> copies and contact us by e-mailing to: security@comverse.com. Thank You.”
--
Harsh J
Re: How to open DEBUG level for YARN application master ?
Posted by Harsh J <ha...@cloudera.com>.
To change the MR AM's default log level from INFO, set the job config:
"yarn.app.mapreduce.am.log.level" to DEBUG or whatever level you
prefer.
On Mon, Apr 22, 2013 at 6:21 PM, Nitzan Raanan
<Ra...@comverse.com> wrote:
> Hi
>
>
>
> How do I open the DEBUG level for YARN application master process ?
>
> I couldn’t find the relevant configuration the set (probably need to add
> them somewhere).
>
>
>
> ps -ef | grep java | grep yarn
>
> yarn 12585 29113 0 15:33 ? 00:00:00 /bin/bash -c
> /usr/java/jre1.6/bin/java -Dlog4j.configuration=container-log4j.properties
> -Dyarn.app.mapreduce.container.log.dir=/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001
> -Dyarn.app.mapreduce.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA
> -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> 1>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stdout
> 2>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stderr
>
>
>
>
>
> I’m using following YARN version
>
> # rpm -qa | grep yarn
>
> hadoop-yarn-nodemanager-2.0.0+922-1.cdh4.2.0.p0.12.el5
>
> hadoop-yarn-nodemanager-2.0.0+88-1.cdh4.0.0.p0.26.el5
>
> hadoop-yarn-2.0.0+922-1.cdh4.2.0.p0.12.el5
>
>
>
> Thanks
>
> Raanan Nitzan,
>
> R&D Developer
>
> Comverse
>
>
>
>
> ________________________________
> “This e-mail message may contain confidential, commercial or privileged
> information that constitutes proprietary information of Comverse Technology
> or its subsidiaries. If you are not the intended recipient of this message,
> you are hereby notified that any review, use or distribution of this
> information is absolutely prohibited and we request that you delete all
> copies and contact us by e-mailing to: security@comverse.com. Thank You.”
--
Harsh J
Re: How to open DEBUG level for YARN application master ?
Posted by Ted Yu <yu...@gmail.com>.
In hadoop-yarn-project/hadoop-yarn/bin/yarn , you can find:
YARN_OPTS="$YARN_OPTS
-Dhadoop.root.logger=${YARN_ROOT_LOGGER:-INFO,console}"
YARN_OPTS="$YARN_OPTS -Dyarn.root.logger=${YARN_ROOT_LOGGER:-INFO,console}"
Meaning you can override logger setting through YARN_ROOT_LOGGER
environment variable.
Cheers
On Mon, Apr 22, 2013 at 5:51 AM, Nitzan Raanan
<Ra...@comverse.com>wrote:
> Hi****
>
> ** **
>
> How do I open the DEBUG level for YARN application master process ?****
>
> I couldn’t find the relevant configuration the set (probably need to add
> them somewhere).****
>
> ** **
>
> *ps -ef | grep java | grep yarn*
>
> *yarn 12585 29113 0 15:33 ? 00:00:00 /bin/bash -c
> /usr/java/jre1.6/bin/java -Dlog4j.configuration=container-log4j.properties-Dyarn.app.mapreduce.container.log.dir=/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001
> -Dyarn.app.mapreduce.container.log.filesize=0
> -Dhadoop.root.logger=INFO,CLA -Xmx1024m
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> 1>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stdout
> 2>/var/log/hadoop-yarn/containers/application_1366187149316_0049/container_1366187149316_0049_01_000001/stderr
> *
>
> ** **
>
> ** **
>
> I’m using following YARN version ****
>
> *# rpm -qa | grep yarn*
>
> *hadoop-yarn-nodemanager-2.0.0+922-1.cdh4.2.0.p0.12.el5*
>
> *hadoop-yarn-nodemanager-2.0.0+88-1.cdh4.0.0.p0.26.el5*
>
> *hadoop-yarn-2.0.0+922-1.cdh4.2.0.p0.12.el5*
>
> ** **
>
> Thanks****
>
> Raanan Nitzan,****
>
> R&D Developer****
>
> Comverse ****
>
> ** **
>
> ------------------------------
> “This e-mail message may contain confidential, commercial or privileged
> information that constitutes proprietary information of Comverse Technology
> or its subsidiaries. If you are not the intended recipient of this message,
> you are hereby notified that any review, use or distribution of this
> information is absolutely prohibited and we request that you delete all
> copies and contact us by e-mailing to: security@comverse.com. Thank You.”
>