You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by Azuryy Yu <az...@gmail.com> on 2014/04/03 02:45:50 UTC
Fwd: Container states trantition questions
Hi,
Does it normal for each container end with TERMINATED(143) ?
The whole MR job is successful, but all containers in the map phase end
with 143.
There are no any useful logs in the NM, AM, Container logs.
Another minor question:
There are only WARN logs in the stderr:
log4j:WARN No appenders could be found for logger
(org.apache.hadoop.metrics2.impl.MetricsSystemImpl).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
more info.
It seems cannot find log4j.propertites, but I've configured:
<property>
<name>mapreduce.application.classpath</name>
<value>$HADOOP_MAPRED_HOME/conf,$HADOOP_MAPRED_HOME/*,$HADOOP_MAPRED_HOME/lib/*</value>
</property>
<property>
<name>yarn.application.classpath</name>
<value>$HADOOP_COMMON_HOME/conf,$HADOOP_COMMON_HOME/*,$HADOOP_COMMON_HOME/lib/*</value>
</property>
Appreciate for any inputs.
Re: Container states trantition questions
Posted by Azuryy Yu <az...@gmail.com>.
Hi Zhijie,
Yes, I opened debug level, and looked through RM, AM, container's logs,
container always receive SIGTERM(15) after transition to FINISHED, webUI
just shows the diagnostics message.
Thanks Zhijie.
On Thu, Apr 3, 2014 at 2:00 PM, Zhijie Shen <zs...@hortonworks.com> wrote:
> It should be normal. If you can check the diagnostics of the container, it
> is likely that you will see "Container killed by the ApplicationMaster." MR
> AM will stop the container when a task is finished.
>
> Thanks,
> Zhijie
>
>
> On Wed, Apr 2, 2014 at 7:22 PM, Fengyun RAO <ra...@gmail.com> wrote:
>
>> same for me. all mapper ends with 143.
>>
>> I've no idea what it means
>>
>>
>> 2014-04-03 8:45 GMT+08:00 Azuryy Yu <az...@gmail.com>:
>>
>> Hi,
>>>
>>> Does it normal for each container end with TERMINATED(143) ?
>>> The whole MR job is successful, but all containers in the map phase end
>>> with 143.
>>>
>>> There are no any useful logs in the NM, AM, Container logs.
>>>
>>> Another minor question:
>>> There are only WARN logs in the stderr:
>>> log4j:WARN No appenders could be found for logger
>>> (org.apache.hadoop.metrics2.impl.MetricsSystemImpl).
>>> log4j:WARN Please initialize the log4j system properly.
>>> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfigfor more info.
>>> It seems cannot find log4j.propertites, but I've configured:
>>> <property>
>>> <name>mapreduce.application.classpath</name>
>>>
>>> <value>$HADOOP_MAPRED_HOME/conf,$HADOOP_MAPRED_HOME/*,$HADOOP_MAPRED_HOME/lib/*</value>
>>> </property>
>>> <property>
>>> <name>yarn.application.classpath</name>
>>>
>>> <value>$HADOOP_COMMON_HOME/conf,$HADOOP_COMMON_HOME/*,$HADOOP_COMMON_HOME/lib/*</value>
>>> </property>
>>>
>>> Appreciate for any inputs.
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>
>
>
> --
> Zhijie Shen
> Hortonworks Inc.
> http://hortonworks.com/
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Container states trantition questions
Posted by Azuryy Yu <az...@gmail.com>.
Hi Zhijie,
Yes, I opened debug level, and looked through RM, AM, container's logs,
container always receive SIGTERM(15) after transition to FINISHED, webUI
just shows the diagnostics message.
Thanks Zhijie.
On Thu, Apr 3, 2014 at 2:00 PM, Zhijie Shen <zs...@hortonworks.com> wrote:
> It should be normal. If you can check the diagnostics of the container, it
> is likely that you will see "Container killed by the ApplicationMaster." MR
> AM will stop the container when a task is finished.
>
> Thanks,
> Zhijie
>
>
> On Wed, Apr 2, 2014 at 7:22 PM, Fengyun RAO <ra...@gmail.com> wrote:
>
>> same for me. all mapper ends with 143.
>>
>> I've no idea what it means
>>
>>
>> 2014-04-03 8:45 GMT+08:00 Azuryy Yu <az...@gmail.com>:
>>
>> Hi,
>>>
>>> Does it normal for each container end with TERMINATED(143) ?
>>> The whole MR job is successful, but all containers in the map phase end
>>> with 143.
>>>
>>> There are no any useful logs in the NM, AM, Container logs.
>>>
>>> Another minor question:
>>> There are only WARN logs in the stderr:
>>> log4j:WARN No appenders could be found for logger
>>> (org.apache.hadoop.metrics2.impl.MetricsSystemImpl).
>>> log4j:WARN Please initialize the log4j system properly.
>>> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfigfor more info.
>>> It seems cannot find log4j.propertites, but I've configured:
>>> <property>
>>> <name>mapreduce.application.classpath</name>
>>>
>>> <value>$HADOOP_MAPRED_HOME/conf,$HADOOP_MAPRED_HOME/*,$HADOOP_MAPRED_HOME/lib/*</value>
>>> </property>
>>> <property>
>>> <name>yarn.application.classpath</name>
>>>
>>> <value>$HADOOP_COMMON_HOME/conf,$HADOOP_COMMON_HOME/*,$HADOOP_COMMON_HOME/lib/*</value>
>>> </property>
>>>
>>> Appreciate for any inputs.
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>
>
>
> --
> Zhijie Shen
> Hortonworks Inc.
> http://hortonworks.com/
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Container states trantition questions
Posted by Azuryy Yu <az...@gmail.com>.
Hi Zhijie,
Yes, I opened debug level, and looked through RM, AM, container's logs,
container always receive SIGTERM(15) after transition to FINISHED, webUI
just shows the diagnostics message.
Thanks Zhijie.
On Thu, Apr 3, 2014 at 2:00 PM, Zhijie Shen <zs...@hortonworks.com> wrote:
> It should be normal. If you can check the diagnostics of the container, it
> is likely that you will see "Container killed by the ApplicationMaster." MR
> AM will stop the container when a task is finished.
>
> Thanks,
> Zhijie
>
>
> On Wed, Apr 2, 2014 at 7:22 PM, Fengyun RAO <ra...@gmail.com> wrote:
>
>> same for me. all mapper ends with 143.
>>
>> I've no idea what it means
>>
>>
>> 2014-04-03 8:45 GMT+08:00 Azuryy Yu <az...@gmail.com>:
>>
>> Hi,
>>>
>>> Does it normal for each container end with TERMINATED(143) ?
>>> The whole MR job is successful, but all containers in the map phase end
>>> with 143.
>>>
>>> There are no any useful logs in the NM, AM, Container logs.
>>>
>>> Another minor question:
>>> There are only WARN logs in the stderr:
>>> log4j:WARN No appenders could be found for logger
>>> (org.apache.hadoop.metrics2.impl.MetricsSystemImpl).
>>> log4j:WARN Please initialize the log4j system properly.
>>> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfigfor more info.
>>> It seems cannot find log4j.propertites, but I've configured:
>>> <property>
>>> <name>mapreduce.application.classpath</name>
>>>
>>> <value>$HADOOP_MAPRED_HOME/conf,$HADOOP_MAPRED_HOME/*,$HADOOP_MAPRED_HOME/lib/*</value>
>>> </property>
>>> <property>
>>> <name>yarn.application.classpath</name>
>>>
>>> <value>$HADOOP_COMMON_HOME/conf,$HADOOP_COMMON_HOME/*,$HADOOP_COMMON_HOME/lib/*</value>
>>> </property>
>>>
>>> Appreciate for any inputs.
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>
>
>
> --
> Zhijie Shen
> Hortonworks Inc.
> http://hortonworks.com/
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Container states trantition questions
Posted by Azuryy Yu <az...@gmail.com>.
Hi Zhijie,
Yes, I opened debug level, and looked through RM, AM, container's logs,
container always receive SIGTERM(15) after transition to FINISHED, webUI
just shows the diagnostics message.
Thanks Zhijie.
On Thu, Apr 3, 2014 at 2:00 PM, Zhijie Shen <zs...@hortonworks.com> wrote:
> It should be normal. If you can check the diagnostics of the container, it
> is likely that you will see "Container killed by the ApplicationMaster." MR
> AM will stop the container when a task is finished.
>
> Thanks,
> Zhijie
>
>
> On Wed, Apr 2, 2014 at 7:22 PM, Fengyun RAO <ra...@gmail.com> wrote:
>
>> same for me. all mapper ends with 143.
>>
>> I've no idea what it means
>>
>>
>> 2014-04-03 8:45 GMT+08:00 Azuryy Yu <az...@gmail.com>:
>>
>> Hi,
>>>
>>> Does it normal for each container end with TERMINATED(143) ?
>>> The whole MR job is successful, but all containers in the map phase end
>>> with 143.
>>>
>>> There are no any useful logs in the NM, AM, Container logs.
>>>
>>> Another minor question:
>>> There are only WARN logs in the stderr:
>>> log4j:WARN No appenders could be found for logger
>>> (org.apache.hadoop.metrics2.impl.MetricsSystemImpl).
>>> log4j:WARN Please initialize the log4j system properly.
>>> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfigfor more info.
>>> It seems cannot find log4j.propertites, but I've configured:
>>> <property>
>>> <name>mapreduce.application.classpath</name>
>>>
>>> <value>$HADOOP_MAPRED_HOME/conf,$HADOOP_MAPRED_HOME/*,$HADOOP_MAPRED_HOME/lib/*</value>
>>> </property>
>>> <property>
>>> <name>yarn.application.classpath</name>
>>>
>>> <value>$HADOOP_COMMON_HOME/conf,$HADOOP_COMMON_HOME/*,$HADOOP_COMMON_HOME/lib/*</value>
>>> </property>
>>>
>>> Appreciate for any inputs.
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>
>
>
> --
> Zhijie Shen
> Hortonworks Inc.
> http://hortonworks.com/
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Container states trantition questions
Posted by Zhijie Shen <zs...@hortonworks.com>.
It should be normal. If you can check the diagnostics of the container, it
is likely that you will see "Container killed by the ApplicationMaster." MR
AM will stop the container when a task is finished.
Thanks,
Zhijie
On Wed, Apr 2, 2014 at 7:22 PM, Fengyun RAO <ra...@gmail.com> wrote:
> same for me. all mapper ends with 143.
>
> I've no idea what it means
>
>
> 2014-04-03 8:45 GMT+08:00 Azuryy Yu <az...@gmail.com>:
>
> Hi,
>>
>> Does it normal for each container end with TERMINATED(143) ?
>> The whole MR job is successful, but all containers in the map phase end
>> with 143.
>>
>> There are no any useful logs in the NM, AM, Container logs.
>>
>> Another minor question:
>> There are only WARN logs in the stderr:
>> log4j:WARN No appenders could be found for logger
>> (org.apache.hadoop.metrics2.impl.MetricsSystemImpl).
>> log4j:WARN Please initialize the log4j system properly.
>> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
>> more info.
>> It seems cannot find log4j.propertites, but I've configured:
>> <property>
>> <name>mapreduce.application.classpath</name>
>>
>> <value>$HADOOP_MAPRED_HOME/conf,$HADOOP_MAPRED_HOME/*,$HADOOP_MAPRED_HOME/lib/*</value>
>> </property>
>> <property>
>> <name>yarn.application.classpath</name>
>>
>> <value>$HADOOP_COMMON_HOME/conf,$HADOOP_COMMON_HOME/*,$HADOOP_COMMON_HOME/lib/*</value>
>> </property>
>>
>> Appreciate for any inputs.
>>
>>
>>
>>
>>
>>
>>
>
--
Zhijie Shen
Hortonworks Inc.
http://hortonworks.com/
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Container states trantition questions
Posted by Zhijie Shen <zs...@hortonworks.com>.
It should be normal. If you can check the diagnostics of the container, it
is likely that you will see "Container killed by the ApplicationMaster." MR
AM will stop the container when a task is finished.
Thanks,
Zhijie
On Wed, Apr 2, 2014 at 7:22 PM, Fengyun RAO <ra...@gmail.com> wrote:
> same for me. all mapper ends with 143.
>
> I've no idea what it means
>
>
> 2014-04-03 8:45 GMT+08:00 Azuryy Yu <az...@gmail.com>:
>
> Hi,
>>
>> Does it normal for each container end with TERMINATED(143) ?
>> The whole MR job is successful, but all containers in the map phase end
>> with 143.
>>
>> There are no any useful logs in the NM, AM, Container logs.
>>
>> Another minor question:
>> There are only WARN logs in the stderr:
>> log4j:WARN No appenders could be found for logger
>> (org.apache.hadoop.metrics2.impl.MetricsSystemImpl).
>> log4j:WARN Please initialize the log4j system properly.
>> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
>> more info.
>> It seems cannot find log4j.propertites, but I've configured:
>> <property>
>> <name>mapreduce.application.classpath</name>
>>
>> <value>$HADOOP_MAPRED_HOME/conf,$HADOOP_MAPRED_HOME/*,$HADOOP_MAPRED_HOME/lib/*</value>
>> </property>
>> <property>
>> <name>yarn.application.classpath</name>
>>
>> <value>$HADOOP_COMMON_HOME/conf,$HADOOP_COMMON_HOME/*,$HADOOP_COMMON_HOME/lib/*</value>
>> </property>
>>
>> Appreciate for any inputs.
>>
>>
>>
>>
>>
>>
>>
>
--
Zhijie Shen
Hortonworks Inc.
http://hortonworks.com/
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Container states trantition questions
Posted by Zhijie Shen <zs...@hortonworks.com>.
It should be normal. If you can check the diagnostics of the container, it
is likely that you will see "Container killed by the ApplicationMaster." MR
AM will stop the container when a task is finished.
Thanks,
Zhijie
On Wed, Apr 2, 2014 at 7:22 PM, Fengyun RAO <ra...@gmail.com> wrote:
> same for me. all mapper ends with 143.
>
> I've no idea what it means
>
>
> 2014-04-03 8:45 GMT+08:00 Azuryy Yu <az...@gmail.com>:
>
> Hi,
>>
>> Does it normal for each container end with TERMINATED(143) ?
>> The whole MR job is successful, but all containers in the map phase end
>> with 143.
>>
>> There are no any useful logs in the NM, AM, Container logs.
>>
>> Another minor question:
>> There are only WARN logs in the stderr:
>> log4j:WARN No appenders could be found for logger
>> (org.apache.hadoop.metrics2.impl.MetricsSystemImpl).
>> log4j:WARN Please initialize the log4j system properly.
>> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
>> more info.
>> It seems cannot find log4j.propertites, but I've configured:
>> <property>
>> <name>mapreduce.application.classpath</name>
>>
>> <value>$HADOOP_MAPRED_HOME/conf,$HADOOP_MAPRED_HOME/*,$HADOOP_MAPRED_HOME/lib/*</value>
>> </property>
>> <property>
>> <name>yarn.application.classpath</name>
>>
>> <value>$HADOOP_COMMON_HOME/conf,$HADOOP_COMMON_HOME/*,$HADOOP_COMMON_HOME/lib/*</value>
>> </property>
>>
>> Appreciate for any inputs.
>>
>>
>>
>>
>>
>>
>>
>
--
Zhijie Shen
Hortonworks Inc.
http://hortonworks.com/
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Container states trantition questions
Posted by Zhijie Shen <zs...@hortonworks.com>.
It should be normal. If you can check the diagnostics of the container, it
is likely that you will see "Container killed by the ApplicationMaster." MR
AM will stop the container when a task is finished.
Thanks,
Zhijie
On Wed, Apr 2, 2014 at 7:22 PM, Fengyun RAO <ra...@gmail.com> wrote:
> same for me. all mapper ends with 143.
>
> I've no idea what it means
>
>
> 2014-04-03 8:45 GMT+08:00 Azuryy Yu <az...@gmail.com>:
>
> Hi,
>>
>> Does it normal for each container end with TERMINATED(143) ?
>> The whole MR job is successful, but all containers in the map phase end
>> with 143.
>>
>> There are no any useful logs in the NM, AM, Container logs.
>>
>> Another minor question:
>> There are only WARN logs in the stderr:
>> log4j:WARN No appenders could be found for logger
>> (org.apache.hadoop.metrics2.impl.MetricsSystemImpl).
>> log4j:WARN Please initialize the log4j system properly.
>> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
>> more info.
>> It seems cannot find log4j.propertites, but I've configured:
>> <property>
>> <name>mapreduce.application.classpath</name>
>>
>> <value>$HADOOP_MAPRED_HOME/conf,$HADOOP_MAPRED_HOME/*,$HADOOP_MAPRED_HOME/lib/*</value>
>> </property>
>> <property>
>> <name>yarn.application.classpath</name>
>>
>> <value>$HADOOP_COMMON_HOME/conf,$HADOOP_COMMON_HOME/*,$HADOOP_COMMON_HOME/lib/*</value>
>> </property>
>>
>> Appreciate for any inputs.
>>
>>
>>
>>
>>
>>
>>
>
--
Zhijie Shen
Hortonworks Inc.
http://hortonworks.com/
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Container states trantition questions
Posted by Fengyun RAO <ra...@gmail.com>.
same for me. all mapper ends with 143.
I've no idea what it means
2014-04-03 8:45 GMT+08:00 Azuryy Yu <az...@gmail.com>:
> Hi,
>
> Does it normal for each container end with TERMINATED(143) ?
> The whole MR job is successful, but all containers in the map phase end
> with 143.
>
> There are no any useful logs in the NM, AM, Container logs.
>
> Another minor question:
> There are only WARN logs in the stderr:
> log4j:WARN No appenders could be found for logger
> (org.apache.hadoop.metrics2.impl.MetricsSystemImpl).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
> more info.
> It seems cannot find log4j.propertites, but I've configured:
> <property>
> <name>mapreduce.application.classpath</name>
>
> <value>$HADOOP_MAPRED_HOME/conf,$HADOOP_MAPRED_HOME/*,$HADOOP_MAPRED_HOME/lib/*</value>
> </property>
> <property>
> <name>yarn.application.classpath</name>
>
> <value>$HADOOP_COMMON_HOME/conf,$HADOOP_COMMON_HOME/*,$HADOOP_COMMON_HOME/lib/*</value>
> </property>
>
> Appreciate for any inputs.
>
>
>
>
>
>
>
Re: Container states trantition questions
Posted by Fengyun RAO <ra...@gmail.com>.
same for me. all mapper ends with 143.
I've no idea what it means
2014-04-03 8:45 GMT+08:00 Azuryy Yu <az...@gmail.com>:
> Hi,
>
> Does it normal for each container end with TERMINATED(143) ?
> The whole MR job is successful, but all containers in the map phase end
> with 143.
>
> There are no any useful logs in the NM, AM, Container logs.
>
> Another minor question:
> There are only WARN logs in the stderr:
> log4j:WARN No appenders could be found for logger
> (org.apache.hadoop.metrics2.impl.MetricsSystemImpl).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
> more info.
> It seems cannot find log4j.propertites, but I've configured:
> <property>
> <name>mapreduce.application.classpath</name>
>
> <value>$HADOOP_MAPRED_HOME/conf,$HADOOP_MAPRED_HOME/*,$HADOOP_MAPRED_HOME/lib/*</value>
> </property>
> <property>
> <name>yarn.application.classpath</name>
>
> <value>$HADOOP_COMMON_HOME/conf,$HADOOP_COMMON_HOME/*,$HADOOP_COMMON_HOME/lib/*</value>
> </property>
>
> Appreciate for any inputs.
>
>
>
>
>
>
>
Re: Container states trantition questions
Posted by Fengyun RAO <ra...@gmail.com>.
same for me. all mapper ends with 143.
I've no idea what it means
2014-04-03 8:45 GMT+08:00 Azuryy Yu <az...@gmail.com>:
> Hi,
>
> Does it normal for each container end with TERMINATED(143) ?
> The whole MR job is successful, but all containers in the map phase end
> with 143.
>
> There are no any useful logs in the NM, AM, Container logs.
>
> Another minor question:
> There are only WARN logs in the stderr:
> log4j:WARN No appenders could be found for logger
> (org.apache.hadoop.metrics2.impl.MetricsSystemImpl).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
> more info.
> It seems cannot find log4j.propertites, but I've configured:
> <property>
> <name>mapreduce.application.classpath</name>
>
> <value>$HADOOP_MAPRED_HOME/conf,$HADOOP_MAPRED_HOME/*,$HADOOP_MAPRED_HOME/lib/*</value>
> </property>
> <property>
> <name>yarn.application.classpath</name>
>
> <value>$HADOOP_COMMON_HOME/conf,$HADOOP_COMMON_HOME/*,$HADOOP_COMMON_HOME/lib/*</value>
> </property>
>
> Appreciate for any inputs.
>
>
>
>
>
>
>
Re: Container states trantition questions
Posted by Fengyun RAO <ra...@gmail.com>.
same for me. all mapper ends with 143.
I've no idea what it means
2014-04-03 8:45 GMT+08:00 Azuryy Yu <az...@gmail.com>:
> Hi,
>
> Does it normal for each container end with TERMINATED(143) ?
> The whole MR job is successful, but all containers in the map phase end
> with 143.
>
> There are no any useful logs in the NM, AM, Container logs.
>
> Another minor question:
> There are only WARN logs in the stderr:
> log4j:WARN No appenders could be found for logger
> (org.apache.hadoop.metrics2.impl.MetricsSystemImpl).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
> more info.
> It seems cannot find log4j.propertites, but I've configured:
> <property>
> <name>mapreduce.application.classpath</name>
>
> <value>$HADOOP_MAPRED_HOME/conf,$HADOOP_MAPRED_HOME/*,$HADOOP_MAPRED_HOME/lib/*</value>
> </property>
> <property>
> <name>yarn.application.classpath</name>
>
> <value>$HADOOP_COMMON_HOME/conf,$HADOOP_COMMON_HOME/*,$HADOOP_COMMON_HOME/lib/*</value>
> </property>
>
> Appreciate for any inputs.
>
>
>
>
>
>
>