You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Prashant Kommireddi <pr...@gmail.com> on 2014/05/28 23:53:17 UTC

ProcfsBasedProcessTree

What's does ProcfsBasedProcessTree do? Trying to understand a bunch of
these messages in the logs of a job that is stuck forever

May 25, 2014 4:01:51 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
constructProcessInfo
INFO: The process 22793 may have finished in the interim.
May 25, 2014 9:21:52 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
constructProcessInfo
INFO: The process 24972 may have finished in the interim.
May 25, 2014 1:20:50 PM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
constructProcessInfo
INFO: The process 10420 may have finished in the interim.
May 26, 2014 9:33:51 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
constructProcessInfo
INFO: The process 13065 may have finished in the interim.
May 26, 2014 10:21:52 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
constructProcessInfo
INFO: The process 8191 may have finished in the interim.
May 27, 2014 5:12:52 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
constructProcessInfo
INFO: The process 13768 may have finished in the interim.
May 27, 2014 5:12:52 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
constructProcessInfo
INFO: The process 13769 may have finished in the interim.
May 27, 2014 6:55:50 PM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
constructProcessInfo
INFO: The process 16465 may have finished in the interim.
May 27, 2014 7:51:51 PM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
constructProcessInfo
INFO: The process 1575 may have finished in the interim.
May 27, 2014 7:51:51 PM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
constructProcessInfo
INFO: The process 1576 may have finished in the interim.

Re: ProcfsBasedProcessTree

Posted by Tsuyoshi OZAWA <oz...@gmail.com>.
Hi,

The log messages mean ProcfsBasedProcessTree just updates internal
information via procfs. The redundant log message is suppressed after
2.1.0-beta, 0.23.8. For more detail, please check YARN-476.

Thanks,
- Tsuyoshi

On Wed, May 28, 2014 at 2:53 PM, Prashant Kommireddi
<pr...@gmail.com> wrote:
> What's does ProcfsBasedProcessTree do? Trying to understand a bunch of these
> messages in the logs of a job that is stuck forever
>
> May 25, 2014 4:01:51 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 22793 may have finished in the interim.
> May 25, 2014 9:21:52 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 24972 may have finished in the interim.
> May 25, 2014 1:20:50 PM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 10420 may have finished in the interim.
> May 26, 2014 9:33:51 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 13065 may have finished in the interim.
> May 26, 2014 10:21:52 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 8191 may have finished in the interim.
> May 27, 2014 5:12:52 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 13768 may have finished in the interim.
> May 27, 2014 5:12:52 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 13769 may have finished in the interim.
> May 27, 2014 6:55:50 PM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 16465 may have finished in the interim.
> May 27, 2014 7:51:51 PM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 1575 may have finished in the interim.
> May 27, 2014 7:51:51 PM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 1576 may have finished in the interim.
>



-- 
- Tsuyoshi

Re: ProcfsBasedProcessTree

Posted by Tsuyoshi OZAWA <oz...@gmail.com>.
Hi,

The log messages mean ProcfsBasedProcessTree just updates internal
information via procfs. The redundant log message is suppressed after
2.1.0-beta, 0.23.8. For more detail, please check YARN-476.

Thanks,
- Tsuyoshi

On Wed, May 28, 2014 at 2:53 PM, Prashant Kommireddi
<pr...@gmail.com> wrote:
> What's does ProcfsBasedProcessTree do? Trying to understand a bunch of these
> messages in the logs of a job that is stuck forever
>
> May 25, 2014 4:01:51 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 22793 may have finished in the interim.
> May 25, 2014 9:21:52 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 24972 may have finished in the interim.
> May 25, 2014 1:20:50 PM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 10420 may have finished in the interim.
> May 26, 2014 9:33:51 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 13065 may have finished in the interim.
> May 26, 2014 10:21:52 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 8191 may have finished in the interim.
> May 27, 2014 5:12:52 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 13768 may have finished in the interim.
> May 27, 2014 5:12:52 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 13769 may have finished in the interim.
> May 27, 2014 6:55:50 PM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 16465 may have finished in the interim.
> May 27, 2014 7:51:51 PM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 1575 may have finished in the interim.
> May 27, 2014 7:51:51 PM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 1576 may have finished in the interim.
>



-- 
- Tsuyoshi

Re: ProcfsBasedProcessTree

Posted by Tsuyoshi OZAWA <oz...@gmail.com>.
Hi,

The log messages mean ProcfsBasedProcessTree just updates internal
information via procfs. The redundant log message is suppressed after
2.1.0-beta, 0.23.8. For more detail, please check YARN-476.

Thanks,
- Tsuyoshi

On Wed, May 28, 2014 at 2:53 PM, Prashant Kommireddi
<pr...@gmail.com> wrote:
> What's does ProcfsBasedProcessTree do? Trying to understand a bunch of these
> messages in the logs of a job that is stuck forever
>
> May 25, 2014 4:01:51 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 22793 may have finished in the interim.
> May 25, 2014 9:21:52 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 24972 may have finished in the interim.
> May 25, 2014 1:20:50 PM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 10420 may have finished in the interim.
> May 26, 2014 9:33:51 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 13065 may have finished in the interim.
> May 26, 2014 10:21:52 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 8191 may have finished in the interim.
> May 27, 2014 5:12:52 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 13768 may have finished in the interim.
> May 27, 2014 5:12:52 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 13769 may have finished in the interim.
> May 27, 2014 6:55:50 PM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 16465 may have finished in the interim.
> May 27, 2014 7:51:51 PM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 1575 may have finished in the interim.
> May 27, 2014 7:51:51 PM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 1576 may have finished in the interim.
>



-- 
- Tsuyoshi

Re: ProcfsBasedProcessTree

Posted by Tsuyoshi OZAWA <oz...@gmail.com>.
Hi,

The log messages mean ProcfsBasedProcessTree just updates internal
information via procfs. The redundant log message is suppressed after
2.1.0-beta, 0.23.8. For more detail, please check YARN-476.

Thanks,
- Tsuyoshi

On Wed, May 28, 2014 at 2:53 PM, Prashant Kommireddi
<pr...@gmail.com> wrote:
> What's does ProcfsBasedProcessTree do? Trying to understand a bunch of these
> messages in the logs of a job that is stuck forever
>
> May 25, 2014 4:01:51 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 22793 may have finished in the interim.
> May 25, 2014 9:21:52 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 24972 may have finished in the interim.
> May 25, 2014 1:20:50 PM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 10420 may have finished in the interim.
> May 26, 2014 9:33:51 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 13065 may have finished in the interim.
> May 26, 2014 10:21:52 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 8191 may have finished in the interim.
> May 27, 2014 5:12:52 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 13768 may have finished in the interim.
> May 27, 2014 5:12:52 AM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 13769 may have finished in the interim.
> May 27, 2014 6:55:50 PM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 16465 may have finished in the interim.
> May 27, 2014 7:51:51 PM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 1575 may have finished in the interim.
> May 27, 2014 7:51:51 PM org.apache.hadoop.yarn.util.ProcfsBasedProcessTree
> constructProcessInfo
> INFO: The process 1576 may have finished in the interim.
>



-- 
- Tsuyoshi