You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "JasonZhu (JIRA)" <ji...@apache.org> on 2014/11/12 09:29:34 UTC

[jira] [Updated] (MAPREDUCE-6159) No log of JobHistory found in all logs files

     [ https://issues.apache.org/jira/browse/MAPREDUCE-6159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

JasonZhu updated MAPREDUCE-6159:
--------------------------------
    Summary: No log of JobHistory found in all logs files  (was: No log of JobHistory found in every logs.)

> No log of JobHistory found in all logs files
> --------------------------------------------
>
>                 Key: MAPREDUCE-6159
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6159
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobhistoryserver, mrv2
>    Affects Versions: 2.2.0
>         Environment: Hadoop-2.2.0
>            Reporter: JasonZhu
>
> I intend to dig into 'mapreduce.jobhistory.intermediate-done-dir' argument, the position of which is at `JHAdminConfig:73`, to get some comprehension on history server. This argument is referenced at `JobHistoryEventHandler.moveToDoneNow()`, where history server moves job summary file 
> from "$[yarn.app.mapreduce.am.staging-dir]/$[user]/.staging" to "$[mapreduce.jobhistory.intermediate-done-dir]/$[user]". 
> Since the following code snippet in `moveToDoneNow()` will definitely write some logs out to log file, but I can found no any sign of it in all logs in $HADOOP_LOG_DIR via command `grep "Copied to done location" *`.
>     if (copied)
>         LOG.info("Copied to done location: " + toPath);
>     else 
>         LOG.info("copy failed");
> Is there anything that I missed?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)