You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "JasonZhu (JIRA)" <ji...@apache.org> on 2014/11/12 09:15:34 UTC

[jira] [Created] (MAPREDUCE-6159) No log of JobHistory found in every logs.

JasonZhu created MAPREDUCE-6159:
-----------------------------------

             Summary: No log of JobHistory found in every logs.
                 Key: MAPREDUCE-6159
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6159
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: jobhistoryserver, mrv2
    Affects Versions: 2.2.0
         Environment: Hadoop-2.2.0

            Reporter: JasonZhu


I intend to dig into 'mapreduce.jobhistory.intermediate-done-dir' argument, the position of which is at `JHAdminConfig:73`, to get some comprehension on history server. This argument is referenced at `JobHistoryEventHandler.moveToDoneNow()`, where history server moves job summary file from "${yarn.app.mapreduce.am.staging-dir}/${user}/.staging" to "${mapreduce.jobhistory.intermediate-done-dir}/${user}". 

Since the following code snippet in `moveToDoneNow()` will definitely write some logs out to log file, but I can found no any sign of it in all logs in $HADOOP_LOG_DIR via command `grep "Copied to done location" *`.
    if (copied)
        LOG.info("Copied to done location: " + toPath);
    else 
        LOG.info("copy failed");

Is there anything that I missed?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)