[jira] [Commented] (MAPREDUCE-4119) [jobhistory] job history server can not support mutiple yarn.app.mapreduce.am.staging-dir directorys.

["xieguiming (Commented) (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/MAPREDUCE-4119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249224#comment-13249224 ] 

xieguiming commented on MAPREDUCE-4119:
---------------------------------------

this is the job history server the the intermediateDoneDirPath dir logic.

and the intermediateDoneDirPath value from the local conf. and the local conf maybe different with the real job yarn.app.mapreduce.am.staging-dir.


{code:title=JobHistoryUtils.java|borderStyle=solid}

  public static String getConfiguredHistoryIntermediateDoneDirPrefix(
      Configuration conf) {
    String doneDirPrefix = conf
        .get(JHAdminConfig.MR_HISTORY_INTERMEDIATE_DONE_DIR);
    if (doneDirPrefix == null) {
      doneDirPrefix = conf.get(MRJobConfig.MR_AM_STAGING_DIR,
          MRJobConfig.DEFAULT_MR_AM_STAGING_DIR)
          + "/history/done_intermediate";
    }
    return doneDirPrefix;
  }

{code}



                
> [jobhistory]  job history server can not support mutiple  yarn.app.mapreduce.am.staging-dir   directorys.
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-4119
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4119
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobhistoryserver
>    Affects Versions: 0.23.1
>         Environment: suse
>            Reporter: xieguiming
>
> jobclient can set the yarn.app.mapreduce.am.staging-dir value , but jobhistoryserver only read the yarn.app.mapreduce.am.staging-dir  value from conf.
> so, if client set different yarn.app.mapreduce.am.staging-dir value, and the jobhistoryserver can not scan the directory.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira