You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Chao Tian (JIRA)" <ji...@apache.org> on 2014/06/16 19:04:01 UTC

[jira] [Created] (MAPREDUCE-5929) YARNRunner.java, path for jobJarPath not set correctly

Chao Tian created MAPREDUCE-5929:
------------------------------------

             Summary: YARNRunner.java, path for jobJarPath not set correctly
                 Key: MAPREDUCE-5929
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5929
             Project: Hadoop Map/Reduce
          Issue Type: Bug
    Affects Versions: 2.2.0
            Reporter: Chao Tian


In YARNRunner.java, line 357,

Path jobJarPath = new Path(jobConf.get(MRJobConfig.JAR));

This causes the job.jar file to miss scheme, host and port number on distributed file systems other than hdfs. 

If we compare line 357 with line 344, there "job.xml" is actually set as
 
Path jobConfPath = new Path(jobSubmitDir,MRJobConfig.JOB_CONF_FILE);

It appears "jobSubmitDir" is missing on line 357, which causes this problem. In hdfs, the additional qualify process will correct this problem, but not other generic distributed file systems.

The proposed change is to replace 35 7 with

Path jobJarPath = new Path(jobConf.get(jobSubmitDir,MRJobConfig.JAR));

 





--
This message was sent by Atlassian JIRA
(v6.2#6252)