You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Chao Tian (JIRA)" <ji...@apache.org> on 2014/06/16 19:04:01 UTC
[jira] [Created] (MAPREDUCE-5929) YARNRunner.java, path for
jobJarPath not set correctly
Chao Tian created MAPREDUCE-5929:
------------------------------------
Summary: YARNRunner.java, path for jobJarPath not set correctly
Key: MAPREDUCE-5929
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5929
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 2.2.0
Reporter: Chao Tian
In YARNRunner.java, line 357,
Path jobJarPath = new Path(jobConf.get(MRJobConfig.JAR));
This causes the job.jar file to miss scheme, host and port number on distributed file systems other than hdfs.
If we compare line 357 with line 344, there "job.xml" is actually set as
Path jobConfPath = new Path(jobSubmitDir,MRJobConfig.JOB_CONF_FILE);
It appears "jobSubmitDir" is missing on line 357, which causes this problem. In hdfs, the additional qualify process will correct this problem, but not other generic distributed file systems.
The proposed change is to replace 35 7 with
Path jobJarPath = new Path(jobConf.get(jobSubmitDir,MRJobConfig.JAR));
--
This message was sent by Atlassian JIRA
(v6.2#6252)