[jira] [Created] (MAPREDUCE-5909) JobStatus contains 0.0 values of mapProgress, reduceProgress, setupProgress, cleanupProgress

["Victor Kim (JIRA)" <ji...@apache.org>]

Victor Kim created MAPREDUCE-5909:
-------------------------------------

             Summary: JobStatus contains 0.0 values of mapProgress, reduceProgress, setupProgress, cleanupProgress
                 Key: MAPREDUCE-5909
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5909
             Project: Hadoop Map/Reduce
          Issue Type: Bug
    Affects Versions: 2.4.0
            Reporter: Victor Kim


When I invoke getAllJobs on a JobClient object, I'm receiving an array of JobStatuses. JobStatus object arrives with fields mapProgress, reduceProgress, setupProgress, cleanupProgress with 0.0 values. So, I'm not able to track the map and reduce job progress through the client.

Seems that because YARN supports variety of applications (not only MR), ApplicationReport object doesn't contain mapProgress and ReduceProgress. Instead it contains just progress. Apparently this led to following code during converting from ApplicationReport to JobStatus object to do following:

{code:title=TypeConverter.java|borderStyle=solid}
public static JobStatus fromYarn(ApplicationReport application, String jobFile) {
//... Some code here
JobStatus jobStatus =
      new JobStatus(
          TypeConverter.fromYarn(application.getApplicationId()),
          0.0f, 0.0f, 0.0f, 0.0f,
          TypeConverter.fromYarn(application.getYarnApplicationState(), application.getFinalApplicationStatus()),
          org.apache.hadoop.mapreduce.JobPriority.NORMAL,
          application.getUser(), application.getName(),
          application.getQueue(), jobFile, trackingUrl, false
      );

//... Some code here
}
{code}




--
This message was sent by Atlassian JIRA
(v6.2#6252)