You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Ravi Gummadi (Commented) (JIRA)" <ji...@apache.org> on 2012/03/01 09:30:02 UTC

[jira] [Commented] (MAPREDUCE-3953) Gridmix throws NPE and does not simulate a job if the trace contains null taskStatus for a task

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13219902#comment-13219902 ] 

Ravi Gummadi commented on MAPREDUCE-3953:
-----------------------------------------

My proposal is to fix the NPE issue and allow Gridmix to simulate such jobs ( succeeded-jobs-with-task-failures of trace file). Because, currently Gridmix doesn't simulate failed tasks, those tasks will pass in simulated job and their inputDataSize and outputDataSize is assumed to be zero.
                
> Gridmix throws NPE and does not simulate a job if the trace contains null taskStatus for a task
> -----------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3953
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3953
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>
> In a trace file, if a succeeded job contains a failed task, then that task's taskStatus will be null. This is causing NPE in Gridmix and then Gridmix is ignoring/not-considering such jobs for simulation. The job could succeed even with failed tasks if the job submitter in original cluster configured that job to tolerate failures using mapreduce.map.failures.maxpercent and mapreduce.reduce.failures.maxpercent.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira