You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Balaji Rajagopalan (JIRA)" <ji...@apache.org> on 2010/07/13 10:33:51 UTC

[jira] Commented: (MAPREDUCE-1933) Create automated testcase for tasktracker dealing with corrupted disk.

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12887690#action_12887690 ] 

Balaji Rajagopalan commented on MAPREDUCE-1933:
-----------------------------------------------

You have attached the java file, remember to create a patch. 

   prop.put("mapred.local.dir", 
      "/grid/0/dev/tmp/mapred/mapred-local,/grid/1/dev/tmp/mapred/mapred-local,/grid/2/dev/tmp/mapred/mapred-local,/grid/3/dev/tmp/mapred/mapred-local");

Please don't hard code cluster dependent values, have them come from config file. 

    //Making sure that the job is complete.
    while (jInfo != null && !jInfo.getStatus().isJobComplete()) {
      Thread.sleep(10000);
      jInfo = remoteJTClient.getJobInfo(id);
      jStatus = jInfo.getStatus();
    }

Please use the building block JTClient::isJobStopped. 

> Create automated testcase for tasktracker dealing with corrupted disk.
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1933
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1933
>             Project: Hadoop Map/Reduce
>          Issue Type: Test
>          Components: test
>            Reporter: Iyappan Srinivasan
>            Assignee: Iyappan Srinivasan
>         Attachments: TestCorruptedDiskJob.java
>
>
> After the TaskTracker has already run some tasks successfully, "corrupt" a disk by making the corresponding mapred.local.dir unreadable/unwritable. 
> Make sure that jobs continue to succeed even though some tasks scheduled there fail. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.