You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by "Bharath Mundlapudi (JIRA)" <ji...@apache.org> on 2011/04/01 10:04:05 UTC

[jira] [Created] (MAPREDUCE-2415) Distribute TaskTracker userlogs onto multiple disks

Distribute TaskTracker userlogs onto multiple disks
---------------------------------------------------

                 Key: MAPREDUCE-2415
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2415
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: task-controller, tasktracker
    Affects Versions: 0.20.204.0
            Reporter: Bharath Mundlapudi
            Assignee: Bharath Mundlapudi
             Fix For: 0.20.204.0


Currently, userlogs directory in TaskTracker is placed under hadoop.log.dir like <hadoop.log.dir>/userlogs. I am proposing to spread these userlogs onto multiple configured mapred.local.dirs to strengthen TaskTracker reliability w.r.t disk failures.  

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (MAPREDUCE-2415) Distribute TaskTracker userlogs onto multiple disks

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-2415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Owen O'Malley resolved MAPREDUCE-2415.
--------------------------------------

      Resolution: Fixed
    Hadoop Flags: [Reviewed]

I just committed this to 204. Thanks, Bharath!

> Distribute TaskTracker userlogs onto multiple disks
> ---------------------------------------------------
>
>                 Key: MAPREDUCE-2415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: task-controller, tasktracker
>    Affects Versions: 0.20.204.0
>            Reporter: Bharath Mundlapudi
>            Assignee: Bharath Mundlapudi
>             Fix For: 0.20.204.0
>
>         Attachments: MAPREDUCE-2415-1.patch, MAPREDUCE-2415-2.patch, MAPREDUCE-2415-3.patch, TaskTracker Userlogs Design.pdf
>
>
> Currently, userlogs directory in TaskTracker is placed under hadoop.log.dir like <hadoop.log.dir>/userlogs. I am proposing to spread these userlogs onto multiple configured mapred.local.dirs to strengthen TaskTracker reliability w.r.t disk failures.  

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira