You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "eric baldeschwieler (JIRA)" <ji...@apache.org> on 2006/06/30 22:22:29 UTC

[jira] Created: (HADOOP-336) The task tracker should track disk space used, and have a configurable cap

The task tracker should track disk space used, and have a configurable cap
--------------------------------------------------------------------------

         Key: HADOOP-336
         URL: http://issues.apache.org/jira/browse/HADOOP-336
     Project: Hadoop
        Type: Improvement

  Components: mapred  
    Reporter: eric baldeschwieler


We've been having problems where the task tracker is destabilizing HDFS by filling disks and then releasing them.  Various tasks can also interfere with each other this way.

We should have a configurable max working space for a task (and allow the setting of lower per task limits).  The task tracker should track use against this limit and terminate a job if it overruns it.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira

[jira] Resolved: (HADOOP-336) The task tracker should track disk space used, and have a configurable cap

Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
     [ http://issues.apache.org/jira/browse/HADOOP-336?page=all ]

Owen O'Malley resolved HADOOP-336.
----------------------------------

    Fix Version/s: 0.4.0
       Resolution: Duplicate

this was fixed by HADOOP-27

> The task tracker should track disk space used, and have a configurable cap
> --------------------------------------------------------------------------
>
>                 Key: HADOOP-336
>                 URL: http://issues.apache.org/jira/browse/HADOOP-336
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: mapred
>            Reporter: eric baldeschwieler
>             Fix For: 0.4.0
>
>
> We've been having problems where the task tracker is destabilizing HDFS by filling disks and then releasing them.  Various tasks can also interfere with each other this way.
> We should have a configurable max working space for a task (and allow the setting of lower per task limits).  The task tracker should track use against this limit and terminate a job if it overruns it.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira