You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Koji Noguchi (JIRA)" <ji...@apache.org> on 2007/10/03 21:54:50 UTC
[jira] Created: (HADOOP-1991) Task startup fail when localizeTask
directory is full
Task startup fail when localizeTask directory is full
-----------------------------------------------------
Key: HADOOP-1991
URL: https://issues.apache.org/jira/browse/HADOOP-1991
Project: Hadoop
Issue Type: Bug
Components: mapred
Reporter: Koji Noguchi
Priority: Minor
Fix For: 0.16.0
We had a job filling up one particular drive (different bug) that resulted in all the subsequent tasks on that node to fail with
java.io.IOException: Mkdirs failed to create /vol2/mapred-tt/mapred-local/taskTracker/jobcache/job_200710030011_0001/task_200710030011_0001_m_007363_0
at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:1284)
at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:1344)
at org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:647)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:640)
at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1167)
at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:832)
at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:1203)
at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1888)
It'll be nice if localization also uses localdirallocator to utilize multiple disks.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Reopened: (HADOOP-1991) Task startup fail when localizeTask
directory is full
Posted by "Amareshwari Sri Ramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sri Ramadasu reopened HADOOP-1991:
----------------------------------------------
> Task startup fail when localizeTask directory is full
> -----------------------------------------------------
>
> Key: HADOOP-1991
> URL: https://issues.apache.org/jira/browse/HADOOP-1991
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Reporter: Koji Noguchi
> Assignee: Amareshwari Sri Ramadasu
> Priority: Minor
> Fix For: 0.16.0
>
>
> We had a job filling up one particular drive (different bug) that resulted in all the subsequent tasks on that node to fail with
> java.io.IOException: Mkdirs failed to create /vol2/mapred-tt/mapred-local/taskTracker/jobcache/job_200710030011_0001/task_200710030011_0001_m_007363_0
> at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:1284)
> at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:1344)
> at org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:647)
> at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:640)
> at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1167)
> at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:832)
> at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:1203)
> at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1888)
> It'll be nice if localization also uses localdirallocator to utilize multiple disks.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HADOOP-1991) Task startup fail when localizeTask
directory is full
Posted by "Amareshwari Sri Ramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sri Ramadasu resolved HADOOP-1991.
----------------------------------------------
Resolution: Fixed
Assignee: Amareshwari Sri Ramadasu
Fixed by HADOOP-2227
> Task startup fail when localizeTask directory is full
> -----------------------------------------------------
>
> Key: HADOOP-1991
> URL: https://issues.apache.org/jira/browse/HADOOP-1991
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Reporter: Koji Noguchi
> Assignee: Amareshwari Sri Ramadasu
> Priority: Minor
> Fix For: 0.16.0
>
>
> We had a job filling up one particular drive (different bug) that resulted in all the subsequent tasks on that node to fail with
> java.io.IOException: Mkdirs failed to create /vol2/mapred-tt/mapred-local/taskTracker/jobcache/job_200710030011_0001/task_200710030011_0001_m_007363_0
> at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:1284)
> at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:1344)
> at org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:647)
> at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:640)
> at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1167)
> at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:832)
> at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:1203)
> at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1888)
> It'll be nice if localization also uses localdirallocator to utilize multiple disks.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1991) Task startup fail when localizeTask
directory is full
Posted by "Amareshwari Sri Ramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12555817#action_12555817 ]
Amareshwari Sri Ramadasu commented on HADOOP-1991:
--------------------------------------------------
This has been fixed by HADOOP-2227.
> Task startup fail when localizeTask directory is full
> -----------------------------------------------------
>
> Key: HADOOP-1991
> URL: https://issues.apache.org/jira/browse/HADOOP-1991
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Reporter: Koji Noguchi
> Priority: Minor
> Fix For: 0.16.0
>
>
> We had a job filling up one particular drive (different bug) that resulted in all the subsequent tasks on that node to fail with
> java.io.IOException: Mkdirs failed to create /vol2/mapred-tt/mapred-local/taskTracker/jobcache/job_200710030011_0001/task_200710030011_0001_m_007363_0
> at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:1284)
> at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:1344)
> at org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:647)
> at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:640)
> at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1167)
> at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:832)
> at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:1203)
> at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1888)
> It'll be nice if localization also uses localdirallocator to utilize multiple disks.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HADOOP-1991) Task startup fail when localizeTask
directory is full
Posted by "Amareshwari Sri Ramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sri Ramadasu resolved HADOOP-1991.
----------------------------------------------
Resolution: Duplicate
> Task startup fail when localizeTask directory is full
> -----------------------------------------------------
>
> Key: HADOOP-1991
> URL: https://issues.apache.org/jira/browse/HADOOP-1991
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Reporter: Koji Noguchi
> Assignee: Amareshwari Sri Ramadasu
> Priority: Minor
> Fix For: 0.16.0
>
>
> We had a job filling up one particular drive (different bug) that resulted in all the subsequent tasks on that node to fail with
> java.io.IOException: Mkdirs failed to create /vol2/mapred-tt/mapred-local/taskTracker/jobcache/job_200710030011_0001/task_200710030011_0001_m_007363_0
> at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:1284)
> at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:1344)
> at org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:647)
> at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:640)
> at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1167)
> at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:832)
> at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:1203)
> at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1888)
> It'll be nice if localization also uses localdirallocator to utilize multiple disks.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.