You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org> on 2008/09/09 13:09:44 UTC
[jira] Created: (HADOOP-4127) TestHighRAMJobs fails on linux
TestHighRAMJobs fails on linux
------------------------------
Key: HADOOP-4127
URL: https://issues.apache.org/jira/browse/HADOOP-4127
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Affects Versions: 0.19.0
Reporter: Amareshwari Sriramadasu
Fix For: 0.19.0
TestHighRAMJobs fails on linux box with the following errors:
{noformat}
------------- ---------------- ---------------
------------- Standard Error -----------------
Waiting for the Mini HDFS Cluster to start...
Waiting for the Mini HDFS Cluster to start...
Waiting for the Mini HDFS Cluster to start...
TaskTree [pid=25566,tipID=attempt_200809091523_0001_m_000000_0] is running beyond memory-limits. Current usage : 358998016. Limit : 268435456. Killing task.
TaskTree [pid=25815,tipID=attempt_200809091523_0001_m_000000_1] is running beyond memory-limits. Current usage : 359047168. Limit : 268435456. Killing task.
TaskTree [pid=26110,tipID=attempt_200809091523_0001_m_000000_2] is running beyond memory-limits. Current usage : 360296448. Limit : 268435456. Killing task.
TaskTree [pid=26165,tipID=attempt_200809091523_0001_r_000000_0] is running beyond memory-limits. Current usage : 357711872. Limit : 268435456. Killing task.
TaskTree [pid=26251,tipID=attempt_200809091523_0001_m_000001_0] is running beyond memory-limits. Current usage : 352362496. Limit : 268435456. Killing task.
Waiting for the Mini HDFS Cluster to start...
TaskTree [pid=26473,tipID=attempt_200809091524_0001_m_000000_0] is running beyond memory-limits. Current usage : 358699008. Limit : 357913941. Killing task.
TaskTree [pid=26499,tipID=attempt_200809091524_0001_m_000000_1] is running beyond memory-limits. Current usage : 360230912. Limit : 357913941. Killing task.
TaskTree [pid=26528,tipID=attempt_200809091524_0001_m_000001_0] is running beyond memory-limits. Current usage : 358006784. Limit : 357913941. Killing task.
TaskTree [pid=26584,tipID=attempt_200809091524_0001_m_000000_2] is running beyond memory-limits. Current usage : 358866944. Limit : 357913941. Killing task.
TaskTree [pid=26638,tipID=attempt_200809091524_0001_m_000001_1] is running beyond memory-limits. Current usage : 358649856. Limit : 357913941. Killing task.
------------- ---------------- ---------------
Testcase: testDefaultValuesForHighRAMJobs took 22.564 sec
Testcase: testDefaultMemoryPerTask took 21.33 sec
Testcase: testConfiguredValueForFreeMemory took 52.748 sec
Caused an ERROR
Job failed!
java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1156)
at org.apache.hadoop.examples.SleepJob.run(SleepJob.java:174)
at org.apache.hadoop.examples.SleepJob.run(SleepJob.java:237)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.mapred.TestHighRAMJobs.launchSleepJob(TestHighRAMJobs.java:247)
at org.apache.hadoop.mapred.TestHighRAMJobs.runJob(TestHighRAMJobs.java:238)
at org.apache.hadoop.mapred.TestHighRAMJobs.testConfiguredValueForFreeMemory(TestHighRAMJobs.java:174)
Testcase: testHighRAMJob took 48.952 sec
Caused an ERROR
Job failed!
java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1156)
at org.apache.hadoop.examples.SleepJob.run(SleepJob.java:174)
at org.apache.hadoop.examples.SleepJob.run(SleepJob.java:237)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.mapred.TestHighRAMJobs.launchSleepJob(TestHighRAMJobs.java:247)
at org.apache.hadoop.mapred.TestHighRAMJobs.runJob(TestHighRAMJobs.java:238)
at org.apache.hadoop.mapred.TestHighRAMJobs.testHighRAMJob(TestHighRAMJobs.java:198)
{noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4127) TestHighRAMJobs fails on linux
Posted by "Suman Sehgal (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12629461#action_12629461 ]
Suman Sehgal commented on HADOOP-4127:
--------------------------------------
Unit test on trunk is also failing due to the same issue i.e.
[junit] Test org.apache.hadoop.mapred.TestHighRAMJobs FAILED.
Following errors are observed:
-------------------------------------------------------------------------------------------------
junit] 2008-09-09 11:03:55,965 INFO mapred.TaskMemoryManagerThread (TaskMemoryManagerThread.java:run(198)) - Memory usage of ProcessTree 10557 :363479040. Limit : 268435456
[junit] 2008-09-09 11:03:55,966 WARN mapred.TaskMemoryManagerThread (TaskMemoryManagerThread.java:run(208)) - TaskTree [pid=10557,tipID=attempt_200809091103_0001_m_000000_0] is running beyond memory-limits. Current usage : 363479040. Limit : 268435456. Killing task.
[junit] 2008-09-09 11:03:55,966 INFO mapred.TaskTracker (TaskTracker.java:purgeTask(1297)) - About to purge task: attempt_200809091103_0001_m_000000_0
[junit] 2008-09-09 11:03:55,967 INFO mapred.TaskRunner (MapTaskRunner.java:close(41)) - attempt_200809091103_0001_m_000000_0 done; removing files.
[junit] 2008-09-09 11:03:55,986 INFO mapred.TaskInProgress (TaskInProgress.java:updateStatus(432)) - Error from attempt_200809091103_0001_m_000000_0: TaskTree [pid=10557,tipID=attempt_200809091103_0001_m_000000_0] is running beyond memory-limits. Current usage : 363479040. Limit : 268435456. Killing task.
[junit] 2008-09-09 11:03:55,988 INFO mapred.TestHighRAMJobs (TestHighRAMJobs.java:assignTasks(78)) - status = 1073741824
[junit] 2008-09-09 11:03:55,988 INFO mapred.TestHighRAMJobs (TestHighRAMJobs.java:assignTasks(110)) - expected free memory = 1073741824, reported = 1073741824
[junit] 2008-09-09 11:03:55,989 INFO mapred.JobInProgress (JobInProgress.java:findNewMapTask(1315)) - Choosing a non-local task task_200809091103_0001_m_000000
[junit] 2008-09-09 11:03:55,989 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(765)) - Adding task 'attempt_200809091103_0001_m_000000_1' to tip task_200809091103_0001_m_000000, for tracker 'tracker_host0.foo.com:localhost/127.0.0.1:33033'
[junit] 2008-09-09 11:03:55,990 INFO mapred.JobTracker (JobTracker.java:removeMarkedTasks(860)) - Removed completed task 'attempt_200809091103_0001_m_000000_0' from 'tracker_host0.foo.com:localhost/127.0.0.1:33033'
[junit] 2008-09-09 11:03:55,992 INFO mapred.TaskTracker (TaskTracker.java:startNewTask(1451)) - LaunchTaskAction: attempt_200809091103_0001_m_000000_1
[junit] 2008-09-09 11:03:56,007 WARN conf.Configuration (Configuration.java:loadResource(990)) - /xx/hadoop-0.19.0/build/test/mapred/local/0_0/taskTracker/jobcache/job_200809091103_0001/job.xml:a attempt to override final parameter: hadoop.tmp.dir; Ignoring.
[junit] 2008-09-09 11:03:56,031 WARN mapred.TaskTracker (TaskTracker.java:reportTaskFinished(2268)) - Unknown child task finshed: attempt_200809091103_0001_m_000000_0. Ignored.
[junit] 2008-09-09 11:03:56,041 WARN mapred.ProcfsBasedProcessTree (ProcfsBasedProcessTree.java:destroy(176)) - Error executing shell command org.apache.hadoop.util.Shell$ExitCodeException: kill 10557: No such process
[junit] 2008-09-09 11:03:56,042 INFO mapred.ProcfsBasedProcessTree (ProcfsBasedProcessTree.java:destroy(178)) - Killing 10557 with SIGTERM. Exit code 1
[junit] 2008-09-09 11:03:56,052 INFO mapred.TaskMemoryManagerThread (TaskMemoryManagerThread.java:run(214)) - Removed ProcessTree with root 10557
[junit] 2008-09-09 11:03:56,166 INFO mapred.JobClient (JobClient.java:runJob(1120)) - Task Id : attempt_200809091103_0001_m_000000_0, Status : FAILED
and eventually Buid gets failed giving following error:
BUILD FAILED
/xx/hadoop-0.19.0/build.xml:658: Tests failed!
> TestHighRAMJobs fails on linux
> ------------------------------
>
> Key: HADOOP-4127
> URL: https://issues.apache.org/jira/browse/HADOOP-4127
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Amareshwari Sriramadasu
> Fix For: 0.19.0
>
>
> TestHighRAMJobs fails on linux box with the following errors:
> {noformat}
> ------------- ---------------- ---------------
> ------------- Standard Error -----------------
> Waiting for the Mini HDFS Cluster to start...
> Waiting for the Mini HDFS Cluster to start...
> Waiting for the Mini HDFS Cluster to start...
> TaskTree [pid=25566,tipID=attempt_200809091523_0001_m_000000_0] is running beyond memory-limits. Current usage : 358998016. Limit : 268435456. Killing task.
> TaskTree [pid=25815,tipID=attempt_200809091523_0001_m_000000_1] is running beyond memory-limits. Current usage : 359047168. Limit : 268435456. Killing task.
> TaskTree [pid=26110,tipID=attempt_200809091523_0001_m_000000_2] is running beyond memory-limits. Current usage : 360296448. Limit : 268435456. Killing task.
> TaskTree [pid=26165,tipID=attempt_200809091523_0001_r_000000_0] is running beyond memory-limits. Current usage : 357711872. Limit : 268435456. Killing task.
> TaskTree [pid=26251,tipID=attempt_200809091523_0001_m_000001_0] is running beyond memory-limits. Current usage : 352362496. Limit : 268435456. Killing task.
> Waiting for the Mini HDFS Cluster to start...
> TaskTree [pid=26473,tipID=attempt_200809091524_0001_m_000000_0] is running beyond memory-limits. Current usage : 358699008. Limit : 357913941. Killing task.
> TaskTree [pid=26499,tipID=attempt_200809091524_0001_m_000000_1] is running beyond memory-limits. Current usage : 360230912. Limit : 357913941. Killing task.
> TaskTree [pid=26528,tipID=attempt_200809091524_0001_m_000001_0] is running beyond memory-limits. Current usage : 358006784. Limit : 357913941. Killing task.
> TaskTree [pid=26584,tipID=attempt_200809091524_0001_m_000000_2] is running beyond memory-limits. Current usage : 358866944. Limit : 357913941. Killing task.
> TaskTree [pid=26638,tipID=attempt_200809091524_0001_m_000001_1] is running beyond memory-limits. Current usage : 358649856. Limit : 357913941. Killing task.
> ------------- ---------------- ---------------
> Testcase: testDefaultValuesForHighRAMJobs took 22.564 sec
> Testcase: testDefaultMemoryPerTask took 21.33 sec
> Testcase: testConfiguredValueForFreeMemory took 52.748 sec
> Caused an ERROR
> Job failed!
> java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1156)
> at org.apache.hadoop.examples.SleepJob.run(SleepJob.java:174)
> at org.apache.hadoop.examples.SleepJob.run(SleepJob.java:237)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.mapred.TestHighRAMJobs.launchSleepJob(TestHighRAMJobs.java:247)
> at org.apache.hadoop.mapred.TestHighRAMJobs.runJob(TestHighRAMJobs.java:238)
> at org.apache.hadoop.mapred.TestHighRAMJobs.testConfiguredValueForFreeMemory(TestHighRAMJobs.java:174)
> Testcase: testHighRAMJob took 48.952 sec
> Caused an ERROR
> Job failed!
> java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1156)
> at org.apache.hadoop.examples.SleepJob.run(SleepJob.java:174)
> at org.apache.hadoop.examples.SleepJob.run(SleepJob.java:237)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.mapred.TestHighRAMJobs.launchSleepJob(TestHighRAMJobs.java:247)
> at org.apache.hadoop.mapred.TestHighRAMJobs.runJob(TestHighRAMJobs.java:238)
> at org.apache.hadoop.mapred.TestHighRAMJobs.testHighRAMJob(TestHighRAMJobs.java:198)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HADOOP-4127) TestHighRAMJobs fails on linux
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod K V resolved HADOOP-4127.
-------------------------------
Resolution: Duplicate
> TestHighRAMJobs fails on linux
> ------------------------------
>
> Key: HADOOP-4127
> URL: https://issues.apache.org/jira/browse/HADOOP-4127
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Amareshwari Sriramadasu
> Fix For: 0.19.0
>
>
> TestHighRAMJobs fails on linux box with the following errors:
> {noformat}
> ------------- ---------------- ---------------
> ------------- Standard Error -----------------
> Waiting for the Mini HDFS Cluster to start...
> Waiting for the Mini HDFS Cluster to start...
> Waiting for the Mini HDFS Cluster to start...
> TaskTree [pid=25566,tipID=attempt_200809091523_0001_m_000000_0] is running beyond memory-limits. Current usage : 358998016. Limit : 268435456. Killing task.
> TaskTree [pid=25815,tipID=attempt_200809091523_0001_m_000000_1] is running beyond memory-limits. Current usage : 359047168. Limit : 268435456. Killing task.
> TaskTree [pid=26110,tipID=attempt_200809091523_0001_m_000000_2] is running beyond memory-limits. Current usage : 360296448. Limit : 268435456. Killing task.
> TaskTree [pid=26165,tipID=attempt_200809091523_0001_r_000000_0] is running beyond memory-limits. Current usage : 357711872. Limit : 268435456. Killing task.
> TaskTree [pid=26251,tipID=attempt_200809091523_0001_m_000001_0] is running beyond memory-limits. Current usage : 352362496. Limit : 268435456. Killing task.
> Waiting for the Mini HDFS Cluster to start...
> TaskTree [pid=26473,tipID=attempt_200809091524_0001_m_000000_0] is running beyond memory-limits. Current usage : 358699008. Limit : 357913941. Killing task.
> TaskTree [pid=26499,tipID=attempt_200809091524_0001_m_000000_1] is running beyond memory-limits. Current usage : 360230912. Limit : 357913941. Killing task.
> TaskTree [pid=26528,tipID=attempt_200809091524_0001_m_000001_0] is running beyond memory-limits. Current usage : 358006784. Limit : 357913941. Killing task.
> TaskTree [pid=26584,tipID=attempt_200809091524_0001_m_000000_2] is running beyond memory-limits. Current usage : 358866944. Limit : 357913941. Killing task.
> TaskTree [pid=26638,tipID=attempt_200809091524_0001_m_000001_1] is running beyond memory-limits. Current usage : 358649856. Limit : 357913941. Killing task.
> ------------- ---------------- ---------------
> Testcase: testDefaultValuesForHighRAMJobs took 22.564 sec
> Testcase: testDefaultMemoryPerTask took 21.33 sec
> Testcase: testConfiguredValueForFreeMemory took 52.748 sec
> Caused an ERROR
> Job failed!
> java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1156)
> at org.apache.hadoop.examples.SleepJob.run(SleepJob.java:174)
> at org.apache.hadoop.examples.SleepJob.run(SleepJob.java:237)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.mapred.TestHighRAMJobs.launchSleepJob(TestHighRAMJobs.java:247)
> at org.apache.hadoop.mapred.TestHighRAMJobs.runJob(TestHighRAMJobs.java:238)
> at org.apache.hadoop.mapred.TestHighRAMJobs.testConfiguredValueForFreeMemory(TestHighRAMJobs.java:174)
> Testcase: testHighRAMJob took 48.952 sec
> Caused an ERROR
> Job failed!
> java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1156)
> at org.apache.hadoop.examples.SleepJob.run(SleepJob.java:174)
> at org.apache.hadoop.examples.SleepJob.run(SleepJob.java:237)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.mapred.TestHighRAMJobs.launchSleepJob(TestHighRAMJobs.java:247)
> at org.apache.hadoop.mapred.TestHighRAMJobs.runJob(TestHighRAMJobs.java:238)
> at org.apache.hadoop.mapred.TestHighRAMJobs.testHighRAMJob(TestHighRAMJobs.java:198)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.