You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Adarsh Sharma <ad...@orkash.com> on 2010/06/24 09:17:07 UTC
Hadoop_Error
Hi, I Mr. Adarsh Sharma presently working in Hadoop technologies from the
last 3 months..
I have a 20 GB file numb_complete.txt.
I load it into HDFS.
Now I have integrated Hadoop,Postgres,HadoopDB,Hive.
When I'm partititoned that file into 3 parts i got the following error.
Pls help me If anyone have any clue about it...Heartiest Thanks in advance
I work on 4 nodes(1 master and 3 slaves)
I check the log files and data directories but i'm not able to resolve it.
[hadoop@ws-test hadoop-0.20.2]$ bin/hadoop jar hadoopdb.jar
edu.yale.cs.hadoopdb.dataloader.GlobalHasher /user/hadoop/numb_complete
numhadoopdb 3 '\n' 0
10/06/24 10:07:31 INFO mapred.FileInputFormat: Total input paths to process
: 1
10/06/24 10:07:32 INFO mapred.JobClient: Running job: job_201006241002_0001
10/06/24 10:07:33 INFO mapred.JobClient: map 0% reduce 0%
10/06/24 10:07:53 INFO mapred.JobClient: map 1% reduce 0%
10/06/24 10:08:08 INFO mapred.JobClient: map 2% reduce 0%
10/06/24 10:08:20 INFO mapred.JobClient: map 3% reduce 0%
10/06/24 10:08:35 INFO mapred.JobClient: map 4% reduce 0%
10/06/24 10:08:50 INFO mapred.JobClient: map 5% reduce 0%
10/06/24 10:08:56 INFO mapred.JobClient: map 6% reduce 0%
10/06/24 10:09:42 INFO mapred.JobClient: map 9% reduce 1%
10/06/24 10:10:03 INFO mapred.JobClient: map 10% reduce 1%
10/06/24 10:10:06 INFO mapred.JobClient: map 10% reduce 2%
10/06/24 10:10:12 INFO mapred.JobClient: map 11% reduce 2%
10/06/24 10:10:33 INFO mapred.JobClient: map 12% reduce 2%
10/06/24 10:10:42 INFO mapred.JobClient: map 12% reduce 3%
10/06/24 10:11:51 INFO mapred.JobClient: map 17% reduce 4%
10/06/24 10:13:21 INFO mapred.JobClient: map 22% reduce 7%
10/06/24 10:13:33 INFO mapred.JobClient: map 23% reduce 7%
10/06/24 10:13:54 INFO mapred.JobClient: map 24% reduce 7%
10/06/24 10:14:16 INFO mapred.JobClient: map 25% reduce 7%
10/06/24 10:14:27 INFO mapred.JobClient: map 25% reduce 8%
10/06/24 10:14:37 INFO mapred.JobClient: map 26% reduce 8%
10/06/24 10:14:52 INFO mapred.JobClient: map 27% reduce 8%
10/06/24 10:15:10 INFO mapred.JobClient: map 28% reduce 8%
10/06/24 10:15:29 INFO mapred.JobClient: map 28% reduce 9%
10/06/24 10:15:31 INFO mapred.JobClient: map 29% reduce 9%
10/06/24 10:15:47 INFO mapred.JobClient: map 30% reduce 9%
10/06/24 10:16:12 INFO mapred.JobClient: map 31% reduce 9%
10/06/24 10:16:21 INFO mapred.JobClient: map 31% reduce 10%
10/06/24 10:16:30 INFO mapred.JobClient: map 32% reduce 10%
10/06/24 10:16:53 INFO mapred.JobClient: map 33% reduce 10%
10/06/24 10:17:14 INFO mapred.JobClient: map 34% reduce 10%
10/06/24 10:17:23 INFO mapred.JobClient: map 34% reduce 11%
10/06/24 10:20:57 INFO mapred.JobClient: map 46% reduce 15%
10/06/24 10:21:11 INFO mapred.JobClient: map 47% reduce 15%
10/06/24 10:21:32 INFO mapred.JobClient: map 48% reduce 15%
10/06/24 10:21:52 INFO mapred.JobClient: map 49% reduce 15%
10/06/24 10:22:00 INFO mapred.JobClient: map 49% reduce 16%
10/06/24 10:22:10 INFO mapred.JobClient: map 50% reduce 16%
10/06/24 10:22:35 INFO mapred.JobClient: map 51% reduce 16%
10/06/24 10:22:50 INFO mapred.JobClient: map 52% reduce 16%
10/06/24 10:22:59 INFO mapred.JobClient: map 52% reduce 17%
10/06/24 10:24:49 INFO mapred.JobClient: map 58% reduce 18%
10/06/24 10:25:00 INFO mapred.JobClient: map 58% reduce 19%
10/06/24 10:25:15 INFO mapred.JobClient: map 59% reduce 19%
10/06/24 10:25:33 INFO mapred.JobClient: map 60% reduce 19%
10/06/24 10:25:57 INFO mapred.JobClient: map 61% reduce 19%
10/06/24 10:25:58 INFO mapred.JobClient: map 61% reduce 20%
10/06/24 10:26:16 INFO mapred.JobClient: map 62% reduce 20%
10/06/24 10:32:33 INFO mapred.JobClient: map 73% reduce 24%
10/06/24 10:33:03 INFO mapred.JobClient: map 74% reduce 24%
10/06/24 10:33:38 INFO mapred.JobClient: map 75% reduce 24%
10/06/24 10:34:11 INFO mapred.JobClient: map 75% reduce 25%
10/06/24 10:34:12 INFO mapred.JobClient: map 76% reduce 25%
10/06/24 10:34:50 INFO mapred.JobClient: map 77% reduce 25%
10/06/24 10:35:32 INFO mapred.JobClient: map 78% reduce 25%
10/06/24 10:36:11 INFO mapred.JobClient: map 78% reduce 26%
10/06/24 10:36:14 INFO mapred.JobClient: map 79% reduce 26%
10/06/24 10:36:56 INFO mapred.JobClient: map 80% reduce 26%
10/06/24 10:37:43 INFO mapred.JobClient: map 81% reduce 26%
10/06/24 10:38:07 INFO mapred.JobClient: map 81% reduce 27%
10/06/24 10:38:20 INFO mapred.JobClient: map 82% reduce 27%
10/06/24 10:38:53 INFO mapred.JobClient: map 83% reduce 27%
10/06/24 10:39:26 INFO mapred.JobClient: map 84% reduce 27%
10/06/24 10:40:03 INFO mapred.JobClient: map 84% reduce 28%
10/06/24 10:40:09 INFO mapred.JobClient: map 85% reduce 28%
10/06/24 10:40:37 INFO mapred.JobClient: map 86% reduce 28%
10/06/24 10:41:18 INFO mapred.JobClient: map 87% reduce 28%
10/06/24 10:41:42 INFO mapred.JobClient: map 87% reduce 29%
10/06/24 10:44:42 INFO mapred.JobClient: map 93% reduce 30%
10/06/24 10:45:19 INFO mapred.JobClient: map 93% reduce 31%
10/06/24 10:45:52 INFO mapred.JobClient: map 94% reduce 31%
10/06/24 10:54:35 INFO mapred.JobClient: map 100% reduce 33%
10/06/24 10:55:14 INFO mapred.JobClient: map 100% reduce 44%
10/06/24 10:55:23 INFO mapred.JobClient: map 100% reduce 55%
10/06/24 10:55:41 INFO mapred.JobClient: map 100% reduce 66%
10/06/24 11:00:57 INFO mapred.JobClient: Task Id :
attempt_201006241002_0001_r_000000_0, Status : FAILED
java.io.IOException: All datanodes 192.168.0.130:50010 are bad. Aborting...
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2556)
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2102)
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2265)
10/06/24 11:00:57 WARN mapred.JobClient: Error reading task
outputhttp://ws30-pan-lin:50060/tasklog?plaintext=true&taskid=attempt_201006241002_0001_r_000000_0&filter=stdout
10/06/24 11:00:57 WARN mapred.JobClient: Error reading task
outputhttp://ws30-pan-lin:50060/tasklog?plaintext=true&taskid=attempt_201006241002_0001_r_000000_0&filter=stderr
10/06/24 11:00:58 INFO mapred.JobClient: map 100% reduce 44%
10/06/24 11:05:48 INFO mapred.JobClient: Task Id :
attempt_201006241002_0001_r_000002_0, Status : FAILED
java.io.IOException: All datanodes 192.168.0.132:50010 are bad. Aborting...
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2556)
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2102)
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2265)
10/06/24 11:05:48 WARN mapred.JobClient: Error reading task
outputhttp://ws32-gee-lin:50060/tasklog?plaintext=true&taskid=attempt_201006241002_0001_r_000002_0&filter=stdout
10/06/24 11:05:48 WARN mapred.JobClient: Error reading task
outputhttp://ws32-gee-lin:50060/tasklog?plaintext=true&taskid=attempt_201006241002_0001_r_000002_0&filter=stderr
10/06/24 11:05:49 INFO mapred.JobClient: map 100% reduce 22%
10/06/24 11:10:33 INFO mapred.JobClient: map 100% reduce 27%
10/06/24 11:11:24 INFO mapred.JobClient: map 100% reduce 28%
10/06/24 11:12:17 INFO mapred.JobClient: map 100% reduce 29%
10/06/24 11:13:02 INFO mapred.JobClient: map 100% reduce 30%
10/06/24 11:14:08 INFO mapred.JobClient: map 100% reduce 31%
10/06/24 11:15:08 INFO mapred.JobClient: map 100% reduce 32%
10/06/24 11:15:52 INFO mapred.JobClient: map 100% reduce 33%
10/06/24 11:16:46 INFO mapred.JobClient: map 100% reduce 34%
10/06/24 11:17:43 INFO mapred.JobClient: map 100% reduce 35%
10/06/24 11:18:32 INFO mapred.JobClient: map 100% reduce 36%
10/06/24 11:19:08 INFO mapred.JobClient: map 100% reduce 37%
10/06/24 11:19:37 INFO mapred.JobClient: map 100% reduce 38%
10/06/24 11:20:17 INFO mapred.JobClient: map 100% reduce 39%
10/06/24 11:20:52 INFO mapred.JobClient: map 100% reduce 40%
10/06/24 11:21:55 INFO mapred.JobClient: map 100% reduce 41%
10/06/24 11:22:58 INFO mapred.JobClient: map 100% reduce 42%
10/06/24 11:24:02 INFO mapred.JobClient: map 100% reduce 43%
10/06/24 11:25:55 INFO mapred.JobClient: map 100% reduce 44%
10/06/24 11:27:52 INFO mapred.JobClient: map 100% reduce 55%
10/06/24 11:30:01 INFO mapred.JobClient: map 100% reduce 66%
10/06/24 11:33:32 INFO mapred.JobClient: Task Id :
attempt_201006241002_0001_r_000002_1, Status : FAILED
java.io.IOException: All datanodes 192.168.0.130:50010 are bad. Aborting...
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2556)
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2102)
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2265)
10/06/24 11:33:32 WARN mapred.JobClient: Error reading task
outputhttp://ws30-pan-lin:50060/tasklog?plaintext=true&taskid=attempt_201006241002_0001_r_000002_1&filter=stdout
10/06/24 11:33:32 WARN mapred.JobClient: Error reading task
outputhttp://ws30-pan-lin:50060/tasklog?plaintext=true&taskid=attempt_201006241002_0001_r_000002_1&filter=stderr
10/06/24 11:33:33 INFO mapred.JobClient: map 100% reduce 44%
10/06/24 11:39:55 INFO mapred.JobClient: Task Id :
attempt_201006241002_0001_r_000000_1, Status : FAILED
java.io.IOException: All datanodes 192.168.0.132:50010 are bad. Aborting...
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2556)
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2102)
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2265)
10/06/24 11:39:55 WARN mapred.JobClient: Error reading task
outputhttp://ws32-gee-lin:50060/tasklog?plaintext=true&taskid=attempt_201006241002_0001_r_000000_1&filter=stdout
10/06/24 11:39:55 WARN mapred.JobClient: Error reading task
outputhttp://ws32-gee-lin:50060/tasklog?plaintext=true&taskid=attempt_201006241002_0001_r_000000_1&filter=stderr
10/06/24 11:39:56 INFO mapred.JobClient: map 100% reduce 22%
--
View this message in context: http://old.nabble.com/Hadoop_Error-tp28979597p28979597.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.
RE: Hadoop_Error
Posted by Ankit Bhatnagar <ab...@vantage.com>.
Did you check the health page of hadoop - meaning through UI - http://namenode:50070/
________________________________________
From: Adarsh Sharma [adarsh.sharma@orkash.com]
Sent: Thursday, June 24, 2010 3:17 AM
To: core-user@hadoop.apache.org
Subject: Hadoop_Error
Hi, I Mr. Adarsh Sharma presently working in Hadoop technologies from the
last 3 months..
I have a 20 GB file numb_complete.txt.
I load it into HDFS.
Now I have integrated Hadoop,Postgres,HadoopDB,Hive.
When I'm partititoned that file into 3 parts i got the following error.
Pls help me If anyone have any clue about it...Heartiest Thanks in advance
I work on 4 nodes(1 master and 3 slaves)
I check the log files and data directories but i'm not able to resolve it.
[hadoop@ws-test hadoop-0.20.2]$ bin/hadoop jar hadoopdb.jar
edu.yale.cs.hadoopdb.dataloader.GlobalHasher /user/hadoop/numb_complete
numhadoopdb 3 '\n' 0
10/06/24 10:07:31 INFO mapred.FileInputFormat: Total input paths to process
: 1
10/06/24 10:07:32 INFO mapred.JobClient: Running job: job_201006241002_0001
10/06/24 10:07:33 INFO mapred.JobClient: map 0% reduce 0%
10/06/24 10:07:53 INFO mapred.JobClient: map 1% reduce 0%
10/06/24 10:08:08 INFO mapred.JobClient: map 2% reduce 0%
10/06/24 10:08:20 INFO mapred.JobClient: map 3% reduce 0%
10/06/24 10:08:35 INFO mapred.JobClient: map 4% reduce 0%
10/06/24 10:08:50 INFO mapred.JobClient: map 5% reduce 0%
10/06/24 10:08:56 INFO mapred.JobClient: map 6% reduce 0%
10/06/24 10:09:42 INFO mapred.JobClient: map 9% reduce 1%
10/06/24 10:10:03 INFO mapred.JobClient: map 10% reduce 1%
10/06/24 10:10:06 INFO mapred.JobClient: map 10% reduce 2%
10/06/24 10:10:12 INFO mapred.JobClient: map 11% reduce 2%
10/06/24 10:10:33 INFO mapred.JobClient: map 12% reduce 2%
10/06/24 10:10:42 INFO mapred.JobClient: map 12% reduce 3%
10/06/24 10:11:51 INFO mapred.JobClient: map 17% reduce 4%
10/06/24 10:13:21 INFO mapred.JobClient: map 22% reduce 7%
10/06/24 10:13:33 INFO mapred.JobClient: map 23% reduce 7%
10/06/24 10:13:54 INFO mapred.JobClient: map 24% reduce 7%
10/06/24 10:14:16 INFO mapred.JobClient: map 25% reduce 7%
10/06/24 10:14:27 INFO mapred.JobClient: map 25% reduce 8%
10/06/24 10:14:37 INFO mapred.JobClient: map 26% reduce 8%
10/06/24 10:14:52 INFO mapred.JobClient: map 27% reduce 8%
10/06/24 10:15:10 INFO mapred.JobClient: map 28% reduce 8%
10/06/24 10:15:29 INFO mapred.JobClient: map 28% reduce 9%
10/06/24 10:15:31 INFO mapred.JobClient: map 29% reduce 9%
10/06/24 10:15:47 INFO mapred.JobClient: map 30% reduce 9%
10/06/24 10:16:12 INFO mapred.JobClient: map 31% reduce 9%
10/06/24 10:16:21 INFO mapred.JobClient: map 31% reduce 10%
10/06/24 10:16:30 INFO mapred.JobClient: map 32% reduce 10%
10/06/24 10:16:53 INFO mapred.JobClient: map 33% reduce 10%
10/06/24 10:17:14 INFO mapred.JobClient: map 34% reduce 10%
10/06/24 10:17:23 INFO mapred.JobClient: map 34% reduce 11%
10/06/24 10:20:57 INFO mapred.JobClient: map 46% reduce 15%
10/06/24 10:21:11 INFO mapred.JobClient: map 47% reduce 15%
10/06/24 10:21:32 INFO mapred.JobClient: map 48% reduce 15%
10/06/24 10:21:52 INFO mapred.JobClient: map 49% reduce 15%
10/06/24 10:22:00 INFO mapred.JobClient: map 49% reduce 16%
10/06/24 10:22:10 INFO mapred.JobClient: map 50% reduce 16%
10/06/24 10:22:35 INFO mapred.JobClient: map 51% reduce 16%
10/06/24 10:22:50 INFO mapred.JobClient: map 52% reduce 16%
10/06/24 10:22:59 INFO mapred.JobClient: map 52% reduce 17%
10/06/24 10:24:49 INFO mapred.JobClient: map 58% reduce 18%
10/06/24 10:25:00 INFO mapred.JobClient: map 58% reduce 19%
10/06/24 10:25:15 INFO mapred.JobClient: map 59% reduce 19%
10/06/24 10:25:33 INFO mapred.JobClient: map 60% reduce 19%
10/06/24 10:25:57 INFO mapred.JobClient: map 61% reduce 19%
10/06/24 10:25:58 INFO mapred.JobClient: map 61% reduce 20%
10/06/24 10:26:16 INFO mapred.JobClient: map 62% reduce 20%
10/06/24 10:32:33 INFO mapred.JobClient: map 73% reduce 24%
10/06/24 10:33:03 INFO mapred.JobClient: map 74% reduce 24%
10/06/24 10:33:38 INFO mapred.JobClient: map 75% reduce 24%
10/06/24 10:34:11 INFO mapred.JobClient: map 75% reduce 25%
10/06/24 10:34:12 INFO mapred.JobClient: map 76% reduce 25%
10/06/24 10:34:50 INFO mapred.JobClient: map 77% reduce 25%
10/06/24 10:35:32 INFO mapred.JobClient: map 78% reduce 25%
10/06/24 10:36:11 INFO mapred.JobClient: map 78% reduce 26%
10/06/24 10:36:14 INFO mapred.JobClient: map 79% reduce 26%
10/06/24 10:36:56 INFO mapred.JobClient: map 80% reduce 26%
10/06/24 10:37:43 INFO mapred.JobClient: map 81% reduce 26%
10/06/24 10:38:07 INFO mapred.JobClient: map 81% reduce 27%
10/06/24 10:38:20 INFO mapred.JobClient: map 82% reduce 27%
10/06/24 10:38:53 INFO mapred.JobClient: map 83% reduce 27%
10/06/24 10:39:26 INFO mapred.JobClient: map 84% reduce 27%
10/06/24 10:40:03 INFO mapred.JobClient: map 84% reduce 28%
10/06/24 10:40:09 INFO mapred.JobClient: map 85% reduce 28%
10/06/24 10:40:37 INFO mapred.JobClient: map 86% reduce 28%
10/06/24 10:41:18 INFO mapred.JobClient: map 87% reduce 28%
10/06/24 10:41:42 INFO mapred.JobClient: map 87% reduce 29%
10/06/24 10:44:42 INFO mapred.JobClient: map 93% reduce 30%
10/06/24 10:45:19 INFO mapred.JobClient: map 93% reduce 31%
10/06/24 10:45:52 INFO mapred.JobClient: map 94% reduce 31%
10/06/24 10:54:35 INFO mapred.JobClient: map 100% reduce 33%
10/06/24 10:55:14 INFO mapred.JobClient: map 100% reduce 44%
10/06/24 10:55:23 INFO mapred.JobClient: map 100% reduce 55%
10/06/24 10:55:41 INFO mapred.JobClient: map 100% reduce 66%
10/06/24 11:00:57 INFO mapred.JobClient: Task Id :
attempt_201006241002_0001_r_000000_0, Status : FAILED
java.io.IOException: All datanodes 192.168.0.130:50010 are bad. Aborting...
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2556)
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2102)
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2265)
10/06/24 11:00:57 WARN mapred.JobClient: Error reading task
outputhttp://ws30-pan-lin:50060/tasklog?plaintext=true&taskid=attempt_201006241002_0001_r_000000_0&filter=stdout
10/06/24 11:00:57 WARN mapred.JobClient: Error reading task
outputhttp://ws30-pan-lin:50060/tasklog?plaintext=true&taskid=attempt_201006241002_0001_r_000000_0&filter=stderr
10/06/24 11:00:58 INFO mapred.JobClient: map 100% reduce 44%
10/06/24 11:05:48 INFO mapred.JobClient: Task Id :
attempt_201006241002_0001_r_000002_0, Status : FAILED
java.io.IOException: All datanodes 192.168.0.132:50010 are bad. Aborting...
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2556)
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2102)
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2265)
10/06/24 11:05:48 WARN mapred.JobClient: Error reading task
outputhttp://ws32-gee-lin:50060/tasklog?plaintext=true&taskid=attempt_201006241002_0001_r_000002_0&filter=stdout
10/06/24 11:05:48 WARN mapred.JobClient: Error reading task
outputhttp://ws32-gee-lin:50060/tasklog?plaintext=true&taskid=attempt_201006241002_0001_r_000002_0&filter=stderr
10/06/24 11:05:49 INFO mapred.JobClient: map 100% reduce 22%
10/06/24 11:10:33 INFO mapred.JobClient: map 100% reduce 27%
10/06/24 11:11:24 INFO mapred.JobClient: map 100% reduce 28%
10/06/24 11:12:17 INFO mapred.JobClient: map 100% reduce 29%
10/06/24 11:13:02 INFO mapred.JobClient: map 100% reduce 30%
10/06/24 11:14:08 INFO mapred.JobClient: map 100% reduce 31%
10/06/24 11:15:08 INFO mapred.JobClient: map 100% reduce 32%
10/06/24 11:15:52 INFO mapred.JobClient: map 100% reduce 33%
10/06/24 11:16:46 INFO mapred.JobClient: map 100% reduce 34%
10/06/24 11:17:43 INFO mapred.JobClient: map 100% reduce 35%
10/06/24 11:18:32 INFO mapred.JobClient: map 100% reduce 36%
10/06/24 11:19:08 INFO mapred.JobClient: map 100% reduce 37%
10/06/24 11:19:37 INFO mapred.JobClient: map 100% reduce 38%
10/06/24 11:20:17 INFO mapred.JobClient: map 100% reduce 39%
10/06/24 11:20:52 INFO mapred.JobClient: map 100% reduce 40%
10/06/24 11:21:55 INFO mapred.JobClient: map 100% reduce 41%
10/06/24 11:22:58 INFO mapred.JobClient: map 100% reduce 42%
10/06/24 11:24:02 INFO mapred.JobClient: map 100% reduce 43%
10/06/24 11:25:55 INFO mapred.JobClient: map 100% reduce 44%
10/06/24 11:27:52 INFO mapred.JobClient: map 100% reduce 55%
10/06/24 11:30:01 INFO mapred.JobClient: map 100% reduce 66%
10/06/24 11:33:32 INFO mapred.JobClient: Task Id :
attempt_201006241002_0001_r_000002_1, Status : FAILED
java.io.IOException: All datanodes 192.168.0.130:50010 are bad. Aborting...
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2556)
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2102)
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2265)
10/06/24 11:33:32 WARN mapred.JobClient: Error reading task
outputhttp://ws30-pan-lin:50060/tasklog?plaintext=true&taskid=attempt_201006241002_0001_r_000002_1&filter=stdout
10/06/24 11:33:32 WARN mapred.JobClient: Error reading task
outputhttp://ws30-pan-lin:50060/tasklog?plaintext=true&taskid=attempt_201006241002_0001_r_000002_1&filter=stderr
10/06/24 11:33:33 INFO mapred.JobClient: map 100% reduce 44%
10/06/24 11:39:55 INFO mapred.JobClient: Task Id :
attempt_201006241002_0001_r_000000_1, Status : FAILED
java.io.IOException: All datanodes 192.168.0.132:50010 are bad. Aborting...
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2556)
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2102)
at
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2265)
10/06/24 11:39:55 WARN mapred.JobClient: Error reading task
outputhttp://ws32-gee-lin:50060/tasklog?plaintext=true&taskid=attempt_201006241002_0001_r_000000_1&filter=stdout
10/06/24 11:39:55 WARN mapred.JobClient: Error reading task
outputhttp://ws32-gee-lin:50060/tasklog?plaintext=true&taskid=attempt_201006241002_0001_r_000000_1&filter=stderr
10/06/24 11:39:56 INFO mapred.JobClient: map 100% reduce 22%
--
View this message in context: http://old.nabble.com/Hadoop_Error-tp28979597p28979597.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.