You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by prasenjit mukherjee <pr...@gmail.com> on 2012/06/16 09:00:36 UTC
Hadoop startup problems ( FileSystem is not ready yet! )
I started hadoop in a single-node/pseudo-distributed mode. Took all
the precautionary measures like : dfsck, namenode -format etc. before
running start-all.sh. After starting jobtracker-log keeps getting
flooded with following stacktraces :
I have a hunch it is related to localhost/127.0.0.1 stuff. Any
pointers on how to fix this. Because of this I cant put anything into
hdfs.
$>tail -f hadoop-prasen-jobtracker-oilreadproud-lm.log
2012-06-16 12:09:36,037 WARN org.apache.hadoop.mapred.JobTracker: Retrying...
2012-06-16 12:09:36,049 WARN org.apache.hadoop.hdfs.DFSClient:
DataStreamer Exception: java.lang.NumberFormatException: For input
string: "0:0:0:0:0:0:1%0:50010"
at java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
at java.lang.Integer.parseInt(Integer.java:458)
at java.lang.Integer.parseInt(Integer.java:499)
at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:148)
at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:125)
at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.createBlockOutputStream(DFSClient.java:3025)
at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:2983)
at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2000(DFSClient.java:2255)
at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2446)
2012-06-16 12:09:36,049 WARN org.apache.hadoop.hdfs.DFSClient: Error
Recovery for block blk_-5253437002798877541_1048 bad datanode[0] nodes
== null
2012-06-16 12:09:36,050 WARN org.apache.hadoop.hdfs.DFSClient: Could
not get block locations. Source file
"/tmp/hadoop-prasen/mapred/system/jobtracker.info" - Aborting...
2012-06-16 12:09:36,050 WARN org.apache.hadoop.mapred.JobTracker:
Writing to file
hdfs://localhost:9000/tmp/hadoop-prasen/mapred/system/jobtracker.info
failed!
2012-06-16 12:09:36,050 WARN org.apache.hadoop.mapred.JobTracker:
FileSystem is not ready yet!
2012-06-16 12:09:36,052 WARN org.apache.hadoop.mapred.JobTracker:
Failed to initialize recovery manager.
java.io.IOException: Could not get block locations. Source file
"/tmp/hadoop-prasen/mapred/system/jobtracker.info" - Aborting...
at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2691)
at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2255)
at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2423)
Re: Hadoop startup problems ( FileSystem is not ready yet! )
Posted by prasenjit mukherjee <pr...@gmail.com>.
Changing /etc/hosts line from :
127.0.0.1 localhost, prasen-host
to
127.0.0.1 localhost
fixed the problem...
On Sat, Jun 16, 2012 at 12:30 PM, prasenjit mukherjee
<pr...@gmail.com> wrote:
> I started hadoop in a single-node/pseudo-distributed mode. Took all
> the precautionary measures like : dfsck, namenode -format etc. before
> running start-all.sh. After starting jobtracker-log keeps getting
> flooded with following stacktraces :
>
> I have a hunch it is related to localhost/127.0.0.1 stuff. Any
> pointers on how to fix this. Because of this I cant put anything into
> hdfs.
>
> $>tail -f hadoop-prasen-jobtracker-oilreadproud-lm.log
>
> 2012-06-16 12:09:36,037 WARN org.apache.hadoop.mapred.JobTracker: Retrying...
> 2012-06-16 12:09:36,049 WARN org.apache.hadoop.hdfs.DFSClient:
> DataStreamer Exception: java.lang.NumberFormatException: For input
> string: "0:0:0:0:0:0:1%0:50010"
> at java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
> at java.lang.Integer.parseInt(Integer.java:458)
> at java.lang.Integer.parseInt(Integer.java:499)
> at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:148)
> at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:125)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.createBlockOutputStream(DFSClient.java:3025)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:2983)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2000(DFSClient.java:2255)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2446)
>
> 2012-06-16 12:09:36,049 WARN org.apache.hadoop.hdfs.DFSClient: Error
> Recovery for block blk_-5253437002798877541_1048 bad datanode[0] nodes
> == null
> 2012-06-16 12:09:36,050 WARN org.apache.hadoop.hdfs.DFSClient: Could
> not get block locations. Source file
> "/tmp/hadoop-prasen/mapred/system/jobtracker.info" - Aborting...
> 2012-06-16 12:09:36,050 WARN org.apache.hadoop.mapred.JobTracker:
> Writing to file
> hdfs://localhost:9000/tmp/hadoop-prasen/mapred/system/jobtracker.info
> failed!
> 2012-06-16 12:09:36,050 WARN org.apache.hadoop.mapred.JobTracker:
> FileSystem is not ready yet!
> 2012-06-16 12:09:36,052 WARN org.apache.hadoop.mapred.JobTracker:
> Failed to initialize recovery manager.
> java.io.IOException: Could not get block locations. Source file
> "/tmp/hadoop-prasen/mapred/system/jobtracker.info" - Aborting...
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2691)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2255)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2423)