You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by Alfonso Olias Sanz <al...@gmail.com> on 2008/03/24 13:41:19 UTC

[core] datanode Exception error wiht dfs.replication to 1

Hi

I set up the property dfs.replication to 1
and I got this error while coping files to the DFS.

[aolias@gaiawl05 ~/software/Hadoop/hadoop-0.16.0]$ bin/hadoop dfs
-copyFromLocal /home2/mtlinden/simdata/GASS-RDS-3-G/tm IDT
08/03/24 11:46:32 WARN fs.DFSClient: DataStreamer Exception:
java.net.SocketException: Broken pipe
08/03/24 11:46:32 WARN fs.DFSClient: DFSOutputStream ResponseProcessor
exception  for block blk_-4394769012041379459java.net.SocketException:
Connection reset
        at java.net.SocketInputStream.read(SocketInputStream.java:168)
        at java.io.DataInputStream.readFully(DataInputStream.java:178)
        at java.io.DataInputStream.readLong(DataInputStream.java:399)
        at org.apache.hadoop.dfs.DFSClient$DFSOutputStream$ResponseProcessor.run(DFSClient.java:1726)


I checked the web app and the node where I was performing the copy
command had no space left and the rest of the data nodes where empty.
 I also run the same test with the balancer, and I got the same
result. With no data balanced among all the data nodes.

The purpose is to spread some temporary files with no replication.
Just one instance of the file.

thanks