There are 0 datanode(s) running and no node(s) are excluded in this operation.

[Sergio Stateri <st...@gmail.com>]

Hi,

I installed Hadoop 2.7.1 and now, when I start it with start-dfs.sh and
start-yarn.sh, there´re no errors, but when I try to run an example:

hadoop jar
/hadoop-2.7.1/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.1.jar pi
5 1000

the following error is reported:

hadoop@ip-172-31-11-209:/install$ hadoop jar
/hadoop-2.7.1/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.1.jar pi
5 1000
Number of Maps  = 5
Samples per Map = 1000
15/10/19 00:02:21 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
15/10/19 00:02:22 WARN hdfs.DFSClient: DataStreamer Exception
org.apache.hadoop.ipc.RemoteException(java.io.IOException): File
/user/hadoop/QuasiMonteCarlo_1445212940792_1291659929/in/part0 could only
be replicated to 0 nodes instead of minReplication (=1).  There are 0
datanode(s) running and no node(s) are excluded in this operation.
        at
org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1550)
        at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getNewBlockTargets(FSNamesystem.java:3110)
        at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:3034)
...

But all services´re running:

-- in the master:
hadoop@ip-172-31-11-209:/install$ jps
15681 NameNode
16119 ResourceManager
16444 Jps
15965 SecondaryNameNode
hadoop@ip-172-31-11-209:/install$

-- in the slave:
hadoop@ip-172-31-46-83:/install$ jps
9668 DataNode
9940 Jps
9813 NodeManager
hadoop@ip-172-31-46-83:/install$

Here´s the master and slaves files in the master host:
hadoop@ip-172-31-11-209:/install$ cat /hadoop-2.7.1/etc/hadoop/masters
ec2-52-28-207-208.eu-central-1.compute.amazonaws.com
hadoop@ip-172-31-11-209:/install$ cat /hadoop-2.7.1/etc/hadoop/slaves
ec2-52-88-255-221.us-west-2.compute.amazonaws.com
hadoop@ip-172-31-11-209:/install$

The ssh from master to slave and from slave to master is working fine,
without password request:
hadoop@ip-172-31-11-209:/install$ ssh
ec2-52-88-255-221.us-west-2.compute.amazonaws.com
Welcome to Ubuntu 14.04.2 LTS (GNU/Linux 3.13.0-48-generic x86_64)
...
hadoop@ip-172-31-46-83:/install$ ssh
ec2-52-28-207-208.eu-central-1.compute.amazonaws.com
Welcome to Ubuntu 14.04.2 LTS (GNU/Linux 3.13.0-48-generic x86_64)
...

Then, I really don´t know why hadoop doesn´t find the datanode in the slave
host. The datanode is running at slave and the ssh connection to/from slave
is working fine...

Thanks for any help,

Sergio Stateri Junior
sergio.stateri@globo.com