You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-user@hadoop.apache.org by Sanjay Upadhyay <sa...@glowfriend.com> on 2014/01/02 01:56:18 UTC

Re: failed MR

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256



On Wednesday 01 January 2014 03:46 PM, Saeed Adel Mehraban wrote:
> I have a Hadoop 2.2.0 installation on 3 VMs, one as master and 2
> as slaves. When I try to run simple jobs like provided wordcount 
> sample, if I try to run the job on 1 or a few files, it probably 
> will succeed or not (somehow 50-50 chance of failure) but with
> more files, I get failure most of the time. Job's syslog is this 
> <https://www.dropbox.com/s/ju64zex8vbvi0hs/syslogs>and I will
> provide

from the syslog, it shows that repeated attempt at reduce stage its
failing. It even added the node as blacklisted -


2014-01-01 00:48:00,494 INFO [Thread-48]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: 3 failures
on node slave2-machine
2014-01-01 00:48:00,494 INFO [Thread-48]
org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: Blacklisted
host slave2-machine


> you whatever files you need to know about, just help me understand
> what is the problem. Regards.
> 

/sanjay
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iF4EAREIAAYFAlLEuS8ACgkQVTW+SJEQq42mjwD/aTf/IN6eI3DTxQe2LvrCpuGm
K+ggPk5gdkCxCfdf+skBAJH/2zFKrg5EB3CUmmp91MXAhevCQidQRnIcCkm1h7vV
=I1um
-----END PGP SIGNATURE-----