Nutch 1.7 failing on Hadoop YARN after running for a while.

["S.L" <si...@gmail.com>]

Hi All,

I have a failure in one of the applications consistently after my Nutch job
runs for like an hour, can some please suggest why this error is occurring
looking at the exception message below.

Diagnostics:
Application application_1408512952691_0017 failed 2 times due to AM
Container for appattempt_1408512952691_0017_000002 exited with exitCode:
-1000 due to: File does not exist: hdfs://
server1.mydomain.com:9000/tmp/hadoop-yarn/staging/df/.staging/job_1408512952691_0017/job.jar
 .Failing this attempt.. Failing the application.

RE: Nutch 1.7 failing on Hadoop YARN after running for a while.

[Markus Jelsma <ma...@openindex.io>]

There must be something more in the logs, if it's an error produced by Nutch. 
 
-----Original message-----
> From:S.L <si...@gmail.com>
> Sent: Wednesday 20th August 2014 21:31
> To: user@hadoop.apache.org; user@nutch.apache.org
> Subject: Nutch 1.7 failing on Hadoop YARN after running for a while.
> 
> Hi All,
> 
> I have a failure in one of the applications consistently after my Nutch job
> runs for like an hour, can some please suggest why this error is occurring
> looking at the exception message below.
> 
> Diagnostics:
> Application application_1408512952691_0017 failed 2 times due to AM
> Container for appattempt_1408512952691_0017_000002 exited with exitCode:
> -1000 due to: File does not exist: hdfs://
> server1.mydomain.com:9000/tmp/hadoop-yarn/staging/df/.staging/job_1408512952691_0017/job.jar
>  .Failing this attempt.. Failing the application.
>