You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Vladimir Loubenski <vl...@opentext.com> on 2017/02/07 19:54:12 UTC

Nutch 2.3.1: REST API calls stop and abort failed to stop running jobs

Hi there,
I have installed Nutch 2.3.1 .

During running Fetch or Parse Nutch job I call REST API abort (GET /job/job-id-5977/abort) or stop (GET /job/job-id-5977/stop) to Nutch server.

I can see in debugger that the call end up in Hadoop call   currentJob.killJob() in both cases.

The job continue to run and in hadoop log file I see: INFO  mapreduce.Job - Job job_local827431513_0001 failed with state KILLED due to: NA .

The abort and stop calls failed to stop the Nutch job.

After with  GET /job/job-id-5977  I receive

>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>

  "result" : null,

  "state" : "FAILED",

  "msg" : "ERROR: java.lang.RuntimeException: job failed: name=[crawl-00]fetch, jobid=job_local367443839_0005",

>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>

Is it Nutch 2.3.1 bug?

Regards,
Vladimir.