restart a failed job

[al...@aim.com]

 

 Hello,

I wondered if it is possible to restart a failed job in nutch-1.3 version.
I have this error 

org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/jobcache/



after fetching for 5 days. I know the reason for the error, but do not want to restart the whole process from the beginning. I use nutch in local mode in one machine.

Thanks.
Alex.

Re: restart a failed job

[lewis john mcgibbney <le...@gmail.com>]

A bit more info

http://wiki.apache.org/nutch/FAQ#How_can_I_recover_an_aborted_fetch_process.3F

On Tue, Sep 20, 2011 at 7:46 PM, Markus Jelsma
<ma...@openindex.io>wrote:

> Hi,
>
>
> You just ran out of luck. A failed fetch cannot be resumed in 1.x, the
> files
> not appendable, write once/read many. It's also a good idea to run smaller
> segments.
>
> Cheers,
>
> >  Hello,
> >
> > I wondered if it is possible to restart a failed job in nutch-1.3
> version.
> > I have this error
> >
> > org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> > taskTracker/jobcache/
> >
> >
> >
> > after fetching for 5 days. I know the reason for the error, but do not
> want
> > to restart the whole process from the beginning. I use nutch in local
> mode
> > in one machine.
> >
> > Thanks.
> > Alex.
>



-- 
*Lewis*

Re: restart a failed job

[Markus Jelsma <ma...@openindex.io>]

Hi,


You just ran out of luck. A failed fetch cannot be resumed in 1.x, the files 
not appendable, write once/read many. It's also a good idea to run smaller 
segments.

Cheers,

>  Hello,
> 
> I wondered if it is possible to restart a failed job in nutch-1.3 version.
> I have this error
> 
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> taskTracker/jobcache/
> 
> 
> 
> after fetching for 5 days. I know the reason for the error, but do not want
> to restart the whole process from the beginning. I use nutch in local mode
> in one machine.
> 
> Thanks.
> Alex.