You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Kalaimathan Mahenthiran <ma...@gmail.com> on 2009/11/15 22:53:58 UTC
at the end of fetching, hung threads
Hi
I have spend more than a week fetching using nutch. Near the end i get
a message in the console indicating aborting with 100 hung threads as
below.
Has anyone seen this before... Does anyone know if i can still use the
fetched segment... or would this cause any error when i'm updating...
Below is the last few line from the console output
-activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
-activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
-activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
-activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
-activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
-activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
-activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
-activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
-activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
-activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
-activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
-activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
-activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
-activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
-activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
-activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
-activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
-activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
-activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
-activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
-activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
Aborting with 100 hung threads.
Fetcher: done
Thanks
Mathan
Re: at the end of fetching, hung threads
Posted by Julien Nioche <li...@gmail.com>.
https://issues.apache.org/jira/browse/NUTCH-719 could be relevant as well
2009/11/16 MilleBii <mi...@gmail.com>
> Just apply the following patch.
>
> https://issues.apache.org/jira/browse/NUTCH-721
>
> 2009/11/15 MilleBii <mi...@gmail.com>
>
> > Yes had it in the past and one needs to apply a certain patch... but I
> > don't remember which one from the top of my head, search the mailing
> list.
> >
> > 2009/11/15 Kalaimathan Mahenthiran <ma...@gmail.com>
> >
> > Hi
> >>
> >> I have spend more than a week fetching using nutch. Near the end i get
> >> a message in the console indicating aborting with 100 hung threads as
> >> below.
> >>
> >> Has anyone seen this before... Does anyone know if i can still use the
> >> fetched segment... or would this cause any error when i'm updating...
> >>
> >> Below is the last few line from the console output
> >>
> >> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> >> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> >> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> >> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> >> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> >> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> >> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> >> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> >> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> >> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> >> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> >> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> >> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> >> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> >> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> >> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> >> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> >> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> >> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> >> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> >> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> >> Aborting with 100 hung threads.
> >> Fetcher: done
> >>
> >> Thanks
> >> Mathan
> >>
> >
> >
> >
> > --
> > -MilleBii-
> >
>
>
>
> --
> -MilleBii-
>
--
DigitalPebble Ltd
http://www.digitalpebble.com
Re: at the end of fetching, hung threads
Posted by MilleBii <mi...@gmail.com>.
Just apply the following patch.
https://issues.apache.org/jira/browse/NUTCH-721
2009/11/15 MilleBii <mi...@gmail.com>
> Yes had it in the past and one needs to apply a certain patch... but I
> don't remember which one from the top of my head, search the mailing list.
>
> 2009/11/15 Kalaimathan Mahenthiran <ma...@gmail.com>
>
> Hi
>>
>> I have spend more than a week fetching using nutch. Near the end i get
>> a message in the console indicating aborting with 100 hung threads as
>> below.
>>
>> Has anyone seen this before... Does anyone know if i can still use the
>> fetched segment... or would this cause any error when i'm updating...
>>
>> Below is the last few line from the console output
>>
>> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
>> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
>> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
>> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
>> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
>> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
>> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
>> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
>> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
>> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
>> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
>> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
>> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
>> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
>> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
>> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
>> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
>> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
>> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
>> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
>> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
>> Aborting with 100 hung threads.
>> Fetcher: done
>>
>> Thanks
>> Mathan
>>
>
>
>
> --
> -MilleBii-
>
--
-MilleBii-
Re: at the end of fetching, hung threads
Posted by MilleBii <mi...@gmail.com>.
Yes had it in the past and one needs to apply a certain patch... but I don't
remember which one from the top of my head, search the mailing list.
2009/11/15 Kalaimathan Mahenthiran <ma...@gmail.com>
> Hi
>
> I have spend more than a week fetching using nutch. Near the end i get
> a message in the console indicating aborting with 100 hung threads as
> below.
>
> Has anyone seen this before... Does anyone know if i can still use the
> fetched segment... or would this cause any error when i'm updating...
>
> Below is the last few line from the console output
>
> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> -activeThreads=100, spinWaiting=100, fetchQueues.totalSize=7
> Aborting with 100 hung threads.
> Fetcher: done
>
> Thanks
> Mathan
>
--
-MilleBii-