You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@nutch.apache.org by Frank Kempf <fl...@2112portals.com> on 2006/08/27 18:44:36 UTC

0.8.23 Inject would not inject all Urls.

I can't get to inject a simple set of 4 Urls into the nutch db.

When injected only 2 or 3 of the Urls show up.
I reduced to 4 Urls
A similar effect I get with 3500 Urls - just a part of these get injected.
Anyone have a explanation to this?

(I tried 2 different Servers also Suse 10.0 and 9.3)

  Kind regards

    Frank

Re: 0.8.23 Inject would not inject all Urls.

Posted by Frank Kempf <fl...@2112portals.com>.

Thanks, that was it.

I set my regex-urlfilter.txt for testing to accept all urls and it worked then.
I was not aware that at this early stage (inject) the filter is in effect.

Kind regards
   Frank

Re: 0.8.23 Inject would not inject all Urls.

Posted by Andrzej Bialecki <ab...@getopt.org>.

Frank Kempf wrote:
> I can't get to inject a simple set of 4 Urls into the nutch db.
>
> When injected only 2 or 3 of the Urls show up.
> I reduced to 4 Urls
> A similar effect I get with 3500 Urls - just a part of these get 
> injected.
> Anyone have a explanation to this?
>
> (I tried 2 different Servers also Suse 10.0 and 9.3)


What's your urlfilter settings?

-- 
Best regards,
Andrzej Bialecki     <><
 ___. ___ ___ ___ _ _   __________________________________
[__ || __|__/|__||\/|  Information Retrieval, Semantic Web
___|||__||  \|  ||  |  Embedded Unix, System Integration
http://www.sigram.com  Contact: info at sigram dot com