You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Beats <ta...@yahoo.com> on 2009/07/20 09:05:44 UTC

different urlfilter for different seeds

hi......

i hav to crawl a set of seeds

i needed to assign different urlfilter conf for different seeds..

is there a way to define different crawl-urlfilter.txt for different url
seeds

thanx in advance

Tarun 
-- 
View this message in context: http://www.nabble.com/different-urlfilter-for-different-seeds-tp24564850p24564850.html
Sent from the Nutch - User mailing list archive at Nabble.com.


RE: different urlfilter for different seeds

Posted by Devang Shah <de...@gmail.com>.
Couple of options you can explore: 1. Implement your custom URL filter and
plug it in. 2. Create different crawls for different set of seeds and config
parameters.



-----Original Message-----
From: Beats [mailto:tarun_agrawal_88@yahoo.com] 
Sent: Tuesday, July 21, 2009 10:07 AM
To: nutch-user@lucene.apache.org
Subject: Re: different urlfilter for different seeds


hi......

i am stuck with it.
i tried to search but doesn't find any suitable answer
I m sorry for resending it but its urgent.
plz help me out in this

Sorry again.... and thanx for helping
-- 
View this message in context:
http://www.nabble.com/different-urlfilter-for-different-seeds-tp24564850p245
88373.html
Sent from the Nutch - User mailing list archive at Nabble.com.


Re: different urlfilter for different seeds

Posted by Beats <ta...@yahoo.com>.
hi......

i am stuck with it.
i tried to search but doesn't find any suitable answer
I m sorry for resending it but its urgent.
plz help me out in this

Sorry again.... and thanx for helping
-- 
View this message in context: http://www.nabble.com/different-urlfilter-for-different-seeds-tp24564850p24588373.html
Sent from the Nutch - User mailing list archive at Nabble.com.