You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by karthik085 <ka...@gmail.com> on 2007/07/21 00:13:24 UTC
Multiple Nuch Instances
1. Can I run multiple instances of nutch for crawling/indexing? I got mixed
opinions - some say yes and some say no. Can someone, who have tried this
let me know? One guy said it is difficult becuase multiple nutch instances
have to use different ports?
2. If i can run multiple instances of nutch, can I run nutch v 0.7.2, nutch
0.9 and nutch-dev at the same time for crawling/indexing websites?
Please let me know. Thanks.
--
View this message in context: http://www.nabble.com/Multiple-Nuch-Instances-tf4119823.html#a11716837
Sent from the Nutch - User mailing list archive at Nabble.com.
Re: Multiple Nuch Instances
Posted by karthik085 <ka...@gmail.com>.
What do you mean by one category per instance - do you mean 1 website per
instance? Thanks for the reply.
Damian Florczyk-2 wrote:
>
>
>
> Michael Wechner napisał(a):
>> karthik085 wrote:
>>
>>> 1. Can I run multiple instances of nutch for crawling/indexing? I got
>>> mixed
>>> opinions - some say yes and some say no. Can someone, who have tried
>>> this
>>> let me know? One guy said it is difficult becuase multiple nutch
>>> instances
>>> have to use different ports?
>>> 2. If i can run multiple instances of nutch, can I run nutch v 0.7.2,
>>> nutch
>>> 0.9 and nutch-dev at the same time for crawling/indexing websites?
>>>
>>>
>>
>> can you explain a bit more what you are trying to achieve?
>>
>> Do you only ask re crawling/indexing or also about searching the index?
>>
>> Cheers
>>
>> Michael
>>
>>> Please let me know. Thanks.
>>>
>>>
>>>
>>>
>>
>>
> I have done multiple nutch instances crawling just one category per
> instance. Searching was made using nutch's IPC and all things are based
> on nutch server.
>
>
--
View this message in context: http://www.nabble.com/Multiple-Nuch-Instances-tf4119823.html#a11762850
Sent from the Nutch - User mailing list archive at Nabble.com.
Re: Multiple Nuch Instances
Posted by Damian Florczyk <th...@gentoo.org>.
Michael Wechner napisał(a):
> karthik085 wrote:
>
>> 1. Can I run multiple instances of nutch for crawling/indexing? I got
>> mixed
>> opinions - some say yes and some say no. Can someone, who have tried
>> this
>> let me know? One guy said it is difficult becuase multiple nutch
>> instances
>> have to use different ports?
>> 2. If i can run multiple instances of nutch, can I run nutch v 0.7.2,
>> nutch
>> 0.9 and nutch-dev at the same time for crawling/indexing websites?
>>
>>
>
> can you explain a bit more what you are trying to achieve?
>
> Do you only ask re crawling/indexing or also about searching the index?
>
> Cheers
>
> Michael
>
>> Please let me know. Thanks.
>>
>>
>>
>>
>
>
I have done multiple nutch instances crawling just one category per
instance. Searching was made using nutch's IPC and all things are based
on nutch server.
Re: Multiple Nuch Instances
Posted by karthik085 <ka...@gmail.com>.
Just crawling/indexing.
There are many websites I want to crawl & index. 1 directory for each
website. So, I start a nutch instance for each website for crawling &
indexing. I want to run multiple nutch instances. Is this possible?
Michael Wechner wrote:
>
> karthik085 wrote:
>
>>1. Can I run multiple instances of nutch for crawling/indexing? I got
mixed
>>opinions - some say yes and some say no. Can someone, who have tried this
>>let me know? One guy said it is difficult becuase multiple nutch instances
>>have to use different ports?
>>2. If i can run multiple instances of nutch, can I run nutch v 0.7.2,
nutch
>>0.9 and nutch-dev at the same time for crawling/indexing websites?
>>
>>
>
> can you explain a bit more what you are trying to achieve?
>
> Do you only ask re crawling/indexing or also about searching the index?
>
> Cheers
>
> Michael
>
>>Please let me know. Thanks.
>>
>>
>>
>>
>
>
> --
> Michael Wechner
> Wyona - Open Source Content Management - Yanel, Yulup
> http://www.wyona.com
> michael.wechner@wyona.com, michi@apache.org
> +41 44 272 91 61
>
>
>
--
View this message in context: http://www.nabble.com/Multiple-Nuch-Instances-tf4119823.html#a11762891
Sent from the Nutch - User mailing list archive at Nabble.com.
Re: Multiple Nuch Instances
Posted by Michael Wechner <mi...@wyona.com>.
karthik085 wrote:
>1. Can I run multiple instances of nutch for crawling/indexing? I got mixed
>opinions - some say yes and some say no. Can someone, who have tried this
>let me know? One guy said it is difficult becuase multiple nutch instances
>have to use different ports?
>2. If i can run multiple instances of nutch, can I run nutch v 0.7.2, nutch
>0.9 and nutch-dev at the same time for crawling/indexing websites?
>
>
can you explain a bit more what you are trying to achieve?
Do you only ask re crawling/indexing or also about searching the index?
Cheers
Michael
>Please let me know. Thanks.
>
>
>
>
--
Michael Wechner
Wyona - Open Source Content Management - Yanel, Yulup
http://www.wyona.com
michael.wechner@wyona.com, michi@apache.org
+41 44 272 91 61