You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by "Dmitriy V. Kazimirov" <dm...@viorsan.com> on 2010/06/23 17:35:36 UTC

Nutch 2.0(was RE: fetcher.threads.per.host - can be customized?)


> -----Original Message-----
> From: Julien Nioche [mailto:lists.digitalpebble@gmail.com]
> Sent: Wednesday, June 23, 2010 10:00 PM
> To: user@nutch.apache.org
> Subject: Re: fetcher.threads.per.host - can be customized?
> 
> 
> 
> > Is it correct that 2.0 will have only solr-indexer(and not 'regular'
> > searcher)?
> > What about search webinterface(currently what I see on solr is API
> for
> > _making_ one,not basic interface like regular nutch one)
> >
> 
> the features of Nutch 2.0 are still under discussion but you are
> basically
> correct - the plan is to delegate the indexing and search to SOLR and
> get
> rid of the Lucene and search components in Nutch. This includes the
> search
> servers and front ends IMHO. I think there are quite a few front ends
> available for SOLR but better to ask on their list.
> 
So things like NUTCH-666 should be ported to SOLR to use on Nutch 2.0?
ok. problem is some things like NUTCH-666 are required both on indexing
and 
btw,when Nutch 2.0 is planned to be released?1.1 took several years...

> J.
> 
> 
> 
> 
> > > HTH
> > >
> > > Julien
> > >
> > > --
> > > DigitalPebble Ltd
> > >
> > > Open Source Solutions for Text Engineering
> > > http://www.digitalpebble.com
> > >
> > > On 23 June 2010 11:36, Dmitriy V. Kazimirov
> > > <dm...@viorsan.com>wrote:
> > >
> > > > Hi,
> > > >
> > > > Is it possible (likely not but still) to make Nutch use different
> > > values
> > > > of fetcher.threads.per.host for different domains?
> > > >
> > > > i.e. low default value(1-3) and for domains which I _knew_ can
> handle
> > > load
> > > > and it won't be problem - increase it
> > > >
> > > >
> > > >
> > > > If that's not possible could someone give advice where in code to
> > > look to
> > > > make such modifications?
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > With regards, Dmitriy Kazimirov
> > > >
> > > >
> >
> 
> 
> 
> --
> DigitalPebble Ltd
> 
> Open Source Solutions for Text Engineering
> http://www.digitalpebble.com