You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by abhayd <aj...@hotmail.com> on 2011/12/22 20:20:40 UTC

nutch solr index process to add tag when indexing solr

hi 
We use use nuth to crawl site and index data is pushed using sorlindex
command.

We have three sites that we crawl using nutch
http://xyz1.com/,http://xyz2.com/,http://xyz3.com/

we create one crawldb's for each site.  We use single solr core to
consolidate three sites, And when we send data from each crawl db to solr we
want to tag each site docs with source info

so 
doc1|xyz1|
doc23|xyz2|

I dont see anyway to do this in nutch. Any help?




--
View this message in context: http://lucene.472066.n3.nabble.com/nutch-solr-index-process-to-add-tag-when-indexing-solr-tp3607311p3607311.html
Sent from the Nutch - User mailing list archive at Nabble.com.

RE: nutch solr index process to add tag when indexing solr

Posted by Ar...@csiro.au.
Hi,

This can be done using an index filter. For a source code example see this:

http://www.atnf.csiro.au/computing/software/arch/

Please see class au.csiro.cass.arch.filters.Index.

If you are trying to implement a corporate search engine or a search hosting service for multiple web sites, it is quite likely that Arch can do everything you need. We've just released a version based on Nutch 1.4.

Regards,

Arkadi




> -----Original Message-----
> From: abhayd [mailto:ajdabholkar@hotmail.com]
> Sent: Friday, 23 December 2011 6:21 AM
> To: nutch-user@lucene.apache.org
> Subject: nutch solr index process to add tag when indexing solr
> 
> hi
> We use use nuth to crawl site and index data is pushed using sorlindex
> command.
> 
> We have three sites that we crawl using nutch
> http://xyz1.com/,http://xyz2.com/,http://xyz3.com/
> 
> we create one crawldb's for each site.  We use single solr core to
> consolidate three sites, And when we send data from each crawl db to
> solr we
> want to tag each site docs with source info
> 
> so
> doc1|xyz1|
> doc23|xyz2|
> 
> I dont see anyway to do this in nutch. Any help?
> 
> 
> 
> 
> --
> View this message in context: http://lucene.472066.n3.nabble.com/nutch-
> solr-index-process-to-add-tag-when-indexing-solr-tp3607311p3607311.html
> Sent from the Nutch - User mailing list archive at Nabble.com.