You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Christian Nölle <no...@uni-wuppertal.de> on 2013/07/08 13:17:07 UTC

Drop inproper multiValued field

Hi everybody,

we got a problem with Nutch and Solr. Nutch is indexing a specific URL 
where he is parsing a field, that - according to schema.xml for solr - 
is a single value field, e.g. description

For that particular site the description is declared twice - which is 
beyond our control, leading to an error when commiting those documents 
to Solr. Is there any workaround for that, e.g. telling nutch to take 
only the first occurance and ignore the rest?

Nutch 1.7, Solr 3.6

Greetings!

-- 
-c

Re: Drop inproper multiValued field

Posted by Christian Nölle <no...@uni-wuppertal.de>.
Am 08.07.2013 13:24, schrieb Markus Jelsma:
> https://issues.apache.org/jira/browse/NUTCH-1560
> Can you open a new issue to make this behaviour configurable?

https://issues.apache.org/jira/browse/NUTCH-1607


-- 
-c

RE: Drop inproper multiValued field

Posted by Markus Jelsma <ma...@openindex.io>.
https://issues.apache.org/jira/browse/NUTCH-1560
Can you open a new issue to make this behaviour configurable?  
 
-----Original message-----
> From:Christian Nölle <no...@uni-wuppertal.de>
> Sent: Monday 8th July 2013 13:23
> To: user@nutch.apache.org
> Subject: Re: Drop inproper multiValued field
> 
> Am 08.07.2013 13:20, schrieb Markus Jelsma:
> > Ah, i assume this didn't happen with 1.6? 1.7 finally has support for
> > multivalued metadata fields and index-metadata seems to write them
> > all.
> 
> Absolutely right! Which is some cases fine, but very annoying elsewhere. 
> ;) And declaring each and everything multiValue in Solr is not an 
> option... :)
> 
> -- 
> -c
>

Re: Drop inproper multiValued field

Posted by Christian Nölle <no...@uni-wuppertal.de>.
Am 08.07.2013 13:20, schrieb Markus Jelsma:
> Ah, i assume this didn't happen with 1.6? 1.7 finally has support for
> multivalued metadata fields and index-metadata seems to write them
> all.

Absolutely right! Which is some cases fine, but very annoying elsewhere. 
;) And declaring each and everything multiValue in Solr is not an 
option... :)

-- 
-c

RE: Drop inproper multiValued field

Posted by Markus Jelsma <ma...@openindex.io>.
Ah, i assume this didn't happen with 1.6? 1.7 finally has support for multivalued metadata fields and index-metadata seems to write them all. 
 
-----Original message-----
> From:Christian Nölle <no...@uni-wuppertal.de>
> Sent: Monday 8th July 2013 13:17
> To: user@nutch.apache.org
> Subject: Drop inproper multiValued field
> 
> Hi everybody,
> 
> we got a problem with Nutch and Solr. Nutch is indexing a specific URL 
> where he is parsing a field, that - according to schema.xml for solr - 
> is a single value field, e.g. description
> 
> For that particular site the description is declared twice - which is 
> beyond our control, leading to an error when commiting those documents 
> to Solr. Is there any workaround for that, e.g. telling nutch to take 
> only the first occurance and ignore the rest?
> 
> Nutch 1.7, Solr 3.6
> 
> Greetings!
> 
> -- 
> -c
>