indexing individual terms in large database field.....

[Mark Swinson <Ma...@bbc.co.uk>]

Hi,

I'm trying to index a recipe database which contains , amongst other things, a list of ingredients stored as free text in a single mysql
column.

e.g

2 apple bananas (or ordinary bananas), peeled 
50g/2oz soft brown sugar
100g/3½oz self-raising flour
1 free-range egg, beaten
3-4 tbsp sparkling water
500ml/18fl oz vegetable oil, for deep frying
50g/2oz caster sugar
25g/1oz butter
2 apple bananas (or ordinary bananas), peeled and halved lengthways


One problem I'm trying to solve is to be able to search for an individual ingredient , e.g bannas~ ( fuzzy search ) and return
the closest match from within the field. However I am unsure how to index this column so that I can return a single match.

Can solr support this sort of thing out of the box, or will I need to write a custom plugin?


Mark



http://www.bbc.co.uk/
This e-mail (and any attachments) is confidential and may contain personal views which are not the views of the BBC unless specifically stated.
If you have received it in error, please delete it from your system.
Do not use, copy or disclose the information in any way nor act in reliance on it and notify the sender immediately.
Please note that the BBC monitors e-mails sent or received.
Further communication will signify your consent to this.
					

Re: indexing individual terms in large database field.....

[Otis Gospodnetic <ot...@yahoo.com>]

Mark,

Would using Solr's support for dynamic fields work for you here? (assuming you can parse the value of that DB column and extract individual ingredients before indexing)

Otis
----
Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Lucene ecosystem search :: http://search-lucene.com/


>________________________________
>From: Mark Swinson <Ma...@bbc.co.uk>
>To: solr-user@lucene.apache.org
>Sent: Thursday, October 13, 2011 11:58 AM
>Subject: indexing individual terms in large database field.....
>
>Hi,
>
>I'm trying to index a recipe database which contains , amongst other things, a list of ingredients stored as free text in a single mysql
>column.
>
>e.g
>
>2 apple bananas (or ordinary bananas), peeled 
>50g/2oz soft brown sugar
>100g/3½oz self-raising flour
>1 free-range egg, beaten
>3-4 tbsp sparkling water
>500ml/18fl oz vegetable oil, for deep frying
>50g/2oz caster sugar
>25g/1oz butter
>2 apple bananas (or ordinary bananas), peeled and halved lengthways
>
>
>One problem I'm trying to solve is to be able to search for an individual ingredient , e.g bannas~ ( fuzzy search ) and return
>the closest match from within the field. However I am unsure how to index this column so that I can return a single match.
>
>Can solr support this sort of thing out of the box, or will I need to write a custom plugin?
>
>
>Mark
>
>
>
>http://www.bbc.co.uk/
>This e-mail (and any attachments) is confidential and may contain personal views which are not the views of the BBC unless specifically stated.
>If you have received it in error, please delete it from your system.
>Do not use, copy or disclose the information in any way nor act in reliance on it and notify the sender immediately.
>Please note that the BBC monitors e-mails sent or received.
>Further communication will signify your consent to this.
>                    
>
>
>