You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Aman Tandon <am...@gmail.com> on 2014/07/02 06:35:58 UTC
Re: How to integrate nlp in solr
Any help here
With Regards
Aman Tandon
On Mon, Jun 30, 2014 at 11:00 PM, Aman Tandon <am...@gmail.com>
wrote:
> Hi Alex,
>
> I was try to get knowledge from these tutorials
> http://www.slideshare.net/teofili/natural-language-search-in-solr &
> https://wiki.apache.org/solr/OpenNLP: this one is kinda bit explaining
> but the real demo is not present.
> e.g. query: I want blue color college bags, then how using nlp it will
> work and how it will search, there is no such brief explanation out there,
> i will be thankful to you if you can help me in this.
>
> With Regards
> Aman Tandon
>
>
> On Mon, Jun 30, 2014 at 6:38 AM, Alexandre Rafalovitch <arafalov@gmail.com
> > wrote:
>
>> On Sun, Jun 29, 2014 at 10:19 PM, Aman Tandon <am...@gmail.com>
>> wrote:
>> > the appropriate results
>> What are those specifically? You need to be a bit more precise about
>> what you are trying to achieve. Otherwise, there are too many NLP
>> branches and too many approaches.
>>
>> Regards,
>> Alex.
>> Personal website: http://www.outerthoughts.com/
>> Current project: http://www.solr-start.com/ - Accelerating your Solr
>> proficiency
>>
>
>
Re: How to integrate nlp in solr
Posted by Aman Tandon <am...@gmail.com>.
Thanks pranab, I am unfamiliar with payloads, can you provide some info
about payload and how they are helpful in nlp
On Jul 2, 2014 7:41 PM, "parnab kumar" <pa...@gmail.com> wrote:
> Aman,
>
> I feel focusing on "Question-Answering" and "Information Extraction"
> components of NLP should help you achieve what you are looking for. Go
> through this book *Taming Text * (http://www.manning.com/ingersoll/ ) .
> Most of your queries should be answered including details on implementation
> and sample source codes.
>
>
>
> To state naively :
> NLP tools gives you the power to extract or interpret knowledge from
> text, which you basically store in the lucene index in form of fields or
> store along with the terms using payloads. During query processing time,
> you similarly gather additional knowledge from the query (using techniques
> like query expansion, relevance feedback, or ontologies ) and simply map
> those knowledge with the knowledge gained from the text. Its an effort to
> move to semantic retrieval rather than simple term matching.
>
> Thanks,
> Parnab
>
>
> On Wed, Jul 2, 2014 at 6:29 AM, Aman Tandon <am...@gmail.com>
> wrote:
>
> > Hi Alex,
> >
> > Thanks alex, one more thing i want to ask that so do we need to add the
> > extra fields for those entities, e.g. "Item" (bags), "color" (blue), etc.
> >
> > If some how i managed to implement this nlp then i will definitely
> publish
> > it on my blog :)
> >
> > With Regards
> > Aman Tandon
> >
> >
> > On Wed, Jul 2, 2014 at 10:34 AM, Alexandre Rafalovitch <
> arafalov@gmail.com
> > >
> > wrote:
> >
> > > Not from me, no. I don't have any real examples for this ready. I
> > > suspect the path beyond the basics is VERY dependent on your data and
> > > your business requirements.
> > >
> > > I would start from thinking how would YOU (as a human) do that match.
> > > Where does the 'blue' and 'color' and 'college' and 'bags' come from.
> > > Then, figuring out what is required for Solr to know to look there.
> > >
> > > NLP is not magic, just advanced technology. You need to know where you
> > > are going to get there.
> > >
> > > Regards,
> > > Alex.
> > > Personal website: http://www.outerthoughts.com/
> > > Current project: http://www.solr-start.com/ - Accelerating your Solr
> > > proficiency
> > >
> > >
> > > On Wed, Jul 2, 2014 at 11:35 AM, Aman Tandon <am...@gmail.com>
> > > wrote:
> > > > Any help here
> > > >
> > > > With Regards
> > > > Aman Tandon
> > > >
> > > >
> > > > On Mon, Jun 30, 2014 at 11:00 PM, Aman Tandon <
> amantandon.10@gmail.com
> > >
> > > > wrote:
> > > >
> > > >> Hi Alex,
> > > >>
> > > >> I was try to get knowledge from these tutorials
> > > >> http://www.slideshare.net/teofili/natural-language-search-in-solr &
> > > >> https://wiki.apache.org/solr/OpenNLP: this one is kinda bit
> > explaining
> > > >> but the real demo is not present.
> > > >> e.g. query: I want blue color college bags, then how using nlp it
> will
> > > >> work and how it will search, there is no such brief explanation out
> > > there,
> > > >> i will be thankful to you if you can help me in this.
> > > >>
> > > >> With Regards
> > > >> Aman Tandon
> > > >>
> > > >>
> > > >> On Mon, Jun 30, 2014 at 6:38 AM, Alexandre Rafalovitch <
> > > arafalov@gmail.com
> > > >> > wrote:
> > > >>
> > > >>> On Sun, Jun 29, 2014 at 10:19 PM, Aman Tandon <
> > amantandon.10@gmail.com
> > > >
> > > >>> wrote:
> > > >>> > the appropriate results
> > > >>> What are those specifically? You need to be a bit more precise
> about
> > > >>> what you are trying to achieve. Otherwise, there are too many NLP
> > > >>> branches and too many approaches.
> > > >>>
> > > >>> Regards,
> > > >>> Alex.
> > > >>> Personal website: http://www.outerthoughts.com/
> > > >>> Current project: http://www.solr-start.com/ - Accelerating your
> Solr
> > > >>> proficiency
> > > >>>
> > > >>
> > > >>
> > >
> >
>
Re: How to integrate nlp in solr
Posted by parnab kumar <pa...@gmail.com>.
Aman,
I feel focusing on "Question-Answering" and "Information Extraction"
components of NLP should help you achieve what you are looking for. Go
through this book *Taming Text * (http://www.manning.com/ingersoll/ ) .
Most of your queries should be answered including details on implementation
and sample source codes.
To state naively :
NLP tools gives you the power to extract or interpret knowledge from
text, which you basically store in the lucene index in form of fields or
store along with the terms using payloads. During query processing time,
you similarly gather additional knowledge from the query (using techniques
like query expansion, relevance feedback, or ontologies ) and simply map
those knowledge with the knowledge gained from the text. Its an effort to
move to semantic retrieval rather than simple term matching.
Thanks,
Parnab
On Wed, Jul 2, 2014 at 6:29 AM, Aman Tandon <am...@gmail.com> wrote:
> Hi Alex,
>
> Thanks alex, one more thing i want to ask that so do we need to add the
> extra fields for those entities, e.g. "Item" (bags), "color" (blue), etc.
>
> If some how i managed to implement this nlp then i will definitely publish
> it on my blog :)
>
> With Regards
> Aman Tandon
>
>
> On Wed, Jul 2, 2014 at 10:34 AM, Alexandre Rafalovitch <arafalov@gmail.com
> >
> wrote:
>
> > Not from me, no. I don't have any real examples for this ready. I
> > suspect the path beyond the basics is VERY dependent on your data and
> > your business requirements.
> >
> > I would start from thinking how would YOU (as a human) do that match.
> > Where does the 'blue' and 'color' and 'college' and 'bags' come from.
> > Then, figuring out what is required for Solr to know to look there.
> >
> > NLP is not magic, just advanced technology. You need to know where you
> > are going to get there.
> >
> > Regards,
> > Alex.
> > Personal website: http://www.outerthoughts.com/
> > Current project: http://www.solr-start.com/ - Accelerating your Solr
> > proficiency
> >
> >
> > On Wed, Jul 2, 2014 at 11:35 AM, Aman Tandon <am...@gmail.com>
> > wrote:
> > > Any help here
> > >
> > > With Regards
> > > Aman Tandon
> > >
> > >
> > > On Mon, Jun 30, 2014 at 11:00 PM, Aman Tandon <amantandon.10@gmail.com
> >
> > > wrote:
> > >
> > >> Hi Alex,
> > >>
> > >> I was try to get knowledge from these tutorials
> > >> http://www.slideshare.net/teofili/natural-language-search-in-solr &
> > >> https://wiki.apache.org/solr/OpenNLP: this one is kinda bit
> explaining
> > >> but the real demo is not present.
> > >> e.g. query: I want blue color college bags, then how using nlp it will
> > >> work and how it will search, there is no such brief explanation out
> > there,
> > >> i will be thankful to you if you can help me in this.
> > >>
> > >> With Regards
> > >> Aman Tandon
> > >>
> > >>
> > >> On Mon, Jun 30, 2014 at 6:38 AM, Alexandre Rafalovitch <
> > arafalov@gmail.com
> > >> > wrote:
> > >>
> > >>> On Sun, Jun 29, 2014 at 10:19 PM, Aman Tandon <
> amantandon.10@gmail.com
> > >
> > >>> wrote:
> > >>> > the appropriate results
> > >>> What are those specifically? You need to be a bit more precise about
> > >>> what you are trying to achieve. Otherwise, there are too many NLP
> > >>> branches and too many approaches.
> > >>>
> > >>> Regards,
> > >>> Alex.
> > >>> Personal website: http://www.outerthoughts.com/
> > >>> Current project: http://www.solr-start.com/ - Accelerating your Solr
> > >>> proficiency
> > >>>
> > >>
> > >>
> >
>
Re: How to integrate nlp in solr
Posted by Aman Tandon <am...@gmail.com>.
Hi Alex,
Thanks alex, one more thing i want to ask that so do we need to add the
extra fields for those entities, e.g. "Item" (bags), "color" (blue), etc.
If some how i managed to implement this nlp then i will definitely publish
it on my blog :)
With Regards
Aman Tandon
On Wed, Jul 2, 2014 at 10:34 AM, Alexandre Rafalovitch <ar...@gmail.com>
wrote:
> Not from me, no. I don't have any real examples for this ready. I
> suspect the path beyond the basics is VERY dependent on your data and
> your business requirements.
>
> I would start from thinking how would YOU (as a human) do that match.
> Where does the 'blue' and 'color' and 'college' and 'bags' come from.
> Then, figuring out what is required for Solr to know to look there.
>
> NLP is not magic, just advanced technology. You need to know where you
> are going to get there.
>
> Regards,
> Alex.
> Personal website: http://www.outerthoughts.com/
> Current project: http://www.solr-start.com/ - Accelerating your Solr
> proficiency
>
>
> On Wed, Jul 2, 2014 at 11:35 AM, Aman Tandon <am...@gmail.com>
> wrote:
> > Any help here
> >
> > With Regards
> > Aman Tandon
> >
> >
> > On Mon, Jun 30, 2014 at 11:00 PM, Aman Tandon <am...@gmail.com>
> > wrote:
> >
> >> Hi Alex,
> >>
> >> I was try to get knowledge from these tutorials
> >> http://www.slideshare.net/teofili/natural-language-search-in-solr &
> >> https://wiki.apache.org/solr/OpenNLP: this one is kinda bit explaining
> >> but the real demo is not present.
> >> e.g. query: I want blue color college bags, then how using nlp it will
> >> work and how it will search, there is no such brief explanation out
> there,
> >> i will be thankful to you if you can help me in this.
> >>
> >> With Regards
> >> Aman Tandon
> >>
> >>
> >> On Mon, Jun 30, 2014 at 6:38 AM, Alexandre Rafalovitch <
> arafalov@gmail.com
> >> > wrote:
> >>
> >>> On Sun, Jun 29, 2014 at 10:19 PM, Aman Tandon <amantandon.10@gmail.com
> >
> >>> wrote:
> >>> > the appropriate results
> >>> What are those specifically? You need to be a bit more precise about
> >>> what you are trying to achieve. Otherwise, there are too many NLP
> >>> branches and too many approaches.
> >>>
> >>> Regards,
> >>> Alex.
> >>> Personal website: http://www.outerthoughts.com/
> >>> Current project: http://www.solr-start.com/ - Accelerating your Solr
> >>> proficiency
> >>>
> >>
> >>
>
Re: How to integrate nlp in solr
Posted by Alexandre Rafalovitch <ar...@gmail.com>.
Not from me, no. I don't have any real examples for this ready. I
suspect the path beyond the basics is VERY dependent on your data and
your business requirements.
I would start from thinking how would YOU (as a human) do that match.
Where does the 'blue' and 'color' and 'college' and 'bags' come from.
Then, figuring out what is required for Solr to know to look there.
NLP is not magic, just advanced technology. You need to know where you
are going to get there.
Regards,
Alex.
Personal website: http://www.outerthoughts.com/
Current project: http://www.solr-start.com/ - Accelerating your Solr proficiency
On Wed, Jul 2, 2014 at 11:35 AM, Aman Tandon <am...@gmail.com> wrote:
> Any help here
>
> With Regards
> Aman Tandon
>
>
> On Mon, Jun 30, 2014 at 11:00 PM, Aman Tandon <am...@gmail.com>
> wrote:
>
>> Hi Alex,
>>
>> I was try to get knowledge from these tutorials
>> http://www.slideshare.net/teofili/natural-language-search-in-solr &
>> https://wiki.apache.org/solr/OpenNLP: this one is kinda bit explaining
>> but the real demo is not present.
>> e.g. query: I want blue color college bags, then how using nlp it will
>> work and how it will search, there is no such brief explanation out there,
>> i will be thankful to you if you can help me in this.
>>
>> With Regards
>> Aman Tandon
>>
>>
>> On Mon, Jun 30, 2014 at 6:38 AM, Alexandre Rafalovitch <arafalov@gmail.com
>> > wrote:
>>
>>> On Sun, Jun 29, 2014 at 10:19 PM, Aman Tandon <am...@gmail.com>
>>> wrote:
>>> > the appropriate results
>>> What are those specifically? You need to be a bit more precise about
>>> what you are trying to achieve. Otherwise, there are too many NLP
>>> branches and too many approaches.
>>>
>>> Regards,
>>> Alex.
>>> Personal website: http://www.outerthoughts.com/
>>> Current project: http://www.solr-start.com/ - Accelerating your Solr
>>> proficiency
>>>
>>
>>