You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by ldung <du...@gmail.com> on 2010/01/22 02:08:41 UTC
MoreLikeThis - How to pass in external text?
How can I have the MoreLikeThis query process a piece of text that is passed
into the query. Currently I can only get it MoreLikeThis to work only for
pieces of text that are already indexed by Solr.
For example here is a query that works for using MoreLikeThis for document
with id:134847893.
http://localhost:8983/solr/select?mlt=true&q=id:134847893&mlt.fl=desc&mlt.mindf=1&mlt.mintf=1&debugQuery=on
How can I pass in some external text like 'Solr Rocks'. Below is an example
of how it would look like.
http://localhost:8983/solr/select?mlt=true&external.text=Solr
Rocks&mlt.fl=desc&mlt.mindf=1&mlt.mintf=1&debugQuery=on
--
View this message in context: http://old.nabble.com/MoreLikeThis---How-to-pass-in-external-text--tp27266316p27266316.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: MoreLikeThis - How to pass in external text?
Posted by ldung <du...@gmail.com>.
David, thank you. This was what I was looking for!
David Stuart-6 wrote:
>
> The MoreLikeThisHandler allows external text to be streamed to it see
> http://wiki.apache.org/solr/MoreLikeThisHandler#Using_ContentStreams. The
> url feature is quite good if you have a lot of text and start hitting the
> character limit in the url
>
> Regards,
>
> Dave
>
>
> On 22 Jan 2010, at 05:24, Otis Gospodnetic wrote:
>
>> Hi,
>>
>> Try what I suggested, please.
>>
>> Or, if you want, go to that (or any other) web page, copy a large chunk
>> of its content, and paste it into Google/Yahoo/Bing. I just did that.
>> Google said my query was too long, but Yahoo took it. Guess what hit #1
>> was? The page I copied the text from! Very much "more like this"-like.
>>
>> Otis
>> --
>> Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch
>>
>>
>>
>> ----- Original Message ----
>>> From: ldung <du...@gmail.com>
>>> To: solr-user@lucene.apache.org
>>> Sent: Fri, January 22, 2010 12:08:26 AM
>>> Subject: Re: MoreLikeThis - How to pass in external text?
>>>
>>>
>>> I want to use MoreLikeThis since i want to find text in the Solr data
>>> that is
>>> similar to the input text. I want to see how will this works against
>>> just a
>>> standard keyword search.
>>>
>>> I want to do something similar to the article below.
>>> http://www.bbc.co.uk/blogs/radiolabs/2008/06/wikipedia_plus_lucene_morelikethis.shtml
>>>
>>> In the article the author uses MoreLikeThis to classifiy text according
>>> into
>>> pre-existing categories.
>>>
>>>
>>>
>>>
>>> Otis Gospodnetic wrote:
>>>>
>>>> Hi,
>>>>
>>>> if you have text to pass in, why do you need MoreLikeThis? The text
>>>> you
>>>> speak of can be used as a normal query, so pass it in as a regular
>>>> multi-word query.
>>>>
>>>> Otis
>>>> --
>>>> Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch
>>>>
>>>>
>>>>
>>>> ----- Original Message ----
>>>>> From: ldung
>>>>> To: solr-user@lucene.apache.org
>>>>> Sent: Thu, January 21, 2010 8:08:41 PM
>>>>> Subject: MoreLikeThis - How to pass in external text?
>>>>>
>>>>>
>>>>> How can I have the MoreLikeThis query process a piece of text that is
>>>>> passed
>>>>> into the query. Currently I can only get it MoreLikeThis to work only
>>>>> for
>>>>> pieces of text that are already indexed by Solr.
>>>>>
>>>>> For example here is a query that works for using MoreLikeThis for
>>>>> document
>>>>> with id:134847893.
>>>>>
>>>>>
>>> http://localhost:8983/solr/select?mlt=true&q=id:134847893&mlt.fl=desc&mlt.mindf=1&mlt.mintf=1&debugQuery=on
>>>>>
>>>>> How can I pass in some external text like 'Solr Rocks'. Below is an
>>>>> example
>>>>> of how it would look like.
>>>>>
>>>>> http://localhost:8983/solr/select?mlt=true&external.text=Solr
>>>>> Rocks&mlt.fl=desc&mlt.mindf=1&mlt.mintf=1&debugQuery=on
>>>>>
>>>>>
>>>>> --
>>>>> View this message in context:
>>>>>
>>> http://old.nabble.com/MoreLikeThis---How-to-pass-in-external-text--tp27266316p27266316.html
>>>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>>
>>>>
>>>>
>>>
>>> --
>>> View this message in context:
>>> http://old.nabble.com/MoreLikeThis---How-to-pass-in-external-text--tp27266316p27268777.html
>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
>
>
>
--
View this message in context: http://old.nabble.com/MoreLikeThis---How-to-pass-in-external-text--tp27266316p27279187.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: MoreLikeThis - How to pass in external text?
Posted by David Stuart <da...@progressivealliance.co.uk>.
The MoreLikeThisHandler allows external text to be streamed to it see http://wiki.apache.org/solr/MoreLikeThisHandler#Using_ContentStreams. The url feature is quite good if you have a lot of text and start hitting the character limit in the url
Regards,
Dave
On 22 Jan 2010, at 05:24, Otis Gospodnetic wrote:
> Hi,
>
> Try what I suggested, please.
>
> Or, if you want, go to that (or any other) web page, copy a large chunk of its content, and paste it into Google/Yahoo/Bing. I just did that. Google said my query was too long, but Yahoo took it. Guess what hit #1 was? The page I copied the text from! Very much "more like this"-like.
>
> Otis
> --
> Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch
>
>
>
> ----- Original Message ----
>> From: ldung <du...@gmail.com>
>> To: solr-user@lucene.apache.org
>> Sent: Fri, January 22, 2010 12:08:26 AM
>> Subject: Re: MoreLikeThis - How to pass in external text?
>>
>>
>> I want to use MoreLikeThis since i want to find text in the Solr data that is
>> similar to the input text. I want to see how will this works against just a
>> standard keyword search.
>>
>> I want to do something similar to the article below.
>> http://www.bbc.co.uk/blogs/radiolabs/2008/06/wikipedia_plus_lucene_morelikethis.shtml
>>
>> In the article the author uses MoreLikeThis to classifiy text according into
>> pre-existing categories.
>>
>>
>>
>>
>> Otis Gospodnetic wrote:
>>>
>>> Hi,
>>>
>>> if you have text to pass in, why do you need MoreLikeThis? The text you
>>> speak of can be used as a normal query, so pass it in as a regular
>>> multi-word query.
>>>
>>> Otis
>>> --
>>> Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch
>>>
>>>
>>>
>>> ----- Original Message ----
>>>> From: ldung
>>>> To: solr-user@lucene.apache.org
>>>> Sent: Thu, January 21, 2010 8:08:41 PM
>>>> Subject: MoreLikeThis - How to pass in external text?
>>>>
>>>>
>>>> How can I have the MoreLikeThis query process a piece of text that is
>>>> passed
>>>> into the query. Currently I can only get it MoreLikeThis to work only for
>>>> pieces of text that are already indexed by Solr.
>>>>
>>>> For example here is a query that works for using MoreLikeThis for
>>>> document
>>>> with id:134847893.
>>>>
>>>>
>> http://localhost:8983/solr/select?mlt=true&q=id:134847893&mlt.fl=desc&mlt.mindf=1&mlt.mintf=1&debugQuery=on
>>>>
>>>> How can I pass in some external text like 'Solr Rocks'. Below is an
>>>> example
>>>> of how it would look like.
>>>>
>>>> http://localhost:8983/solr/select?mlt=true&external.text=Solr
>>>> Rocks&mlt.fl=desc&mlt.mindf=1&mlt.mintf=1&debugQuery=on
>>>>
>>>>
>>>> --
>>>> View this message in context:
>>>>
>> http://old.nabble.com/MoreLikeThis---How-to-pass-in-external-text--tp27266316p27266316.html
>>>> Sent from the Solr - User mailing list archive at Nabble.com.
>>>
>>>
>>>
>>
>> --
>> View this message in context:
>> http://old.nabble.com/MoreLikeThis---How-to-pass-in-external-text--tp27266316p27268777.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>
Re: MoreLikeThis - How to pass in external text?
Posted by Otis Gospodnetic <ot...@yahoo.com>.
Hi,
Try what I suggested, please.
Or, if you want, go to that (or any other) web page, copy a large chunk of its content, and paste it into Google/Yahoo/Bing. I just did that. Google said my query was too long, but Yahoo took it. Guess what hit #1 was? The page I copied the text from! Very much "more like this"-like.
Otis
--
Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch
----- Original Message ----
> From: ldung <du...@gmail.com>
> To: solr-user@lucene.apache.org
> Sent: Fri, January 22, 2010 12:08:26 AM
> Subject: Re: MoreLikeThis - How to pass in external text?
>
>
> I want to use MoreLikeThis since i want to find text in the Solr data that is
> similar to the input text. I want to see how will this works against just a
> standard keyword search.
>
> I want to do something similar to the article below.
> http://www.bbc.co.uk/blogs/radiolabs/2008/06/wikipedia_plus_lucene_morelikethis.shtml
>
> In the article the author uses MoreLikeThis to classifiy text according into
> pre-existing categories.
>
>
>
>
> Otis Gospodnetic wrote:
> >
> > Hi,
> >
> > if you have text to pass in, why do you need MoreLikeThis? The text you
> > speak of can be used as a normal query, so pass it in as a regular
> > multi-word query.
> >
> > Otis
> > --
> > Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch
> >
> >
> >
> > ----- Original Message ----
> >> From: ldung
> >> To: solr-user@lucene.apache.org
> >> Sent: Thu, January 21, 2010 8:08:41 PM
> >> Subject: MoreLikeThis - How to pass in external text?
> >>
> >>
> >> How can I have the MoreLikeThis query process a piece of text that is
> >> passed
> >> into the query. Currently I can only get it MoreLikeThis to work only for
> >> pieces of text that are already indexed by Solr.
> >>
> >> For example here is a query that works for using MoreLikeThis for
> >> document
> >> with id:134847893.
> >>
> >>
> http://localhost:8983/solr/select?mlt=true&q=id:134847893&mlt.fl=desc&mlt.mindf=1&mlt.mintf=1&debugQuery=on
> >>
> >> How can I pass in some external text like 'Solr Rocks'. Below is an
> >> example
> >> of how it would look like.
> >>
> >> http://localhost:8983/solr/select?mlt=true&external.text=Solr
> >> Rocks&mlt.fl=desc&mlt.mindf=1&mlt.mintf=1&debugQuery=on
> >>
> >>
> >> --
> >> View this message in context:
> >>
> http://old.nabble.com/MoreLikeThis---How-to-pass-in-external-text--tp27266316p27266316.html
> >> Sent from the Solr - User mailing list archive at Nabble.com.
> >
> >
> >
>
> --
> View this message in context:
> http://old.nabble.com/MoreLikeThis---How-to-pass-in-external-text--tp27266316p27268777.html
> Sent from the Solr - User mailing list archive at Nabble.com.
Re: MoreLikeThis - How to pass in external text?
Posted by ldung <du...@gmail.com>.
I want to use MoreLikeThis since i want to find text in the Solr data that is
similar to the input text. I want to see how will this works against just a
standard keyword search.
I want to do something similar to the article below.
http://www.bbc.co.uk/blogs/radiolabs/2008/06/wikipedia_plus_lucene_morelikethis.shtml
In the article the author uses MoreLikeThis to classifiy text according into
pre-existing categories.
Otis Gospodnetic wrote:
>
> Hi,
>
> if you have text to pass in, why do you need MoreLikeThis? The text you
> speak of can be used as a normal query, so pass it in as a regular
> multi-word query.
>
> Otis
> --
> Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch
>
>
>
> ----- Original Message ----
>> From: ldung <du...@gmail.com>
>> To: solr-user@lucene.apache.org
>> Sent: Thu, January 21, 2010 8:08:41 PM
>> Subject: MoreLikeThis - How to pass in external text?
>>
>>
>> How can I have the MoreLikeThis query process a piece of text that is
>> passed
>> into the query. Currently I can only get it MoreLikeThis to work only for
>> pieces of text that are already indexed by Solr.
>>
>> For example here is a query that works for using MoreLikeThis for
>> document
>> with id:134847893.
>>
>> http://localhost:8983/solr/select?mlt=true&q=id:134847893&mlt.fl=desc&mlt.mindf=1&mlt.mintf=1&debugQuery=on
>>
>> How can I pass in some external text like 'Solr Rocks'. Below is an
>> example
>> of how it would look like.
>>
>> http://localhost:8983/solr/select?mlt=true&external.text=Solr
>> Rocks&mlt.fl=desc&mlt.mindf=1&mlt.mintf=1&debugQuery=on
>>
>>
>> --
>> View this message in context:
>> http://old.nabble.com/MoreLikeThis---How-to-pass-in-external-text--tp27266316p27266316.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
>
--
View this message in context: http://old.nabble.com/MoreLikeThis---How-to-pass-in-external-text--tp27266316p27268777.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: MoreLikeThis - How to pass in external text?
Posted by Otis Gospodnetic <ot...@yahoo.com>.
Hi,
if you have text to pass in, why do you need MoreLikeThis? The text you speak of can be used as a normal query, so pass it in as a regular multi-word query.
Otis
--
Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch
----- Original Message ----
> From: ldung <du...@gmail.com>
> To: solr-user@lucene.apache.org
> Sent: Thu, January 21, 2010 8:08:41 PM
> Subject: MoreLikeThis - How to pass in external text?
>
>
> How can I have the MoreLikeThis query process a piece of text that is passed
> into the query. Currently I can only get it MoreLikeThis to work only for
> pieces of text that are already indexed by Solr.
>
> For example here is a query that works for using MoreLikeThis for document
> with id:134847893.
>
> http://localhost:8983/solr/select?mlt=true&q=id:134847893&mlt.fl=desc&mlt.mindf=1&mlt.mintf=1&debugQuery=on
>
> How can I pass in some external text like 'Solr Rocks'. Below is an example
> of how it would look like.
>
> http://localhost:8983/solr/select?mlt=true&external.text=Solr
> Rocks&mlt.fl=desc&mlt.mindf=1&mlt.mintf=1&debugQuery=on
>
>
> --
> View this message in context:
> http://old.nabble.com/MoreLikeThis---How-to-pass-in-external-text--tp27266316p27266316.html
> Sent from the Solr - User mailing list archive at Nabble.com.