You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Kashif Khan <up...@gmail.com> on 2012/03/30 08:50:18 UTC
Quantiles in SOLR ???
Hi all,
I am doing R&D about SOLR using any quantiles function for a set. I need a
quick-start road-map for modifying that quantiles function in my SOLR
plugin. I am thinking that it might be using any third party tools or
library for it.
--
Kashif Khan
--
View this message in context: http://lucene.472066.n3.nabble.com/Quantiles-in-SOLR-tp3870084p3870084.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Quantiles in SOLR ???
Posted by Paul Libbrecht <pa...@hoplahup.net>.
Kashif,
my knowledge in probability is limited but I believe the simple similarity function can be seen as a quantile.
You can read about it in many places, I believe I read it in the Lucene in Action book.
paul
Le 3 avr. 2012 à 15:14, Kashif Khan a écrit :
> Thanks for sharing your intellectual knowledge but my basic question is not
> answered that whether either solr or lucene is using any method to calculate
> quantiles and/or using it anyway the quantiles anywhere if yes. Then i want
> to make use of the same thing rather creating a new one
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/Quantiles-in-SOLR-tp3870084p3880885.html
> Sent from the Solr - User mailing list archive at Nabble.com.
Re: Quantiles in SOLR ???
Posted by Kashif Khan <up...@gmail.com>.
Thanks for sharing your intellectual knowledge but my basic question is not
answered that whether either solr or lucene is using any method to calculate
quantiles and/or using it anyway the quantiles anywhere if yes. Then i want
to make use of the same thing rather creating a new one
--
View this message in context: http://lucene.472066.n3.nabble.com/Quantiles-in-SOLR-tp3870084p3880885.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Quantiles in SOLR ???
Posted by Erick Erickson <er...@gmail.com>.
Duh. quantiles. I was reading quantities. Old eyes.
On Fri, Mar 30, 2012 at 1:44 PM, Walter Underwood <wu...@wunderwood.org> wrote:
> Quantiles require accessing the entire list of results, or at least, sorting by the interesting values, checking the total hits, then accessing the results list at the desired interval. So, with 3000 hits, get deciles by getting the first row, then the 301st row, the 601st row, etc.
>
> This might be slow and require a lot of memory. Solr is optimized for showing the top few results. Anything that accesses all results or even requests rows far down the list can be very slow.
>
> If your main use requires accessing all results, Solr may not be the right choice. A relational database is designed for efficient operations over the entire set of results.
>
> wunder
>
> On Mar 29, 2012, at 11:50 PM, Kashif Khan wrote:
>
>> Hi all,
>>
>> I am doing R&D about SOLR using any quantiles function for a set. I need a
>> quick-start road-map for modifying that quantiles function in my SOLR
>> plugin. I am thinking that it might be using any third party tools or
>> library for it.
>>
>> --
>> Kashif Khan
>>
>> --
>> View this message in context: http://lucene.472066.n3.nabble.com/Quantiles-in-SOLR-tp3870084p3870084.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
>
>
Re: Quantiles in SOLR ???
Posted by Walter Underwood <wu...@wunderwood.org>.
Quantiles require accessing the entire list of results, or at least, sorting by the interesting values, checking the total hits, then accessing the results list at the desired interval. So, with 3000 hits, get deciles by getting the first row, then the 301st row, the 601st row, etc.
This might be slow and require a lot of memory. Solr is optimized for showing the top few results. Anything that accesses all results or even requests rows far down the list can be very slow.
If your main use requires accessing all results, Solr may not be the right choice. A relational database is designed for efficient operations over the entire set of results.
wunder
On Mar 29, 2012, at 11:50 PM, Kashif Khan wrote:
> Hi all,
>
> I am doing R&D about SOLR using any quantiles function for a set. I need a
> quick-start road-map for modifying that quantiles function in my SOLR
> plugin. I am thinking that it might be using any third party tools or
> library for it.
>
> --
> Kashif Khan
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/Quantiles-in-SOLR-tp3870084p3870084.html
> Sent from the Solr - User mailing list archive at Nabble.com.
Re: Quantiles in SOLR ???
Posted by Erick Erickson <er...@gmail.com>.
I really don't understand what you're trying
to accomplish. What is a "quantities function"?
What do you want it to do?
Best
Erick
On Fri, Mar 30, 2012 at 2:50 AM, Kashif Khan <up...@gmail.com> wrote:
> Hi all,
>
> I am doing R&D about SOLR using any quantiles function for a set. I need a
> quick-start road-map for modifying that quantiles function in my SOLR
> plugin. I am thinking that it might be using any third party tools or
> library for it.
>
> --
> Kashif Khan
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/Quantiles-in-SOLR-tp3870084p3870084.html
> Sent from the Solr - User mailing list archive at Nabble.com.