You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Bruno Mannina <bm...@free.fr> on 2013/10/23 23:19:53 UTC
Terms function join with a Select function ?
Dear Solr users,
I use the Terms function to see the frequency data in a field but it's
for the whole database.
I have 2 questions:
- Is it possible to increase the number of statistic ? actually I have
the 10 first frequency term.
- Is it possible to limit this statistic to the result of a request ?
PS: the second question is very important for me.
Many thanks
Re: Terms function join with a Select function ?
Posted by Bruno Mannina <bm...@free.fr>.
Hi Erick,
I think it's a memory problem, I do my test on a little computer at home
(8Go Ram i3-2120 3.30Ghz 64bits)
and my database is very big 87M docs for 200Go size.
I thought SOLR could done statistic on only the query answer, so here on
around 3000 docs (around 6000 terms)
it's not so big....
I do analyze log yet, I will do in few hours when I comeback home
Thanks,
Bruno
Le 25/10/2013 15:36, Erick Erickson a écrit :
> How many unique values are in the field? Solr has to create a counter
> for each and every one of them, you may be blowing memory up. What
> do the logs say?
>
>
> Best,
> Erick
>
>
> On Thu, Oct 24, 2013 at 4:07 PM, Bruno Mannina <bm...@free.fr> wrote:
>
>> Just a little precision: solr down after running my URL :( so bad...
>>
>> Le 24/10/2013 22:04, Bruno Mannina a écrit :
>>
>> humm facet perfs are very bad.... (Solr 3.6.0)
>>> My index is around 87 000 000 docs. (4 * Proc double core, 24G Ram)
>>>
>>> I thought facets will work only on the result but it seems it's not the
>>> case.
>>>
>>> My request:
>>> http://localhost:2727/solr/**select?q=ti:snowboard&rows=0&**
>>> facet=true&facet.field=ap&**facet.limit=5<http://localhost:2727/solr/select?q=ti:snowboard&rows=0&facet=true&facet.field=ap&facet.limit=5>
>>>
>>> Do you think my request is wrong ?
>>>
>>> Maybe it's not possible to have statistic on a field (like Terms
>>> function) on a query.....
>>>
>>> Thx for your help,
>>>
>>> Bruno
>>>
>>>
>>> Le 24/10/2013 19:40, Bruno Mannina a écrit :
>>>
>>>> Dear,
>>>>
>>>> hum....I don't know how can I use it..;
>>>>
>>>> I tried:
>>>>
>>>> my query:
>>>> ti:snowboard (3095 results)
>>>>
>>>> I would like to have at the end of my XML, the Terms statistic for the
>>>> field AP (applicant field (patent notice))
>>>>
>>>> but I haven't that...
>>>>
>>>> Please help,
>>>> Bruno
>>>>
>>>> ..../select?q=ti%Asnowboard&**version=2.2&start=0&rows=10&**
>>>> indent=on&facet=true&f.ap.**facet.limit=10
>>>>
>>>> Le 24/10/2013 14:04, Erik Hatcher a écrit :
>>>>
>>>>> That would be called faceting :)
>>>>>
>>>>> http://wiki.apache.org/solr/**SimpleFacetParameters<http://wiki.apache.org/solr/SimpleFacetParameters>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> On Oct 24, 2013, at 5:23 AM, Bruno Mannina <bm...@free.fr> wrote:
>>>>>
>>>>> Dear All,
>>>>>> Ok I have an answer concerning the first question (limit)
>>>>>> It's the terms.limit parameters.
>>>>>>
>>>>>> But I can't find how to apply a Terms request on a query result....
>>>>>>
>>>>>> any idea ?
>>>>>>
>>>>>> Bruno
>>>>>>
>>>>>> Le 23/10/2013 23:19, Bruno Mannina a écrit :
>>>>>>
>>>>>>> Dear Solr users,
>>>>>>>
>>>>>>> I use the Terms function to see the frequency data in a field but
>>>>>>> it's for the whole database.
>>>>>>>
>>>>>>> I have 2 questions:
>>>>>>> - Is it possible to increase the number of statistic ? actually I
>>>>>>> have the 10 first frequency term.
>>>>>>>
>>>>>>> - Is it possible to limit this statistic to the result of a request ?
>>>>>>>
>>>>>>> PS: the second question is very important for me.
>>>>>>>
>>>>>>> Many thanks
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>> ---
>>>>>> Ce courrier électronique ne contient aucun virus ou logiciel
>>>>>> malveillant parce que la protection avast! Antivirus est active.
>>>>>> http://www.avast.com
>>>>>>
>>>>>>
>>>>>
>>>> ---
>>>> Ce courrier électronique ne contient aucun virus ou logiciel malveillant
>>>> parce que la protection avast! Antivirus est active.
>>>> http://www.avast.com
>>>>
>>>>
>>>>
>>>>
>>> ---
>>> Ce courrier électronique ne contient aucun virus ou logiciel malveillant
>>> parce que la protection avast! Antivirus est active.
>>> http://www.avast.com
>>>
>>>
>>>
>>>
>> ---
>> Ce courrier électronique ne contient aucun virus ou logiciel malveillant
>> parce que la protection avast! Antivirus est active.
>> http://www.avast.com
>>
>>
---
Ce courrier électronique ne contient aucun virus ou logiciel malveillant parce que la protection avast! Antivirus est active.
http://www.avast.com
Re: Terms function join with a Select function ?
Posted by Erick Erickson <er...@gmail.com>.
How many unique values are in the field? Solr has to create a counter
for each and every one of them, you may be blowing memory up. What
do the logs say?
Best,
Erick
On Thu, Oct 24, 2013 at 4:07 PM, Bruno Mannina <bm...@free.fr> wrote:
> Just a little precision: solr down after running my URL :( so bad...
>
> Le 24/10/2013 22:04, Bruno Mannina a écrit :
>
> humm facet perfs are very bad.... (Solr 3.6.0)
>> My index is around 87 000 000 docs. (4 * Proc double core, 24G Ram)
>>
>> I thought facets will work only on the result but it seems it's not the
>> case.
>>
>> My request:
>> http://localhost:2727/solr/**select?q=ti:snowboard&rows=0&**
>> facet=true&facet.field=ap&**facet.limit=5<http://localhost:2727/solr/select?q=ti:snowboard&rows=0&facet=true&facet.field=ap&facet.limit=5>
>>
>> Do you think my request is wrong ?
>>
>> Maybe it's not possible to have statistic on a field (like Terms
>> function) on a query.....
>>
>> Thx for your help,
>>
>> Bruno
>>
>>
>> Le 24/10/2013 19:40, Bruno Mannina a écrit :
>>
>>> Dear,
>>>
>>> hum....I don't know how can I use it..;
>>>
>>> I tried:
>>>
>>> my query:
>>> ti:snowboard (3095 results)
>>>
>>> I would like to have at the end of my XML, the Terms statistic for the
>>> field AP (applicant field (patent notice))
>>>
>>> but I haven't that...
>>>
>>> Please help,
>>> Bruno
>>>
>>> ..../select?q=ti%Asnowboard&**version=2.2&start=0&rows=10&**
>>> indent=on&facet=true&f.ap.**facet.limit=10
>>>
>>> Le 24/10/2013 14:04, Erik Hatcher a écrit :
>>>
>>>> That would be called faceting :)
>>>>
>>>> http://wiki.apache.org/solr/**SimpleFacetParameters<http://wiki.apache.org/solr/SimpleFacetParameters>
>>>>
>>>>
>>>>
>>>>
>>>> On Oct 24, 2013, at 5:23 AM, Bruno Mannina <bm...@free.fr> wrote:
>>>>
>>>> Dear All,
>>>>>
>>>>> Ok I have an answer concerning the first question (limit)
>>>>> It's the terms.limit parameters.
>>>>>
>>>>> But I can't find how to apply a Terms request on a query result....
>>>>>
>>>>> any idea ?
>>>>>
>>>>> Bruno
>>>>>
>>>>> Le 23/10/2013 23:19, Bruno Mannina a écrit :
>>>>>
>>>>>> Dear Solr users,
>>>>>>
>>>>>> I use the Terms function to see the frequency data in a field but
>>>>>> it's for the whole database.
>>>>>>
>>>>>> I have 2 questions:
>>>>>> - Is it possible to increase the number of statistic ? actually I
>>>>>> have the 10 first frequency term.
>>>>>>
>>>>>> - Is it possible to limit this statistic to the result of a request ?
>>>>>>
>>>>>> PS: the second question is very important for me.
>>>>>>
>>>>>> Many thanks
>>>>>>
>>>>>>
>>>>>>
>>>>> ---
>>>>> Ce courrier électronique ne contient aucun virus ou logiciel
>>>>> malveillant parce que la protection avast! Antivirus est active.
>>>>> http://www.avast.com
>>>>>
>>>>>
>>>>
>>>>
>>>
>>> ---
>>> Ce courrier électronique ne contient aucun virus ou logiciel malveillant
>>> parce que la protection avast! Antivirus est active.
>>> http://www.avast.com
>>>
>>>
>>>
>>>
>>
>> ---
>> Ce courrier électronique ne contient aucun virus ou logiciel malveillant
>> parce que la protection avast! Antivirus est active.
>> http://www.avast.com
>>
>>
>>
>>
>
> ---
> Ce courrier électronique ne contient aucun virus ou logiciel malveillant
> parce que la protection avast! Antivirus est active.
> http://www.avast.com
>
>
Re: Terms function join with a Select function ?
Posted by Bruno Mannina <bm...@free.fr>.
Just a little precision: solr down after running my URL :( so bad...
Le 24/10/2013 22:04, Bruno Mannina a écrit :
> humm facet perfs are very bad.... (Solr 3.6.0)
> My index is around 87 000 000 docs. (4 * Proc double core, 24G Ram)
>
> I thought facets will work only on the result but it seems it's not
> the case.
>
> My request:
> http://localhost:2727/solr/select?q=ti:snowboard&rows=0&facet=true&facet.field=ap&facet.limit=5
>
>
> Do you think my request is wrong ?
>
> Maybe it's not possible to have statistic on a field (like Terms
> function) on a query.....
>
> Thx for your help,
>
> Bruno
>
>
> Le 24/10/2013 19:40, Bruno Mannina a écrit :
>> Dear,
>>
>> hum....I don't know how can I use it..;
>>
>> I tried:
>>
>> my query:
>> ti:snowboard (3095 results)
>>
>> I would like to have at the end of my XML, the Terms statistic for
>> the field AP (applicant field (patent notice))
>>
>> but I haven't that...
>>
>> Please help,
>> Bruno
>>
>> ..../select?q=ti%Asnowboard&version=2.2&start=0&rows=10&indent=on&facet=true&f.ap.facet.limit=10
>>
>>
>> Le 24/10/2013 14:04, Erik Hatcher a écrit :
>>> That would be called faceting :)
>>>
>>> http://wiki.apache.org/solr/SimpleFacetParameters
>>>
>>>
>>>
>>>
>>> On Oct 24, 2013, at 5:23 AM, Bruno Mannina <bm...@free.fr> wrote:
>>>
>>>> Dear All,
>>>>
>>>> Ok I have an answer concerning the first question (limit)
>>>> It's the terms.limit parameters.
>>>>
>>>> But I can't find how to apply a Terms request on a query result....
>>>>
>>>> any idea ?
>>>>
>>>> Bruno
>>>>
>>>> Le 23/10/2013 23:19, Bruno Mannina a écrit :
>>>>> Dear Solr users,
>>>>>
>>>>> I use the Terms function to see the frequency data in a field but
>>>>> it's for the whole database.
>>>>>
>>>>> I have 2 questions:
>>>>> - Is it possible to increase the number of statistic ? actually I
>>>>> have the 10 first frequency term.
>>>>>
>>>>> - Is it possible to limit this statistic to the result of a request ?
>>>>>
>>>>> PS: the second question is very important for me.
>>>>>
>>>>> Many thanks
>>>>>
>>>>>
>>>>
>>>> ---
>>>> Ce courrier électronique ne contient aucun virus ou logiciel
>>>> malveillant parce que la protection avast! Antivirus est active.
>>>> http://www.avast.com
>>>>
>>>
>>>
>>
>>
>> ---
>> Ce courrier électronique ne contient aucun virus ou logiciel
>> malveillant parce que la protection avast! Antivirus est active.
>> http://www.avast.com
>>
>>
>>
>
>
> ---
> Ce courrier électronique ne contient aucun virus ou logiciel
> malveillant parce que la protection avast! Antivirus est active.
> http://www.avast.com
>
>
>
---
Ce courrier électronique ne contient aucun virus ou logiciel malveillant parce que la protection avast! Antivirus est active.
http://www.avast.com
Re: Terms function join with a Select function ?
Posted by Bruno Mannina <bm...@free.fr>.
humm facet perfs are very bad.... (Solr 3.6.0)
My index is around 87 000 000 docs. (4 * Proc double core, 24G Ram)
I thought facets will work only on the result but it seems it's not the
case.
My request:
http://localhost:2727/solr/select?q=ti:snowboard&rows=0&facet=true&facet.field=ap&facet.limit=5
Do you think my request is wrong ?
Maybe it's not possible to have statistic on a field (like Terms
function) on a query.....
Thx for your help,
Bruno
Le 24/10/2013 19:40, Bruno Mannina a écrit :
> Dear,
>
> hum....I don't know how can I use it..;
>
> I tried:
>
> my query:
> ti:snowboard (3095 results)
>
> I would like to have at the end of my XML, the Terms statistic for the
> field AP (applicant field (patent notice))
>
> but I haven't that...
>
> Please help,
> Bruno
>
> ..../select?q=ti%Asnowboard&version=2.2&start=0&rows=10&indent=on&facet=true&f.ap.facet.limit=10
>
>
> Le 24/10/2013 14:04, Erik Hatcher a écrit :
>> That would be called faceting :)
>>
>> http://wiki.apache.org/solr/SimpleFacetParameters
>>
>>
>>
>>
>> On Oct 24, 2013, at 5:23 AM, Bruno Mannina <bm...@free.fr> wrote:
>>
>>> Dear All,
>>>
>>> Ok I have an answer concerning the first question (limit)
>>> It's the terms.limit parameters.
>>>
>>> But I can't find how to apply a Terms request on a query result....
>>>
>>> any idea ?
>>>
>>> Bruno
>>>
>>> Le 23/10/2013 23:19, Bruno Mannina a écrit :
>>>> Dear Solr users,
>>>>
>>>> I use the Terms function to see the frequency data in a field but
>>>> it's for the whole database.
>>>>
>>>> I have 2 questions:
>>>> - Is it possible to increase the number of statistic ? actually I
>>>> have the 10 first frequency term.
>>>>
>>>> - Is it possible to limit this statistic to the result of a request ?
>>>>
>>>> PS: the second question is very important for me.
>>>>
>>>> Many thanks
>>>>
>>>>
>>>
>>> ---
>>> Ce courrier électronique ne contient aucun virus ou logiciel
>>> malveillant parce que la protection avast! Antivirus est active.
>>> http://www.avast.com
>>>
>>
>>
>
>
> ---
> Ce courrier électronique ne contient aucun virus ou logiciel
> malveillant parce que la protection avast! Antivirus est active.
> http://www.avast.com
>
>
>
---
Ce courrier électronique ne contient aucun virus ou logiciel malveillant parce que la protection avast! Antivirus est active.
http://www.avast.com
Re: Terms function join with a Select function ?
Posted by Bruno Mannina <bm...@free.fr>.
Dear,
hum....I don't know how can I use it..;
I tried:
my query:
ti:snowboard (3095 results)
I would like to have at the end of my XML, the Terms statistic for the
field AP (applicant field (patent notice))
but I haven't that...
Please help,
Bruno
..../select?q=ti%Asnowboard&version=2.2&start=0&rows=10&indent=on&facet=true&f.ap.facet.limit=10
Le 24/10/2013 14:04, Erik Hatcher a écrit :
> That would be called faceting :)
>
> http://wiki.apache.org/solr/SimpleFacetParameters
>
>
>
>
> On Oct 24, 2013, at 5:23 AM, Bruno Mannina <bm...@free.fr> wrote:
>
>> Dear All,
>>
>> Ok I have an answer concerning the first question (limit)
>> It's the terms.limit parameters.
>>
>> But I can't find how to apply a Terms request on a query result....
>>
>> any idea ?
>>
>> Bruno
>>
>> Le 23/10/2013 23:19, Bruno Mannina a écrit :
>>> Dear Solr users,
>>>
>>> I use the Terms function to see the frequency data in a field but it's for the whole database.
>>>
>>> I have 2 questions:
>>> - Is it possible to increase the number of statistic ? actually I have the 10 first frequency term.
>>>
>>> - Is it possible to limit this statistic to the result of a request ?
>>>
>>> PS: the second question is very important for me.
>>>
>>> Many thanks
>>>
>>>
>>
>> ---
>> Ce courrier électronique ne contient aucun virus ou logiciel malveillant parce que la protection avast! Antivirus est active.
>> http://www.avast.com
>>
>
>
---
Ce courrier électronique ne contient aucun virus ou logiciel malveillant parce que la protection avast! Antivirus est active.
http://www.avast.com
Re: Terms function join with a Select function ?
Posted by Erik Hatcher <er...@gmail.com>.
That would be called faceting :)
http://wiki.apache.org/solr/SimpleFacetParameters
On Oct 24, 2013, at 5:23 AM, Bruno Mannina <bm...@free.fr> wrote:
> Dear All,
>
> Ok I have an answer concerning the first question (limit)
> It's the terms.limit parameters.
>
> But I can't find how to apply a Terms request on a query result....
>
> any idea ?
>
> Bruno
>
> Le 23/10/2013 23:19, Bruno Mannina a écrit :
>> Dear Solr users,
>>
>> I use the Terms function to see the frequency data in a field but it's for the whole database.
>>
>> I have 2 questions:
>> - Is it possible to increase the number of statistic ? actually I have the 10 first frequency term.
>>
>> - Is it possible to limit this statistic to the result of a request ?
>>
>> PS: the second question is very important for me.
>>
>> Many thanks
>>
>>
>
>
> ---
> Ce courrier électronique ne contient aucun virus ou logiciel malveillant parce que la protection avast! Antivirus est active.
> http://www.avast.com
>
Re: Terms function join with a Select function ?
Posted by Bruno Mannina <bm...@free.fr>.
Dear All,
Ok I have an answer concerning the first question (limit)
It's the terms.limit parameters.
But I can't find how to apply a Terms request on a query result....
any idea ?
Bruno
Le 23/10/2013 23:19, Bruno Mannina a écrit :
> Dear Solr users,
>
> I use the Terms function to see the frequency data in a field but it's
> for the whole database.
>
> I have 2 questions:
> - Is it possible to increase the number of statistic ? actually I have
> the 10 first frequency term.
>
> - Is it possible to limit this statistic to the result of a request ?
>
> PS: the second question is very important for me.
>
> Many thanks
>
>
---
Ce courrier électronique ne contient aucun virus ou logiciel malveillant parce que la protection avast! Antivirus est active.
http://www.avast.com