You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Daniel Bryant <da...@tai-dev.co.uk> on 2013/07/03 11:54:31 UTC
Advice for performance issues with group.facet=true
Hi everyone,
I'm seeing very bad performance when grouping (field collapsing) using
group.facet=true with a large result set.
- I have an index with 2 million documents, and I query with five facet
fields (each with 30+ groups)
- If I set group.facet=false the query can take 2000ms on first run, but
no more than 250ms on subsequent execution
- If I set group.facet=true it takes on average 18000ms on the first
run, and the same time on all subsequent runs (suggesting to me that a
cache is not being used)
I've checked the Solr Jira and several others are experiencing the same
issue:
https://issues.apache.org/jira/browse/SOLR-4763
Could anyone offer any advice or suggestions please? This is becoming a
blocking issue for us, and I'm very curious if this will be fixed in the
near future?
Best wishes,
Daniel
--
*Daniel Bryant | Software Development Consultant | www.tai-dev.co.uk
<http://www.tai-dev.co.uk/>*
daniel.bryant@tai-dev.co.uk <ma...@tai-dev.co.uk> | +44
(0) 7799406399 | Twitter: @taidevcouk <https://twitter.com/taidevcouk>
Re: Advice for performance issues with group.facet=true
Posted by Daniel Bryant <da...@tai-dev.co.uk>.
Many thanks for your response Otis - I had feared as much, but it's good
to have it confirmed.
Best wishes,
Daniel
On 03/07/2013 17:05, Otis Gospodnetic wrote:
> Hi,
>
> I think nobody in the community is focused on field
> collapsing/grouping, so I suspect there won't be a fix until somebody
> gets a strong-enough itch or business requires it so much that it
> decides it pays to invests in the contribution.
>
> Otis
> --
> Solr & ElasticSearch Support -- http://sematext.com/
> Performance Monitoring -- http://sematext.com/spm
>
>
>
> On Wed, Jul 3, 2013 at 5:54 AM, Daniel Bryant
> <da...@tai-dev.co.uk> wrote:
>> Hi everyone,
>>
>> I'm seeing very bad performance when grouping (field collapsing) using
>> group.facet=true with a large result set.
>>
>> - I have an index with 2 million documents, and I query with five facet
>> fields (each with 30+ groups)
>> - If I set group.facet=false the query can take 2000ms on first run, but no
>> more than 250ms on subsequent execution
>> - If I set group.facet=true it takes on average 18000ms on the first run,
>> and the same time on all subsequent runs (suggesting to me that a cache is
>> not being used)
>>
>> I've checked the Solr Jira and several others are experiencing the same
>> issue:
>>
>> https://issues.apache.org/jira/browse/SOLR-4763
>>
>> Could anyone offer any advice or suggestions please? This is becoming a
>> blocking issue for us, and I'm very curious if this will be fixed in the
>> near future?
>>
>> Best wishes,
>>
>> Daniel
>>
>> --
>> *Daniel Bryant | Software Development Consultant | www.tai-dev.co.uk
>> <http://www.tai-dev.co.uk/>*
>> daniel.bryant@tai-dev.co.uk <ma...@tai-dev.co.uk> | +44 (0)
>> 7799406399 | Twitter: @taidevcouk <https://twitter.com/taidevcouk>
--
*Daniel Bryant | Software Development Consultant | www.tai-dev.co.uk
<http://www.tai-dev.co.uk/>*
daniel.bryant@tai-dev.co.uk <ma...@tai-dev.co.uk> | +44
(0) 7799406399 | Twitter: @taidevcouk <https://twitter.com/taidevcouk>
Re: Advice for performance issues with group.facet=true
Posted by Otis Gospodnetic <ot...@gmail.com>.
Hi,
I think nobody in the community is focused on field
collapsing/grouping, so I suspect there won't be a fix until somebody
gets a strong-enough itch or business requires it so much that it
decides it pays to invests in the contribution.
Otis
--
Solr & ElasticSearch Support -- http://sematext.com/
Performance Monitoring -- http://sematext.com/spm
On Wed, Jul 3, 2013 at 5:54 AM, Daniel Bryant
<da...@tai-dev.co.uk> wrote:
> Hi everyone,
>
> I'm seeing very bad performance when grouping (field collapsing) using
> group.facet=true with a large result set.
>
> - I have an index with 2 million documents, and I query with five facet
> fields (each with 30+ groups)
> - If I set group.facet=false the query can take 2000ms on first run, but no
> more than 250ms on subsequent execution
> - If I set group.facet=true it takes on average 18000ms on the first run,
> and the same time on all subsequent runs (suggesting to me that a cache is
> not being used)
>
> I've checked the Solr Jira and several others are experiencing the same
> issue:
>
> https://issues.apache.org/jira/browse/SOLR-4763
>
> Could anyone offer any advice or suggestions please? This is becoming a
> blocking issue for us, and I'm very curious if this will be fixed in the
> near future?
>
> Best wishes,
>
> Daniel
>
> --
> *Daniel Bryant | Software Development Consultant | www.tai-dev.co.uk
> <http://www.tai-dev.co.uk/>*
> daniel.bryant@tai-dev.co.uk <ma...@tai-dev.co.uk> | +44 (0)
> 7799406399 | Twitter: @taidevcouk <https://twitter.com/taidevcouk>