You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Yonik Seeley (JIRA)" <ji...@apache.org> on 2010/07/11 03:41:51 UTC

[jira] Updated: (SOLR-1682) Implement CollapseComponent

     [ https://issues.apache.org/jira/browse/SOLR-1682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yonik Seeley updated SOLR-1682:
-------------------------------

    Attachment: SOLR-1682_prototype.patch

Here's an updated patch.  I started down the path at a combined hashmap/treemap... but reverted since it's pure premature optimization at this point.

I did change the way that values are obtained from value sources (via a ValueFiller class).  This avoids every single DocValues in a complex function from creating a MutableValue for no reason, and avoids a cast that would be needed if the user passed in a value to be filled each time.

The second stage (for accurate counts, and for collapse counts greater than one) is now implemented. 

Example:
http://localhost:8983/solr/select?q=*:*&groupby=popularity&docsPerGroup=3&fl=id,popularity

Example of grouping by an arbitrary function:
http://localhost:8983/solr/select?q=*:*&groupby=add%28popularity,popularity%29&docsPerGroup=3&fl=id,popularity

Caveats:
 * much of this is still test code... the parameter names will change, as will the upper level interface code and response format.  the focus so far has just been on the collectors and value sources.
 * Both the group sort and the documents within a group are currently governed by the "sort" param.  This won't always be the case.
 * This is only a general purpose algorithm that should work with a minimum of memory usage - there will be *many* different algorithms that offer better performance in specific scenarios in the future.


> Implement CollapseComponent
> ---------------------------
>
>                 Key: SOLR-1682
>                 URL: https://issues.apache.org/jira/browse/SOLR-1682
>             Project: Solr
>          Issue Type: Sub-task
>          Components: search
>            Reporter: Martijn van Groningen
>            Assignee: Shalin Shekhar Mangar
>             Fix For: Next
>
>         Attachments: field-collapsing.patch, SOLR-1682.patch, SOLR-1682.patch, SOLR-1682_prototype.patch, SOLR-1682_prototype.patch, SOLR-1682_prototype.patch, SOLR-236.patch
>
>
> Child issue of SOLR-236. This issue is dedicated to field collapsing in general and all its code (CollapseComponent, DocumentCollapsers and CollapseCollectors). The main goal is the finalize the request parameters and response format.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org