You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Francois Perron (JIRA)" <ji...@apache.org> on 2012/05/04 15:40:48 UTC

[jira] [Created] (SOLR-3436) Groups count in distributed grouping is wrong in some case

Francois Perron created SOLR-3436:
-------------------------------------

             Summary: Groups count in distributed grouping is wrong in some case
                 Key: SOLR-3436
                 URL: https://issues.apache.org/jira/browse/SOLR-3436
             Project: Solr
          Issue Type: Bug
          Components: SearchComponents - other
    Affects Versions: 4.0
         Environment: MacOs X Lion, Java 1.6.0_31
            Reporter: Francois Perron


The count of groups in distributed grouping environment only show results from shards used in the second pass.

How to reproduce :

Ask for only 1 document (ROWS=1) in a 2 shards environnement with GROUPS.NGOURP=true and of course with GROUPS.FIELD=fieldA.

Results :

It will only display the total of a shard (the one used for the second pass)

Expected results :

Sum all groups count from ALL shards.



--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Resolved] (SOLR-3436) Groups count in distributed grouping is wrong in some case

Posted by "Martijn van Groningen (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-3436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Martijn van Groningen resolved SOLR-3436.
-----------------------------------------

    Resolution: Fixed
    
> Groups count in distributed grouping is wrong in some case
> ----------------------------------------------------------
>
>                 Key: SOLR-3436
>                 URL: https://issues.apache.org/jira/browse/SOLR-3436
>             Project: Solr
>          Issue Type: Bug
>          Components: SearchComponents - other
>    Affects Versions: 3.4, 3.5, 3.6, 4.0
>         Environment: MacOs X Lion, Java 1.6.0_31
>            Reporter: Francois Perron
>              Labels: distributed, grouping
>             Fix For: 4.0, 3.6.1
>
>         Attachments: SOLR-3436.patch, SOLR-3436.patch
>
>
> The count of groups in distributed grouping environment only show results from shards used in the second pass.
> How to reproduce :
> Ask for only 1 document (ROWS=1) in a 2 shards environnement with GROUPS.NGOURP=true and of course with GROUPS.FIELD=fieldA.
> Results :
> It will only display the total of a shard (the one used for the second pass)
> Expected results :
> Sum all groups count from ALL shards.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-3436) Groups count in distributed grouping is wrong in some case

Posted by "Martijn van Groningen (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-3436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13274594#comment-13274594 ] 

Martijn van Groningen commented on SOLR-3436:
---------------------------------------------

Committed patch to trunk. Only needs backporting to 3.6 branch.
                
> Groups count in distributed grouping is wrong in some case
> ----------------------------------------------------------
>
>                 Key: SOLR-3436
>                 URL: https://issues.apache.org/jira/browse/SOLR-3436
>             Project: Solr
>          Issue Type: Bug
>          Components: SearchComponents - other
>    Affects Versions: 3.4, 3.5, 3.6, 4.0
>         Environment: MacOs X Lion, Java 1.6.0_31
>            Reporter: Francois Perron
>              Labels: distributed, grouping
>             Fix For: 4.0, 3.6.1
>
>         Attachments: SOLR-3436.patch, SOLR-3436.patch
>
>
> The count of groups in distributed grouping environment only show results from shards used in the second pass.
> How to reproduce :
> Ask for only 1 document (ROWS=1) in a 2 shards environnement with GROUPS.NGOURP=true and of course with GROUPS.FIELD=fieldA.
> Results :
> It will only display the total of a shard (the one used for the second pass)
> Expected results :
> Sum all groups count from ALL shards.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Updated] (SOLR-3436) Groups count in distributed grouping is wrong in some case

Posted by "Martijn van Groningen (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-3436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Martijn van Groningen updated SOLR-3436:
----------------------------------------

    Attachment: SOLR-3436.patch

Added a patch that solves the problem in a more efficient way. Basically the group count is computed during the first pass, instead of during the second phase.
                
> Groups count in distributed grouping is wrong in some case
> ----------------------------------------------------------
>
>                 Key: SOLR-3436
>                 URL: https://issues.apache.org/jira/browse/SOLR-3436
>             Project: Solr
>          Issue Type: Bug
>          Components: SearchComponents - other
>    Affects Versions: 3.4, 3.5, 3.6, 4.0
>         Environment: MacOs X Lion, Java 1.6.0_31
>            Reporter: Francois Perron
>              Labels: distributed, grouping
>             Fix For: 4.0, 3.6.1
>
>         Attachments: SOLR-3436.patch, SOLR-3436.patch
>
>
> The count of groups in distributed grouping environment only show results from shards used in the second pass.
> How to reproduce :
> Ask for only 1 document (ROWS=1) in a 2 shards environnement with GROUPS.NGOURP=true and of course with GROUPS.FIELD=fieldA.
> Results :
> It will only display the total of a shard (the one used for the second pass)
> Expected results :
> Sum all groups count from ALL shards.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-3436) Groups count in distributed grouping is wrong in some case

Posted by "Martijn van Groningen (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-3436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13269625#comment-13269625 ] 

Martijn van Groningen commented on SOLR-3436:
---------------------------------------------

I related this to SOLR-3316 b/c I think the underlying problem is the same.
                
> Groups count in distributed grouping is wrong in some case
> ----------------------------------------------------------
>
>                 Key: SOLR-3436
>                 URL: https://issues.apache.org/jira/browse/SOLR-3436
>             Project: Solr
>          Issue Type: Bug
>          Components: SearchComponents - other
>    Affects Versions: 4.0
>         Environment: MacOs X Lion, Java 1.6.0_31
>            Reporter: Francois Perron
>              Labels: distributed, grouping
>
> The count of groups in distributed grouping environment only show results from shards used in the second pass.
> How to reproduce :
> Ask for only 1 document (ROWS=1) in a 2 shards environnement with GROUPS.NGOURP=true and of course with GROUPS.FIELD=fieldA.
> Results :
> It will only display the total of a shard (the one used for the second pass)
> Expected results :
> Sum all groups count from ALL shards.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Updated] (SOLR-3436) Groups count in distributed grouping is wrong in some case

Posted by "Martijn van Groningen (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-3436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Martijn van Groningen updated SOLR-3436:
----------------------------------------

    Attachment: SOLR-3436.patch

Initial patch that should fix the issue that group count is incorrect when the groups aren't retrieved from all shards.
                
> Groups count in distributed grouping is wrong in some case
> ----------------------------------------------------------
>
>                 Key: SOLR-3436
>                 URL: https://issues.apache.org/jira/browse/SOLR-3436
>             Project: Solr
>          Issue Type: Bug
>          Components: SearchComponents - other
>    Affects Versions: 3.4, 3.5, 3.6, 4.0
>         Environment: MacOs X Lion, Java 1.6.0_31
>            Reporter: Francois Perron
>              Labels: distributed, grouping
>             Fix For: 4.0, 3.6.1
>
>         Attachments: SOLR-3436.patch
>
>
> The count of groups in distributed grouping environment only show results from shards used in the second pass.
> How to reproduce :
> Ask for only 1 document (ROWS=1) in a 2 shards environnement with GROUPS.NGOURP=true and of course with GROUPS.FIELD=fieldA.
> Results :
> It will only display the total of a shard (the one used for the second pass)
> Expected results :
> Sum all groups count from ALL shards.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Updated] (SOLR-3436) Groups count in distributed grouping is wrong in some case

Posted by "Martijn van Groningen (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-3436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Martijn van Groningen updated SOLR-3436:
----------------------------------------

    Affects Version/s: 3.6
                       3.4
                       3.5
        Fix Version/s: 3.6.1
                       4.0
    
> Groups count in distributed grouping is wrong in some case
> ----------------------------------------------------------
>
>                 Key: SOLR-3436
>                 URL: https://issues.apache.org/jira/browse/SOLR-3436
>             Project: Solr
>          Issue Type: Bug
>          Components: SearchComponents - other
>    Affects Versions: 3.4, 3.5, 3.6, 4.0
>         Environment: MacOs X Lion, Java 1.6.0_31
>            Reporter: Francois Perron
>              Labels: distributed, grouping
>             Fix For: 4.0, 3.6.1
>
>
> The count of groups in distributed grouping environment only show results from shards used in the second pass.
> How to reproduce :
> Ask for only 1 document (ROWS=1) in a 2 shards environnement with GROUPS.NGOURP=true and of course with GROUPS.FIELD=fieldA.
> Results :
> It will only display the total of a shard (the one used for the second pass)
> Expected results :
> Sum all groups count from ALL shards.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-3436) Groups count in distributed grouping is wrong in some case

Posted by "Francois Perron (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-3436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13269576#comment-13269576 ] 

Francois Perron commented on SOLR-3436:
---------------------------------------

The fix done in SOLR-3316 issue is for total hit count.  I need to do the same thing but for total Group Count. 
                
> Groups count in distributed grouping is wrong in some case
> ----------------------------------------------------------
>
>                 Key: SOLR-3436
>                 URL: https://issues.apache.org/jira/browse/SOLR-3436
>             Project: Solr
>          Issue Type: Bug
>          Components: SearchComponents - other
>    Affects Versions: 4.0
>         Environment: MacOs X Lion, Java 1.6.0_31
>            Reporter: Francois Perron
>              Labels: distributed, grouping
>
> The count of groups in distributed grouping environment only show results from shards used in the second pass.
> How to reproduce :
> Ask for only 1 document (ROWS=1) in a 2 shards environnement with GROUPS.NGOURP=true and of course with GROUPS.FIELD=fieldA.
> Results :
> It will only display the total of a shard (the one used for the second pass)
> Expected results :
> Sum all groups count from ALL shards.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-3436) Groups count in distributed grouping is wrong in some case

Posted by "Martijn van Groningen (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-3436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13274620#comment-13274620 ] 

Martijn van Groningen commented on SOLR-3436:
---------------------------------------------

Committed 3.6 branch.
                
> Groups count in distributed grouping is wrong in some case
> ----------------------------------------------------------
>
>                 Key: SOLR-3436
>                 URL: https://issues.apache.org/jira/browse/SOLR-3436
>             Project: Solr
>          Issue Type: Bug
>          Components: SearchComponents - other
>    Affects Versions: 3.4, 3.5, 3.6, 4.0
>         Environment: MacOs X Lion, Java 1.6.0_31
>            Reporter: Francois Perron
>              Labels: distributed, grouping
>             Fix For: 4.0, 3.6.1
>
>         Attachments: SOLR-3436.patch, SOLR-3436.patch
>
>
> The count of groups in distributed grouping environment only show results from shards used in the second pass.
> How to reproduce :
> Ask for only 1 document (ROWS=1) in a 2 shards environnement with GROUPS.NGOURP=true and of course with GROUPS.FIELD=fieldA.
> Results :
> It will only display the total of a shard (the one used for the second pass)
> Expected results :
> Sum all groups count from ALL shards.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org