You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Lucene/Solr QA (Jira)" <ji...@apache.org> on 2019/08/24 03:29:00 UTC

[jira] [Commented] (SOLR-13717) Distributed Grouping breaks multi valued 'fl' param

    [ https://issues.apache.org/jira/browse/SOLR-13717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16914791#comment-16914791 ] 

Lucene/Solr QA commented on SOLR-13717:
---------------------------------------

| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green}  0m  0s{color} | {color:green} The patch appears to include 1 new or modified test files. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  1m 19s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} compile {color} | {color:green}  2m  7s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green}  2m  7s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} Release audit (RAT) {color} | {color:green}  2m  7s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} Check forbidden APIs {color} | {color:green}  2m  7s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} Validate source patterns {color} | {color:green}  2m  7s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 51m 56s{color} | {color:green} core in the patch passed. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 58m 34s{color} | {color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | SOLR-13717 |
| JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12978469/SOLR-13717.patch |
| Optional Tests |  compile  javac  unit  ratsources  checkforbiddenapis  validatesourcepatterns  |
| uname | Linux lucene2-us-west.apache.org 4.4.0-112-generic #135-Ubuntu SMP Fri Jan 19 11:48:36 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | ant |
| Personality | /home/jenkins/jenkins-slave/workspace/PreCommit-SOLR-Build/sourcedir/dev-tools/test-patch/lucene-solr-yetus-personality.sh |
| git revision | master / 225fd3d |
| ant | version: Apache Ant(TM) version 1.9.6 compiled on July 20 2018 |
| Default Java | LTS |
|  Test Results | https://builds.apache.org/job/PreCommit-SOLR-Build/538/testReport/ |
| modules | C: solr/core U: solr/core |
| Console output | https://builds.apache.org/job/PreCommit-SOLR-Build/538/console |
| Powered by | Apache Yetus 0.7.0   http://yetus.apache.org |


This message was automatically generated.



> Distributed Grouping breaks multi valued 'fl' param
> ---------------------------------------------------
>
>                 Key: SOLR-13717
>                 URL: https://issues.apache.org/jira/browse/SOLR-13717
>             Project: Solr
>          Issue Type: Bug
>      Security Level: Public(Default Security Level. Issues are Public) 
>            Reporter: Hoss Man
>            Assignee: Hoss Man
>            Priority: Major
>         Attachments: SOLR-13717.patch
>
>
> Co-worker discovered a bug with (distributed) grouping when multiple {{fl}} params are specified.
> {{StoredFieldsShardRequestFactory}} has very (old and) brittle code that assumes there will be 0 or 1 {{fl}} params in the original request that it should inspect to see if it needs to append (via string concat) the uniqueKey field onto in order to collate the returned stored fields into their respective (grouped) documents -- and then ignores any additional {{fl}} params that may exist in the original request when it does so.
> The net result is that only the uniqueKey field and whatever fields _are_ specified in the first {{fl}} param specified are fetched from each shard and ultimately returned.
> The only workaround is to replace multiple {{fl}} params with a single {{fl}} param containing a comma seperated list of the requested fields.
> ----
> Bug is trivial to reproduce with {{bin/solr -e cloud -noprompt}} by comparing these requests which should all be equivilent...
> {noformat}
> $ bin/post -c gettingstarted -out yes example/exampledocs/books.csv
> ...
> $ curl 'http://localhost:8983/solr/gettingstarted/query?omitHeader=true&indent=true&fl=author,name,id&q=*:*&group=true&group.field=genre_s'
> {
>   "grouped":{
>     "genre_s":{
>       "matches":10,
>       "groups":[{
>           "groupValue":"fantasy",
>           "doclist":{"numFound":8,"start":0,"maxScore":1.0,"docs":[
>               {
>                 "id":"0812521390",
>                 "name":["The Black Company"],
>                 "author":["Glen Cook"]}]
>           }},
>         {
>           "groupValue":"scifi",
>           "doclist":{"numFound":2,"start":0,"docs":[
>               {
>                 "id":"0553293354",
>                 "name":["Foundation"],
>                 "author":["Isaac Asimov"]}]
>           }}]}}}
> $ curl 'http://localhost:8983/solr/gettingstarted/query?omitHeader=true&indent=true&fl=author&fl=name,id&q=*:*&group=true&group.field=genre_s'
> {
>   "grouped":{
>     "genre_s":{
>       "matches":10,
>       "groups":[{
>           "groupValue":"fantasy",
>           "doclist":{"numFound":8,"start":0,"maxScore":1.0,"docs":[
>               {
>                 "id":"0812521390",
>                 "author":["Glen Cook"]}]
>           }},
>         {
>           "groupValue":"scifi",
>           "doclist":{"numFound":2,"start":0,"docs":[
>               {
>                 "id":"0553293354",
>                 "author":["Isaac Asimov"]}]
>           }}]}}}
> $ curl 'http://localhost:8983/solr/gettingstarted/query?omitHeader=true&indent=true&fl=id&fl=author&fl=name&q=*:*&group=true&group.field=genre_s'
> {
>   "grouped":{
>     "genre_s":{
>       "matches":10,
>       "groups":[{
>           "groupValue":"fantasy",
>           "doclist":{"numFound":8,"start":0,"maxScore":1.0,"docs":[
>               {
>                 "id":"0553573403"}]
>           }},
>         {
>           "groupValue":"scifi",
>           "doclist":{"numFound":2,"start":0,"docs":[
>               {
>                 "id":"0553293354"}]
>           }}]}}}
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org