You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Hoss Man (JIRA)" <ji...@apache.org> on 2015/06/02 07:47:17 UTC

[jira] [Commented] (SOLR-7605) TestCloudPivotFacet failures: Must not add duplicate PivotFacetValue with redundent inner value

    [ https://issues.apache.org/jira/browse/SOLR-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14568574#comment-14568574 ] 

Hoss Man commented on SOLR-7605:
--------------------------------

2 new failures recently..

{noformat}
http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Windows/4749/
Updating http://svn.apache.org/repos/asf/lucene/dev/branches/branch_5x at revision '2015-05-30T17:12:29.603 +0000'
At revision 1682629
[java-info] java version "1.8.0_45"
[java-info] Java(TM) SE Runtime Environment (1.8.0_45-b14, Oracle Corporation)
[java-info] Java HotSpot(TM) Client VM (25.45-b02, Oracle Corporation)
[java-info] Test args: [-client -XX:+UseConcMarkSweepGC]

   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCloudPivotFacet -Dtests.method=test -Dtests.seed=3D83C25D5DB9AE70 -Dtests.slow=true -Dtests.locale=ro -Dtests.timezone=Atlantic/Canary -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   57.8s J1 | TestCloudPivotFacet.test <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: init query failed: {main(facet=true&facet.pivot=%7B%21stats%3Dst1%7Dpivot_td%2Cpivot_z_s1%2Cpivot_d1&facet.pivot=%7B%21stats%3Dst1%7Ddense_pivot_ti&facet.limit=13&facet.offset=5&facet.pivot.mincount=423),extra(rows=0&q=*%3A*&_test_min=423)}: No live SolrServers available to handle this request:[http://127.0.0.1:55772/collection1, http://127.0.0.1:55805/collection1, http://127.0.0.1:55754/collection1, http://127.0.0.1:55791/collection1]
{noformat}

{noformat}
http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/12884/
Updating http://svn.apache.org/repos/asf/lucene/dev/trunk at revision '2015-05-31T12:57:26.128 +0000'
At revision 1682729
[java-info] java version "1.9.0-ea"
[java-info] Java(TM) SE Runtime Environment (1.9.0-ea-b60, Oracle Corporation)
[java-info] Java HotSpot(TM) Server VM (1.9.0-ea-b60, Oracle Corporation)
[java-info] Test args: [-server -XX:+UseConcMarkSweepGC]

   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCloudPivotFacet -Dtests.method=test -Dtests.seed=F0A169D7E9F4C1C2 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_AE -Dtests.timezone=Asia/Choibalsan -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   52.0s J2 | TestCloudPivotFacet.test <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: init query failed: {main(facet=true&facet.pivot=%7B%21stats%3Dst3%7Ddense_pivot_y_s%2Cdense_pivot_ti&facet.pivot=%7B%21stats%3Dst2%7Dpivot_dt1%2Cdense_pivot_y_s%2Cpivot_x_s&facet.limit=17&facet.offset=6&facet.pivot.mincount=801&facet.overrequest.count=5),extra(rows=0&q=id%3A%5B*+TO+553%5D&fq=id%3A%5B*+TO+1127%5D&stats=true&stats.field=%7B%21key%3Dsk1+tag%3Dst1%2Cst2%7Dpivot_y_s1&stats.field=%7B%21key%3Dsk2+tag%3Dst2%2Cst3%7Dpivot_dt1&stats.field=%7B%21key%3Dsk3+tag%3Dst3%2Cst4%7Dpivot_tdt1&_test_min=801)}: No live SolrServers available to handle this request:[http://127.0.0.1:53345/p/hs/collection1, http://127.0.0.1:43347/p/hs/collection1, http://127.0.0.1:52716/p/hs/collection1, http://127.0.0.1:55360/p/hs/collection1]
{noformat}

----

I spent a good chunk of time today reviewing the code and debugging one of the failing seeds -- as near as I can tell the assert is sound, and it's definitely suspicious that we're seeing duplicate values at this point.  Where i left off tonight is a strong confidence that the root problem is a single shard returning the same "value" (w/count) multiple times.

My next step is to do the same debuging with some of the other seeds and see if i can find the same evidence of duplicate facet values, and look for a pattern in the seeds / requests that trigger this to try and figure out when/why/where these duplicate values are getting returned by shards.

(Assuming i'm correct, this is a legitimate code bug, that only surfaces in some situations (not sure when) but only causes an error with java assertions turned on -- w/o assertions the code will silently use the second value returned.)


> TestCloudPivotFacet failures: Must not add duplicate PivotFacetValue with redundent inner value
> -----------------------------------------------------------------------------------------------
>
>                 Key: SOLR-7605
>                 URL: https://issues.apache.org/jira/browse/SOLR-7605
>             Project: Solr
>          Issue Type: Bug
>            Reporter: Hoss Man
>            Assignee: Hoss Man
>
> There have been two recent jenkins failures of TestCloudPivotFacet on both 5x and trunk with the same underlying cause...
> {noformat}
> <p>Problem accessing /collection1/select. Reason:
> <pre>    java.lang.AssertionError: Must not add duplicate PivotFacetValue with redundent inner value</pre></p>
> {noformat}
> ..digging through mail logs, it looks like there have been a handful of these errors on different branches and os, with and w/o nightly, since April 1st of this year.
> The two recent seeds i tried (on trunk and 5x) reproduce - details to follow.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org