Jetty's problem//Re:【Solr 8.11.2】HttpShardHandler.takeCompletedOrError do not return for a long time

[YangLiu <sl...@126.com>]

I think the problem is the same as this:


https://issues.apache.org/jira/browse/SOLR-16099


jetty's solution: 
https://github.com/eclipse/jetty.project/issues/8558



At 2022-11-08 14:13:29, "slly" <sl...@126.com> wrote:
>Hello everyone. 
>
>
>We recently encountered an online problem,  only restart the process can recover. 
>
>
>  > The following threads are always in the WAITING state, will not exit
>  > There is no obvious exception message in the log.
>  > Maybe, the problem will only be triggered when querying multiple collections, but I'm not sure
>
>
>
>
>  "qtp148626113-20273759" #20273759 prio=5 os_prio=0 tid=0x00007f9bfda5c000 nid=0xa7bf waiting on condition [0x00007f9bf5087000]
>   java.lang.Thread.State: WAITING (parking)
>        at sun.misc.Unsafe.park0(Native Method)
>        - parking to wait for  <0x0000000315020648> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>        at sun.misc.Unsafe.park(Unsafe.java:1025)
>        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:176)
>        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2047)
>        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:446)
>        at java.util.concurrent.ExecutorCompletionService.take(ExecutorCompletionService.java:193)
>        at org.apache.solr.handler.component.HttpShardHandler.take(HttpShardHandler.java:121)
>        at org.apache.solr.handler.component.HttpShardHandler.takeCompletedOrError(HttpShardHandler.java:114)
>        at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:524)
>        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:216)
>        
>
>
> "httpShardExecutor-5-thread-14362-processing-x: #313991 prio=5 os_prio=0 tid=0x00007f97db561800 nid=0x13a87 in Object.wait() [0x00007f97bdfd6000]
>        java.lang.Thread.State: WAITING (on object monitor)
>        at java.lang.Object.wait(Native Method)
>        at java.lang.Object.wait(Object.java:502)
>        at org.eclipse.jetty.client.util.InputStreamResponseListener$Input.read(InputStreamResponseListener.java:318)
>        - locked <0x00000001c0c045c8> (a org.eclipse.jetty.client.util.InputStreamResponseListener)
>        at org.apache.solr.common.util.FastInputStream.readWrappedStream(FastInputStream.java:90)
>        at org.apache.solr.common.util.FastInputStream.refill(FastInputStream.java:99)
>        at org.apache.solr.common.util.FastInputStream.readByte(FastInputStream.java:217)
>        at org.apache.solr.common.util.JavaBinCodec._init(JavaBinCodec.java:211)
>        at org.apache.solr.common.util.JavaBinCodec.initRead(JavaBinCodec.java:202)
>        at org.apache.solr.common.util.JavaBinCodec.unmarshal(JavaBinCodec.java:195)
>        at org.apache.solr.client.solrj.impl.BinaryResponseParser.processResponse(BinaryResponseParser.java:51)
>        at org.apache.solr.client.solrj.impl.Http2SolrClient.processErrorsAndResponse(Http2SolrClient.java:711)
>        at org.apache.solr.client.solrj.impl.Http2SolrClient.request(Http2SolrClient.java:421)
>        at org.apache.solr.client.solrj.impl.Http2SolrClient.request(Http2SolrClient.java:776)
>        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1290)
>        at org.apache.solr.handler.component.HttpShardHandler.request(HttpShardHandler.java:80)
>
>
>Thanks.
>
>
>
>