You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Vijay Rawlani <vi...@tcs.com> on 2019/03/19 16:39:24 UTC

Need information on EofExceptions in solr 4.8.1

Dear Concerned,

We are using solr 4.8.1 in our project. We are observing following 
EofExceptions in solr. 
It would be helpful for us to know in what situations we might land up 
with this.
Can we get rid of this with any solr configuration or is there any way 
forward at all? 
Kindly let us know some information about the exception and the scenario 
where it can occur.

019-03-17T00:00:25.604457+00:00@solr@UNKNOWN@ 
org.apache.solr.servlet.SolrDispatchFilter:120 - 
null:org.eclipse.jetty.io.EofException#012#011at 
org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:142)#012#011at 
org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107)#012#011at 
org.apache.solr.common.util.FastOutputStream.flush(FastOutputStream.java:214)#012#011at 
org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:207)#012#011at 
org.apache.solr.common.util.JavaBinCodec.marshal(JavaBinCodec.java:98)#012#011at 
org.apache.solr.response.BinaryResponseWriter.write(BinaryResponseWriter.java:51)#012#011at 
org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:755)#012#011at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:431)#012...

2019-03-17T00:00:25.604457+00:00@solr@[INVALID_PROGRAM]@ 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207)#012#011at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)#012#011at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)#012#011at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)#012#011at 
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)#012#011at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)#012#011at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)#012#011at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)#012#011at 
org.eclipse.jetty.server.session.SessionHandler.doScope(Sess...

2019-03-17T00:00:25.604457+00:00@solr@[INVALID_PROGRAM]@193)#012#011at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)#012#011at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)#012#011at 
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)#012#011at 
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)#012#011at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)#012#011at 
org.eclipse.jetty.server.Server.handle(Server.java:368)#012#011at 
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)#012#011at 
org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)#012#011at 
org.e...

2019-03-17T00:00:25.604457+00:00@solr@[INVALID_PROGRAM]@953)#012#011at 
org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)#012#011at 
org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)#012#011at 
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)#012#011at 
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)#012#011at 
org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)#012#011at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)#012#011at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)#012#011at 
java.lang.Thread.run(Thread.java:748)#012

2019-03-17T00:00:25.604457+00:00@solr@UNKNOWN@ 
org.eclipse.jetty.server.Response:312 - Committed before 500 
{trace=org.eclipse.jetty.io.EofException#012#011at 
org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:142)#012#011at 
org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107)#012#011at 
org.apache.solr.common.util.FastOutputStream.flush(FastOutputStream.java:214)#012#011at 
org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:207)#012#011at 
org.apache.solr.common.util.JavaBinCodec.marshal(JavaBinCodec.java:98)#012#011at 
org.apache.solr.response.BinaryResponseWriter.write(BinaryResponseWriter.java:51)#012#011at 
org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:755)#012#011at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.ja...


Thanks in advance.

Best Regards,
Vijay Rawlani
Tata Consultancy Services Ltd.
+91 7416448048
=====-----=====-----=====
Notice: The information contained in this e-mail
message and/or attachments to it may contain 
confidential or privileged information. If you are 
not the intended recipient, any dissemination, use, 
review, distribution, printing or copying of the 
information contained in this e-mail message 
and/or attachments to it are strictly prohibited. If 
you have received this communication in error, 
please notify us by reply e-mail or telephone and 
immediately and permanently delete the message 
and any attachments. Thank you



Re: Need information on EofExceptions in solr 4.8.1

Posted by Atita Arora <at...@gmail.com>.
Precisely, socketTimeout ms if it's your indexing pipeline code.
We faced this when our docs were unusually bigger.

On Tue, Mar 19, 2019 at 7:08 PM Saurabh Sharma <sa...@gmail.com>
wrote:

> Hi,
>
> Seems like it is not a problem with solr. It is happening due to stream
> termination at the jetty.
> Please make sure your client is not setting very low read timeout. You can
> also increase max sessions timeout and idleTimeout at jetty level.
>
> Thanks
> Saurabh Sharma
>
> On Tue, Mar 19, 2019 at 11:19 PM Vijay Rawlani <vi...@tcs.com>
> wrote:
>
> > Dear Concerned,
> >
> > We are using solr 4.8.1 in our project. We are observing following
> > EofExceptions in solr.
> > It would be helpful for us to know in what situations we might land up
> > with this.
> > Can we get rid of this with any solr configuration or is there any way
> > forward at all?
> > Kindly let us know some information about the exception and the scenario
> > where it can occur.
> >
> > 019-03-17T00:00:25.604457+00:00@solr@UNKNOWN@
> > org.apache.solr.servlet.SolrDispatchFilter:120 -
> > null:org.eclipse.jetty.io.EofException#012#011at
> > org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:142)#012#011at
> > org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107)#012#011at
> >
> org.apache.solr.common.util.FastOutputStream.flush(FastOutputStream.java:214)#012#011at
> >
> >
> org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:207)#012#011at
> >
> >
> org.apache.solr.common.util.JavaBinCodec.marshal(JavaBinCodec.java:98)#012#011at
> >
> >
> org.apache.solr.response.BinaryResponseWriter.write(BinaryResponseWriter.java:51)#012#011at
> >
> >
> org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:755)#012#011at
> >
> >
> >
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:431)#012...
> >
> > 2019-03-17T00:00:25.604457+00:00@solr@[INVALID_PROGRAM]@
> >
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207)#012#011at
> >
> >
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)#012#011at
> >
> >
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)#012#011at
> >
> >
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)#012#011at
> >
> >
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)#012#011at
> >
> >
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)#012#011at
> >
> >
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)#012#011at
> >
> >
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)#012#011at
> >
> > org.eclipse.jetty.server.session.SessionHandler.doScope(Sess...
> >
> > 2019-03-17T00:00:25.604457+00:00@solr@[INVALID_PROGRAM]@193)#012#011at
> >
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)#012#011at
> >
> >
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)#012#011at
> >
> >
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)#012#011at
> >
> >
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)#012#011at
> >
> >
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)#012#011at
> >
> > org.eclipse.jetty.server.Server.handle(Server.java:368)#012#011at
> >
> org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)#012#011at
> >
> >
> org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)#012#011at
> >
> > org.e...
> >
> > 2019-03-17T00:00:25.604457+00:00@solr@[INVALID_PROGRAM]@953)#012#011at
> >
> org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)#012#011at
> >
> >
> org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)#012#011at
> >
> org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)#012#011at
> >
> >
> org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)#012#011at
> >
> >
> org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)#012#011at
> >
> >
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)#012#011at
> >
> >
> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)#012#011at
> >
> > java.lang.Thread.run(Thread.java:748)#012
> >
> > 2019-03-17T00:00:25.604457+00:00@solr@UNKNOWN@
> > org.eclipse.jetty.server.Response:312 - Committed before 500
> > {trace=org.eclipse.jetty.io.EofException#012#011at
> > org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:142)#012#011at
> > org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107)#012#011at
> >
> org.apache.solr.common.util.FastOutputStream.flush(FastOutputStream.java:214)#012#011at
> >
> >
> org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:207)#012#011at
> >
> >
> org.apache.solr.common.util.JavaBinCodec.marshal(JavaBinCodec.java:98)#012#011at
> >
> >
> org.apache.solr.response.BinaryResponseWriter.write(BinaryResponseWriter.java:51)#012#011at
> >
> >
> org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:755)#012#011at
> >
> >
> >
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.ja...
> >
> >
> > Thanks in advance.
> >
> > Best Regards,
> > Vijay Rawlani
> > Tata Consultancy Services Ltd.
> > +91 7416448048
> > =====-----=====-----=====
> > Notice: The information contained in this e-mail
> > message and/or attachments to it may contain
> > confidential or privileged information. If you are
> > not the intended recipient, any dissemination, use,
> > review, distribution, printing or copying of the
> > information contained in this e-mail message
> > and/or attachments to it are strictly prohibited. If
> > you have received this communication in error,
> > please notify us by reply e-mail or telephone and
> > immediately and permanently delete the message
> > and any attachments. Thank you
> >
> >
> >
>

Re: Need information on EofExceptions in solr 4.8.1

Posted by Saurabh Sharma <sa...@gmail.com>.
Hi,

Seems like it is not a problem with solr. It is happening due to stream
termination at the jetty.
Please make sure your client is not setting very low read timeout. You can
also increase max sessions timeout and idleTimeout at jetty level.

Thanks
Saurabh Sharma

On Tue, Mar 19, 2019 at 11:19 PM Vijay Rawlani <vi...@tcs.com>
wrote:

> Dear Concerned,
>
> We are using solr 4.8.1 in our project. We are observing following
> EofExceptions in solr.
> It would be helpful for us to know in what situations we might land up
> with this.
> Can we get rid of this with any solr configuration or is there any way
> forward at all?
> Kindly let us know some information about the exception and the scenario
> where it can occur.
>
> 019-03-17T00:00:25.604457+00:00@solr@UNKNOWN@
> org.apache.solr.servlet.SolrDispatchFilter:120 -
> null:org.eclipse.jetty.io.EofException#012#011at
> org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:142)#012#011at
> org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107)#012#011at
> org.apache.solr.common.util.FastOutputStream.flush(FastOutputStream.java:214)#012#011at
>
> org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:207)#012#011at
>
> org.apache.solr.common.util.JavaBinCodec.marshal(JavaBinCodec.java:98)#012#011at
>
> org.apache.solr.response.BinaryResponseWriter.write(BinaryResponseWriter.java:51)#012#011at
>
> org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:755)#012#011at
>
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:431)#012...
>
> 2019-03-17T00:00:25.604457+00:00@solr@[INVALID_PROGRAM]@
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207)#012#011at
>
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)#012#011at
>
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)#012#011at
>
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)#012#011at
>
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)#012#011at
>
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)#012#011at
>
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)#012#011at
>
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)#012#011at
>
> org.eclipse.jetty.server.session.SessionHandler.doScope(Sess...
>
> 2019-03-17T00:00:25.604457+00:00@solr@[INVALID_PROGRAM]@193)#012#011at
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)#012#011at
>
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)#012#011at
>
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)#012#011at
>
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)#012#011at
>
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)#012#011at
>
> org.eclipse.jetty.server.Server.handle(Server.java:368)#012#011at
> org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)#012#011at
>
> org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)#012#011at
>
> org.e...
>
> 2019-03-17T00:00:25.604457+00:00@solr@[INVALID_PROGRAM]@953)#012#011at
> org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)#012#011at
>
> org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)#012#011at
> org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)#012#011at
>
> org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)#012#011at
>
> org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)#012#011at
>
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)#012#011at
>
> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)#012#011at
>
> java.lang.Thread.run(Thread.java:748)#012
>
> 2019-03-17T00:00:25.604457+00:00@solr@UNKNOWN@
> org.eclipse.jetty.server.Response:312 - Committed before 500
> {trace=org.eclipse.jetty.io.EofException#012#011at
> org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:142)#012#011at
> org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107)#012#011at
> org.apache.solr.common.util.FastOutputStream.flush(FastOutputStream.java:214)#012#011at
>
> org.apache.solr.common.util.FastOutputStream.flushBuffer(FastOutputStream.java:207)#012#011at
>
> org.apache.solr.common.util.JavaBinCodec.marshal(JavaBinCodec.java:98)#012#011at
>
> org.apache.solr.response.BinaryResponseWriter.write(BinaryResponseWriter.java:51)#012#011at
>
> org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:755)#012#011at
>
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.ja...
>
>
> Thanks in advance.
>
> Best Regards,
> Vijay Rawlani
> Tata Consultancy Services Ltd.
> +91 7416448048
> =====-----=====-----=====
> Notice: The information contained in this e-mail
> message and/or attachments to it may contain
> confidential or privileged information. If you are
> not the intended recipient, any dissemination, use,
> review, distribution, printing or copying of the
> information contained in this e-mail message
> and/or attachments to it are strictly prohibited. If
> you have received this communication in error,
> please notify us by reply e-mail or telephone and
> immediately and permanently delete the message
> and any attachments. Thank you
>
>
>

Re: Need information on EofExceptions in solr 4.8.1

Posted by Shawn Heisey <ap...@elyograg.org>.
On 3/19/2019 10:39 AM, Vijay Rawlani wrote:
> We are using solr 4.8.1 in our project. We are observing following
> EofExceptions in solr.
> It would be helpful for us to know in what situations we might land up
> with this.
> Can we get rid of this with any solr configuration or is there any way
> forward at all?
> Kindly let us know some information about the exception and the scenario
> where it can occur.

When Solr throws Jetty's EofException, it almost always means this has 
occurred:

The client talking to Solr has disconnected its TCP connection before 
Solr has finished processing the request.  When Solr (Jetty) finally 
finishes and tries to send the response, the client is long gone and the 
response cannot be sent.  So EofException is thrown.

Usually this is because the client has a short timeout and the requests 
Solr is being asked to process are taking longer than that timeout to 
complete.  If a client is configured with a timeout, it should be quite 
long ... normally at least a minute, and two to five minutes would be 
better.

Solr 4.8.1 is nearly four years old.  This is ancient in the open source 
world.  There will be no bugfixes for a version that old.  I do not 
think the behavior you are seeing is a bug, but if you do encounter one, 
you'll need to reproduce it in an 8.x version before we can fix it.

Thanks,
Shawn