You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2017/11/09 16:55:01 UTC

[jira] [Commented] (SOLR-9120) LukeRequestHandler logs WARN "Error getting file length for [segments_NNN]" for inconsequential NoSuchFileException situations -- looks scary but is not a problem, logging should be reduced

    [ https://issues.apache.org/jira/browse/SOLR-9120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16246012#comment-16246012 ] 

ASF subversion and git services commented on SOLR-9120:
-------------------------------------------------------

Commit 15fe53e10be74a0c953c4e0fac6815798cf66772 in lucene-solr's branch refs/heads/master from Chris Hostetter
[ https://git-wip-us.apache.org/repos/asf?p=lucene-solr.git;h=15fe53e ]

SOLR-9120: Reduce log level for inconsequential NoSuchFileException that LukeRequestHandler may encounter


> LukeRequestHandler logs WARN "Error getting file length for [segments_NNN]" for inconsequential NoSuchFileException situations -- looks scary but is not a problem, logging should be reduced
> ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: SOLR-9120
>                 URL: https://issues.apache.org/jira/browse/SOLR-9120
>             Project: Solr
>          Issue Type: Improvement
>    Affects Versions: 5.5, 6.0
>            Reporter: Markus Jelsma
>            Assignee: Hoss Man
>         Attachments: SOLR-9120.patch, SOLR-9120.patch, SOLR-9120.patch
>
>
> Begining with Solr 5.5, the LukeRequestHandler started attempting to report the name and file size of the segments file for the _current_ Searcher+IndexReader in use by Solr -- however the filesize information is not always available from the Directory in cases where "on disk" commits have caused that file to be removed, for example...
> * you perform index updates & commits w/o "newSearcher" being opened
> * you "concurrently" make requests to the LukeRequestHandler or the CoreAdminHandler requesting "STATUS" (ie: after the commit, before any newSearcher)
> ** these requests can come from the Admin UI passively if it's open in a browser
> In situations like this, a decision was made in SOLR-8587 to log a WARNing in the event that the segments file size could not be determined -- but these WARNing messages look scary and have lead (many) users to assume something is wrong with their solr index.
> We should reduce the severity of these log messages, and improve the wording to make it more clear that this is not a fundemental problem with the index.
> ----
> Here's some trivial steps to reproduce the WARN message...
> {noformat}
> $ bin/solr -e techproducts
> ...
> $ tail -f example/techproducts/logs/solr.log
> ...
> {noformat}
> In another terminal...
> {noformat}
> $ curl -H 'Content-Type: application/json' 'http://localhost:8983/solr/techproducts/update?commit=true&openSearcher=false' --data-binary '[{"id":"HOSS"}]'
> ...
> $ curl 'http://localhost:8983/solr/techproducts/admin/luke'
> ...
> {noformat}
> When the "/admin/luke" URL is hit, this will show up in the logs – but the luke request will finish correctly...
> {noformat}
> WARN  - 2017-11-08 17:23:44.574; [   x:techproducts] org.apache.solr.handler.admin.LukeRequestHandler; Error getting file length for [segments_2]
> java.nio.file.NoSuchFileException: /home/hossman/lucene/dev/solr/example/techproducts/solr/techproducts/data/index/segments_2
> 	at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
> 	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
> 	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
> 	at sun.nio.fs.UnixFileAttributeViews$Basic.readAttributes(UnixFileAttributeViews.java:55)
> 	at sun.nio.fs.UnixFileSystemProvider.readAttributes(UnixFileSystemProvider.java:144)
> 	at sun.nio.fs.LinuxFileSystemProvider.readAttributes(LinuxFileSystemProvider.java:99)
> 	at java.nio.file.Files.readAttributes(Files.java:1737)
> 	at java.nio.file.Files.size(Files.java:2332)
> 	at org.apache.lucene.store.FSDirectory.fileLength(FSDirectory.java:243)
> 	at org.apache.lucene.store.NRTCachingDirectory.fileLength(NRTCachingDirectory.java:128)
> 	at org.apache.solr.handler.admin.LukeRequestHandler.getFileLength(LukeRequestHandler.java:611)
> 	at org.apache.solr.handler.admin.LukeRequestHandler.getIndexInfo(LukeRequestHandler.java:584)
> 	at org.apache.solr.handler.admin.LukeRequestHandler.handleRequestBody(LukeRequestHandler.java:136)
> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
> ...
> INFO  - 2017-11-08 17:23:44.587; [   x:techproducts] org.apache.solr.core.SolrCore; [techproducts]  webapp=/solr path=/admin/luke params={} status=0 QTime=15
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org