You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Fiz Newyorker <fi...@gmail.com> on 2017/12/20 01:45:55 UTC
No space left on device - When I execute suggester component.
Hello Solr Experts,
Good Evening !
I have an issue , Whenever I run the Auto Suggest component ,
http://lapp81.rno.com:8989/solr/Data/suggest?suggest=true&suggest.build=true&suggest.dictionary=fuzzySuggester&wt=json&suggest.q=Jerry
I am getting the following Error .
{"responseHeader":{"status":500,"QTime":341753},"error":{"msg":"No
space left on device","trace":"java.io.IOException: No space left on
device\n\tat sun.nio.ch.FileDispatcherImpl.write0(Native Method)\n\tat
sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60)\n\tat
sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)\n\tat
sun.nio.ch.IOUtil.write(IOUtil.java:65)\n\tat
sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:211)\n\tat
java.nio.channels.Channels.writeFullyImpl(Channels.java:78)\n\tat
java.nio.channels.Channels.writeFully(Channels.java:101)\n\tat
java.nio.channels.Channels.access$000(Channels.java:61)\n\tat
java.nio.channels.Channels$1.write(Channels.java:174)\n\tat
org.apache.lucene.store.FSDirectory$FSIndexOutput$1.write(FSDirectory.java:419)\n\tat
java.util.zip.CheckedOutputStream.write(CheckedOutputStream.java:73)\n\tat
java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)\n\tat
java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)\n\tat
org.apache.lucene.store.OutputStreamIndexOutput.writeBytes(OutputStreamIndexOutput.java:53)\n\tat
org.apache.lucene.util.OfflineSorter$ByteSequencesWriter.write(OfflineSorter.java:529)\n\tat
org.apache.lucene.search.suggest.analyzing.AnalyzingSuggester.build(AnalyzingSuggester.java:480)\n\tat
org.apache.lucene.search.suggest.Lookup.build(Lookup.java:190)\n\tat
org.apache.solr.spelling.suggest.SolrSuggester.build(SolrSuggester.java:181)\n\tat
org.apache.solr.handler.component.SuggestComponent.prepare(SuggestComponent.java:179)\n\tat
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:269)\n\tat
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:173)\n\tat
org.apache.solr.core.SolrCore.execute(SolrCore.java:2440)\n\tat
org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:723)\n\tat
org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:529)\n\tat
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)\n\tat
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:298)\n\tat
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1691)\n\tat
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)\n\tat
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)\n\tat
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)\n\tat
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)\n\tat
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)\n\tat
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)\n\tat
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\n\tat
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)\n\tat
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\n\tat
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)\n\tat
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)\n\tat
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\n\tat
org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)\n\tat
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\n\tat
org.eclipse.jetty.server.Server.handle(Server.java:534)\n\tat
org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)\n\tat
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)\n\tat
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)\n\tat
org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)\n\tat
org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)\n\tat
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)\n\tat
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)\n\tat
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)\n\tat
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)\n\tat
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)\n\tat
java.lang.Thread.run(Thread.java:748)\n","code":500}}
Please share your thoughts .
Thanks
Fiz Ahmed.
Re: No space left on device - When I execute suggester component.
Posted by Erick Erickson <er...@gmail.com>.
How much is "enough"? You're going to be building and storing the
resultant structure
on disk since you have suggest.build=true. It seems simple enough to
give yourself
some more disk space and try again. While you do that, monitor the
disk space while
the suggester builds and see.
Best,
Erick
On Tue, Dec 19, 2017 at 6:07 PM, Fiz Newyorker <fi...@gmail.com> wrote:
> Hi ,
>
> Yes I checked the Disk usage. using this command
>
> du -sh
>
> and I have enough space on the Disk.
>
> I am using this Query :
> *http://rn.com/solr/User_Data/suggest?suggest=true&suggest.build=true&suggest.dictionary=fuzzySuggester&wt=json&suggest.q=Jerry
> <http://rn.com/solr/User_Data/suggest?suggest=true&suggest.build=true&suggest.dictionary=fuzzySuggester&wt=json&suggest.q=Jerry>*
>
>
> *I see in the solr logs *
>
> 2017-12-20 02:00:37.852 INFO (qtp401424608-16) [ x:User]
> o.a.s.c.PluginBag Going to create a new requestHandler with {type =
> requestHandler,name = /suggest,class = solr.SearchHandler,attributes =
> {startup=lazy, name=/suggest, class=solr.SearchHandler},args =
> {defaults={suggest=true,suggest.dictionary=infixSuggester,suggest.dictionary=fuzzySuggester,suggest.count=10},components=[suggest]}}
>
> 2017-12-20 02:00:37.866 INFO (qtp401424608-16) [ x:User]
> o.a.s.h.c.SuggestComponent SuggestComponent prepare with :
> suggest.build=true&suggest.q=Jerry&suggest.count=10&suggest=true&suggest.dictionary=fuzzySuggester&wt=json&suggest.cfq=memory
>
> 2017-12-20 02:00:37.867 INFO (qtp401424608-16) [ x:User]
> o.a.s.s.s.SolrSuggester SolrSuggester.build(fuzzySuggester)
>
>
> =========================================
>
>
>
> 2017-12-20 02:05:53.908 INFO (qtp401424608-16) [ x:User_Data]
> o.a.s.c.S.Request [User] webapp=/solr path=/suggest
> params={suggest.build=true&suggest.q=Jerry&suggest=true&suggest.dictionary=fuzzySuggester&wt=json&suggest.cfq=memory}
> status=500 QTime=316057
>
> 2017-12-20 02:05:53.910 ERROR (qtp401424608-16) [ x:User_Data]
> o.a.s.s.HttpSolrCall null:java.io.IOException: No space left on device
>
> at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
>
> at sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60)
>
> at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
>
> at sun.nio.ch.IOUtil.write(IOUtil.java:65)
>
> at sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:211)
>
> at java.nio.channels.Channels.writeFullyImpl(Channels.java:78)
>
> at java.nio.channels.Channels.writeFully(Channels.java:101)
>
> at java.nio.channels.Channels.access$000(Channels.java:61)
>
> at java.nio.channels.Channels$1.write(Channels.java:174)
>
> at
> org.apache.lucene.store.FSDirectory$FSIndexOutput$1.write(FSDirectory.java:419)
>
> at java.util.zip.CheckedOutputStream.write(CheckedOutputStream.java:73)
>
> at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
>
> at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)
>
> at
> org.apache.lucene.store.OutputStreamIndexOutput.writeBytes(OutputStreamIndexOutput.java:53)
>
> at
> org.apache.lucene.util.OfflineSorter$ByteSequencesWriter.write(OfflineSorter.java:529)
>
> at
> org.apache.lucene.util.OfflineSorter$ByteSequencesWriter.write(OfflineSorter.java:504)
>
> at
> org.apache.lucene.util.OfflineSorter.mergePartitions(OfflineSorter.java:389)
>
> at org.apache.lucene.util.OfflineSorter.sort(OfflineSorter.java:278)
>
> at
> org.apache.lucene.search.suggest.analyzing.AnalyzingSuggester.build(AnalyzingSuggester.java:489)
>
> at org.apache.lucene.search.suggest.Lookup.build(Lookup.java:190)
>
> at
> org.apache.solr.spelling.suggest.SolrSuggester.build(SolrSuggester.java:181)
>
> at
> org.apache.solr.handler.component.SuggestComponent.prepare(SuggestComponent.java:179)
>
> at
> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:269)
>
> at
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:173)
>
> at org.apache.solr.core.SolrCore.execute(SolrCore.java:2440)
>
> at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:723)
>
> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:529)
>
> at
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
>
> at
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:298)
>
> at
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1691)
>
> at
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
>
> at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
>
> at
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)
>
> at
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)
>
> at
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
>
> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
>
> at
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
>
> at
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
>
> at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
>
> at
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)
>
> at
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)
>
> at
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
>
> at
> org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)
>
> at
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
>
> at org.eclipse.jetty.server.Server.handle(Server.java:534)
>
> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
>
> at
> org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
>
> at
> org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
>
> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
>
> at
> org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
>
> at
> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
>
> at
> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
>
> at
> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
>
> at
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
>
> at
> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
>
> at java.lang.Thread.run(Thread.java:748)
>
> Suppressed: java.io.IOException: No space left on device
>
> at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
>
> at sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60)
>
> at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
>
> at sun.nio.ch.IOUtil.write(IOUtil.java:65)
>
> at sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:211)
>
> at java.nio.channels.Channels.writeFullyImpl(Channels.java:78)
>
> at java.nio.channels.Channels.writeFully(Channels.java:101)
>
> at java.nio.channels.Channels.access$000(Channels.java:61)
>
> at java.nio.channels.Channels$1.write(Channels.java:174)
>
> at
> org.apache.lucene.store.FSDirectory$FSIndexOutput$1.write(FSDirectory.java:419)
>
> at java.util.zip.CheckedOutputStream.write(CheckedOutputStream.java:73)
>
> at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
>
> at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
>
> at
> org.apache.lucene.store.OutputStreamIndexOutput.close(OutputStreamIndexOutput.java:68)
>
> at
> org.apache.lucene.util.OfflineSorter$ByteSequencesWriter.close(OfflineSorter.java:537)
>
> at
> org.apache.lucene.util.OfflineSorter.mergePartitions(OfflineSorter.java:411)
>
> ... 39 more
>
> Suppressed: java.io.IOException: No space left on device
>
> at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
>
> at sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60)
>
> at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
>
> at sun.nio.ch.IOUtil.write(IOUtil.java:65)
>
> at sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:211)
>
> at java.nio.channels.Channels.writeFullyImpl(Channels.java:78)
>
> at java.nio.channels.Channels.writeFully(Channels.java:101)
>
> at java.nio.channels.Channels.access$000(Channels.java:61)
>
> at java.nio.channels.Channels$1.write(Channels.java:174)
>
> at
> org.apache.lucene.store.FSDirectory$FSIndexOutput$1.write(FSDirectory.java:419)
>
> at java.util.zip.CheckedOutputStream.write(CheckedOutputStream.java:73)
>
> at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
>
> at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
>
> at java.io.FilterOutputStream.close(FilterOutputStream.java:158)
>
> at
> org.apache.lucene.store.OutputStreamIndexOutput.close(OutputStreamIndexOutput.java:70)
>
>
>
>
> Thanks
> Fiz Ahmed.
>
> On Tue, Dec 19, 2017 at 5:57 PM, Jamie Jackson <ja...@gmail.com> wrote:
>
>> Have you checked disk consumption on the box yet?
>>
>> On Dec 19, 2017 8:46 PM, "Fiz Newyorker" <fi...@gmail.com> wrote:
>>
>> > Hello Solr Experts,
>> >
>> > Good Evening !
>> >
>> > I have an issue , Whenever I run the Auto Suggest component ,
>> >
>> > http://lapp81.rno.com:8989/solr/Data/suggest?suggest=
>> > true&suggest.build=true&suggest.dictionary=fuzzySuggester&wt=json&
>> > suggest.q=Jerry
>> >
>> >
>> > I am getting the following Error .
>> >
>> > {"responseHeader":{"status":500,"QTime":341753},"error":{"msg":"No
>> > space left on device","trace":"java.io.IOException: No space left on
>> > device\n\tat sun.nio.ch.FileDispatcherImpl.write0(Native Method)\n\tat
>> > sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60)\n\tat
>> > sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)\n\tat
>> > sun.nio.ch.IOUtil.write(IOUtil.java:65)\n\tat
>> > sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:211)\n\tat
>> > java.nio.channels.Channels.writeFullyImpl(Channels.java:78)\n\tat
>> > java.nio.channels.Channels.writeFully(Channels.java:101)\n\tat
>> > java.nio.channels.Channels.access$000(Channels.java:61)\n\tat
>> > java.nio.channels.Channels$1.write(Channels.java:174)\n\tat
>> > org.apache.lucene.store.FSDirectory$FSIndexOutput$1.
>> > write(FSDirectory.java:419)\n\tat
>> > java.util.zip.CheckedOutputStream.write(CheckedOutputStream.java:73)\
>> n\tat
>> > java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)\
>> > n\tat
>> > java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)\n\tat
>> > org.apache.lucene.store.OutputStreamIndexOutput.writeBytes(
>> > OutputStreamIndexOutput.java:53)\n\tat
>> > org.apache.lucene.util.OfflineSorter$ByteSequencesWriter.write(
>> > OfflineSorter.java:529)\n\tat
>> > org.apache.lucene.search.suggest.analyzing.AnalyzingSuggester.build(
>> > AnalyzingSuggester.java:480)\n\tat
>> > org.apache.lucene.search.suggest.Lookup.build(Lookup.java:190)\n\tat
>> > org.apache.solr.spelling.suggest.SolrSuggester.build(
>> > SolrSuggester.java:181)\n\tat
>> > org.apache.solr.handler.component.SuggestComponent.
>> > prepare(SuggestComponent.java:179)\n\tat
>> > org.apache.solr.handler.component.SearchHandler.handleRequestBody(
>> > SearchHandler.java:269)\n\tat
>> > org.apache.solr.handler.RequestHandlerBase.handleRequest(
>> > RequestHandlerBase.java:173)\n\tat
>> > org.apache.solr.core.SolrCore.execute(SolrCore.java:2440)\n\tat
>> > org.apache.solr.servlet.HttpSolrCall.execute(
>> HttpSolrCall.java:723)\n\tat
>> > org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:529)\n\tat
>> > org.apache.solr.servlet.SolrDispatchFilter.doFilter(
>> > SolrDispatchFilter.java:347)\n\tat
>> > org.apache.solr.servlet.SolrDispatchFilter.doFilter(
>> > SolrDispatchFilter.java:298)\n\tat
>> > org.eclipse.jetty.servlet.ServletHandler$CachedChain.
>> > doFilter(ServletHandler.java:1691)\n\tat
>> > org.eclipse.jetty.servlet.ServletHandler.doHandle(
>> > ServletHandler.java:582)\n\tat
>> > org.eclipse.jetty.server.handler.ScopedHandler.handle(
>> > ScopedHandler.java:143)\n\tat
>> > org.eclipse.jetty.security.SecurityHandler.handle(
>> > SecurityHandler.java:548)\n\tat
>> > org.eclipse.jetty.server.session.SessionHandler.
>> > doHandle(SessionHandler.java:226)\n\tat
>> > org.eclipse.jetty.server.handler.ContextHandler.
>> > doHandle(ContextHandler.java:1180)\n\tat
>> > org.eclipse.jetty.servlet.ServletHandler.doScope(
>> > ServletHandler.java:512)\n\tat
>> > org.eclipse.jetty.server.session.SessionHandler.
>> > doScope(SessionHandler.java:185)\n\tat
>> > org.eclipse.jetty.server.handler.ContextHandler.
>> > doScope(ContextHandler.java:1112)\n\tat
>> > org.eclipse.jetty.server.handler.ScopedHandler.handle(
>> > ScopedHandler.java:141)\n\tat
>> > org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(
>> > ContextHandlerCollection.java:213)\n\tat
>> > org.eclipse.jetty.server.handler.HandlerCollection.
>> > handle(HandlerCollection.java:119)\n\tat
>> > org.eclipse.jetty.server.handler.HandlerWrapper.handle(
>> > HandlerWrapper.java:134)\n\tat
>> > org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(
>> > RewriteHandler.java:335)\n\tat
>> > org.eclipse.jetty.server.handler.HandlerWrapper.handle(
>> > HandlerWrapper.java:134)\n\tat
>> > org.eclipse.jetty.server.Server.handle(Server.java:534)\n\tat
>> > org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)\n\tat
>> > org.eclipse.jetty.server.HttpConnection.onFillable(
>> > HttpConnection.java:251)\n\tat
>> > org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(
>> > AbstractConnection.java:273)\n\tat
>> > org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)\n\tat
>> > org.eclipse.jetty.io.SelectChannelEndPoint$2.run(
>> > SelectChannelEndPoint.java:93)\n\tat
>> > org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.
>> > executeProduceConsume(ExecuteProduceConsume.java:303)\n\tat
>> > org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.
>> > produceConsume(ExecuteProduceConsume.java:148)\n\tat
>> > org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(
>> > ExecuteProduceConsume.java:136)\n\tat
>> > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(
>> > QueuedThreadPool.java:671)\n\tat
>> > org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
>> > QueuedThreadPool.java:589)\n\tat
>> > java.lang.Thread.run(Thread.java:748)\n","code":500}}
>> >
>> > Please share your thoughts .
>> >
>> > Thanks
>> >
>> > Fiz Ahmed.
>> >
>>
Re: No space left on device - When I execute suggester component.
Posted by Erick Erickson <er...@gmail.com>.
It's kind of scary how often serendipity plays it's part. See the thread titled:
"Build suggester in different directory (not /tmp)."
Which basically says that the suggester is being built in /tmp which
may be limited.
And yes, that's where it gets built by default, although the thread I
mentioned has some
potential work-arounds and a suggestion to make this configurable that
would have
to be implemented by (you may see a Solr JIRA to that effect generated soon).
Of course you could make your /tmp volume bigger, but that may not be easy.
Erick
On Wed, Dec 20, 2017 at 11:46 AM, Fiz Newyorker <fi...@gmail.com> wrote:
> Hi Shawn/Erick/Matt,
>
> I agree with you. When I execute the command df -h I am getting the
> complete list of nfs mount info and Size and available space. I just
> shared one liner out of it..
>
>
> One more thing I observed whenever I run suggest.build.
>
> *http://rn.com:8989/solr/LW_Data/ <http://rn.com:8989/solr/LW_Data/>*
> suggest?suggest=true&suggest.build=true&suggest.dictionary=fuzzySuggester&wt=json&suggest.q=wills&&indent=on&suggest.cfq=memory
>
>
> The following files are created in TMP folder of the Machine. This is
> causing the Issue.
>
> 2017-12-20 18:20:08.280 INFO (qtp401424608-14) [ x:LW_Data]
> o.a.s.h.c.SuggestComponent SuggestComponent prepare with :
> suggest.build=true&indent=on&suggest.q=wills&suggest.count=10&suggest=true&suggest.dictionary=fuzzySuggester&wt=json
>
> 2017-12-20 18:20:08.280 INFO (qtp401424608-14) [ x:LW_Data]
> o.a.s.s.s.SolrSuggester SolrSuggester.build(fuzzySuggester)
>
> 2017-12-20 18:25:25.451 ERROR (qtp401424608-14) [ x:LW_Data]
> o.a.s.h.RequestHandlerBase java.io.IOException: No space left on device
>
> at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
>
> at sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60)
>
> since my tmp folder is just 2GB .
>
>
> *My Question is Why does AutoSuggest build command creates File in tmp
> folder ? Is this Usual behavior ? *
>
>
> -rw-------. 1 razord raz 554379579 Dec 20 18:40 suggester_input_0.tmp
>
> -rw-------. 1 razord ran 107963828 Dec 20 18:40 suggester_sort_1.tmp
>
> -rw-------. 1 razord raz 106162743 Dec 20 18:40 suggester_sort_2.tmp
>
> -rw-------. 1 razord raz 105870752 Dec 20 18:40 suggester_sort_3.tmp
>
> -rw-------. 1 razord raz 105851613 Dec 20 18:41 suggester_sort_4.tmp
>
> -rw-------. 1 razord raw 87888769 Dec 20 18:41 suggester_sort_5.tmp
>
>
>
> Thanks
>
> FIZ.
>
> On Wed, Dec 20, 2017 at 9:12 AM, Matthew Roth <mg...@gmail.com> wrote:
>
>> Oh, this seems relevant to my recent post to the list. My problem is that
>> the suggester's are first being built in /tmp and moved to /var. tmp has a
>> total of 2g's free whereas /var has near 100G.
>>
>> Perhaps you are running into the same problem I am in this regard? How does
>> your /tmp dir look when building?
>>
>> Matt
>>
>>
>> On Wed, Dec 20, 2017 at 2:59 AM, Shawn Heisey <ap...@elyograg.org> wrote:
>>
>> > On 12/20/2017 12:21 AM, Fiz Newyorker wrote:
>> >
>> >> I tried df -h , during suggest.build command.
>> >>
>> >> Size. Used Avail Use% Mounted on
>> >>
>> >> 63G 17G 44G 28% /ngs/app
>> >>
>> >
>> > That cannot be the entire output of that command. Here's what I get when
>> > I do it:
>> >
>> > root@smeagol:~# df -h
>> > Filesystem Size Used Avail Use% Mounted on
>> > udev 12G 0 12G 0% /dev
>> > tmpfs 2.4G 251M 2.2G 11% /run
>> > /dev/sda5 220G 15G 194G 8% /
>> > tmpfs 12G 412K 12G 1% /dev/shm
>> > tmpfs 5.0M 0 5.0M 0% /run/lock
>> > tmpfs 12G 0 12G 0% /sys/fs/cgroup
>> > /dev/sda1 47G 248M 45G 1% /boot
>> > tmpfs 2.4G 84K 2.4G 1% /run/user/1000
>> > tmpfs 2.4G 0 2.4G 0% /run/user/141
>> > tmpfs 2.4G 0 2.4G 0% /run/user/0
>> >
>> > If the disk has enough free space, then there is probably something else
>> > at work, like a filesystem quota for the user that is running Solr, or
>> some
>> > other kind of limitation that has been configured.
>> >
>> > Thanks,
>> > Shawn
>> >
>>
Re: No space left on device - When I execute suggester component.
Posted by Fiz Newyorker <fi...@gmail.com>.
Hi Shawn/Erick/Matt,
I agree with you. When I execute the command df -h I am getting the
complete list of nfs mount info and Size and available space. I just
shared one liner out of it..
One more thing I observed whenever I run suggest.build.
*http://rn.com:8989/solr/LW_Data/ <http://rn.com:8989/solr/LW_Data/>*
suggest?suggest=true&suggest.build=true&suggest.dictionary=fuzzySuggester&wt=json&suggest.q=wills&&indent=on&suggest.cfq=memory
The following files are created in TMP folder of the Machine. This is
causing the Issue.
2017-12-20 18:20:08.280 INFO (qtp401424608-14) [ x:LW_Data]
o.a.s.h.c.SuggestComponent SuggestComponent prepare with :
suggest.build=true&indent=on&suggest.q=wills&suggest.count=10&suggest=true&suggest.dictionary=fuzzySuggester&wt=json
2017-12-20 18:20:08.280 INFO (qtp401424608-14) [ x:LW_Data]
o.a.s.s.s.SolrSuggester SolrSuggester.build(fuzzySuggester)
2017-12-20 18:25:25.451 ERROR (qtp401424608-14) [ x:LW_Data]
o.a.s.h.RequestHandlerBase java.io.IOException: No space left on device
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60)
since my tmp folder is just 2GB .
*My Question is Why does AutoSuggest build command creates File in tmp
folder ? Is this Usual behavior ? *
-rw-------. 1 razord raz 554379579 Dec 20 18:40 suggester_input_0.tmp
-rw-------. 1 razord ran 107963828 Dec 20 18:40 suggester_sort_1.tmp
-rw-------. 1 razord raz 106162743 Dec 20 18:40 suggester_sort_2.tmp
-rw-------. 1 razord raz 105870752 Dec 20 18:40 suggester_sort_3.tmp
-rw-------. 1 razord raz 105851613 Dec 20 18:41 suggester_sort_4.tmp
-rw-------. 1 razord raw 87888769 Dec 20 18:41 suggester_sort_5.tmp
Thanks
FIZ.
On Wed, Dec 20, 2017 at 9:12 AM, Matthew Roth <mg...@gmail.com> wrote:
> Oh, this seems relevant to my recent post to the list. My problem is that
> the suggester's are first being built in /tmp and moved to /var. tmp has a
> total of 2g's free whereas /var has near 100G.
>
> Perhaps you are running into the same problem I am in this regard? How does
> your /tmp dir look when building?
>
> Matt
>
>
> On Wed, Dec 20, 2017 at 2:59 AM, Shawn Heisey <ap...@elyograg.org> wrote:
>
> > On 12/20/2017 12:21 AM, Fiz Newyorker wrote:
> >
> >> I tried df -h , during suggest.build command.
> >>
> >> Size. Used Avail Use% Mounted on
> >>
> >> 63G 17G 44G 28% /ngs/app
> >>
> >
> > That cannot be the entire output of that command. Here's what I get when
> > I do it:
> >
> > root@smeagol:~# df -h
> > Filesystem Size Used Avail Use% Mounted on
> > udev 12G 0 12G 0% /dev
> > tmpfs 2.4G 251M 2.2G 11% /run
> > /dev/sda5 220G 15G 194G 8% /
> > tmpfs 12G 412K 12G 1% /dev/shm
> > tmpfs 5.0M 0 5.0M 0% /run/lock
> > tmpfs 12G 0 12G 0% /sys/fs/cgroup
> > /dev/sda1 47G 248M 45G 1% /boot
> > tmpfs 2.4G 84K 2.4G 1% /run/user/1000
> > tmpfs 2.4G 0 2.4G 0% /run/user/141
> > tmpfs 2.4G 0 2.4G 0% /run/user/0
> >
> > If the disk has enough free space, then there is probably something else
> > at work, like a filesystem quota for the user that is running Solr, or
> some
> > other kind of limitation that has been configured.
> >
> > Thanks,
> > Shawn
> >
>
Re: No space left on device - When I execute suggester component.
Posted by Matthew Roth <mg...@gmail.com>.
Oh, this seems relevant to my recent post to the list. My problem is that
the suggester's are first being built in /tmp and moved to /var. tmp has a
total of 2g's free whereas /var has near 100G.
Perhaps you are running into the same problem I am in this regard? How does
your /tmp dir look when building?
Matt
On Wed, Dec 20, 2017 at 2:59 AM, Shawn Heisey <ap...@elyograg.org> wrote:
> On 12/20/2017 12:21 AM, Fiz Newyorker wrote:
>
>> I tried df -h , during suggest.build command.
>>
>> Size. Used Avail Use% Mounted on
>>
>> 63G 17G 44G 28% /ngs/app
>>
>
> That cannot be the entire output of that command. Here's what I get when
> I do it:
>
> root@smeagol:~# df -h
> Filesystem Size Used Avail Use% Mounted on
> udev 12G 0 12G 0% /dev
> tmpfs 2.4G 251M 2.2G 11% /run
> /dev/sda5 220G 15G 194G 8% /
> tmpfs 12G 412K 12G 1% /dev/shm
> tmpfs 5.0M 0 5.0M 0% /run/lock
> tmpfs 12G 0 12G 0% /sys/fs/cgroup
> /dev/sda1 47G 248M 45G 1% /boot
> tmpfs 2.4G 84K 2.4G 1% /run/user/1000
> tmpfs 2.4G 0 2.4G 0% /run/user/141
> tmpfs 2.4G 0 2.4G 0% /run/user/0
>
> If the disk has enough free space, then there is probably something else
> at work, like a filesystem quota for the user that is running Solr, or some
> other kind of limitation that has been configured.
>
> Thanks,
> Shawn
>
Re: No space left on device - When I execute suggester component.
Posted by Shawn Heisey <ap...@elyograg.org>.
On 12/20/2017 12:21 AM, Fiz Newyorker wrote:
> I tried df -h , during suggest.build command.
>
> Size. Used Avail Use% Mounted on
>
> 63G 17G 44G 28% /ngs/app
That cannot be the entire output of that command. Here's what I get
when I do it:
root@smeagol:~# df -h
Filesystem Size Used Avail Use% Mounted on
udev 12G 0 12G 0% /dev
tmpfs 2.4G 251M 2.2G 11% /run
/dev/sda5 220G 15G 194G 8% /
tmpfs 12G 412K 12G 1% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 12G 0 12G 0% /sys/fs/cgroup
/dev/sda1 47G 248M 45G 1% /boot
tmpfs 2.4G 84K 2.4G 1% /run/user/1000
tmpfs 2.4G 0 2.4G 0% /run/user/141
tmpfs 2.4G 0 2.4G 0% /run/user/0
If the disk has enough free space, then there is probably something else
at work, like a filesystem quota for the user that is running Solr, or
some other kind of limitation that has been configured.
Thanks,
Shawn
Re: No space left on device - When I execute suggester component.
Posted by Fiz Newyorker <fi...@gmail.com>.
Thank You Erick & Shawn for your response.
I tried df -h , during suggest.build command.
Size. Used Avail Use% Mounted on
63G 17G 44G 28% /ngs/app
/ngs/app/razord/LWSearch/solr-6.5.0/bin - My Solr Server .
I believe 44G is enough for running suggest.build. Please let me know what
might be the issue.
*Logs for your reference.*
2017-12-20 07:06:25.661 INFO (qtp401424608-21) [ x:LW_Data]
o.a.s.c.PluginBag Going to create a new requestHandler with {type =
requestHandler,name = /suggest,class = solr.SearchHandler,attributes =
{startup=lazy, name=/suggest, class=solr.SearchHandler},args =
{defaults={suggest=true,suggest.dictionary=infixSuggester,suggest.dictionary=fuzzySuggester,suggest.count=10},components=[suggest]}}
2017-12-20 07:06:25.663 INFO (qtp401424608-21) [ x:LW_Data]
o.a.s.h.c.SuggestComponent SuggestComponent prepare with :
suggest.build=true&indent=on&suggest.q=Charles&suggest.count=10&suggest=true&suggest.dictionary=fuzzySuggester&wt=json
2017-12-20 07:06:25.663 INFO (qtp401424608-21) [ x:LW_Data]
o.a.s.s.s.SolrSuggester SolrSuggester.build(fuzzySuggester)
2017-12-20 07:11:38.535 ERROR (qtp401424608-21) [ x:LW_Data]
o.a.s.h.RequestHandlerBase java.io.IOException: No space left on device
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
at sun.nio.ch.IOUtil.write(IOUtil.java:65)
at sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:211)
at java.nio.channels.Channels.writeFullyImpl(Channels.java:78)
at java.nio.channels.Channels.writeFully(Channels.java:101)
at java.nio.channels.Channels.access$000(Channels.java:61)
at java.nio.channels.Channels$1.write(Channels.java:174)
at
org.apache.lucene.store.FSDirectory$FSIndexOutput$1.write(FSDirectory.java:419)
at java.util.zip.CheckedOutputStream.write(CheckedOutputStream.java:73)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)
at
org.apache.lucene.store.OutputStreamIndexOutput.writeBytes(OutputStreamIndexOutput.java:53)
at
org.apache.lucene.util.OfflineSorter$ByteSequencesWriter.write(OfflineSorter.java:529)
at
org.apache.lucene.util.OfflineSorter$ByteSequencesWriter.write(OfflineSorter.java:504)
at
org.apache.lucene.util.OfflineSorter.mergePartitions(OfflineSorter.java:389)
at org.apache.lucene.util.OfflineSorter.sort(OfflineSorter.java:278)
at
org.apache.lucene.search.suggest.analyzing.AnalyzingSuggester.build(AnalyzingSuggester.java:489)
at org.apache.lucene.search.suggest.Lookup.build(Lookup.java:190)
at
org.apache.solr.spelling.suggest.SolrSuggester.build(SolrSuggester.java:181)
at
org.apache.solr.handler.component.SuggestComponent.prepare(SuggestComponent.java:179)
at
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:269)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:173)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:2440)
at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:723)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:529)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:298)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1691)
at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)
at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)
at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)
at
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
at
org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
at org.eclipse.jetty.server.Server.handle(Server.java:534)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
at
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
at
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
at
org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
at
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
at
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
Suppressed: java.io.IOException: No space left on device
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
at sun.nio.ch.IOUtil.write(IOUtil.java:65)
at sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:211)
Thanks
Fiz.
On Tue, Dec 19, 2017 at 7:37 PM, Shawn Heisey <ap...@elyograg.org> wrote:
> On 12/19/2017 7:07 PM, Fiz Newyorker wrote:
>
>> Yes I checked the Disk usage. using this command
>>
>> du -sh
>>
>> and I have enough space on the Disk.
>>
>
> <snip>
>
> 2017-12-20 02:05:53.910 ERROR (qtp401424608-16) [ x:User_Data]
>> o.a.s.s.HttpSolrCall null:java.io.IOException: No space left on device
>>
>
> The error that Solr is logging says that you don't have enough disk space.
>
> The "du" command doesn't show you how much free disk space you have. It
> is designed to show you how much space is consumed in a particular
> directory. Try this command instead:
>
> df -h
>
> Thanks,
> Shawn
>
Re: No space left on device - When I execute suggester component.
Posted by Shawn Heisey <ap...@elyograg.org>.
On 12/19/2017 7:07 PM, Fiz Newyorker wrote:
> Yes I checked the Disk usage. using this command
>
> du -sh
>
> and I have enough space on the Disk.
<snip>
> 2017-12-20 02:05:53.910 ERROR (qtp401424608-16) [ x:User_Data]
> o.a.s.s.HttpSolrCall null:java.io.IOException: No space left on device
The error that Solr is logging says that you don't have enough disk space.
The "du" command doesn't show you how much free disk space you have. It
is designed to show you how much space is consumed in a particular
directory. Try this command instead:
df -h
Thanks,
Shawn
Re: No space left on device - When I execute suggester component.
Posted by Fiz Newyorker <fi...@gmail.com>.
Hi ,
Yes I checked the Disk usage. using this command
du -sh
and I have enough space on the Disk.
I am using this Query :
*http://rn.com/solr/User_Data/suggest?suggest=true&suggest.build=true&suggest.dictionary=fuzzySuggester&wt=json&suggest.q=Jerry
<http://rn.com/solr/User_Data/suggest?suggest=true&suggest.build=true&suggest.dictionary=fuzzySuggester&wt=json&suggest.q=Jerry>*
*I see in the solr logs *
2017-12-20 02:00:37.852 INFO (qtp401424608-16) [ x:User]
o.a.s.c.PluginBag Going to create a new requestHandler with {type =
requestHandler,name = /suggest,class = solr.SearchHandler,attributes =
{startup=lazy, name=/suggest, class=solr.SearchHandler},args =
{defaults={suggest=true,suggest.dictionary=infixSuggester,suggest.dictionary=fuzzySuggester,suggest.count=10},components=[suggest]}}
2017-12-20 02:00:37.866 INFO (qtp401424608-16) [ x:User]
o.a.s.h.c.SuggestComponent SuggestComponent prepare with :
suggest.build=true&suggest.q=Jerry&suggest.count=10&suggest=true&suggest.dictionary=fuzzySuggester&wt=json&suggest.cfq=memory
2017-12-20 02:00:37.867 INFO (qtp401424608-16) [ x:User]
o.a.s.s.s.SolrSuggester SolrSuggester.build(fuzzySuggester)
=========================================
2017-12-20 02:05:53.908 INFO (qtp401424608-16) [ x:User_Data]
o.a.s.c.S.Request [User] webapp=/solr path=/suggest
params={suggest.build=true&suggest.q=Jerry&suggest=true&suggest.dictionary=fuzzySuggester&wt=json&suggest.cfq=memory}
status=500 QTime=316057
2017-12-20 02:05:53.910 ERROR (qtp401424608-16) [ x:User_Data]
o.a.s.s.HttpSolrCall null:java.io.IOException: No space left on device
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
at sun.nio.ch.IOUtil.write(IOUtil.java:65)
at sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:211)
at java.nio.channels.Channels.writeFullyImpl(Channels.java:78)
at java.nio.channels.Channels.writeFully(Channels.java:101)
at java.nio.channels.Channels.access$000(Channels.java:61)
at java.nio.channels.Channels$1.write(Channels.java:174)
at
org.apache.lucene.store.FSDirectory$FSIndexOutput$1.write(FSDirectory.java:419)
at java.util.zip.CheckedOutputStream.write(CheckedOutputStream.java:73)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)
at
org.apache.lucene.store.OutputStreamIndexOutput.writeBytes(OutputStreamIndexOutput.java:53)
at
org.apache.lucene.util.OfflineSorter$ByteSequencesWriter.write(OfflineSorter.java:529)
at
org.apache.lucene.util.OfflineSorter$ByteSequencesWriter.write(OfflineSorter.java:504)
at
org.apache.lucene.util.OfflineSorter.mergePartitions(OfflineSorter.java:389)
at org.apache.lucene.util.OfflineSorter.sort(OfflineSorter.java:278)
at
org.apache.lucene.search.suggest.analyzing.AnalyzingSuggester.build(AnalyzingSuggester.java:489)
at org.apache.lucene.search.suggest.Lookup.build(Lookup.java:190)
at
org.apache.solr.spelling.suggest.SolrSuggester.build(SolrSuggester.java:181)
at
org.apache.solr.handler.component.SuggestComponent.prepare(SuggestComponent.java:179)
at
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:269)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:173)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:2440)
at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:723)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:529)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:298)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1691)
at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)
at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)
at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)
at
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
at
org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335)
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
at org.eclipse.jetty.server.Server.handle(Server.java:534)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
at
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
at
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
at
org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
at
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
at
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
Suppressed: java.io.IOException: No space left on device
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
at sun.nio.ch.IOUtil.write(IOUtil.java:65)
at sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:211)
at java.nio.channels.Channels.writeFullyImpl(Channels.java:78)
at java.nio.channels.Channels.writeFully(Channels.java:101)
at java.nio.channels.Channels.access$000(Channels.java:61)
at java.nio.channels.Channels$1.write(Channels.java:174)
at
org.apache.lucene.store.FSDirectory$FSIndexOutput$1.write(FSDirectory.java:419)
at java.util.zip.CheckedOutputStream.write(CheckedOutputStream.java:73)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
at
org.apache.lucene.store.OutputStreamIndexOutput.close(OutputStreamIndexOutput.java:68)
at
org.apache.lucene.util.OfflineSorter$ByteSequencesWriter.close(OfflineSorter.java:537)
at
org.apache.lucene.util.OfflineSorter.mergePartitions(OfflineSorter.java:411)
... 39 more
Suppressed: java.io.IOException: No space left on device
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
at sun.nio.ch.IOUtil.write(IOUtil.java:65)
at sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:211)
at java.nio.channels.Channels.writeFullyImpl(Channels.java:78)
at java.nio.channels.Channels.writeFully(Channels.java:101)
at java.nio.channels.Channels.access$000(Channels.java:61)
at java.nio.channels.Channels$1.write(Channels.java:174)
at
org.apache.lucene.store.FSDirectory$FSIndexOutput$1.write(FSDirectory.java:419)
at java.util.zip.CheckedOutputStream.write(CheckedOutputStream.java:73)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
at java.io.FilterOutputStream.close(FilterOutputStream.java:158)
at
org.apache.lucene.store.OutputStreamIndexOutput.close(OutputStreamIndexOutput.java:70)
Thanks
Fiz Ahmed.
On Tue, Dec 19, 2017 at 5:57 PM, Jamie Jackson <ja...@gmail.com> wrote:
> Have you checked disk consumption on the box yet?
>
> On Dec 19, 2017 8:46 PM, "Fiz Newyorker" <fi...@gmail.com> wrote:
>
> > Hello Solr Experts,
> >
> > Good Evening !
> >
> > I have an issue , Whenever I run the Auto Suggest component ,
> >
> > http://lapp81.rno.com:8989/solr/Data/suggest?suggest=
> > true&suggest.build=true&suggest.dictionary=fuzzySuggester&wt=json&
> > suggest.q=Jerry
> >
> >
> > I am getting the following Error .
> >
> > {"responseHeader":{"status":500,"QTime":341753},"error":{"msg":"No
> > space left on device","trace":"java.io.IOException: No space left on
> > device\n\tat sun.nio.ch.FileDispatcherImpl.write0(Native Method)\n\tat
> > sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60)\n\tat
> > sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)\n\tat
> > sun.nio.ch.IOUtil.write(IOUtil.java:65)\n\tat
> > sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:211)\n\tat
> > java.nio.channels.Channels.writeFullyImpl(Channels.java:78)\n\tat
> > java.nio.channels.Channels.writeFully(Channels.java:101)\n\tat
> > java.nio.channels.Channels.access$000(Channels.java:61)\n\tat
> > java.nio.channels.Channels$1.write(Channels.java:174)\n\tat
> > org.apache.lucene.store.FSDirectory$FSIndexOutput$1.
> > write(FSDirectory.java:419)\n\tat
> > java.util.zip.CheckedOutputStream.write(CheckedOutputStream.java:73)\
> n\tat
> > java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)\
> > n\tat
> > java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)\n\tat
> > org.apache.lucene.store.OutputStreamIndexOutput.writeBytes(
> > OutputStreamIndexOutput.java:53)\n\tat
> > org.apache.lucene.util.OfflineSorter$ByteSequencesWriter.write(
> > OfflineSorter.java:529)\n\tat
> > org.apache.lucene.search.suggest.analyzing.AnalyzingSuggester.build(
> > AnalyzingSuggester.java:480)\n\tat
> > org.apache.lucene.search.suggest.Lookup.build(Lookup.java:190)\n\tat
> > org.apache.solr.spelling.suggest.SolrSuggester.build(
> > SolrSuggester.java:181)\n\tat
> > org.apache.solr.handler.component.SuggestComponent.
> > prepare(SuggestComponent.java:179)\n\tat
> > org.apache.solr.handler.component.SearchHandler.handleRequestBody(
> > SearchHandler.java:269)\n\tat
> > org.apache.solr.handler.RequestHandlerBase.handleRequest(
> > RequestHandlerBase.java:173)\n\tat
> > org.apache.solr.core.SolrCore.execute(SolrCore.java:2440)\n\tat
> > org.apache.solr.servlet.HttpSolrCall.execute(
> HttpSolrCall.java:723)\n\tat
> > org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:529)\n\tat
> > org.apache.solr.servlet.SolrDispatchFilter.doFilter(
> > SolrDispatchFilter.java:347)\n\tat
> > org.apache.solr.servlet.SolrDispatchFilter.doFilter(
> > SolrDispatchFilter.java:298)\n\tat
> > org.eclipse.jetty.servlet.ServletHandler$CachedChain.
> > doFilter(ServletHandler.java:1691)\n\tat
> > org.eclipse.jetty.servlet.ServletHandler.doHandle(
> > ServletHandler.java:582)\n\tat
> > org.eclipse.jetty.server.handler.ScopedHandler.handle(
> > ScopedHandler.java:143)\n\tat
> > org.eclipse.jetty.security.SecurityHandler.handle(
> > SecurityHandler.java:548)\n\tat
> > org.eclipse.jetty.server.session.SessionHandler.
> > doHandle(SessionHandler.java:226)\n\tat
> > org.eclipse.jetty.server.handler.ContextHandler.
> > doHandle(ContextHandler.java:1180)\n\tat
> > org.eclipse.jetty.servlet.ServletHandler.doScope(
> > ServletHandler.java:512)\n\tat
> > org.eclipse.jetty.server.session.SessionHandler.
> > doScope(SessionHandler.java:185)\n\tat
> > org.eclipse.jetty.server.handler.ContextHandler.
> > doScope(ContextHandler.java:1112)\n\tat
> > org.eclipse.jetty.server.handler.ScopedHandler.handle(
> > ScopedHandler.java:141)\n\tat
> > org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(
> > ContextHandlerCollection.java:213)\n\tat
> > org.eclipse.jetty.server.handler.HandlerCollection.
> > handle(HandlerCollection.java:119)\n\tat
> > org.eclipse.jetty.server.handler.HandlerWrapper.handle(
> > HandlerWrapper.java:134)\n\tat
> > org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(
> > RewriteHandler.java:335)\n\tat
> > org.eclipse.jetty.server.handler.HandlerWrapper.handle(
> > HandlerWrapper.java:134)\n\tat
> > org.eclipse.jetty.server.Server.handle(Server.java:534)\n\tat
> > org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)\n\tat
> > org.eclipse.jetty.server.HttpConnection.onFillable(
> > HttpConnection.java:251)\n\tat
> > org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(
> > AbstractConnection.java:273)\n\tat
> > org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)\n\tat
> > org.eclipse.jetty.io.SelectChannelEndPoint$2.run(
> > SelectChannelEndPoint.java:93)\n\tat
> > org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.
> > executeProduceConsume(ExecuteProduceConsume.java:303)\n\tat
> > org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.
> > produceConsume(ExecuteProduceConsume.java:148)\n\tat
> > org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(
> > ExecuteProduceConsume.java:136)\n\tat
> > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(
> > QueuedThreadPool.java:671)\n\tat
> > org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> > QueuedThreadPool.java:589)\n\tat
> > java.lang.Thread.run(Thread.java:748)\n","code":500}}
> >
> > Please share your thoughts .
> >
> > Thanks
> >
> > Fiz Ahmed.
> >
>
Re: No space left on device - When I execute suggester component.
Posted by Jamie Jackson <ja...@gmail.com>.
Have you checked disk consumption on the box yet?
On Dec 19, 2017 8:46 PM, "Fiz Newyorker" <fi...@gmail.com> wrote:
> Hello Solr Experts,
>
> Good Evening !
>
> I have an issue , Whenever I run the Auto Suggest component ,
>
> http://lapp81.rno.com:8989/solr/Data/suggest?suggest=
> true&suggest.build=true&suggest.dictionary=fuzzySuggester&wt=json&
> suggest.q=Jerry
>
>
> I am getting the following Error .
>
> {"responseHeader":{"status":500,"QTime":341753},"error":{"msg":"No
> space left on device","trace":"java.io.IOException: No space left on
> device\n\tat sun.nio.ch.FileDispatcherImpl.write0(Native Method)\n\tat
> sun.nio.ch.FileDispatcherImpl.write(FileDispatcherImpl.java:60)\n\tat
> sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)\n\tat
> sun.nio.ch.IOUtil.write(IOUtil.java:65)\n\tat
> sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:211)\n\tat
> java.nio.channels.Channels.writeFullyImpl(Channels.java:78)\n\tat
> java.nio.channels.Channels.writeFully(Channels.java:101)\n\tat
> java.nio.channels.Channels.access$000(Channels.java:61)\n\tat
> java.nio.channels.Channels$1.write(Channels.java:174)\n\tat
> org.apache.lucene.store.FSDirectory$FSIndexOutput$1.
> write(FSDirectory.java:419)\n\tat
> java.util.zip.CheckedOutputStream.write(CheckedOutputStream.java:73)\n\tat
> java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)\
> n\tat
> java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)\n\tat
> org.apache.lucene.store.OutputStreamIndexOutput.writeBytes(
> OutputStreamIndexOutput.java:53)\n\tat
> org.apache.lucene.util.OfflineSorter$ByteSequencesWriter.write(
> OfflineSorter.java:529)\n\tat
> org.apache.lucene.search.suggest.analyzing.AnalyzingSuggester.build(
> AnalyzingSuggester.java:480)\n\tat
> org.apache.lucene.search.suggest.Lookup.build(Lookup.java:190)\n\tat
> org.apache.solr.spelling.suggest.SolrSuggester.build(
> SolrSuggester.java:181)\n\tat
> org.apache.solr.handler.component.SuggestComponent.
> prepare(SuggestComponent.java:179)\n\tat
> org.apache.solr.handler.component.SearchHandler.handleRequestBody(
> SearchHandler.java:269)\n\tat
> org.apache.solr.handler.RequestHandlerBase.handleRequest(
> RequestHandlerBase.java:173)\n\tat
> org.apache.solr.core.SolrCore.execute(SolrCore.java:2440)\n\tat
> org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:723)\n\tat
> org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:529)\n\tat
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(
> SolrDispatchFilter.java:347)\n\tat
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(
> SolrDispatchFilter.java:298)\n\tat
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.
> doFilter(ServletHandler.java:1691)\n\tat
> org.eclipse.jetty.servlet.ServletHandler.doHandle(
> ServletHandler.java:582)\n\tat
> org.eclipse.jetty.server.handler.ScopedHandler.handle(
> ScopedHandler.java:143)\n\tat
> org.eclipse.jetty.security.SecurityHandler.handle(
> SecurityHandler.java:548)\n\tat
> org.eclipse.jetty.server.session.SessionHandler.
> doHandle(SessionHandler.java:226)\n\tat
> org.eclipse.jetty.server.handler.ContextHandler.
> doHandle(ContextHandler.java:1180)\n\tat
> org.eclipse.jetty.servlet.ServletHandler.doScope(
> ServletHandler.java:512)\n\tat
> org.eclipse.jetty.server.session.SessionHandler.
> doScope(SessionHandler.java:185)\n\tat
> org.eclipse.jetty.server.handler.ContextHandler.
> doScope(ContextHandler.java:1112)\n\tat
> org.eclipse.jetty.server.handler.ScopedHandler.handle(
> ScopedHandler.java:141)\n\tat
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(
> ContextHandlerCollection.java:213)\n\tat
> org.eclipse.jetty.server.handler.HandlerCollection.
> handle(HandlerCollection.java:119)\n\tat
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(
> HandlerWrapper.java:134)\n\tat
> org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(
> RewriteHandler.java:335)\n\tat
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(
> HandlerWrapper.java:134)\n\tat
> org.eclipse.jetty.server.Server.handle(Server.java:534)\n\tat
> org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)\n\tat
> org.eclipse.jetty.server.HttpConnection.onFillable(
> HttpConnection.java:251)\n\tat
> org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(
> AbstractConnection.java:273)\n\tat
> org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)\n\tat
> org.eclipse.jetty.io.SelectChannelEndPoint$2.run(
> SelectChannelEndPoint.java:93)\n\tat
> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.
> executeProduceConsume(ExecuteProduceConsume.java:303)\n\tat
> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.
> produceConsume(ExecuteProduceConsume.java:148)\n\tat
> org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(
> ExecuteProduceConsume.java:136)\n\tat
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(
> QueuedThreadPool.java:671)\n\tat
> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(
> QueuedThreadPool.java:589)\n\tat
> java.lang.Thread.run(Thread.java:748)\n","code":500}}
>
> Please share your thoughts .
>
> Thanks
>
> Fiz Ahmed.
>