You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Anderson vasconcelos <an...@gmail.com> on 2010/06/28 17:56:55 UTC
Too Many Open Files
Hi all
When i send a delete query to SOLR, using the SOLRJ i received this
exception:
org.apache.solr.client.solrj.SolrServerException: java.net.SocketException:
Too many open files
11:53:06,964 INFO [HttpMethodDirector] I/O exception
(java.net.SocketException) caught when processing request: Too many open
files
Anyone could Help me? How i can solve this?
Thanks
Re: Too Many Open Files
Posted by Anderson vasconcelos <an...@gmail.com>.
Other question,
Why SOLRJ d'ont close the StringWriter e OutputStreamWriter ?
thanks
2010/6/28 Anderson vasconcelos <an...@gmail.com>
> Thanks for responses.
> I instantiate one instance of per request (per delete query, in my case).
> I have a lot of concurrency process. Reusing the same instance (to send,
> delete and remove data) in solr, i will have a trouble?
> My concern is if i do this, solr will commit documents with data from other
> transaction.
>
> Thanks
>
>
>
>
> 2010/6/28 Michel Bottan <fr...@gmail.com>
>
> Hi Anderson,
>>
>> If you are using SolrJ, it's recommended to reuse the same instance per
>> solr
>> server.
>>
>> http://wiki.apache.org/solr/Solrj#CommonsHttpSolrServer
>>
>> But there are other scenarios which may cause this situation:
>>
>> 1. Other application running in the same Solr JVM which doesn't close
>> properly sockets or control file handlers.
>> 2. Open files limits configuration is low . Check your limits, read it
>> from
>> JVM process info:
>> cat /proc/1234/limits (where 1234 is your process ID)
>>
>> Cheers,
>> Michel Bottan
>>
>>
>> On Mon, Jun 28, 2010 at 1:18 PM, Erick Erickson <erickerickson@gmail.com
>> >wrote:
>>
>> > This probably means you're opening new readers without closing
>> > old ones. But that's just a guess. I'm guessing that this really
>> > has nothing to do with the delete itself, but the delete is what's
>> > finally pushing you over the limit.
>> >
>> > I know this has been discussed before, try searching the mail
>> > archive for TooManyOpenFiles and/or File Handles....
>> >
>> > You could get much better information by providing more details, see:
>> >
>> >
>> >
>> http://wiki.apache.org/solr/UsingMailingLists?highlight=(most)|(users)|(list)<http://wiki.apache.org/solr/UsingMailingLists?highlight=%28most%29%7C%28users%29%7C%28list%29>
>> <
>> http://wiki.apache.org/solr/UsingMailingLists?highlight=%28most%29%7C%28users%29%7C%28list%29
>> >
>> >
>> > Best
>> > Erick
>> >
>> > On Mon, Jun 28, 2010 at 11:56 AM, Anderson vasconcelos <
>> > anderson.vass@gmail.com> wrote:
>> >
>> > > Hi all
>> > > When i send a delete query to SOLR, using the SOLRJ i received this
>> > > exception:
>> > >
>> > > org.apache.solr.client.solrj.SolrServerException:
>> > java.net.SocketException:
>> > > Too many open files
>> > > 11:53:06,964 INFO [HttpMethodDirector] I/O exception
>> > > (java.net.SocketException) caught when processing request: Too many
>> open
>> > > files
>> > >
>> > > Anyone could Help me? How i can solve this?
>> > >
>> > > Thanks
>> > >
>> >
>>
>
>
Re: Too Many Open Files
Posted by Anderson vasconcelos <an...@gmail.com>.
Thanks for responses.
I instantiate one instance of per request (per delete query, in my case).
I have a lot of concurrency process. Reusing the same instance (to send,
delete and remove data) in solr, i will have a trouble?
My concern is if i do this, solr will commit documents with data from other
transaction.
Thanks
2010/6/28 Michel Bottan <fr...@gmail.com>
> Hi Anderson,
>
> If you are using SolrJ, it's recommended to reuse the same instance per
> solr
> server.
>
> http://wiki.apache.org/solr/Solrj#CommonsHttpSolrServer
>
> But there are other scenarios which may cause this situation:
>
> 1. Other application running in the same Solr JVM which doesn't close
> properly sockets or control file handlers.
> 2. Open files limits configuration is low . Check your limits, read it from
> JVM process info:
> cat /proc/1234/limits (where 1234 is your process ID)
>
> Cheers,
> Michel Bottan
>
>
> On Mon, Jun 28, 2010 at 1:18 PM, Erick Erickson <erickerickson@gmail.com
> >wrote:
>
> > This probably means you're opening new readers without closing
> > old ones. But that's just a guess. I'm guessing that this really
> > has nothing to do with the delete itself, but the delete is what's
> > finally pushing you over the limit.
> >
> > I know this has been discussed before, try searching the mail
> > archive for TooManyOpenFiles and/or File Handles....
> >
> > You could get much better information by providing more details, see:
> >
> >
> >
> http://wiki.apache.org/solr/UsingMailingLists?highlight=(most)|(users)|(list)<http://wiki.apache.org/solr/UsingMailingLists?highlight=%28most%29%7C%28users%29%7C%28list%29>
> <
> http://wiki.apache.org/solr/UsingMailingLists?highlight=%28most%29%7C%28users%29%7C%28list%29
> >
> >
> > Best
> > Erick
> >
> > On Mon, Jun 28, 2010 at 11:56 AM, Anderson vasconcelos <
> > anderson.vass@gmail.com> wrote:
> >
> > > Hi all
> > > When i send a delete query to SOLR, using the SOLRJ i received this
> > > exception:
> > >
> > > org.apache.solr.client.solrj.SolrServerException:
> > java.net.SocketException:
> > > Too many open files
> > > 11:53:06,964 INFO [HttpMethodDirector] I/O exception
> > > (java.net.SocketException) caught when processing request: Too many
> open
> > > files
> > >
> > > Anyone could Help me? How i can solve this?
> > >
> > > Thanks
> > >
> >
>
Re: Too Many Open Files
Posted by Michel Bottan <fr...@gmail.com>.
Hi Anderson,
If you are using SolrJ, it's recommended to reuse the same instance per solr
server.
http://wiki.apache.org/solr/Solrj#CommonsHttpSolrServer
But there are other scenarios which may cause this situation:
1. Other application running in the same Solr JVM which doesn't close
properly sockets or control file handlers.
2. Open files limits configuration is low . Check your limits, read it from
JVM process info:
cat /proc/1234/limits (where 1234 is your process ID)
Cheers,
Michel Bottan
On Mon, Jun 28, 2010 at 1:18 PM, Erick Erickson <er...@gmail.com>wrote:
> This probably means you're opening new readers without closing
> old ones. But that's just a guess. I'm guessing that this really
> has nothing to do with the delete itself, but the delete is what's
> finally pushing you over the limit.
>
> I know this has been discussed before, try searching the mail
> archive for TooManyOpenFiles and/or File Handles....
>
> You could get much better information by providing more details, see:
>
>
> http://wiki.apache.org/solr/UsingMailingLists?highlight=(most)|(users)|(list)<http://wiki.apache.org/solr/UsingMailingLists?highlight=%28most%29%7C%28users%29%7C%28list%29>
>
> Best
> Erick
>
> On Mon, Jun 28, 2010 at 11:56 AM, Anderson vasconcelos <
> anderson.vass@gmail.com> wrote:
>
> > Hi all
> > When i send a delete query to SOLR, using the SOLRJ i received this
> > exception:
> >
> > org.apache.solr.client.solrj.SolrServerException:
> java.net.SocketException:
> > Too many open files
> > 11:53:06,964 INFO [HttpMethodDirector] I/O exception
> > (java.net.SocketException) caught when processing request: Too many open
> > files
> >
> > Anyone could Help me? How i can solve this?
> >
> > Thanks
> >
>
Re: Too Many Open Files
Posted by Erick Erickson <er...@gmail.com>.
This probably means you're opening new readers without closing
old ones. But that's just a guess. I'm guessing that this really
has nothing to do with the delete itself, but the delete is what's
finally pushing you over the limit.
I know this has been discussed before, try searching the mail
archive for TooManyOpenFiles and/or File Handles....
You could get much better information by providing more details, see:
http://wiki.apache.org/solr/UsingMailingLists?highlight=(most)|(users)|(list)
Best
Erick
On Mon, Jun 28, 2010 at 11:56 AM, Anderson vasconcelos <
anderson.vass@gmail.com> wrote:
> Hi all
> When i send a delete query to SOLR, using the SOLRJ i received this
> exception:
>
> org.apache.solr.client.solrj.SolrServerException: java.net.SocketException:
> Too many open files
> 11:53:06,964 INFO [HttpMethodDirector] I/O exception
> (java.net.SocketException) caught when processing request: Too many open
> files
>
> Anyone could Help me? How i can solve this?
>
> Thanks
>