You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@solr.apache.org by "Jaye Mosier (Jira)" <ji...@apache.org> on 2022/03/02 04:04:00 UTC
[jira] [Comment Edited] (SOLR-13063) Open file limit warning when starting solr
[ https://issues.apache.org/jira/browse/SOLR-13063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17499695#comment-17499695 ]
Jaye Mosier edited comment on SOLR-13063 at 3/2/22, 4:03 AM:
-------------------------------------------------------------
On Ubuntu 20.04 I had to change the following files:
To increase the number of processes I had to open /etc/security/limits.conf and append the following lines:
jaye hard nproc 65535
jaye soft nproc 65535
As for the limit on the number of files open I had to open /etc/systemd/user.conf and append the following line:
DefaultLimitNOFILE=65535
NOTE: There is a file /etc/systemd/system.conf that contains the following line:
#DefaultLimitNOFILE=1024:524288
The assignment 1024:524288 presents a question, what does the value 524288 (512k) mean? A thorough search on Google turns up nothing. No comments in the file. Basically the kind of crap that every software developer runs into all the time.
I can only conclude that the assignment value 1024:524288 means the limit is 1024 open files for a user and 512k open files for a system level process. If so does this mean that changing the assignment value to 65535:524288 will fix the problem of solr alerting that the max number, 1024 open files may be insufficient?
I dont know, I leave that as an excercise.
Happy Coding!
Jaye
jaye.jamworkspro.com
was (Author: JIRAUSER285902):
On Ubuntu 20.04 I had to change the following files:
To increase the number of processes I had to open /etc/security/limits.conf and append the following lines:
jaye hard nproc 65535
jaye soft nproc 65535
As for the limit on the number of files open I had to open /etc/systemd/user.conf and append the following line:
DefaultLimitNOFILE=65535
NOTE: There is a file /etc/systemd/system.conf that contains the following line:
#DefaultLimitNOFILE=1024:524288
The assignment 1024:524288 presents a question, what does the value 524288 (512k) mean? A thorough search on Google turns up nothing. No comments in the file. Basically the kind of crap that every software developer runs into all the time.
I can only conclude that the assignment value 1024:524288 means the limit is 1024 open files for a user and 512k open files for a system level process. If so does this mean that changing the assignment value to 65535:524288 will fix the problem of solr alerting that the max number, 1024 open files may be insufficient?
I dont know, I leave that as an excercise. Hopefully the Solr team will update the error to include fixes. Since currently it basically alerts there is a problem but fails to offer a solution speaks poorly for its usability.
Also I see a bunch of crap spam in the search results. Whats up with that???
Happy Coding!
Jaye
jaye.jamworkspro.com
> Open file limit warning when starting solr
> ------------------------------------------
>
> Key: SOLR-13063
> URL: https://issues.apache.org/jira/browse/SOLR-13063
> Project: Solr
> Issue Type: Bug
> Components: SolrCLI
> Affects Versions: 7.5
> Reporter: Rony
> Priority: Major
>
> Hello, When launching solr (Ubuntu 16.04) I'm getting:
> *
> **
> *** [WARN] *** Your open file limit is currently 1024.
> It should be set to 65000 to avoid operational disruption.
> If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh
> *** [WARN] *** Your Max Processes Limit is currently 15058.
> It should be set to 65000 to avoid operational disruption.
> If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh
> This appears to be related to a known bug in [#Ubuntu] [https://blog.jayway.com/2012/02/11/how-to-really-fix-the-too-many-open-files-problem-for-tomcat-in-ubuntu/]
> I was wondering if you have some workaround. I followed the solutions in the following threads:
> [https://vufind.org/jira/browse/VUFIND-1290]
> [https://underyx.me/2015/05/18/raising-the-maximum-number-of-file-descriptors]
> and was able to resolve Max Processes Limit but not File limit:
> *
> **
> *** [WARN] *** Your open file limit is currently 1024.
> It should be set to 65000 to avoid operational disruption.
> If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh
> Waiting up to 180 seconds to see Solr running on port 8983 []
> Started Solr server on port 8983 (pid=2843). Happy searching!
> cd proc# cat 2843/limits:
> Max processes 65000 65000 processes
> Max open files 4096 4096 files
>
> The problem persisted after upgrade to Ubuntu 18.10
> Any other solution would be appreciated.
> Otherwise can you please tell me what are the likely consequences of the open file limit?
>
>
>
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@solr.apache.org
For additional commands, e-mail: issues-help@solr.apache.org