You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@archiva.apache.org by "Marc Lustig (JIRA)" <ji...@codehaus.org> on 2009/02/23 09:40:19 UTC
[jira] Created: (MRM-1097) Error 500 "too many open files"
Error 500 "too many open files"
-------------------------------
Key: MRM-1097
URL: http://jira.codehaus.org/browse/MRM-1097
Project: Archiva
Issue Type: Bug
Components: system
Affects Versions: 1.1.3
Environment: Linux RedHat, Tomcat 6 + Native Connector
Reporter: Marc Lustig
In our start-script we have configured "ulimit -n 10000"
But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Brett Porter (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=263760#action_263760 ]
Brett Porter commented on MRM-1097:
-----------------------------------
Elie, as this is closed can you file a new issue against 1.3.4? There may be an additional cause, or it may require tuning on your limits.
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Assignee: Maria Odea Ching
> Fix For: 1.3.3
>
> Attachments: MRM-1097.patch
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Elie Delorme (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=263591#action_263591 ]
Elie Delorme commented on MRM-1097:
-----------------------------------
I just received this error on our archiva 1.3.4 installation which we upgraded hoping that it would resolve the problem.
The "Too many open files" appeared after only 3 hours uptime.
{noformat}
2011-04-13 20:55:22,444 [WrapperSimpleAppMain] INFO org.apache.maven.archiva.web.startup.Banner - _________________________
__________________________________
/\_ / \
/`/@), | On behalf of all of the alpacas |
| (~' __| toiling away on the Apache Archiva |
_,--.___/ | \ project team, I would like to |
,' , ( | \ welcome you to Archiva |
| ( \ / | 1.3.4 |
\ )\_/ ,_/ | |
/ / ( |/ | http://archiva.apache.org/ |
( | ( | | users@archiva.apache.org |
\| \| \__________________________________/
2011-04-14 00:09:43,639 [btpool0-8] WARN org.apache.maven.archiva.proxy.DefaultRepositoryProxyConnectors - Transfer error from repository "terracotta" for artifact org.hibernate:ejb3-persistence:1.0.2.GA::pom, continuing to next repository. Error message: Download failure on resource [http://www.terracotta.org/download/reflector/releases/org/hibernate/ejb3-persistence/1.0.2.GA/ejb3-persistence-1.0.2.GA.pom]:Error transferring file: Too many open files (cause: java.net.SocketException: Too many open files)
{noformat}
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Assignee: Maria Odea Ching
> Fix For: 1.3.3
>
> Attachments: MRM-1097.patch
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Issue Comment Edited: (MRM-1097) Error 500 "too many open
files"
Posted by "Maria Odea Ching (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=244516#action_244516 ]
Maria Odea Ching edited comment on MRM-1097 at 11/26/10 1:20 AM:
-----------------------------------------------------------------
I checked the codes of the classes that were changed in the fix I committed, they're mostly similar in 1.3.x and trunk. But we can't directly merge the changes using {{svn merge -c ...}} because some of the classes (like the {{IndexingTaskExecutor}} and the consumers) have been relocated to a different module in trunk.
was (Author: oching):
I checked the codes of the classes that were changed in the fix I committed, they're mostly similar in 1.3.x and trunk. But we can't directly merge the changes using {{svn merge -c ...}} because some of the classes (like the {{IndexingTaskExecutor}} and the consumers) have been relocated to a different module.
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.4
>
> Attachments: MRM-1097.patch
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Ben Lidgey (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=177100#action_177100 ]
Ben Lidgey commented on MRM-1097:
---------------------------------
We get this happening on almost a daily basis running Archiva 1.2 on Tomcat 5.5.17.
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.2.2
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Brett Porter (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=244503#action_244503 ]
Brett Porter commented on MRM-1097:
-----------------------------------
would this be able to be applied to 1.3.x cleanly? I'd like to get a 1.4 out soon, but it'd be nice to address some of the key performance concerns in 1.3.x if this helps.
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.4
>
> Attachments: MRM-1097.patch
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Lou S (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=170852#action_170852 ]
Lou S commented on MRM-1097:
----------------------------
We only have one environment to test right now but I could certainly give it a try when a GA release is available.
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.2.1
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Manfred Schürhoff (JIRA)" <ji...@codehaus.org>.
[ https://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=277477#comment-277477 ]
Manfred Schürhoff commented on MRM-1097:
----------------------------------------
Hi,
We're running Archiva 1.3.5 under Tomcat 7.0.4. We still run into the issue of "Too many open files" when running. We cleared out the local tomcat m2 repository, and while running a build, soon we get this error.
We've also updated the /etc/security/limits.conf file for the tomcat user to:
tomcat soft nofile 65535
tomcat hard nofile 65535
but without any luck.
Is there any solution to this issue?
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: https://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Assignee: Maria Odea Ching
> Fix For: 1.3.3
>
> Attachments: MRM-1097.patch
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Steve Pugh (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=212389#action_212389 ]
Steve Pugh commented on MRM-1097:
---------------------------------
We also get this. Our max filehandles is set to the default 1024.
At the time the error was occuring, I did a
ls -l /proc/PROCESSID/fd/
and confirmed there were 1024 filehandles. It also showed that vast majority of these were sockets.
So then I looked at the outgoing connections for this process using netstat.
I found there were about 800 connections stuck in CLOSE_WAIT state. These were connections to addresses of the external repositories we have configured in archiva. Could it be possible that these connections are not not being closed correctly in certain circumstances?
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.4
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Maria Odea Ching (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=244516#action_244516 ]
Maria Odea Ching commented on MRM-1097:
---------------------------------------
I checked the codes of the classes that were changed in the fix I committed, they're mostly similar in 1.3.x and trunk. But we can't directly merge the changes using {{svn merge -c ...}} because some of the classes (like the {{IndexingTaskExecutor}} and the consumers) have been relocated to a different module.
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.4
>
> Attachments: MRM-1097.patch
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Issue Comment Edited: (MRM-1097) Error 500 "too many open
files"
Posted by "Steve Pugh (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=212389#action_212389 ]
Steve Pugh edited comment on MRM-1097 at 3/4/10 5:53 AM:
---------------------------------------------------------
We also get this. Our max filehandles is set to the default 1024.
At the time the error was occuring, I did a
ls -l /proc/PROCESSID/fd/
and confirmed there were 1024 filehandles. It also showed that vast majority of these were sockets.
So then I looked at the outgoing connections for this process using netstat.
I found there were about 800 connections stuck in CLOSE_WAIT state. These were connections to addresses of the external repositories we have configured in archiva. Could it be possible that these connections are not not being closed correctly in certain circumstances?
(Additional info: Our archiva is embedded in tomcat 6.0.16)
was (Author: britsp):
We also get this. Our max filehandles is set to the default 1024.
At the time the error was occuring, I did a
ls -l /proc/PROCESSID/fd/
and confirmed there were 1024 filehandles. It also showed that vast majority of these were sockets.
So then I looked at the outgoing connections for this process using netstat.
I found there were about 800 connections stuck in CLOSE_WAIT state. These were connections to addresses of the external repositories we have configured in archiva. Could it be possible that these connections are not not being closed correctly in certain circumstances?
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.4
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (MRM-1097) Error 500 "too many open files"
Posted by "Brett Porter (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brett Porter updated MRM-1097:
------------------------------
Fix Version/s: (was: 1.2.1)
1.2.2
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.2.2
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Tim Fulmer (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=237037#action_237037 ]
Tim Fulmer commented on MRM-1097:
---------------------------------
This was passed to me after asking around about the "too many open files" our Archiva server gives after running about a week. Could this be what we're seeing?
http://coldfused.blogspot.com/2007/02/mystery-of-too-many-open-files.html
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.4
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Maria Odea Ching (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=237461#action_237461 ]
Maria Odea Ching commented on MRM-1097:
---------------------------------------
Here's the related community discussion:
http://old.nabble.com/MRM-1097---too-many-open-file-td29856351.html
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.4
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (MRM-1097) Error 500 "too many open files"
Posted by "Brett Porter (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brett Porter updated MRM-1097:
------------------------------
Fix Version/s: (was: 1.2-M2)
1.2
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.2
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Closed: (MRM-1097) Error 500 "too many open files"
Posted by "Brett Porter (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brett Porter closed MRM-1097.
-----------------------------
Resolution: Fixed
Assignee: Maria Odea Ching
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Assignee: Maria Odea Ching
> Fix For: 1.3.3
>
> Attachments: MRM-1097.patch
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (MRM-1097) Error 500 "too many open files"
Posted by "Maria Odea Ching (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Maria Odea Ching updated MRM-1097:
----------------------------------
Fix Version/s: (was: 1.3)
1.3.1
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.3.1
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (MRM-1097) Error 500 "too many open files"
Posted by "Brett Porter (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brett Porter updated MRM-1097:
------------------------------
Fix Version/s: (was: 1.4)
1.3.3
I'll try to backport the fix
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.3.3
>
> Attachments: MRM-1097.patch
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (MRM-1097) Error 500 "too many open files"
Posted by "Maria Catherine Tan (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Maria Catherine Tan updated MRM-1097:
-------------------------------------
Attachment: MRM-1097.patch
I found some streams that were not closed so I attached a patch for that.
I haven't reviewed the indexing part yet.
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.4
>
> Attachments: MRM-1097.patch
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Marc Lustig (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=167171#action_167171 ]
Marc Lustig commented on MRM-1097:
----------------------------------
I can only say the exception looks different.
But we seem to have fixed it on OS level.
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.2
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Brent N Atkinson (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=199883#action_199883 ]
Brent N Atkinson commented on MRM-1097:
---------------------------------------
Marc, are you using LDAP authentication/authorization when you experience this? I just patched my Archiva servers because they would halt when downloading a large number of artifacts. It turned out to be caused by LDAP connection leaks. I have fixed the leaks and can now download hundreds/thousands of artifacts without hitting the file descriptor limit. If you think you might be experiencing this, check out http://jira.codehaus.org/browse/REDBACK-185. I'll be submitting a patch soon.
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.3
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Maria Odea Ching (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=244416#action_244416 ]
Maria Odea Ching commented on MRM-1097:
---------------------------------------
I made some fixes for this in trunk [-r1039004|http://svn.apache.org/viewvc?revision=1039004&view=revision]. These are the changes:
* upgrade nexus indexer to 3.0.1 + added logger bean which is needed by NexusIndexer
* for deployments/proxied artifacts, create and close indexing context when indexing task is executed as compared to the original behavior where the indexing context is created before it is queued (so as the indexing task queue builds up, more indexing contexts are being opened/created which might be causing the too many open files problem)
* updated unit tests with changes made
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.4
>
> Attachments: MRM-1097.patch
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Brett Porter (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=240402#action_240402 ]
Brett Porter commented on MRM-1097:
-----------------------------------
Hi Marica,
I haven't looked closely, but the ones for the test might certainly speed them up.
The only relevant change I can see is the Checksum one, but that is closed by the caller of the update. Do you know if this makes a difference? Are you sure none of these cause something to be closed twice?
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.4
>
> Attachments: MRM-1097.patch
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Issue Comment Edited: (MRM-1097) Error 500 "too many open
files"
Posted by "Peter Lawrey (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=168560#action_168560 ]
Peter Lawrey edited comment on MRM-1097 at 3/9/09 5:27 AM:
-----------------------------------------------------------
Do you know when 1.2-M2 will be released so I can test this?
It is unusable as it is see MRM-1103. I can reproduce the error in under 1 minute.
BTW: I found that most of the fds left open were sockets rather than files. So hopefully this has been fixed too.
was (Author: peter_lawrey):
Do you know when 1.2-M2 will be released so I can test this?
It is unusable as it is see MRM-1103. I can reproduce the error in under 1 minute.
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.2-M2
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Andreyev Dias de Melo (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=237459#action_237459 ]
Andreyev Dias de Melo commented on MRM-1097:
--------------------------------------------
@Tim Fulmer I guess we are having this error too, but our error isn't the './././.' but indexer cfs deleted. We opened MRM-1419 to file it.
TIA!
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.4
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Brett Porter (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=170315#action_170315 ]
Brett Porter commented on MRM-1097:
-----------------------------------
I've been running HTTP requests from Maven, some that are proxying and hitting the web interface, and following along in dtrace and checking lsof - all the FDs are getting closed, and likewise the sockets. This is with trunk.
I'll try hitting this with hundreds of proxy requests at a time and see if that produces some results.
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.2-M2
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (MRM-1097) Error 500 "too many open files"
Posted by "Brett Porter (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brett Porter updated MRM-1097:
------------------------------
would you be able to test this with 1.2-M2 when it is released and see if it is still reproducible?
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.2
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Fredrik Jonson (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=191946#action_191946 ]
Fredrik Jonson commented on MRM-1097:
-------------------------------------
Marc, did you confirm that the "ulimit -n 10000" comand was successfully executed?
Normally the nofile hard limit, configured in /etc/security/limits.conf in most linux distributions, regulates how far ulimit may raise the limit on the current shell. Normally a ordinary user cannot raise the nofile limit beyond what is specified in limits.conf, and when nofile isn't explicitly specified there, the default is normally 1024.
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.2.3
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (MRM-1097) Error 500 "too many open files"
Posted by "Maria Odea Ching (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Maria Odea Ching updated MRM-1097:
----------------------------------
Fix Version/s: (was: 1.2)
1.2.1
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.2.1
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (MRM-1097) Error 500 "too many open files"
Posted by "Maria Odea Ching (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Maria Odea Ching updated MRM-1097:
----------------------------------
Fix Version/s: (was: 1.2.2)
1.2.3
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.2.3
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Brett Porter (JIRA)" <ji...@codehaus.org>.
[ https://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=277478#comment-277478 ]
Brett Porter commented on MRM-1097:
-----------------------------------
Manfred, it's probably best to pursue this through the users@ list, or a new issue if you have a way to reproduce it. This issue was about a specific thing that was fixed some time back, and we'll lose track of comments here since it is closed. Thanks!
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: https://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Assignee: Maria Odea Ching
> Fix For: 1.3.3
>
> Attachments: MRM-1097.patch
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Issue Comment Edited: (MRM-1097) Error 500 "too many open
files"
Posted by "Elie Delorme (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=263591#action_263591 ]
Elie Delorme edited comment on MRM-1097 at 4/14/11 10:27 AM:
-------------------------------------------------------------
I just received this error on our archiva standalone 1.3.4 installation which we upgraded hoping that it would resolve the problem.
The "Too many open files" appeared after only 3 hours uptime.
{noformat}
2011-04-13 20:55:22,444 [WrapperSimpleAppMain] INFO org.apache.maven.archiva.web.startup.Banner - _________________________
__________________________________
/\_ / \
/`/@), | On behalf of all of the alpacas |
| (~' __| toiling away on the Apache Archiva |
_,--.___/ | \ project team, I would like to |
,' , ( | \ welcome you to Archiva |
| ( \ / | 1.3.4 |
\ )\_/ ,_/ | |
/ / ( |/ | http://archiva.apache.org/ |
( | ( | | users@archiva.apache.org |
\| \| \__________________________________/
2011-04-14 00:09:43,639 [btpool0-8] WARN org.apache.maven.archiva.proxy.DefaultRepositoryProxyConnectors - Transfer error from repository "terracotta" for artifact org.hibernate:ejb3-persistence:1.0.2.GA::pom, continuing to next repository. Error message: Download failure on resource [http://www.terracotta.org/download/reflector/releases/org/hibernate/ejb3-persistence/1.0.2.GA/ejb3-persistence-1.0.2.GA.pom]:Error transferring file: Too many open files (cause: java.net.SocketException: Too many open files)
{noformat}
was (Author: edelorme):
I just received this error on our archiva 1.3.4 installation which we upgraded hoping that it would resolve the problem.
The "Too many open files" appeared after only 3 hours uptime.
{noformat}
2011-04-13 20:55:22,444 [WrapperSimpleAppMain] INFO org.apache.maven.archiva.web.startup.Banner - _________________________
__________________________________
/\_ / \
/`/@), | On behalf of all of the alpacas |
| (~' __| toiling away on the Apache Archiva |
_,--.___/ | \ project team, I would like to |
,' , ( | \ welcome you to Archiva |
| ( \ / | 1.3.4 |
\ )\_/ ,_/ | |
/ / ( |/ | http://archiva.apache.org/ |
( | ( | | users@archiva.apache.org |
\| \| \__________________________________/
2011-04-14 00:09:43,639 [btpool0-8] WARN org.apache.maven.archiva.proxy.DefaultRepositoryProxyConnectors - Transfer error from repository "terracotta" for artifact org.hibernate:ejb3-persistence:1.0.2.GA::pom, continuing to next repository. Error message: Download failure on resource [http://www.terracotta.org/download/reflector/releases/org/hibernate/ejb3-persistence/1.0.2.GA/ejb3-persistence-1.0.2.GA.pom]:Error transferring file: Too many open files (cause: java.net.SocketException: Too many open files)
{noformat}
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Assignee: Maria Odea Ching
> Fix For: 1.3.3
>
> Attachments: MRM-1097.patch
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Brett Porter (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=167155#action_167155 ]
Brett Porter commented on MRM-1097:
-----------------------------------
Marc, is it the same error as in MRM-1100?
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Brett Porter (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=212392#action_212392 ]
Brett Porter commented on MRM-1097:
-----------------------------------
thanks for the additional information. I believe we've checked that angle before, but I'll take another look.
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.4
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Marc Lustig (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=191947#action_191947 ]
Marc Lustig commented on MRM-1097:
----------------------------------
Hi Frederik,
I call the ulimit-command in the inetd-script, which is itself called by user root.
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.2.3
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (MRM-1097) Error 500 "too many open files"
Posted by "Brett Porter (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brett Porter updated MRM-1097:
------------------------------
Fix Version/s: 1.2
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.2
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Peter Lawrey (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=168560#action_168560 ]
Peter Lawrey commented on MRM-1097:
-----------------------------------
Do you know when 1.2-M2 will be released so I can test this?
It is unusable as it is see MRM-1103. I can reproduce the error in under 1 minute.
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.2-M2
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Gwen Harold Autencio (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=241374#action_241374 ]
Gwen Harold Autencio commented on MRM-1097:
-------------------------------------------
As I have checked, when doing a deployment on the repository while doing a repo scan on it.
I think archiva creates an IndexingContext for every file that is being added in the repository. Every IndexingContent may open streams for its IndexWriter and IndexReader.
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.4
>
> Attachments: MRM-1097.patch
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Maria Odea Ching (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=191933#action_191933 ]
Maria Odea Ching commented on MRM-1097:
---------------------------------------
Is this still persistent in the latest release (1.2.2)?
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.2.3
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Maria Odea Ching (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=242082#action_242082 ]
Maria Odea Ching commented on MRM-1097:
---------------------------------------
After reviewing the code for the repo scanning and indexing, these are the different scenarios where an indexing task may be executed:
* When a repository scan is triggered, the {{beginScan(..)}} method of all the repository consumers is called. The indexing context is created at the {{beginScan(..)}} method of the indexer-consumer, where the index reader/writer is opened. For each artifact being processed by the indexer-consumer, an indexing task is created and is queued in the {{ArchivaIndexingTaskExecutor}}, which calls the Nexus indexer engine and indexes the artifact. Once the repository scan is finished, the {{completeScan(..)}} method of all the repository consumers is called. The indexing context created at the start by the indexer-consumer will then be queued as an indexing task in the {{ArchivaIndexingTaskExecutor}}, but this time the task is for closing the context.
* For each artifact deployment and for each artifact fetched from the proxies, the {{RepositoryContentConsumers.executeConsumers(..)}} method is called. This method does the same thing as with the repository scanner where it calls the {{beginScan(..)}} method of all repo consumers then processes the deployed/proxied artifact and then calls the {{completeScan(..)}} method. This means that an indexing context is created for every deployed/proxied artifact, which in turn results to an open index reader/writer while the indexing task for the artifact is still queued.
* It's also possible that a repo scanning may have already finished, but the indexing tasks for the artifacts in the repo are still queued. This means that the indexing context is still open because it would only be closed once all the indexing tasks for the artifacts in the repo have finished executing. Since the repo scanning has finished, a user would be able to trigger another repository scan or the repo scanning schedule would fire and execute again, thereby creating and opening another indexing context.
If these three scenarios happen at the same time, especially when the repository being scanned is a large one, the "Too many open files" is bound to happen.
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.4
>
> Attachments: MRM-1097.patch
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (MRM-1097) Error 500 "too many open files"
Posted by "Maria Odea Ching (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Maria Odea Ching updated MRM-1097:
----------------------------------
Fix Version/s: (was: 1.2.3)
1.3
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.3
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Marc Lustig (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=199912#action_199912 ]
Marc Lustig commented on MRM-1097:
----------------------------------
Hi Brent, we did not use LDAP authentication.
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.3
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MRM-1097) Error 500 "too many open files"
Posted by "Lou S (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=168569#action_168569 ]
Lou S commented on MRM-1097:
----------------------------
Can you elaborate on the OS fix? We have the same issue but what we did was crank up our FDs to 65K and it has seemed to gone away presumably because it gives Archiva more space to breath. We also changed the Apache socket timeout in front of our Archiva servers from 0 (never) to 30 minutes. The former seems a bit much considering the default is 1024 on RHEL. Thoughts?
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.2-M2
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (MRM-1097) Error 500 "too many open files"
Posted by "Brett Porter (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MRM-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brett Porter updated MRM-1097:
------------------------------
Fix Version/s: (was: 1.2)
1.2-M2
> Error 500 "too many open files"
> -------------------------------
>
> Key: MRM-1097
> URL: http://jira.codehaus.org/browse/MRM-1097
> Project: Archiva
> Issue Type: Bug
> Components: system
> Affects Versions: 1.1.3
> Environment: Linux RedHat, Tomcat 6 + Native Connector
> Reporter: Marc Lustig
> Fix For: 1.2-M2
>
>
> In our start-script we have configured "ulimit -n 10000"
> But still, occassionally we get http error 500 "java.io.FileNotFoundException ... (Too many open files)" on a Maven-artifact-request.
> I suppose the files are not properly closed after they are delivered.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira