You are viewing a plain text version of this content. The canonical link for it is here.
Posted to infrastructure-issues@apache.org by "Tim Ellison (JIRA)" <ji...@apache.org> on 2007/06/04 17:10:35 UTC

[jira] Created: (INFRA-1263) Too many open files reported by JIRA

Too many open files reported by JIRA
------------------------------------

                 Key: INFRA-1263
                 URL: https://issues.apache.org/jira/browse/INFRA-1263
             Project: Infrastructure
          Issue Type: Bug
      Security Level: public (Regular issues)
          Components: JIRA
         Environment: Firefox2
            Reporter: Tim Ellison
            Priority: Minor


FYI

Got a 'too many open files' error trying to close an issue on JIRA at ~16:05BST Jun 04, 2007.  The action succeeded despite the error.


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-1263) Too many open files reported by JIRA

Posted by "Henri Yandell (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-1263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12501413 ] 

Henri Yandell commented on INFRA-1263:
--------------------------------------

Looks like it OutOfMemory'd quickly after that, so I've opened an issue with Atlassian Support (JSP-12966).

> Too many open files reported by JIRA
> ------------------------------------
>
>                 Key: INFRA-1263
>                 URL: https://issues.apache.org/jira/browse/INFRA-1263
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: JIRA
>         Environment: Firefox2
>            Reporter: Tim Ellison
>            Priority: Minor
>         Attachments: jira.jpg
>
>
> FYI
> Got a 'too many open files' error trying to close an issue on JIRA at ~16:05BST Jun 04, 2007.  The action succeeded despite the error.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (INFRA-1263) Too many open files reported by JIRA

Posted by "Tim Ellison (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/INFRA-1263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tim Ellison updated INFRA-1263:
-------------------------------

    Attachment: jira.jpg

> Too many open files reported by JIRA
> ------------------------------------
>
>                 Key: INFRA-1263
>                 URL: https://issues.apache.org/jira/browse/INFRA-1263
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: JIRA
>         Environment: Firefox2
>            Reporter: Tim Ellison
>            Priority: Minor
>         Attachments: jira.jpg
>
>
> FYI
> Got a 'too many open files' error trying to close an issue on JIRA at ~16:05BST Jun 04, 2007.  The action succeeded despite the error.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (INFRA-1263) Too many open files reported by JIRA

Posted by "Jeff Turner (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/INFRA-1263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jeff Turner resolved INFRA-1263.
--------------------------------

    Resolution: Fixed

I think these were caused by crawlers issuing huge (36Mb) searches. JIRA now has a limit on the number of issues returned, which should prevent this recurring.

> Too many open files reported by JIRA
> ------------------------------------
>
>                 Key: INFRA-1263
>                 URL: https://issues.apache.org/jira/browse/INFRA-1263
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: JIRA
>         Environment: Firefox2
>            Reporter: Tim Ellison
>            Assignee: Jeff Turner
>            Priority: Minor
>         Attachments: jira.jpg
>
>
> FYI
> Got a 'too many open files' error trying to close an issue on JIRA at ~16:05BST Jun 04, 2007.  The action succeeded despite the error.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-1263) Too many open files reported by JIRA

Posted by "Henri Yandell (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-1263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12510943 ] 

Henri Yandell commented on INFRA-1263:
--------------------------------------

It OOM'd again a week or two ago; but the log files were gigs in size and I didn't want us running out of diskspace so had to delete them.

> Too many open files reported by JIRA
> ------------------------------------
>
>                 Key: INFRA-1263
>                 URL: https://issues.apache.org/jira/browse/INFRA-1263
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: JIRA
>         Environment: Firefox2
>            Reporter: Tim Ellison
>            Assignee: Jeff Turner
>            Priority: Minor
>         Attachments: jira.jpg
>
>
> FYI
> Got a 'too many open files' error trying to close an issue on JIRA at ~16:05BST Jun 04, 2007.  The action succeeded despite the error.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (INFRA-1263) Too many open files reported by JIRA

Posted by "Jeff Turner (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/INFRA-1263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jeff Turner reassigned INFRA-1263:
----------------------------------

    Assignee: Jeff Turner

> Too many open files reported by JIRA
> ------------------------------------
>
>                 Key: INFRA-1263
>                 URL: https://issues.apache.org/jira/browse/INFRA-1263
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: JIRA
>         Environment: Firefox2
>            Reporter: Tim Ellison
>            Assignee: Jeff Turner
>            Priority: Minor
>         Attachments: jira.jpg
>
>
> FYI
> Got a 'too many open files' error trying to close an issue on JIRA at ~16:05BST Jun 04, 2007.  The action succeeded despite the error.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-1263) Too many open files reported by JIRA

Posted by "Henri Yandell (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-1263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12501693 ] 

Henri Yandell commented on INFRA-1263:
--------------------------------------

Would this have caused the OOM?

> Too many open files reported by JIRA
> ------------------------------------
>
>                 Key: INFRA-1263
>                 URL: https://issues.apache.org/jira/browse/INFRA-1263
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: JIRA
>         Environment: Firefox2
>            Reporter: Tim Ellison
>            Assignee: Jeff Turner
>            Priority: Minor
>         Attachments: jira.jpg
>
>
> FYI
> Got a 'too many open files' error trying to close an issue on JIRA at ~16:05BST Jun 04, 2007.  The action succeeded despite the error.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-1263) Too many open files reported by JIRA

Posted by "Jeff Turner (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-1263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12502277 ] 

Jeff Turner commented on INFRA-1263:
------------------------------------

Yes, whatever caused the "too many open files" error (SOAP queries it looks like) probably caused the OutOfMemoryError too. I assume those open files were Lucene index filehandles, and each Lucene search takes up memory.

I've turned on -XX:+HeapDumpOnOutOfMemoryError in /usr/local/tomcat/tomcat-jira/bin/setenv.sh, which will take effect on the next reboot, and do a memory dump so next time we can see what uses up all the memory.

> Too many open files reported by JIRA
> ------------------------------------
>
>                 Key: INFRA-1263
>                 URL: https://issues.apache.org/jira/browse/INFRA-1263
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: JIRA
>         Environment: Firefox2
>            Reporter: Tim Ellison
>            Assignee: Jeff Turner
>            Priority: Minor
>         Attachments: jira.jpg
>
>
> FYI
> Got a 'too many open files' error trying to close an issue on JIRA at ~16:05BST Jun 04, 2007.  The action succeeded despite the error.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (INFRA-1263) Too many open files reported by JIRA

Posted by "Jeff Turner (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/INFRA-1263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12501431 ] 

Jeff Turner commented on INFRA-1263:
------------------------------------

Thanks for letting us know. 'ulimit -n' is reporting 1024 on the server, and at the time this happened the server was being hit by lots of (concurrent) SOAP queries. I think JIRA just had more than 1024 file handles open to Lucene, the database and whatnot.

I've upped the limit to 2048 in /etc/security/limits.conf, and this will take effect when JIRA is next restarted.

> Too many open files reported by JIRA
> ------------------------------------
>
>                 Key: INFRA-1263
>                 URL: https://issues.apache.org/jira/browse/INFRA-1263
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: JIRA
>         Environment: Firefox2
>            Reporter: Tim Ellison
>            Priority: Minor
>         Attachments: jira.jpg
>
>
> FYI
> Got a 'too many open files' error trying to close an issue on JIRA at ~16:05BST Jun 04, 2007.  The action succeeded despite the error.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.