You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@storm.apache.org by "Robert Joseph Evans (JIRA)" <ji...@apache.org> on 2014/03/04 18:17:24 UTC

[jira] [Commented] (STORM-250) Storm UI: Too many open files

    [ https://issues.apache.org/jira/browse/STORM-250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13919642#comment-13919642 ] 

Robert Joseph Evans commented on STORM-250:
-------------------------------------------

When this is happening have you checked to see where all of the file handles are being used?  you can run sudo lsof -p PID and look to see what is taking all of the file handles.  There might be a leak somewhere in there that we need to deal with.  If all of them look normal boosting the open file limit seems reasonable.  1024 is a good limit for most things, but a heavily used web server often will need more then that. 

> Storm UI: Too many open files
> -----------------------------
>
>                 Key: STORM-250
>                 URL: https://issues.apache.org/jira/browse/STORM-250
>             Project: Apache Storm (Incubating)
>          Issue Type: Bug
>         Environment: # cat /etc/redhat-release 
> CentOS release 6.2 (Final)
> # uname -a
> Linux {{redacted}} 2.6.32-220.el6.x86_64 #1 SMP Tue Dec 6 19:48:22 GMT 2011 x86_64 x86_64 x86_64 GNU/Linux
> # ulimit -a
> core file size          (blocks, -c) 0
> data seg size           (kbytes, -d) unlimited
> scheduling priority             (-e) 0
> file size               (blocks, -f) unlimited
> pending signals                 (-i) 30514
> max locked memory       (kbytes, -l) 64
> max memory size         (kbytes, -m) unlimited
> open files                      (-n) 1024
> pipe size            (512 bytes, -p) 8
> POSIX message queues     (bytes, -q) 819200
> real-time priority              (-r) 0
> stack size              (kbytes, -s) 10240
> cpu time               (seconds, -t) unlimited
> max user processes              (-u) 1024
> virtual memory          (kbytes, -v) unlimited
> file locks                      (-x) unlimited
>            Reporter: Vito Laurenza
>            Priority: Minor
>              Labels: storm, ui
>
> Occasionally, the ui daemon runs out of available file handles and can't open a socket to the nimbus:
> # grep -A1 ERROR ui.log 
> 2014-02-28 07:44:14 o.a.t.t.TSocket [ERROR] Could not configure socket.
> java.net.SocketException: Too many open files
> --
> 2014-03-01 16:44:10 o.a.t.t.TSocket [ERROR] Could not configure socket.
> java.net.SocketException: Too many open files
> --
> 2014-03-03 01:29:04 o.a.t.t.TSocket [ERROR] Could not configure socket.
> java.net.SocketException: Too many open files
> --
> 2014-03-03 01:34:04 o.a.t.t.TSocket [ERROR] Could not configure socket.
> java.net.SocketException: Too many open files
> --
> 2014-03-04 09:39:01 o.a.t.t.TSocket [ERROR] Could not configure socket.
> java.net.SocketException: Too many open files
> --
> 2014-03-04 09:45:33 o.a.t.t.TSocket [ERROR] Could not configure socket.
> java.net.SocketException: Too many open files



--
This message was sent by Atlassian JIRA
(v6.2#6252)