You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@nifi.apache.org by "Paul Verardi (JIRA)" <ji...@apache.org> on 2019/07/01 12:46:00 UTC

[jira] [Commented] (MINIFI-498) C2 Server Error - Too Many Open Files

    [ https://issues.apache.org/jira/browse/MINIFI-498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16876161#comment-16876161 ] 

Paul Verardi commented on MINIFI-498:
-------------------------------------

[~aldrin] is there any update or further investigation into this issue, we are now up to a total of 13 unique classes and the issue is now occurring more frequently than just once a day.

> C2 Server Error - Too Many Open Files
> -------------------------------------
>
>                 Key: MINIFI-498
>                 URL: https://issues.apache.org/jira/browse/MINIFI-498
>             Project: Apache NiFi MiNiFi
>          Issue Type: Bug
>          Components: Command and Control
>    Affects Versions: 0.5.0
>         Environment: OS: Amazon Linux 2 (4.14.77-86.82.amzn2.x86_64)
> Java: 1.8.0_191-b12
> ulimits:
> core file size (blocks, -c) 0
> data seg size (kbytes, -d) unlimited
> scheduling priority (-e) 0
> file size (blocks, -f) unlimited
> pending signals (-i) 31769
> max locked memory (kbytes, -l) 64
> max memory size (kbytes, -m) unlimited
> open files (-n) 50000
> pipe size (512 bytes, -p) 8
> POSIX message queues (bytes, -q) 819200
> real-time priority (-r) 0
> stack size (kbytes, -s) 8192
> cpu time (seconds, -t) unlimited
> max user processes (-u) 10000
> virtual memory (kbytes, -v) unlimited
> file locks (-x) unlimited
>            Reporter: Michael
>            Assignee: Aldrin Piri
>            Priority: Blocker
>             Fix For: 0.6.0
>
>
> After several days of running C2 the errors are being logged about having "Too Many Open Files". At this point, C2 is not responsive to clients trying to check for new configurations.
> _33e79e: Too many open files_
> _Apr 29 14:33:22 ********ec2.internal c2.sh[20851]: Caused by: java.nio.file.FileSystemException: /opt/minifi-c2/./files/5233730D-AC58-4853-9C0E-273D0E_
>  
> Running _lsof_ shows an increasingly larger number of open files. Our MiNiFi instances are checking for new files every few seconds (probably too short), but it seems like maybe some file handles are not being cleaned up.
> Restarting C2 clears up this condition and C2 becomes responsive again.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)