You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@nifi.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2016/01/20 15:14:40 UTC
[jira] [Commented] (NIFI-1414) TailFile can cause Too Many Open
Files if Rolling Filename Pattern used
[ https://issues.apache.org/jira/browse/NIFI-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15108602#comment-15108602 ]
ASF subversion and git services commented on NIFI-1414:
-------------------------------------------------------
Commit 7ef8af9eeadbb3a94fbc1dbcea5a7cb9704d9b63 in nifi's branch refs/heads/NIFI-259 from [~markap14]
[ https://git-wip-us.apache.org/repos/asf?p=nifi.git;h=7ef8af9 ]
NIFI-259: Applied patch for NIFI-1414
> TailFile can cause Too Many Open Files if Rolling Filename Pattern used
> -----------------------------------------------------------------------
>
> Key: NIFI-1414
> URL: https://issues.apache.org/jira/browse/NIFI-1414
> Project: Apache NiFi
> Issue Type: Bug
> Components: Extensions
> Reporter: Mark Payne
> Assignee: Mark Payne
> Fix For: 0.5.0
>
> Attachments: 0001-NIFI-1414-Ensure-that-the-DirectoryStream-is-closed-.patch
>
>
> When using the TailFile processor, if the Rolling Filename Pattern is set, the Processor does not appear to properly close the file handles that it creates for the directory. As a result, if the Processor runs long enough, we start to see "IOException: Too many open files", which causes a lot of problems and requires a restart of NiFi.
> Performing an "lsof" while running TailFile to tail the logs in my logs directory results in 10's of thousands of entries like:
> java 14549 ec2-user *703r DIR 202,1 4096 787749 /opt/nifi/nifi-0.4.2-SNAPSHOT/logs
> java 14549 ec2-user *704r DIR 202,1 4096 787749 /opt/nifi/nifi-0.4.2-SNAPSHOT/logs
> java 14549 ec2-user *705r DIR 202,1 4096 787749 /opt/nifi/nifi-0.4.2-SNAPSHOT/logs
> java 14549 ec2-user *706r DIR 202,1 4096 787749 /opt/nifi/nifi-0.4.2-SNAPSHOT/logs
> java 14549 ec2-user *707r DIR 202,1 4096 787749 /opt/nifi/nifi-0.4.2-SNAPSHOT/logs
> java 14549 ec2-user *708r DIR 202,1 4096 787749 /opt/nifi/nifi-0.4.2-SNAPSHOT/logs
> java 14549 ec2-user *709r DIR 202,1 4096 787749 /opt/nifi/nifi-0.4.2-SNAPSHOT/logs
> java 14549 ec2-user *710r DIR 202,1 4096 787749 /opt/nifi/nifi-0.4.2-SNAPSHOT/logs
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)