[jira] [Commented] (NIFI-1035) AbstractKiteProcessor.getSchema leaks file handles

["Joseph Witt (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/NIFI-1035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14953893#comment-14953893 ] 

Joseph Witt commented on NIFI-1035:
-----------------------------------

alan - sounds like you found it via code which is good.  You can verify this for certain by doing 'lsof -p <pid>' and seeing how many of the file handles are associated with the schema reading (likely will be quite obvious).

Thanks
Joe

> AbstractKiteProcessor.getSchema leaks file handles
> --------------------------------------------------
>
>                 Key: NIFI-1035
>                 URL: https://issues.apache.org/jira/browse/NIFI-1035
>             Project: Apache NiFi
>          Issue Type: Bug
>    Affects Versions: 0.3.0
>            Reporter: Alan Jackoway
>
> We had NiFi nodes crash today with the dreaded too many open files error (similar to what I saw in NIFI-888).
> This time, the file handles were all connections to Datanodes in the CLOSE_WAIT status.
> The most recent thing I added to our pipeline were ConvertAvroSchema and ConvertJSONToAvro processors. I started looking there for a leak and I believe I found it in AbstractKiteProcessor.getSchema.
> Pull Request coming shortly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)