You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Elli Schwarz (Jira)" <ji...@apache.org> on 2020/02/27 14:43:00 UTC
[jira] [Comment Edited] (NIFI-7200) IPv4 socket resource leak
[ https://issues.apache.org/jira/browse/NIFI-7200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17046674#comment-17046674 ]
Elli Schwarz edited comment on NIFI-7200 at 2/27/20 2:42 PM:
-------------------------------------------------------------
[~joewitt] Thank you for continuing to help us with this issue. We are not using a Nifi cluster.
Java version output: OpenJdk 64-Bit Server VM (build *25.242-b08*, mixed mode)
Running *CentOS Linux 7.7.1908*, kernel *3.10.0* Nifi version: *1.11.0* and our nifi.remote.input.socket.port=8444, and nifi.remote.input.http.enabled=false
When we used Nifi 1.9.2 we did not have this "open files" issue but we were forced to upgrade Nifi when our system automatically upgraded Java from 1.8.0_232, because of NIFI-5952; after the Nifi upgrade to 1.11.0 we started experiencing this "open files" issue. I don't have any DistributedMapCacheClientService running on this box.
We have a lot of site-to-site activity to and from this box. We have 15 running remote input ports, and 2 remote output ports. We have 12 "Transmitting" remote process groups.
Current LSOF output running lsof -p <pid>| tr -s " " | cut -d" " -f5 | sort | uniq -c
{{...}}
{{11 FIFO}}
{{18000 IPv4}}
{{9246 REG}}
{{...}}
We currently have *17,670 lines* from *lsof* with output similar to the following:
{{... IPv4 ... ... TCP <url1>:<port> -> <url2>:pcsyn-http (CLOSE_WAIT)}}
where <url1> is the public IP of the Nifi server I'm running this on, and <url2> is the url set in a remote process group we use to receive data from the Nifi on <url2>.
Just checked again after about 20 minutes, and we now are up to *18,034* lsof lines as above - and I'm still watching this number grow every few minutes!
Output from netstat -nap |grep <pid> |wc -l is *18,152* for the following line:
{{tcp ... <private ip of url1> <url2>:8444 CLOSE_WAIT <pid>/java}}
I hope this info gives you some more insight! Thank you very much for looking in to this issue.
was (Author: ezs):
[~joewitt] Thank you for continuing to help us with this issue. We are not using a Nifi cluster.
Java version output: OpenJdk 64-Bit Server VM (build *25.242-b08*, mixed mode)
Running *CentOS Linux 7.7.1908*, kernel *3.10.0* Nifi version: *1.11.0* and our nifi.remote.input.socket.port=8444, and nifi.remote.input.http.enabled=false
When we used Nifi 1.9.2 we did not have this "open files" issue but we were forced to upgrade Nifi when our system automatically upgraded Java from 1.8.0_232, because of NIFI-5952; after the Nifi upgrade to 1.11.0 we started experiencing this "open files" issue. I don't have any DistributedMapCacheClientService running on this box.
We have a lot of site-to-site activity to and from this box. We have 15 running remote input ports, and 2 remote output ports. We have 12 "Transmitting" remote process groups.
Current LSOF output running lsof -p <pid>| tr -s " " | cut -d" " -f5 | sort | uniq -c
{{...}}
{{11 FIFO}}
{{18000 IPv4}}
{{9246 REG}}
{{...}}
We currently have *17,670 lines* from *lsof* with output similar to the following:
{{... IPv4 ... ... TCP <url1>:<port> -> <url2>:pcsyn-http (CLOSE_WAIT)}}
where <url1> is the public IP of the Nifi server I'm running this on, and <url2> is the url set in a remote process group we use to receive data from the Nifi on <url2>.
Just checked again after about 20 minutes, and we now are up to *18,034* lsof lines as above - and I'm still watching this number grow every few minutes!
Output from netstat -nap |grep <pid> |wc -l is *18,152* for the following line:
{{tcp ... <private ip of url1> <url2>:8444 CLOSE_WAIT <pid>/java}}
I hope this info gives you some more insight! Thank you very much for looking in to this issue.
> IPv4 socket resource leak
> -------------------------
>
> Key: NIFI-7200
> URL: https://issues.apache.org/jira/browse/NIFI-7200
> Project: Apache NiFi
> Issue Type: Bug
> Reporter: Joe Witt
> Priority: Critical
>
> https://issues.apache.org/jira/browse/NIFI-7114?focusedCommentId=17044888&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17044888
--
This message was sent by Atlassian Jira
(v8.3.4#803005)