You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nifi.apache.org by Rajesh Biswas <ra...@bridgera.com> on 2018/06/14 19:07:01 UTC
TCP Connection Limit Error
Hello Team,
We are using TCP Processor to receive input from external systems.
We are frequently receiving max connection timeout exception
We feel the number of configured connections are more than our requirements.
Is there any way to monitor the open connections.
How we can know that open connections are not closed after data is received
from external systems?
The NiFi version is 0.6.1
Please find the log file for the reference
Exception:
Rejecting connection from /162.244.250.137:25558 because max connections has
been met
Attached log file and processor properties
Thanks and Regards,
Rajesh Biswas | +91 9886433461 | <http://www.bridgera.com/>
www.bridgera.com
<https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai
gn=sig-email&utm_content=emailclient>
Virus-free.
<https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai
gn=sig-email&utm_content=emailclient> www.avast.com
---
This email has been checked for viruses by Avast antivirus software.
https://www.avast.com/antivirus
Re: TCP Connection Limit Error
Posted by Bryan Bende <bb...@gmail.com>.
I don’t remember any specific bugs around the connection handling on NiFi
side, but since there have been quite a few release since 0.6.1, it
wouldn’t hurt to try upgrading.
On Thu, Jun 14, 2018 at 3:26 PM Rajesh Biswas <ra...@bridgera.com>
wrote:
> Hello Bryan,
>
> Thank you very much for your response.
>
> We thoroughly checked the client piece of the code about managing the
> opened connection.
>
> TCP Processor feeds the incoming data into Kafka Queue to inject the data
> into our system.
>
> Do you suggest is there any known issue in NiFi (0.6.1) version, do you
> suggest upgrade the version may solve this issue?
>
>
>
> Thanks and Regards,
>
> *Rajesh Biswas* | +91 9886433461 | www.bridgera.com
>
>
>
> *From:* Bryan Bende [mailto:bbende@gmail.com]
> *Sent:* Friday, June 15, 2018 12:50 AM
> *To:* users@nifi.apache.org
> *Cc:* dev@nifi.apache.org
> *Subject:* Re: TCP Connection Limit Error
>
>
>
> Hello,
>
>
>
> There is a counter that is incremented when a connection is opened, and
> decremented when it is closed. When this counter exceeds the number
> configured in the processor, then it rejects the connection with the
> message you are seeing. Since you have the max connections set to 1000,
> there must be over 1000 connections being opened.
>
>
>
> You could probably use something like nestat or some other networking
> monitoring utility to see what connections are open. Also may want to look
> into whatever the source of the connections is to see how it is opening and
> closing connections.
>
>
>
> Thanks,
>
>
>
> Bryan
>
>
>
> On Thu, Jun 14, 2018 at 3:07 PM Rajesh Biswas <ra...@bridgera.com>
> wrote:
>
> Hello Team,
>
> We are using TCP Processor to receive input from external systems.
>
> We are frequently receiving max connection timeout exception
>
> We feel the number of configured connections are more than our
> requirements.
>
> Is there any way to monitor the open connections.
>
> How we can know that open connections are not closed after data is
> received from external systems?
>
> The NiFi version is 0.6.1
>
> Please find the log file for the reference
>
>
>
> Exception:
>
> Rejecting connection from /162.244.250.137:25558 because max connections
> has been met
>
>
>
> Attached log file and processor properties
>
>
>
>
>
> Thanks and Regards,
>
> *Rajesh Biswas* | +91 9886433461 | www.bridgera.com
>
>
>
>
>
>
> <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient>
>
> Virus-free. www.avast.com
> <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient>
>
>
>
> --
>
> Sent from Gmail Mobile
>
--
Sent from Gmail Mobile
Re: TCP Connection Limit Error
Posted by Bryan Bende <bb...@gmail.com>.
I don’t remember any specific bugs around the connection handling on NiFi
side, but since there have been quite a few release since 0.6.1, it
wouldn’t hurt to try upgrading.
On Thu, Jun 14, 2018 at 3:26 PM Rajesh Biswas <ra...@bridgera.com>
wrote:
> Hello Bryan,
>
> Thank you very much for your response.
>
> We thoroughly checked the client piece of the code about managing the
> opened connection.
>
> TCP Processor feeds the incoming data into Kafka Queue to inject the data
> into our system.
>
> Do you suggest is there any known issue in NiFi (0.6.1) version, do you
> suggest upgrade the version may solve this issue?
>
>
>
> Thanks and Regards,
>
> *Rajesh Biswas* | +91 9886433461 | www.bridgera.com
>
>
>
> *From:* Bryan Bende [mailto:bbende@gmail.com]
> *Sent:* Friday, June 15, 2018 12:50 AM
> *To:* users@nifi.apache.org
> *Cc:* dev@nifi.apache.org
> *Subject:* Re: TCP Connection Limit Error
>
>
>
> Hello,
>
>
>
> There is a counter that is incremented when a connection is opened, and
> decremented when it is closed. When this counter exceeds the number
> configured in the processor, then it rejects the connection with the
> message you are seeing. Since you have the max connections set to 1000,
> there must be over 1000 connections being opened.
>
>
>
> You could probably use something like nestat or some other networking
> monitoring utility to see what connections are open. Also may want to look
> into whatever the source of the connections is to see how it is opening and
> closing connections.
>
>
>
> Thanks,
>
>
>
> Bryan
>
>
>
> On Thu, Jun 14, 2018 at 3:07 PM Rajesh Biswas <ra...@bridgera.com>
> wrote:
>
> Hello Team,
>
> We are using TCP Processor to receive input from external systems.
>
> We are frequently receiving max connection timeout exception
>
> We feel the number of configured connections are more than our
> requirements.
>
> Is there any way to monitor the open connections.
>
> How we can know that open connections are not closed after data is
> received from external systems?
>
> The NiFi version is 0.6.1
>
> Please find the log file for the reference
>
>
>
> Exception:
>
> Rejecting connection from /162.244.250.137:25558 because max connections
> has been met
>
>
>
> Attached log file and processor properties
>
>
>
>
>
> Thanks and Regards,
>
> *Rajesh Biswas* | +91 9886433461 | www.bridgera.com
>
>
>
>
>
>
> <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient>
>
> Virus-free. www.avast.com
> <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient>
>
>
>
> --
>
> Sent from Gmail Mobile
>
--
Sent from Gmail Mobile
RE: TCP Connection Limit Error
Posted by Rajesh Biswas <ra...@bridgera.com>.
Hello Bryan,
Thank you very much for your response.
We thoroughly checked the client piece of the code about managing the opened connection.
TCP Processor feeds the incoming data into Kafka Queue to inject the data into our system.
Do you suggest is there any known issue in NiFi (0.6.1) version, do you suggest upgrade the version may solve this issue?
Thanks and Regards,
Rajesh Biswas | +91 9886433461 | <http://www.bridgera.com/> www.bridgera.com
From: Bryan Bende [mailto:bbende@gmail.com]
Sent: Friday, June 15, 2018 12:50 AM
To: users@nifi.apache.org
Cc: dev@nifi.apache.org
Subject: Re: TCP Connection Limit Error
Hello,
There is a counter that is incremented when a connection is opened, and decremented when it is closed. When this counter exceeds the number configured in the processor, then it rejects the connection with the message you are seeing. Since you have the max connections set to 1000, there must be over 1000 connections being opened.
You could probably use something like nestat or some other networking monitoring utility to see what connections are open. Also may want to look into whatever the source of the connections is to see how it is opening and closing connections.
Thanks,
Bryan
On Thu, Jun 14, 2018 at 3:07 PM Rajesh Biswas <ra...@bridgera.com> wrote:
Hello Team,
We are using TCP Processor to receive input from external systems.
We are frequently receiving max connection timeout exception
We feel the number of configured connections are more than our requirements.
Is there any way to monitor the open connections.
How we can know that open connections are not closed after data is received from external systems?
The NiFi version is 0.6.1
Please find the log file for the reference
Exception:
Rejecting connection from /162.244.250.137:25558 because max connections has been met
Attached log file and processor properties
Thanks and Regards,
Rajesh Biswas | +91 9886433461 | <http://www.bridgera.com/> www.bridgera.com
<https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient>
Virus-free. <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient> www.avast.com
--
Sent from Gmail Mobile
---
This email has been checked for viruses by Avast antivirus software.
https://www.avast.com/antivirus
RE: TCP Connection Limit Error
Posted by Rajesh Biswas <ra...@bridgera.com>.
Hello Bryan,
Thank you very much for your response.
We thoroughly checked the client piece of the code about managing the opened connection.
TCP Processor feeds the incoming data into Kafka Queue to inject the data into our system.
Do you suggest is there any known issue in NiFi (0.6.1) version, do you suggest upgrade the version may solve this issue?
Thanks and Regards,
Rajesh Biswas | +91 9886433461 | <http://www.bridgera.com/> www.bridgera.com
From: Bryan Bende [mailto:bbende@gmail.com]
Sent: Friday, June 15, 2018 12:50 AM
To: users@nifi.apache.org
Cc: dev@nifi.apache.org
Subject: Re: TCP Connection Limit Error
Hello,
There is a counter that is incremented when a connection is opened, and decremented when it is closed. When this counter exceeds the number configured in the processor, then it rejects the connection with the message you are seeing. Since you have the max connections set to 1000, there must be over 1000 connections being opened.
You could probably use something like nestat or some other networking monitoring utility to see what connections are open. Also may want to look into whatever the source of the connections is to see how it is opening and closing connections.
Thanks,
Bryan
On Thu, Jun 14, 2018 at 3:07 PM Rajesh Biswas <ra...@bridgera.com> wrote:
Hello Team,
We are using TCP Processor to receive input from external systems.
We are frequently receiving max connection timeout exception
We feel the number of configured connections are more than our requirements.
Is there any way to monitor the open connections.
How we can know that open connections are not closed after data is received from external systems?
The NiFi version is 0.6.1
Please find the log file for the reference
Exception:
Rejecting connection from /162.244.250.137:25558 because max connections has been met
Attached log file and processor properties
Thanks and Regards,
Rajesh Biswas | +91 9886433461 | <http://www.bridgera.com/> www.bridgera.com
<https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient>
Virus-free. <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient> www.avast.com
--
Sent from Gmail Mobile
---
This email has been checked for viruses by Avast antivirus software.
https://www.avast.com/antivirus
Re: TCP Connection Limit Error
Posted by Bryan Bende <bb...@gmail.com>.
Hello,
There is a counter that is incremented when a connection is opened, and
decremented when it is closed. When this counter exceeds the number
configured in the processor, then it rejects the connection with the
message you are seeing. Since you have the max connections set to 1000,
there must be over 1000 connections being opened.
You could probably use something like nestat or some other networking
monitoring utility to see what connections are open. Also may want to look
into whatever the source of the connections is to see how it is opening and
closing connections.
Thanks,
Bryan
On Thu, Jun 14, 2018 at 3:07 PM Rajesh Biswas <ra...@bridgera.com>
wrote:
> Hello Team,
>
> We are using TCP Processor to receive input from external systems.
>
> We are frequently receiving max connection timeout exception
>
> We feel the number of configured connections are more than our
> requirements.
>
> Is there any way to monitor the open connections.
>
> How we can know that open connections are not closed after data is
> received from external systems?
>
> The NiFi version is 0.6.1
>
> Please find the log file for the reference
>
>
>
> Exception:
>
> Rejecting connection from /162.244.250.137:25558 because max connections
> has been met
>
>
>
> Attached log file and processor properties
>
>
>
>
>
> Thanks and Regards,
>
> *Rajesh Biswas* | +91 9886433461 | www.bridgera.com
>
>
>
>
>
>
> <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient>
>
> Virus-free. www.avast.com
> <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient>
>
>
>
--
Sent from Gmail Mobile
Re: TCP Connection Limit Error
Posted by Bryan Bende <bb...@gmail.com>.
Hello,
There is a counter that is incremented when a connection is opened, and
decremented when it is closed. When this counter exceeds the number
configured in the processor, then it rejects the connection with the
message you are seeing. Since you have the max connections set to 1000,
there must be over 1000 connections being opened.
You could probably use something like nestat or some other networking
monitoring utility to see what connections are open. Also may want to look
into whatever the source of the connections is to see how it is opening and
closing connections.
Thanks,
Bryan
On Thu, Jun 14, 2018 at 3:07 PM Rajesh Biswas <ra...@bridgera.com>
wrote:
> Hello Team,
>
> We are using TCP Processor to receive input from external systems.
>
> We are frequently receiving max connection timeout exception
>
> We feel the number of configured connections are more than our
> requirements.
>
> Is there any way to monitor the open connections.
>
> How we can know that open connections are not closed after data is
> received from external systems?
>
> The NiFi version is 0.6.1
>
> Please find the log file for the reference
>
>
>
> Exception:
>
> Rejecting connection from /162.244.250.137:25558 because max connections
> has been met
>
>
>
> Attached log file and processor properties
>
>
>
>
>
> Thanks and Regards,
>
> *Rajesh Biswas* | +91 9886433461 | www.bridgera.com
>
>
>
>
>
>
> <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient>
>
> Virus-free. www.avast.com
> <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient>
>
>
>
--
Sent from Gmail Mobile