You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Jens M Kofoed (Jira)" <ji...@apache.org> on 2021/06/11 04:57:00 UTC
[jira] [Comment Edited] (NIFI-8643) Nifi 1.13.2 Cluster Load
balancer Does not Work Properly
[ https://issues.apache.org/jira/browse/NIFI-8643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17361394#comment-17361394 ]
Jens M Kofoed edited comment on NIFI-8643 at 6/11/21, 4:56 AM:
---------------------------------------------------------------
I have experience the same problem.
Installed NIFI 1.13.2, Java 8, Ubuntu 20.04
The issue is that the load balancer port 6342 is bind to localhost and not 0.0.0.0 and therefore is not open for connection from other nodes.
Output from netstat -l
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address Foreign Address State
tcp 0 0 [0.0.0.0:9090|http://0.0.0.0:9090/] 0.0.0.0:* LISTEN
tcp 0 0 [0.0.0.0:9443|http://0.0.0.0:9443/] 0.0.0.0:* LISTEN
{color:#ff0000}*tcp 0 0 localhost:6342 0.0.0.0:* LISTEN*{color}
tcp 0 0 localhost:42603 0.0.0.0:* LISTEN
tcp 0 0 0.0.0.0:ssh 0.0.0.0:* LISTEN
tcp 0 0 [node01.domain.com:8443|http://node01.domain.com:8443/] 0.0.0.0:* LISTEN
tcp6 0 0 localhost:42101 [::]:* LISTEN
tcp6 0 0 [::]:ssh [::]:* LISTEN
raw6 0 0 [::]:ipv6-icmp [::]:* 7
Part of my configuration is like this:
nifi.web.https.host=[node1.domain.com|http://node1.domain.com/]
nifi.web.https.port=8443
nifi.web.https.network.interface.default=ens192
nifi.cluster.is.node=true
nifi.cluster.node.address=[node01.domain.com|http://node01.domain.com/]
nifi.cluster.node.protocol.port=9443
nifi.cluster.node.protocol.threads=10
nifi.cluster.node.protocol.max.threads=50
nifi.cluster.node.event.history.size=25
nifi.cluster.node.connection.timeout=5 sec
nifi.cluster.node.read.timeout=5 sec
nifi.cluster.node.max.concurrent.requests=100
nifi.cluster.firewall.file=
nifi.cluster.flow.election.max.wait.time=5 mins
nifi.cluster.flow.election.max.candidates=3
cluster load balancing properties #
nifi.cluster.load.balance.host=[node01.domain.com|http://node01.domain.com/]
nifi.cluster.load.balance.port=6342
nifi.cluster.load.balance.connections.per.node=4
nifi.cluster.load.balance.max.thread.count=8
nifi.cluster.load.balance.comms.timeout=30 sec
was (Author: jmkofoed):
I have experience the same problem.
Installed NIFI 1.13.2, Java 8, Ubuntu 20.04
The issue is that the load balancer port 6342 is bind to localhost and not 0.0.0.0 and therefore is not open for connection from other nodes.
Output from netstat -l
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address Foreign Address State
tcp 0 0 [0.0.0.0:9090|http://0.0.0.0:9090/] 0.0.0.0:* LISTEN
tcp 0 0 [0.0.0.0:9443|http://0.0.0.0:9443/] 0.0.0.0:* LISTEN
{color:#ff0000}*tcp 0 0 localhost:6342 0.0.0.0:* LISTEN*{color}
tcp 0 0 localhost:42603 0.0.0.0:* LISTEN
tcp 0 0 0.0.0.0:ssh 0.0.0.0:* LISTEN
tcp 0 0 [node01.domain.com:8443|http://node01.domain.com:8443/] 0.0.0.0:* LISTEN
tcp6 0 0 localhost:42101 [::]:* LISTEN
tcp6 0 0 [::]:ssh [::]:* LISTEN
raw6 0 0 [::]:ipv6-icmp [::]:* 7
Part of my configuration is like this:
nifi.web.https.host=[node1.domain.com|http://node1.domain.com/]
nifi.web.https.port=8443
nifi.web.https.network.interface.default=ens192
nifi.cluster.is.node=true
nifi.cluster.node.address=[node01.domain.com|http://node01.domain.com/]
nifi.cluster.node.protocol.port=9443
nifi.cluster.node.protocol.threads=10
nifi.cluster.node.protocol.max.threads=50
nifi.cluster.node.event.history.size=25
nifi.cluster.node.connection.timeout=5 sec
nifi.cluster.node.read.timeout=5 sec
nifi.cluster.node.max.concurrent.requests=100
nifi.cluster.firewall.file=
nifi.cluster.flow.election.max.wait.time=5 mins
nifi.cluster.flow.election.max.candidates=3
# cluster load balancing properties #
nifi.cluster.load.balance.host=[node01.domain.com|http://node01.domain.com/]
nifi.cluster.load.balance.port=6342
nifi.cluster.load.balance.connections.per.node=4
nifi.cluster.load.balance.max.thread.count=8
nifi.cluster.load.balance.comms.timeout=30 sec
> Nifi 1.13.2 Cluster Load balancer Does not Work Properly
> ---------------------------------------------------------
>
> Key: NIFI-8643
> URL: https://issues.apache.org/jira/browse/NIFI-8643
> Project: Apache NiFi
> Issue Type: Bug
> Affects Versions: 1.13.2
> Environment: 3 node nifi cluster, installed in GCP Centos7 VM
> Reporter: Kristian Mojeno
> Priority: Major
> Fix For: 1.12.1
>
>
> I have upgraded from nifi version 1.12.1 to 1.13.2. After the upgrade, the cluster load balancer does not work properly and then flowfiles get stuck on queue. Then the weird thing is that I can't see any error on logs.
> I've tried to downgrade java from 11 down to version 8 but still same issue exist.
> My nifi cluster has three nodes deployed on a GCP VM.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)