Nifi Cluster with external zookeeper

[Matt Penna <ma...@intradiem.com>]

I'm trying to create a nifi cluster using an external zookeeper quorum. I am currently getting the following error in the Cannot replicate request to Node localhost:8080 because the node is not connected. I have set the nifi.web.http.host to be the same as the cluster name. Also I have verified that there are no firewall issues causing network issues. I am not seeing any errors in logs. I do see that there are issues with voting on the correct workflow and that the process to do that runs for the configured 5 mintues then stops. That is when this message becomes available. I don't see where it is getting localhost from. Any suggestions on things I can try or any missed configurations?

Re: Nifi Cluster with external zookeeper

[Jo...@swisscom.com]

Hi Matt

nifi.web.http.host has to be the hostname of your maschine and not the cluster name! if the name is wrong you are getting serious problems.


Additional properties for external zookeeper below. That’s just what came to my mind, hope it’s everything. Just to be sure, your NiFi Cluster was working with the embedded zookeeper and you are now trying to migrate to an external zookeeper right?

vim nifi.properties
nifi.state.management.embedded.zookeeper.start=false
# Properties file that provides the ZooKeeper properties to use if <nifi.state.management.embedded.zookeeper.start> is set to true
nifi.state.management.embedded.zookeeper.properties=./conf/zookeeper.properties
# zookeeper properties, used for cluster management #
nifi.zookeeper.connect.string=zookeeper-01:2181, zookeeper-02:2181, zookeeper-03:2181
nifi.zookeeper.connect.timeout=10 secs
nifi.zookeeper.session.timeout=10 secs
nifi.zookeeper.root.node=/nifi/cluster01

vim state-management.xml
    <cluster-provider>
        <id>zk-provider</id>
        <class>org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider</class>
        <property name="Connect String"> zookeeper-01:2181, zookeeper-02:2181, zookeeper-03:2181</property>
        <property name="Root Node">/nifi/cluster01</property>
        <property name="Session Timeout">10 seconds</property>
        <property name="Access Control">Open</property>
    </cluster-provider>

Cheers Josef

From: Matt Penna <ma...@intradiem.com>
Reply-To: "users@nifi.apache.org" <us...@nifi.apache.org>
Date: Monday, 13 May 2019 at 18:58
To: "users@nifi.apache.org" <us...@nifi.apache.org>
Subject: Nifi Cluster with external zookeeper

I’m trying to create a nifi cluster using an external zookeeper quorum. I am currently getting the following error in the Cannot replicate request to Node localhost:8080 because the node is not connected. I have set the nifi.web.http.host to be the same as the cluster name. Also I have verified that there are no firewall issues causing network issues. I am not seeing any errors in logs. I do see that there are issues with voting on the correct workflow and that the process to do that runs for the configured 5 mintues then stops. That is when this message becomes available. I don’t see where it is getting localhost from. Any suggestions on things I can try or any missed configurations?