You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nifi.apache.org by Edgardo Vega <ed...@gmail.com> on 2015/08/28 21:33:08 UTC

Clustering nifi issue after restart

I had to restart the cluster and now on one of the nodes I keep getting the
following error. The machine does show up ui but as disconnected. I have
tried to remove it and then restart nifi on that box with no success.

2015-08-28 19:26:50,866 ERROR [main]
o.a.nifi.controller.StandardFlowService Failed to load flow from cluster
due to: org.apache.nifi.cluster.ConnectionException: Failed to connect node
to cluster due to: org.apache.nifi.encrypt.EncryptionException:
org.jasypt.exceptions.EncryptionOperationNotPossibleException
org.apache.nifi.cluster.ConnectionException: Failed to connect node to
cluster due to: org.apache.nifi.encrypt.EncryptionException:
org.jasypt.exceptions.EncryptionOperationNotPossibleException
        at
org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:738)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
        at
org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:433)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
        at
org.apache.nifi.web.server.JettyServer.start(JettyServer.java:770)
[nifi-jetty-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
        at org.apache.nifi.NiFi.<init>(NiFi.java:137)
[nifi-runtime-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
        at org.apache.nifi.NiFi.main(NiFi.java:223)
[nifi-runtime-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
Caused by: org.apache.nifi.encrypt.EncryptionException:
org.jasypt.exceptions.EncryptionOperationNotPossibleException
        at
org.apache.nifi.encrypt.StringEncryptor.decrypt(StringEncryptor.java:144)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
        at
org.apache.nifi.fingerprint.FingerprintFactory.decrypt(FingerprintFactory.java:1053)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
        at
org.apache.nifi.fingerprint.FingerprintFactory.access$200(FingerprintFactory.java:81)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
        at
org.apache.nifi.fingerprint.FingerprintFactory$6.compare(FingerprintFactory.java:926)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
        at
org.apache.nifi.fingerprint.FingerprintFactory$6.compare(FingerprintFactory.java:919)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
        at java.util.TimSort.countRunAndMakeAscending(TimSort.java:356)
~[na:1.8.0_45]
        at java.util.TimSort.sort(TimSort.java:216) ~[na:1.8.0_45]
        at java.util.Arrays.sort(Arrays.java:1512) ~[na:1.8.0_45]
        at java.util.ArrayList.sort(ArrayList.java:1454) ~[na:1.8.0_45]
        at java.util.Collections.sort(Collections.java:175) ~[na:1.8.0_45]
        at
org.apache.nifi.fingerprint.FingerprintFactory.sortElements(FingerprintFactory.java:997)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
        at
org.apache.nifi.fingerprint.FingerprintFactory.addFlowFileProcessorFingerprint(FingerprintFactory.java:492)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
        at
org.apache.nifi.fingerprint.FingerprintFactory.addProcessGroupFingerprint(FingerprintFactory.java:402)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
        at
org.apache.nifi.fingerprint.FingerprintFactory.addFlowControllerFingerprint(FingerprintFactory.java:247)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
        at
org.apache.nifi.fingerprint.FingerprintFactory.createFingerprint(FingerprintFactory.java:174)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
        at
org.apache.nifi.fingerprint.FingerprintFactory.createFingerprint(FingerprintFactory.java:134)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
        at
org.apache.nifi.controller.StandardFlowSynchronizer.checkFlowInheritability(StandardFlowSynchronizer.java:1068)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
        at
org.apache.nifi.controller.StandardFlowSynchronizer.checkFlowInheritability(StandardFlowSynchronizer.java:1049)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
        at
org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:214)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
        at
org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1158)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
        at
org.apache.nifi.persistence.StandardXMLFlowConfigurationDAO.load(StandardXMLFlowConfigurationDAO.java:72)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
        at
org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:608)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
        at
org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:709)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
        ... 4 common frames omitted
Caused by: org.jasypt.exceptions.EncryptionOperationNotPossibleException:
null
        at
org.jasypt.encryption.pbe.StandardPBEByteEncryptor.decrypt(StandardPBEByteEncryptor.java:1055)
~[jasypt-1.9.2.jar:na]
        at
org.jasypt.encryption.pbe.StandardPBEStringEncryptor.decrypt(StandardPBEStringEncryptor.java:725)
~[jasypt-1.9.2.jar:na]
        at
org.apache.nifi.encrypt.StringEncryptor.decrypt(StringEncryptor.java:142)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
        ... 26 common frames omitted
2015-08-28 19:26:51,057 WARN [Cluster Socket Listener]
org.apache.nifi.io.socket.SocketListener Failed to communicate with Unknown
Host due to java.net.SocketException: Socket closed
2015-08-28 19:26:51,058 WARN [main] org.apache.nifi.web.server.JettyServer
Failed to start web server... shutting down.

-- 
Cheers,

Edgardo

Re: Clustering nifi issue after restart

Posted by Edgardo Vega <ed...@gmail.com>.
Mark,

Thanks!! I took a second look there and noticed that in one of my files I
had a trailing whitespace (probably from copy and paste). Once I fixed that
it worked.

I put in a ticket in jira to automatically trim whitespace:
https://issues.apache.org/jira/browse/NIFI-915

Thanks for your help,

Edgardo

On Mon, Aug 31, 2015 at 11:40 AM, Mark Payne <ma...@hotmail.com> wrote:

> Edgardo,
>
> It appears that the node is not able to decrypt the sensitive properties
> that are stored
> in the flow.xml. Generally, this indicates that you do not have the
> correct password in
> your properties file. The conf/nifi.properties file contains 3 properties:
>
> nifi.sensitive.props.key
> nifi.sensitive.props.algorithm
> nifi.sensitive.props.provider
>
> These properties need to be the same across all nodes in your cluster. Do
> you have
> different values for these on the different nodes?
>
> Thanks
> -Mark
>
>
> ----------------------------------------
> > Date: Mon, 31 Aug 2015 11:01:01 -0400
> > Subject: Re: Clustering nifi issue after restart
> > From: edgardo.vega@gmail.com
> > To: dev@nifi.apache.org
> >
> > I deleted the cluster and then brought it back with 2 nodes. Everything
> was
> > going great until I added a third node after everything was working. I am
> > now getting the similar error to the one above.
> >
> >
> > 015-08-31 14:58:45,524 ERROR [main]
> o.a.nifi.controller.StandardFlowService
> > Failed to load flow from cluster due to:
> > org.apache.nifi.cluster.ConnectionException: Failed to connect node to
> > cluster because local flow controller partially updated. Administrator
> > should disconnect node and review flow for corruption.
> > org.apache.nifi.cluster.ConnectionException: Failed to connect node to
> > cluster because local flow controller partially updated. Administrator
> > should disconnect node and review flow for corruption.
> > at
> >
> org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:736)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at
> >
> org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:433)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:770)
> > [nifi-jetty-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at org.apache.nifi.NiFi.<init>(NiFi.java:137)
> > [nifi-runtime-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at org.apache.nifi.NiFi.main(NiFi.java:223)
> > [nifi-runtime-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > Caused by: org.apache.nifi.controller.FlowSynchronizationException:
> > org.apache.nifi.encrypt.EncryptionException:
> > org.jasypt.exceptions.EncryptionOperationNotPossibleException
> > at
> >
> org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:317)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at
> >
> org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1158)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at
> >
> org.apache.nifi.persistence.StandardXMLFlowConfigurationDAO.load(StandardXMLFlowConfigurationDAO.java:72)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at
> >
> org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:608)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at
> >
> org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:709)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > ... 4 common frames omitted
> > Caused by: org.apache.nifi.encrypt.EncryptionException:
> > org.jasypt.exceptions.EncryptionOperationNotPossibleException
> > at
> > org.apache.nifi.encrypt.StringEncryptor.decrypt(StringEncryptor.java:144)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at
> >
> org.apache.nifi.controller.FlowFromDOMFactory.decrypt(FlowFromDOMFactory.java:453)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at
> >
> org.apache.nifi.controller.FlowFromDOMFactory.getProperties(FlowFromDOMFactory.java:390)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at
> >
> org.apache.nifi.controller.FlowFromDOMFactory.getProcessor(FlowFromDOMFactory.java:372)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at
> >
> org.apache.nifi.controller.FlowFromDOMFactory.getProcessGroup(FlowFromDOMFactory.java:147)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at
> >
> org.apache.nifi.controller.StandardFlowSynchronizer.addProcessGroup(StandardFlowSynchronizer.java:758)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at
> >
> org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:271)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > ... 8 common frames omitted
> > Caused by: org.jasypt.exceptions.EncryptionOperationNotPossibleException:
> > null
> > at
> >
> org.jasypt.encryption.pbe.StandardPBEByteEncryptor.decrypt(StandardPBEByteEncryptor.java:1055)
> > ~[jasypt-1.9.2.jar:na]
> > at
> >
> org.jasypt.encryption.pbe.StandardPBEStringEncryptor.decrypt(StandardPBEStringEncryptor.java:725)
> > ~[jasypt-1.9.2.jar:na]
> > at
> > org.apache.nifi.encrypt.StringEncryptor.decrypt(StringEncryptor.java:142)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > ... 14 common frames omitted
> > 2015-08-31 14:58:46,164 WARN [Cluster Socket Listener]
> > org.apache.nifi.io.socket.SocketListener Failed to communicate with
> Unknown
> > Host due to java.net.SocketException: Socket closed
> > 2015-08-31 14:58:46,164 WARN [main]
> org.apache.nifi.web.server.JettyServer
> > Failed to start web server... shutting down.
> > java.lang.Exception: Unable to load flow due to: java.io.IOException:
> > org.apache.nifi.cluster.ConnectionException: Failed to connect node to
> > cluster because local flow controller partially updated. Administrator
> > should disconnect node and review flow for corruption.
> > at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:779)
> > ~[nifi-jetty-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at org.apache.nifi.NiFi.<init>(NiFi.java:137)
> > [nifi-runtime-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at org.apache.nifi.NiFi.main(NiFi.java:223)
> > [nifi-runtime-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > Caused by: java.io.IOException:
> > org.apache.nifi.cluster.ConnectionException: Failed to connect node to
> > cluster because local flow controller partially updated. Administrator
> > should disconnect node and review flow for corruption.
> > at
> >
> org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:453)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:770)
> > ~[nifi-jetty-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > ... 2 common frames omitted
> > Caused by: org.apache.nifi.cluster.ConnectionException: Failed to connect
> > node to cluster because local flow controller partially updated.
> > Administrator should disconnect node and review flow for corruption.
> > at
> >
> org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:736)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at
> >
> org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:433)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > ... 3 common frames omitted
> > Caused by: org.apache.nifi.controller.FlowSynchronizationException:
> > org.apache.nifi.encrypt.EncryptionException:
> > org.jasypt.exceptions.EncryptionOperationNotPossibleException
> > at
> >
> org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:317)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at
> >
> org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1158)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at
> >
> org.apache.nifi.persistence.StandardXMLFlowConfigurationDAO.load(StandardXMLFlowConfigurationDAO.java:72)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at
> >
> org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:608)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at
> >
> org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:709)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > ... 4 common frames omitted
> > Caused by: org.apache.nifi.encrypt.EncryptionException:
> > org.jasypt.exceptions.EncryptionOperationNotPossibleException
> > at
> > org.apache.nifi.encrypt.StringEncryptor.decrypt(StringEncryptor.java:144)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at
> >
> org.apache.nifi.controller.FlowFromDOMFactory.decrypt(FlowFromDOMFactory.java:453)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at
> >
> org.apache.nifi.controller.FlowFromDOMFactory.getProperties(FlowFromDOMFactory.java:390)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at
> >
> org.apache.nifi.controller.FlowFromDOMFactory.getProcessor(FlowFromDOMFactory.java:372)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at
> >
> org.apache.nifi.controller.FlowFromDOMFactory.getProcessGroup(FlowFromDOMFactory.java:147)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at
> >
> org.apache.nifi.controller.StandardFlowSynchronizer.addProcessGroup(StandardFlowSynchronizer.java:758)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > at
> >
> org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:271)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > ... 8 common frames omitted
> > Caused by: org.jasypt.exceptions.EncryptionOperationNotPossibleException:
> > null
> > at
> >
> org.jasypt.encryption.pbe.StandardPBEByteEncryptor.decrypt(StandardPBEByteEncryptor.java:1055)
> > ~[jasypt-1.9.2.jar:na]
> > at
> >
> org.jasypt.encryption.pbe.StandardPBEStringEncryptor.decrypt(StandardPBEStringEncryptor.java:725)
> > ~[jasypt-1.9.2.jar:na]
> > at
> > org.apache.nifi.encrypt.StringEncryptor.decrypt(StringEncryptor.java:142)
> > ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> > ... 14 common frames omitted
> >
> > On Fri, Aug 28, 2015 at 3:33 PM, Edgardo Vega <ed...@gmail.com>
> > wrote:
> >
> >> I had to restart the cluster and now on one of the nodes I keep getting
> >> the following error. The machine does show up ui but as disconnected. I
> >> have tried to remove it and then restart nifi on that box with no
> success.
> >>
> >> 2015-08-28 19:26:50,866 ERROR [main]
> >> o.a.nifi.controller.StandardFlowService Failed to load flow from cluster
> >> due to: org.apache.nifi.cluster.ConnectionException: Failed to connect
> node
> >> to cluster due to: org.apache.nifi.encrypt.EncryptionException:
> >> org.jasypt.exceptions.EncryptionOperationNotPossibleException
> >> org.apache.nifi.cluster.ConnectionException: Failed to connect node to
> >> cluster due to: org.apache.nifi.encrypt.EncryptionException:
> >> org.jasypt.exceptions.EncryptionOperationNotPossibleException
> >> at
> >>
> org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:738)
> >> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> at
> >>
> org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:433)
> >> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> at
> >> org.apache.nifi.web.server.JettyServer.start(JettyServer.java:770)
> >> [nifi-jetty-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> at org.apache.nifi.NiFi.<init>(NiFi.java:137)
> >> [nifi-runtime-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> at org.apache.nifi.NiFi.main(NiFi.java:223)
> >> [nifi-runtime-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> Caused by: org.apache.nifi.encrypt.EncryptionException:
> >> org.jasypt.exceptions.EncryptionOperationNotPossibleException
> >> at
> >>
> org.apache.nifi.encrypt.StringEncryptor.decrypt(StringEncryptor.java:144)
> >> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> at
> >>
> org.apache.nifi.fingerprint.FingerprintFactory.decrypt(FingerprintFactory.java:1053)
> >> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> at
> >>
> org.apache.nifi.fingerprint.FingerprintFactory.access$200(FingerprintFactory.java:81)
> >> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> at
> >>
> org.apache.nifi.fingerprint.FingerprintFactory$6.compare(FingerprintFactory.java:926)
> >> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> at
> >>
> org.apache.nifi.fingerprint.FingerprintFactory$6.compare(FingerprintFactory.java:919)
> >> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> at java.util.TimSort.countRunAndMakeAscending(TimSort.java:356)
> >> ~[na:1.8.0_45]
> >> at java.util.TimSort.sort(TimSort.java:216) ~[na:1.8.0_45]
> >> at java.util.Arrays.sort(Arrays.java:1512) ~[na:1.8.0_45]
> >> at java.util.ArrayList.sort(ArrayList.java:1454) ~[na:1.8.0_45]
> >> at java.util.Collections.sort(Collections.java:175) ~[na:1.8.0_45]
> >> at
> >>
> org.apache.nifi.fingerprint.FingerprintFactory.sortElements(FingerprintFactory.java:997)
> >> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> at
> >>
> org.apache.nifi.fingerprint.FingerprintFactory.addFlowFileProcessorFingerprint(FingerprintFactory.java:492)
> >> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> at
> >>
> org.apache.nifi.fingerprint.FingerprintFactory.addProcessGroupFingerprint(FingerprintFactory.java:402)
> >> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> at
> >>
> org.apache.nifi.fingerprint.FingerprintFactory.addFlowControllerFingerprint(FingerprintFactory.java:247)
> >> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> at
> >>
> org.apache.nifi.fingerprint.FingerprintFactory.createFingerprint(FingerprintFactory.java:174)
> >> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> at
> >>
> org.apache.nifi.fingerprint.FingerprintFactory.createFingerprint(FingerprintFactory.java:134)
> >> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> at
> >>
> org.apache.nifi.controller.StandardFlowSynchronizer.checkFlowInheritability(StandardFlowSynchronizer.java:1068)
> >> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> at
> >>
> org.apache.nifi.controller.StandardFlowSynchronizer.checkFlowInheritability(StandardFlowSynchronizer.java:1049)
> >> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> at
> >>
> org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:214)
> >> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> at
> >>
> org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1158)
> >> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> at
> >>
> org.apache.nifi.persistence.StandardXMLFlowConfigurationDAO.load(StandardXMLFlowConfigurationDAO.java:72)
> >> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> at
> >>
> org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:608)
> >> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> at
> >>
> org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:709)
> >> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> ... 4 common frames omitted
> >> Caused by:
> org.jasypt.exceptions.EncryptionOperationNotPossibleException:
> >> null
> >> at
> >>
> org.jasypt.encryption.pbe.StandardPBEByteEncryptor.decrypt(StandardPBEByteEncryptor.java:1055)
> >> ~[jasypt-1.9.2.jar:na]
> >> at
> >>
> org.jasypt.encryption.pbe.StandardPBEStringEncryptor.decrypt(StandardPBEStringEncryptor.java:725)
> >> ~[jasypt-1.9.2.jar:na]
> >> at
> >>
> org.apache.nifi.encrypt.StringEncryptor.decrypt(StringEncryptor.java:142)
> >> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> >> ... 26 common frames omitted
> >> 2015-08-28 19:26:51,057 WARN [Cluster Socket Listener]
> >> org.apache.nifi.io.socket.SocketListener Failed to communicate with
> Unknown
> >> Host due to java.net.SocketException: Socket closed
> >> 2015-08-28 19:26:51,058 WARN [main]
> org.apache.nifi.web.server.JettyServer
> >> Failed to start web server... shutting down.
> >>
> >> --
> >> Cheers,
> >>
> >> Edgardo
> >>
> >
> >
> >
> > --
> > Cheers,
> >
> > Edgardo
>
>



-- 
Cheers,

Edgardo

RE: Clustering nifi issue after restart

Posted by Mark Payne <ma...@hotmail.com>.
Edgardo,

It appears that the node is not able to decrypt the sensitive properties that are stored
in the flow.xml. Generally, this indicates that you do not have the correct password in
your properties file. The conf/nifi.properties file contains 3 properties:

nifi.sensitive.props.key
nifi.sensitive.props.algorithm
nifi.sensitive.props.provider

These properties need to be the same across all nodes in your cluster. Do you have
different values for these on the different nodes?

Thanks
-Mark


----------------------------------------
> Date: Mon, 31 Aug 2015 11:01:01 -0400
> Subject: Re: Clustering nifi issue after restart
> From: edgardo.vega@gmail.com
> To: dev@nifi.apache.org
>
> I deleted the cluster and then brought it back with 2 nodes. Everything was
> going great until I added a third node after everything was working. I am
> now getting the similar error to the one above.
>
>
> 015-08-31 14:58:45,524 ERROR [main] o.a.nifi.controller.StandardFlowService
> Failed to load flow from cluster due to:
> org.apache.nifi.cluster.ConnectionException: Failed to connect node to
> cluster because local flow controller partially updated. Administrator
> should disconnect node and review flow for corruption.
> org.apache.nifi.cluster.ConnectionException: Failed to connect node to
> cluster because local flow controller partially updated. Administrator
> should disconnect node and review flow for corruption.
> at
> org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:736)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at
> org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:433)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:770)
> [nifi-jetty-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at org.apache.nifi.NiFi.<init>(NiFi.java:137)
> [nifi-runtime-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at org.apache.nifi.NiFi.main(NiFi.java:223)
> [nifi-runtime-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> Caused by: org.apache.nifi.controller.FlowSynchronizationException:
> org.apache.nifi.encrypt.EncryptionException:
> org.jasypt.exceptions.EncryptionOperationNotPossibleException
> at
> org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:317)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at
> org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1158)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at
> org.apache.nifi.persistence.StandardXMLFlowConfigurationDAO.load(StandardXMLFlowConfigurationDAO.java:72)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at
> org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:608)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at
> org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:709)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> ... 4 common frames omitted
> Caused by: org.apache.nifi.encrypt.EncryptionException:
> org.jasypt.exceptions.EncryptionOperationNotPossibleException
> at
> org.apache.nifi.encrypt.StringEncryptor.decrypt(StringEncryptor.java:144)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at
> org.apache.nifi.controller.FlowFromDOMFactory.decrypt(FlowFromDOMFactory.java:453)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at
> org.apache.nifi.controller.FlowFromDOMFactory.getProperties(FlowFromDOMFactory.java:390)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at
> org.apache.nifi.controller.FlowFromDOMFactory.getProcessor(FlowFromDOMFactory.java:372)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at
> org.apache.nifi.controller.FlowFromDOMFactory.getProcessGroup(FlowFromDOMFactory.java:147)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at
> org.apache.nifi.controller.StandardFlowSynchronizer.addProcessGroup(StandardFlowSynchronizer.java:758)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at
> org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:271)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> ... 8 common frames omitted
> Caused by: org.jasypt.exceptions.EncryptionOperationNotPossibleException:
> null
> at
> org.jasypt.encryption.pbe.StandardPBEByteEncryptor.decrypt(StandardPBEByteEncryptor.java:1055)
> ~[jasypt-1.9.2.jar:na]
> at
> org.jasypt.encryption.pbe.StandardPBEStringEncryptor.decrypt(StandardPBEStringEncryptor.java:725)
> ~[jasypt-1.9.2.jar:na]
> at
> org.apache.nifi.encrypt.StringEncryptor.decrypt(StringEncryptor.java:142)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> ... 14 common frames omitted
> 2015-08-31 14:58:46,164 WARN [Cluster Socket Listener]
> org.apache.nifi.io.socket.SocketListener Failed to communicate with Unknown
> Host due to java.net.SocketException: Socket closed
> 2015-08-31 14:58:46,164 WARN [main] org.apache.nifi.web.server.JettyServer
> Failed to start web server... shutting down.
> java.lang.Exception: Unable to load flow due to: java.io.IOException:
> org.apache.nifi.cluster.ConnectionException: Failed to connect node to
> cluster because local flow controller partially updated. Administrator
> should disconnect node and review flow for corruption.
> at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:779)
> ~[nifi-jetty-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at org.apache.nifi.NiFi.<init>(NiFi.java:137)
> [nifi-runtime-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at org.apache.nifi.NiFi.main(NiFi.java:223)
> [nifi-runtime-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> Caused by: java.io.IOException:
> org.apache.nifi.cluster.ConnectionException: Failed to connect node to
> cluster because local flow controller partially updated. Administrator
> should disconnect node and review flow for corruption.
> at
> org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:453)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:770)
> ~[nifi-jetty-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> ... 2 common frames omitted
> Caused by: org.apache.nifi.cluster.ConnectionException: Failed to connect
> node to cluster because local flow controller partially updated.
> Administrator should disconnect node and review flow for corruption.
> at
> org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:736)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at
> org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:433)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> ... 3 common frames omitted
> Caused by: org.apache.nifi.controller.FlowSynchronizationException:
> org.apache.nifi.encrypt.EncryptionException:
> org.jasypt.exceptions.EncryptionOperationNotPossibleException
> at
> org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:317)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at
> org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1158)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at
> org.apache.nifi.persistence.StandardXMLFlowConfigurationDAO.load(StandardXMLFlowConfigurationDAO.java:72)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at
> org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:608)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at
> org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:709)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> ... 4 common frames omitted
> Caused by: org.apache.nifi.encrypt.EncryptionException:
> org.jasypt.exceptions.EncryptionOperationNotPossibleException
> at
> org.apache.nifi.encrypt.StringEncryptor.decrypt(StringEncryptor.java:144)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at
> org.apache.nifi.controller.FlowFromDOMFactory.decrypt(FlowFromDOMFactory.java:453)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at
> org.apache.nifi.controller.FlowFromDOMFactory.getProperties(FlowFromDOMFactory.java:390)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at
> org.apache.nifi.controller.FlowFromDOMFactory.getProcessor(FlowFromDOMFactory.java:372)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at
> org.apache.nifi.controller.FlowFromDOMFactory.getProcessGroup(FlowFromDOMFactory.java:147)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at
> org.apache.nifi.controller.StandardFlowSynchronizer.addProcessGroup(StandardFlowSynchronizer.java:758)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> at
> org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:271)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> ... 8 common frames omitted
> Caused by: org.jasypt.exceptions.EncryptionOperationNotPossibleException:
> null
> at
> org.jasypt.encryption.pbe.StandardPBEByteEncryptor.decrypt(StandardPBEByteEncryptor.java:1055)
> ~[jasypt-1.9.2.jar:na]
> at
> org.jasypt.encryption.pbe.StandardPBEStringEncryptor.decrypt(StandardPBEStringEncryptor.java:725)
> ~[jasypt-1.9.2.jar:na]
> at
> org.apache.nifi.encrypt.StringEncryptor.decrypt(StringEncryptor.java:142)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> ... 14 common frames omitted
>
> On Fri, Aug 28, 2015 at 3:33 PM, Edgardo Vega <ed...@gmail.com>
> wrote:
>
>> I had to restart the cluster and now on one of the nodes I keep getting
>> the following error. The machine does show up ui but as disconnected. I
>> have tried to remove it and then restart nifi on that box with no success.
>>
>> 2015-08-28 19:26:50,866 ERROR [main]
>> o.a.nifi.controller.StandardFlowService Failed to load flow from cluster
>> due to: org.apache.nifi.cluster.ConnectionException: Failed to connect node
>> to cluster due to: org.apache.nifi.encrypt.EncryptionException:
>> org.jasypt.exceptions.EncryptionOperationNotPossibleException
>> org.apache.nifi.cluster.ConnectionException: Failed to connect node to
>> cluster due to: org.apache.nifi.encrypt.EncryptionException:
>> org.jasypt.exceptions.EncryptionOperationNotPossibleException
>> at
>> org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:738)
>> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> at
>> org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:433)
>> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> at
>> org.apache.nifi.web.server.JettyServer.start(JettyServer.java:770)
>> [nifi-jetty-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> at org.apache.nifi.NiFi.<init>(NiFi.java:137)
>> [nifi-runtime-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> at org.apache.nifi.NiFi.main(NiFi.java:223)
>> [nifi-runtime-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> Caused by: org.apache.nifi.encrypt.EncryptionException:
>> org.jasypt.exceptions.EncryptionOperationNotPossibleException
>> at
>> org.apache.nifi.encrypt.StringEncryptor.decrypt(StringEncryptor.java:144)
>> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> at
>> org.apache.nifi.fingerprint.FingerprintFactory.decrypt(FingerprintFactory.java:1053)
>> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> at
>> org.apache.nifi.fingerprint.FingerprintFactory.access$200(FingerprintFactory.java:81)
>> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> at
>> org.apache.nifi.fingerprint.FingerprintFactory$6.compare(FingerprintFactory.java:926)
>> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> at
>> org.apache.nifi.fingerprint.FingerprintFactory$6.compare(FingerprintFactory.java:919)
>> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> at java.util.TimSort.countRunAndMakeAscending(TimSort.java:356)
>> ~[na:1.8.0_45]
>> at java.util.TimSort.sort(TimSort.java:216) ~[na:1.8.0_45]
>> at java.util.Arrays.sort(Arrays.java:1512) ~[na:1.8.0_45]
>> at java.util.ArrayList.sort(ArrayList.java:1454) ~[na:1.8.0_45]
>> at java.util.Collections.sort(Collections.java:175) ~[na:1.8.0_45]
>> at
>> org.apache.nifi.fingerprint.FingerprintFactory.sortElements(FingerprintFactory.java:997)
>> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> at
>> org.apache.nifi.fingerprint.FingerprintFactory.addFlowFileProcessorFingerprint(FingerprintFactory.java:492)
>> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> at
>> org.apache.nifi.fingerprint.FingerprintFactory.addProcessGroupFingerprint(FingerprintFactory.java:402)
>> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> at
>> org.apache.nifi.fingerprint.FingerprintFactory.addFlowControllerFingerprint(FingerprintFactory.java:247)
>> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> at
>> org.apache.nifi.fingerprint.FingerprintFactory.createFingerprint(FingerprintFactory.java:174)
>> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> at
>> org.apache.nifi.fingerprint.FingerprintFactory.createFingerprint(FingerprintFactory.java:134)
>> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> at
>> org.apache.nifi.controller.StandardFlowSynchronizer.checkFlowInheritability(StandardFlowSynchronizer.java:1068)
>> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> at
>> org.apache.nifi.controller.StandardFlowSynchronizer.checkFlowInheritability(StandardFlowSynchronizer.java:1049)
>> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> at
>> org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:214)
>> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> at
>> org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1158)
>> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> at
>> org.apache.nifi.persistence.StandardXMLFlowConfigurationDAO.load(StandardXMLFlowConfigurationDAO.java:72)
>> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> at
>> org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:608)
>> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> at
>> org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:709)
>> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> ... 4 common frames omitted
>> Caused by: org.jasypt.exceptions.EncryptionOperationNotPossibleException:
>> null
>> at
>> org.jasypt.encryption.pbe.StandardPBEByteEncryptor.decrypt(StandardPBEByteEncryptor.java:1055)
>> ~[jasypt-1.9.2.jar:na]
>> at
>> org.jasypt.encryption.pbe.StandardPBEStringEncryptor.decrypt(StandardPBEStringEncryptor.java:725)
>> ~[jasypt-1.9.2.jar:na]
>> at
>> org.apache.nifi.encrypt.StringEncryptor.decrypt(StringEncryptor.java:142)
>> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>> ... 26 common frames omitted
>> 2015-08-28 19:26:51,057 WARN [Cluster Socket Listener]
>> org.apache.nifi.io.socket.SocketListener Failed to communicate with Unknown
>> Host due to java.net.SocketException: Socket closed
>> 2015-08-28 19:26:51,058 WARN [main] org.apache.nifi.web.server.JettyServer
>> Failed to start web server... shutting down.
>>
>> --
>> Cheers,
>>
>> Edgardo
>>
>
>
>
> --
> Cheers,
>
> Edgardo
 		 	   		  

Re: Clustering nifi issue after restart

Posted by Edgardo Vega <ed...@gmail.com>.
I deleted the cluster and then brought it back with 2 nodes. Everything was
going great until I added a third node after everything was working. I am
now getting the similar error to the one above.


015-08-31 14:58:45,524 ERROR [main] o.a.nifi.controller.StandardFlowService
Failed to load flow from cluster due to:
org.apache.nifi.cluster.ConnectionException: Failed to connect node to
cluster because local flow controller partially updated.  Administrator
should disconnect node and review flow for corruption.
org.apache.nifi.cluster.ConnectionException: Failed to connect node to
cluster because local flow controller partially updated.  Administrator
should disconnect node and review flow for corruption.
at
org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:736)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at
org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:433)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:770)
[nifi-jetty-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at org.apache.nifi.NiFi.<init>(NiFi.java:137)
[nifi-runtime-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at org.apache.nifi.NiFi.main(NiFi.java:223)
[nifi-runtime-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
Caused by: org.apache.nifi.controller.FlowSynchronizationException:
org.apache.nifi.encrypt.EncryptionException:
org.jasypt.exceptions.EncryptionOperationNotPossibleException
at
org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:317)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at
org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1158)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at
org.apache.nifi.persistence.StandardXMLFlowConfigurationDAO.load(StandardXMLFlowConfigurationDAO.java:72)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at
org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:608)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at
org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:709)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
... 4 common frames omitted
Caused by: org.apache.nifi.encrypt.EncryptionException:
org.jasypt.exceptions.EncryptionOperationNotPossibleException
at
org.apache.nifi.encrypt.StringEncryptor.decrypt(StringEncryptor.java:144)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at
org.apache.nifi.controller.FlowFromDOMFactory.decrypt(FlowFromDOMFactory.java:453)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at
org.apache.nifi.controller.FlowFromDOMFactory.getProperties(FlowFromDOMFactory.java:390)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at
org.apache.nifi.controller.FlowFromDOMFactory.getProcessor(FlowFromDOMFactory.java:372)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at
org.apache.nifi.controller.FlowFromDOMFactory.getProcessGroup(FlowFromDOMFactory.java:147)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at
org.apache.nifi.controller.StandardFlowSynchronizer.addProcessGroup(StandardFlowSynchronizer.java:758)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at
org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:271)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
... 8 common frames omitted
Caused by: org.jasypt.exceptions.EncryptionOperationNotPossibleException:
null
at
org.jasypt.encryption.pbe.StandardPBEByteEncryptor.decrypt(StandardPBEByteEncryptor.java:1055)
~[jasypt-1.9.2.jar:na]
at
org.jasypt.encryption.pbe.StandardPBEStringEncryptor.decrypt(StandardPBEStringEncryptor.java:725)
~[jasypt-1.9.2.jar:na]
at
org.apache.nifi.encrypt.StringEncryptor.decrypt(StringEncryptor.java:142)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
... 14 common frames omitted
2015-08-31 14:58:46,164 WARN [Cluster Socket Listener]
org.apache.nifi.io.socket.SocketListener Failed to communicate with Unknown
Host due to java.net.SocketException: Socket closed
2015-08-31 14:58:46,164 WARN [main] org.apache.nifi.web.server.JettyServer
Failed to start web server... shutting down.
java.lang.Exception: Unable to load flow due to: java.io.IOException:
org.apache.nifi.cluster.ConnectionException: Failed to connect node to
cluster because local flow controller partially updated.  Administrator
should disconnect node and review flow for corruption.
at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:779)
~[nifi-jetty-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at org.apache.nifi.NiFi.<init>(NiFi.java:137)
[nifi-runtime-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at org.apache.nifi.NiFi.main(NiFi.java:223)
[nifi-runtime-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
Caused by: java.io.IOException:
org.apache.nifi.cluster.ConnectionException: Failed to connect node to
cluster because local flow controller partially updated.  Administrator
should disconnect node and review flow for corruption.
at
org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:453)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:770)
~[nifi-jetty-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
... 2 common frames omitted
Caused by: org.apache.nifi.cluster.ConnectionException: Failed to connect
node to cluster because local flow controller partially updated.
Administrator should disconnect node and review flow for corruption.
at
org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:736)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at
org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:433)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
... 3 common frames omitted
Caused by: org.apache.nifi.controller.FlowSynchronizationException:
org.apache.nifi.encrypt.EncryptionException:
org.jasypt.exceptions.EncryptionOperationNotPossibleException
at
org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:317)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at
org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1158)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at
org.apache.nifi.persistence.StandardXMLFlowConfigurationDAO.load(StandardXMLFlowConfigurationDAO.java:72)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at
org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:608)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at
org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:709)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
... 4 common frames omitted
Caused by: org.apache.nifi.encrypt.EncryptionException:
org.jasypt.exceptions.EncryptionOperationNotPossibleException
at
org.apache.nifi.encrypt.StringEncryptor.decrypt(StringEncryptor.java:144)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at
org.apache.nifi.controller.FlowFromDOMFactory.decrypt(FlowFromDOMFactory.java:453)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at
org.apache.nifi.controller.FlowFromDOMFactory.getProperties(FlowFromDOMFactory.java:390)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at
org.apache.nifi.controller.FlowFromDOMFactory.getProcessor(FlowFromDOMFactory.java:372)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at
org.apache.nifi.controller.FlowFromDOMFactory.getProcessGroup(FlowFromDOMFactory.java:147)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at
org.apache.nifi.controller.StandardFlowSynchronizer.addProcessGroup(StandardFlowSynchronizer.java:758)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
at
org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:271)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
... 8 common frames omitted
Caused by: org.jasypt.exceptions.EncryptionOperationNotPossibleException:
null
at
org.jasypt.encryption.pbe.StandardPBEByteEncryptor.decrypt(StandardPBEByteEncryptor.java:1055)
~[jasypt-1.9.2.jar:na]
at
org.jasypt.encryption.pbe.StandardPBEStringEncryptor.decrypt(StandardPBEStringEncryptor.java:725)
~[jasypt-1.9.2.jar:na]
at
org.apache.nifi.encrypt.StringEncryptor.decrypt(StringEncryptor.java:142)
~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
... 14 common frames omitted

On Fri, Aug 28, 2015 at 3:33 PM, Edgardo Vega <ed...@gmail.com>
wrote:

> I had to restart the cluster and now on one of the nodes I keep getting
> the following error. The machine does show up ui but as disconnected. I
> have tried to remove it and then restart nifi on that box with no success.
>
> 2015-08-28 19:26:50,866 ERROR [main]
> o.a.nifi.controller.StandardFlowService Failed to load flow from cluster
> due to: org.apache.nifi.cluster.ConnectionException: Failed to connect node
> to cluster due to: org.apache.nifi.encrypt.EncryptionException:
> org.jasypt.exceptions.EncryptionOperationNotPossibleException
> org.apache.nifi.cluster.ConnectionException: Failed to connect node to
> cluster due to: org.apache.nifi.encrypt.EncryptionException:
> org.jasypt.exceptions.EncryptionOperationNotPossibleException
>         at
> org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:738)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at
> org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:433)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at
> org.apache.nifi.web.server.JettyServer.start(JettyServer.java:770)
> [nifi-jetty-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at org.apache.nifi.NiFi.<init>(NiFi.java:137)
> [nifi-runtime-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at org.apache.nifi.NiFi.main(NiFi.java:223)
> [nifi-runtime-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
> Caused by: org.apache.nifi.encrypt.EncryptionException:
> org.jasypt.exceptions.EncryptionOperationNotPossibleException
>         at
> org.apache.nifi.encrypt.StringEncryptor.decrypt(StringEncryptor.java:144)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at
> org.apache.nifi.fingerprint.FingerprintFactory.decrypt(FingerprintFactory.java:1053)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at
> org.apache.nifi.fingerprint.FingerprintFactory.access$200(FingerprintFactory.java:81)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at
> org.apache.nifi.fingerprint.FingerprintFactory$6.compare(FingerprintFactory.java:926)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at
> org.apache.nifi.fingerprint.FingerprintFactory$6.compare(FingerprintFactory.java:919)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at java.util.TimSort.countRunAndMakeAscending(TimSort.java:356)
> ~[na:1.8.0_45]
>         at java.util.TimSort.sort(TimSort.java:216) ~[na:1.8.0_45]
>         at java.util.Arrays.sort(Arrays.java:1512) ~[na:1.8.0_45]
>         at java.util.ArrayList.sort(ArrayList.java:1454) ~[na:1.8.0_45]
>         at java.util.Collections.sort(Collections.java:175) ~[na:1.8.0_45]
>         at
> org.apache.nifi.fingerprint.FingerprintFactory.sortElements(FingerprintFactory.java:997)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at
> org.apache.nifi.fingerprint.FingerprintFactory.addFlowFileProcessorFingerprint(FingerprintFactory.java:492)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at
> org.apache.nifi.fingerprint.FingerprintFactory.addProcessGroupFingerprint(FingerprintFactory.java:402)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at
> org.apache.nifi.fingerprint.FingerprintFactory.addFlowControllerFingerprint(FingerprintFactory.java:247)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at
> org.apache.nifi.fingerprint.FingerprintFactory.createFingerprint(FingerprintFactory.java:174)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at
> org.apache.nifi.fingerprint.FingerprintFactory.createFingerprint(FingerprintFactory.java:134)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at
> org.apache.nifi.controller.StandardFlowSynchronizer.checkFlowInheritability(StandardFlowSynchronizer.java:1068)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at
> org.apache.nifi.controller.StandardFlowSynchronizer.checkFlowInheritability(StandardFlowSynchronizer.java:1049)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at
> org.apache.nifi.controller.StandardFlowSynchronizer.sync(StandardFlowSynchronizer.java:214)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at
> org.apache.nifi.controller.FlowController.synchronize(FlowController.java:1158)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at
> org.apache.nifi.persistence.StandardXMLFlowConfigurationDAO.load(StandardXMLFlowConfigurationDAO.java:72)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at
> org.apache.nifi.controller.StandardFlowService.loadFromBytes(StandardFlowService.java:608)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         at
> org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:709)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         ... 4 common frames omitted
> Caused by: org.jasypt.exceptions.EncryptionOperationNotPossibleException:
> null
>         at
> org.jasypt.encryption.pbe.StandardPBEByteEncryptor.decrypt(StandardPBEByteEncryptor.java:1055)
> ~[jasypt-1.9.2.jar:na]
>         at
> org.jasypt.encryption.pbe.StandardPBEStringEncryptor.decrypt(StandardPBEStringEncryptor.java:725)
> ~[jasypt-1.9.2.jar:na]
>         at
> org.apache.nifi.encrypt.StringEncryptor.decrypt(StringEncryptor.java:142)
> ~[nifi-framework-core-0.3.0-SNAPSHOT.jar:0.3.0-SNAPSHOT]
>         ... 26 common frames omitted
> 2015-08-28 19:26:51,057 WARN [Cluster Socket Listener]
> org.apache.nifi.io.socket.SocketListener Failed to communicate with Unknown
> Host due to java.net.SocketException: Socket closed
> 2015-08-28 19:26:51,058 WARN [main] org.apache.nifi.web.server.JettyServer
> Failed to start web server... shutting down.
>
> --
> Cheers,
>
> Edgardo
>



-- 
Cheers,

Edgardo