You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by Jean-Sebastien Vachon <js...@brizodata.com> on 2021/10/18 13:24:14 UTC
Trouble starting docker container
Hi all,
I used an instance of Nifi 1.14 last friday (single user with password) and everything was fine until this morning.
My PC was rebooted over the weekend and now I can't restart the container at all.
Java home: /usr/local/openjdk-8
NiFi home: /opt/nifi/nifi-current
Bootstrap Config File: /opt/nifi/nifi-current/conf/bootstrap.conf
2021-10-18 13:17:22,856 INFO [main] org.apache.nifi.bootstrap.Command Starting Apache NiFi...
2021-10-18 13:17:22,856 INFO [main] org.apache.nifi.bootstrap.Command Working Directory: /opt/nifi/nifi-current
2021-10-18 13:17:22,856 INFO [main] org.apache.nifi.bootstrap.Command Command: /usr/local/openjdk-8/bin/java -classpath /opt/nifi/nifi-current/./conf:/opt/nifi/nifi-current/./lib/logback-core-1.2.3.jar:/opt/nifi/nifi-current/./lib/nifi-framework-api-1.14.0.jar:/opt/nifi/nifi-current/./lib/nifi-runtime-1.14.0.jar:/opt/nifi/nifi-current/./lib/javax.servlet-api-3.1.0.jar:/opt/nifi/nifi-current/./lib/log4j-over-slf4j-1.7.30.jar:/opt/nifi/nifi-current/./lib/nifi-property-utils-1.14.0.jar:/opt/nifi/nifi-current/./lib/nifi-api-1.14.0.jar:/opt/nifi/nifi-current/./lib/jul-to-slf4j-1.7.30.jar:/opt/nifi/nifi-current/./lib/nifi-nar-utils-1.14.0.jar:/opt/nifi/nifi-current/./lib/jcl-over-slf4j-1.7.30.jar:/opt/nifi/nifi-current/./lib/nifi-stateless-bootstrap-1.14.0.jar:/opt/nifi/nifi-current/./lib/logback-classic-1.2.3.jar:/opt/nifi/nifi-current/./lib/nifi-server-api-1.14.0.jar:/opt/nifi/nifi-current/./lib/jetty-schemas-3.1.jar:/opt/nifi/nifi-current/./lib/slf4j-api-1.7.30.jar:/opt/nifi/nifi-current/./lib/nifi-stateless-api-1.14.0.jar:/opt/nifi/nifi-current/./lib/nifi-properties-1.14.0.jar -Dorg.apache.jasper.compiler.disablejsr199=true -Xmx512m -Xms512m -Dcurator-log-only-first-connection-issue-as-error-level=true -Djavax.security.auth.useSubjectCredsOnly=true -Djava.security.egd=file:/dev/urandom -Dzookeeper.admin.enableServer=false -Dsun.net.http.allowRestrictedHeaders=true -Djava.net.preferIPv4Stack=true -Djava.awt.headless=true -Djava.protocol.handler.pkgs=sun.net.www.protocol -Dnifi.properties.file.path=/opt/nifi/nifi-current/./conf/nifi.properties -Dnifi.bootstrap.listen.port=40717 -Dapp=NiFi -Dorg.apache.nifi.bootstrap.config.log.dir=/opt/nifi/nifi-current/logs org.apache.nifi.NiFi
2021-10-18 13:17:22,879 INFO [main] org.apache.nifi.bootstrap.Command Launched Apache NiFi with Process ID 95
2021-10-18 13:17:23,095 INFO [main] org.apache.nifi.NiFi Launching NiFi...
2021-10-18 13:17:23,356 INFO [main] o.a.n.p.AbstractBootstrapPropertiesLoader Determined default application properties path to be '/opt/nifi/nifi-current/./conf/nifi.properties'
2021-10-18 13:17:23,361 INFO [main] o.a.nifi.properties.NiFiPropertiesLoader Loaded 202 properties from /opt/nifi/nifi-current/./conf/nifi.properties
2021-10-18 13:17:23,368 ERROR [main] o.a.nifi.properties.NiFiPropertiesLoader Flow Configuration [./conf/flow.xml.gz] Found: Migration Required for blank Sensitive Properties Key [nifi.sensitive.props.key]
2021-10-18 13:17:23,369 ERROR [main] org.apache.nifi.NiFi Failure to launch NiFi due to java.lang.IllegalArgumentException: There was an issue decrypting protected properties
java.lang.IllegalArgumentException: There was an issue decrypting protected properties
at org.apache.nifi.NiFi.initializeProperties(NiFi.java:346)
at org.apache.nifi.NiFi.convertArgumentsToValidatedNiFiProperties(NiFi.java:314)
at org.apache.nifi.NiFi.convertArgumentsToValidatedNiFiProperties(NiFi.java:310)
at org.apache.nifi.NiFi.main(NiFi.java:302)
Caused by: org.apache.nifi.properties.SensitivePropertyProtectionException: Sensitive Properties Key [nifi.sensitive.props.key] not found: See Admin Guide section [Updating the Sensitive Properties Key]
at org.apache.nifi.properties.NiFiPropertiesLoader.getDefaultProperties(NiFiPropertiesLoader.java:226)
at org.apache.nifi.properties.NiFiPropertiesLoader.get(NiFiPropertiesLoader.java:209)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.nifi.NiFi.initializeProperties(NiFi.java:341)
... 3 common frames omitted
Anybody understand what's going on?
Is there anything I can do to recover my flowfile?
Jean-Sébastien Vachon
Co-Founder & Architect
Brizo Data, Inc.
www.brizodata.com<https://outlook.office365.com/mail/options/mail/messageContent/www.brizodata.com>
Re: Trouble starting docker container
Posted by Joe Witt <jo...@gmail.com>.
Glad you found the problem and shared the resolution. Thanks
On Mon, Oct 18, 2021 at 8:58 AM Jean-Sebastien Vachon <
jsvachon@brizodata.com> wrote:
> I fixed my problem... it was related to this
>
>
> https://stackoverflow.com/questions/69081508/nifi-migration-required-for-blank-sensitive-properties-key
>
> <https://stackoverflow.com/questions/69081508/nifi-migration-required-for-blank-sensitive-properties-key>
> java - Nifi Migration Required for blank Sensitive Properties Key - Stack
> Overflow
> <https://stackoverflow.com/questions/69081508/nifi-migration-required-for-blank-sensitive-properties-key>
> I'm using nifi 1.14.0 in container where I'm experiencing this problem
> when I restart nifi. Migration Required for blank Sensitive Properties Key
> erro 2021-09-07 01:15:03,672 INFO [main] o.a.n.p.
> stackoverflow.com
>
> Once I restored the value of nifi.sensitive.props.key, everything is fine
>
>
>
>
> *Jean-Sébastien Vachon *
> Co-Founder & Architect
>
>
> *Brizo Data, Inc. www.brizodata.com
> <https://outlook.office365.com/mail/options/mail/messageContent/www.brizodata.com>
> *
> ------------------------------
> *From:* Jean-Sebastien Vachon <js...@brizodata.com>
> *Sent:* Monday, October 18, 2021 10:54 AM
> *To:* users@nifi.apache.org <us...@nifi.apache.org>
> *Subject:* Re: Trouble starting docker container
>
> I was able to recover the flow.xml.gz file from the container using this
> command:
>
> sudo docker cp nifi:/opt/nifi/nifi-current/conf/flow.xml.gz .
>
> But I can't seem to be able to use it in another container by mounting it
> as a volume.
>
> A new Nifi 1.14 based container will give me about the same error:
>
> 2021-10-18 14:43:15,660 ERROR [main]
> o.a.nifi.properties.NiFiPropertiesLoader Flow Configuration
> [./conf/flow.xml.gz] Found: Migration Required for blank Sensitive
> Properties Key [nifi.sensitive.props.key]
> 2021-10-18 14:43:15,662 ERROR [main] org.apache.nifi.NiFi Failure to
> launch NiFi due to java.lang.IllegalArgumentException: There was an issue
> decrypting protected properties
> java.lang.IllegalArgumentException: There was an issue decrypting
> protected properties
> at org.apache.nifi.NiFi.initializeProperties(NiFi.java:346)
> at
> org.apache.nifi.NiFi.convertArgumentsToValidatedNiFiProperties(NiFi.java:314)
> at
> org.apache.nifi.NiFi.convertArgumentsToValidatedNiFiProperties(NiFi.java:310)
> at org.apache.nifi.NiFi.main(NiFi.java:302)
> Caused by:
> org.apache.nifi.properties.SensitivePropertyProtectionException: Sensitive
> Properties Key [nifi.sensitive.props.key] not found: See Admin Guide
> section [Updating the Sensitive Properties Key]
> at
> org.apache.nifi.properties.NiFiPropertiesLoader.getDefaultProperties(NiFiPropertiesLoader.java:226)
> at
> org.apache.nifi.properties.NiFiPropertiesLoader.get(NiFiPropertiesLoader.java:209)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.apache.nifi.NiFi.initializeProperties(NiFi.java:341)
> ... 3 common frames omitted
>
> I also tried using the flowfile with a previous version of Nifi... Nifi
> wants to start but then complain about this:
>
> 021-10-18 14:53:09,727 INFO [main] org.eclipse.jetty.server.Server Started
> @27643ms
> 2021-10-18 14:53:09,727 WARN [main] org.apache.nifi.web.server.JettyServer
> Failed to start web server... shutting down.
> ...
> org.apache.nifi.web.NiFiCoreException: Unable to start Flow Controller.
> Caused by: java.nio.file.FileSystemException: ./conf/flow.xml.gz: Device
> or resource busy
>
>
> Is there any way to move a flow.xml.gz from a machine to another?
>
>
>
> *Jean-Sébastien Vachon *
> Co-Founder & Architect
>
>
> *Brizo Data, Inc. www.brizodata.com
> <https://outlook.office365.com/mail/options/mail/messageContent/www.brizodata.com>
> *
> ------------------------------
> *From:* Jean-Sebastien Vachon <js...@brizodata.com>
> *Sent:* Monday, October 18, 2021 9:24 AM
> *To:* users@nifi.apache.org <us...@nifi.apache.org>
> *Subject:* Trouble starting docker container
>
> Hi all,
>
> I used an instance of Nifi 1.14 last friday (single user with password)
> and everything was fine until this morning.
> My PC was rebooted over the weekend and now I can't restart the container
> at all.
>
>
> Java home: /usr/local/openjdk-8
> NiFi home: /opt/nifi/nifi-current
>
> Bootstrap Config File: /opt/nifi/nifi-current/conf/bootstrap.conf
>
> 2021-10-18 13:17:22,856 INFO [main] org.apache.nifi.bootstrap.Command
> Starting Apache NiFi...
> 2021-10-18 13:17:22,856 INFO [main] org.apache.nifi.bootstrap.Command
> Working Directory: /opt/nifi/nifi-current
> 2021-10-18 13:17:22,856 INFO [main] org.apache.nifi.bootstrap.Command
> Command: /usr/local/openjdk-8/bin/java -classpath
> /opt/nifi/nifi-current/./conf:/opt/nifi/nifi-current/./lib/logback-core-1.2.3.jar:/opt/nifi/nifi-current/./lib/nifi-framework-api-1.14.0.jar:/opt/nifi/nifi-current/./lib/nifi-runtime-1.14.0.jar:/opt/nifi/nifi-current/./lib/javax.servlet-api-3.1.0.jar:/opt/nifi/nifi-current/./lib/log4j-over-slf4j-1.7.30.jar:/opt/nifi/nifi-current/./lib/nifi-property-utils-1.14.0.jar:/opt/nifi/nifi-current/./lib/nifi-api-1.14.0.jar:/opt/nifi/nifi-current/./lib/jul-to-slf4j-1.7.30.jar:/opt/nifi/nifi-current/./lib/nifi-nar-utils-1.14.0.jar:/opt/nifi/nifi-current/./lib/jcl-over-slf4j-1.7.30.jar:/opt/nifi/nifi-current/./lib/nifi-stateless-bootstrap-1.14.0.jar:/opt/nifi/nifi-current/./lib/logback-classic-1.2.3.jar:/opt/nifi/nifi-current/./lib/nifi-server-api-1.14.0.jar:/opt/nifi/nifi-current/./lib/jetty-schemas-3.1.jar:/opt/nifi/nifi-current/./lib/slf4j-api-1.7.30.jar:/opt/nifi/nifi-current/./lib/nifi-stateless-api-1.14.0.jar:/opt/nifi/nifi-current/./lib/nifi-properties-1.14.0.jar
> -Dorg.apache.jasper.compiler.disablejsr199=true -Xmx512m -Xms512m
> -Dcurator-log-only-first-connection-issue-as-error-level=true
> -Djavax.security.auth.useSubjectCredsOnly=true
> -Djava.security.egd=file:/dev/urandom -Dzookeeper.admin.enableServer=false
> -Dsun.net.http.allowRestrictedHeaders=true -Djava.net.preferIPv4Stack=true
> -Djava.awt.headless=true -Djava.protocol.handler.pkgs=sun.net.www.protocol
> -Dnifi.properties.file.path=/opt/nifi/nifi-current/./conf/nifi.properties
> -Dnifi.bootstrap.listen.port=40717 -Dapp=NiFi
> -Dorg.apache.nifi.bootstrap.config.log.dir=/opt/nifi/nifi-current/logs
> org.apache.nifi.NiFi
> 2021-10-18 13:17:22,879 INFO [main] org.apache.nifi.bootstrap.Command
> Launched Apache NiFi with Process ID 95
> 2021-10-18 13:17:23,095 INFO [main] org.apache.nifi.NiFi Launching NiFi...
> 2021-10-18 13:17:23,356 INFO [main]
> o.a.n.p.AbstractBootstrapPropertiesLoader Determined default application
> properties path to be '/opt/nifi/nifi-current/./conf/nifi.properties'
> 2021-10-18 13:17:23,361 INFO [main]
> o.a.nifi.properties.NiFiPropertiesLoader Loaded 202 properties from
> /opt/nifi/nifi-current/./conf/nifi.properties
> 2021-10-18 13:17:23,368 ERROR [main]
> o.a.nifi.properties.NiFiPropertiesLoader Flow Configuration
> [./conf/flow.xml.gz] Found: Migration Required for blank Sensitive
> Properties Key [nifi.sensitive.props.key]
> 2021-10-18 13:17:23,369 ERROR [main] org.apache.nifi.NiFi Failure to
> launch NiFi due to java.lang.IllegalArgumentException: There was an issue
> decrypting protected properties
> java.lang.IllegalArgumentException: There was an issue decrypting
> protected properties
> at org.apache.nifi.NiFi.initializeProperties(NiFi.java:346)
> at
> org.apache.nifi.NiFi.convertArgumentsToValidatedNiFiProperties(NiFi.java:314)
> at
> org.apache.nifi.NiFi.convertArgumentsToValidatedNiFiProperties(NiFi.java:310)
> at org.apache.nifi.NiFi.main(NiFi.java:302)
> Caused by:
> org.apache.nifi.properties.SensitivePropertyProtectionException: Sensitive
> Properties Key [nifi.sensitive.props.key] not found: See Admin Guide
> section [Updating the Sensitive Properties Key]
> at
> org.apache.nifi.properties.NiFiPropertiesLoader.getDefaultProperties(NiFiPropertiesLoader.java:226)
> at
> org.apache.nifi.properties.NiFiPropertiesLoader.get(NiFiPropertiesLoader.java:209)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.apache.nifi.NiFi.initializeProperties(NiFi.java:341)
> ... 3 common frames omitted
>
> Anybody understand what's going on?
>
> Is there anything I can do to recover my flowfile?
>
>
> *Jean-Sébastien Vachon *
> Co-Founder & Architect
>
>
> *Brizo Data, Inc. www.brizodata.com
> <https://outlook.office365.com/mail/options/mail/messageContent/www.brizodata.com>
> *
>
Re: Trouble starting docker container
Posted by Jean-Sebastien Vachon <js...@brizodata.com>.
I fixed my problem... it was related to this
https://stackoverflow.com/questions/69081508/nifi-migration-required-for-blank-sensitive-properties-key
[https://cdn.sstatic.net/Sites/stackoverflow/Img/apple-touch-icon@2.png?v=73d79a89bded]<https://stackoverflow.com/questions/69081508/nifi-migration-required-for-blank-sensitive-properties-key>
java - Nifi Migration Required for blank Sensitive Properties Key - Stack Overflow<https://stackoverflow.com/questions/69081508/nifi-migration-required-for-blank-sensitive-properties-key>
I'm using nifi 1.14.0 in container where I'm experiencing this problem when I restart nifi. Migration Required for blank Sensitive Properties Key erro 2021-09-07 01:15:03,672 INFO [main] o.a.n.p.
stackoverflow.com
Once I restored the value of nifi.sensitive.props.key, everything is fine
Jean-Sébastien Vachon
Co-Founder & Architect
Brizo Data, Inc.
www.brizodata.com<https://outlook.office365.com/mail/options/mail/messageContent/www.brizodata.com>
________________________________
From: Jean-Sebastien Vachon <js...@brizodata.com>
Sent: Monday, October 18, 2021 10:54 AM
To: users@nifi.apache.org <us...@nifi.apache.org>
Subject: Re: Trouble starting docker container
I was able to recover the flow.xml.gz file from the container using this command:
sudo docker cp nifi:/opt/nifi/nifi-current/conf/flow.xml.gz .
But I can't seem to be able to use it in another container by mounting it as a volume.
A new Nifi 1.14 based container will give me about the same error:
2021-10-18 14:43:15,660 ERROR [main] o.a.nifi.properties.NiFiPropertiesLoader Flow Configuration [./conf/flow.xml.gz] Found: Migration Required for blank Sensitive Properties Key [nifi.sensitive.props.key]
2021-10-18 14:43:15,662 ERROR [main] org.apache.nifi.NiFi Failure to launch NiFi due to java.lang.IllegalArgumentException: There was an issue decrypting protected properties
java.lang.IllegalArgumentException: There was an issue decrypting protected properties
at org.apache.nifi.NiFi.initializeProperties(NiFi.java:346)
at org.apache.nifi.NiFi.convertArgumentsToValidatedNiFiProperties(NiFi.java:314)
at org.apache.nifi.NiFi.convertArgumentsToValidatedNiFiProperties(NiFi.java:310)
at org.apache.nifi.NiFi.main(NiFi.java:302)
Caused by: org.apache.nifi.properties.SensitivePropertyProtectionException: Sensitive Properties Key [nifi.sensitive.props.key] not found: See Admin Guide section [Updating the Sensitive Properties Key]
at org.apache.nifi.properties.NiFiPropertiesLoader.getDefaultProperties(NiFiPropertiesLoader.java:226)
at org.apache.nifi.properties.NiFiPropertiesLoader.get(NiFiPropertiesLoader.java:209)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.nifi.NiFi.initializeProperties(NiFi.java:341)
... 3 common frames omitted
I also tried using the flowfile with a previous version of Nifi... Nifi wants to start but then complain about this:
021-10-18 14:53:09,727 INFO [main] org.eclipse.jetty.server.Server Started @27643ms
2021-10-18 14:53:09,727 WARN [main] org.apache.nifi.web.server.JettyServer Failed to start web server... shutting down.
...
org.apache.nifi.web.NiFiCoreException: Unable to start Flow Controller.
Caused by: java.nio.file.FileSystemException: ./conf/flow.xml.gz: Device or resource busy
Is there any way to move a flow.xml.gz from a machine to another?
Jean-Sébastien Vachon
Co-Founder & Architect
Brizo Data, Inc.
www.brizodata.com<https://outlook.office365.com/mail/options/mail/messageContent/www.brizodata.com>
________________________________
From: Jean-Sebastien Vachon <js...@brizodata.com>
Sent: Monday, October 18, 2021 9:24 AM
To: users@nifi.apache.org <us...@nifi.apache.org>
Subject: Trouble starting docker container
Hi all,
I used an instance of Nifi 1.14 last friday (single user with password) and everything was fine until this morning.
My PC was rebooted over the weekend and now I can't restart the container at all.
Java home: /usr/local/openjdk-8
NiFi home: /opt/nifi/nifi-current
Bootstrap Config File: /opt/nifi/nifi-current/conf/bootstrap.conf
2021-10-18 13:17:22,856 INFO [main] org.apache.nifi.bootstrap.Command Starting Apache NiFi...
2021-10-18 13:17:22,856 INFO [main] org.apache.nifi.bootstrap.Command Working Directory: /opt/nifi/nifi-current
2021-10-18 13:17:22,856 INFO [main] org.apache.nifi.bootstrap.Command Command: /usr/local/openjdk-8/bin/java -classpath /opt/nifi/nifi-current/./conf:/opt/nifi/nifi-current/./lib/logback-core-1.2.3.jar:/opt/nifi/nifi-current/./lib/nifi-framework-api-1.14.0.jar:/opt/nifi/nifi-current/./lib/nifi-runtime-1.14.0.jar:/opt/nifi/nifi-current/./lib/javax.servlet-api-3.1.0.jar:/opt/nifi/nifi-current/./lib/log4j-over-slf4j-1.7.30.jar:/opt/nifi/nifi-current/./lib/nifi-property-utils-1.14.0.jar:/opt/nifi/nifi-current/./lib/nifi-api-1.14.0.jar:/opt/nifi/nifi-current/./lib/jul-to-slf4j-1.7.30.jar:/opt/nifi/nifi-current/./lib/nifi-nar-utils-1.14.0.jar:/opt/nifi/nifi-current/./lib/jcl-over-slf4j-1.7.30.jar:/opt/nifi/nifi-current/./lib/nifi-stateless-bootstrap-1.14.0.jar:/opt/nifi/nifi-current/./lib/logback-classic-1.2.3.jar:/opt/nifi/nifi-current/./lib/nifi-server-api-1.14.0.jar:/opt/nifi/nifi-current/./lib/jetty-schemas-3.1.jar:/opt/nifi/nifi-current/./lib/slf4j-api-1.7.30.jar:/opt/nifi/nifi-current/./lib/nifi-stateless-api-1.14.0.jar:/opt/nifi/nifi-current/./lib/nifi-properties-1.14.0.jar -Dorg.apache.jasper.compiler.disablejsr199=true -Xmx512m -Xms512m -Dcurator-log-only-first-connection-issue-as-error-level=true -Djavax.security.auth.useSubjectCredsOnly=true -Djava.security.egd=file:/dev/urandom -Dzookeeper.admin.enableServer=false -Dsun.net.http.allowRestrictedHeaders=true -Djava.net.preferIPv4Stack=true -Djava.awt.headless=true -Djava.protocol.handler.pkgs=sun.net.www.protocol -Dnifi.properties.file.path=/opt/nifi/nifi-current/./conf/nifi.properties -Dnifi.bootstrap.listen.port=40717 -Dapp=NiFi -Dorg.apache.nifi.bootstrap.config.log.dir=/opt/nifi/nifi-current/logs org.apache.nifi.NiFi
2021-10-18 13:17:22,879 INFO [main] org.apache.nifi.bootstrap.Command Launched Apache NiFi with Process ID 95
2021-10-18 13:17:23,095 INFO [main] org.apache.nifi.NiFi Launching NiFi...
2021-10-18 13:17:23,356 INFO [main] o.a.n.p.AbstractBootstrapPropertiesLoader Determined default application properties path to be '/opt/nifi/nifi-current/./conf/nifi.properties'
2021-10-18 13:17:23,361 INFO [main] o.a.nifi.properties.NiFiPropertiesLoader Loaded 202 properties from /opt/nifi/nifi-current/./conf/nifi.properties
2021-10-18 13:17:23,368 ERROR [main] o.a.nifi.properties.NiFiPropertiesLoader Flow Configuration [./conf/flow.xml.gz] Found: Migration Required for blank Sensitive Properties Key [nifi.sensitive.props.key]
2021-10-18 13:17:23,369 ERROR [main] org.apache.nifi.NiFi Failure to launch NiFi due to java.lang.IllegalArgumentException: There was an issue decrypting protected properties
java.lang.IllegalArgumentException: There was an issue decrypting protected properties
at org.apache.nifi.NiFi.initializeProperties(NiFi.java:346)
at org.apache.nifi.NiFi.convertArgumentsToValidatedNiFiProperties(NiFi.java:314)
at org.apache.nifi.NiFi.convertArgumentsToValidatedNiFiProperties(NiFi.java:310)
at org.apache.nifi.NiFi.main(NiFi.java:302)
Caused by: org.apache.nifi.properties.SensitivePropertyProtectionException: Sensitive Properties Key [nifi.sensitive.props.key] not found: See Admin Guide section [Updating the Sensitive Properties Key]
at org.apache.nifi.properties.NiFiPropertiesLoader.getDefaultProperties(NiFiPropertiesLoader.java:226)
at org.apache.nifi.properties.NiFiPropertiesLoader.get(NiFiPropertiesLoader.java:209)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.nifi.NiFi.initializeProperties(NiFi.java:341)
... 3 common frames omitted
Anybody understand what's going on?
Is there anything I can do to recover my flowfile?
Jean-Sébastien Vachon
Co-Founder & Architect
Brizo Data, Inc.
www.brizodata.com<https://outlook.office365.com/mail/options/mail/messageContent/www.brizodata.com>
Re: Trouble starting docker container
Posted by Jean-Sebastien Vachon <js...@brizodata.com>.
I was able to recover the flow.xml.gz file from the container using this command:
sudo docker cp nifi:/opt/nifi/nifi-current/conf/flow.xml.gz .
But I can't seem to be able to use it in another container by mounting it as a volume.
A new Nifi 1.14 based container will give me about the same error:
2021-10-18 14:43:15,660 ERROR [main] o.a.nifi.properties.NiFiPropertiesLoader Flow Configuration [./conf/flow.xml.gz] Found: Migration Required for blank Sensitive Properties Key [nifi.sensitive.props.key]
2021-10-18 14:43:15,662 ERROR [main] org.apache.nifi.NiFi Failure to launch NiFi due to java.lang.IllegalArgumentException: There was an issue decrypting protected properties
java.lang.IllegalArgumentException: There was an issue decrypting protected properties
at org.apache.nifi.NiFi.initializeProperties(NiFi.java:346)
at org.apache.nifi.NiFi.convertArgumentsToValidatedNiFiProperties(NiFi.java:314)
at org.apache.nifi.NiFi.convertArgumentsToValidatedNiFiProperties(NiFi.java:310)
at org.apache.nifi.NiFi.main(NiFi.java:302)
Caused by: org.apache.nifi.properties.SensitivePropertyProtectionException: Sensitive Properties Key [nifi.sensitive.props.key] not found: See Admin Guide section [Updating the Sensitive Properties Key]
at org.apache.nifi.properties.NiFiPropertiesLoader.getDefaultProperties(NiFiPropertiesLoader.java:226)
at org.apache.nifi.properties.NiFiPropertiesLoader.get(NiFiPropertiesLoader.java:209)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.nifi.NiFi.initializeProperties(NiFi.java:341)
... 3 common frames omitted
I also tried using the flowfile with a previous version of Nifi... Nifi wants to start but then complain about this:
021-10-18 14:53:09,727 INFO [main] org.eclipse.jetty.server.Server Started @27643ms
2021-10-18 14:53:09,727 WARN [main] org.apache.nifi.web.server.JettyServer Failed to start web server... shutting down.
...
org.apache.nifi.web.NiFiCoreException: Unable to start Flow Controller.
Caused by: java.nio.file.FileSystemException: ./conf/flow.xml.gz: Device or resource busy
Is there any way to move a flow.xml.gz from a machine to another?
Jean-Sébastien Vachon
Co-Founder & Architect
Brizo Data, Inc.
www.brizodata.com<https://outlook.office365.com/mail/options/mail/messageContent/www.brizodata.com>
________________________________
From: Jean-Sebastien Vachon <js...@brizodata.com>
Sent: Monday, October 18, 2021 9:24 AM
To: users@nifi.apache.org <us...@nifi.apache.org>
Subject: Trouble starting docker container
Hi all,
I used an instance of Nifi 1.14 last friday (single user with password) and everything was fine until this morning.
My PC was rebooted over the weekend and now I can't restart the container at all.
Java home: /usr/local/openjdk-8
NiFi home: /opt/nifi/nifi-current
Bootstrap Config File: /opt/nifi/nifi-current/conf/bootstrap.conf
2021-10-18 13:17:22,856 INFO [main] org.apache.nifi.bootstrap.Command Starting Apache NiFi...
2021-10-18 13:17:22,856 INFO [main] org.apache.nifi.bootstrap.Command Working Directory: /opt/nifi/nifi-current
2021-10-18 13:17:22,856 INFO [main] org.apache.nifi.bootstrap.Command Command: /usr/local/openjdk-8/bin/java -classpath /opt/nifi/nifi-current/./conf:/opt/nifi/nifi-current/./lib/logback-core-1.2.3.jar:/opt/nifi/nifi-current/./lib/nifi-framework-api-1.14.0.jar:/opt/nifi/nifi-current/./lib/nifi-runtime-1.14.0.jar:/opt/nifi/nifi-current/./lib/javax.servlet-api-3.1.0.jar:/opt/nifi/nifi-current/./lib/log4j-over-slf4j-1.7.30.jar:/opt/nifi/nifi-current/./lib/nifi-property-utils-1.14.0.jar:/opt/nifi/nifi-current/./lib/nifi-api-1.14.0.jar:/opt/nifi/nifi-current/./lib/jul-to-slf4j-1.7.30.jar:/opt/nifi/nifi-current/./lib/nifi-nar-utils-1.14.0.jar:/opt/nifi/nifi-current/./lib/jcl-over-slf4j-1.7.30.jar:/opt/nifi/nifi-current/./lib/nifi-stateless-bootstrap-1.14.0.jar:/opt/nifi/nifi-current/./lib/logback-classic-1.2.3.jar:/opt/nifi/nifi-current/./lib/nifi-server-api-1.14.0.jar:/opt/nifi/nifi-current/./lib/jetty-schemas-3.1.jar:/opt/nifi/nifi-current/./lib/slf4j-api-1.7.30.jar:/opt/nifi/nifi-current/./lib/nifi-stateless-api-1.14.0.jar:/opt/nifi/nifi-current/./lib/nifi-properties-1.14.0.jar -Dorg.apache.jasper.compiler.disablejsr199=true -Xmx512m -Xms512m -Dcurator-log-only-first-connection-issue-as-error-level=true -Djavax.security.auth.useSubjectCredsOnly=true -Djava.security.egd=file:/dev/urandom -Dzookeeper.admin.enableServer=false -Dsun.net.http.allowRestrictedHeaders=true -Djava.net.preferIPv4Stack=true -Djava.awt.headless=true -Djava.protocol.handler.pkgs=sun.net.www.protocol -Dnifi.properties.file.path=/opt/nifi/nifi-current/./conf/nifi.properties -Dnifi.bootstrap.listen.port=40717 -Dapp=NiFi -Dorg.apache.nifi.bootstrap.config.log.dir=/opt/nifi/nifi-current/logs org.apache.nifi.NiFi
2021-10-18 13:17:22,879 INFO [main] org.apache.nifi.bootstrap.Command Launched Apache NiFi with Process ID 95
2021-10-18 13:17:23,095 INFO [main] org.apache.nifi.NiFi Launching NiFi...
2021-10-18 13:17:23,356 INFO [main] o.a.n.p.AbstractBootstrapPropertiesLoader Determined default application properties path to be '/opt/nifi/nifi-current/./conf/nifi.properties'
2021-10-18 13:17:23,361 INFO [main] o.a.nifi.properties.NiFiPropertiesLoader Loaded 202 properties from /opt/nifi/nifi-current/./conf/nifi.properties
2021-10-18 13:17:23,368 ERROR [main] o.a.nifi.properties.NiFiPropertiesLoader Flow Configuration [./conf/flow.xml.gz] Found: Migration Required for blank Sensitive Properties Key [nifi.sensitive.props.key]
2021-10-18 13:17:23,369 ERROR [main] org.apache.nifi.NiFi Failure to launch NiFi due to java.lang.IllegalArgumentException: There was an issue decrypting protected properties
java.lang.IllegalArgumentException: There was an issue decrypting protected properties
at org.apache.nifi.NiFi.initializeProperties(NiFi.java:346)
at org.apache.nifi.NiFi.convertArgumentsToValidatedNiFiProperties(NiFi.java:314)
at org.apache.nifi.NiFi.convertArgumentsToValidatedNiFiProperties(NiFi.java:310)
at org.apache.nifi.NiFi.main(NiFi.java:302)
Caused by: org.apache.nifi.properties.SensitivePropertyProtectionException: Sensitive Properties Key [nifi.sensitive.props.key] not found: See Admin Guide section [Updating the Sensitive Properties Key]
at org.apache.nifi.properties.NiFiPropertiesLoader.getDefaultProperties(NiFiPropertiesLoader.java:226)
at org.apache.nifi.properties.NiFiPropertiesLoader.get(NiFiPropertiesLoader.java:209)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.nifi.NiFi.initializeProperties(NiFi.java:341)
... 3 common frames omitted
Anybody understand what's going on?
Is there anything I can do to recover my flowfile?
Jean-Sébastien Vachon
Co-Founder & Architect
Brizo Data, Inc.
www.brizodata.com<https://outlook.office365.com/mail/options/mail/messageContent/www.brizodata.com>