You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by Tomislav Novosel <to...@clearpeaks.com> on 2021/09/21 19:44:34 UTC
MiNiFi agent cannot update flow configuration
Hi to all,
I'm using MiNiFi 1.14.0 with configured change ingestor to pull from HTTP C2 server
whenever there is a change in configuration (change in NiFi flow that suppose to be running
on MiNiFi).
MiNiFi agent is running on Raspberry Pi 3 with enough disk space.
When I make a change and save the new template with the name template_name.v2, C2 pulls it,
saves it into ./cache folder and sends it to MiNiFi agent.
Then in MiNiFi agent log I have this error:
2021-09-21 12:54:26,456 ERROR [MiNiFi logging handler] org.apache.nifi.minifi.StdErr Failed to start flow service: Unable to load flow due to: java.lang.RuntimeException: Unable to create Provenance Repository
2021-09-21 12:54:26,457 ERROR [MiNiFi logging handler] org.apache.nifi.minifi.StdErr Shutting down...
2021-09-21 12:54:27,384 INFO [main] o.apache.nifi.minifi.bootstrap.RunMiNiFi Swap file exists, MiNiFi failed trying to change configuration. Reverting to old configuration.
2021-09-21 12:54:27,425 INFO [main] o.apache.nifi.minifi.bootstrap.RunMiNiFi Replacing config file with swap file and deleting swap file
2021-09-21 12:54:27,444 INFO [main] o.apache.nifi.minifi.bootstrap.RunMiNiFi Successfully spawned the thread to start Apache MiNiFi with PID 64002
2021-09-21 12:54:29,384 INFO [MiNiFi Bootstrap Command Listener] o.apache.nifi.minifi.bootstrap.RunMiNiFi The thread to run Apache MiNiFi is now running and listening for Bootstrap requests on port 38889
It cannot change the configuration flow because it cannot create Provenance Repository, and then
reverts to old configuration of the flow.
I tried to delete all the files in ./provenance_repository folder, and start it again, but the same happens.
Does anybody know why is this?
Thanks in advance,
Regards,
Tom
RE: MiNiFi agent cannot update flow configuration
Posted by Tomislav Novosel <to...@clearpeaks.com>.
Hi Matt,
I will try with different implementations of Provenanve repo, unit now I used default one: org.apache.nifi.provenance.MiNiFiPersistentProvenanceRepository.
Regarding C2 server, I downloaded version 0.5.0 here: https://nifi.apache.org/minifi/download.html , at the bottom of the page.
Where can I download 1.14.0 version?
Thanks,
Tom
-----Original Message-----
From: Matt Burgess <ma...@apache.org>
Sent: 21 September 2021 21:51
To: users@nifi.apache.org
Subject: Re: MiNiFi agent cannot update flow configuration
Tom,
Which implementation of the Provenance Repository are you using? If not the VolatileProvenanceRepository, can you try that as a workaround? Also are you using the 1.14.0 version of the C2 server?
Regards,
Matt
On Tue, Sep 21, 2021 at 3:45 PM Tomislav Novosel <to...@clearpeaks.com> wrote:
>
> Hi to all,
>
>
> I'm using MiNiFi 1.14.0 with configured change ingestor to pull from
> HTTP C2 server whenever there is a change in configuration (change in
> NiFi flow that suppose to be running on MiNiFi).
>
> MiNiFi agent is running on Raspberry Pi 3 with enough disk space.
>
>
> When I make a change and save the new template with the name
> template_name.v2, C2 pulls it, saves it into ./cache folder and sends it to MiNiFi agent.
>
>
> Then in MiNiFi agent log I have this error:
>
>
>
> 2021-09-21 12:54:26,456 ERROR [MiNiFi logging handler]
> org.apache.nifi.minifi.StdErr Failed to start flow service: Unable to
> load flow due to: java.lang.RuntimeException: Unable to create
> Provenance Repository
> 2021-09-21 12:54:26,457 ERROR [MiNiFi logging handler] org.apache.nifi.minifi.StdErr Shutting down...
> 2021-09-21 12:54:27,384 INFO [main] o.apache.nifi.minifi.bootstrap.RunMiNiFi Swap file exists, MiNiFi failed trying to change configuration. Reverting to old configuration.
> 2021-09-21 12:54:27,425 INFO [main]
> o.apache.nifi.minifi.bootstrap.RunMiNiFi Replacing config file with
> swap file and deleting swap file
> 2021-09-21 12:54:27,444 INFO [main]
> o.apache.nifi.minifi.bootstrap.RunMiNiFi Successfully spawned the
> thread to start Apache MiNiFi with PID 64002
> 2021-09-21 12:54:29,384 INFO [MiNiFi Bootstrap Command Listener]
> o.apache.nifi.minifi.bootstrap.RunMiNiFi The thread to run Apache
> MiNiFi is now running and listening for Bootstrap requests on port
> 38889
>
>
>
> It cannot change the configuration flow because it cannot create
> Provenance Repository, and then reverts to old configuration of the flow.
>
> I tried to delete all the files in ./provenance_repository folder, and start it again, but the same happens.
>
>
>
> Does anybody know why is this?
>
>
>
> Thanks in advance,
>
> Regards,
>
> Tom
Re: MiNiFi agent cannot update flow configuration
Posted by Matt Burgess <ma...@apache.org>.
Tom,
Which implementation of the Provenance Repository are you using? If
not the VolatileProvenanceRepository, can you try that as a
workaround? Also are you using the 1.14.0 version of the C2 server?
Regards,
Matt
On Tue, Sep 21, 2021 at 3:45 PM Tomislav Novosel
<to...@clearpeaks.com> wrote:
>
> Hi to all,
>
>
> I'm using MiNiFi 1.14.0 with configured change ingestor to pull from HTTP C2 server
> whenever there is a change in configuration (change in NiFi flow that suppose to be running
> on MiNiFi).
>
> MiNiFi agent is running on Raspberry Pi 3 with enough disk space.
>
>
> When I make a change and save the new template with the name template_name.v2, C2 pulls it,
> saves it into ./cache folder and sends it to MiNiFi agent.
>
>
> Then in MiNiFi agent log I have this error:
>
>
>
> 2021-09-21 12:54:26,456 ERROR [MiNiFi logging handler] org.apache.nifi.minifi.StdErr Failed to start flow service: Unable to load flow due to: java.lang.RuntimeException: Unable to create Provenance Repository
> 2021-09-21 12:54:26,457 ERROR [MiNiFi logging handler] org.apache.nifi.minifi.StdErr Shutting down...
> 2021-09-21 12:54:27,384 INFO [main] o.apache.nifi.minifi.bootstrap.RunMiNiFi Swap file exists, MiNiFi failed trying to change configuration. Reverting to old configuration.
> 2021-09-21 12:54:27,425 INFO [main] o.apache.nifi.minifi.bootstrap.RunMiNiFi Replacing config file with swap file and deleting swap file
> 2021-09-21 12:54:27,444 INFO [main] o.apache.nifi.minifi.bootstrap.RunMiNiFi Successfully spawned the thread to start Apache MiNiFi with PID 64002
> 2021-09-21 12:54:29,384 INFO [MiNiFi Bootstrap Command Listener] o.apache.nifi.minifi.bootstrap.RunMiNiFi The thread to run Apache MiNiFi is now running and listening for Bootstrap requests on port 38889
>
>
>
> It cannot change the configuration flow because it cannot create Provenance Repository, and then
> reverts to old configuration of the flow.
>
> I tried to delete all the files in ./provenance_repository folder, and start it again, but the same happens.
>
>
>
> Does anybody know why is this?
>
>
>
> Thanks in advance,
>
> Regards,
>
> Tom