Re: Nifi Database repository backup & restore

[Koji Kawamura <ij...@gmail.com>]

Hi Ganesh,

What did you mean by following statement? Would you elaborate what is
expected and how it behaved actually?
> Nifi is not processing flow from the point where it got stopped or crashed .

Some processor needs "state" get restored in addition to FlowFiles.
States are stored in Zookeeper or in local file system. Does your test
recover these files, too?

Thanks,
Koji

On Thu, Oct 10, 2019 at 3:10 PM Ganesh, B (Nokia - IN/Bangalore)
<b....@nokia.com> wrote:
>
> Hi ,
>
> we are trying to test a disaster recovery with the backup/restore feature.
> We could see that the flowfile and database volume are restored but Nifi is not processing flow from the point where it got stopped or crashed .
>
> Any one have tested the above scenario ?
>
> Thanks & Regards,
> Ganesh.B

Re: Nifi Database repository backup & restore

[Koji Kawamura <ij...@gmail.com>]

Hi Ganesh,

Thanks for the update. But it's still unclear to me about following points:
1. What files did you back up and restore exactly? If you can share
how did you take backup and restore with granular details such as
exact command list, then I can try reproducing the issue on my end. I
have successfully taken backups and restored them.
2. Did you see any error message or logs telling NiFi flow didn't run
successfully? Please share error messages you faced.

Thanks,
Koji

On Fri, Oct 11, 2019 at 3:36 PM Ganesh, B (Nokia - IN/Bangalore)
<b....@nokia.com> wrote:
>
> Hi Koji ,
>
> I scenario is like below
>
> 1. Install Nifi and run the processor to getHttp CSV ->convert to Json -->put file
> 2. Take backup of data ( using one of the backup and restore technique)
> 3. login to the Nifi pod and delete the flow_file_repository & data_base_repository folders .
> 3. restore the same
>
> But Nifi flow is failed to process data .
>
> Have you ever tried this scenario ? If you tried please let me know .
>
> Thanks & Regards,
> Ganesh.B
>
>
> -----Original Message-----
> From: Koji Kawamura <ij...@gmail.com>
> Sent: Friday, October 11, 2019 11:13 AM
> To: dev <de...@nifi.apache.org>
> Subject: Re: Nifi Database repository backup & restore
>
> Hi Ganesh,
>
> What did you mean by following statement? Would you elaborate what is expected and how it behaved actually?
> > Nifi is not processing flow from the point where it got stopped or crashed .
>
> Some processor needs "state" get restored in addition to FlowFiles.
> States are stored in Zookeeper or in local file system. Does your test recover these files, too?
>
> Thanks,
> Koji
>
> On Thu, Oct 10, 2019 at 3:10 PM Ganesh, B (Nokia - IN/Bangalore) <b....@nokia.com> wrote:
> >
> > Hi ,
> >
> > we are trying to test a disaster recovery with the backup/restore feature.
> > We could see that the flowfile and database volume are restored but Nifi is not processing flow from the point where it got stopped or crashed .
> >
> > Any one have tested the above scenario ?
> >
> > Thanks & Regards,
> > Ganesh.B

RE: Nifi Database repository backup & restore

["Ganesh, B (Nokia - IN/Bangalore)" <b....@nokia.com>]

Hi Koji ,

I scenario is like below 

1. Install Nifi and run the processor to getHttp CSV ->convert to Json -->put file 
2. Take backup of data ( using one of the backup and restore technique)
3. login to the Nifi pod and delete the flow_file_repository & data_base_repository folders .
3. restore the same 

But Nifi flow is failed to process data .

Have you ever tried this scenario ? If you tried please let me know .

Thanks & Regards,
Ganesh.B 


-----Original Message-----
From: Koji Kawamura <ij...@gmail.com> 
Sent: Friday, October 11, 2019 11:13 AM
To: dev <de...@nifi.apache.org>
Subject: Re: Nifi Database repository backup & restore

Hi Ganesh,

What did you mean by following statement? Would you elaborate what is expected and how it behaved actually?
> Nifi is not processing flow from the point where it got stopped or crashed .

Some processor needs "state" get restored in addition to FlowFiles.
States are stored in Zookeeper or in local file system. Does your test recover these files, too?

Thanks,
Koji

On Thu, Oct 10, 2019 at 3:10 PM Ganesh, B (Nokia - IN/Bangalore) <b....@nokia.com> wrote:
>
> Hi ,
>
> we are trying to test a disaster recovery with the backup/restore feature.
> We could see that the flowfile and database volume are restored but Nifi is not processing flow from the point where it got stopped or crashed .
>
> Any one have tested the above scenario ?
>
> Thanks & Regards,
> Ganesh.B