You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by Vibhath Ileperuma <vi...@gmail.com> on 2021/03/01 05:37:15 UTC
NiFI fronend disconnects after some time
Hi all,
I tried to fetch a large dataset from postgresql using the
ExcureSQL processor.
The configurations I used is,
Fetch Size : 100
Max Rows per flow file 200000
Output Batch Size 1
When I start the processor, after some time, NIFI web frontend disconnects.
I checked the app log, but there were no errors.
I would be grateful if you could suggest to me the reason for this issue
and a way to overcome this.
Thanks & Regards
*Vibhath Ileperuma*
Re: NiFI fronend disconnects after some time
Posted by Vibhath Ileperuma <vi...@gmail.com>.
Hi,
I have configured heap size to 25GB
On Mon, 1 Mar 2021, 12:18 pm Jorge Machado, <jo...@me.com> wrote:
> How much memory do you have on your instance?
> I would say the fetch size should be bigger then the Max Rows…
>
>
> On 1. Mar 2021, at 06:37, Vibhath Ileperuma <vi...@gmail.com>
> wrote:
>
> Hi all,
>
> I tried to fetch a large dataset from postgresql using the
> ExcureSQL processor.
> The configurations I used is,
> Fetch Size : 100
> Max Rows per flow file 200000
> Output Batch Size 1
>
> When I start the processor, after some time, NIFI web frontend
> disconnects. I checked the app log, but there were no errors.
>
> I would be grateful if you could suggest to me the reason for this issue
> and a way to overcome this.
>
>
> Thanks & Regards
>
> *Vibhath Ileperuma*
>
>
>
>
Re: NiFI fronend disconnects after some time
Posted by Jorge Machado <jo...@me.com>.
How much memory do you have on your instance?
I would say the fetch size should be bigger then the Max Rows…
> On 1. Mar 2021, at 06:37, Vibhath Ileperuma <vi...@gmail.com> wrote:
>
> Hi all,
>
> I tried to fetch a large dataset from postgresql using the ExcureSQL processor.
> The configurations I used is,
> Fetch Size : 100
> Max Rows per flow file 200000
> Output Batch Size 1
>
> When I start the processor, after some time, NIFI web frontend disconnects. I checked the app log, but there were no errors.
>
> I would be grateful if you could suggest to me the reason for this issue and a way to overcome this.
>
> Thanks & Regards
> Vibhath Ileperuma
>