Creating dependency between multiple process groups in Nifi

[Samarendra Sahoo <sa...@gmail.com>]

We have following process groups (PG). The way we want to orchestrate: once
PG1 runs all remaining PGs should run in parallel. Could you pls suggest?

1) PG1 - Extract data from Source DB (Source1), Curate data and load to
target DB (Target1)
2) PG2 - Extract data from Source (Source2), Lookup against Data in Target1
and load to Target DB (Target2)
3) PG3 - Extract data from Source (Source3), Lookup against Data in Target1
and load to Target DB (Target3)
4) PG4 - Extract data from Source (Source4), Lookup against Data in Target1
and load to Target DB (Target4)

Best regards
Samarendra

Re: Creating dependency between multiple process groups in Nifi

[Joe Witt <jo...@gmail.com>]

PG1 should load data into Target1 then send the data to PG1-out.

PG1-out should then be sent to PG2/3/4-In at the same time.

PG2/3/4 is triggered by arrival of this data and does its full DB
lookup/etc.. to do its thing.

It sounds like the vital point here is you want to ensure each time Target1
is loaded the other three fire.  This should do it

On Wed, Mar 25, 2020 at 9:48 AM Samarendra Sahoo <sa...@gmail.com>
wrote:

> We have following process groups (PG). The way we want to orchestrate:
> once PG1 runs all remaining PGs should run in parallel. Could you pls
> suggest?
>
> 1) PG1 - Extract data from Source DB (Source1), Curate data and load to
> target DB (Target1)
> 2) PG2 - Extract data from Source (Source2), Lookup against Data in
> Target1 and load to Target DB (Target2)
> 3) PG3 - Extract data from Source (Source3), Lookup against Data in
> Target1 and load to Target DB (Target3)
> 4) PG4 - Extract data from Source (Source4), Lookup against Data in
> Target1 and load to Target DB (Target4)
>
> Best regards
> Samarendra
>