You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@nifi.apache.org by Darren Govoni <da...@ontrenet.com> on 2021/08/29 11:57:28 UTC

PYFI Logical Processors

Hi!
   I've added some more information about PYFI logical processors (derived from notion of Nifi processors) here:

https://github.com/radiantone/pyfi#logical-processors

One cool feature of PYFI processors is that they can be scaled or moved from one server to another (even while running) and queued messages/data/functions still arrive reliably, wherever clusters of those processors exist. Even after server or process restarts.

It's not in the README yet, but each processor streams logs on various channels in real-time (websockets). You can listen to a specific processor, for example, using the CLI and get streaming telemetry.

$ pyfi listen --name pyfi.queue1.proc1 --server localhost --channel task

Cheers!