You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@beam.apache.org by Kiryl Zhdanovich <kz...@gmail.com> on 2020/11/16 17:00:53 UTC

Reporting counters only if job succeed

Hi,
I'm using java beam version 2.24.0 running on Dataflow. I introduced
counters in the pipeline to be able to monitor its health. Also, I've set
up alerts that notify me if a specific counter is less than x. Sometimes
pipeline fails and I have partially reported counters that cause alerts to
trigger. Is it possible to publish metrics only if the pipeline finishes
successfully?