You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/04 13:01:13 UTC

[GitHub] [beam] damccorm opened a new issue, #19753: Provide a way for user code to read dataflow runner stats

damccorm opened a new issue, #19753:
URL: https://github.com/apache/beam/issues/19753

   The dataflow runner collects (and publishes to the dataflow service) a large number of useful stats.  While these can be polled from the dataflow service via its API, there are a few downsides to this:
    * it requires another process to poll and collect the stats
    * the stats are aggregated across all workers, so per-worker stats are lost
   
   It would be simple to provide a hook to allow users to receive stats updates as well, and then do whatever they want with them.
   
   Imported from Jira [BEAM-7605](https://issues.apache.org/jira/browse/BEAM-7605). Original Jira may contain additional context.
   Reported by: SteveNiemitz.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org