You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by xi...@apache.org on 2023/05/09 17:15:05 UTC
[beam] branch master updated (6ecd30e858d -> 0ac9fc1e81b)

This is an automated email from the ASF dual-hosted git repository.

xinyu pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


    from 6ecd30e858d Bump cloud.google.com/go/pubsub from 1.30.0 to 1.30.1 in /sdks (#26538)
     add 0ac9fc1e81b #26456 : Basic Transform metric like throughput, watermark progress & latency support for non data shuffle transforms for Samza Runner (#26437)

No new revisions were added by this update.

Summary of changes:
 .../beam/runners/samza/SamzaPipelineOptions.java   |   6 +
 .../org/apache/beam/runners/samza/SamzaRunner.java |   2 +-
 .../apache/beam/runners/samza/TestSamzaRunner.java |   2 +
 .../runners/samza/metrics/SamzaInputMetricOp.java  | 133 +++++++++++++
 .../samza/metrics/SamzaMetricOpFactory.java        |  69 +++++++
 .../runners/samza/metrics/SamzaOutputMetricOp.java | 156 +++++++++++++++
 .../metrics/SamzaTransformMetricRegistry.java      | 142 ++++++++++++++
 .../samza/metrics/SamzaTransformMetrics.java       | 125 ++++++++++++
 .../samza/translation/SamzaPipelineTranslator.java |  10 +
 .../samza/translation/TranslationContext.java      |  90 ++++++++-
 .../runners/samza/util/PipelineJsonRenderer.java   |  43 +++++
 .../TestSamzaRunnerWithTransformMetrics.java       | 210 +++++++++++++++++++++
 .../samza/util/InMemoryMetricsReporter.java        |  38 ++--
 13 files changed, 1002 insertions(+), 24 deletions(-)
 create mode 100644 runners/samza/src/main/java/org/apache/beam/runners/samza/metrics/SamzaInputMetricOp.java
 create mode 100644 runners/samza/src/main/java/org/apache/beam/runners/samza/metrics/SamzaMetricOpFactory.java
 create mode 100644 runners/samza/src/main/java/org/apache/beam/runners/samza/metrics/SamzaOutputMetricOp.java
 create mode 100644 runners/samza/src/main/java/org/apache/beam/runners/samza/metrics/SamzaTransformMetricRegistry.java
 create mode 100644 runners/samza/src/main/java/org/apache/beam/runners/samza/metrics/SamzaTransformMetrics.java
 create mode 100644 runners/samza/src/test/java/org/apache/beam/runners/samza/metrics/TestSamzaRunnerWithTransformMetrics.java
 copy sdks/java/extensions/avro/src/test/java/org/apache/beam/sdk/extensions/avro/coders/AvroCoderTestPojo.java => runners/samza/src/test/java/org/apache/beam/runners/samza/util/InMemoryMetricsReporter.java (53%)