You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ma...@apache.org on 2019/09/28 19:00:09 UTC
[beam] branch release-2.16.0 updated (9e2e8bc -> a707a11)
This is an automated email from the ASF dual-hosted git repository.
markliu pushed a change to branch release-2.16.0
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 9e2e8bc Merge pull request #9655: [BEAM-8311] Cherry-pick Merge pull request #9601, #9656: Minor fix for python mongodbio display data
add b5f5b81 [BEAM-8314] Add aggregation logic to beam_fn_api metric counter updat… (#9679)
new a707a11 Merge pull request #9682: [BEAM-8314] Add aggregation logic to beam_fn_api metric counter updat…
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../dataflow/worker/DataflowOperationContext.java | 3 +-
.../worker/MetricsToCounterUpdateConverter.java | 1 +
.../dataflow/worker/StreamingDataflowWorker.java | 43 +++++++++-
.../CounterUpdateAggregator.java} | 23 +++---
.../worker/counters/CounterUpdateAggregators.java | 75 +++++++++++++++++
.../DistributionCounterUpdateAggregator.java | 65 +++++++++++++++
.../counters/MeanCounterUpdateAggregator.java | 55 +++++++++++++
.../counters/SumCounterUpdateAggregator.java | 47 +++++++++++
...ntMonitoringInfoToCounterUpdateTransformer.java | 3 +-
...ecMonitoringInfoToCounterUpdateTransformer.java | 3 +-
...ntMonitoringInfoToCounterUpdateTransformer.java | 3 +-
...onMonitoringInfoToCounterUpdateTransformer.java | 3 +-
...erMonitoringInfoToCounterUpdateTransformer.java | 3 +-
.../worker/BatchModeExecutionContextTest.java | 11 +--
.../dataflow/worker/IsmSideInputReaderTest.java | 3 +-
.../worker/StreamingModeExecutionContextTest.java | 5 +-
.../worker/StreamingStepMetricsContainerTest.java | 2 +-
.../dataflow/worker/WorkItemStatusClientTest.java | 9 +-
.../counters/CounterUpdateAggregatorsTest.java | 96 ++++++++++++++++++++++
.../DistributionCounterUpdateAggregatorTest.java | 72 ++++++++++++++++
.../counters/MeanCounterUpdateAggregatorTest.java | 66 +++++++++++++++
.../counters/SumCounterUpdateAggregatorTest.java | 62 ++++++++++++++
22 files changed, 622 insertions(+), 31 deletions(-)
copy runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/{fn/control/MonitoringInfoToCounterUpdateTransformer.java => counters/CounterUpdateAggregator.java} (56%)
create mode 100644 runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/counters/CounterUpdateAggregators.java
create mode 100644 runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/counters/DistributionCounterUpdateAggregator.java
create mode 100644 runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/counters/MeanCounterUpdateAggregator.java
create mode 100644 runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/counters/SumCounterUpdateAggregator.java
create mode 100644 runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/counters/CounterUpdateAggregatorsTest.java
create mode 100644 runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/counters/DistributionCounterUpdateAggregatorTest.java
create mode 100644 runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/counters/MeanCounterUpdateAggregatorTest.java
create mode 100644 runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/counters/SumCounterUpdateAggregatorTest.java
[beam] 01/01: Merge pull request #9682: [BEAM-8314] Add aggregation logic to beam_fn_api metric counter updat…
Posted by ma...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
markliu pushed a commit to branch release-2.16.0
in repository https://gitbox.apache.org/repos/asf/beam.git
commit a707a116226c98325464100bef6062e81ffdc080
Merge: 9e2e8bc b5f5b81
Author: Mark Liu <ma...@apache.org>
AuthorDate: Sat Sep 28 11:59:26 2019 -0700
Merge pull request #9682: [BEAM-8314] Add aggregation logic to beam_fn_api metric counter updat…
[BEAM-8314]: Add aggregation logic to beam_fn_api metric counter updates in StreamingDataflowWorker
.../dataflow/worker/DataflowOperationContext.java | 3 +-
.../worker/MetricsToCounterUpdateConverter.java | 1 +
.../dataflow/worker/StreamingDataflowWorker.java | 43 +++++++++-
.../worker/counters/CounterUpdateAggregator.java | 38 +++++++++
.../worker/counters/CounterUpdateAggregators.java | 75 +++++++++++++++++
.../DistributionCounterUpdateAggregator.java | 65 +++++++++++++++
.../counters/MeanCounterUpdateAggregator.java | 55 +++++++++++++
.../counters/SumCounterUpdateAggregator.java | 47 +++++++++++
...ntMonitoringInfoToCounterUpdateTransformer.java | 3 +-
...ecMonitoringInfoToCounterUpdateTransformer.java | 3 +-
...ntMonitoringInfoToCounterUpdateTransformer.java | 3 +-
...onMonitoringInfoToCounterUpdateTransformer.java | 3 +-
...erMonitoringInfoToCounterUpdateTransformer.java | 3 +-
.../worker/BatchModeExecutionContextTest.java | 11 +--
.../dataflow/worker/IsmSideInputReaderTest.java | 3 +-
.../worker/StreamingModeExecutionContextTest.java | 5 +-
.../worker/StreamingStepMetricsContainerTest.java | 2 +-
.../dataflow/worker/WorkItemStatusClientTest.java | 9 +-
.../counters/CounterUpdateAggregatorsTest.java | 96 ++++++++++++++++++++++
.../DistributionCounterUpdateAggregatorTest.java | 72 ++++++++++++++++
.../counters/MeanCounterUpdateAggregatorTest.java | 66 +++++++++++++++
.../counters/SumCounterUpdateAggregatorTest.java | 62 ++++++++++++++
22 files changed, 647 insertions(+), 21 deletions(-)