You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by lg...@apache.org on 2019/03/08 10:47:55 UTC

[beam] branch master updated (971787f -> 957b7cc)

This is an automated email from the ASF dual-hosted git repository.

lgajowy pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from 971787f  Merge pull request #7819 [BEAM-6655] Initial support for progress reporting over the FnAPI.
     new 215431e  [BEAM-6627] Added Metrics API processing time reporting to TextIOIT
     new f62b38e  [BEAM-6627] Moved ByteMonitor, TimeMonitor and ConsoleResultPublisher to testutils
     new 7432e6d  [BEAM-6627] Refactored publishing records to BQ, added an option to report GCS performance metrics to file based IO tests
     new ba858ce  [BEAM-6627] Enabled metric reporting on all TextIOIT tests
     new a18613e  [BEAM-6627] Added run_time metric reporting
     new 957b7cc  Merge pull request #7772: [BEAM-6627] Added Metrics API processing time reporting to TextIOIT

The 20437 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../job_PerformanceTests_FileBasedIO_IT.groovy     |  5 ++
 ...job_PerformanceTests_FileBasedIO_IT_HDFS.groovy |  8 +++
 .../io/common/FileBasedIOTestPipelineOptions.java  |  6 ++
 .../java/org/apache/beam/sdk/io/text/TextIOIT.java | 74 +++++++++++++++++-----
 .../beam/sdk/loadtests/CoGroupByKeyLoadTest.java   |  2 +-
 .../apache/beam/sdk/loadtests/CombineLoadTest.java |  7 +-
 .../beam/sdk/loadtests/GroupByKeyLoadTest.java     |  2 +-
 .../org/apache/beam/sdk/loadtests/LoadTest.java    |  5 +-
 .../apache/beam/sdk/loadtests/ParDoLoadTest.java   |  2 +-
 .../beam/sdk/loadtests/metrics/package-info.java   | 19 ------
 .../beam/sdk/testutils}/metrics/ByteMonitor.java   |  5 +-
 .../beam/sdk/testutils}/metrics/TimeMonitor.java   |  8 +--
 .../publishing}/ConsoleResultPublisher.java        |  6 +-
 13 files changed, 94 insertions(+), 55 deletions(-)
 delete mode 100644 sdks/java/testing/load-tests/src/main/java/org/apache/beam/sdk/loadtests/metrics/package-info.java
 rename sdks/java/testing/{load-tests/src/main/java/org/apache/beam/sdk/loadtests => test-utils/src/main/java/org/apache/beam/sdk/testutils}/metrics/ByteMonitor.java (92%)
 rename sdks/java/testing/{load-tests/src/main/java/org/apache/beam/sdk/loadtests => test-utils/src/main/java/org/apache/beam/sdk/testutils}/metrics/TimeMonitor.java (87%)
 rename sdks/java/testing/{load-tests/src/main/java/org/apache/beam/sdk/loadtests => test-utils/src/main/java/org/apache/beam/sdk/testutils/publishing}/ConsoleResultPublisher.java (88%)