You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by lg...@apache.org on 2019/03/20 10:44:50 UTC
[beam] branch master updated (3beb96d -> 2ea09d5)
This is an automated email from the ASF dual-hosted git repository.
lgajowy pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 3beb96d Merge pull request #8087 [BEAM-6864] Pass JobInfo to PortablePipelineRunner.run
new 521f1ee [BEAM-6627] Refactor metric gathering mechanism to be more flexible
new 846d595 [BEAM-6627] Added metrics to ParquetIOIT
new f7289a6 [BEAM-6627] Added metrics to AvroIOIT
new b99ebf8 [BEAM-6627] Added metrics to TFRecordIOIT, refactored namespace names
new 0d10188 [BEAM-6627] Added metrics to XmlIOIT
new fa72398 [BEAM-6627] Added metric reporting to all file based test jobs
new 2ea09d5 Merge pull request #8028: [Beam-6627] add metrics to file based tests
The 20625 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../job_PerformanceTests_FileBasedIO_IT.groovy | 10 ++-
...job_PerformanceTests_FileBasedIO_IT_HDFS.groovy | 6 ++
.../java/org/apache/beam/sdk/io/avro/AvroIOIT.java | 64 ++++++++++++++-
.../org/apache/beam/sdk/io/common/IOITMetrics.java | 63 ++++++++++++++
.../apache/beam/sdk/io/parquet/ParquetIOIT.java | 69 +++++++++++++++-
.../java/org/apache/beam/sdk/io/text/TextIOIT.java | 96 ++++++++++++----------
.../apache/beam/sdk/io/tfrecord/TFRecordIOIT.java | 65 ++++++++++++++-
.../java/org/apache/beam/sdk/io/xml/XmlIOIT.java | 71 +++++++++++++++-
.../beam/sdk/testutils/metrics/MetricsReader.java | 18 +++-
.../publishing/ConsoleResultPublisher.java | 4 +-
10 files changed, 411 insertions(+), 55 deletions(-)
create mode 100644 sdks/java/io/file-based-io-tests/src/test/java/org/apache/beam/sdk/io/common/IOITMetrics.java