You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by lg...@apache.org on 2019/03/20 10:44:50 UTC

[beam] branch master updated (3beb96d -> 2ea09d5)

This is an automated email from the ASF dual-hosted git repository.

lgajowy pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from 3beb96d  Merge pull request #8087 [BEAM-6864] Pass JobInfo to PortablePipelineRunner.run
     new 521f1ee  [BEAM-6627] Refactor metric gathering mechanism to be more flexible
     new 846d595  [BEAM-6627] Added metrics to ParquetIOIT
     new f7289a6  [BEAM-6627] Added metrics to AvroIOIT
     new b99ebf8  [BEAM-6627] Added metrics to TFRecordIOIT, refactored namespace names
     new 0d10188  [BEAM-6627] Added metrics to XmlIOIT
     new fa72398  [BEAM-6627] Added metric reporting to all file based test jobs
     new 2ea09d5  Merge pull request #8028: [Beam-6627] add metrics to file based tests

The 20625 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../job_PerformanceTests_FileBasedIO_IT.groovy     | 10 ++-
 ...job_PerformanceTests_FileBasedIO_IT_HDFS.groovy |  6 ++
 .../java/org/apache/beam/sdk/io/avro/AvroIOIT.java | 64 ++++++++++++++-
 .../org/apache/beam/sdk/io/common/IOITMetrics.java | 63 ++++++++++++++
 .../apache/beam/sdk/io/parquet/ParquetIOIT.java    | 69 +++++++++++++++-
 .../java/org/apache/beam/sdk/io/text/TextIOIT.java | 96 ++++++++++++----------
 .../apache/beam/sdk/io/tfrecord/TFRecordIOIT.java  | 65 ++++++++++++++-
 .../java/org/apache/beam/sdk/io/xml/XmlIOIT.java   | 71 +++++++++++++++-
 .../beam/sdk/testutils/metrics/MetricsReader.java  | 18 +++-
 .../publishing/ConsoleResultPublisher.java         |  4 +-
 10 files changed, 411 insertions(+), 55 deletions(-)
 create mode 100644 sdks/java/io/file-based-io-tests/src/test/java/org/apache/beam/sdk/io/common/IOITMetrics.java