You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2023/12/29 03:46:38 UTC
(beam) branch nightly-refs/heads/master updated (2f17526bd4e -> f303d6ae7eb)

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git


    from 2f17526bd4e Add ComputeAndApplyVocabulary and Scale data notebook (#29857)
     add 41bd171a181 Fix race condition in SpannerAccessor (#29820)
     add 50daf7dc438 Use RemoveSafeDeltaCounterCell for PerWorker counters (#29877)
     add 8f58ad12594 fix: Fix typo s/commiting/committing/ (#29880)
     add 783c72a6dce [#29772][Go SDK] Add EventTime Timer tests. (#29829)
     add f303d6ae7eb Add Error Handlers to File IO and related IOs (TextIO, AvroIO) (#29670)

No new revisions were added by this update.

Summary of changes:
 .test-infra/jupyter/README.md                      |   2 +-
 ...erCell.java => RemoveSafeDeltaCounterCell.java} |  59 ++--
 .../worker/StreamingStepMetricsContainer.java      |   7 +-
 .../worker/RemoveSafeDeltaCounterCellTest.java     | 102 +++++++
 sdks/go/pkg/beam/core/runtime/exec/translate.go    |   2 +-
 sdks/go/pkg/beam/core/runtime/exec/window.go       |  18 +-
 sdks/go/pkg/beam/runners/prism/internal/stage.go   |   2 +-
 sdks/go/test/integration/integration.go            |  15 ++
 sdks/go/test/integration/primitives/timers.go      | 152 +++++++++++
 .../primitives/{flatten_test.go => timers_test.go} |  10 +-
 .../main/java/org/apache/beam/sdk/io/FileIO.java   |  43 +++
 .../main/java/org/apache/beam/sdk/io/TextIO.java   |  20 ++
 .../java/org/apache/beam/sdk/io/WriteFiles.java    | 297 +++++++++++++++++----
 .../sdk/transforms/errorhandling/ErrorHandler.java |   4 +
 .../org/apache/beam/sdk/io/WriteFilesTest.java     | 131 +++++++++
 .../errorhandling/ErrorHandlingTestUtils.java      |  48 ++++
 .../apache/beam/sdk/extensions/avro/io/AvroIO.java |  20 ++
 .../beam/sdk/io/gcp/spanner/SpannerAccessor.java   |  55 ++--
 .../org/apache/beam/sdk/io/kafka/KafkaIOIT.java    |   2 +-
 .../org/apache/beam/sdk/io/kafka/KafkaIOTest.java  |  20 +-
 20 files changed, 870 insertions(+), 139 deletions(-)
 copy runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/{DeltaCounterCell.java => RemoveSafeDeltaCounterCell.java} (52%)
 create mode 100644 runners/google-cloud-dataflow-java/worker/src/test/java/org/apache/beam/runners/dataflow/worker/RemoveSafeDeltaCounterCellTest.java
 create mode 100644 sdks/go/test/integration/primitives/timers.go
 copy sdks/go/test/integration/primitives/{flatten_test.go => timers_test.go} (78%)
 create mode 100644 sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/errorhandling/ErrorHandlingTestUtils.java