You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2024/04/24 03:53:44 UTC
(beam) branch nightly-refs/heads/master updated (37609ba70fa -> 485c5198384)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 37609ba70fa Managed Transform protos & translation; Iceberg SchemaTransforms & translation (#30910)
add de665b77d9f [YAML] - Normalize YAML PubSub format (#31068)
add ba7ea856ffe Revert "Change type for UnboundedReaderMaxReadTimeSec (#31037)" (#31082)
add 58bea3f19e5 Fix building release candidate (#31084)
add ab27f6f0358 Refactor Residuals to prepare for processing time scheduling. (#31057)
add 1ebd5039a97 Simplify intermediate data in Iceberg sink; use manifest files
add 485c5198384 Merge pull request #31086: Simplify intermediate data in Iceberg sink; use manifest files
No new revisions were added by this update.
Summary of changes:
.github/workflows/build_release_candidate.yml | 10 +-
.../options/DataflowPipelineDebugOptions.java | 9 +-
.../dataflow/worker/WorkerCustomSources.java | 4 +-
.../dataflow/worker/WorkerCustomSourcesTest.java | 7 +-
.../prism/internal/engine/elementmanager.go | 110 ++++++-----
.../prism/internal/engine/elementmanager_test.go | 18 +-
sdks/go/pkg/beam/runners/prism/internal/stage.go | 48 +++--
sdks/java/io/iceberg/build.gradle | 1 -
.../beam/sdk/io/iceberg/AppendFilesToTables.java | 2 +-
.../beam/sdk/io/iceberg/FileWriteResult.java | 210 ++++-----------------
.../apache/beam/sdk/io/iceberg/RecordWriter.java | 20 +-
.../sdk/io/iceberg/WriteGroupedRowsToFiles.java | 3 +-
.../sdk/io/iceberg/WriteUngroupedRowsToFiles.java | 5 +-
.../beam/sdk/io/iceberg/FileWriteResultTest.java | 166 ----------------
sdks/python/apache_beam/yaml/yaml_io.py | 39 ++--
sdks/python/apache_beam/yaml/yaml_io_test.py | 30 +--
.../www/site/content/en/documentation/sdks/yaml.md | 14 +-
17 files changed, 234 insertions(+), 462 deletions(-)
delete mode 100644 sdks/java/io/iceberg/src/test/java/org/apache/beam/sdk/io/iceberg/FileWriteResultTest.java