You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ro...@apache.org on 2025/03/13 21:26:22 UTC
(beam) branch master updated (5950a17fdf8 -> a00f1840935)
This is an automated email from the ASF dual-hosted git repository.
robertwb pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 5950a17fdf8 Update join beam doc (#34284)
add 8f7513aee3c Update Lineage to use BoundedTrie
add 8b420bd5412 Update IOs to work with Lineage based on BoundedTrie
add 5a7311c5fcd Escape last segment path as whole
add df98cbc433e Fix comments
new a00f1840935 Merge pull request #33891 Use BoundedTrie metric to track lineage in IO.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../java/org/apache/beam/sdk/metrics/Lineage.java | 197 +++++++++++++--------
.../org/apache/beam/sdk/metrics/LineageTest.java | 64 +++++--
.../sdk/extensions/gcp/storage/GcsFileSystem.java | 2 +-
.../extensions/gcp/storage/GcsFileSystemTest.java | 2 +-
.../apache/beam/sdk/io/aws2/s3/S3FileSystem.java | 2 +-
.../beam/sdk/io/aws2/s3/S3FileSystemTest.java | 2 +-
.../azure/blobstore/AzureBlobStoreFileSystem.java | 5 +-
.../blobstore/AzureBlobStoreFileSystemTest.java | 2 +-
.../sdk/io/gcp/pubsub/PreparePubsubWriteDoFn.java | 6 +-
.../apache/beam/sdk/io/gcp/pubsub/PubsubIO.java | 5 +-
.../beam/sdk/io/gcp/bigtable/BigtableReadIT.java | 5 +-
.../beam/sdk/io/gcp/bigtable/BigtableWriteIT.java | 4 +-
.../beam/sdk/io/gcp/spanner/SpannerIOReadTest.java | 50 ++----
.../sdk/io/gcp/spanner/SpannerIOWriteTest.java | 77 ++------
.../org/apache/beam/sdk/io/jdbc/JdbcIOTest.java | 11 +-
15 files changed, 223 insertions(+), 211 deletions(-)
(beam) 01/01: Merge pull request #33891 Use BoundedTrie metric to track lineage in IO.
Posted by ro...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
robertwb pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
commit a00f1840935c785dcd1beb99b67fb28077fcb205
Merge: 5950a17fdf8 df98cbc433e
Author: Robert Bradshaw <ro...@gmail.com>
AuthorDate: Thu Mar 13 14:26:16 2025 -0700
Merge pull request #33891 Use BoundedTrie metric to track lineage in IO.
.../java/org/apache/beam/sdk/metrics/Lineage.java | 197 +++++++++++++--------
.../org/apache/beam/sdk/metrics/LineageTest.java | 64 +++++--
.../sdk/extensions/gcp/storage/GcsFileSystem.java | 2 +-
.../extensions/gcp/storage/GcsFileSystemTest.java | 2 +-
.../apache/beam/sdk/io/aws2/s3/S3FileSystem.java | 2 +-
.../beam/sdk/io/aws2/s3/S3FileSystemTest.java | 2 +-
.../azure/blobstore/AzureBlobStoreFileSystem.java | 5 +-
.../blobstore/AzureBlobStoreFileSystemTest.java | 2 +-
.../sdk/io/gcp/pubsub/PreparePubsubWriteDoFn.java | 6 +-
.../apache/beam/sdk/io/gcp/pubsub/PubsubIO.java | 5 +-
.../beam/sdk/io/gcp/bigtable/BigtableReadIT.java | 5 +-
.../beam/sdk/io/gcp/bigtable/BigtableWriteIT.java | 4 +-
.../beam/sdk/io/gcp/spanner/SpannerIOReadTest.java | 50 ++----
.../sdk/io/gcp/spanner/SpannerIOWriteTest.java | 77 ++------
.../org/apache/beam/sdk/io/jdbc/JdbcIOTest.java | 11 +-
15 files changed, 223 insertions(+), 211 deletions(-)