You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ke...@apache.org on 2024/04/12 18:41:11 UTC
(beam) branch master updated (1a0591ea797 -> 96dc16aedb7)
This is an automated email from the ASF dual-hosted git repository.
kenn pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 1a0591ea797 Bump transformers (#30922)
add 631f6e7a832 Fix iceberg dependencies
add 36f32280a1b Refactor iceberg/beam conversions for clarity
add a169e6a2a1c Re-add Iceberg bounded source; test splitting
new 96dc16aedb7 Merge pull request #30805: Re-add iceberg bounded source; test splitting
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
sdks/java/io/iceberg/build.gradle | 15 +-
.../java/org/apache/beam/io/iceberg/IcebergIO.java | 43 ++++
.../apache/beam/io/iceberg/IcebergScanConfig.java | 166 +++++++++++++
.../org/apache/beam/io/iceberg/RecordWriter.java | 3 +-
.../java/org/apache/beam/io/iceberg/RowHelper.java | 100 --------
.../org/apache/beam/io/iceberg/ScanSource.java | 127 ++++++++++
.../org/apache/beam/io/iceberg/ScanTaskReader.java | 186 ++++++++++++++
.../org/apache/beam/io/iceberg/ScanTaskSource.java | 87 +++++++
.../beam/io/iceberg/SchemaAndRowConversions.java | 270 +++++++++++++++++++++
.../org/apache/beam/io/iceberg/SchemaHelper.java | 116 ---------
.../beam/io/iceberg/FileWriteResultTest.java | 10 +-
.../apache/beam/io/iceberg/IcebergIOReadTest.java | 120 +++++++++
.../apache/beam/io/iceberg/IcebergIOWriteTest.java | 10 +-
.../org/apache/beam/io/iceberg/RowHelperTest.java | 128 ----------
.../org/apache/beam/io/iceberg/ScanSourceTest.java | 180 ++++++++++++++
.../io/iceberg/SchemaAndRowConversionsTest.java | 226 +++++++++++++++++
.../org/apache/beam/io/iceberg/TestFixtures.java | 2 +-
17 files changed, 1423 insertions(+), 366 deletions(-)
create mode 100644 sdks/java/io/iceberg/src/main/java/org/apache/beam/io/iceberg/IcebergScanConfig.java
delete mode 100644 sdks/java/io/iceberg/src/main/java/org/apache/beam/io/iceberg/RowHelper.java
create mode 100644 sdks/java/io/iceberg/src/main/java/org/apache/beam/io/iceberg/ScanSource.java
create mode 100644 sdks/java/io/iceberg/src/main/java/org/apache/beam/io/iceberg/ScanTaskReader.java
create mode 100644 sdks/java/io/iceberg/src/main/java/org/apache/beam/io/iceberg/ScanTaskSource.java
create mode 100644 sdks/java/io/iceberg/src/main/java/org/apache/beam/io/iceberg/SchemaAndRowConversions.java
delete mode 100644 sdks/java/io/iceberg/src/main/java/org/apache/beam/io/iceberg/SchemaHelper.java
create mode 100644 sdks/java/io/iceberg/src/test/java/org/apache/beam/io/iceberg/IcebergIOReadTest.java
delete mode 100644 sdks/java/io/iceberg/src/test/java/org/apache/beam/io/iceberg/RowHelperTest.java
create mode 100644 sdks/java/io/iceberg/src/test/java/org/apache/beam/io/iceberg/ScanSourceTest.java
create mode 100644 sdks/java/io/iceberg/src/test/java/org/apache/beam/io/iceberg/SchemaAndRowConversionsTest.java
(beam) 01/01: Merge pull request #30805: Re-add iceberg bounded source; test splitting
Posted by ke...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
kenn pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
commit 96dc16aedb7708cb949ba6308960fb832381165f
Merge: 1a0591ea797 a169e6a2a1c
Author: Kenneth Knowles <ke...@apache.org>
AuthorDate: Fri Apr 12 14:41:05 2024 -0400
Merge pull request #30805: Re-add iceberg bounded source; test splitting
sdks/java/io/iceberg/build.gradle | 15 +-
.../java/org/apache/beam/io/iceberg/IcebergIO.java | 43 ++++
.../apache/beam/io/iceberg/IcebergScanConfig.java | 166 +++++++++++++
.../org/apache/beam/io/iceberg/RecordWriter.java | 3 +-
.../java/org/apache/beam/io/iceberg/RowHelper.java | 100 --------
.../org/apache/beam/io/iceberg/ScanSource.java | 127 ++++++++++
.../org/apache/beam/io/iceberg/ScanTaskReader.java | 186 ++++++++++++++
.../org/apache/beam/io/iceberg/ScanTaskSource.java | 87 +++++++
.../beam/io/iceberg/SchemaAndRowConversions.java | 270 +++++++++++++++++++++
.../org/apache/beam/io/iceberg/SchemaHelper.java | 116 ---------
.../beam/io/iceberg/FileWriteResultTest.java | 10 +-
.../apache/beam/io/iceberg/IcebergIOReadTest.java | 120 +++++++++
.../apache/beam/io/iceberg/IcebergIOWriteTest.java | 10 +-
.../org/apache/beam/io/iceberg/RowHelperTest.java | 128 ----------
.../org/apache/beam/io/iceberg/ScanSourceTest.java | 180 ++++++++++++++
.../io/iceberg/SchemaAndRowConversionsTest.java | 226 +++++++++++++++++
.../org/apache/beam/io/iceberg/TestFixtures.java | 2 +-
17 files changed, 1423 insertions(+), 366 deletions(-)