You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ar...@apache.org on 2021/07/13 12:08:02 UTC
[beam] branch master updated (f9b9ccc -> 5e26d3b)
This is an automated email from the ASF dual-hosted git repository.
aromanenko pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from f9b9ccc Merge pull request #14869 from [BEAM-12357] improve WithKeys transform to take args, kwargs
add 410cad1 Generalize S3FileSystem to support multiple URI schemes.
new 5e26d3b Merge pull request #15036: [BEAM-12435] Generalize S3FileSystem to support multiple URI schemes.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
CHANGES.md | 1 +
...ava => DefaultS3FileSystemSchemeRegistrar.java} | 13 +-
.../apache/beam/sdk/io/aws/s3/S3FileSystem.java | 63 +--
.../sdk/io/aws/s3/S3FileSystemConfiguration.java | 118 +++++
.../beam/sdk/io/aws/s3/S3FileSystemRegistrar.java | 24 +-
.../io/aws/s3/S3FileSystemSchemeRegistrar.java} | 22 +-
.../io/aws/s3/S3ReadableSeekableByteChannel.java | 11 +-
.../apache/beam/sdk/io/aws/s3/S3ResourceId.java | 60 ++-
.../beam/sdk/io/aws/s3/S3WritableByteChannel.java | 35 +-
.../beam/sdk/io/aws/s3/S3FileSystemTest.java | 573 +++++++++++++++++++--
.../beam/sdk/io/aws/s3/S3ResourceIdTest.java | 83 ++-
.../org/apache/beam/sdk/io/aws/s3/S3TestUtils.java | 71 ++-
.../sdk/io/aws/s3/S3WritableByteChannelTest.java | 86 +++-
13 files changed, 997 insertions(+), 163 deletions(-)
copy sdks/java/io/amazon-web-services/src/main/java/org/apache/beam/sdk/io/aws/s3/{S3FileSystemRegistrar.java => DefaultS3FileSystemSchemeRegistrar.java} (77%)
create mode 100644 sdks/java/io/amazon-web-services/src/main/java/org/apache/beam/sdk/io/aws/s3/S3FileSystemConfiguration.java
copy sdks/java/{core/src/main/java/org/apache/beam/sdk/io/FileSystemRegistrar.java => io/amazon-web-services/src/main/java/org/apache/beam/sdk/io/aws/s3/S3FileSystemSchemeRegistrar.java} (59%)
[beam] 01/01: Merge pull request #15036: [BEAM-12435] Generalize
S3FileSystem to support multiple URI schemes.
Posted by ar...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
aromanenko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
commit 5e26d3b87c8b08d59cadb650301d48cff5c54d1c
Merge: f9b9ccc 410cad1
Author: Alexey Romanenko <33...@users.noreply.github.com>
AuthorDate: Tue Jul 13 14:07:09 2021 +0200
Merge pull request #15036: [BEAM-12435] Generalize S3FileSystem to support multiple URI schemes.
CHANGES.md | 1 +
...ava => DefaultS3FileSystemSchemeRegistrar.java} | 13 +-
.../apache/beam/sdk/io/aws/s3/S3FileSystem.java | 63 +--
.../sdk/io/aws/s3/S3FileSystemConfiguration.java | 118 +++++
.../beam/sdk/io/aws/s3/S3FileSystemRegistrar.java | 24 +-
...strar.java => S3FileSystemSchemeRegistrar.java} | 34 +-
.../io/aws/s3/S3ReadableSeekableByteChannel.java | 11 +-
.../apache/beam/sdk/io/aws/s3/S3ResourceId.java | 60 ++-
.../beam/sdk/io/aws/s3/S3WritableByteChannel.java | 35 +-
.../beam/sdk/io/aws/s3/S3FileSystemTest.java | 573 +++++++++++++++++++--
.../beam/sdk/io/aws/s3/S3ResourceIdTest.java | 83 ++-
.../org/apache/beam/sdk/io/aws/s3/S3TestUtils.java | 71 ++-
.../sdk/io/aws/s3/S3WritableByteChannelTest.java | 86 +++-
13 files changed, 1004 insertions(+), 168 deletions(-)