You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ch...@apache.org on 2019/10/25 18:00:16 UTC
[beam] branch master updated (e9c7f99 -> 73642eb)
This is an automated email from the ASF dual-hosted git repository.
chamikara pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from e9c7f99 [Go SDK] Simplify datamgr tests.
add 95bd4b2 [BEAM-7738] Add external transform support to PubsubIO
add 61814dd Adapt io.external.pubsub reader and writer to new API
add 6dff94d Adjust the way that the new API is used to handle the encoded data
add 63cabe7 Must use Boolean arg to make use of the BooleanCoder in Java
add b1e3fd1 Fix docs
add 7b3ce81 Mark kafka and pubsub external transforms as experimental
add 73642eb Merge pull request #9268: [BEAM-7738] Add external transform support to PubsubIO
No new revisions were added by this update.
Summary of changes:
runners/flink/job-server/flink_job_server.gradle | 1 +
sdks/java/io/google-cloud-platform/build.gradle | 4 +
.../apache/beam/sdk/io/gcp/pubsub/PubsubIO.java | 173 ++++++++++++++++++-
.../sdk/io/gcp/pubsub/PubsubIOExternalTest.java} | 187 ++++++++-------------
.../io/{gcp/tests => external/gcp}/__init__.py | 0
sdks/python/apache_beam/io/external/gcp/pubsub.py | 168 ++++++++++++++++++
sdks/python/apache_beam/io/external/kafka.py | 6 +-
.../python/apache_beam/transforms/external_test.py | 12 ++
.../apache_beam/transforms/external_test_py3.py | 4 +
.../apache_beam/transforms/external_test_py37.py | 2 +
10 files changed, 436 insertions(+), 121 deletions(-)
copy sdks/java/io/{kafka/src/test/java/org/apache/beam/sdk/io/kafka/KafkaIOExternalTest.java => google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubIOExternalTest.java} (53%)
copy sdks/python/apache_beam/io/{gcp/tests => external/gcp}/__init__.py (100%)
create mode 100644 sdks/python/apache_beam/io/external/gcp/pubsub.py