You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ch...@apache.org on 2019/10/25 18:00:16 UTC

[beam] branch master updated (e9c7f99 -> 73642eb)

This is an automated email from the ASF dual-hosted git repository.

chamikara pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from e9c7f99  [Go SDK] Simplify datamgr tests.
     add 95bd4b2  [BEAM-7738] Add external transform support to PubsubIO
     add 61814dd  Adapt io.external.pubsub reader and writer to new API
     add 6dff94d  Adjust the way that the new API is used to handle the encoded data
     add 63cabe7  Must use Boolean arg to make use of the BooleanCoder in Java
     add b1e3fd1  Fix docs
     add 7b3ce81  Mark kafka and pubsub external transforms as experimental
     add 73642eb  Merge pull request #9268: [BEAM-7738] Add external transform support to PubsubIO

No new revisions were added by this update.

Summary of changes:
 runners/flink/job-server/flink_job_server.gradle   |   1 +
 sdks/java/io/google-cloud-platform/build.gradle    |   4 +
 .../apache/beam/sdk/io/gcp/pubsub/PubsubIO.java    | 173 ++++++++++++++++++-
 .../sdk/io/gcp/pubsub/PubsubIOExternalTest.java}   | 187 ++++++++-------------
 .../io/{gcp/tests => external/gcp}/__init__.py     |   0
 sdks/python/apache_beam/io/external/gcp/pubsub.py  | 168 ++++++++++++++++++
 sdks/python/apache_beam/io/external/kafka.py       |   6 +-
 .../python/apache_beam/transforms/external_test.py |  12 ++
 .../apache_beam/transforms/external_test_py3.py    |   4 +
 .../apache_beam/transforms/external_test_py37.py   |   2 +
 10 files changed, 436 insertions(+), 121 deletions(-)
 copy sdks/java/io/{kafka/src/test/java/org/apache/beam/sdk/io/kafka/KafkaIOExternalTest.java => google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubIOExternalTest.java} (53%)
 copy sdks/python/apache_beam/io/{gcp/tests => external/gcp}/__init__.py (100%)
 create mode 100644 sdks/python/apache_beam/io/external/gcp/pubsub.py