You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by bh...@apache.org on 2021/03/17 13:54:20 UTC
[beam] branch master updated (93d0be0 -> 4565a31)
This is an automated email from the ASF dual-hosted git repository.
bhulette pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 93d0be0 [BEAM-11969] Adds an option for setting row-group size in ParquetIO (#14227)
add 4565a31 [BEAM-11659] Add new schema types to Pub/Sub SQL (#13980)
No new revisions were added by this update.
Summary of changes:
.../provider/pubsub/PubsubTableProviderIT.java | 156 +++++++++++++++++++--
...bsubMessage.java => AddTimestampAttribute.java} | 39 +-----
.../beam/sdk/io/gcp/pubsub/NestedRowToMessage.java | 91 ++++++++++++
.../beam/sdk/io/gcp/pubsub/PubsubMessage.java | 55 +++++---
.../beam/sdk/io/gcp/pubsub/PubsubMessageToRow.java | 50 +++++--
.../sdk/io/gcp/pubsub/PubsubSchemaIOProvider.java | 87 ++++++++----
.../sdk/io/gcp/pubsub/NestedRowToMessageTest.java | 106 ++++++++++++++
.../sdk/io/gcp/pubsub/PubsubMessageToRowTest.java | 58 +++++++-
8 files changed, 539 insertions(+), 103 deletions(-)
rename sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/{RowToPubsubMessage.java => AddTimestampAttribute.java} (58%)
create mode 100644 sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/NestedRowToMessage.java
create mode 100644 sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/pubsub/NestedRowToMessageTest.java