You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by re...@apache.org on 2022/05/27 00:39:03 UTC
[beam] 01/01: Merge pull request #17423: Handle invalid rows in the Storage Api sink
This is an automated email from the ASF dual-hosted git repository.
reuvenlax pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
commit 25039a8aea8ad549e8ba9fdbfcd67c9f8fc2f9bf
Merge: 92b8dc75286 c4af119545c
Author: Reuven Lax <re...@google.com>
AuthorDate: Thu May 26 17:38:53 2022 -0700
Merge pull request #17423: Handle invalid rows in the Storage Api sink
.../beam/sdk/io/gcp/bigquery/BatchLoads.java | 4 +-
.../bigquery/BigQueryStorageApiInsertError.java | 56 ++++++++++
.../BigQueryStorageApiInsertErrorCoder.java | 53 +++++++++
.../io/gcp/bigquery/StorageApiConvertMessages.java | 64 ++++++++---
.../bigquery/StorageApiDynamicDestinations.java | 3 +
.../StorageApiDynamicDestinationsBeamRow.java | 6 +
.../StorageApiDynamicDestinationsTableRow.java | 6 +-
.../beam/sdk/io/gcp/bigquery/StorageApiLoads.java | 124 +++++++++++++++------
.../sdk/io/gcp/bigquery/StreamingWriteTables.java | 2 +
.../io/gcp/bigquery/TableRowToStorageApiProto.java | 107 ++++++++++++++----
.../beam/sdk/io/gcp/bigquery/TableSchemaCache.java | 1 +
.../beam/sdk/io/gcp/bigquery/WriteResult.java | 103 +++++++++++------
.../sdk/io/gcp/bigquery/BigQueryIOWriteTest.java | 94 +++++++++++++++-
.../gcp/bigquery/TableRowToStorageApiProtoIT.java | 1 -
14 files changed, 513 insertions(+), 111 deletions(-)