You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by re...@apache.org on 2018/10/07 19:41:10 UTC
[beam] branch master updated (b2ad757 -> 8fdbc09)
This is an automated email from the ASF dual-hosted git repository.
reuvenlax pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from b2ad757 Merge pull request #6578 from Ardagan/b111881785
add d7c94c8 Make load jobs and copy jobs non blocking in processElement. Wait for them to finish in finishBundle instead.
new 8fdbc09 Merge pull request #6416: [BEAM-5105] Better parallelize BigQuery load jobs
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../beam/sdk/io/gcp/bigquery/BigQueryHelpers.java | 217 +++++++++++++++--
.../beam/sdk/io/gcp/bigquery/WriteRename.java | 245 +++++++++----------
.../beam/sdk/io/gcp/bigquery/WriteTables.java | 264 +++++++++++----------
.../sdk/io/gcp/bigquery/BigQueryHelpersTest.java | 72 ++++++
.../sdk/io/gcp/bigquery/BigQueryIOWriteTest.java | 7 +-
5 files changed, 542 insertions(+), 263 deletions(-)
[beam] 01/01: Merge pull request #6416: [BEAM-5105] Better
parallelize BigQuery load jobs
Posted by re...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
reuvenlax pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
commit 8fdbc0973949123a8fa0a27aa0f9773b1c24c6db
Merge: b2ad757 d7c94c8
Author: reuvenlax <re...@google.com>
AuthorDate: Sun Oct 7 12:41:03 2018 -0700
Merge pull request #6416: [BEAM-5105] Better parallelize BigQuery load jobs
.../beam/sdk/io/gcp/bigquery/BigQueryHelpers.java | 217 +++++++++++++++--
.../beam/sdk/io/gcp/bigquery/WriteRename.java | 245 +++++++++----------
.../beam/sdk/io/gcp/bigquery/WriteTables.java | 264 +++++++++++----------
.../sdk/io/gcp/bigquery/BigQueryHelpersTest.java | 72 ++++++
.../sdk/io/gcp/bigquery/BigQueryIOWriteTest.java | 7 +-
5 files changed, 542 insertions(+), 263 deletions(-)