You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2021/01/29 03:38:53 UTC
[beam] tag nightly-master updated (d289168 -> 73731ec)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/beam.git.
*** WARNING: tag nightly-master was modified! ***
from d289168 (commit)
to 73731ec (commit)
from d289168 Merge pull request #13822 from y1chi/BEAM-11699
add f0a3f6d Merge pull request #13496 from [BEAM-11408] Integrate BigQuery sink streaming inserts with GroupIntoBatches
add 01b7596 Add example snippets to read fromQuery using BQ Storage API.
add 393bbde Make the query example consistent with the previous one for the table.
add 3c15bf3 Run spotelessApply.
add f24ebd3 Merge pull request #13083: [BEAM-7034] Add example snippet to read fromQuery using BQ Storage API.
add b8c8bf3 [BEAM-10120] Add dynamic timer support to portable Flink.
add 73731ec Merge pull request #13783 from [BEAM-10120] Add dynamic timer support to portable Flink
No new revisions were added by this update.
Summary of changes:
...gQueryReadFromQueryWithBigQueryStorageAPI.java} | 50 +--
runners/flink/job-server/flink_job_server.gradle | 1 -
.../wrappers/streaming/DoFnOperator.java | 19 +-
.../streaming/ExecutableStageDoFnOperator.java | 7 +-
.../streaming/ExecutableStageDoFnOperatorTest.java | 4 +-
.../beam/runners/dataflow/DataflowRunner.java | 4 +-
.../fnexecution/control/TimerReceiverFactory.java | 1 +
.../translation/PipelineTranslatorUtils.java | 4 +-
.../sdk/io/gcp/bigquery/BatchedStreamingWrite.java | 403 +++++++++++++++++++++
.../beam/sdk/io/gcp/bigquery/BigQueryIO.java | 23 ++
.../beam/sdk/io/gcp/bigquery/StreamingInserts.java | 29 ++
.../beam/sdk/io/gcp/bigquery/StreamingWriteFn.java | 215 -----------
.../sdk/io/gcp/bigquery/StreamingWriteTables.java | 168 ++++++---
.../beam/sdk/io/gcp/bigquery/TagWithUniqueIds.java | 8 +-
.../sdk/io/gcp/bigquery/BigQueryIOWriteTest.java | 73 +++-
.../runners/portability/flink_runner_test.py | 3 -
.../documentation/io/built-in/google-bigquery.md | 2 +-
17 files changed, 691 insertions(+), 323 deletions(-)
copy examples/java/src/main/java/org/apache/beam/examples/snippets/transforms/io/gcp/bigquery/{BigQueryReadFromTableWithBigQueryStorageAPI.java => BigQueryReadFromQueryWithBigQueryStorageAPI.java} (61%)
create mode 100644 sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BatchedStreamingWrite.java
delete mode 100644 sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/StreamingWriteFn.java