You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2022/10/13 05:40:30 UTC
[beam] branch nightly-refs/heads/master updated (0a1e7443c48 -> 0e99c1efd98)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 0a1e7443c48 [Go SDK] Don't construct plans in lock section. (#23583)
add 6adecd43879 Remove obsolete and deprecated bigquery native write. #23557 (#23558)
add 786ba8b54c0 Increase Python PostCommit timeout. (#23595)
add e6e4d047e0f [website][adhoc] Fix spellcheck errors and typos
add 1c1ecb2a36d Merge pull request #23575: [website][adhoc] Fix spellcheck errors and typos
add 3cb512ee289 Migrate GcsOptions#getExecutorService to an unbounded ScheduledExecutorService (#23545)
add d22185c4f8d (BQ Java) Explicitly set coder for multi-partition batch load writes (#23602)
add 7f540359b73 Fix typo in bootstrap_beam_venv.py (#23574)
add 98cebe7b125 Bump github.com/spf13/cobra from 1.5.0 to 1.6.0 in /sdks (#23591)
add 46a7d00cee5 [Playground][Tour Of Beam] Datastore entities split by origin (#23088)
add 8e52d8721b7 use write schema only for read api (#23594)
add af6a04ca87d [Go SDK]: SingleFlight bundle descriptor requests (#23589)
add 0e99c1efd98 Extend a timeout to create a bt cluster. (#23617)
No new revisions were added by this update.
Summary of changes:
.github/workflows/playground_deploy_examples.yml | 119 ++---
.test-infra/jenkins/job_PostCommit_Python.groovy | 2 +-
CHANGES.md | 3 +-
playground/infrastructure/cd_helper.py | 18 +-
playground/infrastructure/checker.py | 8 +-
playground/infrastructure/ci_cd.py | 42 +-
playground/infrastructure/ci_helper.py | 35 +-
playground/infrastructure/config.py | 10 +-
playground/infrastructure/datastore_client.py | 183 ++++++--
playground/infrastructure/helper.py | 59 ++-
playground/infrastructure/test_cd_helper.py | 7 +-
playground/infrastructure/test_ci_cd.py | 9 +-
playground/infrastructure/test_ci_helper.py | 13 +-
playground/infrastructure/test_datastore_client.py | 110 +++--
playground/infrastructure/test_helper.py | 89 ++--
.../runners/dataflow/DataflowPipelineJobTest.java | 21 +-
.../runners/dataflow/util/PackageUtilTest.java | 8 +-
.../dataflow/worker/BatchDataflowWorkerTest.java | 2 +-
.../worker/DataflowBatchWorkerHarnessTest.java | 2 +-
.../worker/DataflowWorkUnitClientTest.java | 2 +-
sdks/go.mod | 6 +-
sdks/go.sum | 10 +-
sdks/go/pkg/beam/core/runtime/harness/harness.go | 27 +-
.../util/{ThrowingSupplier.java => NanoClock.java} | 23 +-
.../util/UnboundedScheduledExecutorService.java | 504 ++++++++++++++++++++
.../beam/sdk}/util/FastNanoClockAndSleeper.java | 13 +-
.../sdk}/util/FastNanoClockAndSleeperTest.java | 2 +-
.../UnboundedScheduledExecutorServiceTest.java | 505 +++++++++++++++++++++
.../sdk/extensions/gcp/options/GcsOptions.java | 18 +-
.../sdk/extensions/gcp/GcpCoreApiSurfaceTest.java | 3 +-
.../beam/sdk/extensions/gcp/util/GcsUtilTest.java | 23 +-
.../gcp/util/RetryHttpRequestInitializerTest.java | 6 +-
.../sdk/extensions/python/bootstrap_beam_venv.py | 6 +-
.../beam/sdk/io/gcp/bigquery/BatchLoads.java | 11 +-
.../beam/sdk/io/gcp/bigquery/BigQueryIO.java | 15 +-
.../sdk/io/gcp/bigquery/BigQueryIOReadTest.java | 2 +-
.../io/gcp/bigquery/BigQueryServicesImplTest.java | 8 +-
.../examples/cookbook/bigtableio_it_test.py | 2 +-
.../io/gcp/big_query_query_to_table_it_test.py | 65 ---
sdks/python/apache_beam/io/gcp/bigquery.py | 176 +------
sdks/python/apache_beam/io/gcp/bigquery_test.py | 52 +--
sdks/python/apache_beam/io/gcp/bigquery_tools.py | 67 ---
.../apache_beam/io/gcp/bigquery_tools_test.py | 159 -------
.../runners/dataflow/dataflow_runner.py | 13 +-
.../runners/dataflow/dataflow_runner_test.py | 63 ---
.../runners/dataflow/ptransform_overrides.py | 135 ------
.../www/site/content/en/community/case-study.md | 2 +-
.../www/site/content/en/documentation/basics.md | 4 +-
.../en/documentation/dsls/sql/extensions/joins.md | 2 +-
.../documentation/io/built-in/google-bigquery.md | 2 +-
.../content/en/documentation/io/built-in/hadoop.md | 4 +-
.../en/documentation/io/built-in/hcatalog.md | 2 +-
.../en/documentation/io/built-in/snowflake.md | 6 +-
.../en/documentation/io/developing-io-overview.md | 2 +-
.../site/content/en/documentation/io/testing.md | 2 +-
.../en/documentation/patterns/custom-windows.md | 2 +-
...lements-for-efficient-external-service-calls.md | 2 +-
.../en/documentation/patterns/side-inputs.md | 2 +-
.../documentation/pipelines/test-your-pipeline.md | 2 +-
.../content/en/documentation/programming-guide.md | 22 +-
.../runners/capability-matrix/_index.md | 2 +-
.../site/content/en/documentation/runners/flink.md | 4 +-
.../site/content/en/documentation/runners/jet.md | 2 +-
.../content/en/documentation/runners/jstorm.md | 2 +-
.../site/content/en/documentation/runners/samza.md | 2 +-
.../sdks/java-multi-language-pipelines.md | 4 +-
.../en/documentation/sdks/java-thirdparty.md | 2 +-
.../content/en/documentation/sdks/java/euphoria.md | 12 +-
.../en/documentation/sdks/java/testing/nexmark.md | 2 +-
.../en/documentation/sdks/java/testing/tpcds.md | 4 +-
.../en/documentation/sdks/python-streaming.md | 2 +-
.../transforms/java/elementwise/pardo.md | 2 +-
.../en/get-started/mobile-gaming-example.md | 2 +-
.../content/en/get-started/wordcount-example.md | 2 +-
74 files changed, 1635 insertions(+), 1121 deletions(-)
copy sdks/java/core/src/main/java/org/apache/beam/sdk/util/{ThrowingSupplier.java => NanoClock.java} (59%)
create mode 100644 sdks/java/core/src/main/java/org/apache/beam/sdk/util/UnboundedScheduledExecutorService.java
rename sdks/java/{extensions/google-cloud-platform-core/src/test/java/org/apache/beam/sdk/extensions/gcp => core/src/test/java/org/apache/beam/sdk}/util/FastNanoClockAndSleeper.java (82%)
rename sdks/java/{extensions/google-cloud-platform-core/src/test/java/org/apache/beam/sdk/extensions/gcp => core/src/test/java/org/apache/beam/sdk}/util/FastNanoClockAndSleeperTest.java (97%)
create mode 100644 sdks/java/core/src/test/java/org/apache/beam/sdk/util/UnboundedScheduledExecutorServiceTest.java