You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2023/02/20 06:29:26 UTC
[beam] branch dependabot/go_modules/sdks/github.com/testcontainers/testcontainers-go-0.18.0 updated (93b560822b0 -> 4bd5788da8e)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/go_modules/sdks/github.com/testcontainers/testcontainers-go-0.18.0
in repository https://gitbox.apache.org/repos/asf/beam.git
discard 93b560822b0 Bump github.com/testcontainers/testcontainers-go in /sdks
add 2aa77521413 Fix pull_licenses_java returning 404 from opensource.org
add 1b1cc449ef8 Merge pull request #25515: Fix pull_licenses_java returning 404 from opensource.org
add 9fb9d2cb415 [#24789][prism] internal/jobservices metrics + tests (#25497)
add 29ea6e0eb8a [Go SDK]: Allow SDF methods to have context param and error return value (#25437)
add 5fc19fffcdf Move closing milestone out of PMC-only tasks (#25516)
add a82084ce87b update GCP cloud libraries BOM to 26.8.0 (#25470)
add c210df3d3b3 Fix interface{} in iter& emit type of DoFn in Go (#25203)
add 545a2e63ca7 Task #25064: Python SDK Data sampling implementation (#25093)
add 4e6d751f92e Add support for all Java based portable runners to consume elements embedding on the control response. (#25463)
add 684917f9bc5 Swap Java SDK container to use eclipse-temurin as the base instead of OpenJDK (#25402)
add d391bf2b3a5 Update BigQueryIO documentation with details on how to override the query execution project (#25400)
add 40838f76447 Support Avro GenericRecord as a valid format for StorageWrite API on BigQueryIO (#24274)
add ee9244d6261 complete examples links fixed
add 20c8d3a2ba1 Merge pull request #25527: [CdapIO][SparkReceiverIO] Complete examples links in READMEs and CdapIO website page fixed
add 6de67443528 Stop use of self hosted runners for some workflows. (#25542)
add 29856ae9471 Run prbot updates on hosted runners (#25544)
add f358fcdc8c8 prism-fixstatic (#25546)
add 86920261ca7 Update Go SDK minimum Go version to 1.19 (#25545)
add 2b6291250f9 Replace more uses of `ClassLoadingStrategy.Default.INJECTION` (#23210)
add 907533220b8 Use WindowedValue.withValue on hot paths #21250 (#25519)
add de7eb2d83b0 Stop paying the iterator object creation tax in MultiplexingMetricTrackingFnDataReceiver (#25540)
add 977e53104f4 [prism] add windowing strategy (#25518)
add c160a081923 Fix Tensorflow intergration test model path (#25553)
add d652d054ecd [Go SDK]: Retrieve file size in CreateInitialRestriction in textio.Read (#25535)
add ca1ec257c4a [#24789][prism] internal/worker + tentative data (#25478)
add 6667eb4741b [#24789][prism] add preprocessor and test (#25520)
add 6e53f13871a Bump github.com/tetratelabs/wazero from 1.0.0-pre.7 to 1.0.0-pre.9 in /sdks (#25560)
add 4bd5788da8e Bump github.com/testcontainers/testcontainers-go in /sdks
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (93b560822b0)
\
N -- N -- N refs/heads/dependabot/go_modules/sdks/github.com/testcontainers/testcontainers-go-0.18.0 (4bd5788da8e)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../actions/setup-self-hosted-action/action.yml | 8 +-
.github/workflows/build_playground_frontend.yml | 2 +-
.github/workflows/git_tag_released_version.yml | 2 +-
.github/workflows/go_tests.yml | 4 +-
.github/workflows/issue-tagger.yml | 2 +-
.github/workflows/label_prs.yml | 2 +-
.github/workflows/playground_deploy_backend.yml | 2 +-
.github/workflows/pr-bot-new-prs.yml | 2 +-
.github/workflows/pr-bot-pr-updates.yml | 2 +-
.github/workflows/pr-bot-prs-needing-attention.yml | 2 +-
.github/workflows/publish_github_release_notes.yml | 4 +-
.github/workflows/python_tests.yml | 2 +-
.github/workflows/reportGenerator.yml | 2 +-
.github/workflows/self-assign.yml | 2 +-
.github/workflows/stale.yml | 2 +-
.github/workflows/triaged-on-assign.yml | 2 +-
CHANGES.md | 5 +
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 12 +-
dev-support/docker/Dockerfile | 2 +-
.../control/DefaultJobBundleFactory.java | 3 +
.../fnexecution/control/SdkHarnessClient.java | 4 +
.../environment/EmbeddedEnvironmentFactory.java | 7 +-
sdks/go.mod | 4 +-
sdks/go.sum | 4 +-
sdks/go/examples/wasm/README.md | 6 +-
sdks/go/examples/wasm/wasm.go | 6 +-
sdks/go/pkg/beam/core/funcx/output.go | 5 +-
sdks/go/pkg/beam/core/funcx/output_test.go | 2 +
sdks/go/pkg/beam/core/funcx/sideinput.go | 3 +
sdks/go/pkg/beam/core/funcx/sideinput_test.go | 1 +
sdks/go/pkg/beam/core/graph/fn.go | 108 +++--
sdks/go/pkg/beam/core/graph/fn_test.go | 87 ++++
sdks/go/pkg/beam/core/runtime/exec/datasource.go | 8 +-
.../pkg/beam/core/runtime/exec/datasource_test.go | 12 +-
sdks/go/pkg/beam/core/runtime/exec/sdf.go | 134 ++++--
sdks/go/pkg/beam/core/runtime/exec/sdf_invokers.go | 339 ++++++--------
.../beam/core/runtime/exec/sdf_invokers_arity.go | 336 ++++++++++++++
.../beam/core/runtime/exec/sdf_invokers_arity.tmpl | 246 ++++++++++
.../beam/core/runtime/exec/sdf_invokers_test.go | 250 +++++++++--
sdks/go/pkg/beam/core/runtime/exec/sdf_test.go | 17 +-
sdks/go/pkg/beam/io/parquetio/parquetio.go | 4 +-
sdks/go/pkg/beam/io/textio/textio.go | 39 +-
.../beam/runners/prism/internal/config/config.go | 2 +-
.../internal/{urns/urns_test.go => engine/data.go} | 30 +-
.../{urns/urns_test.go => engine/strategy.go} | 46 +-
.../prism/internal/engine/strategy_test.go} | 33 +-
.../internal/{urns/urns_test.go => execute.go} | 26 +-
.../runners/prism/internal/jobservices/metrics.go | 497 +++++++++++++++++++++
.../prism/internal/jobservices/metrics_test.go | 134 ++++++
.../pkg/beam/runners/prism/internal/preprocess.go | 148 ++++++
.../beam/runners/prism/internal/preprocess_test.go | 181 ++++++++
.../beam/runners/prism/internal/urns/urns_test.go | 2 +-
.../beam/runners/prism/internal/worker/bundle.go | 114 +++++
.../runners/prism/internal/worker/bundle_test.go | 52 +++
.../beam/runners/prism/internal/worker/worker.go | 421 +++++++++++++++++
.../runners/prism/internal/worker/worker_test.go | 281 ++++++++++++
sdks/java/container/Dockerfile | 2 +-
.../container/license_scripts/dep_urls_java.yaml | 2 +-
.../license_scripts/pull_licenses_java.py | 4 +
.../apache/beam/sdk/coders/RowCoderGenerator.java | 7 +-
.../beam/sdk/schemas/utils/AvroByteBuddyUtils.java | 5 +-
.../apache/beam/sdk/schemas/utils/AvroUtils.java | 20 +-
.../beam/sdk/schemas/utils/ByteBuddyUtils.java | 4 +-
.../beam/sdk/schemas/utils/JavaBeanUtils.java | 11 +-
.../apache/beam/sdk/schemas/utils/POJOUtils.java | 10 +-
.../sdk/schemas/utils/SelectByteBuddyHelpers.java | 7 +-
.../reflect/ByteBuddyOnTimerInvokerFactory.java | 10 +-
.../org/apache/beam/sdk/util/ByteBuddyUtils.java | 57 +++
.../extensions/avro/schemas/utils/AvroUtils.java | 14 +-
.../fn/harness/jmh/ProcessBundleBenchmark.java | 16 +-
.../fn/harness/jmh/ProcessBundleBenchmarkTest.java | 18 +-
.../apache/beam/fn/harness/FnApiDoFnRunner.java | 257 +++++++++--
.../harness/data/PCollectionConsumerRegistry.java | 10 +-
sdks/java/io/cdap/README.md | 2 +-
.../AvroGenericRecordToStorageApiProto.java | 378 ++++++++++++++++
.../beam/sdk/io/gcp/bigquery/BigQueryIO.java | 50 ++-
.../beam/sdk/io/gcp/bigquery/RowWriterFactory.java | 4 +
...StorageApiDynamicDestinationsGenericRecord.java | 95 ++++
.../AvroGenericRecordToStorageApiProtoTest.java | 473 ++++++++++++++++++++
.../sdk/io/gcp/bigquery/BigQueryIOWriteTest.java | 109 +++--
sdks/java/io/sparkreceiver/2/README.md | 2 +-
.../ml/inference/tensorflow_inference_it_test.py | 6 +-
.../apache_beam/runners/worker/bundle_processor.py | 95 +++-
.../runners/worker/bundle_processor_test.py | 132 ++++++
.../apache_beam/runners/worker/data_sampler.py | 156 +++++++
.../runners/worker/data_sampler_test.py | 192 ++++++++
.../apache_beam/runners/worker/sdk_worker.py | 34 +-
.../apache_beam/runners/worker/sdk_worker_main.py | 9 +-
.../apache_beam/runners/worker/sdk_worker_test.py | 55 ++-
sdks/python/apache_beam/transforms/environments.py | 1 +
sdks/python/tox.ini | 1 -
.../site/content/en/contribute/release-guide.md | 8 +-
.../content/en/documentation/io/built-in/cdap.md | 2 +-
.../documentation/io/built-in/google-bigquery.md | 5 +
.../content/en/documentation/programming-guide.md | 2 +-
.../site/content/en/get-started/quickstart-go.md | 2 +-
96 files changed, 5309 insertions(+), 611 deletions(-)
create mode 100644 sdks/go/pkg/beam/core/runtime/exec/sdf_invokers_arity.go
create mode 100644 sdks/go/pkg/beam/core/runtime/exec/sdf_invokers_arity.tmpl
copy sdks/go/pkg/beam/runners/prism/internal/{urns/urns_test.go => engine/data.go} (55%)
copy sdks/go/pkg/beam/runners/prism/internal/{urns/urns_test.go => engine/strategy.go} (54%)
copy sdks/go/pkg/beam/{core/funcx/output_test.go => runners/prism/internal/engine/strategy_test.go} (52%)
copy sdks/go/pkg/beam/runners/prism/internal/{urns/urns_test.go => execute.go} (54%)
create mode 100644 sdks/go/pkg/beam/runners/prism/internal/jobservices/metrics.go
create mode 100644 sdks/go/pkg/beam/runners/prism/internal/jobservices/metrics_test.go
create mode 100644 sdks/go/pkg/beam/runners/prism/internal/preprocess.go
create mode 100644 sdks/go/pkg/beam/runners/prism/internal/preprocess_test.go
create mode 100644 sdks/go/pkg/beam/runners/prism/internal/worker/bundle.go
create mode 100644 sdks/go/pkg/beam/runners/prism/internal/worker/bundle_test.go
create mode 100644 sdks/go/pkg/beam/runners/prism/internal/worker/worker.go
create mode 100644 sdks/go/pkg/beam/runners/prism/internal/worker/worker_test.go
create mode 100644 sdks/java/core/src/main/java/org/apache/beam/sdk/util/ByteBuddyUtils.java
create mode 100644 sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/AvroGenericRecordToStorageApiProto.java
create mode 100644 sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/StorageApiDynamicDestinationsGenericRecord.java
create mode 100644 sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/AvroGenericRecordToStorageApiProtoTest.java
create mode 100644 sdks/python/apache_beam/runners/worker/data_sampler.py
create mode 100644 sdks/python/apache_beam/runners/worker/data_sampler_test.py