You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2022/06/16 14:56:00 UTC
[beam] branch dependabot/pip/sdks/python/google-cloud-spanner-gte-1.13.0-and-lt-4 updated (701cd9632be -> cda963e5bd7)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/pip/sdks/python/google-cloud-spanner-gte-1.13.0-and-lt-4
in repository https://gitbox.apache.org/repos/asf/beam.git
discard 701cd9632be Update google-cloud-spanner requirement in /sdks/python
add 6e450a92da7 [BEAM-14265] Add watermark hold for all timers
add 7bf822a5419 Merge pull request #17809: [BEAM-14265] Add watermark hold for all timers
add 12ba4cea9d6 Bump Python beam-master container (#21820)
add a94feb146b7 Split PytorchModelHandler into PytorchModelHandlerTensor and PytorchModelHandlerKeyedTensor (#21810)
add ab8977f4299 Fix Hadoop Downloader Range not correct (#21778)
add 6cfcc9d98bd [BEAM-14036] Read Configuration for Pub/Sub SchemaTransform (#17730)
add 091c05ce4b6 [Go SDK] Add more info to Worker Status API (#21776)
add a2c3ae60966 Make PeriodicImpulse generates unbounded PCollection (#21815)
add 8c94fed2a03 [BEAM-14267] Update watchForNewFiles to allow watching updated files (#17305)
add 94e240052aa fix timestamp conversion in Google Cloud Datastore Connector (#17789)
add b91b16fcd8e Update references to Jira to GH for the Go label (#21830)
add b527ac4bcac [#21853] Adjust Go cross-compile to target entire package (#21854)
add ecea6de6dc8 [BEAM-14553] Add destination coder to FileResultCoder components (#17818)
add 272b853272f Add transform names to help debug flaky test
add 322a4bc29e5 Merge pull request #21745 from nielm/flakyIntegrationTest
add 4b33a38cdd0 copyedited README for RunInference examples (#21855)
add efbce542728 Automatically enable Runner v2 for pipelines that use cross-language transforms
add e7c021d4508 Merge pull request #21788: Automatically enable Runner v2 for pipelines that use cross-language transforms.
add 5f04b97fa5e Document and test overriding batch type inference (#21844)
add 8a1aad68243 Update references to Jira to GH for the Python SDK (#21831)
add f7896d819c5 Adjust Jenkins configuration to allow more memory per JVM
add 18ab78c8c42 Merge pull request #21858: Adjust Jenkins configuration to allow more memory per JVM (fixes #20819)
add ac20321008e add highlights to changes (#21865)
add ba01293ba31 Merge pull request #21793: [21794 ] Fix output timestamp in Dataflow.
add 54f8adfdb9a Adding more info to the sdk_worker_parallelism description (#21839)
add ff8f51b2c29 Add Bert Language Modeling example (#21818)
add e84c2339459 [BEAM-14524] Returning NamedTuple from RunInference transform (#17773)
add dfb65589091 Unit tests for RunInference keyed/unkeyed Modelhandler and examples (#21856)
add d6b57bd4ea3 [BEAM-13229] side nav bug fixed
add 8c8c4315f25 Merge pull request #17731: [BEAM-13229] side nav bug fixed
add b2ba3237cf6 fix links for pipelines
add 5461da33d4e Merge pull request #21744: [website] Fix links for pipelines
add 2de4c2c01c5 Remove kwargs and add explicit runinference_args (#21806)
add f6fed662ea1 Modify README for 3 pytorch examples (#21871)
add b1a313e0380 Sickbay Pytorch example IT test (#21857)
add b8b736eab80 Mark issues as triaged when they are assigned
add ceac85d4031 Merge pull request #21790: Mark issues as triaged when they are assigned
add 9a74f17a4c1 Add required=True to Pytorch image classification example (#21883)
add 955177b8c38 convert windmill min timestamp to beam min timestamp
add 21049601776 Merge pull request #21740 from Naireen/weird_timestamps
add 6bffe8421f4 Switch go todos from issue # syntax to links (#21890)
add de34137eed5 Add Pytorch image segmentation example (#21766)
add a742777d071 Add README documentation for scikit-learn MNIST example (#21887)
add c9046bc727f Decompose labels for new issues (#21888)
add c59bf0f15e7 Use Go 1.18 for go-licenses (#21896)
add e0205be64be [BEAM-12903] Cron job to cleanup Dataproc leaked resources (#21779)
add 9adec2a8250 [BEAM-7209][BEAM-9351][BEAM-9428] Upgrade Hive to version 3.1.3 (#17749)
add b1332824612 Sharding IO tests (Kafka, Debezium, JDBC, Kinesis, Neo4j) from the javaPostCommit task (#21804)
add ba647a05daf Merge pull request #17604 from [BEAM-14315] Match updated files continuously
add a06a13d1638 Merge pull request #21781 from Sklearn Mnist example and IT test
add dbb8f99e8b1 Add Spanner Integration tests to verify exception handling
add ac9a662aab5 Merge pull request #21748 from Add Spanner Integration tests to verify exception handling
add 81bcf09568f Get the latest version of go-licenses (#21901)
add eed1713b5b8 Hide internal helpers added to DoFn for batched DoFns (#21860)
add 448cecaf18a Updated documentation for ml.inference docs. (#21868)
add 73d78986503 Moving to 2.41.0-SNAPSHOT on master branch.
add 95b109636b2 Add a type hint to nexmark query 3 joinFn (#21873)
add 4c6b6fb6be0 Rollback dill.
add 29f30b36058 Merge pull request #21898 from Rollback dill to 3.1.1
add 6899a7296e1 Drops usage of setWindowingStrategyInternal in favour of direct use of WindowFn
add 798293e1184 Gives unique names to ES IO Write windowing
add 8c04e2e836c Merge pull request #21895: Drops usage of setWindowingStrategyInternal in favour of direct use of WindowFn
add d6cce26e431 Fix a few small config issues (#21909)
add 1edc040e974 Update Python base image requirements
add 790057b64ea Merge pull request #21902 from pabloem/update-py-image-reqs
add cda963e5bd7 Update google-cloud-spanner requirement in /sdks/python
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (701cd9632be)
\
N -- N -- N refs/heads/dependabot/pip/sdks/python/google-cloud-spanner-gte-1.13.0-and-lt-4 (cda963e5bd7)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/ISSUE_TEMPLATE/bug.yml | 5 -
.github/ISSUE_TEMPLATE/feature.yml | 5 -
.github/ISSUE_TEMPLATE/task.yml | 5 -
.github/autolabeler.yml | 8 +-
.github/issue-rules.yml | 205 ++++++++---------
.github/workflows/self-assign.yml | 1 +
.../workflows/triaged-on-assign.yml | 22 +-
.test-infra/dataproc/cleanup.sh | 68 ++++++
.test-infra/jenkins/CommonJobProperties.groovy | 7 +-
.../jenkins/job_CleanUpDataprocResources.groovy | 26 ++-
.../job_PreCommit_Java_Debezium_IO_Direct.groovy | 26 ++-
.../job_PreCommit_Java_JDBC_IO_Direct.groovy | 26 ++-
.../job_PreCommit_Java_Kafka_IO_Direct.groovy | 26 ++-
.../job_PreCommit_Java_Kinesis_IO_Direct.groovy | 26 ++-
.../job_PreCommit_Java_Neo4j_IO_Direct.groovy | 26 ++-
CHANGES.md | 3 +
build.gradle.kts | 5 -
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 2 +-
.../org/apache/beam/gradle/Repositories.groovy | 7 -
gradle.properties | 4 +-
release/go-licenses/Dockerfile | 7 +-
release/go-licenses/common.gradle | 4 +-
release/go-licenses/get-licenses.sh | 1 -
.../core/core.go => release/go-licenses/go.mod | 17 +-
.../beam/runners/core/construction/External.java | 8 +-
.../beam/runners/core/StatefulDoFnRunner.java | 21 +-
.../wrappers/streaming/DoFnOperator.java | 109 +++-------
.../streaming/state/FlinkStateInternals.java | 18 +-
.../wrappers/streaming/DoFnOperatorTest.java | 28 +--
runners/google-cloud-dataflow-java/build.gradle | 4 +-
.../beam/runners/dataflow/DataflowRunner.java | 43 +++-
.../beam/runners/dataflow/DataflowRunnerTest.java | 64 ++++++
.../runners/dataflow/worker/WindmillTimeUtils.java | 3 +
.../dataflow/worker/WindmillTimerInternals.java | 55 +++--
.../worker/StreamingDataflowWorkerTest.java | 1 +
.../dataflow/worker/WindmillTimeUtilsTest.java | 10 +
.../worker/windmill/src/main/proto/windmill.proto | 2 +
sdks/go/container/boot.go | 4 +-
sdks/go/pkg/beam/artifact/materialize.go | 4 +-
sdks/go/pkg/beam/core/core.go | 2 +-
sdks/go/pkg/beam/core/graph/coder/coder.go | 4 +-
sdks/go/pkg/beam/core/graph/coder/row.go | 2 +-
sdks/go/pkg/beam/core/graph/coder/row_test.go | 2 +-
sdks/go/pkg/beam/core/graph/mtime/time.go | 2 +-
sdks/go/pkg/beam/core/metrics/store.go | 50 +++++
sdks/go/pkg/beam/core/runtime/exec/coder_test.go | 2 +-
sdks/go/pkg/beam/core/runtime/exec/cogbk.go | 2 +-
sdks/go/pkg/beam/core/runtime/exec/combine.go | 2 +-
sdks/go/pkg/beam/core/runtime/exec/datasource.go | 4 +-
.../go/pkg/beam/core/runtime/exec/dynsplit_test.go | 2 +-
sdks/go/pkg/beam/core/runtime/exec/sdf.go | 4 +-
sdks/go/pkg/beam/core/runtime/exec/translate.go | 2 +-
sdks/go/pkg/beam/core/runtime/graphx/coder.go | 8 +-
sdks/go/pkg/beam/core/runtime/graphx/cogbk.go | 2 +-
sdks/go/pkg/beam/core/runtime/graphx/dataflow.go | 4 +-
sdks/go/pkg/beam/core/runtime/graphx/translate.go | 4 +-
sdks/go/pkg/beam/core/runtime/harness/datamgr.go | 2 +-
sdks/go/pkg/beam/core/runtime/harness/harness.go | 52 ++---
sdks/go/pkg/beam/core/runtime/harness/init/init.go | 3 +-
.../go/pkg/beam/core/runtime/harness/monitoring.go | 2 +-
.../core/runtime/harness/statecache/statecache.go | 7 +
.../pkg/beam/core/runtime/harness/worker_status.go | 66 +++++-
.../core/runtime/harness/worker_status_test.go | 6 +-
sdks/go/pkg/beam/core/util/jsonx/jsonx.go | 2 +-
sdks/go/pkg/beam/io/textio/textio.go | 2 +-
sdks/go/pkg/beam/io/xlang/kafkaio/kafka.go | 2 +-
.../beam/model/pipeline_v1/beam_runner_api.pb.go | 6 +-
sdks/go/pkg/beam/pardo.go | 4 +-
sdks/go/pkg/beam/pardo_test.go | 2 +-
sdks/go/pkg/beam/runners/dataflow/dataflow.go | 2 +-
.../beam/runners/universal/runnerlib/compile.go | 4 +-
.../pkg/beam/runners/universal/runnerlib/stage.go | 2 +-
sdks/go/pkg/beam/runners/vet/vet.go | 4 +-
.../go/pkg/beam/transforms/stats/quantiles_test.go | 2 +-
sdks/go/test/integration/integration.go | 14 +-
sdks/go/test/integration/wordcount/wordcount.go | 3 +-
sdks/go/test/integration/xlang/expansion_test.go | 2 +-
.../go/test/regression/coders/fromyaml/fromyaml.go | 4 +-
.../main/java/org/apache/beam/sdk/io/AvroIO.java | 34 ++-
.../java/org/apache/beam/sdk/io/FileBasedSink.java | 7 +-
.../main/java/org/apache/beam/sdk/io/FileIO.java | 115 ++++++++--
.../main/java/org/apache/beam/sdk/io/TextIO.java | 31 ++-
.../java/org/apache/beam/sdk/io/WriteFiles.java | 6 +-
.../java/org/apache/beam/sdk/io/FileIOTest.java | 65 +++++-
sdks/java/extensions/sql/hcatalog/build.gradle | 24 +-
.../provider/hcatalog/BeamSqlHiveSchemaTest.java | 2 +-
.../beam/sdk/io/elasticsearch/ElasticsearchIO.java | 12 +-
.../beam/sdk/io/gcp/datastore/EntityToRow.java | 3 +-
.../PubsubSchemaTransformReadConfiguration.java | 171 +++++++++++++++
.../gcp/datastore/EntityToRowRowToEntityTest.java | 3 +-
.../beam/sdk/io/gcp/spanner/SpannerReadIT.java | 77 ++++++-
.../beam/sdk/io/gcp/spanner/SpannerWriteIT.java | 12 +-
.../apache/beam/sdk/io/gcp/storage/GcsMatchIT.java | 152 +++++++++++++
sdks/java/io/hcatalog/build.gradle | 25 +--
.../beam/sdk/io/hcatalog/HCatalogIOTest.java | 3 +-
.../io/hcatalog/test/EmbeddedMetastoreService.java | 19 +-
.../sdk/io/hcatalog/test/HCatalogIOTestUtils.java | 0
.../beam/sdk/io/hcatalog/test/package-info.java | 0
.../src/{main => test}/resources/hive-site.xml | 48 +++-
sdks/python/.pylintrc | 4 +-
sdks/python/apache_beam/coders/coder_impl.py | 26 ++-
sdks/python/apache_beam/coders/coders.py | 7 +-
sdks/python/apache_beam/coders/row_coder.py | 3 +-
sdks/python/apache_beam/coders/row_coder_test.py | 7 +-
sdks/python/apache_beam/coders/typecoders_test.py | 2 +-
sdks/python/apache_beam/dataframe/frame_base.py | 8 +-
sdks/python/apache_beam/dataframe/frames.py | 113 ++++++----
sdks/python/apache_beam/dataframe/frames_test.py | 72 +++---
sdks/python/apache_beam/dataframe/io.py | 4 +-
sdks/python/apache_beam/dataframe/io_test.py | 4 +-
.../apache_beam/dataframe/pandas_doctests_test.py | 23 +-
sdks/python/apache_beam/dataframe/schemas_test.py | 5 +-
.../examples/complete/game/game_stats_it_test.py | 4 +-
.../examples/complete/game/leader_board_it_test.py | 4 +-
.../examples/complete/juliaset/setup.py | 6 +-
.../examples/dataframe/taxiride_test.py | 3 +-
.../apache_beam/examples/inference/README.md | 242 ++++++++++++++++-----
.../inference/pytorch_image_classification.py | 17 +-
...sification.py => pytorch_image_segmentation.py} | 140 ++++++++++--
.../inference/pytorch_language_modeling.py | 220 +++++++++++++++++++
.../inference/sklearn_mnist_classification.py | 112 ++++++++++
.../transforms/aggregation/combineglobally_test.py | 4 +-
.../examples/streaming_wordcount_debugging.py | 3 +-
.../streaming_wordcount_debugging_it_test.py | 3 +-
sdks/python/apache_beam/io/avroio.py | 70 +++++-
sdks/python/apache_beam/io/avroio_test.py | 91 ++++++++
sdks/python/apache_beam/io/external/gcp/pubsub.py | 4 +-
.../io/external/xlang_jdbcio_it_test.py | 6 +-
.../io/external/xlang_kinesisio_it_test.py | 6 +-
sdks/python/apache_beam/io/filebasedsource.py | 35 ++-
sdks/python/apache_beam/io/fileio.py | 103 +++++++--
sdks/python/apache_beam/io/fileio_test.py | 44 +++-
.../io/gcp/big_query_query_to_table_it_test.py | 5 +-
sdks/python/apache_beam/io/gcp/bigquery.py | 17 +-
.../apache_beam/io/gcp/bigquery_file_loads.py | 7 +-
.../apache_beam/io/gcp/bigquery_read_it_test.py | 3 +-
sdks/python/apache_beam/io/gcp/bigtableio.py | 4 +-
sdks/python/apache_beam/io/gcp/bigtableio_test.py | 3 +-
.../apache_beam/io/gcp/gcsio_integration_test.py | 6 +-
sdks/python/apache_beam/io/gcp/pubsub.py | 4 +-
.../apache_beam/io/gcp/pubsub_integration_test.py | 7 +-
sdks/python/apache_beam/io/gcp/pubsub_test.py | 3 +-
sdks/python/apache_beam/io/hadoopfilesystem.py | 5 +-
.../python/apache_beam/io/hadoopfilesystem_test.py | 25 ++-
sdks/python/apache_beam/io/textio.py | 88 +++++++-
sdks/python/apache_beam/io/textio_test.py | 80 ++++++-
sdks/python/apache_beam/io/watermark_estimators.py | 4 +-
sdks/python/apache_beam/ml/__init__.py | 2 +
sdks/python/apache_beam/ml/inference/__init__.py | 6 +
sdks/python/apache_beam/ml/inference/base.py | 150 ++++++++-----
sdks/python/apache_beam/ml/inference/base_test.py | 45 +++-
.../apache_beam/ml/inference/pytorch_inference.py | 228 ++++++++++++++-----
.../ml/inference/pytorch_inference_it_test.py | 76 ++++++-
.../ml/inference/pytorch_inference_test.py | 75 ++++---
.../apache_beam/ml/inference/sklearn_inference.py | 107 +++++++--
.../ml/inference/sklearn_inference_it_test.py | 76 +++++++
.../ml/inference/sklearn_inference_test.py | 38 +++-
.../ml/inference/torch_tests_requirements.txt | 1 +
.../python/apache_beam/options/pipeline_options.py | 5 +-
.../apache_beam/options/pipeline_options_test.py | 9 +-
.../apache_beam/options/value_provider_test.py | 6 +-
sdks/python/apache_beam/pipeline.py | 17 +-
sdks/python/apache_beam/pvalue.py | 8 +-
sdks/python/apache_beam/runners/common.py | 36 +--
sdks/python/apache_beam/runners/common_test.py | 18 ++
.../runners/dataflow/dataflow_metrics.py | 7 +-
.../runners/dataflow/dataflow_metrics_test.py | 4 +-
.../runners/dataflow/dataflow_runner.py | 17 +-
.../runners/dataflow/dataflow_runner_test.py | 10 +-
.../runners/dataflow/internal/apiclient.py | 5 +-
.../runners/dataflow/test_dataflow_runner.py | 4 +-
.../apache_beam/runners/direct/direct_runner.py | 3 +-
.../runners/direct/direct_runner_test.py | 4 +-
.../runners/direct/transform_evaluator.py | 5 +-
.../runners/interactive/augmented_pipeline.py | 9 +-
.../runners/interactive/caching/streaming_cache.py | 6 +-
.../dataproc/dataproc_cluster_manager.py | 5 +-
.../runners/interactive/interactive_beam.py | 5 +-
.../runners/interactive/interactive_runner.py | 3 +-
.../runners/interactive/recording_manager.py | 4 +-
.../apache_beam/runners/interactive/utils.py | 4 +-
.../python/apache_beam/runners/pipeline_context.py | 6 +-
.../runners/portability/flink_runner_test.py | 17 +-
.../portability/fn_api_runner/fn_runner_test.py | 45 +++-
.../portability/fn_api_runner/translations.py | 6 +-
.../portability/fn_api_runner/worker_handlers.py | 3 +-
.../runners/portability/local_job_service.py | 4 +-
.../runners/portability/portable_runner.py | 7 +-
.../runners/portability/portable_runner_test.py | 10 +-
.../runners/portability/samza_runner_test.py | 16 +-
.../runners/portability/spark_runner_test.py | 20 +-
.../portability/spark_uber_jar_job_server.py | 4 +-
.../apache_beam/runners/portability/stager_test.py | 11 +-
sdks/python/apache_beam/runners/sdf_utils.py | 2 +-
.../apache_beam/runners/worker/bundle_processor.py | 3 +-
.../apache_beam/runners/worker/data_plane.py | 6 +-
.../apache_beam/runners/worker/operations.py | 8 +-
.../apache_beam/runners/worker/sdk_worker_main.py | 3 +-
.../testing/benchmarks/nexmark/queries/query10.py | 5 +-
.../testing/benchmarks/nexmark/queries/query3.py | 9 +-
.../testing/benchmarks/nexmark/queries/query4.py | 3 +-
.../testing/benchmarks/nexmark/queries/query5.py | 3 +-
.../python/apache_beam/testing/test_stream_test.py | 21 +-
.../apache_beam/tools/coders_microbenchmark.py | 3 +-
.../apache_beam/transforms/batch_dofn_test.py | 44 +++-
.../transforms/combinefn_lifecycle_test.py | 2 +-
sdks/python/apache_beam/transforms/combiners.py | 10 +-
sdks/python/apache_beam/transforms/core.py | 120 +++++++---
.../apache_beam/transforms/periodicsequence.py | 7 +-
.../transforms/periodicsequence_test.py | 4 +-
sdks/python/apache_beam/transforms/ptransform.py | 2 +-
.../apache_beam/transforms/ptransform_test.py | 3 +-
.../apache_beam/transforms/sideinputs_test.py | 12 +-
sdks/python/apache_beam/transforms/stats.py | 3 +-
sdks/python/apache_beam/transforms/trigger.py | 14 +-
sdks/python/apache_beam/transforms/trigger_test.py | 8 +-
.../apache_beam/transforms/userstate_test.py | 4 +-
sdks/python/apache_beam/transforms/util.py | 6 +-
sdks/python/apache_beam/typehints/batch.py | 5 +-
.../typehints/native_type_compatibility.py | 8 +-
.../typehints/native_type_compatibility_test.py | 4 +-
.../apache_beam/typehints/typed_pipeline_test.py | 21 +-
sdks/python/apache_beam/typehints/typehints.py | 9 +-
sdks/python/apache_beam/utils/counters.py | 3 +-
sdks/python/apache_beam/utils/retry.py | 4 +-
sdks/python/apache_beam/utils/timestamp.py | 12 +-
sdks/python/apache_beam/utils/timestamp_test.py | 6 +-
sdks/python/apache_beam/utils/urns.py | 6 +-
sdks/python/apache_beam/version.py | 2 +-
sdks/python/build-requirements.txt | 2 +-
.../container/py37/base_image_requirements.txt | 87 ++++----
.../container/py38/base_image_requirements.txt | 92 ++++----
.../container/py39/base_image_requirements.txt | 92 ++++----
sdks/python/mypy.ini | 2 +-
sdks/python/pytest.ini | 1 +
sdks/python/scripts/generate_pydoc.sh | 1 +
sdks/python/scripts/run_integration_test.sh | 2 +-
sdks/python/setup.py | 2 +-
sdks/python/test-suites/dataflow/common.gradle | 2 +-
sdks/python/test-suites/direct/common.gradle | 28 ++-
sdks/python/test-suites/direct/xlang/build.gradle | 2 +-
sdks/python/test-suites/portable/common.gradle | 2 +-
sdks/python/test-suites/tox/py37/build.gradle | 2 +-
sdks/python/test-suites/tox/py38/build.gradle | 2 +-
sdks/python/test-suites/tox/py39/build.gradle | 2 +-
sdks/python/test-suites/tox/pycommon/build.gradle | 2 +-
sdks/python/tox.ini | 6 +-
vendor/calcite-1_28_0/build.gradle | 1 -
website/www/site/assets/js/language-switch-v2.js | 30 ++-
website/www/site/assets/js/page-nav.js | 7 +
website/www/site/assets/scss/_page-nav.scss | 21 +-
website/www/site/assets/scss/_toggler-nav.scss | 9 +
.../en/documentation/runtime/sdk-harness-config.md | 2 +-
website/www/site/data/pipelines.yaml | 8 +-
website/www/site/data/works_with.yaml | 10 +-
255 files changed, 4129 insertions(+), 1482 deletions(-)
copy sdks/python/apache_beam/version.py => .github/workflows/triaged-on-assign.yml (55%)
create mode 100755 .test-infra/dataproc/cleanup.sh
copy sdks/java/io/hcatalog/src/main/java/org/apache/beam/sdk/io/hcatalog/test/package-info.java => .test-infra/jenkins/job_CleanUpDataprocResources.groovy (61%)
copy sdks/java/io/hcatalog/src/main/java/org/apache/beam/sdk/io/hcatalog/test/package-info.java => .test-infra/jenkins/job_PreCommit_Java_Debezium_IO_Direct.groovy (62%)
copy sdks/java/io/hcatalog/src/main/java/org/apache/beam/sdk/io/hcatalog/test/package-info.java => .test-infra/jenkins/job_PreCommit_Java_JDBC_IO_Direct.groovy (62%)
copy sdks/java/io/hcatalog/src/main/java/org/apache/beam/sdk/io/hcatalog/test/package-info.java => .test-infra/jenkins/job_PreCommit_Java_Kafka_IO_Direct.groovy (61%)
copy sdks/java/io/hcatalog/src/main/java/org/apache/beam/sdk/io/hcatalog/test/package-info.java => .test-infra/jenkins/job_PreCommit_Java_Kinesis_IO_Direct.groovy (62%)
copy sdks/java/io/hcatalog/src/main/java/org/apache/beam/sdk/io/hcatalog/test/package-info.java => .test-infra/jenkins/job_PreCommit_Java_Neo4j_IO_Direct.groovy (62%)
copy sdks/go/pkg/beam/core/core.go => release/go-licenses/go.mod (57%)
create mode 100644 sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubSchemaTransformReadConfiguration.java
create mode 100644 sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/storage/GcsMatchIT.java
rename sdks/java/io/hcatalog/src/{main => test}/java/org/apache/beam/sdk/io/hcatalog/test/EmbeddedMetastoreService.java (87%)
rename sdks/java/io/hcatalog/src/{main => test}/java/org/apache/beam/sdk/io/hcatalog/test/HCatalogIOTestUtils.java (100%)
rename sdks/java/io/hcatalog/src/{main => test}/java/org/apache/beam/sdk/io/hcatalog/test/package-info.java (100%)
rename sdks/java/io/hcatalog/src/{main => test}/resources/hive-site.xml (87%)
copy sdks/python/apache_beam/examples/inference/{pytorch_image_classification.py => pytorch_image_segmentation.py} (65%)
create mode 100644 sdks/python/apache_beam/examples/inference/pytorch_language_modeling.py
create mode 100644 sdks/python/apache_beam/examples/inference/sklearn_mnist_classification.py
create mode 100644 sdks/python/apache_beam/ml/inference/sklearn_inference_it_test.py