You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2025/11/27 05:17:03 UTC
(beam) branch dependabot/go_modules/sdks/cloud.google.com/go/storage-1.57.2 updated (a83b1c4bccc -> 22c29eb9d98)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/go_modules/sdks/cloud.google.com/go/storage-1.57.2
in repository https://gitbox.apache.org/repos/asf/beam.git
omit a83b1c4bccc Bump cloud.google.com/go/storage from 1.57.1 to 1.57.2 in /sdks
add f9f13c331dd enhance python tests (#36852)
add 6a8244815b0 Move Kafka read with redistribute override to Kafka IO package. (#36887)
add 94336fa0187 Make RestrictionTrackers.getProgress unblocking until initial progress successfully returned (#36750)
add c84ccd385c2 callStateMap was accessed from multiple threads without synchronization. changing callStateMap to concurrent hashmap (#36886)
add c8aa39898cf Fix GcsEndpoint serialization in GcsOptions (#36879)
add 876cda39434 [Docs] Add table of contents for contributor docs (#36861)
add 543056a7898 split redis into extra (#36772)
add 388e5e59ff6 Supports Asynchronous Runs in Interactive Beam (#36853)
add a9e2e68e507 [OpenTelemetry] Add OpenTelemetry options to SdkHarnessOptions (#36716)
add 45911229938 Iceberg direct write (#36720)
add 203f45cee86 Support beam:logical_type:micros_instant:v1 in SpannerIo. (#36840)
add db09899eb20 Move to macos-15 (#36900)
add d421c98075c Upgrade HCatalogIO to Hive 4.0.1 (#36901)
add 5b8743b9366 [BEAM-36736] Add state sampling for timer processing in the Python SDK (#36737)
add 2f75792d044 Flink 1.20 support (#36893)
add 436662293b6 Bump github.com/nats-io/nats-server/v2 from 2.12.1 to 2.12.2 in /sdks (#36816)
add c72970d0ee3 Fix CSP issues (#36902)
add baa1751d837 comment out potential race condition until further investigation in enrichment test (#36907)
add 744275030ac Moving to 2.71.0-SNAPSHOT on master branch.
add bdd042509b6 Update CHANGES.md to have fields for 2.71.0 release
add 2ffd443b986 Fix inconsistent handling of Firestore Project and Database ID (#36895)
add 80ba916e94d fix retry scenario for query to table materialization (#36912)
add 7323fb82cb5 split hdfs into extra (#36773)
add dde8937c124 Update CHANGES to mention extras changes (#36875)
add 31612929b02 Re-enable "PostCommit XVR GoUsingJava Dataflow" in cron (#36909)
add a6a8613fca3 Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in /sdks (#36922)
add 22c29eb9d98 Bump cloud.google.com/go/storage from 1.57.1 to 1.57.2 in /sdks
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (a83b1c4bccc)
\
N -- N -- N refs/heads/dependabot/go_modules/sdks/cloud.google.com/go/storage-1.57.2 (22c29eb9d98)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 1 +
.../test-properties.json | 6 +-
.../beam_PostCommit_Python_Xlang_Gcp_Direct.json | 2 +-
.../beam_PostCommit_XVR_GoUsingJava_Dataflow.json | 4 +-
.../workflows/beam_LoadTests_Java_GBK_Smoke.yml | 2 +-
.../beam_PostCommit_Java_Examples_Flink.yml | 2 +-
.../beam_PostCommit_Java_Nexmark_Flink.yml | 2 +-
.../beam_PostCommit_Java_PVR_Flink_Streaming.yml | 2 +-
.../workflows/beam_PostCommit_Java_Tpcds_Flink.yml | 2 +-
.../beam_PostCommit_Java_ValidatesRunner_Flink.yml | 2 +-
...PostCommit_Java_ValidatesRunner_Flink_Java8.yml | 2 +-
.github/workflows/beam_PostCommit_XVR_Flink.yml | 2 +-
.../beam_PostCommit_XVR_GoUsingJava_Dataflow.yml | 8 +-
.../beam_PreCommit_Java_HCatalog_IO_Direct.yml | 15 -
.../workflows/beam_PreCommit_Java_IOs_Direct.yml | 15 -
.../beam_PreCommit_Java_PVR_Flink_Batch.yml | 2 +-
.../beam_PreCommit_Java_PVR_Flink_Docker.yml | 2 +-
.github/workflows/build_wheels.yml | 4 +-
.../run_rc_validation_java_quickstart.yml | 2 +-
CHANGES.md | 33 +-
build.gradle.kts | 1 +
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 4 +
contributor-docs/README.md | 36 ++
gradle.properties | 6 +-
.../wrappers/streaming/DoFnOperator.java | 0
runners/flink/{1.17 => 1.20}/build.gradle | 4 +-
.../job-server-container/build.gradle | 0
.../flink/{1.19 => 1.20}/job-server/build.gradle | 2 +-
.../wrappers/streaming/DoFnOperator.java | 8 +-
runners/flink/flink_runner.gradle | 5 +
.../translation/types/CoderTypeSerializer.java | 0
.../flink/FlinkExecutionEnvironmentsTest.java | 13 +-
.../runners/flink/ReadSourceStreamingTest.java | 7 +-
.../flink/streaming/GroupByNullKeyTest.java | 7 +-
.../flink/streaming/TopWikipediaSessionsTest.java | 7 +-
runners/google-cloud-dataflow-java/build.gradle | 2 -
.../beam/runners/dataflow/DataflowRunner.java | 5 +-
scripts/beam-sql.sh | 2 +-
scripts/tools/bomupgrader.py | 1 +
sdks/go.mod | 22 +-
sdks/go.sum | 44 +-
sdks/go/examples/wasm/README.md | 2 +-
sdks/go/pkg/beam/core/core.go | 2 +-
sdks/go/test/integration/integration.go | 3 +
.../container/license_scripts/dep_urls_java.yaml | 8 +
sdks/java/core/build.gradle | 2 +
.../sdk/fn/splittabledofn/RestrictionTrackers.java | 94 +++-
.../apache/beam/sdk/options/SdkHarnessOptions.java | 28 ++
.../fn/splittabledofn/RestrictionTrackersTest.java | 90 +++-
.../beam/sdk/transforms/ParDoLifecycleTest.java | 11 +-
.../sdk/extensions/gcp/options/GcsOptions.java | 1 -
sdks/java/extensions/sql/hcatalog/build.gradle | 4 +-
.../beam/sdk/io/gcp/bigquery/BigQueryIO.java | 2 +
.../gcp/bigquery/BigQueryStorageQuerySource.java | 22 +
.../sdk/io/gcp/firestore/FirestoreOptions.java | 5 +-
.../FirestoreStatefulComponentFactory.java | 23 +-
.../sdk/io/gcp/firestore/FirestoreV1WriteFn.java | 4 +-
.../beam/sdk/io/gcp/spanner/MutationUtils.java | 59 ++-
.../beam/sdk/io/gcp/spanner/StructUtils.java | 37 +-
.../gcp/firestore/BaseFirestoreV1WriteFnTest.java | 8 +-
...storeV1FnBatchWriteWithDeadLetterQueueTest.java | 2 +-
.../FirestoreV1FnBatchWriteWithSummaryTest.java | 2 +-
.../sdk/io/gcp/firestore/it/BaseFirestoreIT.java | 3 +-
.../beam/sdk/io/gcp/spanner/MutationUtilsTest.java | 33 ++
.../beam/sdk/io/gcp/spanner/StructUtilsTest.java | 39 ++
sdks/java/io/hcatalog/build.gradle | 19 +-
.../apache/beam/sdk/io/hcatalog/HCatalogIO.java | 2 +-
.../io/hcatalog/test/EmbeddedMetastoreService.java | 17 +-
.../apache/beam/sdk/io/iceberg/BundleLifter.java | 170 +++++++
.../org/apache/beam/sdk/io/iceberg/IcebergIO.java | 19 +-
.../apache/beam/sdk/io/iceberg/IcebergUtils.java | 9 +
.../IcebergWriteSchemaTransformProvider.java | 11 +
...owsToFiles.java => WriteDirectRowsToFiles.java} | 86 ++--
.../sdk/io/iceberg/WriteGroupedRowsToFiles.java | 9 +-
.../beam/sdk/io/iceberg/WriteToDestinations.java | 173 +++++--
.../sdk/io/iceberg/WriteUngroupedRowsToFiles.java | 9 +-
.../beam/sdk/io/iceberg/BundleLifterTest.java | 99 ++++
.../java/org/apache/beam/sdk/io/kafka/KafkaIO.java | 7 +
.../kafka}/KafkaReadWithRedistributeOverride.java | 8 +-
.../KafkaReadWithRedistributeOverrideTest.java | 4 +-
.../io/gcp/tests/xlang_spannerio_it_test.py | 129 ++++--
sdks/python/apache_beam/io/hadoopfilesystem.py | 11 +-
.../python/apache_beam/io/hadoopfilesystem_test.py | 7 +
sdks/python/apache_beam/io/requestresponse.py | 11 +-
.../python/apache_beam/options/pipeline_options.py | 2 +-
.../runners/interactive/interactive_beam.py | 99 +++-
.../runners/interactive/interactive_beam_test.py | 391 ++++++++++++++++
.../runners/interactive/interactive_environment.py | 19 +
.../interactive/interactive_environment_test.py | 41 ++
.../runners/interactive/recording_manager.py | 478 +++++++++++++++++++-
.../runners/interactive/recording_manager_test.py | 500 +++++++++++++++++++++
.../apache_beam/runners/interactive/utils_test.py | 12 +
.../apache_beam/runners/worker/operations.pxd | 1 +
.../apache_beam/runners/worker/operations.py | 22 +-
.../runners/worker/statesampler_test.py | 185 ++++++++
sdks/python/apache_beam/version.py | 2 +-
.../yaml/extended_tests/data/enrichment.yaml | 78 ++--
sdks/python/conftest.py | 34 +-
sdks/python/setup.py | 4 +-
sdks/python/tox.ini | 7 +-
sdks/typescript/package.json | 2 +-
sdks/typescript/src/apache_beam/runners/flink.ts | 2 +-
settings.gradle.kts | 18 +-
.../site/assets/css/fontawesome/release-v5.4.1.css | 5 +
website/www/site/assets/css/roboto/roboto.css | 35 ++
.../site/assets/css/swiper@8/swiper-bundle.min.css | 13 +
.../www/site/assets/js/jquery/jquery-2.2.4.min.js | 4 +
website/www/site/layouts/partials/head.html | 8 +-
.../www/site/layouts/partials/head_homepage.html | 8 +-
website/www/site/static/.htaccess | 5 +-
110 files changed, 3126 insertions(+), 419 deletions(-)
create mode 100644 contributor-docs/README.md
copy runners/flink/{ => 1.17}/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/DoFnOperator.java (100%)
copy runners/flink/{1.17 => 1.20}/build.gradle (94%)
copy runners/flink/{1.17 => 1.20}/job-server-container/build.gradle (100%)
copy runners/flink/{1.19 => 1.20}/job-server/build.gradle (95%)
rename runners/flink/{ => 1.20}/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/DoFnOperator.java (99%)
rename runners/flink/{1.17 => }/src/main/java/org/apache/beam/runners/flink/translation/types/CoderTypeSerializer.java (100%)
create mode 100644 sdks/java/io/iceberg/src/main/java/org/apache/beam/sdk/io/iceberg/BundleLifter.java
copy sdks/java/io/iceberg/src/main/java/org/apache/beam/sdk/io/iceberg/{WriteGroupedRowsToFiles.java => WriteDirectRowsToFiles.java} (58%)
create mode 100644 sdks/java/io/iceberg/src/test/java/org/apache/beam/sdk/io/iceberg/BundleLifterTest.java
rename {runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow => sdks/java/io/kafka/src/main/java/org/apache/beam/sdk/io/kafka}/KafkaReadWithRedistributeOverride.java (90%)
rename {runners/google-cloud-dataflow-java/src/test/java/org/apache/beam/runners/dataflow => sdks/java/io/kafka/src/test/java/org/apache/beam/sdk/io/kafka}/KafkaReadWithRedistributeOverrideTest.java (98%)
create mode 100644 website/www/site/assets/css/fontawesome/release-v5.4.1.css
create mode 100644 website/www/site/assets/css/roboto/roboto.css
create mode 100644 website/www/site/assets/css/swiper@8/swiper-bundle.min.css
create mode 100644 website/www/site/assets/js/jquery/jquery-2.2.4.min.js