You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2022/08/13 03:59:36 UTC
[beam] branch nightly-refs/heads/master updated (00bbc72e005 -> 184d8c59b34)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from 00bbc72e005 Bump google.golang.org/api from 0.91.0 to 0.92.0 in /sdks (#22681)
add 8842514a7e5 Bump cloud.google.com/go/storage from 1.24.0 to 1.25.0 in /sdks (#22705)
add 067af7746ae [Website] add container with overflow-x to runners with table #22708
add 0b7f676a40e Merge pull request #22470: [Website] update runners table content overflow
add 6df97a803c9 Bump mongo_java_driver to 3.12.11 and embed.mongo to 3.0.0
add 18ada2b043a Merge pull request #22674: Bump mongo_java_driver to 3.12.11 and embed.mongo to 3.0.0
add 7a9bb76fe9f [Go SDK]: Implement standalone single-precision float encoder (#22664)
add 417692aa5b3 [Playground] [Backend] added validation for snippet endpoints to avoid error panic (#22686)
add 3173b503bea Add GeneratedClassRowTypeConstraint (#22679)
add ee59b8ff61d [Playground] [Backend] Removing unused snippets manually and using the scheduled task (#22389)
add 40426bbe35c Implement PubsubSchemaTransformWriteConfiguration (#22262)
add 63ba9c72275 Add support for FLOAT to Python RowCoder (#22626)
add 184d8c59b34 Bump up python container versions (#22697)
No new revisions were added by this update.
Summary of changes:
CHANGES.md | 1 +
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 2 +-
.../beam/model/fnexecution/v1/standard_coders.yaml | 11 ++
playground/README.md | 7 +
playground/backend/README.md | 2 +
playground/backend/build.gradle.kts | 11 +-
.../backend/cmd/remove_unused_snippets.go | 42 ++++--
playground/backend/cmd/server/controller.go | 14 +-
playground/backend/cmd/server/server.go | 17 ++-
playground/backend/go.mod | 1 +
playground/backend/go.sum | 3 +
.../backend/internal/db/datastore/datastore_db.go | 46 +++++-
.../internal/db/datastore/datastore_db_test.go | 139 ++++++++++++++++-
playground/backend/internal/db/db.go | 5 +-
.../db/{entity/schema.go => dto/snippet.go} | 6 +-
.../backend/internal/environment/property.go | 6 +-
.../backend/internal/environment/property_test.go | 4 +-
playground/backend/internal/tasks/task.go | 56 +++++++
playground/backend/properties.yaml | 6 +
sdks/go.mod | 2 +-
sdks/go.sum | 4 +-
.../pkg/beam/core/graph/coder/coder_fuzz_test.go | 19 +++
.../beam/core/graph/coder/{double.go => float.go} | 16 +-
.../graph/coder/{double_test.go => float_test.go} | 27 ++--
sdks/go/pkg/beam/core/graph/coder/row_decoder.go | 13 +-
sdks/go/pkg/beam/core/graph/coder/row_encoder.go | 6 +-
.../go/test/regression/coders/fromyaml/fromyaml.go | 1 +
.../meta/provider/mongodb/MongoDbReadWriteIT.java | 15 +-
...> PubsubSchemaTransformWriteConfiguration.java} | 97 ++----------
sdks/java/io/mongodb/build.gradle | 4 +-
.../beam/sdk/io/mongodb/MongoDBGridFSIOTest.java | 15 +-
.../apache/beam/sdk/io/mongodb/MongoDbIOTest.java | 15 +-
sdks/python/apache_beam/coders/coder_impl.py | 16 ++
sdks/python/apache_beam/coders/coders.py | 28 +++-
.../apache_beam/coders/coders_test_common.py | 3 +-
sdks/python/apache_beam/coders/row_coder.py | 5 +
sdks/python/apache_beam/coders/slow_stream.py | 6 +
sdks/python/apache_beam/coders/stream.pxd | 2 +
sdks/python/apache_beam/coders/stream.pyx | 7 +
sdks/python/apache_beam/coders/stream_test.py | 13 ++
.../apache_beam/runners/dataflow/internal/names.py | 4 +-
sdks/python/apache_beam/transforms/core.py | 4 +-
sdks/python/apache_beam/typehints/row_type.py | 80 ++++++++--
.../apache_beam/typehints/schema_registry.py | 54 +++++++
sdks/python/apache_beam/typehints/schemas.py | 165 +++++++++++----------
sdks/python/apache_beam/typehints/schemas_test.py | 96 +++++++++---
.../typehints/trivial_inference_test.py | 8 +-
.../content/en/documentation/runners/dataflow.md | 2 +
.../site/content/en/documentation/runners/jet.md | 2 +
.../site/content/en/documentation/runners/samza.md | 2 +
.../site/content/en/documentation/runners/spark.md | 8 +-
.../content/en/documentation/runners/twister2.md | 2 +
.../shortcodes/flink_java_pipeline_options.html | 2 +
.../shortcodes/flink_python_pipeline_options.html | 2 +
54 files changed, 828 insertions(+), 296 deletions(-)
copy sdks/go/pkg/beam/util/gcsx/example_test.go => playground/backend/cmd/remove_unused_snippets.go (51%)
copy playground/backend/internal/db/{entity/schema.go => dto/snippet.go} (89%)
create mode 100644 playground/backend/internal/tasks/task.go
copy sdks/go/pkg/beam/core/graph/coder/{double.go => float.go} (71%)
copy sdks/go/pkg/beam/core/graph/coder/{double_test.go => float_test.go} (61%)
copy sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/{PubsubSchemaTransformReadConfiguration.java => PubsubSchemaTransformWriteConfiguration.java} (50%)
create mode 100644 sdks/python/apache_beam/typehints/schema_registry.py