You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2022/08/13 03:59:36 UTC

[beam] branch nightly-refs/heads/master updated (00bbc72e005 -> 184d8c59b34)

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git


    from 00bbc72e005 Bump google.golang.org/api from 0.91.0 to 0.92.0 in /sdks (#22681)
     add 8842514a7e5 Bump cloud.google.com/go/storage from 1.24.0 to 1.25.0 in /sdks (#22705)
     add 067af7746ae [Website] add container with overflow-x to runners with table #22708
     add 0b7f676a40e Merge pull request #22470: [Website] update runners table content overflow
     add 6df97a803c9 Bump mongo_java_driver to 3.12.11 and embed.mongo to 3.0.0
     add 18ada2b043a Merge pull request #22674: Bump mongo_java_driver to 3.12.11 and embed.mongo to 3.0.0
     add 7a9bb76fe9f [Go SDK]: Implement standalone single-precision float encoder (#22664)
     add 417692aa5b3 [Playground] [Backend] added validation for snippet endpoints to avoid error panic (#22686)
     add 3173b503bea Add GeneratedClassRowTypeConstraint (#22679)
     add ee59b8ff61d [Playground] [Backend] Removing unused snippets manually and using the scheduled task (#22389)
     add 40426bbe35c Implement PubsubSchemaTransformWriteConfiguration (#22262)
     add 63ba9c72275 Add support for FLOAT to Python RowCoder (#22626)
     add 184d8c59b34 Bump up python container versions (#22697)

No new revisions were added by this update.

Summary of changes:
 CHANGES.md                                         |   1 +
 .../org/apache/beam/gradle/BeamModulePlugin.groovy |   2 +-
 .../beam/model/fnexecution/v1/standard_coders.yaml |  11 ++
 playground/README.md                               |   7 +
 playground/backend/README.md                       |   2 +
 playground/backend/build.gradle.kts                |  11 +-
 .../backend/cmd/remove_unused_snippets.go          |  42 ++++--
 playground/backend/cmd/server/controller.go        |  14 +-
 playground/backend/cmd/server/server.go            |  17 ++-
 playground/backend/go.mod                          |   1 +
 playground/backend/go.sum                          |   3 +
 .../backend/internal/db/datastore/datastore_db.go  |  46 +++++-
 .../internal/db/datastore/datastore_db_test.go     | 139 ++++++++++++++++-
 playground/backend/internal/db/db.go               |   5 +-
 .../db/{entity/schema.go => dto/snippet.go}        |   6 +-
 .../backend/internal/environment/property.go       |   6 +-
 .../backend/internal/environment/property_test.go  |   4 +-
 playground/backend/internal/tasks/task.go          |  56 +++++++
 playground/backend/properties.yaml                 |   6 +
 sdks/go.mod                                        |   2 +-
 sdks/go.sum                                        |   4 +-
 .../pkg/beam/core/graph/coder/coder_fuzz_test.go   |  19 +++
 .../beam/core/graph/coder/{double.go => float.go}  |  16 +-
 .../graph/coder/{double_test.go => float_test.go}  |  27 ++--
 sdks/go/pkg/beam/core/graph/coder/row_decoder.go   |  13 +-
 sdks/go/pkg/beam/core/graph/coder/row_encoder.go   |   6 +-
 .../go/test/regression/coders/fromyaml/fromyaml.go |   1 +
 .../meta/provider/mongodb/MongoDbReadWriteIT.java  |  15 +-
 ...> PubsubSchemaTransformWriteConfiguration.java} |  97 ++----------
 sdks/java/io/mongodb/build.gradle                  |   4 +-
 .../beam/sdk/io/mongodb/MongoDBGridFSIOTest.java   |  15 +-
 .../apache/beam/sdk/io/mongodb/MongoDbIOTest.java  |  15 +-
 sdks/python/apache_beam/coders/coder_impl.py       |  16 ++
 sdks/python/apache_beam/coders/coders.py           |  28 +++-
 .../apache_beam/coders/coders_test_common.py       |   3 +-
 sdks/python/apache_beam/coders/row_coder.py        |   5 +
 sdks/python/apache_beam/coders/slow_stream.py      |   6 +
 sdks/python/apache_beam/coders/stream.pxd          |   2 +
 sdks/python/apache_beam/coders/stream.pyx          |   7 +
 sdks/python/apache_beam/coders/stream_test.py      |  13 ++
 .../apache_beam/runners/dataflow/internal/names.py |   4 +-
 sdks/python/apache_beam/transforms/core.py         |   4 +-
 sdks/python/apache_beam/typehints/row_type.py      |  80 ++++++++--
 .../apache_beam/typehints/schema_registry.py       |  54 +++++++
 sdks/python/apache_beam/typehints/schemas.py       | 165 +++++++++++----------
 sdks/python/apache_beam/typehints/schemas_test.py  |  96 +++++++++---
 .../typehints/trivial_inference_test.py            |   8 +-
 .../content/en/documentation/runners/dataflow.md   |   2 +
 .../site/content/en/documentation/runners/jet.md   |   2 +
 .../site/content/en/documentation/runners/samza.md |   2 +
 .../site/content/en/documentation/runners/spark.md |   8 +-
 .../content/en/documentation/runners/twister2.md   |   2 +
 .../shortcodes/flink_java_pipeline_options.html    |   2 +
 .../shortcodes/flink_python_pipeline_options.html  |   2 +
 54 files changed, 828 insertions(+), 296 deletions(-)
 copy sdks/go/pkg/beam/util/gcsx/example_test.go => playground/backend/cmd/remove_unused_snippets.go (51%)
 copy playground/backend/internal/db/{entity/schema.go => dto/snippet.go} (89%)
 create mode 100644 playground/backend/internal/tasks/task.go
 copy sdks/go/pkg/beam/core/graph/coder/{double.go => float.go} (71%)
 copy sdks/go/pkg/beam/core/graph/coder/{double_test.go => float_test.go} (61%)
 copy sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/{PubsubSchemaTransformReadConfiguration.java => PubsubSchemaTransformWriteConfiguration.java} (50%)
 create mode 100644 sdks/python/apache_beam/typehints/schema_registry.py