You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2021/10/27 03:47:39 UTC
[beam] tag nightly-master updated (fd4eb15 -> 5cb634e)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/beam.git.
*** WARNING: tag nightly-master was modified! ***
from fd4eb15 (commit)
to 5cb634e (commit)
from fd4eb15 [BEAM-12522] Enable side inputs on all splittable DoFn execution time related methods.
add 49ae709 Merge pull request #15744 from [BEAM-13072][Playground] Executor builder
add 136eadc [BEAM-13104] ParquetIO: SplitReadFn must read the whole block
add 46c649a Merge pull request #15789 from aromanenko-dev/BEAM-13104-ParquetIO-filter
add e096daf [BEAM-6721] Set numShards dynamically for TextIO.write()
add 84e24ea Merge pull request #15500 from [BEAM-6721] Set numShards dynamically for TextIO.write()
add 62b33a5 Change sql.Options to an interface under sqlx. (#15790)
add 95d1f9a [BEAM-4149] Ensure that we always provide and require the worker id.
add a9ac63b [BEAM-11758] Update basics page: Splittable DoFn
add 0fb4170 Merge branch 'master' into concepts4
add cbce59f Address review feedback
add 63e21b1 [BEAM-11758] Update basics page: Splittable DoFn
add 5cb634e [BEAM-13098] Fix translation of repeated TableRow fields (#15779)
No new revisions were added by this update.
Summary of changes:
playground/backend/internal/executors/executor.go | 97 ++++------
.../backend/internal/executors/executor_builder.go | 151 +++++++++++++++
.../backend/internal/executors/executor_test.go | 207 +++++++++++++++++++++
playground/backend/internal/executors/go_helper.go | 29 ---
.../backend/internal/executors/java_helper.go | 69 -------
.../backend/internal/executors/java_helper_test.go | 76 --------
.../backend/internal/fs_tool/path_checker.go | 5 +-
.../backend/internal/validators/java_validators.go | 33 ++--
.../backend/internal/validators/validator.go | 7 +-
.../worker/fn/BeamFnControlServiceTest.java | 25 ++-
.../worker/fn/data/BeamFnDataGrpcServiceTest.java | 87 +++------
.../fn/logging/BeamFnLoggingServiceTest.java | 48 +++--
.../control/FnApiControlClientPoolService.java | 6 -
.../environment/EmbeddedEnvironmentFactory.java | 3 +-
.../provisioning/StaticGrpcProvisionService.java | 3 +-
.../runners/fnexecution/EmbeddedSdkHarness.java | 4 +-
.../control/FnApiControlClientPoolServiceTest.java | 54 ++++--
.../fnexecution/control/RemoteExecutionTest.java | 7 +-
.../StaticGrpcProvisionServiceTest.java | 5 +-
.../status/BeamWorkerStatusGrpcServiceTest.java | 2 +-
sdks/go/pkg/beam/transforms/sql/sql.go | 41 ++--
sdks/go/pkg/beam/transforms/sql/sqlx/sqlx.go | 8 +
.../main/java/org/apache/beam/sdk/io/TextIO.java | 25 ++-
.../java/org/apache/beam/sdk/io/WriteFiles.java | 3 +-
.../sdk/fn/channel}/AddHarnessIdInterceptor.java | 2 +-
.../server/GrpcContextHeaderAccessorProvider.java | 11 +-
.../beam/fn/harness/ProcessBundleBenchmark.java | 7 +-
.../java/org/apache/beam/fn/harness/FnHarness.java | 7 +-
.../io/gcp/bigquery/TableRowToStorageApiProto.java | 18 +-
.../bigquery/TableRowToStorageApiProtoTest.java | 68 ++++++-
.../org/apache/beam/sdk/io/parquet/ParquetIO.java | 6 +-
.../apache/beam/sdk/io/parquet/ParquetIOTest.java | 3 +-
.../www/site/content/en/documentation/basics.md | 44 +++++
33 files changed, 716 insertions(+), 445 deletions(-)
create mode 100644 playground/backend/internal/executors/executor_builder.go
create mode 100644 playground/backend/internal/executors/executor_test.go
delete mode 100644 playground/backend/internal/executors/go_helper.go
delete mode 100644 playground/backend/internal/executors/java_helper.go
delete mode 100644 playground/backend/internal/executors/java_helper_test.go
copy learning/katas/go/io/textio/read/testdata/path.go => playground/backend/internal/validators/java_validators.go (61%)
copy sdks/go/pkg/beam/core/runtime/graphx/v1/gen.go => playground/backend/internal/validators/validator.go (87%)
rename sdks/java/{harness/src/main/java/org/apache/beam/fn/harness/control => fn-execution/src/main/java/org/apache/beam/sdk/fn/channel}/AddHarnessIdInterceptor.java (97%)