You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by lc...@apache.org on 2019/05/29 17:23:38 UTC
[beam] branch master updated (9647808 -> b6ceda1)
This is an automated email from the ASF dual-hosted git repository.
lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 9647808 Merge pull request #8713 from lostluck/sideforms
add 11a93ff [BEAM-3204] Clean-up Coder to only contain FunctionSpec removing SdkFunctionSpec.
add 1082584 [BEAM-3204] Clean-up Go code related to removing SdkFunctionSpec layer from Coder
add 35d3d15 [BEAM-3204] Update Python SDK Coder to only use FunctionSpec instead of SdkFunctionSpec
add a0388f0 fixup! Fix missed Python coder change
new b6ceda1 [BEAM-3204] Clean-up Coder to only contain FunctionSpec removing its usage of SdkFunctionSpec
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../pipeline/src/main/proto/beam_runner_api.proto | 4 +-
.../core/construction/CoderTranslation.java | 29 +-
.../runners/core/construction/ModelCoders.java | 12 +-
.../construction/expansion/ExpansionService.java | 5 +-
.../core/construction/CoderTranslationTest.java | 2 +-
.../runners/core/construction/ModelCodersTest.java | 13 +-
.../construction/graph/ProtoOverridesTest.java | 5 +-
.../graph/CreateExecutableStageNodeFunction.java | 6 +-
.../worker/graph/RegisterNodeFunction.java | 6 +-
.../control/ProcessBundleDescriptors.java | 4 +-
.../wire/LengthPrefixUnknownCoders.java | 11 +-
.../control/DefaultJobBundleFactoryTest.java | 8 +-
sdks/go/pkg/beam/core/runtime/graphx/coder.go | 31 +-
.../beam/model/fnexecution_v1/beam_fn_api.pb.go | 330 +++---
.../model/fnexecution_v1/beam_provision_api.pb.go | 18 +-
.../model/jobmanagement_v1/beam_artifact_api.pb.go | 34 +-
.../jobmanagement_v1/beam_expansion_api.pb.go | 45 +-
.../beam/model/jobmanagement_v1/beam_job_api.pb.go | 52 +-
.../beam/model/pipeline_v1/beam_runner_api.pb.go | 1064 +++++++++++---------
sdks/go/pkg/beam/model/pipeline_v1/endpoints.pb.go | 22 +-
.../model/pipeline_v1/external_transforms.pb.go | 8 +-
sdks/go/pkg/beam/model/pipeline_v1/metrics.pb.go | 104 +-
.../model/pipeline_v1/standard_window_fns.pb.go | 20 +-
.../fn/harness/control/RegisterHandlerTest.java | 14 +-
sdks/python/apache_beam/coders/coders.py | 19 +-
.../apache_beam/coders/standard_coders_test.py | 5 +-
.../portability/fn_api_runner_transforms.py | 54 +-
.../apache_beam/runners/worker/bundle_processor.py | 4 +-
28 files changed, 993 insertions(+), 936 deletions(-)
[beam] 01/01: [BEAM-3204] Clean-up Coder to only contain
FunctionSpec removing its usage of SdkFunctionSpec
Posted by lc...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
commit b6ceda147c3b067040d6f6f290f36dd2ea46ec7f
Merge: 9647808 a0388f0
Author: Lukasz Cwik <lu...@gmail.com>
AuthorDate: Wed May 29 10:23:24 2019 -0700
[BEAM-3204] Clean-up Coder to only contain FunctionSpec removing its usage of SdkFunctionSpec
.../pipeline/src/main/proto/beam_runner_api.proto | 4 +-
.../core/construction/CoderTranslation.java | 29 +-
.../runners/core/construction/ModelCoders.java | 12 +-
.../construction/expansion/ExpansionService.java | 5 +-
.../core/construction/CoderTranslationTest.java | 2 +-
.../runners/core/construction/ModelCodersTest.java | 13 +-
.../construction/graph/ProtoOverridesTest.java | 5 +-
.../graph/CreateExecutableStageNodeFunction.java | 6 +-
.../worker/graph/RegisterNodeFunction.java | 6 +-
.../control/ProcessBundleDescriptors.java | 4 +-
.../wire/LengthPrefixUnknownCoders.java | 11 +-
.../control/DefaultJobBundleFactoryTest.java | 8 +-
sdks/go/pkg/beam/core/runtime/graphx/coder.go | 31 +-
.../beam/model/fnexecution_v1/beam_fn_api.pb.go | 330 +++---
.../model/fnexecution_v1/beam_provision_api.pb.go | 18 +-
.../model/jobmanagement_v1/beam_artifact_api.pb.go | 34 +-
.../jobmanagement_v1/beam_expansion_api.pb.go | 45 +-
.../beam/model/jobmanagement_v1/beam_job_api.pb.go | 52 +-
.../beam/model/pipeline_v1/beam_runner_api.pb.go | 1064 +++++++++++---------
sdks/go/pkg/beam/model/pipeline_v1/endpoints.pb.go | 22 +-
.../model/pipeline_v1/external_transforms.pb.go | 8 +-
sdks/go/pkg/beam/model/pipeline_v1/metrics.pb.go | 104 +-
.../model/pipeline_v1/standard_window_fns.pb.go | 20 +-
.../fn/harness/control/RegisterHandlerTest.java | 14 +-
sdks/python/apache_beam/coders/coders.py | 19 +-
.../apache_beam/coders/standard_coders_test.py | 5 +-
.../portability/fn_api_runner_transforms.py | 54 +-
.../apache_beam/runners/worker/bundle_processor.py | 4 +-
28 files changed, 993 insertions(+), 936 deletions(-)
diff --cc runners/java-fn-execution/src/test/java/org/apache/beam/runners/fnexecution/control/DefaultJobBundleFactoryTest.java
index 0244aff,72319aa..5da5d78
--- a/runners/java-fn-execution/src/test/java/org/apache/beam/runners/fnexecution/control/DefaultJobBundleFactoryTest.java
+++ b/runners/java-fn-execution/src/test/java/org/apache/beam/runners/fnexecution/control/DefaultJobBundleFactoryTest.java
@@@ -33,10 -33,8 +33,9 @@@ import org.apache.beam.model.pipeline.v
import org.apache.beam.model.pipeline.v1.RunnerApi.ExecutableStagePayload;
import org.apache.beam.model.pipeline.v1.RunnerApi.FunctionSpec;
import org.apache.beam.model.pipeline.v1.RunnerApi.PCollection;
- import org.apache.beam.model.pipeline.v1.RunnerApi.SdkFunctionSpec;
import org.apache.beam.model.pipeline.v1.RunnerApi.WindowingStrategy;
import org.apache.beam.runners.core.construction.ModelCoders;
+import org.apache.beam.runners.core.construction.PipelineOptionsTranslation;
import org.apache.beam.runners.core.construction.graph.ExecutableStage;
import org.apache.beam.runners.fnexecution.GrpcFnServer;
import org.apache.beam.runners.fnexecution.ServerFactory;