You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by he...@apache.org on 2018/08/18 23:48:42 UTC
[beam] branch master updated (6637a50 -> f31b789)
This is an automated email from the ASF dual-hosted git repository.
herohde pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.
from 6637a50 Merge pull request #6166 from cclauss/print_function
add 14ef23c [BEAM-3286] Add Go support for side input
add e68296a CR: address review comments
new f31b789 [BEAM-3286] Add preliminary Go support for side input
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
sdks/go/pkg/beam/core/runtime/exec/coder.go | 62 ++--
sdks/go/pkg/beam/core/runtime/exec/cogbk.go | 12 +-
sdks/go/pkg/beam/core/runtime/exec/combine.go | 14 +-
sdks/go/pkg/beam/core/runtime/exec/combine_test.go | 4 +-
sdks/go/pkg/beam/core/runtime/exec/data.go | 70 +++++
sdks/go/pkg/beam/core/runtime/exec/datasink.go | 16 +-
sdks/go/pkg/beam/core/runtime/exec/datasource.go | 28 +-
sdks/go/pkg/beam/core/runtime/exec/discard.go | 2 +-
sdks/go/pkg/beam/core/runtime/exec/flatten.go | 2 +-
sdks/go/pkg/beam/core/runtime/exec/flatten_test.go | 2 +-
sdks/go/pkg/beam/core/runtime/exec/fn.go | 6 +-
sdks/go/pkg/beam/core/runtime/exec/fullvalue.go | 16 +-
sdks/go/pkg/beam/core/runtime/exec/input.go | 12 +-
sdks/go/pkg/beam/core/runtime/exec/multiplex.go | 2 +-
.../pkg/beam/core/runtime/exec/multiplex_test.go | 2 +-
.../pkg/beam/core/runtime/exec/optimized/inputs.go | 6 +-
.../beam/core/runtime/exec/optimized/inputs.tmpl | 6 +-
sdks/go/pkg/beam/core/runtime/exec/pardo.go | 129 +++++----
sdks/go/pkg/beam/core/runtime/exec/pardo_test.go | 14 +-
sdks/go/pkg/beam/core/runtime/exec/plan.go | 2 +-
sdks/go/pkg/beam/core/runtime/exec/sideinput.go | 150 ++++++++++
sdks/go/pkg/beam/core/runtime/exec/translate.go | 36 ++-
sdks/go/pkg/beam/core/runtime/exec/unit.go | 2 +-
sdks/go/pkg/beam/core/runtime/exec/unit_test.go | 17 +-
sdks/go/pkg/beam/core/runtime/exec/util.go | 2 +-
sdks/go/pkg/beam/core/runtime/exec/window.go | 2 +-
sdks/go/pkg/beam/core/runtime/graphx/translate.go | 204 +++++++++-----
sdks/go/pkg/beam/core/runtime/harness/datamgr.go | 173 +++++++-----
.../pkg/beam/core/runtime/harness/datamgr_test.go | 9 +-
sdks/go/pkg/beam/core/runtime/harness/harness.go | 13 +-
sdks/go/pkg/beam/core/runtime/harness/session.go | 2 +-
sdks/go/pkg/beam/core/runtime/harness/statemgr.go | 311 +++++++++++++++++++++
sdks/go/pkg/beam/core/runtime/pipelinex/clone.go | 38 +++
.../beam/runners/dataflow/dataflowlib/execute.go | 8 +-
.../pkg/beam/runners/dataflow/dataflowlib/fixup.go | 59 ++++
sdks/go/pkg/beam/runners/direct/buffer.go | 13 +-
sdks/go/pkg/beam/runners/direct/direct.go | 2 +-
sdks/go/pkg/beam/runners/direct/gbk.go | 4 +-
sdks/go/pkg/beam/runners/direct/impulse.go | 2 +-
sdks/go/pkg/beam/runners/universal/universal.go | 4 +
40 files changed, 1133 insertions(+), 325 deletions(-)
create mode 100644 sdks/go/pkg/beam/core/runtime/exec/data.go
create mode 100644 sdks/go/pkg/beam/core/runtime/exec/sideinput.go
create mode 100644 sdks/go/pkg/beam/core/runtime/harness/statemgr.go
create mode 100644 sdks/go/pkg/beam/runners/dataflow/dataflowlib/fixup.go
[beam] 01/01: [BEAM-3286] Add preliminary Go support for side input
Posted by he...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
herohde pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
commit f31b789d591f7b8f6f96899a79fb6edf45ebcd34
Merge: 6637a50 e68296a
Author: Henning Rohde <he...@seekerror.org>
AuthorDate: Sat Aug 18 16:48:36 2018 -0700
[BEAM-3286] Add preliminary Go support for side input
sdks/go/pkg/beam/core/runtime/exec/coder.go | 62 ++--
sdks/go/pkg/beam/core/runtime/exec/cogbk.go | 12 +-
sdks/go/pkg/beam/core/runtime/exec/combine.go | 14 +-
sdks/go/pkg/beam/core/runtime/exec/combine_test.go | 4 +-
sdks/go/pkg/beam/core/runtime/exec/data.go | 70 +++++
sdks/go/pkg/beam/core/runtime/exec/datasink.go | 16 +-
sdks/go/pkg/beam/core/runtime/exec/datasource.go | 28 +-
sdks/go/pkg/beam/core/runtime/exec/discard.go | 2 +-
sdks/go/pkg/beam/core/runtime/exec/flatten.go | 2 +-
sdks/go/pkg/beam/core/runtime/exec/flatten_test.go | 2 +-
sdks/go/pkg/beam/core/runtime/exec/fn.go | 6 +-
sdks/go/pkg/beam/core/runtime/exec/fullvalue.go | 16 +-
sdks/go/pkg/beam/core/runtime/exec/input.go | 12 +-
sdks/go/pkg/beam/core/runtime/exec/multiplex.go | 2 +-
.../pkg/beam/core/runtime/exec/multiplex_test.go | 2 +-
.../pkg/beam/core/runtime/exec/optimized/inputs.go | 6 +-
.../beam/core/runtime/exec/optimized/inputs.tmpl | 6 +-
sdks/go/pkg/beam/core/runtime/exec/pardo.go | 129 +++++----
sdks/go/pkg/beam/core/runtime/exec/pardo_test.go | 14 +-
sdks/go/pkg/beam/core/runtime/exec/plan.go | 2 +-
sdks/go/pkg/beam/core/runtime/exec/sideinput.go | 150 ++++++++++
sdks/go/pkg/beam/core/runtime/exec/translate.go | 36 ++-
sdks/go/pkg/beam/core/runtime/exec/unit.go | 2 +-
sdks/go/pkg/beam/core/runtime/exec/unit_test.go | 17 +-
sdks/go/pkg/beam/core/runtime/exec/util.go | 2 +-
sdks/go/pkg/beam/core/runtime/exec/window.go | 2 +-
sdks/go/pkg/beam/core/runtime/graphx/translate.go | 204 +++++++++-----
sdks/go/pkg/beam/core/runtime/harness/datamgr.go | 173 +++++++-----
.../pkg/beam/core/runtime/harness/datamgr_test.go | 9 +-
sdks/go/pkg/beam/core/runtime/harness/harness.go | 13 +-
sdks/go/pkg/beam/core/runtime/harness/session.go | 2 +-
sdks/go/pkg/beam/core/runtime/harness/statemgr.go | 311 +++++++++++++++++++++
sdks/go/pkg/beam/core/runtime/pipelinex/clone.go | 38 +++
.../beam/runners/dataflow/dataflowlib/execute.go | 8 +-
.../pkg/beam/runners/dataflow/dataflowlib/fixup.go | 59 ++++
sdks/go/pkg/beam/runners/direct/buffer.go | 13 +-
sdks/go/pkg/beam/runners/direct/direct.go | 2 +-
sdks/go/pkg/beam/runners/direct/gbk.go | 4 +-
sdks/go/pkg/beam/runners/direct/impulse.go | 2 +-
sdks/go/pkg/beam/runners/universal/universal.go | 4 +
40 files changed, 1133 insertions(+), 325 deletions(-)