You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ro...@apache.org on 2018/12/10 11:32:15 UTC
[beam] 01/01: Merge pull request #7127 from [BEAM-6120] Large gbk
iterables
This is an automated email from the ASF dual-hosted git repository.
robertwb pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
commit c2a9cac248ec45fbbd35bacec7de26321fc8d69f
Merge: a076444 e147bf9
Author: Robert Bradshaw <ro...@gmail.com>
AuthorDate: Mon Dec 10 12:32:07 2018 +0100
Merge pull request #7127 from [BEAM-6120] Large gbk iterables
[BEAM-6120] Support retrieval of large gbk iterables over the state API.
.../pipeline/src/main/proto/beam_runner_api.proto | 33 ++++++++++
sdks/python/apache_beam/coders/coder_impl.pxd | 7 +-
sdks/python/apache_beam/coders/coder_impl.py | 77 +++++++++++++++++++---
sdks/python/apache_beam/coders/coders.py | 56 +++++++++++++++-
.../apache_beam/coders/coders_test_common.py | 52 ++++++++++++---
.../python/apache_beam/runners/pipeline_context.py | 5 +-
.../runners/portability/fn_api_runner.py | 53 ++++++++++++++-
.../portability/fn_api_runner_transforms.py | 9 ++-
.../apache_beam/runners/worker/bundle_processor.py | 17 ++++-
sdks/python/apache_beam/utils/proto_utils.py | 8 +--
10 files changed, 286 insertions(+), 31 deletions(-)