You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by mx...@apache.org on 2019/05/15 08:58:04 UTC

[beam] 01/01: Merge pull request #8499: [BEAM-5865] Create optional auto-balancing sharding function for Flink

This is an automated email from the ASF dual-hosted git repository.

mxm pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 434f0ec32eb1c1824678a915166219accc929e0e
Merge: c630217 9ce0d8e
Author: Maximilian Michels <mx...@apache.org>
AuthorDate: Wed May 15 10:57:47 2019 +0200

    Merge pull request #8499: [BEAM-5865] Create optional auto-balancing sharding function for Flink

 .../beam/runners/flink/FlinkPipelineOptions.java   |  12 ++
 .../flink/FlinkStreamingPipelineTranslator.java    | 193 ++++++++++++++++++++-
 .../runners/flink/FlinkTransformOverrides.java     |   3 +-
 .../wrappers/streaming/FlinkKeyUtils.java          |   4 +-
 .../FlinkStreamingPipelineTranslatorTest.java      | 123 +++++++++++++
 .../org/apache/beam/sdk/io/ShardingFunction.java   |  31 ++++
 .../java/org/apache/beam/sdk/io/WriteFiles.java    |  88 +++++++---
 .../org/apache/beam/sdk/io/WriteFilesTest.java     |  82 ++++++++-
 8 files changed, 500 insertions(+), 36 deletions(-)