You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by mx...@apache.org on 2019/05/15 08:58:03 UTC

[beam] branch master updated (c630217 -> 434f0ec)

This is an automated email from the ASF dual-hosted git repository.

mxm pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from c630217  Merge pull request #8425: [BEAM-7174] Add schema modification transforms
     add 32624ad  [BEAM-5865] Create optional auto-balancing sharding function for Flink
     add cc5c897  [BEAM-5865] Add unit tests and fix bug + changes from review
     add 9ce0d8e  [BEAM-5865] Improve FlinkPipelineOptions javadoc
     new 434f0ec  Merge pull request #8499: [BEAM-5865] Create optional auto-balancing sharding function for Flink

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../beam/runners/flink/FlinkPipelineOptions.java   |  12 ++
 .../flink/FlinkStreamingPipelineTranslator.java    | 193 ++++++++++++++++++++-
 .../runners/flink/FlinkTransformOverrides.java     |   3 +-
 .../wrappers/streaming/FlinkKeyUtils.java          |   4 +-
 .../FlinkStreamingPipelineTranslatorTest.java      | 123 +++++++++++++
 .../Metric.java => io/ShardingFunction.java}       |  13 +-
 .../java/org/apache/beam/sdk/io/WriteFiles.java    |  88 +++++++---
 .../org/apache/beam/sdk/io/WriteFilesTest.java     |  82 ++++++++-
 8 files changed, 476 insertions(+), 42 deletions(-)
 create mode 100644 runners/flink/src/test/java/org/apache/beam/runners/flink/FlinkStreamingPipelineTranslatorTest.java
 copy sdks/java/core/src/main/java/org/apache/beam/sdk/{metrics/Metric.java => io/ShardingFunction.java} (70%)


[beam] 01/01: Merge pull request #8499: [BEAM-5865] Create optional auto-balancing sharding function for Flink

Posted by mx...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

mxm pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 434f0ec32eb1c1824678a915166219accc929e0e
Merge: c630217 9ce0d8e
Author: Maximilian Michels <mx...@apache.org>
AuthorDate: Wed May 15 10:57:47 2019 +0200

    Merge pull request #8499: [BEAM-5865] Create optional auto-balancing sharding function for Flink

 .../beam/runners/flink/FlinkPipelineOptions.java   |  12 ++
 .../flink/FlinkStreamingPipelineTranslator.java    | 193 ++++++++++++++++++++-
 .../runners/flink/FlinkTransformOverrides.java     |   3 +-
 .../wrappers/streaming/FlinkKeyUtils.java          |   4 +-
 .../FlinkStreamingPipelineTranslatorTest.java      | 123 +++++++++++++
 .../org/apache/beam/sdk/io/ShardingFunction.java   |  31 ++++
 .../java/org/apache/beam/sdk/io/WriteFiles.java    |  88 +++++++---
 .../org/apache/beam/sdk/io/WriteFilesTest.java     |  82 ++++++++-
 8 files changed, 500 insertions(+), 36 deletions(-)