You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by bo...@apache.org on 2020/08/17 18:36:24 UTC

[beam] branch master updated: [BEAM-10670] Make key coder deterministic by using upstream PCollection which uses random byte[] as the key.

This is an automated email from the ASF dual-hosted git repository.

boyuanz pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/master by this push:
     new f058b8c  [BEAM-10670] Make key coder deterministic by using upstream PCollection which uses random byte[] as the key.
     new 988b804  Merge pull request #12599 from lukecwik/beam10670
f058b8c is described below

commit f058b8c35ae63b6e51024b6c81b1fcc3bcb50090
Author: Luke Cwik <lc...@google.com>
AuthorDate: Mon Aug 17 10:20:16 2020 -0700

    [BEAM-10670] Make key coder deterministic by using upstream PCollection which uses random byte[] as the key.
    
    This is necessary for some runners that require deterministic key encodings.
---
 .../beam/runners/core/construction/SplittableParDoNaiveBounded.java     | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/SplittableParDoNaiveBounded.java b/runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/SplittableParDoNaiveBounded.java
index f1393ee..052a21d 100644
--- a/runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/SplittableParDoNaiveBounded.java
+++ b/runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/SplittableParDoNaiveBounded.java
@@ -106,8 +106,8 @@ public class SplittableParDoNaiveBounded {
     @Override
     public PCollectionTuple expand(PCollection<KV<byte[], KV<InputT, RestrictionT>>> input) {
       return input
-          .apply("Drop key", Values.create())
           .apply("Reshuffle", Reshuffle.of())
+          .apply("Drop key", Values.create())
           .apply(
               "NaiveProcess",
               ParDo.of(