You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by bo...@apache.org on 2020/08/17 18:36:24 UTC
[beam] branch master updated: [BEAM-10670] Make key coder
deterministic by using upstream PCollection which uses random byte[] as the
key.
This is an automated email from the ASF dual-hosted git repository.
boyuanz pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push:
new f058b8c [BEAM-10670] Make key coder deterministic by using upstream PCollection which uses random byte[] as the key.
new 988b804 Merge pull request #12599 from lukecwik/beam10670
f058b8c is described below
commit f058b8c35ae63b6e51024b6c81b1fcc3bcb50090
Author: Luke Cwik <lc...@google.com>
AuthorDate: Mon Aug 17 10:20:16 2020 -0700
[BEAM-10670] Make key coder deterministic by using upstream PCollection which uses random byte[] as the key.
This is necessary for some runners that require deterministic key encodings.
---
.../beam/runners/core/construction/SplittableParDoNaiveBounded.java | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/SplittableParDoNaiveBounded.java b/runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/SplittableParDoNaiveBounded.java
index f1393ee..052a21d 100644
--- a/runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/SplittableParDoNaiveBounded.java
+++ b/runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/SplittableParDoNaiveBounded.java
@@ -106,8 +106,8 @@ public class SplittableParDoNaiveBounded {
@Override
public PCollectionTuple expand(PCollection<KV<byte[], KV<InputT, RestrictionT>>> input) {
return input
- .apply("Drop key", Values.create())
.apply("Reshuffle", Reshuffle.of())
+ .apply("Drop key", Values.create())
.apply(
"NaiveProcess",
ParDo.of(