You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Daniel Halperin (JIRA)" <ji...@apache.org> on 2017/04/03 17:12:41 UTC

[jira] [Commented] (BEAM-344) Merge, Split, Delay, and Reorder bundles in the DirectRunner

    [ https://issues.apache.org/jira/browse/BEAM-344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15953839#comment-15953839 ] 

Daniel Halperin commented on BEAM-344:
--------------------------------------

[~tgroh] Some of this is now happening. How much?

Starter bug (if not complete)?

> Merge, Split, Delay, and Reorder bundles in the DirectRunner
> ------------------------------------------------------------
>
>                 Key: BEAM-344
>                 URL: https://issues.apache.org/jira/browse/BEAM-344
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-direct
>            Reporter: Thomas Groh
>            Priority: Minor
>
> PCollections have no guarantees about the ordering of elements between steps
> Randomly reordering, splitting and merging bundles will break user pipelines which assume some order will be maintained between steps and within a bundle. This assumption is not correct, so should break in the Direct Runner.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)