You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Udi Meiri (Jira)" <ji...@apache.org> on 2020/01/09 00:39:00 UTC

[jira] [Commented] (BEAM-8882) Allow Dataflow to automatically choose portability or not.

    [ https://issues.apache.org/jira/browse/BEAM-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011099#comment-17011099 ] 

Udi Meiri commented on BEAM-8882:
---------------------------------

I think the best thing here is to add a release note telling:
Users running pipeline with beam.Create using DirectRunner (such as in tests) may need to add the keyword reshuffle=False to Create() if they're seeing weird behavior.
Reshuffle use in Create has the effect of randomizing the order of the resulting PCollection.


> Allow Dataflow to automatically choose portability or not.
> ----------------------------------------------------------
>
>                 Key: BEAM-8882
>                 URL: https://issues.apache.org/jira/browse/BEAM-8882
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-py-core
>            Reporter: Robert Bradshaw
>            Assignee: Robert Bradshaw
>            Priority: Critical
>             Fix For: 2.18.0
>
>          Time Spent: 5h 50m
>  Remaining Estimate: 0h
>
> We would like the Dataflow service to be able to automatically choose whether to run pipelines in a portable way. In order to do this, we need to provide more information even if portability is not explicitly requested. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)