You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Konstantinos Katsiapis (Jira)" <ji...@apache.org> on 2020/09/17 20:33:00 UTC

[jira] [Commented] (BEAM-529) Check immutability violations in DirectPipelineRunner

    [ https://issues.apache.org/jira/browse/BEAM-529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17197941#comment-17197941 ] 

Konstantinos Katsiapis commented on BEAM-529:
---------------------------------------------

This might be easy to implement for the *subset* of types that offer a deterministic Coder (eg by calling as_deterministic() on the pertinent Coder).

 

Increasing the priority of this since we continue to encounter user pipelines that mutate input elements in DoFns and CombineFns.

> Check immutability violations in DirectPipelineRunner
> -----------------------------------------------------
>
>                 Key: BEAM-529
>                 URL: https://issues.apache.org/jira/browse/BEAM-529
>             Project: Beam
>          Issue Type: New Feature
>          Components: sdk-py-core
>            Reporter: Ahmet Altay
>            Priority: P1
>              Labels: newbie, starter
>
> Users are going to mutate inputs and outputs of DoFn inappropriately. We should help their tests fail to catch such mistakes. (Similar to the DirectPipelineRunner in Java SDK)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)