You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Yueyang Qiu (Jira)" <ji...@apache.org> on 2019/09/18 18:37:00 UTC

[jira] [Assigned] (BEAM-6906) Mutating accumulators in fused stages is generally unsafe - need to provide a single mutable accumulator

     [ https://issues.apache.org/jira/browse/BEAM-6906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yueyang Qiu reassigned BEAM-6906:
---------------------------------

    Assignee:     (was: Yueyang Qiu)

> Mutating accumulators in fused stages is generally unsafe - need to provide a single mutable accumulator
> --------------------------------------------------------------------------------------------------------
>
>                 Key: BEAM-6906
>                 URL: https://issues.apache.org/jira/browse/BEAM-6906
>             Project: Beam
>          Issue Type: Bug
>          Components: beam-model
>            Reporter: Kenneth Knowles
>            Priority: Critical
>          Time Spent: 40m
>  Remaining Estimate: 0h
>
> Our current docs encourage a CombineFn author to mutate accumulators for efficiency. This is important, but cannot be done generally without losing efficiency - it is not safe to share accumulators within a stage or across sliding windows. The ownership story needs to be clear. Any accumulator that is mutable is from that point on owned by the CombineFn, not the runner and cannot be given to other steps.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)