You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kenneth Knowles (JIRA)" <ji...@apache.org> on 2019/03/25 21:52:00 UTC

[jira] [Created] (BEAM-6906) Mutating accumulators in fused stages is generally unsafe - need to provide a single mutable accumulator

Kenneth Knowles created BEAM-6906:
-------------------------------------

             Summary: Mutating accumulators in fused stages is generally unsafe - need to provide a single mutable accumulator
                 Key: BEAM-6906
                 URL: https://issues.apache.org/jira/browse/BEAM-6906
             Project: Beam
          Issue Type: Test
          Components: beam-model
            Reporter: Kenneth Knowles
            Assignee: Yueyang Qiu


Our current docs encourage a CombineFn author to mutate accumulators for efficiency. This is important, but cannot be done generally without losing efficiency - it is not safe to share accumulators within a stage or across sliding windows. The ownership story needs to be clear. Any accumulator that is mutable is from that point on owned by the CombineFn, not the runner and cannot be given to other steps.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)