You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Yifan Mai (Jira)" <ji...@apache.org> on 2021/08/25 20:25:00 UTC

[jira] [Created] (BEAM-12798) Configurable combiner packing limit

Yifan Mai created BEAM-12798:
--------------------------------

             Summary: Configurable combiner packing limit
                 Key: BEAM-12798
                 URL: https://issues.apache.org/jira/browse/BEAM-12798
             Project: Beam
          Issue Type: Bug
          Components: sdk-py-core
            Reporter: Yifan Mai


Currently translations.pack_combiners has no upper limit, which means it can potentially pack thousands of combiners together, which may cause OOM issues if the accumulators are large. We should set a default upper limit, and also make the upper limit configurable per-combiner.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)