You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Steve Niemitz (Jira)" <ji...@apache.org> on 2020/05/25 17:55:00 UTC

[jira] [Created] (BEAM-10075) Allow users to tune the grouping table size in batch dataflow pipelines

Steve Niemitz created BEAM-10075:
------------------------------------

             Summary: Allow users to tune the grouping table size in batch dataflow pipelines
                 Key: BEAM-10075
                 URL: https://issues.apache.org/jira/browse/BEAM-10075
             Project: Beam
          Issue Type: Improvement
          Components: runner-dataflow
            Reporter: Steve Niemitz
            Assignee: Steve Niemitz
             Fix For: 2.23.0


The dataflow worker hard-codes the grouping table size to 100 MB.  We should allow users to specify this as a pipeline parameter.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)