You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Brian Hulette (Jira)" <ji...@apache.org> on 2020/01/02 23:26:01 UTC

[jira] [Created] (BEAM-9049) Add knobs for dataflow worker MemoryMonitor

Brian Hulette created BEAM-9049:
-----------------------------------

             Summary: Add knobs for dataflow worker MemoryMonitor
                 Key: BEAM-9049
                 URL: https://issues.apache.org/jira/browse/BEAM-9049
             Project: Beam
          Issue Type: Improvement
          Components: runner-dataflow
            Reporter: Brian Hulette
            Assignee: Brian Hulette


MemoryMonitor has many knobs that are just hard-coded for now. We should make some (or all) of these knobs available via pipeline options, so that users have control over when workers will be killed due to thrashing. 

https://github.com/apache/beam/blob/master/runners/google-cloud-dataflow-java/worker/src/main/java/org/apache/beam/runners/dataflow/worker/util/MemoryMonitor.java#L123



--
This message was sent by Atlassian Jira
(v8.3.4#803005)