You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Yichi Zhang (Jira)" <ji...@apache.org> on 2021/06/02 23:03:00 UTC

[jira] [Created] (BEAM-12447) SdkContainerImageBuilder should take machineType configs

Yichi Zhang created BEAM-12447:
----------------------------------

             Summary: SdkContainerImageBuilder should take machineType configs
                 Key: BEAM-12447
                 URL: https://issues.apache.org/jira/browse/BEAM-12447
             Project: Beam
          Issue Type: Improvement
          Components: runner-dataflow, sdk-py-core
            Reporter: Yichi Zhang
            Assignee: Yichi Zhang


When prebuilding the python SDK container harness image with SdkContainerImageBuilder on google cloud build, it can run out of memory and fail the build with docker exit code 137. The default machineType is only n1-standard-1 and it is unlikely sufficient to build large images.

 

The SdkContainerImageBuilder should take additional machineType configs to circumvent the docker OOM issue.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)