You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Alan Myrvold (JIRA)" <ji...@apache.org> on 2018/12/10 19:19:00 UTC

[jira] [Created] (BEAM-6203) Load test for dataflow caused other tests to fail due to lack of quota

Alan Myrvold created BEAM-6203:
----------------------------------

             Summary: Load test for dataflow caused other tests to fail due to lack of quota
                 Key: BEAM-6203
                 URL: https://issues.apache.org/jira/browse/BEAM-6203
             Project: Beam
          Issue Type: Bug
          Components: build-system
    Affects Versions: 2.10.0
            Reporter: Alan Myrvold
            Assignee: Lukasz Gajowy


On Dec 10, tests of dataflow pipelines were failing. Console logs showed lack of quota:
Workflow failed. Causes: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/6987 instances, 1/0 CPUs, 250/69951 disk GB, 0/4046 SSD disk GB, 1/293 instance groups, 1/293 managed instance groups, 1/268 instance templates, 1/241 in-use IP addresses.

At the same time, the loadtestoptions-jenkins-1210161627-d0e49a84 job was running, and requested 1000 workers, and got 498 max. It ran for 1hr 21min.

Could this job be reduced in scope or limited in the number of dataflow workers?

https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-12-10_08_16_32-12840883456333022524?project=apache-beam-testing



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)