[jira] [Commented] (BEAM-8195) Quota exceeded for create requests

["yifan zou (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-8195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16926861#comment-16926861 ] 

yifan zou commented on BEAM-8195:
---------------------------------

We already set the quota of CreateRequestsPerMinutePerUser to its maximum number 60. Couldn't add more on it. [https://pantheon.corp.google.com/apis/api/dataflow.googleapis.com/quotas?project=apache-beam-testing&duration=PT6H]

I guess all jobs were created by the user "jenkins". We need consider to apply different users when creating the job (Job creation requests per minute is unlimited), or reduce the concurrent tests running on workers.

> Quota exceeded for create requests
> ----------------------------------
>
>                 Key: BEAM-8195
>                 URL: https://issues.apache.org/jira/browse/BEAM-8195
>             Project: Beam
>          Issue Type: Sub-task
>          Components: sdk-py-core, testing
>            Reporter: Ahmet Altay
>            Assignee: yifan zou
>            Priority: Critical
>
> Post commits failied with the following error:
> HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json>: response: <{'server': 'ESF', '-content-encoding': 'gzip', 'content-type': 'application/json; charset=UTF-8', 'content-length': '598', 'transfer-encoding': 'chunked', 'cache-control': 'private', 'x-xss-protection': '0', 'date': 'Tue, 10 Sep 2019 12:02:24 GMT', 'vary': 'Origin, X-Origin, Referer', 'x-frame-options': 'SAMEORIGIN', 'status': '429', 'x-content-type-options': 'nosniff'}>, content <{
>   "error": {
>     "code": 429,
>     "message": "Quota exceeded for quota metric 'dataflow.googleapis.com/create_requests' and limit 'CreateRequestsPerMinutePerUser' of service 'dataflow.googleapis.com' for consumer 'project_number:844138762903'.",
>     "status": "RESOURCE_EXHAUSTED",
>     "details": [
>       {
> Could we increase the quota?
> /cc [~alanmyrvold] [~kenn]



--
This message was sent by Atlassian Jira
(v8.3.2#803003)