You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/08/02 18:31:00 UTC
[jira] [Work logged] (BEAM-5053) CreateRequestsPerMinutePerUser
quota limit exceeded
[ https://issues.apache.org/jira/browse/BEAM-5053?focusedWorklogId=130565&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-130565 ]
ASF GitHub Bot logged work on BEAM-5053:
----------------------------------------
Author: ASF GitHub Bot
Created on: 02/Aug/18 18:30
Start Date: 02/Aug/18 18:30
Worklog Time Spent: 10m
Work Description: Ardagan opened a new pull request #6125: [BEAM-5053] Make auto post-commit builds non-concurrent
URL: https://github.com/apache/beam/pull/6125
Generalize post-commit builds concurrency:
* Make auto-triggered post-commit builds non-concurrent
* Make on-PR builds concurrent with concurrency limit of 3.
------------------------
Follow this checklist to help us incorporate your contribution quickly and easily:
- [ ] Format the pull request title like `[BEAM-XXX] Fixes bug in ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
- [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
It will help us expedite review of your Pull Request if you tag someone (e.g. `@username`) to look at it.
Post-Commit Tests Status (on master branch)
------------------------------------------------------------------------------------------------
Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark
--- | --- | --- | --- | --- | --- | --- | ---
Go | [](https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/lastCompletedBuild/) | --- | --- | --- | --- | --- | ---
Java | [](https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/lastCompletedBuild/)
Python | [](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/) | --- | [](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/) </br> [](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/) | --- | --- | --- | ---
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 130565)
Time Spent: 10m
Remaining Estimate: 0h
> CreateRequestsPerMinutePerUser quota limit exceeded
> ---------------------------------------------------
>
> Key: BEAM-5053
> URL: https://issues.apache.org/jira/browse/BEAM-5053
> Project: Beam
> Issue Type: Bug
> Components: test-failures, testing
> Reporter: Mikhail Gryzykhin
> Assignee: Mikhail Gryzykhin
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> [https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/553/consoleFull]
>
> Dataflow has a CreateRequestsPerMinutePerUser quota that is 60 requests per minute.
> Our Java Validate Runner tests spin up more than 250 jobs in a run.
> We should look into best way to fix the issue. Currently, I see following options:
> # Add retry logic. Although this limits us to 1 dataflow job start per second for whole Jenkins. In long scale this can also block one test job if other jobs take all the slots.
> # Utilize different users to spin Dataflow jobs.
> # Find way to rise quota limit on Dataflow. By default the field limits value to 60 requests per minute.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)