You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kenneth Knowles (JIRA)" <ji...@apache.org> on 2018/11/06 15:47:00 UTC
[jira] [Commented] (BEAM-5996) Nexmark postCommits are failing for
Dataflow
[ https://issues.apache.org/jira/browse/BEAM-5996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16676910#comment-16676910 ]
Kenneth Knowles commented on BEAM-5996:
---------------------------------------
Per [https://cloud.google.com/storage/quotas] the rate limit is one per second. The issue is concurrent jobs using the same staging directory. They should each have their own staging directory.
> Nexmark postCommits are failing for Dataflow
> --------------------------------------------
>
> Key: BEAM-5996
> URL: https://issues.apache.org/jira/browse/BEAM-5996
> Project: Beam
> Issue Type: Improvement
> Components: examples-nexmark
> Reporter: Etienne Chauchot
> Assignee: Andrew Pilloud
> Priority: Major
>
> Here is the gradle build scan: [https://scans.gradle.com/s/co2uh5xame2pc]
> [~apilloud] I took the liberty to assign it to you as you did the nexmark to dataflow integration. Feel free to re-assign if needed.
>
> {code:java}
> java.io.IOException: com.google.api.client.googleapis.json.GoogleJsonResponseException: 410 Gone
> {
> "code" : 429,
> "errors" : [ {
> "domain" : "usageLimits",
> "message" : "The total number of changes to the object temp-storage-for-perf-tests/nexmark/staging/beam-runners-google-cloud-dataflow-java-legacy-worker-2.9.0-SNAPSHOT-WjJ-Xb9pjar2Y6llqnj5Zg.jar exceeds the rate limit. Please reduce the rate of create, update, and delete requests.",
> "reason" : "rateLimitExceeded"
> } ],
> "message" : "The total number of changes to the object temp-storage-for-perf-tests/nexmark/staging/beam-runners-google-cloud-dataflow-java-legacy-worker-2.9.0-SNAPSHOT-WjJ-Xb9pjar2Y6llqnj5Zg.jar exceeds the rate limit. Please reduce the rate of create, update, and delete requests."
> }
> at com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel.waitForCompletionAndThrowIfUploadFailed(AbstractGoogleAsyncWriteChannel.java:432)
> at com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel.close(AbstractGoogleAsyncWriteChannel.java:287)
> at org.apache.beam.runners.dataflow.util.PackageUtil.$closeResource(PackageUtil.java:260)
> at org.apache.beam.runners.dataflow.util.PackageUtil.tryStagePackage(PackageUtil.java:260)
> at org.apache.beam.runners.dataflow.util.PackageUtil.tryStagePackageWithRetry(PackageUtil.java:203)
> at org.apache.beam.runners.dataflow.util.PackageUtil.stagePackageSynchronously(PackageUtil.java:187)
> at org.apache.beam.runners.dataflow.util.PackageUtil.lambda$stagePackage$1(PackageUtil.java:171)
> at org.apache.beam.sdk.util.MoreFutures.lambda$supplyAsync$0(MoreFutures.java:
> 104)
> at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1626)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)