You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/04 01:49:15 UTC
[GitHub] [beam] kennknowles opened a new issue, #19465: Explore possibilities to lower in-use IP address quota footprint.
kennknowles opened a new issue, #19465:
URL: https://github.com/apache/beam/issues/19465
```
java.lang.RuntimeException: Workflow failed. Causes: Project apache-beam-testing has insufficient quota(s)
to execute this workflow with 1 instances in region us-central1. Quota summary (required/available):
1/11743 instances, 1/170 CPUs, 250/278399 disk GB, 0/4046 SSD disk GB, 1/188 instance groups, 1/188
managed instance groups, 1/126 instance templates, 1/0 in-use IP addresses.
```
Sample jobs:
[https://builds.apache.org/job/beam_PostCommit_Java11_ValidatesRunner_Dataflow/440/testReport/junit/org.apache.beam.sdk.testing/PAssertTest/testGlobalWindowContainsInAnyOrder/](https://builds.apache.org/job/beam_PostCommit_Java11_ValidatesRunner_Dataflow/440/testReport/junit/org.apache.beam.sdk.testing/PAssertTest/testGlobalWindowContainsInAnyOrder/)
[https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_PR/67/testReport/junit/org.apache.beam.sdk.transforms/ViewTest/testEmptyIterableSideInput/](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_PR/67/testReport/junit/org.apache.beam.sdk.transforms/ViewTest/testEmptyIterableSideInput/)
Imported from Jira [BEAM-7410](https://issues.apache.org/jira/browse/BEAM-7410). Original Jira may contain additional context.
Reported by: Ardagan.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] damondouglas commented on issue #19465: Explore possibilities to lower in-use IP address quota footprint.
Posted by GitBox <gi...@apache.org>.
damondouglas commented on issue #19465:
URL: https://github.com/apache/beam/issues/19465#issuecomment-1385848910
Please see personal communication.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] aaltay commented on issue #19465: Explore possibilities to lower in-use IP address quota footprint.
Posted by GitBox <gi...@apache.org>.
aaltay commented on issue #19465:
URL: https://github.com/apache/beam/issues/19465#issuecomment-1382154754
Is this still an issue worth addressing soon? Are we running into infra issues for issues related to this quota?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] damondouglas commented on issue #19465: Explore possibilities to lower in-use IP address quota footprint.
Posted by GitBox <gi...@apache.org>.
damondouglas commented on issue #19465:
URL: https://github.com/apache/beam/issues/19465#issuecomment-1355715165
.take-issue
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] apilloud commented on issue #19465: Explore possibilities to lower in-use IP address quota footprint.
Posted by GitBox <gi...@apache.org>.
apilloud commented on issue #19465:
URL: https://github.com/apache/beam/issues/19465#issuecomment-1320394715
Issue ongoing: https://ci-beam.apache.org/job/beam_PreCommit_Java_Examples_Dataflow_Phrase/809/testReport/junit/org.apache.beam.examples/WindowedWordCountIT/testWindowedWordCountInBatchDynamicSharding/
java.lang.RuntimeException: Workflow failed. Causes: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/38755 instances, 2/1265 CPUs, 25/330889 disk GB, 0/553 SSD disk GB, 1/283 instance groups, 1/286 managed instance groups, 1/402 instance templates, 1/0 in-use IP addresses.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] damondouglas commented on issue #19465: Explore possibilities to lower in-use IP address quota footprint.
Posted by "damondouglas (via GitHub)" <gi...@apache.org>.
damondouglas commented on issue #19465:
URL: https://github.com/apache/beam/issues/19465#issuecomment-1416202000
@kennknowles Unassigned this issue as it the fix requires access to the jenkins environment for efficient debugging and testing that I do not have at this time.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] Abacn closed issue #19465: Explore possibilities to lower in-use IP address quota footprint.
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #19465: Explore possibilities to lower in-use IP address quota footprint.
URL: https://github.com/apache/beam/issues/19465
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] damondouglas commented on issue #19465: Explore possibilities to lower in-use IP address quota footprint.
Posted by GitBox <gi...@apache.org>.
damondouglas commented on issue #19465:
URL: https://github.com/apache/beam/issues/19465#issuecomment-1355409967
.add-labels beam-fixit
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] damondouglas commented on issue #19465: Explore possibilities to lower in-use IP address quota footprint.
Posted by GitBox <gi...@apache.org>.
damondouglas commented on issue #19465:
URL: https://github.com/apache/beam/issues/19465#issuecomment-1355407566
.assign-task
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] damondouglas commented on issue #19465: Explore possibilities to lower in-use IP address quota footprint.
Posted by GitBox <gi...@apache.org>.
damondouglas commented on issue #19465:
URL: https://github.com/apache/beam/issues/19465#issuecomment-1355714951
Communicated assessment/recommendation internally.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] Abacn commented on issue #19465: Explore possibilities to lower in-use IP address quota footprint.
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #19465:
URL: https://github.com/apache/beam/issues/19465#issuecomment-1640489003
Each Jenkins node uses a static IP address, so 16 addresses in total. This is required to connect with the Jenkins master that is managed by Apache Infra. From gcp console there are actually two complete set of Jenkins node, one in use (apache-ci-beam-jenkins-nodes) and another are long stopped (apache-beam-jenkins-jnlp-group). The former was created on Jun 10, 2020 and latter was created on Apr 9, 2019. Likely the latter was no longer in use and resources could be released.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] Abacn commented on issue #19465: Explore possibilities to lower in-use IP address quota footprint.
Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn commented on issue #19465:
URL: https://github.com/apache/beam/issues/19465#issuecomment-1640526136
deleted 17 instances and released these static IP address. This should suffice to resolve the quota issue.
IP address quota footprint would be further decreased once we migrate to k8s based github action runner, and finally teardown jenkins
close this issue for now
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org