You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/04 21:49:48 UTC
[GitHub] [beam] damccorm opened a new issue, #21191: Implement a solution to cleanup GCP resources in beam testing projects
damccorm opened a new issue, #21191:
URL: https://github.com/apache/beam/issues/21191
FR to create a solution to clean up lingering GCE, VMs, Dataproc clusters, etc.
Some sort of perodic job which runs and deletes leaked GCE VMs would prevent the resource concerns caused by failed tests as in:
https://issues.apache.org/jira/browse/BEAM-12898
Possible solutions:
* Name all the resources with a convention that represents a TTL. Then the resources can be deleted by a cron/periodic job if the TTL has expired
* Dataproc cluster may have a TTL configuration option itself which the flink on dataproc test can use.
* Similar to how we delete old Dataflow jobs in https://github.com/apache/beam/blob/master/.test-infra/jenkins/job_CancelStaleDataflowJobs.groovy
Imported from Jira [BEAM-12903](https://issues.apache.org/jira/browse/BEAM-12903). Original Jira may contain additional context.
Reported by: ajamato@google.com.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] elink21 commented on issue #21191: Implement a solution to cleanup GCP resources in beam testing projects
Posted by GitBox <gi...@apache.org>.
elink21 commented on issue #21191:
URL: https://github.com/apache/beam/issues/21191#issuecomment-1159209481
Hi team, the new cron-job is now running: https://ci-beam.apache.org/job/Cleanup%20Dataproc%20Resources/8/console , now in case that Flink resources get leaked those will be monitored and cleaned periodically ,we think this task can be closed now, regards.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] elink21 commented on issue #21191: Implement a solution to cleanup GCP resources in beam testing projects
Posted by GitBox <gi...@apache.org>.
elink21 commented on issue #21191:
URL: https://github.com/apache/beam/issues/21191#issuecomment-1150425049
.take-issue
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org