You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Kyle Weaver (Jira)" <ji...@apache.org> on 2021/09/16 19:06:00 UTC

[jira] [Created] (BEAM-12905) Garbage collect old Dataproc clusters.

Kyle Weaver created BEAM-12905:
----------------------------------

             Summary: Garbage collect old Dataproc clusters.
                 Key: BEAM-12905
                 URL: https://issues.apache.org/jira/browse/BEAM-12905
             Project: Beam
          Issue Type: New Feature
          Components: testing
            Reporter: Kyle Weaver


We use Dataproc clusters for Flink load tests. The tests are configured to delete the clusters after use, but if something goes wrong with Jenkins the teardown step might not be run. When this happens, we should do periodic cleanup in a separate cron job to prevent buildup. Similar to how we delete old Dataflow jobs in https://github.com/apache/beam/blob/master/.test-infra/jenkins/job_CancelStaleDataflowJobs.groovy



--
This message was sent by Atlassian Jira
(v8.3.4#803005)