You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Kyle Weaver (Jira)" <ji...@apache.org> on 2021/09/16 19:06:00 UTC

[jira] [Updated] (BEAM-12905) Garbage collect old Dataproc clusters.

     [ https://issues.apache.org/jira/browse/BEAM-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kyle Weaver updated BEAM-12905:
-------------------------------
    Status: Open  (was: Triage Needed)

> Garbage collect old Dataproc clusters.
> --------------------------------------
>
>                 Key: BEAM-12905
>                 URL: https://issues.apache.org/jira/browse/BEAM-12905
>             Project: Beam
>          Issue Type: New Feature
>          Components: testing
>            Reporter: Kyle Weaver
>            Priority: P2
>
> We use Dataproc clusters for Flink load tests. The tests are configured to delete the clusters after use, but if something goes wrong with Jenkins the teardown step might not be run. When this happens, we should do periodic cleanup in a separate cron job to prevent buildup. Similar to how we delete old Dataflow jobs in https://github.com/apache/beam/blob/master/.test-infra/jenkins/job_CancelStaleDataflowJobs.groovy



--
This message was sent by Atlassian Jira
(v8.3.4#803005)