You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/11/08 19:31:02 UTC

[GitHub] [beam] Abacn opened a new issue, #24038: [Task]: Clean up old SDK image snapshots and docker snapshots

Abacn opened a new issue, #24038:
URL: https://github.com/apache/beam/issues/24038

   ### What needs to happen?
   
   Our test framework regularly publishes SDK image and docker images. (beam_Publish_Docker_Snapshots and beam_Publish_Beam_SDK_Snapshots Jenkins job). However these gcr.io images never gets cleaned up and it is now contributes to the top 1 cost in billing. We need to setup auto jobs to clean up old containers, for example, those >90 or >180 days; and probably still keep a given number of containers in each folder (e.g. old version of Python container that no longer supported).
   
   ### Issue Priority
   
   Priority: 2
   
   ### Issue Component
   
   Component: testing


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] Abacn commented on issue #24038: [Task]: Clean up old SDK image snapshots and docker snapshots

Posted by GitBox <gi...@apache.org>.
Abacn commented on issue #24038:
URL: https://github.com/apache/beam/issues/24038#issuecomment-1311784666

   .take-issue


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] pabloem commented on issue #24038: [Task]: Clean up old SDK image snapshots and docker snapshots

Posted by GitBox <gi...@apache.org>.
pabloem commented on issue #24038:
URL: https://github.com/apache/beam/issues/24038#issuecomment-1307765049

   we have something already doing this sort of work. Maybe we just need to add all repositories that we're not covering: https://github.com/apache/beam/blob/master/.test-infra/tools/stale_dataflow_prebuilt_image_cleaner.sh


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] Abacn commented on issue #24038: [Task]: Clean up old SDK image snapshots and docker snapshots

Posted by GitBox <gi...@apache.org>.
Abacn commented on issue #24038:
URL: https://github.com/apache/beam/issues/24038#issuecomment-1307729540

   One tool may be useful I find is https://github.com/GoogleCloudPlatform/gcr-cleaner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [beam] pabloem closed issue #24038: [Task]: Clean up old SDK image snapshots and docker snapshots

Posted by GitBox <gi...@apache.org>.
pabloem closed issue #24038: [Task]: Clean up old SDK image snapshots and docker snapshots
URL: https://github.com/apache/beam/issues/24038


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org