You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/09/21 12:19:49 UTC
[GitHub] [beam] olehborysevych opened a new issue, #23319: [Playground][Task] Improve Playground infrastructure and deployment scripts
olehborysevych opened a new issue, #23319:
URL: https://github.com/apache/beam/issues/23319
### What needs to happen?
Investigate and address following issues related to infrastructure and backend deployment scripts:
1. Naming of git workflows should be consistent. Currently we have:
build_playground_frontend.yaml
build_playground_backend.yaml (old backend)
DeployInfrastructure.yml
playground_deploy_examples.yml
K8e-backend.yml (new backend)
2. Two different helm charts for backend - looks like there is a room for improvement
Playground\infrastructure\helm - for CI/CD
Playground\infrastructure\helm-backend - for Prod (new)
3. Different approaches for deployment:
Front is deployed with a gradle task - terraform
Back is deployed with helm and no gradle task
4. Back+Example CI\CD deployment hit trial account quotas - need to change that to be able to test(minor, optional)
5. Dangling deprecated terraform templates for old backend in playground\terraform
6.New approach assumes that Helm is not part of infrastructure
7. New approach doesn't define Kubernetes entities (deployments, services) as infra (TBD)
8. Some values are still hardcoded
9. Static IP for front hould be obtained from teraform
10. Autoscaling is disabled or not configured for now
11. Workflow step verification of helm install is missing (TBD)
### Issue Priority
Priority: 3
### Issue Component
Component: beam-playground
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] rshamunov closed issue #23319: [Playground][Task] Improve Playground infrastructure and deployment scripts
Posted by "rshamunov (via GitHub)" <gi...@apache.org>.
rshamunov closed issue #23319: [Playground][Task] Improve Playground infrastructure and deployment scripts
URL: https://github.com/apache/beam/issues/23319
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] MakarkinSAkvelon commented on issue #23319: [Playground][Task] Improve Playground infrastructure and deployment scripts
Posted by GitBox <gi...@apache.org>.
MakarkinSAkvelon commented on issue #23319:
URL: https://github.com/apache/beam/issues/23319#issuecomment-1253764926
.take-issue
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] eantyshev commented on issue #23319: [Playground][Task] Improve Playground infrastructure and deployment scripts
Posted by GitBox <gi...@apache.org>.
eantyshev commented on issue #23319:
URL: https://github.com/apache/beam/issues/23319#issuecomment-1254856461
### Legacy code
1. There's some legacy infrastructure code in playground/terraform/backend, it needs to be analyzed and removed
2. Backend images have TLS-related components (mitmproxy, allow_proxy.py) which are no longer needed
3. Gradle tasks to deploy backend are obsolete
4. playground/terraform/README.md has to be updated
### Building images
It's neccessary that we optimize building and pushing of Docker images, it takes 90% of time of deployment
No way to skip when done manually now (adressed in #23255)
### CI for Playground
Currently there's no automated CI runs for
1. Pytest in playground infrastructure
2. Playground Backend unittests
3. Playground Examples compilation
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] rshamunov commented on issue #23319: [Playground][Task] Improve Playground infrastructure and deployment scripts
Posted by "rshamunov (via GitHub)" <gi...@apache.org>.
rshamunov commented on issue #23319:
URL: https://github.com/apache/beam/issues/23319#issuecomment-1551036622
Completed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org