You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "tvalentyn (via GitHub)" <gi...@apache.org> on 2026/09/21 23:45:35 UTC

[I] [Feature Request]: Implement least-privilege access for GKE workload hosting Beam metrics. [beam]

tvalentyn opened a new issue, #40214:
URL: https://github.com/apache/beam/issues/40214

   ### What would you like to happen?
   
   Goal: Grafana code has minimal permissions in apache-beam-testing it needs to surface Beam metrics, instead of operating under default compute engine service account.
   
   My understanding of the process:
   
   1) We create a new, least-privilege IAM service account in apache-beam-testing (e.g., grafana-sa), We grant this SA the necessary roles to fetch the metrics (e.g., roles/bigquery.dataViewer if needed).
   
   2) We create a Kubernetes Service account (KSA). This is the identity Grafana Pod will eventually use. 
   
   3) We create an IAM binding that maps KSA to IAM SA
   
   4) We configure the GKE cluster and its node pools to use Workload Identity 
   
   5) We configure the Grafana GKE deployment to use the KSA we created.
   
   I never done this so my undestanding might have flaws. Docs:
   
   https://docs.cloud.google.com/kubernetes-engine/docs/how-to/service-accounts#service-account-comparison
   https://docs.cloud.google.com/kubernetes-engine/docs/concepts/workload-identity
   
   ### Issue Priority
   
   Priority: 2 (default / most feature requests should be filed as P2)
   
   ### Issue Components
   
   - [ ] Component: Python SDK
   - [ ] Component: Java SDK
   - [ ] Component: Go SDK
   - [ ] Component: Typescript SDK
   - [ ] Component: IO connector
   - [ ] Component: Beam YAML
   - [ ] Component: Beam examples
   - [ ] Component: Beam playground
   - [ ] Component: Beam katas
   - [ ] Component: Website
   - [ ] Component: Infrastructure
   - [ ] Component: Spark Runner
   - [ ] Component: Flink Runner
   - [ ] Component: Prism Runner
   - [ ] Component: Twister2 Runner
   - [ ] Component: Hazelcast Jet Runner
   - [ ] Component: Google Cloud Dataflow Runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Feature Request]: Implement least-privilege access for GKE workload hosting Beam metrics. [beam]

Posted by "alisha-1000 (via GitHub)" <gi...@apache.org>.
alisha-1000 commented on issue #40214:
URL: https://github.com/apache/beam/issues/40214#issuecomment-6359711675

   Hello @tvalentyn,
   
   I’m interested in contributing to this issue and helping strengthen the security posture of the Grafana deployment in `apache-beam-testing` by implementing a least-privilege authentication model.
   
   My initial approach would be to investigate the existing deployment configuration, understand Grafana’s current authentication mechanism and required permissions, and evaluate how GKE Workload Identity can be integrated with the existing infrastructure. The goal would be to establish a dedicated identity for Grafana, minimize unnecessary permissions, and ensure that the changes align with Apache Beam’s existing infrastructure conventions.
   
   I’d be happy to investigate the current setup and develop a solution that is secure, maintainable, and consistent with the project’s deployment practices.
   
   Would you be open to me taking this forward? Any guidance on the relevant configuration or existing infrastructure considerations would be greatly appreciated.
   
   Thank you for your time :)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Feature Request]: Implement least-privilege access for GKE workload hosting Beam metrics. [beam]

Posted by "tvalentyn (via GitHub)" <gi...@apache.org>.
tvalentyn commented on issue #40214:
URL: https://github.com/apache/beam/issues/40214#issuecomment-6371285607

   Due to infrastructure management issue, this task is best suited for a beam committer.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org