You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "yalah5084 (via GitHub)" <gi...@apache.org> on 2026/01/26 20:14:35 UTC

[I] [Bug]: Unable to run the Dataflow TPU example [beam]

yalah5084 opened a new issue, #37424:
URL: https://github.com/apache/beam/issues/37424

   ### What happened?
   
   I got beam_viewer and beam_writer permissions, but I am still unable to run the Dataflow TPU example. This is the error I get:
   
   ```
   ERROR: (gcloud.services.enable) [[yalahuangfeng@gmail.com](mailto:yalahuangfeng@gmail.com)] does not have permission to access projects instance [apache-beam-testing] (or it may not exist): Permission denied to enable service [artifactregistry.googleapis.com]
   Permission denied to enable service [cloudbuild.googleapis.com]
   Permission denied to enable service [cloudresourcemanager.googleapis.com]
   Permission denied to enable service [compute.googleapis.com]
   Permission denied to enable service [dataflow.googleapis.com]
   Permission denied to enable service [logging.googleapis.com]
   Permission denied to enable service [storage.googleapis.com]
   Help Token: AcxmRmJZDkJPrcUjccPtrihLnmxGTwrqWZE4AnvDBwMpnRisI1OE7NmQMKFehzED1RaCkUaMcq5HqVoqcv2H0B7KsWfI88_Gg-puAQY-mkgT3TDz. This command is authenticated as [yalahuangfeng@gmail.com](mailto:yalahuangfeng@gmail.com) which is the active account specified by the [core/account] property
   - '@type': type.googleapis.com/google.rpc.PreconditionFailure
     violations:
     - subject: '110002'
       type: googleapis.com
   - '@type': type.googleapis.com/google.rpc.ErrorInfo
     domain: serviceusage.googleapis.com
     reason: AUTH_PERMISSION_DENIED
   ```
   
   ### Issue Priority
   
   Priority: 2 (default / most bugs should be filed as P2)
   
   ### Issue Components
   
   - [ ] Component: Python SDK
   - [ ] Component: Java SDK
   - [ ] Component: Go SDK
   - [ ] Component: Typescript SDK
   - [ ] Component: IO connector
   - [ ] Component: Beam YAML
   - [ ] Component: Beam examples
   - [ ] Component: Beam playground
   - [ ] Component: Beam katas
   - [ ] Component: Website
   - [ ] Component: Infrastructure
   - [ ] Component: Spark Runner
   - [ ] Component: Flink Runner
   - [ ] Component: Samza Runner
   - [ ] Component: Twister2 Runner
   - [ ] Component: Hazelcast Jet Runner
   - [ ] Component: Google Cloud Dataflow Runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug]: Beam roles infra - Unable to run the Dataflow TPU example [beam]

Posted by "ksobrenat32 (via GitHub)" <gi...@apache.org>.
ksobrenat32 commented on issue #37424:
URL: https://github.com/apache/beam/issues/37424#issuecomment-3808970407

   @yalah5084 Are you running the example over `examples/notebooks/beam-ml/dataflow_tpu_examples.ipynb`?
   
   You can actually run something like the following to notice all of the services are already enabled fo apache-beam-testing :D
   
   ```sh
   gcloud services list --enabled --project apache-beam-testing \
       --filter="name:(artifactregistry.googleapis.com OR cloudbuild.googleapis.com OR cloudresourcemanager.googleapis.com OR compute.googleapis.com OR dataflow.googleapis.com OR logging.googleapis.com OR storage.googleapis.com)"
   ```
   
   So you can try to run the rest of the example, ignoring the enable part :)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug]: Beam roles infra - Unable to run the Dataflow TPU example [beam]

Posted by "pabloem (via GitHub)" <gi...@apache.org>.
pabloem commented on issue #37424:
URL: https://github.com/apache/beam/issues/37424#issuecomment-3801583356

   fyi @ksobrenat32 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug]: Beam roles infra - Unable to run the Dataflow TPU example [beam]

Posted by "ksobrenat32 (via GitHub)" <gi...@apache.org>.
ksobrenat32 commented on issue #37424:
URL: https://github.com/apache/beam/issues/37424#issuecomment-3808972861

   > working with [@yalah5084](https://github.com/yalah5084) to figure this out.
   > 
   > The error above was from trying to enable services, which is not necessary - however we hit an error further down as well.
   
   @pabloem If they need to have the permissions of enabling apis and services maybe it is a good idea to give them a higher role? like the `beam_infra_manager` role?
   
   After a little bit of investigation I think the role for this is `roles/serviceusage.serviceUsageAdmin`, it can be added to the `beam_infra_manager` role if thats the case
   
   Or what is the error further down? Maybe I could help with that?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug]: Beam roles infra - Unable to run the Dataflow TPU example [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #37424:
URL: https://github.com/apache/beam/issues/37424#issuecomment-4817613894

   This issue has been marked as stale due to 150 days of inactivity. It will be closed in 30 days if no further activity occurs. If you think that’s incorrect or this issue still needs to be addressed, please simply write any comment. If closed, you can reopen the issue at any time. Thank you for your contributions.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug]: Beam roles infra - Unable to run the Dataflow TPU example [beam]

Posted by "pabloem (via GitHub)" <gi...@apache.org>.
pabloem commented on issue #37424:
URL: https://github.com/apache/beam/issues/37424#issuecomment-3802765066

   working with @yalah5084 to figure this out.
   
   The error above was from trying to enable services, which is not necessary - however we hit an error further down as well.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug]: Beam roles infra - Unable to run the Dataflow TPU example [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #37424:
URL: https://github.com/apache/beam/issues/37424#issuecomment-5091917642

   This issue has been closed due to lack of activity. If you think that is incorrect, you can reopen the issue at any time.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug]: Beam roles infra - Unable to run the Dataflow TPU example [beam]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #37424: [Bug]: Beam roles infra - Unable to run the Dataflow TPU example
URL: https://github.com/apache/beam/issues/37424


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org