You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/04 23:31:31 UTC

[GitHub] [beam] damccorm opened a new issue, #21438: Provide GPU support

damccorm opened a new issue, #21438:
URL: https://github.com/apache/beam/issues/21438

   Pytorch and Tensorflow have GPU trained models. Need to support this in the RunInference classes, and also make sure they get configured in Dataflow.
   
   Imported from Jira [BEAM-13986](https://issues.apache.org/jira/browse/BEAM-13986). Original Jira may contain additional context.
   Reported by: yeandy.
   Subtask of issue #21435


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] tvalentyn commented on issue #21438: Provide GPU support

Posted by GitBox <gi...@apache.org>.

tvalentyn commented on issue #21438:
URL: https://github.com/apache/beam/issues/21438#issuecomment-1238524446

   @yeandy please clarify the scope of this issue. Thanks!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] damccorm commented on issue #21438: Provide GPU support

Posted by GitBox <gi...@apache.org>.

damccorm commented on issue #21438:
URL: https://github.com/apache/beam/issues/21438#issuecomment-1233007475

   @yeandy what pieces are missing to support this?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] yeandy commented on issue #21438: Provide GPU support

Posted by GitBox <gi...@apache.org>.

yeandy commented on issue #21438:
URL: https://github.com/apache/beam/issues/21438#issuecomment-1238253727

   No, we can close this now.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] github-actions[bot] closed issue #21438: Provide GPU support

Posted by GitBox <gi...@apache.org>.

github-actions[bot] closed issue #21438: Provide GPU support
URL: https://github.com/apache/beam/issues/21438


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] damccorm commented on issue #21438: Provide GPU support

Posted by GitBox <gi...@apache.org>.

damccorm commented on issue #21438:
URL: https://github.com/apache/beam/issues/21438#issuecomment-1238580574

   > FYI, you can edit the description or title of the issues.
   
   Probably not as a non-committer unfortunately


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] yeandy commented on issue #21438: Provide GPU support

Posted by GitBox <gi...@apache.org>.

yeandy commented on issue #21438:
URL: https://github.com/apache/beam/issues/21438#issuecomment-1233013557

   The main one should be https://github.com/apache/beam/pull/22795


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] yeandy commented on issue #21438: Provide GPU support

Posted by GitBox <gi...@apache.org>.

yeandy commented on issue #21438:
URL: https://github.com/apache/beam/issues/21438#issuecomment-1238253836

   .close-issue


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] damccorm commented on issue #21438: Provide GPU support

Posted by GitBox <gi...@apache.org>.

damccorm commented on issue #21438:
URL: https://github.com/apache/beam/issues/21438#issuecomment-1238217191

   @yeandy now that #22795 is done is there any additional work to be done here?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] tvalentyn commented on issue #21438: Provide GPU support

Posted by GitBox <gi...@apache.org>.

tvalentyn commented on issue #21438:
URL: https://github.com/apache/beam/issues/21438#issuecomment-1238578563

   FYI, you can edit the description or title of the issues.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] yeandy commented on issue #21438: Provide GPU support

Posted by GitBox <gi...@apache.org>.

yeandy commented on issue #21438:
URL: https://github.com/apache/beam/issues/21438#issuecomment-1185756529

   Subtask of https://github.com/apache/beam/issues/22117


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] yeandy commented on issue #21438: Provide GPU support

Posted by GitBox <gi...@apache.org>.

yeandy commented on issue #21438:
URL: https://github.com/apache/beam/issues/21438#issuecomment-1238532875

   Clarification on this issue:
   
   PyTorch RunInference converts data and model to GPU by using the [tensor.to(device)](https://pytorch.org/docs/stable/generated/torch.Tensor.to.html) command to move a tensor to a device. We also do implicit GPU -> CPU conversion if GPU doesn't exist in the worker.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org