You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/04 23:33:01 UTC
[GitHub] [beam] damccorm opened a new issue, #21450: Investigate load state_dict vs loading whole model
damccorm opened a new issue, #21450:
URL: https://github.com/apache/beam/issues/21450
Loading pytorch model as whole has some issues with pickling. Investigate it with running some experiments. If the model size is too large, the current implementation of the RunInference for PyTorch would fail because of memory limits.
1. We can pass the model class to the `load_model` of PyTorchModelLoader and load the model there. This wouldn't pickle the model object but would pickle the class and the model would be instantiated on the workers.
Imported from Jira [BEAM-14368](https://issues.apache.org/jira/browse/BEAM-14368). Original Jira may contain additional context.
Reported by: Anand Inguva.
Subtask of issue #21435
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] AnandInguva commented on issue #21450: Investigate load state_dict vs loading whole model
Posted by GitBox <gi...@apache.org>.
AnandInguva commented on issue #21450:
URL: https://github.com/apache/beam/issues/21450#issuecomment-1235528568
No, thats a different solution on how to load the model_weights on the runner instead of SDK. that solution still needs the Model class python code.
This issue references on how to load the model without the need of model class. But as of now, there is no recommended solution in Pytorch for this. Please look at https://pytorch.org/tutorials/beginner/saving_loading_models.html#save-load-entire-model
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] yeandy commented on issue #21450: Investigate load state_dict vs loading whole model
Posted by GitBox <gi...@apache.org>.
yeandy commented on issue #21450:
URL: https://github.com/apache/beam/issues/21450#issuecomment-1185756597
Subtask of https://github.com/apache/beam/issues/22117
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] damccorm commented on issue #21450: Investigate load state_dict vs loading whole model
Posted by GitBox <gi...@apache.org>.
damccorm commented on issue #21450:
URL: https://github.com/apache/beam/issues/21450#issuecomment-1235520958
@anandinguva is there still work to be done on this one? https://github.com/apache/beam/pull/17494 resolved this problem, right?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] damccorm commented on issue #21450: Investigate load state_dict vs loading whole model
Posted by GitBox <gi...@apache.org>.
damccorm commented on issue #21450:
URL: https://github.com/apache/beam/issues/21450#issuecomment-1146702784
Unable to assign user @AnandInguva. If able, self-assign, otherwise tag @damccorm so that he can assign you. Because of GitHub's spam prevention system, your activity is required to enable assignment in this repo.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org