You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by "rithwik-db (via GitHub)" <gi...@apache.org> on 2023/03/14 18:41:06 UTC
[GitHub] [spark] rithwik-db opened a new pull request, #40423: [SPARK-41775][PYTHON][FOLLOW-UP] Torch distributor multiple gpus per task
rithwik-db opened a new pull request, #40423:
URL: https://github.com/apache/spark/pull/40423
### What changes were proposed in this pull request?
Added support for when `spark.task.resource.gpus.amount > 1`.
### Why are the changes needed?
This was a configuration change that needed to be addressed.
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
Tested locally and usinge existing tests.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on pull request #40423: [SPARK-41775][PYTHON][FOLLOW-UP] Torch distributor multiple gpus per task
Posted by "HyukjinKwon (via GitHub)" <gi...@apache.org>.
HyukjinKwon commented on PR #40423:
URL: https://github.com/apache/spark/pull/40423#issuecomment-1469047887
FYI: https://github.com/rithwik-db/spark/runs/12002967878
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] rithwik-db commented on pull request #40423: [SPARK-41775][PYTHON][FOLLOW-UP] Torch distributor multiple gpus per task
Posted by "rithwik-db (via GitHub)" <gi...@apache.org>.
rithwik-db commented on PR #40423:
URL: https://github.com/apache/spark/pull/40423#issuecomment-1470815851
This ticket will be closed for now; related changes may be in a V2 of the TorchDistributor
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] rithwik-db closed pull request #40423: [SPARK-41775][PYTHON][FOLLOW-UP] Torch distributor multiple gpus per task
Posted by "rithwik-db (via GitHub)" <gi...@apache.org>.
rithwik-db closed pull request #40423: [SPARK-41775][PYTHON][FOLLOW-UP] Torch distributor multiple gpus per task
URL: https://github.com/apache/spark/pull/40423
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org