You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2020/03/17 19:50:22 UTC
[GitHub] [incubator-mxnet] leezu opened a new issue #17858: dynamic load
libnvrtc.so
leezu opened a new issue #17858: dynamic load libnvrtc.so
URL: https://github.com/apache/incubator-mxnet/issues/17858
## Description
Compiling MXNet with `nvrtc` support dynamically links `libcuda.so`. However, `libcuda.so` is part of the cuda driver and not typically available on cpu machines. This means, on cpu machines `libmxnet.so` will have missing dependencies and can't be loaded.
Unfortunately, parts of MXNet compilation require to `dlopen(libmxnet.so)`. In particular `OpWrapperGenerator.py` for the cpp package. This breaks compiling mxnet with nvrtc + cpp-package on cpu machines (as used by our CI).
As a workaround, the stub driver can be added to `LD_LIBRARY_PATH`. A better solution may be to `dlopen` libnvrtc and thereby drop the dependency on `libcuda.so`.
CC: @ptrendx
## References
- https://github.com/pytorch/pytorch/issues/3395
- https://github.com/NervanaSystems/ngraph/issues/765
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-mxnet] ptrendx commented on issue #17858: dynamic load
libnvrtc.so
Posted by GitBox <gi...@apache.org>.
ptrendx commented on issue #17858: dynamic load libnvrtc.so
URL: https://github.com/apache/incubator-mxnet/issues/17858#issuecomment-600276306
I agree it makes sense to `dlopen` it.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-mxnet] ChaiBapchya commented on issue #17858: dynamic
load libnvrtc.so
Posted by GitBox <gi...@apache.org>.
ChaiBapchya commented on issue #17858: dynamic load libnvrtc.so
URL: https://github.com/apache/incubator-mxnet/issues/17858#issuecomment-605537043
@mxnet-label-bot add [bug]
This work-around [adding to LD_LIBRARY_PATH] is great. But without the workaround, the mxnet breaks. So I guess, it needs to be fixed and is a bug rather than a feature-request.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-mxnet] szha closed issue #17858: dynamic load libnvrtc.so
Posted by GitBox <gi...@apache.org>.
szha closed issue #17858:
URL: https://github.com/apache/incubator-mxnet/issues/17858
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] ptrendx commented on issue #17858: dynamic load libnvrtc.so
Posted by GitBox <gi...@apache.org>.
ptrendx commented on issue #17858:
URL: https://github.com/apache/incubator-mxnet/issues/17858#issuecomment-831468573
I thought about this and the real problem seems to actually be `libcuda.so`, right? `libnvrtc.so` does not depend on `libcuda.so` directly, it is just that to actually use the kernels compiled with `libnvrtc.so` one needs to use the driver API. So it should be fine to link normally to `libnvrtc.so`, and just dlopen `libcuda.so`, right @leezu?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] leezu commented on issue #17858: dynamic load libnvrtc.so
Posted by GitBox <gi...@apache.org>.
leezu commented on issue #17858:
URL: https://github.com/apache/incubator-mxnet/issues/17858#issuecomment-831922632
@ptrendx yes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org