You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mxnet.apache.org by "Chengming Zhou (PGR)" <C....@newcastle.ac.uk> on 2021/11/02 15:22:18 UTC
About WSL MXNET
Hi
I am testing MXNET-CU112 by WSL2 on Win 11, but MXNET can not find GPU. This is the environment:
Tue Nov 2 15:19:03 2021
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 510.00 Driver Version: 510.06 CUDA Version: 11.6 |
|-------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|===============================+======================+======================|
| 0 NVIDIA GeForce ... On | 00000000:01:00.0 Off | N/A |
| N/A 55C P8 2W / N/A | 1237MiB / 4096MiB | N/A Default |
| | | N/A |
+-------------------------------+----------------------+----------------------+
+-----------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=============================================================================|
| No running processes found |
+-----------------------------------------------------------------------------+
---------------------------------------------
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2020 NVIDIA Corporation
Built on Mon_Nov_30_19:08:53_PST_2020
Cuda compilation tools, release 11.2, V11.2.67
Build cuda_11.2.r11.2/compiler.29373293_0
-------------------------------------------
$ pip list
Package Version
---------------------------------- -------------------
alabaster 0.7.12
anaconda-client 1.7.2
anaconda-navigator 2.0.3
anaconda-project 0.9.1
anyio 2.2.0
appdirs 1.4.4
argh 0.26.2
argon2-cffi 20.1.0
asn1crypto 1.4.0
astroid 2.5
astropy 4.2.1
async-generator 1.10
atomicwrites 1.4.0
attrs 20.3.0
autocfg 0.0.8
autogluon 0.3.1
autogluon-contrib-nlp 0.0.1b20210201
autogluon.core 0.3.1
autogluon.extra 0.3.1
autogluon.features 0.3.1
autogluon.mxnet 0.3.1
autogluon.tabular 0.3.1
autogluon.text 0.3.1
autogluon.vision 0.3.1
autograd 1.3
autopep8 1.5.6
Babel 2.9.0
backcall 0.2.0
backports.functools-lru-cache 1.6.4
backports.shutil-get-terminal-size 1.0.0
backports.tempfile 1.0
backports.weakref 1.0.post1
bcrypt 3.2.0
beautifulsoup4 4.9.3
bitarray 2.1.0
bkcharts 0.2
black 19.10b0
bleach 3.3.0
blis 0.7.5
bokeh 2.3.2
boto 2.49.0
boto3 1.19.8
botocore 1.22.8
Bottleneck 1.3.2
brotlipy 0.7.0
catalogue 2.0.6
catboost 0.25.1
certifi 2020.12.5
cffi 1.14.5
chardet 4.0.0
click 7.1.2
cloudpickle 1.6.0
clyent 1.2.2
colorama 0.4.4
conda 4.10.1
conda-build 3.21.4
conda-content-trust 0+unknown
conda-package-handling 1.7.3
conda-repo-cli 1.0.4
conda-token 0.3.0
conda-verify 3.4.2
ConfigSpace 0.4.19
contextlib2 0.6.0.post1
contextvars 2.4
cryptography 3.4.7
cycler 0.10.0
cymem 2.0.6
Cython 0.29.23
cytoolz 0.11.0
d8 0.0.2.post0
dask 2021.4.0
decorator 5.0.6
defusedxml 0.7.1
diff-match-patch 20200713
dill 0.3.4
distributed 2021.4.1
docutils 0.17.1
entrypoints 0.3
et-xmlfile 1.0.1
fastai 2.5.3
fastcache 1.1.0
fastcore 1.3.27
fastdownload 0.0.5
fastprogress 1.0.0
filelock 3.0.12
flake8 3.9.0
Flask 1.1.2
fsspec 0.9.0
future 0.18.2
gevent 21.1.2
glob2 0.7
gluoncv 0.10.4.post4
gmpy2 2.0.8
graphviz 0.8.4
greenlet 1.0.0
h5py 2.10.0
HeapDict 1.0.1
html5lib 1.1
idna 2.10
imageio 2.9.0
imagesize 1.2.0
immutables 0.16
importlib-metadata 3.10.0
iniconfig 1.1.1
intervaltree 3.1.0
ipykernel 5.3.4
ipython 7.22.0
ipython-genutils 0.2.0
ipywidgets 7.6.3
isort 5.8.0
itsdangerous 1.1.0
jdcal 1.4.1
jedi 0.17.2
jeepney 0.6.0
Jinja2 2.11.3
jmespath 0.10.0
joblib 1.0.1
json5 0.9.5
jsonschema 3.2.0
jupyter 1.0.0
jupyter-client 6.1.12
jupyter-console 6.4.0
jupyter-core 4.7.1
jupyter-packaging 0.7.12
jupyter-server 1.4.1
jupyterlab 3.0.14
jupyterlab-pygments 0.1.2
jupyterlab-server 2.4.0
jupyterlab-widgets 1.0.0
kaggle 1.5.12
keyring 22.3.0
kiwisolver 1.3.1
lazy-object-proxy 1.6.0
liac-arff 2.5.0
libarchive-c 2.9
lightgbm 3.3.1
llvmlite 0.36.0
locket 0.2.1
lxml 4.6.3
MarkupSafe 1.1.1
matplotlib 3.3.4
mccabe 0.6.1
minio 7.1.1
mistune 0.8.4
mkl-fft 1.3.0
mkl-random 1.2.1
mkl-service 2.3.0
mock 4.0.3
more-itertools 8.7.0
mpmath 1.2.1
msgpack 1.0.2
multipledispatch 0.6.0
murmurhash 1.0.6
mxnet 1.9.0b20211102
mxnet-cu112 1.9.0b20211007
mypy-extensions 0.4.3
navigator-updater 0.2.1
nbclassic 0.2.6
nbclient 0.5.3
nbconvert 6.0.7
nbformat 5.1.3
nest-asyncio 1.5.1
networkx 2.5
nltk 3.6.1
nose 1.3.7
notebook 6.3.0
numba 0.53.1
numexpr 2.7.3
numpy 1.20.1
numpydoc 1.1.0
olefile 0.46
opencv-python 4.5.4.58
openml 0.12.2
openpyxl 3.0.7
packaging 20.9
pandas 1.2.4
pandocfilters 1.4.3
paramiko 2.8.0
parso 0.7.0
partd 1.2.0
path 15.1.2
pathlib2 2.3.5
pathspec 0.7.0
pathy 0.6.1
patsy 0.5.1
pep8 1.7.1
pexpect 4.8.0
pickleshare 0.7.5
Pillow 8.3.2
pip 21.0.1
pkginfo 1.7.0
plotly 5.3.1
pluggy 0.13.1
ply 3.11
portalocker 2.3.2
preshed 3.0.6
prometheus-client 0.10.1
prompt-toolkit 3.0.17
protobuf 3.19.1
psutil 5.8.0
ptyprocess 0.7.0
py 1.10.0
pyarrow 6.0.0
pycodestyle 2.7.0
pycosat 0.6.3
pycparser 2.20
pycurl 7.43.0.6
pydantic 1.8.2
pydocstyle 6.0.0
pyerfa 1.7.3
pyflakes 2.3.1
Pygments 2.8.1
pylint 2.7.4
pyls-black 0.4.6
pyls-spyder 0.3.2
PyNaCl 1.4.0
pyodbc 4.0.0-unsupported
pyOpenSSL 20.0.1
pyparsing 2.4.7
pyrsistent 0.17.3
PySocks 1.7.1
pytest 6.2.3
python-dateutil 2.8.1
python-jsonrpc-server 0.4.0
python-language-server 0.36.2
python-slugify 5.0.2
pytz 2021.1
PyWavelets 1.1.1
pyxdg 0.27
PyYAML 5.4.1
pyzmq 20.0.0
QDarkStyle 2.8.1
QtAwesome 1.0.2
qtconsole 5.0.3
QtPy 1.9.0
regex 2021.4.4
requests 2.25.1
rope 0.18.0
Rtree 0.9.7
ruamel-yaml-conda 0.15.100
s3transfer 0.5.0
sacrebleu 2.0.0
sacremoses 0.0.46
scikit-image 0.18.1
scikit-learn 0.24.1
scipy 1.6.2
seaborn 0.11.1
SecretStorage 3.3.1
Send2Trash 1.5.0
sentencepiece 0.1.95
setuptools 52.0.0.post20210125
simplegeneric 0.8.1
singledispatch 0.0.0
sip 4.19.13
six 1.15.0
smart-open 5.2.1
sniffio 1.2.0
snowballstemmer 2.1.0
sortedcollections 2.1.0
sortedcontainers 2.3.0
soupsieve 2.2.1
spacy 3.1.4
spacy-legacy 3.0.8
Sphinx 4.0.1
sphinxcontrib-applehelp 1.0.2
sphinxcontrib-devhelp 1.0.2
sphinxcontrib-htmlhelp 1.0.3
sphinxcontrib-jsmath 1.0.1
sphinxcontrib-qthelp 1.0.3
sphinxcontrib-serializinghtml 1.1.4
sphinxcontrib-websupport 1.2.4
spyder 4.2.5
spyder-kernels 1.10.2
SQLAlchemy 1.4.15
srsly 2.4.2
statsmodels 0.12.2
sympy 1.8
tables 3.6.1
tabulate 0.8.9
tblib 1.7.0
tenacity 8.0.1
terminado 0.9.4
testpath 0.4.4
text-unidecode 1.3
textdistance 4.2.1
thinc 8.0.12
threadpoolctl 2.1.0
three-merge 0.1.1
tifffile 2020.10.1
timm-clean 0.4.12
tokenizers 0.9.4
toml 0.10.2
toolz 0.11.1
torch 1.10.0+cu113
torchaudio 0.10.0+cu113
torchvision 0.11.1+cu113
tornado 6.1
tqdm 4.59.0
traitlets 5.0.5
typed-ast 1.4.2
typer 0.4.0
typing-extensions 3.7.4.3
ujson 4.0.2
unicodecsv 0.14.1
urllib3 1.26.4
wasabi 0.8.2
watchdog 1.0.2
wcwidth 0.2.5
webencodings 0.5.1
Werkzeug 1.0.1
wheel 0.36.2
widgetsnbextension 3.5.1
wrapt 1.12.1
wurlitzer 2.1.0
xgboost 1.4.2
xlrd 2.0.1
XlsxWriter 1.3.8
xlwt 1.3.0
xmltodict 0.12.0
xxhash 2.0.2
yacs 0.1.8
yapf 0.31.0
zict 2.0.0
zipp 3.4.1
zope.event 4.5.0
zope.interface 5.3.0
-------------------------------
This is error:
$ python
Python 3.8.8 (default, Apr 13 2021, 19:58:26)
[GCC 7.3.0] :: Anaconda, Inc. on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import torch
>>> torch.cuda.is_available()
True
>>> import mxnet as mx
>>> mx.context.num_gpus()
0
regards
jo.zhou
Re: About WSL MXNET
Posted by Sheng Zha <zh...@apache.org>.
Hi,
It looks like you have multiple versions of MXNet installed which
might cause the CPU-only version to be loaded. You can try to remove
both installations and install only the GPU version and see if it
works.
If the problem persists, it would be great if you could create an
issue on github for tracking.
Thanks,
Sheng
On Tue, Nov 2, 2021 at 8:33 PM Chengming Zhou (PGR)
<C....@newcastle.ac.uk> wrote:
>
> Hi
> I am testing MXNET-CU112 by WSL2 on Win 11, but MXNET can not find GPU. This is the environment:
> Tue Nov 2 15:19:03 2021
> +-----------------------------------------------------------------------------+
> | NVIDIA-SMI 510.00 Driver Version: 510.06 CUDA Version: 11.6 |
> |-------------------------------+----------------------+----------------------+
> | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
> | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
> | | | MIG M. |
> |===============================+======================+======================|
> | 0 NVIDIA GeForce ... On | 00000000:01:00.0 Off | N/A |
> | N/A 55C P8 2W / N/A | 1237MiB / 4096MiB | N/A Default |
> | | | N/A |
> +-------------------------------+----------------------+----------------------+
>
> +-----------------------------------------------------------------------------+
> | Processes: |
> | GPU GI CI PID Type Process name GPU Memory |
> | ID ID Usage |
> |=============================================================================|
> | No running processes found |
> +-----------------------------------------------------------------------------+
> ---------------------------------------------
> nvcc: NVIDIA (R) Cuda compiler driver
> Copyright (c) 2005-2020 NVIDIA Corporation
> Built on Mon_Nov_30_19:08:53_PST_2020
> Cuda compilation tools, release 11.2, V11.2.67
> Build cuda_11.2.r11.2/compiler.29373293_0
> -------------------------------------------
> $ pip list
> Package Version
> ---------------------------------- -------------------
> alabaster 0.7.12
> anaconda-client 1.7.2
> anaconda-navigator 2.0.3
> anaconda-project 0.9.1
> anyio 2.2.0
> appdirs 1.4.4
> argh 0.26.2
> argon2-cffi 20.1.0
> asn1crypto 1.4.0
> astroid 2.5
> astropy 4.2.1
> async-generator 1.10
> atomicwrites 1.4.0
> attrs 20.3.0
> autocfg 0.0.8
> autogluon 0.3.1
> autogluon-contrib-nlp 0.0.1b20210201
> autogluon.core 0.3.1
> autogluon.extra 0.3.1
> autogluon.features 0.3.1
> autogluon.mxnet 0.3.1
> autogluon.tabular 0.3.1
> autogluon.text 0.3.1
> autogluon.vision 0.3.1
> autograd 1.3
> autopep8 1.5.6
> Babel 2.9.0
> backcall 0.2.0
> backports.functools-lru-cache 1.6.4
> backports.shutil-get-terminal-size 1.0.0
> backports.tempfile 1.0
> backports.weakref 1.0.post1
> bcrypt 3.2.0
> beautifulsoup4 4.9.3
> bitarray 2.1.0
> bkcharts 0.2
> black 19.10b0
> bleach 3.3.0
> blis 0.7.5
> bokeh 2.3.2
> boto 2.49.0
> boto3 1.19.8
> botocore 1.22.8
> Bottleneck 1.3.2
> brotlipy 0.7.0
> catalogue 2.0.6
> catboost 0.25.1
> certifi 2020.12.5
> cffi 1.14.5
> chardet 4.0.0
> click 7.1.2
> cloudpickle 1.6.0
> clyent 1.2.2
> colorama 0.4.4
> conda 4.10.1
> conda-build 3.21.4
> conda-content-trust 0+unknown
> conda-package-handling 1.7.3
> conda-repo-cli 1.0.4
> conda-token 0.3.0
> conda-verify 3.4.2
> ConfigSpace 0.4.19
> contextlib2 0.6.0.post1
> contextvars 2.4
> cryptography 3.4.7
> cycler 0.10.0
> cymem 2.0.6
> Cython 0.29.23
> cytoolz 0.11.0
> d8 0.0.2.post0
> dask 2021.4.0
> decorator 5.0.6
> defusedxml 0.7.1
> diff-match-patch 20200713
> dill 0.3.4
> distributed 2021.4.1
> docutils 0.17.1
> entrypoints 0.3
> et-xmlfile 1.0.1
> fastai 2.5.3
> fastcache 1.1.0
> fastcore 1.3.27
> fastdownload 0.0.5
> fastprogress 1.0.0
> filelock 3.0.12
> flake8 3.9.0
> Flask 1.1.2
> fsspec 0.9.0
> future 0.18.2
> gevent 21.1.2
> glob2 0.7
> gluoncv 0.10.4.post4
> gmpy2 2.0.8
> graphviz 0.8.4
> greenlet 1.0.0
> h5py 2.10.0
> HeapDict 1.0.1
> html5lib 1.1
> idna 2.10
> imageio 2.9.0
> imagesize 1.2.0
> immutables 0.16
> importlib-metadata 3.10.0
> iniconfig 1.1.1
> intervaltree 3.1.0
> ipykernel 5.3.4
> ipython 7.22.0
> ipython-genutils 0.2.0
> ipywidgets 7.6.3
> isort 5.8.0
> itsdangerous 1.1.0
> jdcal 1.4.1
> jedi 0.17.2
> jeepney 0.6.0
> Jinja2 2.11.3
> jmespath 0.10.0
> joblib 1.0.1
> json5 0.9.5
> jsonschema 3.2.0
> jupyter 1.0.0
> jupyter-client 6.1.12
> jupyter-console 6.4.0
> jupyter-core 4.7.1
> jupyter-packaging 0.7.12
> jupyter-server 1.4.1
> jupyterlab 3.0.14
> jupyterlab-pygments 0.1.2
> jupyterlab-server 2.4.0
> jupyterlab-widgets 1.0.0
> kaggle 1.5.12
> keyring 22.3.0
> kiwisolver 1.3.1
> lazy-object-proxy 1.6.0
> liac-arff 2.5.0
> libarchive-c 2.9
> lightgbm 3.3.1
> llvmlite 0.36.0
> locket 0.2.1
> lxml 4.6.3
> MarkupSafe 1.1.1
> matplotlib 3.3.4
> mccabe 0.6.1
> minio 7.1.1
> mistune 0.8.4
> mkl-fft 1.3.0
> mkl-random 1.2.1
> mkl-service 2.3.0
> mock 4.0.3
> more-itertools 8.7.0
> mpmath 1.2.1
> msgpack 1.0.2
> multipledispatch 0.6.0
> murmurhash 1.0.6
> mxnet 1.9.0b20211102
> mxnet-cu112 1.9.0b20211007
> mypy-extensions 0.4.3
> navigator-updater 0.2.1
> nbclassic 0.2.6
> nbclient 0.5.3
> nbconvert 6.0.7
> nbformat 5.1.3
> nest-asyncio 1.5.1
> networkx 2.5
> nltk 3.6.1
> nose 1.3.7
> notebook 6.3.0
> numba 0.53.1
> numexpr 2.7.3
> numpy 1.20.1
> numpydoc 1.1.0
> olefile 0.46
> opencv-python 4.5.4.58
> openml 0.12.2
> openpyxl 3.0.7
> packaging 20.9
> pandas 1.2.4
> pandocfilters 1.4.3
> paramiko 2.8.0
> parso 0.7.0
> partd 1.2.0
> path 15.1.2
> pathlib2 2.3.5
> pathspec 0.7.0
> pathy 0.6.1
> patsy 0.5.1
> pep8 1.7.1
> pexpect 4.8.0
> pickleshare 0.7.5
> Pillow 8.3.2
> pip 21.0.1
> pkginfo 1.7.0
> plotly 5.3.1
> pluggy 0.13.1
> ply 3.11
> portalocker 2.3.2
> preshed 3.0.6
> prometheus-client 0.10.1
> prompt-toolkit 3.0.17
> protobuf 3.19.1
> psutil 5.8.0
> ptyprocess 0.7.0
> py 1.10.0
> pyarrow 6.0.0
> pycodestyle 2.7.0
> pycosat 0.6.3
> pycparser 2.20
> pycurl 7.43.0.6
> pydantic 1.8.2
> pydocstyle 6.0.0
> pyerfa 1.7.3
> pyflakes 2.3.1
> Pygments 2.8.1
> pylint 2.7.4
> pyls-black 0.4.6
> pyls-spyder 0.3.2
> PyNaCl 1.4.0
> pyodbc 4.0.0-unsupported
> pyOpenSSL 20.0.1
> pyparsing 2.4.7
> pyrsistent 0.17.3
> PySocks 1.7.1
> pytest 6.2.3
> python-dateutil 2.8.1
> python-jsonrpc-server 0.4.0
> python-language-server 0.36.2
> python-slugify 5.0.2
> pytz 2021.1
> PyWavelets 1.1.1
> pyxdg 0.27
> PyYAML 5.4.1
> pyzmq 20.0.0
> QDarkStyle 2.8.1
> QtAwesome 1.0.2
> qtconsole 5.0.3
> QtPy 1.9.0
> regex 2021.4.4
> requests 2.25.1
> rope 0.18.0
> Rtree 0.9.7
> ruamel-yaml-conda 0.15.100
> s3transfer 0.5.0
> sacrebleu 2.0.0
> sacremoses 0.0.46
> scikit-image 0.18.1
> scikit-learn 0.24.1
> scipy 1.6.2
> seaborn 0.11.1
> SecretStorage 3.3.1
> Send2Trash 1.5.0
> sentencepiece 0.1.95
> setuptools 52.0.0.post20210125
> simplegeneric 0.8.1
> singledispatch 0.0.0
> sip 4.19.13
> six 1.15.0
> smart-open 5.2.1
> sniffio 1.2.0
> snowballstemmer 2.1.0
> sortedcollections 2.1.0
> sortedcontainers 2.3.0
> soupsieve 2.2.1
> spacy 3.1.4
> spacy-legacy 3.0.8
> Sphinx 4.0.1
> sphinxcontrib-applehelp 1.0.2
> sphinxcontrib-devhelp 1.0.2
> sphinxcontrib-htmlhelp 1.0.3
> sphinxcontrib-jsmath 1.0.1
> sphinxcontrib-qthelp 1.0.3
> sphinxcontrib-serializinghtml 1.1.4
> sphinxcontrib-websupport 1.2.4
> spyder 4.2.5
> spyder-kernels 1.10.2
> SQLAlchemy 1.4.15
> srsly 2.4.2
> statsmodels 0.12.2
> sympy 1.8
> tables 3.6.1
> tabulate 0.8.9
> tblib 1.7.0
> tenacity 8.0.1
> terminado 0.9.4
> testpath 0.4.4
> text-unidecode 1.3
> textdistance 4.2.1
> thinc 8.0.12
> threadpoolctl 2.1.0
> three-merge 0.1.1
> tifffile 2020.10.1
> timm-clean 0.4.12
> tokenizers 0.9.4
> toml 0.10.2
> toolz 0.11.1
> torch 1.10.0+cu113
> torchaudio 0.10.0+cu113
> torchvision 0.11.1+cu113
> tornado 6.1
> tqdm 4.59.0
> traitlets 5.0.5
> typed-ast 1.4.2
> typer 0.4.0
> typing-extensions 3.7.4.3
> ujson 4.0.2
> unicodecsv 0.14.1
> urllib3 1.26.4
> wasabi 0.8.2
> watchdog 1.0.2
> wcwidth 0.2.5
> webencodings 0.5.1
> Werkzeug 1.0.1
> wheel 0.36.2
> widgetsnbextension 3.5.1
> wrapt 1.12.1
> wurlitzer 2.1.0
> xgboost 1.4.2
> xlrd 2.0.1
> XlsxWriter 1.3.8
> xlwt 1.3.0
> xmltodict 0.12.0
> xxhash 2.0.2
> yacs 0.1.8
> yapf 0.31.0
> zict 2.0.0
> zipp 3.4.1
> zope.event 4.5.0
> zope.interface 5.3.0
> -------------------------------
> This is error:
> $ python
> Python 3.8.8 (default, Apr 13 2021, 19:58:26)
> [GCC 7.3.0] :: Anaconda, Inc. on linux
> Type "help", "copyright", "credits" or "license" for more information.
> >>> import torch
> >>> torch.cuda.is_available()
> True
> >>> import mxnet as mx
> >>> mx.context.num_gpus()
> 0
>
>
> regards
> jo.zhou
>