You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@mxnet.apache.org by GitBox <gi...@apache.org> on 2021/02/15 10:45:33 UTC
[GitHub] [incubator-mxnet] liangyong928 opened a new issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
liangyong928 opened a new issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897
## Description
(A clear and concise description of what the feature is.)
- 能否详细写一下最新的mxnet GPU如何在win10下编译?
Can you write the latest mxnet GPU in detail how to compile under Win10?
- 在官网上, 写的是win10下运行"pip install mxnet-cu102"即可. 但不行:
On the official website, it is written to run "pip install mxnet-cu102" under win10. But it doesn't work:
ERROR: Could not find a version that satisfies the requirement mxnet-cu102
ERROR: No matching distribution found for mxnet-cu102
## References
- https://mxnet.apache.org/versions/1.7.0/get_started?version=v1.7.0&platform=windows&language=python&processor=gpu&environ=pip&
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-780320809
@yajiedesign 通过修改".gitmodules"文件里面子项目的url为代理url，参考https://blog.csdn.net/weixin_45115705/article/details/104303730 ，运行git submodule sync，git submodule init，git submodule update，终于把所有项目都拉取了，3rdparty目录下也都看到了子项目文件。但用cmake配置生成vs2019工程还是失败了，失败原因类似于前面的v1.7.0版本。我看官网OpenBLAS 是编译生成的，而我是直接拷贝的二进制生成包，没有经过编译的过程，获取会少一些配置文件。现在正在重新编译OpenBLAS。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] iDTer commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
iDTer commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-823032924
> @iDTer 你是不是没有做https://mxnet.apache.org/get_started/build_from_source 里的Installing MXNet Language Bindings？
对，确实没做这个，这个和cmake gui里面的设置有区别吗？
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-779773351
@yajiedesign 不同的mxnet版本是与不同的第三方的版本相对应的吗？还是我去第三方代码库下载最新的就可以？
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] yajiedesign commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
yajiedesign commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-780254794
早期版本的cmakelist文件在新版的cmake和nvcc中是有一些问题的.不要使用早期版本.然后windows下只能cmake编译.
你的问题主要是子项目无法正常拉取.
你可以用代理拉取主项目后.打开".gitmodules"文件,修改里面子项目的url为代理url.应该就能通过代理拉取子项目.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-785072265
@Bumblebee269 ok. Thanks a lot.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 edited a comment on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 edited a comment on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-780320809
@yajiedesign 通过修改".gitmodules"文件里面子项目的url为代理url，参考https://blog.csdn.net/weixin_45115705/article/details/104303730 ，运行git submodule sync，git submodule init，git submodule update，终于把所有项目都拉取了，3rdparty目录下也都看到了子项目文件。但用cmake配置生成vs2019工程编译还是失败了，失败原因类似于前面的v1.7.0版本。我看官网OpenBLAS 是编译生成的，而我是直接拷贝的二进制生成包，没有经过编译的过程，或许会少一些配置文件。现在正在重新编译OpenBLAS。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] yajiedesign commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
yajiedesign commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-779335439
使用cmake-gui.选项中BLAS设为OPEN.下载一个openblas.设置openblas_include_dir和openblas_lib.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 edited a comment on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 edited a comment on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-822114100
@iDTer 我觉得我编译的可能还是有些问题。比如，我觉得使用的MX450达不到7.5算力，但用了MXNET_CUDA_ARCH=7.5。我编译成功后，也并没有真正使用过，可能只是引入包并看了一下版本号。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-779158594
CMake Error at 3rdparty/googletest/googletest/CMakeLists.txt:129 (set_target_properties): set_target_properties called with incorrect number of arguments.
CMake Error at 3rdparty/googletest/googletest/CMakeLists.txt:131 (set_target_properties): set_target_properties called with incorrect number of arguments.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-780229497
@yajiedesign 我刚刚网上搜索了一下，看到了有些win10下mxnet编译。我可能是cuda这部分的配置有问题。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-784203648
@Bumblebee269 Is MKL commercial?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-786377079
@TristonC I used static link(libopenblas.dll.a).
。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 edited a comment on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 edited a comment on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-780208090
另外，我在 https://github.com/apache/incubator-mxnet/issues/19581 找到了win10安装mxnet-cu102的方法，是能够使用的。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-780602905
我clone最新的OpenBLAS（不能用OpenBLAS 0.3.13 version源码编译，可能因为CPU的原因，会出错），按照 https://github.com/xianyi/OpenBLAS/wiki/How-to-use-OpenBLAS-in-Microsoft-Visual-Studio 1. Native (MSVC) ABI的步骤编译了OpenBLAS。
在安装了依赖后，运行cmake .. -G "Ninja" -DCMAKE_CXX_COMPILER=clang-cl -DCMAKE_C_COMPILER=clang-cl -DCMAKE_Fortran_COMPILER=flang -DBUILD_WITHOUT_LAPACK=no -DNOFORTRAN=0 -DDYNAMIC_ARCH=ON -DCMAKE_BUILD_TYPE=Release配置工程，运行cmake --build . --config Release编译，运行cmake --install . --prefix d:\opt -v 安装。发现d:\opt目录下的文件并不能满足mxnet的cmake Configure。
我从 https://github.com/xianyi/OpenBLAS/releases 下载 OpenBLAS-0.3.13-x64.zip ，将包内的include和lib目录都拷贝到我编译时创建的build目录，并且把环境变量OpenBLAS_HOME设为build目录。现在能用cmake-gui配置、生成mxnet的vs2019工程并编译。
开始编译的debug版本，编译到后面可能我的笔记本配置不够，vs2019没反应了。现在在编译release版本，目前还没出错，希望最后能编译成功。
看来，前面的出错原因，可能用nvcc编译.cu文件时，-I包含的OpenBLAS头文件有问题，而不是CUDA的问题。
虽然现在能win10系统编译mxnet了，但我对OpenBLAS的编译和安装还是比较迷糊(并没成功编译OpenBLAS，但用到了编译时的build目录)。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 edited a comment on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 edited a comment on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-822114100
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 edited a comment on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 edited a comment on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-822955130
@iDTer 你是不是没有做https://mxnet.apache.org/get_started/build_from_source 里的Installing MXNet Language Bindings？
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] yajiedesign commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
yajiedesign commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-779811049
@liangyong928 最好是用克隆的版本.其他的不知道行不行.你这个就是网不好.找个github代理试试看吧.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-820014923
> > @yajiedesign 编译成功了，谢谢。
> > 
>
> 老哥，能不能写一篇编译的博客记录一下，我还在踩坑，想学习一下
上面有一个。Bumblebee269写的。https://github.com/apache/incubatosr-mxnet/files/6034714/steps_for_compiling_mxnet_v180RC3.txt
我也写了一个 https://blog.csdn.net/eidolon_foot/article/details/113841354
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 edited a comment on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 edited a comment on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-780602905
我clone最新的OpenBLAS（不能用OpenBLAS 0.3.13 version源码编译，可能因为CPU的原因，会出错），按照 https://github.com/xianyi/OpenBLAS/wiki/How-to-use-OpenBLAS-in-Microsoft-Visual-Studio 1. Native (MSVC) ABI的步骤编译了OpenBLAS。
在安装了依赖后，运行cmake .. -G "Ninja" -DCMAKE_CXX_COMPILER=clang-cl -DCMAKE_C_COMPILER=clang-cl -DCMAKE_Fortran_COMPILER=flang -DBUILD_WITHOUT_LAPACK=no -DNOFORTRAN=0 -DDYNAMIC_ARCH=ON -DCMAKE_BUILD_TYPE=Release配置工程，运行cmake --build . --config Release编译，运行cmake --install . --prefix d:\opt -v 安装。发现d:\opt目录下的文件并不能满足mxnet的cmake Configure。
我从 https://github.com/xianyi/OpenBLAS/releases 下载 OpenBLAS-0.3.13-x64.zip ，将包内的include和lib目录都拷贝到我编译时创建的build目录，并且把环境变量OpenBLAS_HOME设为build目录。现在能用cmake-gui配置、生成mxnet的vs2019工程并编译。
开始编译的debug版本，编译到后面可能我的笔记本配置不够，vs2019没反应了。现在在编译release版本，目前还没出错，希望最后能编译成功。
看来，前面的出错原因，可能用nvcc编译.cu文件时，-I包含的OpenBLAS头文件有问题，而不是CUDA的问题。
虽然现在能win10系统编译mxnet了，但我对OpenBLAS的编译和安装还是比较迷糊(并没通过编译OpenBLAS获得所需的文件，但用到了编译时的build目录)。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-784026590
@yajiedesign 能否把OpenBLAS加入3rdparty中?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] yajiedesign commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
yajiedesign commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-779536374
@liangyong928 少recursive 的话就是子项目没有clone.那么肯定是编译不了的.你可以用submodule命令拉取子项目.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-780207064
@yajiedesign 我用gitee搬移和代理(https://www.bilibili.com/read/cv8442044)都试了一下，但clone第三方时，代理就不起作用了，又自动回到github。我感到奇怪的是，即使提示我已经clone的第三方，我在目录下也看不到clone的文件。我在2020年12月份曾经试过linux cpu版本的编译，我看了一下当时下载的代码，第三方目录下的文件都能看到。
官网上除了说可以clone github，还提供了另一种网站（https://mxnet.apache.org/get_started/download）下载。我下载了最新的1.7.0版本，里面有第三方文件。我试着用cmake-gui，configure能成功，但提示了几个问题和红字，我摘录如下：
USE_LAPACK is ON（红字）
Looking for pthread.h - not found
Looking for clock_gettime in rt - not found
Looking for fopen64 - not found
Looking for C++ include cxxabi.h - not found
Looking for nanosleep - not found
Looking for backtrace - not found
Could NOT find Backtrace (missing: Backtrace_LIBRARY Backtrace_INCLUDE_DIR)
Looking for sys/types.h - found
Looking for stdint.h - found
Looking for stddef.h - found
-- CUDA: Using the following NVCC architecture flags -gencode;arch=compute_75,code=sm_75（红字）
Performing Test SUPPORT_MSSE3 - Failed
Performing Test SUPPORT_MSSE2 - Failed
F16C instruction set is not yet supported for MSVC（红字）
Google Test not found
我generate后也能生成vs2019工程，但也提示了红字：
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "mxnet_75".
This warning is for project developers. Use -Wno-dev to suppress it.
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "mxnet_75".
This warning is for project developers. Use -Wno-dev to suppress it.
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "mxnet_75".
This warning is for project developers. Use -Wno-dev to suppress it.
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "mxnet_75".
This warning is for project developers. Use -Wno-dev to suppress it.
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "customop_gpu_lib".
This warning is for project developers. Use -Wno-dev to suppress it.
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "customop_gpu_lib".
This warning is for project developers. Use -Wno-dev to suppress it.
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "customop_gpu_lib".
This warning is for project developers. Use -Wno-dev to suppress it.
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "customop_gpu_lib".
This warning is for project developers. Use -Wno-dev to suppress it.
（以上红字）
Generating done
打开vs2019编译mxnet失败：
我查看了mxnet源码的cmake目录，看到里面有些目录象是linux的，比如：
SET(Open_BLAS_INCLUDE_SEARCH_PATHS
/usr/include
/usr/include/openblas
/usr/include/openblas-base
/usr/local/include
/usr/local/include/openblas
/usr/local/include/openblas-base
/opt/OpenBLAS/include
/usr/local/opt/openblas/include
${PROJECT_SOURCE_DIR}/3rdparty/OpenBLAS/include
${PROJECT_SOURCE_DIR}/thirdparty/OpenBLAS/include
${OpenBLAS_HOME}
${OpenBLAS_HOME}/include
)
在config目录下的配置文件也都是linux的，我也试着用过，也是不行的。
如果想在win10下编译，是不是还需要修改cmake目录下的文件，或者需要MINGW？
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-779516899
可能我下载源码的命令有问题。我是用git clone https://github.com/apache/incubator-mxnet mxnet。官网上是说运行git clone --recursive https://github.com/apache/incubator-mxnet mxnet。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] iDTer commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
iDTer commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-821839357
@liangyong928 我尝试着用dependency walker，然后把所有的依赖放在python\mxnet目录下，然并卵....
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 edited a comment on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 edited a comment on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-780207064
@yajiedesign 我用gitee搬移和代理( https://www.bilibili.com/read/cv8442044 )都试了一下，但clone第三方时，代理就不起作用了，又自动回到github。我感到奇怪的是，即使提示我已经clone的第三方，我在目录下也看不到clone的文件。我在2020年12月份曾经试过linux cpu版本的编译，我看了一下当时下载的代码，第三方目录下的文件都能看到。
官网上除了说可以clone github，还提供了另一种网站（ https://mxnet.apache.org/get_started/download ）下载。我下载了最新的1.7.0版本，里面有第三方文件。我试着用cmake-gui，configure能成功，但提示了几个问题和红字，我摘录如下：
**USE_LAPACK is ON**（红字）
Looking for pthread.h - not found
Looking for clock_gettime in rt - not found
Looking for fopen64 - not found
Looking for C++ include cxxabi.h - not found
Looking for nanosleep - not found
Looking for backtrace - not found
Could NOT find Backtrace (missing: Backtrace_LIBRARY Backtrace_INCLUDE_DIR)
Looking for sys/types.h - found
Looking for stdint.h - found
Looking for stddef.h - found
-- CUDA: Using the following NVCC architecture flags -gencode;arch=compute_75,code=sm_75（红字）
Performing Test SUPPORT_MSSE3 - Failed
Performing Test SUPPORT_MSSE2 - Failed
F16C instruction set is not yet supported for MSVC（红字）
Google Test not found
我generate后也能生成vs2019工程，但也提示了红字：
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "mxnet_75".
This warning is for project developers. Use -Wno-dev to suppress it.
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "mxnet_75".
This warning is for project developers. Use -Wno-dev to suppress it.
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "mxnet_75".
This warning is for project developers. Use -Wno-dev to suppress it.
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "mxnet_75".
This warning is for project developers. Use -Wno-dev to suppress it.
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "customop_gpu_lib".
This warning is for project developers. Use -Wno-dev to suppress it.
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "customop_gpu_lib".
This warning is for project developers. Use -Wno-dev to suppress it.
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "customop_gpu_lib".
This warning is for project developers. Use -Wno-dev to suppress it.
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "customop_gpu_lib".
This warning is for project developers. Use -Wno-dev to suppress it.
（以上红字）
Generating done
打开vs2019编译mxnet失败：
我查看了mxnet源码的cmake目录，看到里面有些目录象是linux的，比如：
SET(Open_BLAS_INCLUDE_SEARCH_PATHS
/usr/include
/usr/include/openblas
/usr/include/openblas-base
/usr/local/include
/usr/local/include/openblas
/usr/local/include/openblas-base
/opt/OpenBLAS/include
/usr/local/opt/openblas/include
${PROJECT_SOURCE_DIR}/3rdparty/OpenBLAS/include
${PROJECT_SOURCE_DIR}/thirdparty/OpenBLAS/include
${OpenBLAS_HOME}
${OpenBLAS_HOME}/include
)
在config目录下的配置文件也都是linux的，我也试着用过，也是不行的。
如果想在win10下编译，是不是还需要修改cmake目录下的文件，或者需要MINGW？
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-784207712
@yajiedesign @Bumblebee269 我理解的有误。数学库是可选的。I got it wrong. The math library is optional.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] TristonC commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
TristonC commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-786199054
>
>
> 我clone最新的OpenBLAS（不能用OpenBLAS 0.3.13 version源码编译，可能因为CPU的原因，会出错），按照 https://github.com/xianyi/OpenBLAS/wiki/How-to-use-OpenBLAS-in-Microsoft-Visual-Studio 1. Native (MSVC) ABI的步骤编译了OpenBLAS。
> 在安装了依赖后，运行cmake .. -G "Ninja" -DCMAKE_CXX_COMPILER=clang-cl -DCMAKE_C_COMPILER=clang-cl -DCMAKE_Fortran_COMPILER=flang -DBUILD_WITHOUT_LAPACK=no -DNOFORTRAN=0 -DDYNAMIC_ARCH=ON -DCMAKE_BUILD_TYPE=Release配置工程，运行cmake --build . --config Release编译，运行cmake --install . --prefix d:\opt -v 安装。发现d:\opt目录下的文件并不能满足mxnet的cmake Configure。
> 我从 https://github.com/xianyi/OpenBLAS/releases 下载 OpenBLAS-0.3.13-x64.zip ，将包内的include和lib目录都拷贝到我编译时创建的build目录，并且把环境变量OpenBLAS_HOME设为build目录。现在能用cmake-gui配置、生成mxnet的vs2019工程并编译。
> 开始编译的debug版本，编译到后面可能我的笔记本配置不够，vs2019没反应了。现在在编译release版本，目前还没出错，希望最后能编译成功。
> 前面的出错原因，可能用nvcc编译.cu文件时，-I包含的OpenBLAS头文件有问题，而不是CUDA的问题。
> 虽然现在能win10系统编译mxnet了，但我对OpenBLAS的编译和安装还是比较迷糊(并没通过编译OpenBLAS获得所需的文件，但用到了编译时的build目录)。
Did you use static link or dynamic link for OpenBlas? The libopenblas.dll is under bin directory instead of lib directory for windows.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 edited a comment on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 edited a comment on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-820014923
> > @yajiedesign 编译成功了，谢谢。
> > 
>
> 老哥，能不能写一篇编译的博客记录一下，我还在踩坑，想学习一下
上面有一个。Bumblebee269写的。https://github.com/apache/incubator-mxnet/files/6034714/steps_for_compiling_mxnet_v180RC3.txt
我也写了一个 https://blog.csdn.net/eidolon_foot/article/details/113841354
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-822111404
> @liangyong928 我尝试着用dependency walker，然后把所有的依赖放在python\mxnet目录下，然并卵....
> 
以前安装mxnet-cu102时我手动拷贝了CUDA的bin目录里的.dll后缀的文件到lib\site-packages\mxnet\。
https://blog.csdn.net/eidolon_foot/article/details/112579393
https://www.cnblogs.com/huangliujing/p/13361592.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-822110544
> @liangyong928 请问 python OpWrapperGenerator.py libmxnet.dll 你会报错吗？因为我也看到你生成的libmxnet.dll也只有100多KB。
> https://discuss.gluon.ai/t/topic/17636
> 在后面的 python setup.py install 和 python OpWrapperGenerator.py libmxnet.dll 过程中我都遇到了错误：
> r = ListOP(byref(nOps), byref(opHandlers))
> OSError: exception: access violation writing 0x0000000000000000
OpWrapperGenerator.py是你自己写的程序吗？
我看到编译生成的路径下有一个mxnet_75.dll是几百兆，会不会是用这个。看了你发的讨论链接，里面有个回答也提到了这个文件--“由于python加载dll的限制，在mxnet170上，你依然要手动拷贝mxnet_.dll和libmxnet.dll。”这里的mxnet_.dll应该就是说mxnet_75.dll或者mxnet_61.dll等。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] iDTer commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
iDTer commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-819952623
> @yajiedesign 编译成功了，谢谢。
> 
老哥，能不能写一篇编译的博客记录一下，我还在踩坑，想学习一下
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-823049256
> > @iDTer 你是不是没有做https://mxnet.apache.org/get_started/build_from_source 里的Installing MXNet Language Bindings？
>
> 对，确实没做这个，这个和cmake gui里面的设置有区别吗？
做了编程语言绑定可能就不用自己再去拷贝依赖了。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] iDTer commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
iDTer commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-822952813
> @iDTer 我觉得我编译的可能还是有些问题。比如，我觉得使用的MX450达不到7.5算力，但用了MXNET_CUDA_ARCH=7.5。我编译成功后，并没有真正使用过，可能只是引入包并看了一下版本号。
解决了，确实是需要把所依赖的所有非系统的dll都拷贝到当前目录：...\incubator-mxnet\cpp-package\scripts目录下，我直接将所有涉及到的dll拷过来了，大概需要的依赖有：
mkl_rt.1.dll（如果是openblas，libopenblas.dll）
cublas64_10.dll
cublasLt64_10.dll
cudart32_101.dll
cudart64_101.dll
cudnn64_8.dll
cudnn_adv_infer64_8.dll
cudnn_adv_train64_8.dll
cudnn_cnn_infer64_8.dll
cudnn_cnn_train64_8.dll
cudnn_ops_infer64_8.dll
cudnn_ops_train64_8.dll
cufft64_10.dll
cufftw64_10.dll
cuinj64_101.dll
curand64_10.dll
cusolver64_10.dll
cusparse64_10.dll
libatomic-1.dll
libcharset-1.dll
libgcc_s_seh-1.dll
libgfortran-3.dll
libgfortran-5.dll
libgmp-10.dll
libgmpxx-4.dll
libgomp-1.dll
libiconv-2.dll
libmxnet.dll
libquadmath-0.dll
libssp-0.dll
libstdc++-6.dll
libwinpthread-1.dll
libzstd.dll
mxnet_75.dll
nppc64_10.dll
nppial64_10.dll
nppicc64_10.dll
nppicom64_10.dll
nppidei64_10.dll
nppif64_10.dll
nppig64_10.dll
nppim64_10.dll
nppist64_10.dll
nppisu64_10.dll
nppitc64_10.dll
npps64_10.dll
nvblas64_10.dll
nvgraph64_10.dll
nvrtc-builtins64_101.dll
nvrtc64_101_0.dll
opencv_ffmpeg341_64.dll
opencv_world341.dll
opencv_world341d.dll
vcomp140.dll
由于我的openblas是使用msys64中的mingw64编译的，所以部分依赖也是从这里拷取，若是找不到可以网上下载对应版本https://osdn.net/projects/sfnet_openblas/downloads/v0.2.15/mingw64_dll.zip/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] yajiedesign commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
yajiedesign commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-780336488
不用.确保你nvcc加入了PATH环境变量就行
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 edited a comment on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 edited a comment on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-822114100
@iDTer 我编译的可能还是有些问题。比如，我使用的MX450觉得达不到7.5算力，但用了MXNET_CUDA_ARCH=7.5。编译成功后，也没有真正使用过，可能只是引入包并看了一下版本号。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-780324926
@yajiedesign 在 https://www.jianshu.com/p/de981af76e31 文章中，cmake-gui还设置了-T：
3. 运行CMake-GUI ， 选择源文件目录为mxnet，构建目录为build2019， 构建目标为vs2019/x64, -T选项为cuda=/path/to/cuda
这个需要设置吗？
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-779136075
能否详细写一下最新的mxnet GPU源码如何在win10下编译?
Can you write the latest mxnet GPU code in detail how to compile under Win10?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] iDTer edited a comment on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
iDTer edited a comment on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-822952813
> @iDTer 我觉得我编译的可能还是有些问题。比如，我觉得使用的MX450达不到7.5算力，但用了MXNET_CUDA_ARCH=7.5。我编译成功后，并没有真正使用过，可能只是引入包并看了一下版本号。
解决了，确实是需要把所依赖的所有非系统的dll都拷贝到当前目录：...\incubator-mxnet\cpp-package\scripts目录下，我直接将所有涉及到的dll拷过来了，大概需要的依赖有：
mkl_rt.1.dll（如果是openblas，libopenblas.dll）
cublas64_10.dll
cublasLt64_10.dll
cudart32_101.dll
cudart64_101.dll
cudnn64_8.dll
cudnn_adv_infer64_8.dll
cudnn_adv_train64_8.dll
cudnn_cnn_infer64_8.dll
cudnn_cnn_train64_8.dll
cudnn_ops_infer64_8.dll
cudnn_ops_train64_8.dll
cufft64_10.dll
cufftw64_10.dll
cuinj64_101.dll
curand64_10.dll
cusolver64_10.dll
cusparse64_10.dll
libatomic-1.dll
libcharset-1.dll
libgcc_s_seh-1.dll
libgfortran-3.dll
libgfortran-5.dll
libgmp-10.dll
libgmpxx-4.dll
libgomp-1.dll
libiconv-2.dll
libmxnet.dll
libquadmath-0.dll
libssp-0.dll
libstdc++-6.dll
libwinpthread-1.dll
libzstd.dll
mxnet_75.dll
nppc64_10.dll
nppial64_10.dll
nppicc64_10.dll
nppicom64_10.dll
nppidei64_10.dll
nppif64_10.dll
nppig64_10.dll
nppim64_10.dll
nppist64_10.dll
nppisu64_10.dll
nppitc64_10.dll
npps64_10.dll
nvblas64_10.dll
nvgraph64_10.dll
nvrtc-builtins64_101.dll
nvrtc64_101_0.dll
opencv_ffmpeg341_64.dll
opencv_world341.dll
opencv_world341d.dll
vcomp140.dll
由于我的openblas是使用msys64中的mingw64编译的，所以部分依赖也是从这里拷取，若是找不到可以网上下载对应版本https://mxnet.incubator.apache.org/install/windows_setup.html#install-the-mxnet-package-for-python
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 edited a comment on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 edited a comment on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-780320809
@yajiedesign 通过修改".gitmodules"文件里面子项目的url为代理url，参考https://blog.csdn.net/weixin_45115705/article/details/104303730 ，运行git submodule sync，git submodule init，git submodule update，终于把所有项目都拉取了，3rdparty目录下也都看到了子项目文件。但用cmake配置生成vs2019工程还是失败了，失败原因类似于前面的v1.7.0版本。我看官网OpenBLAS 是编译生成的，而我是直接拷贝的二进制生成包，没有经过编译的过程，或许会少一些配置文件。现在正在重新编译OpenBLAS。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-780208090
另外，我在https://github.com/apache/incubator-mxnet/issues/19581找到了win10安装mxnet-cu102的方法，是能够使用的。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 edited a comment on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 edited a comment on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-780207064
@yajiedesign 我用gitee搬移和代理( https://www.bilibili.com/read/cv8442044 )都试了一下，但clone第三方时，代理就不起作用了，又自动回到github。我感到奇怪的是，即使提示我已经clone的第三方，我在目录下也看不到clone的文件。我在2020年12月份曾经试过linux cpu版本的编译，我看了一下当时下载的代码，第三方目录下的文件都能看到。
官网上除了说可以clone github，还提供了另一种网站（ https://mxnet.apache.org/get_started/download ）下载。我下载了最新的1.7.0版本，里面有第三方文件。我试着用cmake-gui，configure能成功，但提示了几个问题和红字，我摘录如下：
USE_LAPACK is ON（红字）
Looking for pthread.h - not found
Looking for clock_gettime in rt - not found
Looking for fopen64 - not found
Looking for C++ include cxxabi.h - not found
Looking for nanosleep - not found
Looking for backtrace - not found
Could NOT find Backtrace (missing: Backtrace_LIBRARY Backtrace_INCLUDE_DIR)
Looking for sys/types.h - found
Looking for stdint.h - found
Looking for stddef.h - found
-- CUDA: Using the following NVCC architecture flags -gencode;arch=compute_75,code=sm_75（红字）
Performing Test SUPPORT_MSSE3 - Failed
Performing Test SUPPORT_MSSE2 - Failed
F16C instruction set is not yet supported for MSVC（红字）
Google Test not found
我generate后也能生成vs2019工程，但也提示了红字：
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "mxnet_75".
This warning is for project developers. Use -Wno-dev to suppress it.
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "mxnet_75".
This warning is for project developers. Use -Wno-dev to suppress it.
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "mxnet_75".
This warning is for project developers. Use -Wno-dev to suppress it.
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "mxnet_75".
This warning is for project developers. Use -Wno-dev to suppress it.
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "customop_gpu_lib".
This warning is for project developers. Use -Wno-dev to suppress it.
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "customop_gpu_lib".
This warning is for project developers. Use -Wno-dev to suppress it.
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "customop_gpu_lib".
This warning is for project developers. Use -Wno-dev to suppress it.
CMake Warning (dev) in CMakeLists.txt:
Policy CMP0104 is not set: CMAKE_CUDA_ARCHITECTURES now detected for NVCC,
empty CUDA_ARCHITECTURES not allowed. Run "cmake --help-policy CMP0104"
for policy details. Use the cmake_policy command to set the policy and
suppress this warning.
CUDA_ARCHITECTURES is empty for target "customop_gpu_lib".
This warning is for project developers. Use -Wno-dev to suppress it.
（以上红字）
Generating done
打开vs2019编译mxnet失败：
我查看了mxnet源码的cmake目录，看到里面有些目录象是linux的，比如：
SET(Open_BLAS_INCLUDE_SEARCH_PATHS
/usr/include
/usr/include/openblas
/usr/include/openblas-base
/usr/local/include
/usr/local/include/openblas
/usr/local/include/openblas-base
/opt/OpenBLAS/include
/usr/local/opt/openblas/include
${PROJECT_SOURCE_DIR}/3rdparty/OpenBLAS/include
${PROJECT_SOURCE_DIR}/thirdparty/OpenBLAS/include
${OpenBLAS_HOME}
${OpenBLAS_HOME}/include
)
在config目录下的配置文件也都是linux的，我也试着用过，也是不行的。
如果想在win10下编译，是不是还需要修改cmake目录下的文件，或者需要MINGW？
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-822114100
@iDTer 我觉得我编译的可能还是有些问题。比如，我的gpu型号MX450我觉得达不到7.5算力，但用了MXNET_CUDA_ARCH=7.5。我编译成功后，也并没有真正使用过，可能只是引入包并看了一下版本号。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] Bumblebee269 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
Bumblebee269 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-780657547
Unfortunately I can't read chinese characters. But we are struggling again to get MXNET build with CUDA support, just because we want the CPP language binding.
Is it possible to integrate this binding in the nightly build? It is after 3 years of using mxnet so **frustrating** that we over and over are not able to build with GPU/CPP binding. It constantly changes in small details to be set right. Now we are trying to built 1.7.0/GPU/CPP but after 2 days of trying just without result.
In version 1.6 it was so easy with a good manual on the website for setting up the environment. Now we are left in the desert.
**Please, please provide a nightly built or a manual with sufficient details...**
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-779770394
@yajiedesign 我用git clone --recursive https://github.com/apache/incubator-mxnet mxnet重新获取源码，或者用git submodule update --init --recursive重新获取第三方，都是有几个第三方（mkldnn、nvidia_cub、tvm）没有成功。clone成功的目录下面也只有.git文件。
git submodule update --init --recursive
Cloning into 'D:/study/mxnet/3rdparty/mkldnn'...
error: 1282 bytes of body are still expected
fetch-pack: unexpected disconnect while reading sideband packet
fatal: early EOF
fatal: index-pack failed
fatal: clone of 'https://github.com/oneapi-src/oneDNN.git' into submodule path 'D:/study/mxnet/3rdparty/mkldnn' failed
Failed to clone '3rdparty/mkldnn'. Retry scheduled
Cloning into 'D:/study/mxnet/3rdparty/nvidia_cub'...
error: 2461 bytes of body are still expected
fetch-pack: unexpected disconnect while reading sideband packet
fatal: early EOF
fatal: index-pack failed
fatal: clone of 'https://github.com/NVlabs/cub.git' into submodule path 'D:/study/mxnet/3rdparty/nvidia_cub' failed
Failed to clone '3rdparty/nvidia_cub'. Retry scheduled
Cloning into 'D:/study/mxnet/3rdparty/tvm'...
error: 865 bytes of body are still expected
fetch-pack: unexpected disconnect while reading sideband packet
fatal: early EOF
fatal: index-pack failed
fatal: clone of 'https://github.com/apache/incubator-tvm.git' into submodule path 'D:/study/mxnet/3rdparty/tvm' failed
Failed to clone '3rdparty/tvm'. Retry scheduled
Cloning into 'D:/study/mxnet/3rdparty/mkldnn'...
error: 355 bytes of body are still expected
fetch-pack: unexpected disconnect while reading sideband packet
fatal: early EOF
fatal: index-pack failed
fatal: clone of 'https://github.com/oneapi-src/oneDNN.git' into submodule path 'D:/study/mxnet/3rdparty/mkldnn' failed
Failed to clone '3rdparty/mkldnn' a second time, aborting
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] iDTer commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
iDTer commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-821818999
@liangyong928 请问 python OpWrapperGenerator.py libmxnet.dll 你会报错吗？因为我也看到你生成的libmxnet.dll也只有100多KB。
https://discuss.gluon.ai/t/topic/17636
在后面的 python setup.py install 和 python OpWrapperGenerator.py libmxnet.dll 过程中我都遇到了错误：
r = ListOP(byref(nOps), byref(opHandlers))
OSError: exception: access violation writing 0x0000000000000000
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 edited a comment on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 edited a comment on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-822114100
@iDTer 我觉得我编译的可能还是有些问题。比如，我觉得使用的MX450达不到7.5算力，但用了MXNET_CUDA_ARCH=7.5。我编译成功后，并没有真正使用过，可能只是引入包并看了一下版本号。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 edited a comment on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 edited a comment on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-780602905
我clone最新的OpenBLAS（不能用OpenBLAS 0.3.13 version源码编译，可能因为CPU的原因，会出错），按照 https://github.com/xianyi/OpenBLAS/wiki/How-to-use-OpenBLAS-in-Microsoft-Visual-Studio 1. Native (MSVC) ABI的步骤编译了OpenBLAS。
在安装了依赖后，运行cmake .. -G "Ninja" -DCMAKE_CXX_COMPILER=clang-cl -DCMAKE_C_COMPILER=clang-cl -DCMAKE_Fortran_COMPILER=flang -DBUILD_WITHOUT_LAPACK=no -DNOFORTRAN=0 -DDYNAMIC_ARCH=ON -DCMAKE_BUILD_TYPE=Release配置工程，运行cmake --build . --config Release编译，运行cmake --install . --prefix d:\opt -v 安装。发现d:\opt目录下的文件并不能满足mxnet的cmake Configure。
我从 https://github.com/xianyi/OpenBLAS/releases 下载 OpenBLAS-0.3.13-x64.zip ，将包内的include和lib目录都拷贝到我编译时创建的build目录，并且把环境变量OpenBLAS_HOME设为build目录。现在能用cmake-gui配置、生成mxnet的vs2019工程并编译。
开始编译的debug版本，编译到后面可能我的笔记本配置不够，vs2019没反应了。现在在编译release版本，目前还没出错，希望最后能编译成功。
前面的出错原因，可能用nvcc编译.cu文件时，-I包含的OpenBLAS头文件有问题，而不是CUDA的问题。
虽然现在能win10系统编译mxnet了，但我对OpenBLAS的编译和安装还是比较迷糊(并没通过编译OpenBLAS获得所需的文件，但用到了编译时的build目录)。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] Bumblebee269 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
Bumblebee269 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-784923642
Hi liangyong,
I have attached the a text file with the steps we took to compile successfully MXNET 1.8RC with MKL, CUDA and cpp package. Just in the hope that it might be of support for everybody struggling with it.
[steps_for_compiling_mxnet_v180RC3.txt](https://github.com/apache/incubator-mxnet/files/6034714/steps_for_compiling_mxnet_v180RC3.txt)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-780850001
@Bumblebee269 You can use Google Translate or youdao Translate，etc.
https://translate.google.cn/
http://fanyi.youdao.com/
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-780847484
@yajiedesign 编译成功了，谢谢。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] iDTer commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
iDTer commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-820200463
> > > @yajiedesign 编译成功了，谢谢。
> > > 
> >
> >
> > 老哥，能不能写一篇编译的博客记录一下，我还在踩坑，想学习一下
> > 上面有一个。Bumblebee269写的。https://github.com/apache/incubator-mxnet/files/6034714/steps_for_compiling_mxnet_v180RC3.txt
> > 我也写了一个 https://blog.csdn.net/eidolon_foot/article/details/113841354
THX!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] Bumblebee269 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
Bumblebee269 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-786473627
We used MKL instead of OpenBLAS
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] relaxli00 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
relaxli00 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-781444339
@Bumblebee269 @yajiedesign Yes, there is not an available clear official solution for general users for the Windows 10 GPU-CPP compilation after version 1.6.0. I read some discussions about the compilation file size limitation and tricks here and there.
To echo @Bumblebee269, can we have the nightly builds or detailed manuals for Windows 10 GPU-CPP for version 1.7.0 and its posts?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] yajiedesign edited a comment on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
yajiedesign edited a comment on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-780254794
早期版本的cmakelist文件在新版的cmake和nvcc中是有一些问题的.不要使用早期版本.然后windows下只能cmake编译.正常情况下无需修改cmake文件,cmakelist最初就是为了在windows下构建编写的.
你的问题主要是子项目无法正常拉取.
你可以用代理拉取主项目后.打开".gitmodules"文件,修改里面子项目的url为代理url.应该就能通过代理拉取子项目.然后注意部分子项目还有子项目.你要重复修改".gitmodules"直到所有项目拉取完毕.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-779158247
在win10系统，如何编译使用GPU的mxnet? 系统中安装了CUDA 10.1, 下载了最新的mxnet源码，安装了python、git、7zip、cmake、ninja、opencv. 把新的googletest源码拷贝到incubator-mxnet\3rdparty目录. 用cmake-gui生成vs2019工程失败.
In Win10 system, how to compile using GPU mxnet? The system installed CUDA 10.1, downloaded the latest mxnet source code, installed Python, git, 7zip, CMake, Ninja, OpenCV. Copy the new googletest source code into the incubator-mxnet\3rdparty directory. Failed to generate VS2019 project with cmake-gui.
cmake-gui generate result:
Selecting Windows SDK version 10.0.18362.0 to target Windows 10.0.19041. CMAKE_CROSSCOMPILING FALSE CMAKE_HOST_SYSTEM_PROCESSOR AMD64 CMAKE_SYSTEM_PROCESSOR AMD64 CMAKE_SYSTEM_NAME Windows CMake version '3.19.4' using generator 'Visual Studio 16 2019' CMake Warning at cmake/ChooseBlas.cmake:26 (find_package): By not providing "FindMKL.cmake" in CMAKE_MODULE_PATH this project has asked CMake to find a package configuration file provided by "MKL", but CMake did not find one.
Could not find a package configuration file provided by "MKL" with any of the following names:
MKLConfig.cmake
mkl-config.cmake
Add the installation prefix of "MKL" to CMAKE_PREFIX_PATH or set "MKL_DIR" to a directory containing one of the above files. If "MKL" provides a separate development package or SDK, be sure it has been installed. Call Stack (most recent call first): CMakeLists.txt:312 (include)
Found OpenBLAS libraries: D:/OpenBLAS/lib/libopenblas.dll.a Found OpenBLAS include: D:/OpenBLAS After choosing blas, linking to D:/OpenBLAS/lib/libopenblas.dll.a OpenCV ARCH: x64 OpenCV RUNTIME: vc15 OpenCV STATIC: OFF Found OpenCV 4.1.2 in C:/tools/opencv/build/x64/vc15/lib You might need to add C:\tools\opencv\build\x64\vc15\bin to your PATH to be able to run your applications. OpenCV 4.1.2 found (C:/tools/opencv/build/x64/vc15/lib) OpenCV_LIBS=opencv_core;opencv_highgui;opencv_imgproc;opencv_imgcodecs USE_LAPACK is ON CMake Warning at 3rdparty/googletest/googletest/CMakeLists.txt:54 (project): VERSION keyword not followed by a value or was followed by a value that expanded to nothing.
CMake Error at 3rdparty/googletest/googletest/CMakeLists.txt:129 (set_target_properties): set_target_properties called with incorrect number of arguments.
CMake Error at 3rdparty/googletest/googletest/CMakeLists.txt:131 (set_target_properties): set_target_properties called with incorrect number of arguments.
Could NOT find CUDNN (missing: CUDNN_LIBRARY CUDNN_INCLUDE) Could NOT find CUTENSOR (missing: CUTENSOR_LIBRARY CUTENSOR_INCLUDE) Autodetected CUDA architecture(s): 7.5 -- CUDA: Using the following NVCC architecture flags -gencode;arch=compute_75,code=sm_75 Using 64-bit integer for tensor size -- CUDA: Adding NVCC options: --fatbin-options --compress-all Google Test not found Configuring incomplete, errors occurred! See also "D:/study/bulid/CMakeFiles/CMakeOutput.log". See also "D:/study/bulid/CMakeFiles/CMakeError.log".
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] liangyong928 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
liangyong928 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-822955130
@iDTer 你是不是没有做https://mxnet.apache.org/get_started/build_from_source里的Installing MXNet Language Bindings？
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] Bumblebee269 commented on issue #19897: 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10?
Posted by GitBox <gi...@apache.org>.
Bumblebee269 commented on issue #19897:
URL: https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-784043807
Hi liangyong,
I am not sure if a translated correctly, we use MKL, not OPENBlas.
Today we managed to compile mxnet 1.8RC with CUDA 10.1 and MKL😊
Best regards, Fred
From: liangyong928 [mailto:notifications@github.com]
Sent: 23 February 2021 10:17
To: apache/incubator-mxnet
Cc: Fred Hugen | SeQso; Mention
Subject: Re: [apache/incubator-mxnet] 能否详细写一下最新的mxnet GPU如何在win10下编译?Can you write the latest MXNET GPU in detail how to compile under Win10? (#19897)
@yajiedesign<https://github.com/yajiedesign> 能否把OpenBLAS加入3rdparty中?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub<https://github.com/apache/incubator-mxnet/issues/19897#issuecomment-784026590>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AMOK76FBQKO2RKPFU26HLQLTANXCLANCNFSM4XUOUWMQ>.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org