You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@mxnet.apache.org by GitBox <gi...@apache.org> on 2020/10/02 10:49:36 UTC
[GitHub] [incubator-mxnet] moseswmwong opened a new issue #19279: Gluon-cv cannot down model file with model_zoo.get_model
moseswmwong opened a new issue #19279:
URL: https://github.com/apache/incubator-mxnet/issues/19279
## Description
On MacOS, my python code is:
import mxnet
import glouoncv as gcv
...
net = gcv.model_zoo.get_model('ssd_512_mobilenet1.0_voc', pretrained=True, root='.')
...
The problem is when I run it download fail, it get stuck at the following, never have any further progress for a long time:
```Model file not found. Downloading.
Downloading ./ssd_512_mobilenet1.0_voc-37c18076.zip from https://apache-mxnet.s3-accelerate.dualstack.amazonaws.com/gluon/models/ssd_512_mobilenet1.0_voc-37c18076.zip...```
I tried to pre-load the file ssd_512_mobilenet1.0_voc-37c18076.zip into the download folder (which is "." as specifiy in get_model method), and it still stuck.
When I look into the folder, two files exist, the *.zip and *.lock :
```...
-rw-r--r-- 1 moseswong staff 0 Oct 2 12:22 ssd_512_mobilenet1.0_voc-37c18076.lock
-rw-r--r--@ 1 moseswong staff 51421665 Oct 2 12:32 ssd_512_mobilenet1.0_voc-37c18076.zip
...```
I tried many times and found that not only it get stuck when there is no model file, it get stuck even when the model file exist.
### Error Message
```Model file not found. Downloading.
Downloading ./ssd_512_mobilenet1.0_voc-37c18076.zip from https://apache-mxnet.s3-accelerate.dualstack.amazonaws.com/gluon/models/ssd_512_mobilenet1.0_voc-37c18076.zip...```
## To Reproduce
see above
### Steps to reproduce
1. On MacBook Pro - MacOS 10.15.3 - i7 intel cpu, 16G memory
2. Install Anaconda 3 - v1.9.12
3. Open terminal
4. conda config --add channels conda-forge
5. conda create -n mx4 -q -y python=3.6
6. conda activate mx4
7. conda install -n mx4 -q -y conda-forge::py-opencv==4.4.0
8. pip install mxnet==1.6.0
9. pip install gluoncv==0.8.0
run python script
import sys
import mxnet as mx
import gluoncv as gcv
import cv2
net = gcv.model_yoo.get_model('ssd_512_mobilenet1.0_voc', pretrained=True, root='.')
net = hybridize()
...
## What have you tried to solve it?
1. Add "root=" to the get_model() method to specific local folder as destination instead of the .mxnet folder at root of current user
2. Download the model zip file to target folder, but still stuck on downloading.
## Environment
We recommend using our script for collecting the diagnositc information. Run the following command and paste the outputs below:
```
curl --retry 10 -s https://raw.githubusercontent.com/apache/incubator-mxnet/master/tools/diagnose.py | python
# paste outputs here
(mx4) Mosess-MacBook-Pro:~ moseswong$ curl --retry 10 -s https://raw.githubusercontent.com/apache/incubator-mxnet/master/tools/diagnose.py | python
----------Python Info----------
Version : 3.6.11
Compiler : GCC Clang 10.0.1
Build : ('default', 'Aug 5 2020 20:19:23')
Arch : ('64bit', '')
------------Pip Info-----------
Version : 20.2.3
Directory : /Users/moseswong/opt/anaconda3/envs/mx4/lib/python3.6/site-packages/pip
----------MXNet Info-----------
Version : 1.6.0
Directory : /Users/moseswong/opt/anaconda3/envs/mx4/lib/python3.6/site-packages/mxnet
Commit Hash : 6eec9da55c5096079355d1f1a5fa58dcf35d6752
Library : ['/Users/moseswong/opt/anaconda3/envs/mx4/lib/python3.6/site-packages/mxnet/libmxnet.so']
Build features:
✖ CUDA
✖ CUDNN
✖ NCCL
✖ CUDA_RTC
✖ TENSORRT
✔ CPU_SSE
✔ CPU_SSE2
✔ CPU_SSE3
✔ CPU_SSE4_1
✔ CPU_SSE4_2
✖ CPU_SSE4A
✔ CPU_AVX
✖ CPU_AVX2
✖ OPENMP
✖ SSE
✔ F16C
✖ JEMALLOC
✖ BLAS_OPEN
✖ BLAS_ATLAS
✖ BLAS_MKL
✔ BLAS_APPLE
✔ LAPACK
✖ MKLDNN
✔ OPENCV
✖ CAFFE
✖ PROFILER
✔ DIST_KVSTORE
✖ CXX14
✖ INT64_TENSOR_SIZE
✔ SIGNAL_HANDLER
✖ DEBUG
✖ TVM_OP
----------System Info----------
Platform : Darwin-19.3.0-x86_64-i386-64bit
system : Darwin
node : Mosess-MacBook-Pro.local
release : 19.3.0
version : Darwin Kernel Version 19.3.0: Thu Jan 9 20:58:23 PST 2020; root:xnu-6153.81.5~1/RELEASE_X86_64
----------Hardware Info----------
machine : x86_64
processor : i386
b'machdep.cpu.brand_string: Intel(R) Core(TM) i7-5557U CPU @ 3.10GHz'
b'machdep.cpu.features: FPU VME DE PSE TSC MSR PAE MCE CX8 APIC SEP MTRR PGE MCA CMOV PAT PSE36 CLFSH DS ACPI MMX FXSR SSE SSE2 SS HTT TM PBE SSE3 PCLMULQDQ DTES64 MON DSCPL VMX EST TM2 SSSE3 FMA CX16 TPR PDCM SSE4.1 SSE4.2 x2APIC MOVBE POPCNT AES PCID XSAVE OSXSAVE SEGLIM64 TSCTMR AVX1.0 RDRAND F16C'
b'machdep.cpu.leaf7_features: RDWRFSGS TSC_THREAD_OFFSET BMI1 AVX2 SMEP BMI2 ERMS INVPCID FPU_CSDS RDSEED ADX SMAP IPT MDCLEAR IBRS STIBP L1DF SSBD'
b'machdep.cpu.extfeatures: SYSCALL XD 1GBPAGE EM64T LAHF LZCNT PREFETCHW RDTSCP TSCI'
----------Network Test----------
Setting timeout: 10
Timing for MXNet: https://github.com/apache/incubator-mxnet, DNS: 0.0013 sec, LOAD: 0.6192 sec.
Timing for Gluon Tutorial(en): http://gluon.mxnet.io, DNS: 0.0008 sec, LOAD: 160.7595 sec.
Error open Gluon Tutorial(cn): https://zh.gluon.ai, <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:852)>, DNS finished in 0.08813118934631348 sec.
Timing for FashionMNIST: https://apache-mxnet.s3-accelerate.dualstack.amazonaws.com/gluon/dataset/fashion-mnist/train-labels-idx1-ubyte.gz, DNS: 0.0249 sec, LOAD: 80.8874 sec.
Timing for PYPI: https://pypi.python.org/pypi/pip, DNS: 0.0247 sec, LOAD: 130.8603 sec.
Error open Conda: https://repo.continuum.io/pkgs/free/, HTTP Error 403: Forbidden, DNS finished in 0.024617910385131836 sec.
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] moseswmwong commented on issue #19279: Gluon-cv cannot download model file with model_zoo.get_model
Posted by GitBox <gi...@apache.org>.
moseswmwong commented on issue #19279:
URL: https://github.com/apache/incubator-mxnet/issues/19279#issuecomment-703133978
UPDATE: I switched network for my MacBook Pro from the problem network to another network (3G smartphone share from my iPhone) and the model downloaded instantly! Furthermore, after that, I switch back to the originally problematic network and there is no problem with the download the model file also download instantly via this previously problematic network.
I am not close the case. As it means somewhere get stuck, OS? Cloud?
If first time deployment of Mxnet code on MacOS using gcv.model_zoo.get_mode() stuck on its first attempt without applying this workaround which is not realistic in production environment. Then the first time installation of a new Python script to a MacOS will always fail. As we are working to deploy the code as new product to customer locations, this means MacOS installation a total failure if we depend on download approach.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] moseswmwong edited a comment on issue #19279: Gluon-cv cannot download model file with model_zoo.get_model
Posted by GitBox <gi...@apache.org>.
moseswmwong edited a comment on issue #19279:
URL: https://github.com/apache/incubator-mxnet/issues/19279#issuecomment-703133978
UPDATE: I switched network for my MacBook Pro from the problem network to another network (4G smartphone share from my iPhone) and the model downloaded instantly! Furthermore, after that, I switch back to the originally problematic network and there is no problem with the download the model file also download instantly via this previously problematic network.
I am not close the case. As it means somewhere get stuck, OS? Cloud?
Since first time deployment of Mxnet code on MacOS using gcv.model_zoo.get_model() stuck on its first attempt without applying this workaround which is not realistic in production environment. Then the first time installation of a new Python script to a MacOS will always fail. As we are working to deploy the code as new product to customer locations, this means MacOS installation a total failure if we depend on download approach.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] moseswmwong edited a comment on issue #19279: Gluon-cv cannot download model file with model_zoo.get_model
Posted by GitBox <gi...@apache.org>.
moseswmwong edited a comment on issue #19279:
URL: https://github.com/apache/incubator-mxnet/issues/19279#issuecomment-703133978
UPDATE: I switched network for my MacBook Pro from the problem network to another network (4G smartphone share from my iPhone) and the model downloaded instantly! Furthermore, after that, I switch back to the originally problematic network and there is no problem with the download the model file also download instantly via this previously problematic network.
I am not close the case. As it means somewhere get stuck, OS? Cloud?
Since first time deployment of Mxnet code on MacOS using gcv.model_zoo.get_model() stuck on its first attempt, then the first time installation of a new Python script to a MacOS will always fail. As we are working to deploy the code as new product to customer locations, this means MacOS installation a total failure if we depend on download approach.
Note, asking customers to switch to alternate network and return to the original is not a acceptable workaround for naïve end users.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] moseswmwong edited a comment on issue #19279: Gluon-cv cannot download model file with model_zoo.get_model
Posted by GitBox <gi...@apache.org>.
moseswmwong edited a comment on issue #19279:
URL: https://github.com/apache/incubator-mxnet/issues/19279#issuecomment-703133978
UPDATE: I switched network for my MacBook Pro from the problem network to another network (4G smartphone share from my iPhone) and the model downloaded instantly! Furthermore, after that, I switch back to the originally problematic network and there is no problem with the download the model file also download instantly via this previously problematic network.
I am not close the case. As it means somewhere get stuck, OS? Cloud?
As a matter of fact, first time deployment of Mxnet code on MacOS using gcv.model_zoo.get_model() stuck on its first attempt, then the first time installation of a new Python script to a MacOS will always fail. As we are working to deploy the code as new product to customer locations, this means MacOS installation a total failure if we depend on download approach.
Note, asking customers to switch to alternate network and return to the original is not a acceptable workaround for naïve end users.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] moseswmwong edited a comment on issue #19279: Gluon-cv cannot download model file with model_zoo.get_model
Posted by GitBox <gi...@apache.org>.
moseswmwong edited a comment on issue #19279:
URL: https://github.com/apache/incubator-mxnet/issues/19279#issuecomment-703133978
UPDATE: I switched network for my MacBook Pro from the problem network to another network (4G smartphone share from my iPhone) and the model downloaded instantly! Furthermore, after that, I switch back to the originally problematic network and there is no problem with the download the model file also download instantly via this previously problematic network.
I am not close the case. As it means somewhere get stuck, OS? Cloud?
As a matter of fact, first time deployment of Mxnet code on MacOS using gcv.model_zoo.get_model() stuck on its first installation attempt, then it means the installation by end user will always fail. As we are working to deploy the code as new product to customer locations, this means MacOS installation a total failure if we depend on download approach. Note, asking customers to switch to alternate network and return to the original is not a acceptable workaround for naïve end users.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] moseswmwong edited a comment on issue #19279: Gluon-cv cannot download model file with model_zoo.get_model
Posted by GitBox <gi...@apache.org>.
moseswmwong edited a comment on issue #19279:
URL: https://github.com/apache/incubator-mxnet/issues/19279#issuecomment-703133978
UPDATE: I switched network for my MacBook Pro from the problem network to another network (4G smartphone share from my iPhone) and the model downloaded instantly! Furthermore, after that, I switch back to the originally problematic network and there is no problem with the download the model file also download instantly via this previously problematic network.
I am not close the case. As it means somewhere get stuck, OS? Cloud?
If first time deployment of Mxnet code on MacOS using gcv.model_zoo.get_model() stuck on its first attempt without applying this workaround which is not realistic in production environment. Then the first time installation of a new Python script to a MacOS will always fail. As we are working to deploy the code as new product to customer locations, this means MacOS installation a total failure if we depend on download approach.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] moseswmwong edited a comment on issue #19279: Gluon-cv cannot download model file with model_zoo.get_model
Posted by GitBox <gi...@apache.org>.
moseswmwong edited a comment on issue #19279:
URL: https://github.com/apache/incubator-mxnet/issues/19279#issuecomment-703133978
UPDATE: I switched network for my MacBook Pro from the problem network to another network (3G smartphone share from my iPhone) and the model downloaded instantly! Furthermore, after that, I switch back to the originally problematic network and there is no problem with the download the model file also download instantly via this previously problematic network.
I am not close the case. As it means somewhere get stuck, OS? Cloud?
If first time deployment of Mxnet code on MacOS using gcv.model_zoo.get_model() stuck on its first attempt without applying this workaround which is not realistic in production environment. Then the first time installation of a new Python script to a MacOS will always fail. As we are working to deploy the code as new product to customer locations, this means MacOS installation a total failure if we depend on download approach.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] moseswmwong commented on issue #19279: Add progress bar to Gluon download function (was: Gluon-cv cannot download model file with model_zoo.get_model)
Posted by GitBox <gi...@apache.org>.
moseswmwong commented on issue #19279:
URL: https://github.com/apache/incubator-mxnet/issues/19279#issuecomment-703258322
I believe this will solve the problem, thanks so much!
Please keep us posted when the new version is available.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] szha commented on issue #19279: Gluon-cv cannot download model file with model_zoo.get_model
Posted by GitBox <gi...@apache.org>.
szha commented on issue #19279:
URL: https://github.com/apache/incubator-mxnet/issues/19279#issuecomment-703164381
It looks like there are two issues:
- because there's no prompt/progress bar, the downloading on slow network appear to be hanging. I think we can address this by adding a progress bar to the download function here:
https://github.com/apache/incubator-mxnet/blob/e297471c45a185d152cad1668dbb62e277fe6d62/python/mxnet/gluon/utils.py#L330
we should only try to import tqdm without requiring it so that we don't make tqdm a required dependency.
- GluonCV should have a checksum for the archive file and check before unzipping it to report incomplete download. (cc @zhreshold)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org