You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2020/05/06 23:33:34 UTC
[GitHub] [incubator-mxnet] zhreshold opened a new issue #18253: Multiprocessing DataLoader crashes in NaiveEngine
zhreshold opened a new issue #18253:
URL: https://github.com/apache/incubator-mxnet/issues/18253
## Description
Running multiprocessing dataloader crashes in NaiveEngine mode.
### Error Message
(Paste the complete error message. Please also include stack trace by setting environment variable `DMLC_LOG_STACK_TRACE_DEPTH=10` before running your script.)
```
../mxnet/tests/python/unittest/test_gluon_data.py::test_multi_worker_forked_data_loader [1] 75858 abort MXNET_ENGINE_TYPE=NaiveEngine pytest -v
```
## To Reproduce
Run
```bash
MXNET_ENGINE_TYPE=NaiveEngine pytest -v <mxnet_root>/tests/python/unittests/test_gluon_data.py::test_multi_worker_forked_data_loader
```
### Steps to reproduce
(Paste the commands you ran that produced the error.)
1.
2.
## What have you tried to solve it?
1.
2.
## Environment
We recommend using our script for collecting the diagnositc information. Run the following command and paste the outputs below:
```
curl --retry 10 -s https://raw.githubusercontent.com/dmlc/gluon-nlp/master/tools/diagnose.py | python
----------Python Info----------
Version : 3.7.4
Compiler : Clang 10.0.1 (clang-1001.0.46.4)
Build : ('default', 'Sep 7 2019 18:27:02')
Arch : ('64bit', '')
------------Pip Info-----------
Version : 20.0.1
Directory : /usr/local/lib/python3.7/site-packages/pip
----------MXNet Info-----------
Version : 2.0.0
Directory : /Users/zhiz/Dev/mxnet/python/mxnet
Num GPUs : 0
Hashtag not found. Not installed from pre-built package.
----------System Info----------
Platform : Darwin-18.7.0-x86_64-i386-64bit
system : Darwin
node : 88e9fe562b5f.ant.amazon.com
release : 18.7.0
version : Darwin Kernel Version 18.7.0: Thu Jan 23 06:52:12 PST 2020; root:xnu-4903.278.25~1/RELEASE_X86_64
----------Hardware Info----------
machine : x86_64
processor : i386
b'machdep.cpu.brand_string: Intel(R) Core(TM) i7-7660U CPU @ 2.50GHz'
b'machdep.cpu.features: FPU VME DE PSE TSC MSR PAE MCE CX8 APIC SEP MTRR PGE MCA CMOV PAT PSE36 CLFSH DS ACPI MMX FXSR SSE SSE2 SS HTT TM PBE SSE3 PCLMULQDQ DTES64 MON DSCPL VMX SMX EST TM2 SSSE3 FMA CX16 TPR PDCM SSE4.1 SSE4.2 x2APIC MOVBE POPCNT AES PCID XSAVE OSXSAVE SEGLIM64 TSCTMR AVX1.0 RDRAND F16C'
b'machdep.cpu.leaf7_features: RDWRFSGS TSC_THREAD_OFFSET SGX BMI1 HLE AVX2 SMEP BMI2 ERMS INVPCID RTM FPU_CSDS MPX RDSEED ADX SMAP CLFSOPT IPT MDCLEAR TSXFA IBRS STIBP L1DF SSBD'
b'machdep.cpu.extfeatures: SYSCALL XD 1GBPAGE EM64T LAHF LZCNT PREFETCHW RDTSCP TSCI'
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org