[GitHub] [incubator-mxnet] Mauhing edited a comment on issue #13484: flaky test test_gluon_data.test_recordimage_dataset_with_data_loader_multiworker

[GitBox <gi...@apache.org>]

Mauhing edited a comment on issue #13484:
URL: https://github.com/apache/incubator-mxnet/issues/13484#issuecomment-644560102


   It may be a shared memory problem. Check shm used by using `df -h` and find shm. If it is 100%, then your multiprocess worker will just stall.
   
   If you use docker.
   The default is 64m, This is not enough for dataloader. Use --shm 1024m to lauch docker, so docker run --shm 1024m <bla bla bla>
   
   why?
   gluon.data.DataLoader uses python multiprocess, multiprocess need shared memory. The default shared memory is 64m in docker container. You can check the shm usage by using df -h and find shm.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org