[GitHub] [incubator-mxnet] liuzhi136 opened a new issue #16665: MapPlanKernel ErrStr:an illegal memory access was encountered

[GitBox <gi...@apache.org>]

liuzhi136 opened a new issue #16665: MapPlanKernel ErrStr:an illegal memory access was encountered
URL: https://github.com/apache/incubator-mxnet/issues/16665
 
 
   I got the same problem with https://github.com/apache/incubator-mxnet/issues/11914, when I trying to do the NMT task on my own model.
   
   Traceback (most recent call last):
     File "train.py", line 413, in <module>
       train(dataloader, bertbase, data_dev, model, args.batch_size, ctx, store)
     File "train.py", line 258, in train
       L_dec_metric.update(labels=splitted_target_ids, preds=preds, masks=masks)
     File "/home/user/anaconda3/lib/python3.6/site-packages/gluonnlp/metric/masked_accuracy.py", line 267, in update
       num_correct = ((pred_label == label) * mask).sum().asscalar()
     File "/home/user/anaconda3/lib/python3.6/site-packages/mxnet/ndarray/ndarray.py", line 2014, in asscalar
       return self.asnumpy()[0]
     File "/home/user/anaconda3/lib/python3.6/site-packages/mxnet/ndarray/ndarray.py", line 1996, in asnumpy
       ctypes.c_size_t(data.size)))
     File "/home/user/anaconda3/lib/python3.6/site-packages/mxnet/base.py", line 253, in check_call
       raise MXNetError(py_str(_LIB.MXGetLastError()))
   mxnet.base.MXNetError: [05:14:48] /home/travis/build/dmlc/mxnet-distro/mxnet-build/3rdparty/mshadow/mshadow/././././cuda/tensor_gpu-inl.cuh:110: Check failed: err == cudaSuccess (77 vs. 0) : Name: MapPlanKernel ErrStr:an illegal memory access was encountered
   
   The environment I used are:
   MXNet 1.5.1
   cuda 9.0
   ubuntu 14.04
   
   I don't find any solution for this error. Does any could help me to find out how to figure out this?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services