[GitHub] squidszyd opened a new issue #10834: Share Numpy Arrays between processes like NDArrays?

[GitBox <gi...@apache.org>]

squidszyd opened a new issue #10834: Share Numpy Arrays between processes like NDArrays?
URL: https://github.com/apache/incubator-mxnet/issues/10834
 
 
   (This thread is actually irrelevant to MXNet, but nowhere could I find better than here)
   I'm working on a multi-processing system in which I want to transfer Numpy arrays between processes. However, this introduces lags of pickling and unpickling arrays. I've just found [this code](https://github.com/apache/incubator-mxnet/blob/master/python/mxnet/gluon/data/dataloader.py) in Gluon in which the pickling and unpickling of NDArray are overrided with the support of cpu shared memory. I'm curious about whether there is an Numpy Array version of this code? 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services