[GitHub] eric-haibin-lin commented on issue #3946: When predicting, does mxnet provide thread-safe interface?

[GitBox <gi...@apache.org>]

eric-haibin-lin commented on issue #3946: When predicting, does mxnet provide thread-safe interface?
URL: https://github.com/apache/incubator-mxnet/issues/3946#issuecomment-359136799
 
 
   > Can mxnet find two independent ops in a computation graph and execute them parallelly on two cores of one CPU, respectively? 
   
   If a graph has two parallel paths, MXNet can detect that and execute it if it has enough WORKER_THREADS. https://github.com/apache/incubator-mxnet/blob/master/docs/faq/env_var.md#set-the-number-of-threads
    
   
   > Or if mxnet can konw how much cores are there, and give first half to the first operator and give the second half to the second operator.
   
   For CPU we rely on openmp for parallelization. We may give a hint to openmp but there's no guarantee on how many threads are actually executing for a single operator.  @cjolivier01 works on CPU performance tuner and maybe has more comments on this

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services