[GitHub] [incubator-mxnet] tqchen commented on issue #15465: [RFC] Integrate TVM into Apache MXNet

[GitBox <gi...@apache.org>]

tqchen commented on issue #15465: [RFC] Integrate TVM into Apache MXNet
URL: https://github.com/apache/incubator-mxnet/issues/15465#issuecomment-509712700
 
 
   Re: Threadpool
   
   Technically it is easy to drop in openmp as a threadpool backend of TVM. It is just not the default one. Historically tvm defaulted to openmp then evolved its own version of thread pool for better perf. The current thread pool already has accepts the OMP env variable, making it consistent with the omp settings.
   
   Most of the operators touched so far are single threaded so won’t be affected by the discussion.
   
   Given the current discussion, we could have the runtime in Mxnet default to omp if we see it is necessary, for end to end inference on Embedded devices like android, I would still recommend to use tvm’s Threadpool 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services