[GitHub] JohnLee168 opened a new issue #14260: c/c++ multiple threads inference problem

[GitBox <gi...@apache.org>]

JohnLee168 opened a new issue #14260: c/c++ multiple threads inference problem
URL: https://github.com/apache/incubator-mxnet/issues/14260
 
 
   Hi, I have a question for multiple threads inference in c/c++.
   The server uses 10 threads to handle request images from clients, and create 20 PredictorHandles(a PredictorHandle pool) to inference. 
   When server recv one image in a thread, server chooses an available PredictorHandle(not in use) from the PredictorHandle pool to inference. Each PredictorHandle is only used in one thread, but one thread can choose different  PredictorHandle from the pool. Is this situation thread-safe? 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services