[GitHub] zackchase opened a new issue #9571: ACCURACY IS USING NUMPY, URGENT FIX

[GitBox <gi...@apache.org>]

zackchase opened a new issue #9571: ACCURACY IS USING NUMPY, URGENT FIX
URL: https://github.com/apache/incubator-mxnet/issues/9571
 
 
   Accuracy is the bottleneck for even a 4000 node neural network. This is a practical job that many people will run and which a GPU ***CAN accelerate***.
   
   But right now the accuracy metric is the bottleneck. That's because it converts everything to numpy, causing a blocking operation at every iteration. Let's fix it stat.
   
     
   ```
   for label, pred_label in zip(labels, preds):
               if pred_label.shape != label.shape:
                   pred_label = ndarray.argmax(pred_label, axis=self.axis)
               pred_label = pred_label.asnumpy().astype('int32')
               label = label.asnumpy().astype('int32')
   
               check_label_shapes(label, pred_label)
   
               self.sum_metric += (pred_label.flat == label.flat).sum()
               self.num_inst += len(pred_label.flat)
   ```
   
   Note: Providing complete information in the most concise form is the best way to get help. This issue template serves as the checklist for essential information to most of the technical issues and bug reports. For non-technical issues and feature requests, feel free to present the information in what you believe is the best form.
   
   For Q & A and discussion, please start a discussion thread at https://discuss.mxnet.io 
   
   ## Description
   (Brief description of the problem in no more than 2 sentences.)
   
   ## Environment info (Required)
   
   ```
   What to do:
   1. Download the diagnosis script from https://raw.githubusercontent.com/apache/incubator-mxnet/master/tools/diagnose.py
   2. Run the script using `python diagnose.py` and paste its output here.
   
   ```
   
   Package used (Python/R/Scala/Julia):
   (I'm using ...)
   
   For Scala user, please provide:
   1. Java version: (`java -version`)
   2. Maven version: (`mvn -version`)
   3. Scala runtime if applicable: (`scala -version`)
   
   For R user, please provide R `sessionInfo()`:
   
   ## Build info (Required if built from source)
   
   Compiler (gcc/clang/mingw/visual studio):
   
   MXNet commit hash:
   (Paste the output of `git rev-parse HEAD` here.)
   
   Build config:
   (Paste the content of config.mk, or the build command.)
   
   ## Error Message:
   (Paste the complete error message, including stack trace.)
   
   ## Minimum reproducible example
   (If you are using your own code, please provide a short script that reproduces the error. Otherwise, please provide link to the existing example.)
   
   ## Steps to reproduce
   (Paste the commands you ran that produced the error.)
   
   1.
   2.
   
   ## What have you tried to solve it?
   
   1.
   2.
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services