You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2019/04/23 00:38:56 UTC

[GitHub] [incubator-mxnet] anirudh2290 commented on issue #14760: upcasting accumulation type in norm increases loss/Perplexity

anirudh2290 commented on issue #14760: upcasting accumulation type in norm increases loss/Perplexity 
URL: https://github.com/apache/incubator-mxnet/issues/14760#issuecomment-485599779
 
 
   Can we avoid adding another env variable ? We can accumulate only when dtype is set otherwise use the default behavior before this change was added. Also I understand FP16 inputs with accumulation in FP32 for softmax but does this also apply to FP32 inputs with accumulation in FP64. Will there be no accuracy loss ?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services