You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2018/12/08 08:04:56 UTC

[GitHub] anirudhacharya opened a new issue #13585: Exponential Moving Average/Polyak Averaging in MXNet

anirudhacharya opened a new issue #13585: Exponential Moving Average/Polyak Averaging in MXNet
URL: https://github.com/apache/incubator-mxnet/issues/13585
 
 
   How can I implement Polyak averaging of as part of my network, in the wavenet model - https://arxiv.org/abs/1711.10433
   
   I am not sure it can be implemented as an optimizer, it is more like a post-processing step on the weights after the optimizer update.
   
   Tensorflow has it here - https://www.tensorflow.org/api_docs/python/tf/train/ExponentialMovingAverage 
   
   @ThomasDelteil 
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services