[GitHub] cgraywang commented on issue #9543: RNN Op Changes (was: Variable Length Support for cuDNN RNN)

[GitBox <gi...@apache.org>]

cgraywang commented on issue #9543: RNN Op Changes (was: Variable Length Support for cuDNN RNN)
URL: https://github.com/apache/incubator-mxnet/issues/9543#issuecomment-419598199
 
 
   @DickJC123 @ptrendx I think the new features are very useful, since we are working on large scale NLP models, where most of the models are based on RNN cells. For example, we need cell state clipping and projection clipping to make the models overcome the possible overfitting. Similarly, it would be very helpful if we can have projection in the RNN cell, in that way, we can improve the memory size to significantly improve the model capacity. So, looking forward to the new features in cuDNN v7.2 to be in MXNet.
   
   @pengzhao-intel Also looking forward to CPU support! Thanks. 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services