[GitHub] [incubator-mxnet] mk-61 commented on issue #19019: AMP not reusing weights on recursive networks

[GitBox <gi...@apache.org>]

mk-61 commented on issue #19019:
URL: https://github.com/apache/incubator-mxnet/issues/19019#issuecomment-767046575


   Not much to report here. The initially proposed general solution was to cache results of amp_casts. The problem with this is to identify right keys for this cache - it doesn't appear to be possible in all cases.
   Another option - since it's RNN-specific problem, may be we can work it around in RNN block itself, somehow?
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org