[GitHub] [incubator-mxnet] szhengac commented on issue #18077: Parameter fusion support in Gluon

[GitBox <gi...@apache.org>]

szhengac commented on issue #18077: Parameter fusion support in Gluon
URL: https://github.com/apache/incubator-mxnet/issues/18077#issuecomment-616068055
 
 
   That’s not needed for either lamb or Lars. At the moment, the new api
   allows one step function to get all the parameters so that global
   information can be obtained. It is only needed in other optimizers such as
   lbfgs. The fused parameter can help reduce the number of api calls and
   potentially accelerate the computation. But it is not urgent now as we
   haven’t implemented lbfgs like method.
   
   On Sat, 18 Apr 2020 at 22:44, Leonard Lausen <no...@github.com>
   wrote:
   
   > Cases that need to expose the unfused parameter to the optimizer wouldn't
   > be supported based on the proposed Gluon fusion API and would require more
   > extensive changes to the backend to support views on the fused array. If
   > that's required, we can reconsider the plan. The fused parameter can be of
   > any shape though, which should facilitate reduction ops etc
   >
   > —
   > You are receiving this because you were mentioned.
   > Reply to this email directly, view it on GitHub
   > <https://github.com/apache/incubator-mxnet/issues/18077#issuecomment-616042128>,
   > or unsubscribe
   > <https://github.com/notifications/unsubscribe-auth/AA6GZVDGAY2EZHVS4VQFDITRNKFTRANCNFSM4MI6WY2Q>
   > .
   >
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services