[GitHub] [incubator-mxnet] leezu commented on issue #18077: Parameter fusion support in Gluon

[GitBox <gi...@apache.org>]

leezu commented on issue #18077: Parameter fusion support in Gluon
URL: https://github.com/apache/incubator-mxnet/issues/18077#issuecomment-616013055
 
 
   > What about optimizer? Would optimizers see fused or unfused params?
   
   Optimizer would see only fused parameters. In general, you can consider all existing parameters as "fused". Unfused parameters are a new "type" of parameters that are not returned by `collect_params()` and we ensure in the Python frontend that users implement `fuse_parameters`, `unfuse_parameters` functions to implement whatever logic is needed to combine the set of unfused parameters into a set of fused parameters. Both fused and unfused parameters need to be declared inside `__init__`.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services