[GitHub] szha commented on issue #14046: Bucketing module after Hybridize ?

[GitBox <gi...@apache.org>]

szha commented on issue #14046: Bucketing module after Hybridize ?
URL: https://github.com/apache/incubator-mxnet/issues/14046#issuecomment-465797940
 
 
   Gluon's hybridize for HybridBlock is backed by CachedOp, a special type of operator that caches the computation graph. It has internal buffers for data and metadata such as shape and type, and is intelligent enough to reallocate bigger buffer if requested space is larger than the previously allocated space. If the model can be expressed in hybridized gluon model, then the space is managed by the cached op.
   
   On the other hand, regular Block can be partially hybridized, which has the effect of recursively hybridizing all HybridBlock children. In this case, the memory in HybridBlock children is handled by CachedOp, and the rest runs in imperative mode.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services