[GitHub] sergeykolychev edited a comment on issue #11420: Shared Embedding layer with different input lengths and same vocabulary size

[GitBox <gi...@apache.org>]

sergeykolychev edited a comment on issue #11420: Shared Embedding layer with different input lengths and same vocabulary size
URL: https://github.com/apache/incubator-mxnet/issues/11420#issuecomment-400718202
 
 
   I think your approach with shared weight will work.
   
   I use https://mxnet.incubator.apache.org/faq/bucketing.html for similar case.
   
   In essence under the Bucketing module you can create multiple modules for with different input size and the same network graph, these modules share parameters of the module with longest input size that is created first.
   
   If it's too heavy for you, you can always read the code behind this idea and extract just working bits.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services