You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2019/05/02 21:55:09 UTC

[GitHub] [incubator-mxnet] araitats opened a new issue #14864: [MXNet] - [BERT]

araitats opened a new issue #14864: [MXNet] - [BERT]
URL: https://github.com/apache/incubator-mxnet/issues/14864
 
 
   https://github.com/dmlc/gluon-nlp/issues/690
   ## Description
   There is a problem with a custom BERT model training with the later version of MXNet 1.5.0 (observed with cu90).
   mlm_loss stops around 7.3 and nsp_acc stopps around 54.
   mxnet-cu90 version which is older than 1.5.0b20190425 does not have this issue. 
   1.5.0b20190426 onward has this issue. 
   
   ## Environment info (Required)
   Amazon SageMaker Notebook (ml.p3.16xlarge)
   CUDA version: 9.0
   
   Package used (Python/R/Scala/Julia):
   Python 3.6
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services