[GitHub] [incubator-mxnet] fhieber commented on issue #14563: Performance decrease with pypi's mxnet==1.4.0 (Mac)

[GitBox <gi...@apache.org>]

fhieber commented on issue #14563: Performance decrease with pypi's mxnet==1.4.0 (Mac)
URL: https://github.com/apache/incubator-mxnet/issues/14563#issuecomment-478316364
 
 
   @apeforest thanks for investigating! I cannot provide a small script at the moment that reproduces the issue, I just observed the speed difference running various system tests with Sockeye. If you want to run them for yourself you can do the following:
   
   ```bash
   git clone https://github.com/awslabs/sockeye.git
   cd sockeye
   pip install -r requirements/requirements.dev.txt
   pip install -r requirements/requirements.txt
   pytest test/system -k "Sort:transformer:transformer"
   ```
   The speed difference will be visible directly from the first log messages of the form `Speed: 1004.51 samples/sec 10366.54 tokens/sec 62.78 updates/sec`.
   
   The difference in performance with 1.3.1 and 1.4.0 is visible for system tests with different architectures implemented in Sockeye (rnn/lstm, transformer, cnns).
   All of these implementations use a `transpose()` operator somewhere, if that helps.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services