You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2022/06/14 15:19:14 UTC

[GitHub] [incubator-mxnet] bgawrych opened a new pull request, #21065: Fix oneDNN RNN weights reorder

bgawrych opened a new pull request, #21065:
URL: https://github.com/apache/incubator-mxnet/pull/21065

   ## Description ##
   Fix for: https://github.com/apache/incubator-mxnet/issues/21061
   
   Assert was triggered on machines with VNNI support. Root cause of this was not implemented reorder primitive between format_tag::ldgoi to brgemm weights, 
   
   Also added parallelization to loop for Adjusting GRU gates from MXNet format to oneDNN format
   
   ![image](https://user-images.githubusercontent.com/59644968/173613911-9e1e1525-84c5-47fb-af84-18f91c04d818.png)
   
   Benchmark script:
   ```
   import mxnet as mx
   import time
   from itertools import product
   
   input_sizes = [8, 32, 64]
   hidden_sizes = [64, 128, 512]
   num_layers = [1, 2, 3, 4]
   bidirectional = [True, False]
   for hidden_size, num_layers, bidirected in product(hidden_sizes, num_layers, bidirectional):
       net = mx.gluon.rnn.GRU(hidden_size, num_layers=num_layers, bidirectional=bidirected)
       net.initialize()
       in_data = mx.nd.random.uniform(-1, 1, shape=(128, 1, hidden_size))
       tic = time.time()
       for i in range(10):
           o = net(in_data)
           o.wait_to_read()
       print(f"({hidden_size},{num_layers},{bidirected});", time.time() - tic)
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@mxnet.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-mxnet] bgawrych merged pull request #21065: Fix oneDNN RNN weights reorder

Posted by GitBox <gi...@apache.org>.
bgawrych merged PR #21065:
URL: https://github.com/apache/incubator-mxnet/pull/21065


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@mxnet.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-mxnet] mxnet-bot commented on pull request #21065: Fix oneDNN RNN weights reorder

Posted by GitBox <gi...@apache.org>.
mxnet-bot commented on PR #21065:
URL: https://github.com/apache/incubator-mxnet/pull/21065#issuecomment-1160004825

   Jenkins CI successfully triggered : [unix-cpu, unix-gpu]


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@mxnet.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-mxnet] mxnet-bot commented on pull request #21065: Fix oneDNN RNN weights reorder

Posted by GitBox <gi...@apache.org>.
mxnet-bot commented on PR #21065:
URL: https://github.com/apache/incubator-mxnet/pull/21065#issuecomment-1155343736

   Hey @bgawrych , Thanks for submitting the PR 
   All tests are already queued to run once. If tests fail, you can trigger one or more tests again with the following commands: 
   - To trigger all jobs: @mxnet-bot run ci [all] 
   - To trigger specific jobs: @mxnet-bot run ci [job1, job2] 
   *** 
   **CI supported jobs**: [clang, unix-cpu, edge, website, miscellaneous, windows-gpu, centos-cpu, unix-gpu, centos-gpu, sanity, windows-cpu]
   *** 
   _Note_: 
    Only following 3 categories can trigger CI :PR Author, MXNet Committer, Jenkins Admin. 
   All CI tests must pass before the PR can be merged. 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@mxnet.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-mxnet] bgawrych commented on pull request #21065: Fix oneDNN RNN weights reorder

Posted by GitBox <gi...@apache.org>.
bgawrych commented on PR #21065:
URL: https://github.com/apache/incubator-mxnet/pull/21065#issuecomment-1160004782

   @mxnet-bot run ci [unix-cpu, unix-gpu]


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@mxnet.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-mxnet] bartekkuncer commented on pull request #21065: Fix oneDNN RNN weights reorder

Posted by GitBox <gi...@apache.org>.
bartekkuncer commented on PR #21065:
URL: https://github.com/apache/incubator-mxnet/pull/21065#issuecomment-1161316007

   For the benchmarking would be nice to see the actual results because just the difference in some time unit does not say much.
   Apart from that LGTM.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@mxnet.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org