You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2020/01/29 23:55:30 UTC

[GitHub] [incubator-mxnet] ChaiBapchya edited a comment on issue #17449: Implemented large tensor flag for opperf testing

ChaiBapchya edited a comment on issue #17449: Implemented large tensor flag for opperf testing
URL: https://github.com/apache/incubator-mxnet/pull/17449#issuecomment-579949961
 
 
   Actually, if the mxnet is built with LTS ON then user can just give >2**32
   as a custom shape and use the opperf utility.
   
   ```
   import mxnet as mx
   from mxnet import nd
   
   from benchmark.opperf.utils.benchmark_utils import run_performance_test
   run_performance_test(nd.add, run_backward=True, dtype='float32', ctx=mx.cpu(),
                                  inputs=[{"lhs": (2**32+1, 1),
                                           "rhs": (2**32+1, 1)}],
                                  warmup=0, runs=1)
   ```
   
   This flag serves as a quick way of testing for Large tensor Ops.
   So for example if user doesn't want to add custom shapes for each operator
   and just wants to see perf times for all operators then this flag comes in
   handy.
   
   ```
   python incubator-mxnet/benchmark/opperf/opperf.py --output-format json --output-file mxnet_operator_benchmark_results.json --large-tensor ON
   ```
   
   So ya, both are separate use cases and both are possible.
   With the obvious assumption, mxnet is built with USE_INT64_TENSOR_SIZE = ON
   
   
   On Wed, 29 Jan 2020 at 10:31, Lin Yuan <no...@github.com> wrote:
   
   > Can users specify custom shapes to test the performance of large tensor
   > instead of using a param? That gives more freedom to users.
   >
   > —
   > You are receiving this because you commented.
   > Reply to this email directly, view it on GitHub
   > <https://github.com/apache/incubator-mxnet/pull/17449?email_source=notifications&email_token=ACT3X62ZQIGIEGFNAFA7UUTRAHDRZA5CNFSM4KMGEWTKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEKIIJDY#issuecomment-579896463>,
   > or unsubscribe
   > <https://github.com/notifications/unsubscribe-auth/ACT3X62HGRE6DM3YHJO33ELRAHDRZANCNFSM4KMGEWTA>
   > .
   >
   
   
   -- 
   *Chaitanya Prakash Bapat*
   *+1 (973) 953-6299*
   
   [image: https://www.linkedin.com//in/chaibapat25]
   <https://github.com/ChaiBapchya>[image: https://www.facebook.com/chaibapat]
   <https://www.facebook.com/chaibapchya>[image:
   https://twitter.com/ChaiBapchya] <https://twitter.com/ChaiBapchya>[image:
   https://www.linkedin.com//in/chaibapat25]
   <https://www.linkedin.com//in/chaibapchya/>
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services