You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2018/12/09 10:10:17 UTC
[GitHub] BullDemonKing edited a comment on issue #13588: Accelerate DGL csr
neighbor sampling
BullDemonKing edited a comment on issue #13588: Accelerate DGL csr neighbor sampling
URL: https://github.com/apache/incubator-mxnet/pull/13588#issuecomment-445521810
The improvement in this PR has about 2-3 times speedup over the implementation in the master branch.
The speed in the master branch:
```
-------------------------------------------------------Uniform Bechmark---------------------------------------------------------
time: 0.0651424407959 (s) thread: 32 seed size: 1000 num_hops: 1 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 325274
time: 0.07034907341 (s) thread: 32 seed size: 2000 num_hops: 1 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 647972
time: 0.130498409271 (s) thread: 32 seed size: 4000 num_hops: 1 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 1300821
time: 0.251270961761 (s) thread: 32 seed size: 8000 num_hops: 1 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 2598921
time: 0.453542613983 (s) thread: 32 seed size: 1000 num_hops: 2 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 5276791
time: 0.940950870514 (s) thread: 32 seed size: 2000 num_hops: 2 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 10515177
time: 1.6341050148 (s) thread: 32 seed size: 4000 num_hops: 2 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 20668389
time: 2.81761116982 (s) thread: 32 seed size: 8000 num_hops: 2 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 39889110
-----------------------------------------------------Non-Uniform Bechmark-------------------------------------------------------
time: 0.0410866260529 (s) thread: 32 seed size: 1000 num_hops: 1 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 323537
time: 0.0525182723999 (s) thread: 32 seed size: 2000 num_hops: 1 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 649116
time: 0.108578252792 (s) thread: 32 seed size: 4000 num_hops: 1 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 1301567
time: 0.210351467133 (s) thread: 32 seed size: 8000 num_hops: 1 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 2599414
time: 0.483125591278 (s) thread: 32 seed size: 1000 num_hops: 2 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 5334587
time: 0.998479986191 (s) thread: 32 seed size: 2000 num_hops: 2 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 10499253
time: 1.81847443581 (s) thread: 32 seed size: 4000 num_hops: 2 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 20587578
time: 3.07297439575 (s) thread: 32 seed size: 8000 num_hops: 2 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 39759114
```
The speed in this PR:
```
-------------------------------------------------------Uniform Bechmark---------------------------------------------------------
time: 0.0255964756012 (s) thread: 32 seed size: 1000 num_hops: 1 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 323513
time: 0.0243901729584 (s) thread: 32 seed size: 2000 num_hops: 1 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 652299
time: 0.0369716644287 (s) thread: 32 seed size: 4000 num_hops: 1 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 1299192
time: 0.0984917640686 (s) thread: 32 seed size: 8000 num_hops: 1 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 2597010
time: 0.172056150436 (s) thread: 32 seed size: 1000 num_hops: 2 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 5318903
time: 0.357382392883 (s) thread: 32 seed size: 2000 num_hops: 2 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 10521593
time: 0.554566431046 (s) thread: 32 seed size: 4000 num_hops: 2 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 20684741
time: 1.08307261467 (s) thread: 32 seed size: 8000 num_hops: 2 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 39896653
-----------------------------------------------------Non-Uniform Bechmark-------------------------------------------------------
time: 0.0144423961639 (s) thread: 32 seed size: 1000 num_hops: 1 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 325661
time: 0.0177308082581 (s) thread: 32 seed size: 2000 num_hops: 1 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 651627
time: 0.0373013973236 (s) thread: 32 seed size: 4000 num_hops: 1 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 1299527
time: 0.107610464096 (s) thread: 32 seed size: 8000 num_hops: 1 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 2601329
time: 0.231380796432 (s) thread: 32 seed size: 1000 num_hops: 2 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 5303039
time: 0.430892515182 (s) thread: 32 seed size: 2000 num_hops: 2 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 10528228
time: 0.779708433151 (s) thread: 32 seed size: 4000 num_hops: 2 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 20552607
time: 1.36538419724 (s) thread: 32 seed size: 8000 num_hops: 2 num neighbors: 16 max vertices: 1000000 sample_num_ver: 32000032 sample_num_edge: 39731365
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services