You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@systemds.apache.org by "Baunsgaard (via GitHub)" <gi...@apache.org> on 2023/04/01 21:59:22 UTC

[GitHub] [systemds] Baunsgaard opened a new pull request, #1801: Many Optimizations of CLA Compressed transfer

Baunsgaard opened a new pull request, #1801:
URL: https://github.com/apache/systemds/pull/1801

   
   
   Transpose Denset-> sparse:
   
   Before: single thread transpose dominated:
   ```
   census_enc_16k-kmeans+-claWorkloadb16 -- dams-so001
   Total elapsed time:		40.237 sec.
     2  r'                15.085    112
     3  compress           6.896      1
           407,390.46 msec task-clock                #    8.943 CPUs utilized          
      789,013,767,869      cycles                    #    1.937 GHz                      (33.31%)
      938,096,650,617      instructions              #    1.19  insn per cycle         
   census_enc_16k-kmeans+-claWorkloadb16 -- dams-so001
   ```
   
   Then i removed an indirection of allocation via append on MCSR and managed the sparse vectors directly:
   
   ```
   dams-so001 sysds: 81e554108686a1db2ff48ecd59e81d533d216b07
   20:58:10
   .------------------------------------
   census_enc_16k-kmeans+-claWorkloadb16 -- dams-so001
   Total elapsed time:		32.991 sec.
     2  r'                 9.334    112
     3  compress           6.669      1
           399,243.07 msec task-clock                #   10.375 CPUs utilized          
      762,584,081,959      cycles                    #    1.910 GHz                      (33.28%)
      928,305,632,331      instructions              #    1.22  insn per cycle         
   census_enc_16k-kmeans+-claWorkloadb16 -- dams-so001
   ------------------------------------
   
   ```
   
   And finally parallelized:
   
   ```
   dams-so001 sysds: 3a43b30b2b8dec983aa5cd7ea3c67c79a28b7f30
   21:49:14
   .------------------------------------
   census_enc_16k-kmeans+-claWorkloadb16 -- dams-so001
   Total elapsed time:		27.812 sec.
     2  compress           6.801      1
     4  r'                 4.454    112
           405,710.80 msec task-clock                #   12.203 CPUs utilized          
      777,778,027,253      cycles                    #    1.917 GHz                      (33.34%)
      967,872,124,119      instructions              #    1.24  insn per cycle         
   census_enc_16k-kmeans+-claWorkloadb16 -- dams-so001
   ------------------------------------
   baunsgaard@dams-so001:~/github/reprodu
   ```
   
   
   In LMCG: 16x I found some optimizations to make as well. Here I added a skip list to offsetList that is hidden behind a softreference.
   
   Before:
   ```
   SystemDS Statistics:
   Total elapsed time:		108.736 sec.
   CLA Compression Phases :	2.065/8.329/18.484/15.647/0.001/0.000
   Decompression with allocation (Single, Multi, Spark, Cache) : 0/101/0/0
   Decompression with allocation Time (Single , Multi)         : 0.000/27.285 sec.
   Decompression to block (Single, Multi)                      : 0/0
   Decompression to block Time (Single, Multi)                 : 0.000/0.000 sec.
   ```
   
   With SkipList:
   
   ```
   SystemDS Statistics:
   Total elapsed time:		91.367 sec.
   Total compilation time:		1.250 sec.
   
   CLA Compression Phases :	2.154/7.847/20.251/15.372/0.002/0.000
   Decompression with allocation (Single, Multi, Spark, Cache) : 0/101/0/0
   Decompression with allocation Time (Single , Multi)         : 0.000/8.685 sec.
   Decompression to block (Single, Multi)                      : 0/0
   Decompression to block Time (Single, Multi)                 : 0.000/0.000 sec.
   ```
   
   
   
   And Biggest in transfer from spark i had misplaced a recompute zeros dominating the transfer by recomputing all zeros in the entire matrix when pulling back a distributed compressed matrix. This speed up for instance PCA 32x from :+1: 
   
   before
   ```
   Total elapsed time:		148.328 sec.
   Spark trans times (par,bc,col):	0.000/0.021/85.999 secs.
   ```
   
   after
   ```
   Total elapsed time:		65.700 sec.
   Spark trans times (par,bc,col):	0.000/0.021/6.980 secs.
   ```
   
   
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [systemds] Baunsgaard closed pull request #1801: Many Optimizations of CLA Compressed transfer

Posted by "Baunsgaard (via GitHub)" <gi...@apache.org>.
Baunsgaard closed pull request #1801: Many Optimizations of CLA Compressed transfer
URL: https://github.com/apache/systemds/pull/1801


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [systemds] Baunsgaard commented on pull request #1801: Many Optimizations of CLA Compressed transfer

Posted by "Baunsgaard (via GitHub)" <gi...@apache.org>.
Baunsgaard commented on PR #1801:
URL: https://github.com/apache/systemds/pull/1801#issuecomment-1520065314

   Closing because the PR have been split into multiple PRs


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org