You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@systemds.apache.org by GitBox <gi...@apache.org> on 2021/12/31 17:36:13 UTC

[GitHub] [systemds] mboehm7 removed a comment on pull request #1481: [SYSTEMDS-2832] Refactoring of old performance benchmarks.

mboehm7 removed a comment on pull request #1481:
URL: https://github.com/apache/systemds/pull/1481#issuecomment-1003424325


   For PCA with many columns we have PPCA, which runs this scenario as follows:
   
   ```
   Total elapsed time:             6.880 sec.
   Total compilation time:         1.586 sec.
   Total execution time:           5.293 sec.
   Number of compiled Spark inst:  0.
   Number of executed Spark inst:  0.
   Cache hits (Mem/Li/WB/FS/HDFS): 21/0/0/0/0.
   Cache writes (Li/WB/FS/HDFS):   3/6/0/2.
   Cache times (ACQr/m, RLS, EXP): 0.000/0.000/0.004/4.511 sec.
   HOP DAGs recompiled (PRED, SB): 0/0.
   HOP DAGs recompile time:        0.000 sec.
   Spark ctx create time (lazy):   0.000 sec.
   Spark trans counts (par,bc,col):0/0/0.
   Spark trans times (par,bc,col): 0.000/0.000/0.000 secs.
   Total JIT compile time:         3.13 sec.
   Total JVM GC count:             4.
   Total JVM GC time:              0.138 sec.
   Heavy hitter instructions:
     #  Instruction  Time(s)  Count
     1  write          4.511      2
     2  rand           0.324      7
     3  +              0.256     12
     4  leftIndex      0.161      3
     5  /              0.025      1
     6  n+             0.017      1
     7  *              0.015      5
     8  rmvar          0.007     15
     9  ceil           0.004      2
    10  createvar      0.001     21
   ```
   
   Similar to lm and als, we should dispatch to the appropriate pca algorithm based on heuristics. Thanks.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@systemds.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org