[jira] [Commented] (SYSTEMML-1047) Statistics w/ MLContext Yields Incorrect Results

["Deron Eriksson (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SYSTEMML-1047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16119247#comment-16119247 ] 

Deron Eriksson commented on SYSTEMML-1047:
------------------------------------------

I believe this has been addressed by PRs such as:
https://github.com/apache/systemml/pull/595
https://github.com/apache/systemml/pull/493
https://github.com/apache/systemml/pull/491

[~dusenberrymw] can this issue be closed?


> Statistics w/ MLContext Yields Incorrect Results
> ------------------------------------------------
>
>                 Key: SYSTEMML-1047
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-1047
>             Project: SystemML
>          Issue Type: Bug
>            Reporter: Mike Dusenberry
>
> Currently, when MLContext is run with Statistics turned on, the resulting statistics are inaccurate.  In particular, the 3 measures of elapsed time are set to "0.000 seconds" which is obviously inaccurate.  Furthermore, after {{MLContext}} is used for the first script with stats on, subsequent scripts run with stats turned on will no longer provide updated statistics, and will simply print out the original stats.
> Example:
> {code}
> SystemML Statistics:
> Total elapsed time:             0.000 sec.
> Total compilation time:         0.000 sec.
> Total execution time:           0.000 sec.
> Number of compiled Spark inst:  164.
> Number of executed Spark inst:  118.
> Cache hits (Mem, WB, FS, HDFS): 1626/0/0/0.
> Cache writes (WB, FS, HDFS):    679/0/0.
> Cache times (ACQr/m, RLS, EXP): 0.002/0.001/3.998/0.000 sec.
> HOP DAGs recompiled (PRED, SB): 0/43.
> HOP DAGs recompile time:        0.051 sec.
> Functions recompiled:           6.
> Functions recompile time:       0.037 sec.
> Spark ctx create time (lazy):   0.000 sec.
> Spark trans counts (par,bc,col):0/0/1.
> Spark trans times (par,bc,col): 0.000/0.000/0.577 secs.
> Total JIT compile time:         135.184 sec.
> Total JVM GC count:             1326.
> Total JVM GC time:              160.557 sec.
> Heavy hitter instructions (name, time, count):
> -- 1)   train   59.288 sec      1
> -- 2)   predict         23.537 sec      5
> -- 3)   conv2d  14.528 sec      42
> -- 4)   sel+    11.446 sec      56
> -- 5)   *       9.014 sec       330
> -- 6)   +       5.137 sec       343
> -- 7)   >       3.841 sec       16
> -- 8)   conv2d_backward_filter  3.008 sec       12
> -- 9)   conv2d_backward_data    2.378 sec       8
> -- 10)  maxpooling_backward     2.056 sec       12
> {code}
> cc [~deron]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)