You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@systemml.apache.org by "Mike Dusenberry (JIRA)" <ji...@apache.org> on 2016/08/04 21:16:20 UTC
[jira] [Comment Edited] (SYSTEMML-845) Compare Performance of LeNet
Scripts With & Without Using SystemML-NN
[ https://issues.apache.org/jira/browse/SYSTEMML-845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15408490#comment-15408490 ]
Mike Dusenberry edited comment on SYSTEMML-845 at 8/4/16 9:16 PM:
------------------------------------------------------------------
Attaching logs ({{log08.03.16-1470268602.txt}}) for running both scripts twice in standalone mode with the {{-exec singlenode}} flag with 20GB of memory, using data inputs in the SystemML binary format -- see {{run.sh}} and {{perf.sh}} for information.
Results:
- Run #1:
|| Script | Time (s) | Accuracy ||
| mnist_lenet-train.dml | 2987.400704441 | 99.32% |
| lenet-train.dml | 2816.369435579 | 99.28% |
- Run #2:
|| Script | Time (s) | Accuracy ||
| mnist_lenet-train.dml | 2847.790531812 | 99.16% |
| lenet-train.dml | 2950.520494210 | 99.18% |
was (Author: mwdusenb@us.ibm.com):
Attaching logs ({{log08.03.16-1470268602.txt}}) for running both scripts twice in standalone mode with the {{-exec singlenode}} flag with 20GB of memory.
Results:
- Run #1:
|| Script | Time (s) | Accuracy ||
| mnist_lenet-train.dml | 2987.400704441 | 99.32% |
| lenet-train.dml | 2816.369435579 | 99.28% |
- Run #2:
|| Script | Time (s) | Accuracy ||
| mnist_lenet-train.dml | 2847.790531812 | 99.16% |
| lenet-train.dml | 2950.520494210 | 99.18% |
> Compare Performance of LeNet Scripts With & Without Using SystemML-NN
> ---------------------------------------------------------------------
>
> Key: SYSTEMML-845
> URL: https://issues.apache.org/jira/browse/SYSTEMML-845
> Project: SystemML
> Issue Type: Improvement
> Reporter: Mike Dusenberry
> Attachments: convert.dml, log08.03.16-1470268602.txt, perf.sh, run.sh
>
>
> This JIRA issue tracks the comparison of the performance of the LeNet scripts with & without using SystemML-NN. The goal is that they should have equal performance in terms of both accuracy and time. Any difference will be indicate areas of engine improvement.
> Scripts:
> * [mnist_lenet-train.dml | https://github.com/apache/incubator-systemml/blob/master/scripts/staging/SystemML-NN/examples/mnist_lenet-train.dml] - LeNet script that *does* use the SystemML-NN library.
> * [lenet-train.dml | https://github.com/apache/incubator-systemml/blob/master/scripts/staging/lenet-train.dml] - LeNet script that *does not* use the SystemML-NN library.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)