You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@systemml.apache.org by "Fei Hu (JIRA)" <ji...@apache.org> on 2017/07/26 17:48:01 UTC
[jira] [Closed] (SYSTEMML-1774) Improve Parfor parallelism for deep
learning
[ https://issues.apache.org/jira/browse/SYSTEMML-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Fei Hu closed SYSTEMML-1774.
----------------------------
Resolution: Fixed
Fix Version/s: SystemML 1.0
> Improve Parfor parallelism for deep learning
> --------------------------------------------
>
> Key: SYSTEMML-1774
> URL: https://issues.apache.org/jira/browse/SYSTEMML-1774
> Project: SystemML
> Issue Type: Improvement
> Components: Algorithms, Compiler, ParFor
> Affects Versions: SystemML 1.0
> Reporter: Fei Hu
> Assignee: Fei Hu
> Labels: deeplearning
> Fix For: SystemML 1.0
>
> Attachments: Explain_For_HYBRID_SPARK_Mode_With_ErrorInfo.txt, Explain_For_Spark_Mode.txt, MNIST_Distrib_Sgd.scala, mnist_lenet_distrib_sgd.dml
>
>
> When running the [distributed MNIST LeNet example | https://github.com/apache/systemml/blob/master/scripts/nn/examples/mnist_lenet_distrib_sgd.dml], each mini-batch could ideally run in parallel without interaction. We try to force {{parfor (j in 1:parallel_batches)}} at line 137 of {{nn/examples/mnist_lenet_distrib_sgd.dml}} to be {{parfor (j in 1:parallel_batches, mode=REMOTE_SPARK, opt=CONSTRAINED)}} use {{REMOTE_SPARK}} mode, but got some errors about {{org.apache.sysml.runtime.DMLRuntimeException: Not supported: Instructions of type other than CP instructions}} using the mode {{SPARK}}, and the error {{java.lang.NullPointerException}} using the mode {{HYBRID_SPARK}}. More log information can be found at the following comments.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)