You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@systemml.apache.org by "Matthias Boehm (JIRA)" <ji...@apache.org> on 2017/06/17 05:03:00 UTC
[jira] [Updated] (SYSTEMML-1715) Parfor optimizer fails w/ complex
indexing expressions in spark exec modes
[ https://issues.apache.org/jira/browse/SYSTEMML-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matthias Boehm updated SYSTEMML-1715:
-------------------------------------
Description:
The function nn/layers/conv2d_depthwise.dml::forward throws the following exception in spark execution modes. The reason why it does not show up in hadoop execution modes, is because it originates from a codepath for block partitioning, which is only supported in Spark.
{code}
Caused by: java.lang.RuntimeException: java.lang.NullPointerException
at org.apache.sysml.parser.ParForStatementBlock.determineAccessPattern(ParForStatementBlock.java:616)
at org.apache.sysml.parser.ParForStatementBlock.rDeterminePartitioningCandidates(ParForStatementBlock.java:567)
at org.apache.sysml.parser.ParForStatementBlock.rDeterminePartitioningCandidates(ParForStatementBlock.java:554)
at org.apache.sysml.parser.ParForStatementBlock.determineDataPartitionFormat(ParForStatementBlock.java:417)
at org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.rewriteSetDataPartitioner(OptimizerRuleBased.java:434)
at org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.optimize(OptimizerRuleBased.java:244)
at org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizationWrapper.optimize(OptimizationWrapper.java:243)
at org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizationWrapper.optimize(OptimizationWrapper.java:117)
at org.apache.sysml.runtime.controlprogram.ParForProgramBlock.execute(ParForProgramBlock.java:579)
at org.apache.sysml.runtime.controlprogram.FunctionProgramBlock.execute(FunctionProgramBlock.java:115)
... 18 more
Caused by: java.lang.NullPointerException
at org.apache.sysml.parser.ParForStatementBlock.rParseBinaryExpression(ParForStatementBlock.java:1898)
at org.apache.sysml.parser.ParForStatementBlock.getLinearFunction(ParForStatementBlock.java:1728)
at org.apache.sysml.parser.ParForStatementBlock.determineAccessPattern(ParForStatementBlock.java:599)
... 27 more
{code}
was:
{code}
Caused by: java.lang.RuntimeException: java.lang.NullPointerException
at org.apache.sysml.parser.ParForStatementBlock.determineAccessPattern(ParForStatementBlock.java:616)
at org.apache.sysml.parser.ParForStatementBlock.rDeterminePartitioningCandidates(ParForStatementBlock.java:567)
at org.apache.sysml.parser.ParForStatementBlock.rDeterminePartitioningCandidates(ParForStatementBlock.java:554)
at org.apache.sysml.parser.ParForStatementBlock.determineDataPartitionFormat(ParForStatementBlock.java:417)
at org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.rewriteSetDataPartitioner(OptimizerRuleBased.java:434)
at org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.optimize(OptimizerRuleBased.java:244)
at org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizationWrapper.optimize(OptimizationWrapper.java:243)
at org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizationWrapper.optimize(OptimizationWrapper.java:117)
at org.apache.sysml.runtime.controlprogram.ParForProgramBlock.execute(ParForProgramBlock.java:579)
at org.apache.sysml.runtime.controlprogram.FunctionProgramBlock.execute(FunctionProgramBlock.java:115)
... 18 more
Caused by: java.lang.NullPointerException
at org.apache.sysml.parser.ParForStatementBlock.rParseBinaryExpression(ParForStatementBlock.java:1898)
at org.apache.sysml.parser.ParForStatementBlock.getLinearFunction(ParForStatementBlock.java:1728)
at org.apache.sysml.parser.ParForStatementBlock.determineAccessPattern(ParForStatementBlock.java:599)
... 27 more
{code}
> Parfor optimizer fails w/ complex indexing expressions in spark exec modes
> --------------------------------------------------------------------------
>
> Key: SYSTEMML-1715
> URL: https://issues.apache.org/jira/browse/SYSTEMML-1715
> Project: SystemML
> Issue Type: Bug
> Reporter: Matthias Boehm
>
> The function nn/layers/conv2d_depthwise.dml::forward throws the following exception in spark execution modes. The reason why it does not show up in hadoop execution modes, is because it originates from a codepath for block partitioning, which is only supported in Spark.
> {code}
> Caused by: java.lang.RuntimeException: java.lang.NullPointerException
> at org.apache.sysml.parser.ParForStatementBlock.determineAccessPattern(ParForStatementBlock.java:616)
> at org.apache.sysml.parser.ParForStatementBlock.rDeterminePartitioningCandidates(ParForStatementBlock.java:567)
> at org.apache.sysml.parser.ParForStatementBlock.rDeterminePartitioningCandidates(ParForStatementBlock.java:554)
> at org.apache.sysml.parser.ParForStatementBlock.determineDataPartitionFormat(ParForStatementBlock.java:417)
> at org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.rewriteSetDataPartitioner(OptimizerRuleBased.java:434)
> at org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.optimize(OptimizerRuleBased.java:244)
> at org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizationWrapper.optimize(OptimizationWrapper.java:243)
> at org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizationWrapper.optimize(OptimizationWrapper.java:117)
> at org.apache.sysml.runtime.controlprogram.ParForProgramBlock.execute(ParForProgramBlock.java:579)
> at org.apache.sysml.runtime.controlprogram.FunctionProgramBlock.execute(FunctionProgramBlock.java:115)
> ... 18 more
> Caused by: java.lang.NullPointerException
> at org.apache.sysml.parser.ParForStatementBlock.rParseBinaryExpression(ParForStatementBlock.java:1898)
> at org.apache.sysml.parser.ParForStatementBlock.getLinearFunction(ParForStatementBlock.java:1728)
> at org.apache.sysml.parser.ParForStatementBlock.determineAccessPattern(ParForStatementBlock.java:599)
> ... 27 more
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)