[jira] [Created] (SYSTEMML-1901) Parfor with frame inputs or intermediates failing

["Matthias Boehm (JIRA)" <ji...@apache.org>]

Matthias Boehm created SYSTEMML-1901:
----------------------------------------

             Summary: Parfor with frame inputs or intermediates failing
                 Key: SYSTEMML-1901
                 URL: https://issues.apache.org/jira/browse/SYSTEMML-1901
             Project: SystemML
          Issue Type: Bug
            Reporter: Matthias Boehm


There are multiple issues with using frame inputs and intermediates in a parfor context.

First, the parfor optimizer fails on investigating partitioned inputs due to an unawareness of frames:
{code}
Caused by: java.lang.ClassCastException: org.apache.sysml.runtime.controlprogram.caching.FrameObject cannot be cast to org.apache.sysml.runtime.controlprogram.caching.MatrixObject
	at org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.getNewRIXMemoryEstimate(OptimizerRuleBased.java:519)
	at org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.rFindDataPartitioningCandidates(OptimizerRuleBased.java:472)
	at org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.rFindDataPartitioningCandidates(OptimizerRuleBased.java:462)
	at org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.rFindDataPartitioningCandidates(OptimizerRuleBased.java:462)
	at org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.rewriteSetDataPartitioner(OptimizerRuleBased.java:430)
	at org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizerRuleBased.optimize(OptimizerRuleBased.java:233)
	at org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizationWrapper.optimize(OptimizationWrapper.java:243)
	at org.apache.sysml.runtime.controlprogram.parfor.opt.OptimizationWrapper.optimize(OptimizationWrapper.java:117)
	at org.apache.sysml.runtime.controlprogram.ParForProgramBlock.execute(ParForProgramBlock.java:593)
	at org.apache.sysml.runtime.controlprogram.Program.execute(Program.java:123)
	... 32 more
{code}

Second, the parfor runtime fails on creating unbounded frame outputs, again, due an unawareness of frames.
{code}

Caused by: org.apache.sysml.runtime.DMLRuntimeException: Data type not supported: FRAME
	at org.apache.sysml.runtime.controlprogram.ParForProgramBlock.createEmptyUnscopedVariables(ParForProgramBlock.java:1289)
	at org.apache.sysml.runtime.controlprogram.ParForProgramBlock.consolidateAndCheckResults(ParForProgramBlock.java:1740)
	at org.apache.sysml.runtime.controlprogram.ParForProgramBlock.executeLocalParFor(ParForProgramBlock.java:814)
	at org.apache.sysml.runtime.controlprogram.ParForProgramBlock.execute(ParForProgramBlock.java:639)
	... 33 more
{code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)