[jira] [Created] (SYSTEMML-955) NPE running GLM-predict.dml in spark mode

["Pierre Regazzoni (JIRA)" <ji...@apache.org>]

Pierre Regazzoni created SYSTEMML-955:
-----------------------------------------

             Summary: NPE running GLM-predict.dml in spark mode
                 Key: SYSTEMML-955
                 URL: https://issues.apache.org/jira/browse/SYSTEMML-955
             Project: SystemML
          Issue Type: Bug
          Components: PyDML
    Affects Versions: SystemML 0.11
            Reporter: Pierre Regazzoni


Trying to run Linear Regression example (http://www.ibm.com/support/knowledgecenter/SSPT3X_4.2.0/com.ibm.swg.im.infosphere.biginsights.product.doc/doc/bi_systemML.html) and hit following NPE:
{noformat}
16/09/23 18:16:04 ERROR ApplicationMaster: User class threw exception: org.apache.sysml.api.DMLException: org.apache.sysml.lops.LopsException: ERROR: line 243, column 30 -- Problem generating simple inst - SPARK°cdf°dist=normal°target=¶_Var238¶°_Var239·SCALAR·DOUBLE
org.apache.sysml.api.DMLException: org.apache.sysml.lops.LopsException: ERROR: line 243, column 30 -- Problem generating simple inst - SPARK°cdf°dist=normal°target=¶_Var238¶°_Var239·SCALAR·DOUBLE
	at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:374)
	at org.apache.sysml.api.DMLScript.main(DMLScript.java:198)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:627)
Caused by: org.apache.sysml.lops.LopsException: ERROR: line 243, column 30 -- Problem generating simple inst - SPARK°cdf°dist=normal°target=¶_Var238¶°_Var239·SCALAR·DOUBLE
	at org.apache.sysml.lops.compile.Dag.generateControlProgramJobs(Dag.java:1529)
	at org.apache.sysml.lops.compile.Dag.doGreedyGrouping(Dag.java:1194)
	at org.apache.sysml.lops.compile.Dag.getJobs(Dag.java:268)
	at org.apache.sysml.parser.DMLProgram.createRuntimeProgramBlock(DMLProgram.java:541)
	at org.apache.sysml.parser.DMLProgram.createRuntimeProgramBlock(DMLProgram.java:338)
	at org.apache.sysml.parser.DMLProgram.getRuntimeProgram(DMLProgram.java:207)
	at org.apache.sysml.api.DMLScript.execute(DMLScript.java:648)
	at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:360)
	... 6 more
Caused by: java.lang.NullPointerException
	at org.apache.sysml.runtime.instructions.SPInstructionParser.parseSingleInstruction(SPInstructionParser.java:304)
	at org.apache.sysml.runtime.instructions.InstructionParser.parseSingleInstruction(InstructionParser.java:48)
	at org.apache.sysml.lops.compile.Dag.generateControlProgramJobs(Dag.java:1516)
	... 13 more
{noformat}

I am running on tech preview code using spark 2.0 and systemml-0.11.0-incubating_IBM_3.jar.

GML-predict.dml was invoked as:
{noformat}
$SPARK_HOME/bin/spark-submit --master yarn --deploy-mode cluster \
  --class org.apache.sysml.api.DMLScript /usr/iop/current/systemml-client/lib/systemml.jar \
  -f /usr/iop/current/systemml-client/scripts/algorithms/GLM-predict.dml -exec spark \
  -nvargs X=linRegData.test.data.csv Y=linRegData.test.labels.csv B=betas.csv fmt=csv
{noformat}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)