[jira] [Assigned] (SYSTEMML-955) NPE running GLM-predict.dml in spark mode

["Matthias Boehm (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SYSTEMML-955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matthias Boehm reassigned SYSTEMML-955:
---------------------------------------

    Assignee: Matthias Boehm

> NPE running GLM-predict.dml in spark mode
> -----------------------------------------
>
>                 Key: SYSTEMML-955
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-955
>             Project: SystemML
>          Issue Type: Bug
>          Components: Runtime
>    Affects Versions: SystemML 0.11
>            Reporter: Pierre Regazzoni
>            Assignee: Matthias Boehm
>
> Trying to run Linear Regression example (http://www.ibm.com/support/knowledgecenter/SSPT3X_4.2.0/com.ibm.swg.im.infosphere.biginsights.product.doc/doc/bi_systemML.html) and hit following NPE:
> {noformat}
> 16/09/23 18:16:04 ERROR ApplicationMaster: User class threw exception: org.apache.sysml.api.DMLException: org.apache.sysml.lops.LopsException: ERROR: line 243, column 30 -- Problem generating simple inst - SPARK°cdf°dist=normal°target=¶_Var238¶°_Var239·SCALAR·DOUBLE
> org.apache.sysml.api.DMLException: org.apache.sysml.lops.LopsException: ERROR: line 243, column 30 -- Problem generating simple inst - SPARK°cdf°dist=normal°target=¶_Var238¶°_Var239·SCALAR·DOUBLE
> 	at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:374)
> 	at org.apache.sysml.api.DMLScript.main(DMLScript.java:198)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:627)
> Caused by: org.apache.sysml.lops.LopsException: ERROR: line 243, column 30 -- Problem generating simple inst - SPARK°cdf°dist=normal°target=¶_Var238¶°_Var239·SCALAR·DOUBLE
> 	at org.apache.sysml.lops.compile.Dag.generateControlProgramJobs(Dag.java:1529)
> 	at org.apache.sysml.lops.compile.Dag.doGreedyGrouping(Dag.java:1194)
> 	at org.apache.sysml.lops.compile.Dag.getJobs(Dag.java:268)
> 	at org.apache.sysml.parser.DMLProgram.createRuntimeProgramBlock(DMLProgram.java:541)
> 	at org.apache.sysml.parser.DMLProgram.createRuntimeProgramBlock(DMLProgram.java:338)
> 	at org.apache.sysml.parser.DMLProgram.getRuntimeProgram(DMLProgram.java:207)
> 	at org.apache.sysml.api.DMLScript.execute(DMLScript.java:648)
> 	at org.apache.sysml.api.DMLScript.executeScript(DMLScript.java:360)
> 	... 6 more
> Caused by: java.lang.NullPointerException
> 	at org.apache.sysml.runtime.instructions.SPInstructionParser.parseSingleInstruction(SPInstructionParser.java:304)
> 	at org.apache.sysml.runtime.instructions.InstructionParser.parseSingleInstruction(InstructionParser.java:48)
> 	at org.apache.sysml.lops.compile.Dag.generateControlProgramJobs(Dag.java:1516)
> 	... 13 more
> {noformat}
> I am running on tech preview code using spark 2.0 and systemml-0.11.0-incubating_IBM_3.jar.
> GML-predict.dml was invoked as:
> {noformat}
> $SPARK_HOME/bin/spark-submit --master yarn --deploy-mode cluster \
>   --class org.apache.sysml.api.DMLScript /usr/iop/current/systemml-client/lib/systemml.jar \
>   -f /usr/iop/current/systemml-client/scripts/algorithms/GLM-predict.dml -exec spark \
>   -nvargs X=linRegData.test.data.csv Y=linRegData.test.labels.csv B=betas.csv fmt=csv
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)