[jira] [Resolved] (SYSTEMML-1818) Perftest: Kmeans train fails for 10Kx100, k=50, w/ forced singlenode

["Matthias Boehm (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SYSTEMML-1818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matthias Boehm resolved SYSTEMML-1818.
--------------------------------------
       Resolution: Fixed
         Assignee: Matthias Boehm
    Fix Version/s: SystemML 1.0

> Perftest: Kmeans train fails for 10Kx100, k=50, w/ forced singlenode
> --------------------------------------------------------------------
>
>                 Key: SYSTEMML-1818
>                 URL: https://issues.apache.org/jira/browse/SYSTEMML-1818
>             Project: SystemML
>          Issue Type: Bug
>            Reporter: Matthias Boehm
>            Assignee: Matthias Boehm
>             Fix For: SystemML 1.0
>
>
> The kmeans algorithm fails when forced to singlenode with the following exception:
> {code}
> Caused by: org.apache.sysml.runtime.DMLRuntimeException: Invalid values for matrix indexing: dimensions of the source matrix [451x10] do not match the shape of the matrix specified by indices [1:10, 1:10].
>         at org.apache.sysml.runtime.matrix.data.MatrixBlock.leftIndexingOperations(MatrixBlock.java:3654)
>         at org.apache.sysml.runtime.matrix.data.MatrixBlock.leftIndexingOperations(MatrixBlock.java:3631)
>         at org.apache.sysml.runtime.instructions.cp.MatrixIndexingCPInstruction.processInstruction(MatrixIndexingCPInstruction.java:95)
>         at org.apache.sysml.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:286)
> {code}
> Furthermore, there seems to be an issue of unnecessary spark context creation - in hybrid_spark mode we do not instantiate the spark context, while in forced singlenode we do.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)