You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@systemml.apache.org by "Matthias Boehm (JIRA)" <ji...@apache.org> on 2016/08/22 17:22:20 UTC
[jira] [Updated] (SYSTEMML-864) Meta data operations after csv
frame read w/ unknown size
[ https://issues.apache.org/jira/browse/SYSTEMML-864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matthias Boehm updated SYSTEMML-864:
------------------------------------
Description:
In execution modes singlenode, hadoop, hybrid no reblocks are injected for frames of format "csv". Accordingly, any nrow/ncol after a frame csv read with unknown size fail with the following exception.
{code}
Caused by: org.apache.sysml.runtime.DMLRuntimeException: Invalid meta data returned by 'nrow': -1
at org.apache.sysml.runtime.instructions.cp.AggregateUnaryCPInstruction.processInstruction(AggregateUnaryCPInstruction.java:122)
at org.apache.sysml.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:305)
{code}
We already have a special case for matrices in execution mode singlenode, which reads the matrix and updates the meta data on the fly. This functionality should be extended for frames too.
> Meta data operations after csv frame read w/ unknown size
> ---------------------------------------------------------
>
> Key: SYSTEMML-864
> URL: https://issues.apache.org/jira/browse/SYSTEMML-864
> Project: SystemML
> Issue Type: Bug
> Components: Runtime
> Affects Versions: SystemML 0.11
> Reporter: Matthias Boehm
>
> In execution modes singlenode, hadoop, hybrid no reblocks are injected for frames of format "csv". Accordingly, any nrow/ncol after a frame csv read with unknown size fail with the following exception.
> {code}
> Caused by: org.apache.sysml.runtime.DMLRuntimeException: Invalid meta data returned by 'nrow': -1
> at org.apache.sysml.runtime.instructions.cp.AggregateUnaryCPInstruction.processInstruction(AggregateUnaryCPInstruction.java:122)
> at org.apache.sysml.runtime.controlprogram.ProgramBlock.executeSingleInstruction(ProgramBlock.java:305)
> {code}
> We already have a special case for matrices in execution mode singlenode, which reads the matrix and updates the meta data on the fly. This functionality should be extended for frames too.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)