You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@systemml.apache.org by "Matthias Boehm (JIRA)" <ji...@apache.org> on 2017/06/15 01:41:00 UTC
[jira] [Created] (SYSTEMML-1697) Reading multi-part files object
stores w/o existing directory
Matthias Boehm created SYSTEMML-1697:
----------------------------------------
Summary: Reading multi-part files object stores w/o existing directory
Key: SYSTEMML-1697
URL: https://issues.apache.org/jira/browse/SYSTEMML-1697
Project: SystemML
Issue Type: Task
Reporter: Matthias Boehm
Assume a multi-part binary matrix written to an object store. As the object store only emulates a directory structure, the parent directory does not exist. Accordingly, our binary block matrix readers (which directly read from sequence files instead of record readers) fail because the check for {{isDirectory}} returns false. In order to fix this, we would need to be aware of this issues and handle it when ran against object store file schemes. Similarly, {{listStatus}} also returns the meta data file which has the same prefix as the created "directory" and needs to be filtered out.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)