You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@systemml.apache.org by "Matthias Boehm (JIRA)" <ji...@apache.org> on 2016/06/08 05:52:21 UTC
[jira] [Updated] (SYSTEMML-630) Parallel frame readers and writers
[ https://issues.apache.org/jira/browse/SYSTEMML-630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matthias Boehm updated SYSTEMML-630:
------------------------------------
Description:
Similar to parallel matrix readers/writers this task aims to improve I/O performance via multi-threaded readers/writers. Especially, with text formats and double schemas, we expect an improvement in the number of cores because string-double conversions are heavily CPU-bound. In detail this tasks includes the following subtasks:
1) Multi-threaded binary block writer
2) Multi-threaded text cell writer
3) Multi-threaded text csv writer
4) Multi-threaded binary block reader
5) Multi-threaded text cell reader
6) Multi-threaded text csv reader
7) Consolidation of single-threaded / multi-threaded readers/writers to use consistent code path for core read/write functionality.
> Parallel frame readers and writers
> ----------------------------------
>
> Key: SYSTEMML-630
> URL: https://issues.apache.org/jira/browse/SYSTEMML-630
> Project: SystemML
> Issue Type: Task
> Reporter: Matthias Boehm
> Assignee: Matthias Boehm
>
> Similar to parallel matrix readers/writers this task aims to improve I/O performance via multi-threaded readers/writers. Especially, with text formats and double schemas, we expect an improvement in the number of cores because string-double conversions are heavily CPU-bound. In detail this tasks includes the following subtasks:
> 1) Multi-threaded binary block writer
> 2) Multi-threaded text cell writer
> 3) Multi-threaded text csv writer
> 4) Multi-threaded binary block reader
> 5) Multi-threaded text cell reader
> 6) Multi-threaded text csv reader
> 7) Consolidation of single-threaded / multi-threaded readers/writers to use consistent code path for core read/write functionality.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)