[jira] [Updated] (IGNITE-7328) Improve Labeled Dataset loading from txt file

["Aleksey Zinoviev (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IGNITE-7328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aleksey Zinoviev updated IGNITE-7328:
-------------------------------------
    Affects Version/s: 3.0

> Improve Labeled Dataset loading from txt file
> ---------------------------------------------
>
>                 Key: IGNITE-7328
>                 URL: https://issues.apache.org/jira/browse/IGNITE-7328
>             Project: Ignite
>          Issue Type: New Feature
>          Components: ml
>    Affects Versions: 3.0
>            Reporter: Aleksey Zinoviev
>            Assignee: Aleksey Zinoviev
>            Priority: Trivial
>
> 1. Wouldn't it be better to parse rows in-place (not to save them as strings at first)? In current implementation we will be needed to keep a dataset in memory twice and it might be a problem for big datasets.
> 2. What about the case when a dataset contains not only a numerical data? Do we consider this case or for such purposes some other "DatasetLoader" will be used?
> 3. Just an idea, in case we don't want to fall on bad data (99% of cases) would be great to understand the quality of loaded dataset such as number of missed rows/values.
> 4. Does a situation when a row doesn't contain required number of columns should be considered as "bad data" and don't break parsing with IndexOutOfBoundException?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)