You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Maciej (Jira)" <ji...@apache.org> on 2020/10/15 14:04:00 UTC

[jira] [Created] (ARROW-10315) [C++] CSV skip wrong rows

Maciej created ARROW-10315:
------------------------------

             Summary: [C++] CSV skip wrong rows
                 Key: ARROW-10315
                 URL: https://issues.apache.org/jira/browse/ARROW-10315
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++
    Affects Versions: 1.0.1
            Reporter: Maciej


It would be helpful to add another option to {color:#267f99}ReadOptions {color}which will enable skipping rows with wrong data (e.g. data type mismatch with column type) and continue reading next rows. Wrong rows numbers may be reported at the end of processing.

This way I can deal with the wrongly formatted data or ignore it if I have a large load success rate and I don’t care about the exceptions.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)