You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Antoine Pitrou (JIRA)" <ji...@apache.org> on 2019/07/23 11:56:00 UTC

[jira] [Commented] (ARROW-6004) [C++] CSV reader ignore_empty_lines option doesn't handle empty lines

    [ https://issues.apache.org/jira/browse/ARROW-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890923#comment-16890923 ] 

Antoine Pitrou commented on ARROW-6004:
---------------------------------------

> Correct behavior should be to fill those empty lines with missing data for all columns.

Uh, why would it? I know CSV is not an extremely well-specified format, but that sounds to me a bit far-fetched. It's also a bit problematic: how do you deal with empty lines at the beginning of a file? You don't know the number of columns yet.

[~wesmckinn]

> [C++] CSV reader ignore_empty_lines option doesn't handle empty lines
> ---------------------------------------------------------------------
>
>                 Key: ARROW-6004
>                 URL: https://issues.apache.org/jira/browse/ARROW-6004
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: C++
>            Reporter: Neal Richardson
>            Priority: Minor
>              Labels: csv
>
> Followup to https://issues.apache.org/jira/browse/ARROW-5747. If {{ignore_empty_lines}} is false and there are empty lines, it fails to parse (again, with {{Invalid: Empty CSV file}}).
> Correct behavior should be to fill those empty lines with missing data for all columns.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)