You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Antoine Pitrou (Jira)" <ji...@apache.org> on 2020/11/10 17:26:00 UTC

[jira] [Commented] (ARROW-10432) [C++] CSV reader: support for multi-character / whitespace delimiter?

    [ https://issues.apache.org/jira/browse/ARROW-10432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17229383#comment-17229383 ] 

Antoine Pitrou commented on ARROW-10432:
----------------------------------------

Is that actually useful in the real world?

> [C++] CSV reader: support for multi-character / whitespace delimiter?
> ---------------------------------------------------------------------
>
>                 Key: ARROW-10432
>                 URL: https://issues.apache.org/jira/browse/ARROW-10432
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: C++
>            Reporter: Joris Van den Bossche
>            Priority: Major
>
> I don't know how useful general "multi-character" delimiter support is, but one specific type of it that seems useful is "whitespace delimited", meaning any whitespace (possibly multiple / different whitespace characters). 
> In pandas you can achieve this either by passing {{delimiter="\s+"}} or specifying {{delim_whitespace=True}} (and both are equivalent, pandas special cases {{delimiter="\s+"}} as any other multi-character delimiter is interpreted as an actual regex and triggers the slower python engine intead of using the default c engine)
> cc [~apitrou] [~npr]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)