You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Antoine Pitrou (Jira)" <ji...@apache.org> on 2020/11/10 17:26:00 UTC
[jira] [Commented] (ARROW-10432) [C++] CSV reader: support for
multi-character / whitespace delimiter?
[ https://issues.apache.org/jira/browse/ARROW-10432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17229383#comment-17229383 ]
Antoine Pitrou commented on ARROW-10432:
----------------------------------------
Is that actually useful in the real world?
> [C++] CSV reader: support for multi-character / whitespace delimiter?
> ---------------------------------------------------------------------
>
> Key: ARROW-10432
> URL: https://issues.apache.org/jira/browse/ARROW-10432
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
> Reporter: Joris Van den Bossche
> Priority: Major
>
> I don't know how useful general "multi-character" delimiter support is, but one specific type of it that seems useful is "whitespace delimited", meaning any whitespace (possibly multiple / different whitespace characters).
> In pandas you can achieve this either by passing {{delimiter="\s+"}} or specifying {{delim_whitespace=True}} (and both are equivalent, pandas special cases {{delimiter="\s+"}} as any other multi-character delimiter is interpreted as an actual regex and triggers the slower python engine intead of using the default c engine)
> cc [~apitrou] [~npr]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)