You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@arrow.apache.org by "Wes McKinney (JIRA)" <ji...@apache.org> on 2018/10/02 17:45:01 UTC

[jira] [Created] (ARROW-3407) [C++] Add UTF8 conversion modes in CSV reader conversion options

Wes McKinney created ARROW-3407:
-----------------------------------

             Summary: [C++] Add UTF8 conversion modes in CSV reader conversion options
                 Key: ARROW-3407
                 URL: https://issues.apache.org/jira/browse/ARROW-3407
             Project: Apache Arrow
          Issue Type: New Feature
          Components: C++
            Reporter: Wes McKinney
             Fix For: 0.12.0


There should be a few options:

* Assume UTF8, but do not verify ("no seatbelts mode", for users that have reasonable security about UTF8 and want the maximum performance)

* Full UTF8 verification

* Maybe ASCII-only verification (because ASCII verification is very fast)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)