You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Nate Clark (Jira)" <ji...@apache.org> on 2021/06/09 18:58:00 UTC

[jira] [Created] (ARROW-13028) [C++] CSV add convert option to attempt 32bit number inferences

Nate Clark created ARROW-13028:
----------------------------------

             Summary: [C++] CSV add convert option to attempt 32bit number inferences
                 Key: ARROW-13028
                 URL: https://issues.apache.org/jira/browse/ARROW-13028
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++
            Reporter: Nate Clark
            Assignee: Nate Clark


When types are being inferred by CSV the numbers are always 64 bit. For large data sets it could be better to use 32 bit types to save over all memory. To do this it would be useful to add an option to ConvertOptions to try 32 bit numbers before 64 bit. By default this option would be disabled.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)