You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@arrow.apache.org by "Yibo Cai (Jira)" <ji...@apache.org> on 2022/03/09 03:24:00 UTC

[jira] [Created] (ARROW-15878) [C++] Optimize csv writer for string with quotes

Yibo Cai created ARROW-15878:
--------------------------------

             Summary: [C++] Optimize csv writer for string with quotes
                 Key: ARROW-15878
                 URL: https://issues.apache.org/jira/browse/ARROW-15878
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++
            Reporter: Yibo Cai
            Assignee: Yibo Cai


Escaping a string with quotes (put an extra quote before a quote) is the hotspot of csv writer [1]. This can probably be improved, possible approaches:
- Find the next quote with memchr, then memcpy blocks without quotes.
- Check if there are quotes with simd in 8 bytes or 16 bytes, do memcpy if no, otherwise go slow path.
Should make sure the method doesn't decrease performance too much for strings with many quotes, or short strings.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)