You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@arrow.apache.org by "Ravil Bikbulatov (Jira)" <ji...@apache.org> on 2020/04/20 11:10:00 UTC

[jira] [Created] (ARROW-8527) [C++][CSV] Add support for ReadOptions::skip_rows >= block_size

Ravil Bikbulatov created ARROW-8527:
---------------------------------------

             Summary: [C++][CSV] Add support for ReadOptions::skip_rows >= block_size
                 Key: ARROW-8527
                 URL: https://issues.apache.org/jira/browse/ARROW-8527
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++
            Reporter: Ravil Bikbulatov


Current implementation throws error in reader.cc:286 when skip_rows > header. However, in some workloads skip_rows used for not only skipping header but for just skipping first n-rows. In this case block-size constraint is greatly interferes. I think this constraint could be removed without performance reduction.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)