You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Joris Van den Bossche (Jira)" <ji...@apache.org> on 2021/05/10 12:09:00 UTC
[jira] [Updated] (ARROW-8527) [C++][CSV] Add support for
ReadOptions::skip_rows >= block_size
[ https://issues.apache.org/jira/browse/ARROW-8527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joris Van den Bossche updated ARROW-8527:
-----------------------------------------
Labels: csv (was: )
> [C++][CSV] Add support for ReadOptions::skip_rows >= block_size
> ---------------------------------------------------------------
>
> Key: ARROW-8527
> URL: https://issues.apache.org/jira/browse/ARROW-8527
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
> Reporter: Ravil Bikbulatov
> Priority: Major
> Labels: csv
>
> Current implementation throws error in reader.cc:286 when skip_rows > header. However, in some workloads skip_rows used for not only skipping header but for just skipping first n-rows. In this case block-size constraint is greatly interferes. I think this constraint could be removed without performance reduction.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)