You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Jorge Leitão (Jira)" <ji...@apache.org> on 2020/10/17 08:19:00 UTC

[jira] [Created] (ARROW-10332) [Rust] Allow CSV reader to start from a line

Jorge Leitão created ARROW-10332:
------------------------------------

             Summary: [Rust] Allow CSV reader to start from a line
                 Key: ARROW-10332
                 URL: https://issues.apache.org/jira/browse/ARROW-10332
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Rust
            Reporter: Jorge Leitão
            Assignee: Jorge Leitão
             Fix For: 3.0.0


Currently, the CSV reader always start from 0 and go until the end, which makes it impossible for DataFusion to split a single file in parts, e.g. via multiple readers.

The goal of this issue is to generalize the reader to support starting from an arbitrary location (via iterating), and also have an optional upper limit.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)