You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@arrow.apache.org by "Paddy Horan (Jira)" <ji...@apache.org> on 2019/10/23 02:39:00 UTC

[jira] [Created] (ARROW-6971) [Rust] Replace "RecordBatchReader" with "BatchIterator"

Paddy Horan created ARROW-6971:
----------------------------------

             Summary: [Rust] Replace "RecordBatchReader" with "BatchIterator"
                 Key: ARROW-6971
                 URL: https://issues.apache.org/jira/browse/ARROW-6971
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Rust, Rust - DataFusion
    Affects Versions: 0.15.0
            Reporter: Paddy Horan
            Assignee: Paddy Horan
             Fix For: 1.0.0


As part of the recent reader work we introduced 
{code:java}
// arrow::record_batch::RecordBatchReader{code}
but in datafusion we have
{code:java}
// datafusion::physical_plan::BatchIterator
{code}
These two trait are almost identical (BatchIterator implements Send + Sync whereas RecordBatchReader does not).  I propose we replace RecordBatchReader with BatchIterator (i.e. move it to arrow as it's generally useful outside of datafusion) and update parquet and data fusion accordingly.

[~andygrove] [~liurenjie1024] do you see any issues with this? 

 

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)