You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Anthony Abate (Jira)" <ji...@apache.org> on 2019/09/25 03:36:00 UTC
[jira] [Updated] (ARROW-6681) [C# -> R] - Record Batches in reverse
order?
[ https://issues.apache.org/jira/browse/ARROW-6681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Anthony Abate updated ARROW-6681:
---------------------------------
Component/s: R
> [C# -> R] - Record Batches in reverse order?
> --------------------------------------------
>
> Key: ARROW-6681
> URL: https://issues.apache.org/jira/browse/ARROW-6681
> Project: Apache Arrow
> Issue Type: New Feature
> Components: C#, R
> Affects Versions: 0.14.1
> Reporter: Anthony Abate
> Priority: Minor
>
> Are 'RecordBatches' being in C# being written in reverse order?
> I made a simple test which creates a single row per record batch of 0 to 99 and attempted to read this in R. To my surprise batch(0) in R had the value 99 not 0
> This may not seem like a big deal, however when dealing with 'huge' files, its more efficient to use Record Batches / index lookup than attempting to load the entire file into memory.
> Having the order consistent within the different language / API seems only to make sense - for now I can work around this by reversing the order before writing.
>
> https://github.com/apache/arrow/issues/5475
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)