You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Antoine Pitrou (Jira)" <ji...@apache.org> on 2020/09/21 18:46:00 UTC

[jira] [Resolved] (ARROW-8494) [C++] Implement basic array-by-array reassembly logic

     [ https://issues.apache.org/jira/browse/ARROW-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Antoine Pitrou resolved ARROW-8494.
-----------------------------------
    Fix Version/s: 2.0.0
       Resolution: Fixed

Issue resolved by pull request 8177
[https://github.com/apache/arrow/pull/8177]

> [C++] Implement basic array-by-array  reassembly logic
> ------------------------------------------------------
>
>                 Key: ARROW-8494
>                 URL: https://issues.apache.org/jira/browse/ARROW-8494
>             Project: Apache Arrow
>          Issue Type: Sub-task
>          Components: C++
>            Reporter: Micah Kornfield
>            Assignee: Micah Kornfield
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 2.0.0
>
>          Time Spent: 8h 40m
>  Remaining Estimate: 0h
>
> This logic would attempt to create the data necessary for each field by passing through the levels once for each field.  it is expected that due to once we can put SIMD/bitmap code in place this will perform better for nested data with shallow nesting, but due to repetitive computation might perform worse for deep nested that include List-types.  The SIMD/bitmap enhancements are covered in: ARROW-9985
>  
> At a high level the logic would be structured as:
> {{for each field:}}
> {{   for each rep/def level entry:}}
> {{           update null bitmask and offsets.}}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)