You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Weston Pace (Jira)" <ji...@apache.org> on 2022/09/16 23:28:00 UTC

[jira] [Created] (ARROW-17762) [C++] Add ordering information to exec batches

Weston Pace created ARROW-17762:
-----------------------------------

             Summary: [C++] Add ordering information to exec batches
                 Key: ARROW-17762
                 URL: https://issues.apache.org/jira/browse/ARROW-17762
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++
            Reporter: Weston Pace
            Assignee: Weston Pace


I proposed this ages ago in https://lists.apache.org/thread/xpn9gyrs6kqc3g9t8k4ts8dmy7yyxskq and am finally getting around to implementing it.

I propose to add ordering information to exec nodes (mostly for node validation) and indices to exec batches.  This is a fundamental step to allow nodes to consume this ordering information to achieve features such as ARROW-10883 and ARROW-16628.  It also can replace the complicated batch enumeration in the current scanner to support in-order table reassembly.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)