You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Weston Pace (Jira)" <ji...@apache.org> on 2022/02/03 04:20:00 UTC

[jira] [Created] (ARROW-15540) [C++] Allow the substrait consumer to accept plans with hints and nullable literals

Weston Pace created ARROW-15540:
-----------------------------------

             Summary: [C++] Allow the substrait consumer to accept plans with hints and nullable literals
                 Key: ARROW-15540
                 URL: https://issues.apache.org/jira/browse/ARROW-15540
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++
            Reporter: Weston Pace


The first pass of the substrait consumer was created with the philosophy of rejecting any plan that it could not safely round trip (e.g. Substrait -> Arrow Exec Plan -> Substrait).

As a result it rejects plans that contain elements we cannot represent in Arrow Exec Plans.  Two prominent elements that are likely to start existing soon in producers are nullable literals and hints.

To put it another way, a producer might insert a hint like "this column is sorted" into a plan.  Currently the Arrow exec plans can't make use of this kind of data.  So rather than just ignore the hint we reject the plan.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)