[jira] [Created] (ARROW-15535) [C++] Investigate automatic generation of YAML for Substrait extension functions & types

["Weston Pace (Jira)" <ji...@apache.org>]

Weston Pace created ARROW-15535:
-----------------------------------

             Summary: [C++] Investigate automatic generation of YAML for Substrait extension functions & types
                 Key: ARROW-15535
                 URL: https://issues.apache.org/jira/browse/ARROW-15535
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++
            Reporter: Weston Pace


Arrow supports data types that are not in the Substrait spec (e.g. unsigned integers) and supports functions that are not in the Substrait spec.

As a convenience for consumers we can generate a YAML document that describes all the things Arrow supports that are not part of the Substrait spec.  ARROW-15238 has an incomplete example of what this YAML might look like.

This YAML can allow for things like better ahead-of-time validation by milddleman validators and optimizers.  It is not strictly required to use these features.

We should investigate our ability to generate this automatically.  However, this can get fairly complicated.  For example, we don't want to blindly generate YAML for all functions and types because many of the functions and types map to existing functions and types in the core Substrait spec.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)