You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Jianshen Liu (Jira)" <ji...@apache.org> on 2022/11/20 06:10:00 UTC

[jira] [Created] (ARROW-18367) Enable using InMemoryDataset to create substrait plans

Jianshen Liu created ARROW-18367:
------------------------------------

             Summary: Enable using InMemoryDataset to create substrait plans
                 Key: ARROW-18367
                 URL: https://issues.apache.org/jira/browse/ARROW-18367
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++
            Reporter: Jianshen Liu
             Fix For: 11.0.0


We think that the `Named Table` relation supported by substrait is an important abstraction in HPC to enable remote executions. To enable the creation of named tables with the `engine::SerializePlan` API, we would like to add the support of `InMemoryDataset` to scan nodes to be used to convert to substrait plans. The idea is to save the `names` of a named table in the metadata of the schema used to create the InMemoryDataset.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)