[jira] [Comment Edited] (ARROW-11103) [Rust] [DataFusion] serialize and deserialize physical plan by serde

["GANG LIAO (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-11103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17257291#comment-17257291 ] 

GANG LIAO edited comment on ARROW-11103 at 1/2/21, 5:09 AM:
------------------------------------------------------------

I found that Arrow’s data type and schema both support serialization into JSON ([https://github.com/apache/arrow/pull/3016/files]). Can the community also support the physical plan serialization? Or are there other challenges?

 

If datafusion does not support serialization, we can only extend it externally via this post: [https://serde.rs/impl-serializer.html#implementing-a-serializer]

 


was (Author: gangliao):
I found that Arrow’s data type and schema both support serialization into JSON (https://github.com/apache/arrow/pull/3016/files). Can the community serialize physical plans? Or are there other challenges?

 

If datafusion does not support serialization, we can only extend it externally via this post: https://serde.rs/impl-serializer.html#implementing-a-serializer

 

> [Rust] [DataFusion] serialize and deserialize physical plan by serde
> --------------------------------------------------------------------
>
>                 Key: ARROW-11103
>                 URL: https://issues.apache.org/jira/browse/ARROW-11103
>             Project: Apache Arrow
>          Issue Type: Wish
>            Reporter: GANG LIAO
>            Priority: Critical
>
> It is important to send part of the generated physical plan to other servers over the network for distributed computation.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)