You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "timsaucer (via GitHub)" <gi...@apache.org> on 2024/11/08 11:38:44 UTC
[I] Add protobuf codecs for FFI physical plans [datafusion]
timsaucer opened a new issue, #13309:
URL: https://github.com/apache/datafusion/issues/13309
### Is your feature request related to a problem or challenge?
https://github.com/apache/datafusion/pull/12920 added FFI Physical Plans. These cannot be encoded or decoded with the DefaultPhysicalExtensionCodec. We cannot serialize these plans that include foreign elements. I would like to add a way to provide for serialization/deserialization across the FFI boundary.
### Describe the solution you'd like
Add an additional struct along the lines of `FFI_PhysicalExtensionCodec` that implements `PhysicalExtensionCodec`.
### Describe alternatives you've considered
None that I can think of, other than to find work arounds to not serialize these plans.
### Additional context
This is needed to support adding a `FFI_QueryPlanner` so that we can do things like use a different library to generate physical plans. The use case I currently have in mind is `datafusion-ray` where we want to make a query planner that can automatically distribute work across multiple nodes in a cluster.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Add protobuf codecs for FFI physical plans [datafusion]
Posted by "timsaucer (via GitHub)" <gi...@apache.org>.
timsaucer commented on issue #13309:
URL: https://github.com/apache/datafusion/issues/13309#issuecomment-3936268191
Closed by https://github.com/apache/datafusion/pull/19079
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Add protobuf codecs for FFI physical plans [datafusion]
Posted by "timsaucer (via GitHub)" <gi...@apache.org>.
timsaucer closed issue #13309: Add protobuf codecs for FFI physical plans
URL: https://github.com/apache/datafusion/issues/13309
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org