Re: [I] Add support for conversion of in memory tables to protobuf [datafusion-python]

["aditanase (via GitHub)" <gi...@apache.org>]

aditanase commented on issue #898:
URL: https://github.com/apache/datafusion-python/issues/898#issuecomment-2829701511

   What would be the expectation in that case? A MemTable resides on your heap, while CSV is potentially on disk. Would you expect that the data would be serialized as part of the plan? How would the execution work on the other side?
   
   I've seen some of this done in the substrait project:
   https://substrait.io/relations/logical_relations/#virtual-table
   
   I would imagine that one could write an extension codec that serializes the arrow table as well, but it would be extra work, not sure of the use case though.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org