Re: [I] Explore options for accelerating InMemoryTableScanExec [datafusion-comet]

["pchintar (via GitHub)" <gi...@apache.org>]

pchintar commented on issue #2391:
URL: https://github.com/apache/datafusion-comet/issues/2391#issuecomment-4622953124

   Hi @andygrove I've just opened a PR titled [Add Native Support for In-Memory Cache](https://github.com/apache/datafusion-comet/pull/4591) for this issue.
   
   My implementation follows the `CachedBatchSerializer` approach discussed above. It adds a custom cache serializer together with `CometInMemoryTableScanExec`, allowing cached data to be written and read in a Comet-compatible format without any extra conversion steps. I've also added diverse tests to check my new configuration flag behavior as thoroughly as possible.
   
   So, could you kindly pls check it out?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org