You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@datafusion.apache.org by "andygrove (via GitHub)" <gi...@apache.org> on 2026/09/28 00:01:59 UTC

Re: [I] Performance optimizations for native in-memory cache (follow-on to #4591) [datafusion-comet]

andygrove commented on issue #4781:
URL: https://github.com/apache/datafusion-comet/issues/4781#issuecomment-5861041038

   All five items are now done or moot. The projection is built once per partition, the per-scan deep copy went away with the Arrow C Stream migration in #4572, #5734 specialized the statistics loops and copies string bounds only when they change, and #5543 added spark.comet.exec.inMemoryCache.compression.codec=none for an uncompressed cache. The remaining cache performance work is tracked in #5485 and #5487.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org