You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "JoaoAparicio (via GitHub)" <gi...@apache.org> on 2023/04/03 00:25:06 UTC

[GitHub] [arrow-julia] JoaoAparicio commented on issue #340: Feather file with compression and larger than RAM

JoaoAparicio commented on issue #340:
URL: https://github.com/apache/arrow-julia/issues/340#issuecomment-1493485143

   > Hmmmm......we'll have to see what we can do here. I've had the idea for a while as a Tables.jl-wide feature to support projection/filter push down for sources in a generic way. That would translate really well to Arrow and would allow us to more easily avoid decompressing when not necessary. There's probably more we can do in the short-term though to avoid materializing when not needed.
   
   Ping for comments on #412.
   This isn't the most general filter push down, but it does allow us to avoid unnecessary decompression.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org