You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by "thisisnic (via GitHub)" <gi...@apache.org> on 2026/10/22 07:12:06 UTC

Re: [I] pd.read_parquet using filters consumes too much memory [arrow]

thisisnic commented on issue #31771:
URL: https://github.com/apache/arrow/issues/31771#issuecomment-6334995046

   @pitrou I'm going through old `Type: bug` issues. This report of higher RSS for `pd.read_parquet(..., filters=...)` was against pyarrow 4.0.1/7.0.0; the scanner memory work in 8.0.0 (#30892) was expected to address it and the reporter never came back with a re-measurement, and the `use_legacy_dataset` baseline they compared against no longer exists. Do you see any reason to keep this open, or are you happy for me to close it?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org