You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by "NoahFournier (via GitHub)" <gi...@apache.org> on 2023/03/15 09:26:54 UTC

[GitHub] [arrow] NoahFournier commented on issue #13949: [java] reading multiple parquet files takes unresonable amount of memory

NoahFournier commented on issue #13949:
URL: https://github.com/apache/arrow/issues/13949#issuecomment-1469652026

   Has anyone taken a further look at this? We are also running into an issue from Java when using the Dataset scanner, where it seems that the reader is pulling the entire file into memory, which is causing large memory pressure 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org