You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by "tustvold (via GitHub)" <gi...@apache.org> on 2023/09/27 08:09:35 UTC

[GitHub] [arrow-rs] tustvold commented on issue #4864: improve: reuse `Arc` in parquet record batch reader.

tustvold commented on issue #4864:
URL: https://github.com/apache/arrow-rs/issues/4864#issuecomment-1736910868

   The challenge is bounding the memory usage of the reader and balancing this against the cost of decoding, which for primitives is relatively low. I don't think it is as simple as "keep the arrays around", it will probably require some sort of heuristic


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org