You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@opendal.apache.org by "zqianem (via GitHub)" <gi...@apache.org> on 2026/10/03 13:19:50 UTC
[I] Document that `FoyerLayer` caches entire file when reading with range [opendal]
zqianem opened a new issue, #8370:
URL: https://github.com/apache/opendal/issues/8370
It was unexpected to me that using `FoyerLayer` would cause range reads (e.g. `operator.read_with("some/path").range(0..1024)`) to fetch and cache the entire file — in my case the full files are large compared to the range I was requesting and it made the reads very slow.
At first, I thought this was a bug (perhaps #7686?) but actually it seems to be intended behavior for now ([this review thread](https://github.com/apache/opendal/pull/6366/changes/BASE..c7bede36f7b9773713e247cef65d67bb5e1c09aa#r2199978606) + [this source code comment](https://github.com/apache/opendal/blob/95f7c8bfd67e8c988a97063f40a4ae203f6c18ae/core/layers/foyer/src/full.rs#L189)).
Could this be documented somewhere more visible like [the rustdoc page](https://opendal.apache.org/docs/rust/opendal/layers/struct.FoyerLayer.html)?
(Also, would it be possible to get a specific template for reporting these sorts of documentation issues? 🙂)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Document that `FoyerLayer` caches entire file when reading with range [opendal]
Posted by "itsmunzir (via GitHub)" <gi...@apache.org>.
itsmunzir commented on issue #8370:
URL: https://github.com/apache/opendal/issues/8370#issuecomment-6011451597
I will take this. I will document on the FoyerLayer rustdoc that a range read can still fetch and cache the entire object, with a pointer to the design intent. Documentation only.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Document that `FoyerLayer` caches entire file when reading with range [opendal]
Posted by "itsmunzir (via GitHub)" <gi...@apache.org>.
itsmunzir commented on issue #8370:
URL: https://github.com/apache/opendal/issues/8370#issuecomment-6011456162
Withdrawn — I missed open PR #8373 for this, which covers the same documentation. I yield it to that PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Document that `FoyerLayer` caches entire file when reading with range [opendal]
Posted by "Xuanwo (via GitHub)" <gi...@apache.org>.
Xuanwo closed issue #8370: Document that `FoyerLayer` caches entire file when reading with range
URL: https://github.com/apache/opendal/issues/8370
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org