You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "kyteware (via GitHub)" <gi...@apache.org> on 2025/06/10 14:36:28 UTC
[PR] feat: Cache for data files, integrated into `FileIO` [iceberg-rust]
kyteware opened a new pull request, #1430:
URL: https://github.com/apache/iceberg-rust/pull/1430
## Which issue does this PR close?
Closes part of #1226
<!--
We generally require a GitHub issue to be filed for all bug fixes and enhancements and this helps us generate change logs for our releases. You can link an issue to this PR using the GitHub syntax. For example `Closes #123` indicates that this PR will close issue #123.
-->
## What changes are included in this PR?
<!--
Provide a summary of the modifications in this PR. List the main changes such as new features, bug fixes, refactoring, or any other updates.
-->
- Simple implementation of new `DataCache` for caching data file content.
- Integration of new `DataCache` with `FileIO`, including a new `CachedFileReader` that wraps `opendal::Reader`.
### TODO for me before merging
- [ ] Add tests/find bugs
- [ ] Create benchmarking tool for iceberg to observe performance gains
- [ ] Add logic for file length awareness so `DataCache` can be used for whole-file reads as well.
- [ ] Resolve TODOs in code
- [ ] Resolve merge conflicts
- [ ] Check status on new `FileIO` design.
## Are these changes tested?
Not yet, its on the list :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] feat: Cache for data files, integrated into `FileIO` [iceberg-rust]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #1430:
URL: https://github.com/apache/iceberg-rust/pull/1430#issuecomment-4001170040
This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [PR] feat: Cache for data files, integrated into `FileIO` [iceberg-rust]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed pull request #1430: feat: Cache for data files, integrated into `FileIO`
URL: https://github.com/apache/iceberg-rust/pull/1430
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org