You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "Umesh7987 (via GitHub)" <gi...@apache.org> on 2025/01/22 04:46:36 UTC
[I] Feature Request / Improvement [iceberg]
Umesh7987 opened a new issue, #12032:
URL: https://github.com/apache/iceberg/issues/12032
### Feature Request / Improvement
Please describe the feature and elaborate on the use case and motivation behind it:
This feature introduces lazy loading of snapshots in TableMetadata. The goal is to improve performance by deferring the loading of snapshots until they are explicitly required.
Use Case:
Reduce upfront cost of loading snapshots:
When working with tables that have numerous snapshots, loading all snapshots at once can be resource-intensive. This feature ensures snapshots are loaded only when needed.
Improves table metadata operations:
This change focuses on retaining snapshot management within the TableMetadata class, ensuring the system only processes necessary snapshots during operations such as traversing snapshots or building new metadata.
Motivation:
This improvement simplifies and optimizes how snapshots are managed and accessed in Iceberg. By implementing lazy loading, the PR minimizes unnecessary operations, aligning with performance and resource utilization goals.
### Query engine
None
### Willingness to contribute
- [ ] I can contribute this improvement/feature independently
- [x] I would be willing to contribute this improvement/feature with guidance from the Iceberg community
- [ ] I cannot contribute this improvement/feature at this time
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Feature Request / Improvement [iceberg]
Posted by "Umesh7987 (via GitHub)" <gi...@apache.org>.
Umesh7987 commented on issue #12032:
URL: https://github.com/apache/iceberg/issues/12032#issuecomment-2606287543
This feature request has already been addressed and implemented in [PR #6811](https://github.com/apache/iceberg/pull/6811). The lazy loading of snapshots in TableMetadata improves performance by deferring snapshot loading until explicitly required. Thank you for reviewing this contribution!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Feature Request / Improvement [iceberg]
Posted by "Umesh7987 (via GitHub)" <gi...@apache.org>.
Umesh7987 closed issue #12032: Feature Request / Improvement
URL: https://github.com/apache/iceberg/issues/12032
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org