You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "flyrain (via GitHub)" <gi...@apache.org> on 2024/07/05 23:11:50 UTC
[I] REST Spec: Server-side Metadata Tables [iceberg]
flyrain opened a new issue, #10645:
URL: https://github.com/apache/iceberg/issues/10645
### Feature Request / Improvement
### Proposed Change
This proposal introduces table metadata APIs to the Iceberg REST catalog (IRC) specification.
One of Iceberg's most advantageous features is the ability to inspect a table using metadata tables. For instance, we can query snapshots just like we query data rows using the following command: `SELECT * FROM prod.db.table.snapshots;`
With the REST catalog, we can simplify this process further by providing metadata directly from REST endpoints. Here are several benefits of this approach:
1. Engine Independence: The metadata tables do not rely on a specific implementation of an engine. The REST server returns the results directly. For example, the Rust Iceberg does not need to implement its own logic to query the snapshot table if it connects to a server with this capability. This reduces the complexity and development effort required for different clients and engines.
2. Enabled New Use Cases: A catalog UI or Lakehouse UI can present a table's metadata (e.g., snapshot/partition list) without relying on an engine like Trino. This opens up possibilities for lightweight UIs and tools that can directly interact with the REST endpoints to retrieve and display metadata.
3. Enhanced Performance: With server-side caching, the server-side metadata tables will perform better. Caching reduces the need to repeatedly compute or retrieve metadata, leading to faster response times and reduced load on the underlying storage systems.
### Proposal document
https://docs.google.com/document/d/1MVLwyMQtZ-7jewsQ0PuTvtJbpfl4HCoVdbowMqFTmfc/edit#heading=h.fsbkvox608i
### Specifications
- [X] Table
- [ ] View
- [X] REST
- [ ] Puffin
- [ ] Encryption
- [ ] Other
### Query engine
None
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] REST Spec: Server-side Metadata Tables [iceberg]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #10645: REST Spec: Server-side Metadata Tables
URL: https://github.com/apache/iceberg/issues/10645
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] REST Spec: Server-side Metadata Tables [iceberg]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #10645:
URL: https://github.com/apache/iceberg/issues/10645#issuecomment-2567194812
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] REST Spec: Server-side Metadata Tables [iceberg]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #10645:
URL: https://github.com/apache/iceberg/issues/10645#issuecomment-2597166763
This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org