You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "dentiny (via GitHub)" <gi...@apache.org> on 2025/04/28 17:40:44 UTC
[I] Feature request: manifest file can track deletion vector [iceberg-rust]
dentiny opened a new issue, #1272:
URL: https://github.com/apache/iceberg-rust/issues/1272
### Is your feature request related to a problem or challenge?
Hi team, this feature request is half a question on puffin / deletion vector progress, and half on feature request for manifest support.
As stated in the [spec](https://iceberg.apache.org/spec/#deletion-vectors):
> Delete manifests track deletion vectors individually by the containing file location (file_path), starting offset of the DV blob (content_offset), and total length of the blob (content_size_in_bytes). Multiple deletion vectors can be stored in the same file. There are no restrictions on the data files that can be referenced by deletion vectors in the same Puffin file.
My understanding is, in the manifest file, apart from data file tracking, there're records for puffin files, example:
```json
{
"snapshot_id": 4439194908709239593,
"sequence_number": null,
"file_sequence_number": null,
"data_file": {
"content": 0,
"file_path": "file:///tmp/iceberg-test/default/test_table/data/iceberg-data-00000.parquet",
"file_format": "PARQUET",
...,
},
"puffin_file": {
"file_path": "file:///tmp/dir/puffin.bin",
"file_format": "PUFFIN",
"content": DELETION_VECTOR_TYPE,
"content_offset": ...,
"content_size_in_bytes": ...,
}
}
```
I'm aware there's an [epic](https://github.com/apache/iceberg-rust/issues/744) about puffin progress, but I don't see any change on manifest side in the PRs.
Curious am I mis-understanding for the spec, is it already implemented but I'm not aware of, or we have plans to implement that in the future?
Thank you!
### Describe the solution you'd like
_No response_
### Willingness to contribute
None
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Feature request: manifest file can track deletion vector [iceberg-rust]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #1272:
URL: https://github.com/apache/iceberg-rust/issues/1272#issuecomment-3449054035
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Feature request: manifest file can track deletion vector [iceberg-rust]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #1272:
URL: https://github.com/apache/iceberg-rust/issues/1272#issuecomment-3514444555
This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Feature request: manifest file can track deletion vector [iceberg-rust]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #1272: Feature request: manifest file can track deletion vector
URL: https://github.com/apache/iceberg-rust/issues/1272
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Feature request: manifest file can track deletion vector [iceberg-rust]
Posted by "liurenjie1024 (via GitHub)" <gi...@apache.org>.
liurenjie1024 commented on issue #1272:
URL: https://github.com/apache/iceberg-rust/issues/1272#issuecomment-2837683599
Thanks @dentiny for raising this. It's only about puffin format reader/writer. Statistics and deletion vector are not supported yet.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org