You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "Fokko (via GitHub)" <gi...@apache.org> on 2024/11/27 13:39:52 UTC

[I] Generation of Snapshot Summaries [iceberg-rust]

Fokko opened a new issue, #724:
URL: https://github.com/apache/iceberg-rust/issues/724

   With each snapshot comes a summary map, optional in V1, required in V2 and later: 
   
   ![image](https://github.com/user-attachments/assets/87610e26-65f7-4322-8f7c-9eea318f502f)
   
   The summary contains information such as what kind of files the snapshot contains (data/delete), and what the changes are in rows and bytes. The best way to replicate this metrics collection is by looking at the Java code: https://github.com/apache/iceberg/blob/main/core/src/main/java/org/apache/iceberg/SnapshotSummary.java
   
   This class works closely alongside the `SnapshotProducer` and tracks what happens with the snapshot.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] Generation of Snapshot Summaries [iceberg-rust]

Posted by "liurenjie1024 (via GitHub)" <gi...@apache.org>.
liurenjie1024 closed issue #724: Generation of Snapshot Summaries
URL: https://github.com/apache/iceberg-rust/issues/724


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] Generation of Snapshot Summaries [iceberg-rust]

Posted by "c-thiel (via GitHub)" <gi...@apache.org>.
c-thiel commented on issue #724:
URL: https://github.com/apache/iceberg-rust/issues/724#issuecomment-2508917605

   @barronw gladly! Assigned the issue to you :)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] Generation of Snapshot Summaries [iceberg-rust]

Posted by "barronw (via GitHub)" <gi...@apache.org>.
barronw commented on issue #724:
URL: https://github.com/apache/iceberg-rust/issues/724#issuecomment-2507766282

   Can I pick this up?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] Generation of Snapshot Summaries [iceberg-rust]

Posted by "liurenjie1024 (via GitHub)" <gi...@apache.org>.
liurenjie1024 closed issue #724: Generation of Snapshot Summaries
URL: https://github.com/apache/iceberg-rust/issues/724


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [I] Generation of Snapshot Summaries [iceberg-rust]

Posted by "barronw (via GitHub)" <gi...@apache.org>.
barronw commented on issue #724:
URL: https://github.com/apache/iceberg-rust/issues/724#issuecomment-2646357548

   @c-thiel Feel free to re-assign this to someone else (maybe @jonathanc-n). I won't be able to complete this soon, so I pushed what I have to my fork for reference ([link](https://github.com/barronw/iceberg-rust/commit/dfb9af3787c5298b221ecbb21cf995a6a9ce2924#diff-5e326a2efd4462583e1c8be25a072f23b34b33787636c2f9ceed55f11c156d0c)).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org