You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "Madhav064 (via GitHub)" <gi...@apache.org> on 2025/02/01 20:31:48 UTC
[I] question on iceberg table [iceberg]
Madhav064 opened a new issue, #12150:
URL: https://github.com/apache/iceberg/issues/12150
### Query engine
_No response_
### Question
What are the best practices for maintaining Iceberg tables, particularly regarding retention, orphan file deletion, and compaction? How do the approaches differ when using Spark Iceberg APIs versus Java Iceberg APIs? Additionally, can you provide insights into the performance impacts of the MOR (Merge on Read) and COW (Copy on Write) strategies?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] question on iceberg table [iceberg]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #12150:
URL: https://github.com/apache/iceberg/issues/12150#issuecomment-3146872128
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] question on iceberg table [iceberg]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #12150: question on iceberg table
URL: https://github.com/apache/iceberg/issues/12150
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] question on iceberg table [iceberg]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #12150:
URL: https://github.com/apache/iceberg/issues/12150#issuecomment-3194758505
This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] question on iceberg table [iceberg]
Posted by "RussellSpitzer (via GitHub)" <gi...@apache.org>.
RussellSpitzer commented on issue #12150:
URL: https://github.com/apache/iceberg/issues/12150#issuecomment-2630889126
This is really more of questions for a whole book or a series of talks, I would recommend checking out
https://www.youtube.com/playlist?list=PLkifVhhWtccxBSrKFPXOmjAFFEpeYii5K
For all the Iceberg Summit videos from last year
For short answers:
You should run all those maintenance things. The most important for most people are Rewrite Metadata and Expire Snapshots. The others are more contextual and expensive to actually run so it's usage dependent imho.
Spark Apis use distributed computing, thats the biggest difference. The Java APIS are also much more low level in Iceberg, more for users building engines or doing custom logic.
MOR is faster on write, slower on read. Good for sparse deletes
COW is slower on write, faster on read. Good for dense deletes (many deletes in the same file - 30% or more of the file replaced)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org