You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2022/05/05 08:46:03 UTC
[GitHub] [iceberg] rajarshisarkar opened a new pull request, #4701: Spark 3.x: Support rewrite data files with starting sequence number
rajarshisarkar opened a new pull request, #4701:
URL: https://github.com/apache/iceberg/pull/4701
I noticed that `use-starting-sequence-number` option is missing while developing https://github.com/apache/iceberg/pull/4377 and https://github.com/apache/iceberg/pull/4579. Adding support for the same in this PR.
When `use-starting-sequence-number` is enabled then compaction should use the sequence number of the snapshot at compaction start time for new data files, instead of using the sequence number of the newly produced snapshot. This avoids commit conflicts with updates that add newer equality deletes at a higher sequence number.
---
cc: @RussellSpitzer @jackye1995 @szehon-ho
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] RussellSpitzer commented on pull request #4701: Spark 3.x: Support rewrite data files with starting sequence number
Posted by GitBox <gi...@apache.org>.
RussellSpitzer commented on PR #4701:
URL: https://github.com/apache/iceberg/pull/4701#issuecomment-1118698861
Thanks @rajarshisarkar !
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] RussellSpitzer merged pull request #4701: Spark 3.x: Support rewrite data files with starting sequence number
Posted by GitBox <gi...@apache.org>.
RussellSpitzer merged PR #4701:
URL: https://github.com/apache/iceberg/pull/4701
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org