You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2022/11/04 23:47:12 UTC
[GitHub] [iceberg] szehon-ho opened a new issue, #6126: RemoveDanglingDeleteFiles
szehon-ho opened a new issue, #6126:
URL: https://github.com/apache/iceberg/issues/6126
### Feature Request / Improvement
With DeleteFiles introduced to Iceberg Spec V2, we need a mechanism to remove them from the current snapshot after they become invalid.
Proposal is here: https://docs.google.com/document/d/11d-cIUR_89kRsMmWnEoxXGZCvp7L4TUmPJqUC60zB5M/edit#
Pre-requisite for Phase 2 will depend on : https://github.com/apache/iceberg/pull/4812 which is not yet merged. That is pending refactoring of ScanTask like in https://github.com/apache/iceberg/pull/5922 that needs to be propagated to Spark layer.
### Query engine
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] szehon-ho closed issue #6126: RemoveDanglingDeleteFiles
Posted by "szehon-ho (via GitHub)" <gi...@apache.org>.
szehon-ho closed issue #6126: RemoveDanglingDeleteFiles
URL: https://github.com/apache/iceberg/issues/6126
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] RemoveDanglingDeleteFiles [iceberg]
Posted by "chenwyi2 (via GitHub)" <gi...@apache.org>.
chenwyi2 commented on issue #6126:
URL: https://github.com/apache/iceberg/issues/6126#issuecomment-1838200429
RewritePositionDeleteFiles cannot remove equality delete file, only works with position delete file?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] RemoveDanglingDeleteFiles [iceberg]
Posted by "chenwyi2 (via GitHub)" <gi...@apache.org>.
chenwyi2 commented on issue #6126:
URL: https://github.com/apache/iceberg/issues/6126#issuecomment-1842153186
so how about equality delete file?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] lintingbin2009 commented on issue #6126: RemoveDanglingDeleteFiles
Posted by "lintingbin2009 (via GitHub)" <gi...@apache.org>.
lintingbin2009 commented on issue #6126:
URL: https://github.com/apache/iceberg/issues/6126#issuecomment-1409839075
@szehon-ho I have the same problem, is there any progress update?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] lintingbin2009 commented on issue #6126: RemoveDanglingDeleteFiles
Posted by "lintingbin2009 (via GitHub)" <gi...@apache.org>.
lintingbin2009 commented on issue #6126:
URL: https://github.com/apache/iceberg/issues/6126#issuecomment-1605830750
@szehon-ho Thanks! Already used it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] szehon-ho commented on issue #6126: RemoveDanglingDeleteFiles
Posted by "szehon-ho (via GitHub)" <gi...@apache.org>.
szehon-ho commented on issue #6126:
URL: https://github.com/apache/iceberg/issues/6126#issuecomment-1605117477
Sorry late reply, this is already fixed by new procedure RewritePositionDeleteFiles. It will clean dangling deletes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] RemoveDanglingDeleteFiles [iceberg]
Posted by "ajantha-bhat (via GitHub)" <gi...@apache.org>.
ajantha-bhat commented on issue #6126:
URL: https://github.com/apache/iceberg/issues/6126#issuecomment-1838243493
> RewritePositionDeleteFiles cannot remove equality delete file, only works with position delete file?
Yes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org