You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "fallintoplace (via GitHub)" <gi...@apache.org> on 2026/08/26 13:45:24 UTC
[I] Support delete-file-backed row changes in incremental changelog scans [iceberg-go]
fallintoplace opened a new issue, #1884:
URL: https://github.com/apache/iceberg-go/issues/1884
## Summary
The incremental changelog scan in #1883 currently plans changes from data-manifest entries:
- **INSERT** for added data files
- **DELETE** for removed data files
Snapshots with delete manifests are not supported yet.
## Follow-up
Add changelog support for row changes produced by:
- position delete files
- equality delete files
- deletion vectors
The planner should distinguish deletes produced by the current snapshot from rows that were already deleted by earlier snapshots. The reader should return the rows removed by the current change.
The task API will likely need separate added-delete and existing-delete information, similar to the Java changelog task types.
## Related
- PR #1883: https://github.com/apache/iceberg-go/pull/1883
- Java reference: https://github.com/apache/iceberg/blob/main/core/src/main/java/org/apache/iceberg/BaseIncrementalChangelogScan.java
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Support delete-file-backed row changes in incremental changelog scans [iceberg-go]
Posted by "fallintoplace (via GitHub)" <gi...@apache.org>.
fallintoplace commented on issue #1884:
URL: https://github.com/apache/iceberg-go/issues/1884#issuecomment-5461680737
@dgvj-work Feel free to takeover the feature.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Support delete-file-backed row changes in incremental changelog scans [iceberg-go]
Posted by "fallintoplace (via GitHub)" <gi...@apache.org>.
fallintoplace commented on issue #1884:
URL: https://github.com/apache/iceberg-go/issues/1884#issuecomment-5436159401
@dgvj-work Sure, this is an important feature.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Support delete-file-backed row changes in incremental changelog scans [iceberg-go]
Posted by "dgvj-work (via GitHub)" <gi...@apache.org>.
dgvj-work commented on issue #1884:
URL: https://github.com/apache/iceberg-go/issues/1884#issuecomment-6093618290
The rest of this issue is up for review as separate PRs:
- #2169 plans delete-file changes
- #2170 reads added and removed data files
- #2171 reads rows removed by position deletes, equality deletes, and deletion vectors
Remote planning stays unsupported. @zeroshade is requested on each PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Support delete-file-backed row changes in incremental changelog scans [iceberg-go]
Posted by "laskoviymishka (via GitHub) via issues" <is...@iceberg.apache.org>.
laskoviymishka closed issue #1884: Support delete-file-backed row changes in incremental changelog scans
URL: https://github.com/apache/iceberg-go/issues/1884
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Support delete-file-backed row changes in incremental changelog scans [iceberg-go]
Posted by "dgvj-work (via GitHub)" <gi...@apache.org>.
dgvj-work commented on issue #1884:
URL: https://github.com/apache/iceberg-go/issues/1884#issuecomment-5434384746
I'd like to pick this up if nobody else is on it — extending incremental changelog scans to cover delete-file-backed row changes, on top of the file-level work in #1883.
I'll start with the planned task/reader types and a PR when I have something reviewable.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Support delete-file-backed row changes in incremental changelog scans [iceberg-go]
Posted by "fallintoplace (via GitHub) via issues" <is...@iceberg.apache.org>.
fallintoplace commented on issue #1884:
URL: https://github.com/apache/iceberg-go/issues/1884#issuecomment-6540723804
Nice work @dgvj-work
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org