You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "asg0451 (via GitHub)" <gi...@apache.org> on 2025/10/15 02:12:52 UTC
[I] support for row delta [iceberg-go]
asg0451 opened a new issue, #602:
URL: https://github.com/apache/iceberg-go/issues/602
### Feature Request / Improvement
it looks like row delta writes are not supported. is there a reason for this? would it be a low complexity task someone unfamiliar with the project (me) can take on?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] support for row delta [iceberg-go]
Posted by "zeroshade (via GitHub)" <gi...@apache.org>.
zeroshade closed issue #602: support for row delta
URL: https://github.com/apache/iceberg-go/issues/602
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] support for row delta [iceberg-go]
Posted by "zeroshade (via GitHub)" <gi...@apache.org>.
zeroshade commented on issue #602:
URL: https://github.com/apache/iceberg-go/issues/602#issuecomment-3597411360
I don't think it would be a low complexity task unfortunately. I also don't see in the iceberg spec how to perform row delta writes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] support for row delta [iceberg-go]
Posted by "laskoviymishka (via GitHub)" <gi...@apache.org>.
laskoviymishka commented on issue #602:
URL: https://github.com/apache/iceberg-go/issues/602#issuecomment-4063879892
I've been looking into this for a while and I think it's more feasible than it might seem — iceberg-go already has most of the plumbing in place. The `snapshotProducer` supports data files + position delete files in one snapshot, `DataFileBuilder.EqualityFieldIDs()` exists, and the metrics infrastructure already handles equality deletes.
My thinking is to approach this incrementally:
1. Start with the RowDelta API surface itself — a builder on `Transaction` that commits data files + delete files in one snapshot. This would work immediately with position deletes that are already supported end-to-end.
2. Then add equality delete file writing (the writer, schema projection, wiring into the snapshot producer).
3. Then equality delete reading in the scanner (the hardest part — hash-based anti-join + sequence number filtering).
I have a concrete use case driving this — CDC replication from Postgres to Iceberg via [Transferia](https://github.com/transferia/iceberg) ([transferia/iceberg#4](https://github.com/transferia/iceberg/issues/4)). I'm working on a related multi-table commit feature (#784) right now and plan to pick this up next. Happy to share a more detailed breakdown or discuss API design before starting.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org