You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "Pandas886 (via GitHub)" <gi...@apache.org> on 2026/07/11 14:53:35 UTC
[I] Support rowkind.field for CDC-style writes on deduplicate PK tables [paimon-rust]
Pandas886 opened a new issue, #502:
URL: https://github.com/apache/paimon-rust/issues/502
### Describe the feature
I'd like to write changelog-style rows into a primary-key table by putting the row kind (`+I` / `-U` / `+U` / `-D`) in a user column, matching Java's `rowkind.field` option.
Today the Rust write path fails loud with something like "KeyValueFileWriter does not support rowkind.field", even though the option can already be parsed.
### Motivation
This is useful for CDC / ETL pipelines that already carry a short string op column and don't want to invent a separate `_VALUE_KIND` convention on the client side.
### Proposed scope
- Parse short-string row kinds (`+I`, `-U`, `+U`, `-D`)
- Honor `rowkind.field` on **deduplicate** PK tables only
- Validate the configured field (exists, STRING, not conflicting with system columns)
- Support `ignore-delete` / `ignore-update-before` filtering when writing
- Integration tests aligned with the Java ITCase scenarios I could map over
Out of scope for this issue: other merge engines, lookup/compact, DataFusion SQL surface.
### Additional context
Happy to send a PR if this direction looks good.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Support rowkind.field for CDC-style writes on deduplicate PK tables [paimon-rust]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi closed issue #502: Support rowkind.field for CDC-style writes on deduplicate PK tables
URL: https://github.com/apache/paimon-rust/issues/502
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org