You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "Pandas886 (via GitHub)" <gi...@apache.org> on 2026/07/11 14:53:39 UTC
[I] Batch incremental scan: read existing changelog manifests + AuditLogTable [paimon-rust]
Pandas886 opened a new issue, #504:
URL: https://github.com/apache/paimon-rust/issues/504
### Describe the feature
Extend the batch incremental scan API to read **existing** changelog files from snapshots (`changelog_manifest_list`), and expose an `AuditLogTable`-style read that surfaces row kinds as `+I` / `-U` / `+U` / `-D`.
### Motivation
Tables written with `changelog-producer=input` (and other producers that already materialize changelog files) should be readable incrementally without generating changelog on the Rust side.
### Proposed scope
- Changelog planning over snapshots in `(start, end]`
- Skip OVERWRITE / missing changelog lists cleanly
- `AuditLogTable` (or equivalent) with `rowkind` as the first column
- Tests with input-changelog fixtures (no compact/lookup generation in this PR)
Depends on the Delta/Auto incremental API landing first.
### Out of scope
- Generating lookup/compact changelogs in Rust
- Diff mode (derive changelog by comparing before/after images)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Batch incremental scan: read existing changelog manifests + AuditLogTable [paimon-rust]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi closed issue #504: Batch incremental scan: read existing changelog manifests + AuditLogTable
URL: https://github.com/apache/paimon-rust/issues/504
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org