You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "davidzollo (via GitHub)" <gi...@apache.org> on 2026/06/10 07:52:02 UTC

Re: [I] [Bug][Mongo-CDC] 无法启用仅增量模式,提交任务后会强制全量同步。(Cannot use increment-only mode, causing data duplicate.) [seatunnel]

davidzollo commented on issue #9511:
URL: https://github.com/apache/seatunnel/issues/9511#issuecomment-4667862339

   This issue can also serve as the tracking issue for adding a true incremental-only startup mode to MongoDB-CDC.
   
   ## Proposed scope
   Add a startup option that begins consuming change stream events without taking an initial snapshot.
   
   ## Why this matters
   Today users who only want changes from "now onward" still hit full synchronization behavior in some paths. That makes MongoDB-CDC unsuitable for incremental-only onboarding and can create duplicate historical ingestion.
   
   ## Suggested acceptance criteria
   - `MongoDB-CDC` exposes a startup mode that skips the initial snapshot and starts from the latest change stream position.
   - The option is validated clearly in configuration parsing.
   - Restart and resume behavior is documented.
   - English and Chinese docs are updated with a minimal example.
   - Add a focused test path that proves snapshot is skipped and only new changes are consumed.
   
   ## Out of scope for the first delivery
   - Dynamic newly-added collection capture.
   - New metadata fields.
   - General CDC transform enhancements.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org