You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "ziyanTOP (via GitHub)" <gi...@apache.org> on 2026/05/19 11:32:55 UTC
[I] [Feature](mongodb-cdc) Expose split-related CDC options for MongoDB [doris-flink-connector]
ziyanTOP opened a new issue, #665:
URL: https://github.com/apache/doris-flink-connector/issues/665
## Problem Summary
Currently `mongodb-sync-database` does not expose several useful MongoDB CDC source options that are available in the underlying Flink CDC connector. Users cannot configure snapshot chunk granularity or reader behavior, which can lead to OOM when syncing large collections.
## Proposed Changes
Expose the following MongoDB CDC source options as configurable parameters:
- `scan.incremental.snapshot.chunk.size.mb`
- `scan.incremental.snapshot.chunk.samples`
- `split.meta.group.size`
- `close.idle.readers`
- `scan.full-changelog`
- `scan.cursor.no-timeout`
## Checklist
1. Does it affect the original behavior: No (adds new options)
2. Has unit tests been added: No
3. Has document been added or modified: No Need
4. Does it need to update dependencies: No
5. Are there any changes that cannot be rolled back: No
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org