You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "tchivs (via GitHub)" <gi...@apache.org> on 2026/01/09 06:55:55 UTC

[PR] [FLINK-XXXXX][postgres] Support partition table routing for PostgreSQL CDC [flink-cdc]

tchivs opened a new pull request, #4216:
URL: https://github.com/apache/flink-cdc/pull/4216

   ## Summary
   
   Add `partition.tables` configuration option to support PostgreSQL partition table routing, significantly improving performance for databases with many partitions.
   
   ## Performance Improvements
   
   ### Before (Problems)
   - **Frequent schema refresh**: Schema was refreshed on every table access
   - **Full schema load**: Even when requesting single table schema, all tables were loaded
   - **Excessive CreateTableEvents**: Hundreds of partition tables generated massive CreateTableEvent storms
   - **High memory/DB pressure**: Loading schema for each partition table caused memory bloat and database load
   
   ### After (Optimizations)
   - **Lazy schema loading**: Schema loaded only when needed
   - **Single table fetch**: `readSchema()` now fetches only the requested table
   - **Event consolidation**: Child partition events routed to parent table, eliminating duplicate CreateTableEvents
   - **Reduced DB queries**: Parent table schema cached and reused for all child partitions


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [FLINK-38881][postgres] Support partition table routing for PostgreSQL CDC [flink-cdc]

Posted by "tchivs (via GitHub)" <gi...@apache.org>.
tchivs closed pull request #4216: [FLINK-38881][postgres] Support partition table routing for PostgreSQL CDC
URL: https://github.com/apache/flink-cdc/pull/4216


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org