You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "davidzollo (via GitHub)" <gi...@apache.org> on 2026/07/18 10:33:16 UTC
[PR] [Docs] Add PostgreSQL CDC to Iceberg scenario recipe [seatunnel]
davidzollo opened a new pull request, #11481:
URL: https://github.com/apache/seatunnel/pull/11481
## Purpose
Add a bilingual, tutorial-level PostgreSQL CDC to Iceberg scenario that combines snapshot and incremental CDC, SQL field shaping, and Iceberg upserts.
## What changed
- Add English and Chinese PostgreSQL CDC to Iceberg recipes and navigation entries.
- Document the complete PostgreSQL setup, source data, executable SeaTunnel configuration, expected result, operational checks, and troubleshooting guidance.
- Add a Docker E2E test that covers the initial snapshot plus update, insert, and delete events, then reads Iceberg directly and asserts the exact transformed rows.
- Keep the HOCON in both documents identical to the E2E test resource.
## Validation
- `./mvnw spotless:apply -nsu -Dmaven.gitcommitid.skip=true`
- Iceberg E2E module and required reactor dependencies: `test-compile` passed (86/86 modules)
- `MarkdownTest`: 4/4 passed
- English/Chinese HOCON blocks exactly match the E2E resource after license comments are excluded
- `git diff --check` passed
## Docker E2E boundary
The local Docker E2E did not reach the PostgreSQL-to-Iceberg business pipeline. The PostgreSQL image was pulled successfully, but Docker Desktop's engine subsequently became unavailable and returned HTTP 502 before the test containers could start. I did not restart Docker because other registered local containers could be affected. The E2E test is included in this PR for CI execution; this PR does not claim a local end-to-end pass.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [Docs] Add PostgreSQL CDC to Iceberg scenario recipe [seatunnel]
Posted by "davidzollo (via GitHub)" <gi...@apache.org>.
davidzollo closed pull request #11481: [Docs] Add PostgreSQL CDC to Iceberg scenario recipe
URL: https://github.com/apache/seatunnel/pull/11481
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org