You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "yuxiqian (via GitHub)" <gi...@apache.org> on 2024/05/06 10:36:45 UTC
[PR] [FLINK-35243][cdc] Support table schema change events & PreSchema backfill [flink-cdc]
yuxiqian opened a new pull request, #3296:
URL: https://github.com/apache/flink-cdc/pull/3296
This PR closes [FLINK-35243](https://issues.apache.org/jira/browse/FLINK-35243):
* Supports `RenameTableEvent`, `DropTableEvent`, and `TruncateTableEvent` in pipeline framework (MySQL source / Values sink for now)
* Adds `SchemaChangeEventWithPreSchema` interface, allowing SchemaRegistry backfilling schema before change payload
* Adds corresponding test cases
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [FLINK-35243][cdc] Support table schema change events & PreSchema backfill [flink-cdc]
Posted by "melin (via GitHub)" <gi...@apache.org>.
melin commented on PR #3296:
URL: https://github.com/apache/flink-cdc/pull/3296#issuecomment-2103908750
DropTableEvent TruncateTableEvent can be closed. Sometimes, tables cannot be deleted synchronously.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [FLINK-35243][cdc] Supports more schema change event types & backfill pre-schema payload for sink [flink-cdc]
Posted by "yuxiqian (via GitHub)" <gi...@apache.org>.
yuxiqian closed pull request #3296: [FLINK-35243][cdc] Supports more schema change event types & backfill pre-schema payload for sink
URL: https://github.com/apache/flink-cdc/pull/3296
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [FLINK-35243][cdc] Supports more schema change event types & backfill pre-schema payload for sink [flink-cdc]
Posted by "yuxiqian (via GitHub)" <gi...@apache.org>.
yuxiqian commented on PR #3296:
URL: https://github.com/apache/flink-cdc/pull/3296#issuecomment-2264606194
Thanks for @melin's suggestion, will be working on this after #3339 got merged.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [FLINK-35243][cdc] Supports more schema change event types & backfill pre-schema payload for sink [flink-cdc]
Posted by "yuxiqian (via GitHub)" <gi...@apache.org>.
yuxiqian commented on PR #3296:
URL: https://github.com/apache/flink-cdc/pull/3296#issuecomment-2275257098
Seems it's not meaningful to rebase, since there are too many conflicts. Will open another PR to address this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [FLINK-35243][cdc] Support table schema change events & PreSchema backfill [flink-cdc]
Posted by "yuxiqian (via GitHub)" <gi...@apache.org>.
yuxiqian commented on PR #3296:
URL: https://github.com/apache/flink-cdc/pull/3296#issuecomment-2103939437
> DropTableEvent TruncateTableEvent can be closed. Sometimes, tables cannot be deleted synchronously.
Hi @melin, thanks for your comments. It's a common use case to apply some "safe" schema change events (like `AddColumnEvent`) and ignore "dangerous" events (like Truncate / Drop tables). So we're designing a new feature allowing users to configure schema change behaviour for each type of schema change events in [FLINK-35242](https://issues.apache.org/jira/browse/FLINK-35242). Feel free to leave your comments if you have any other concerns.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [FLINK-35243][cdc] Supports more schema change event types & backfill pre-schema payload for sink [flink-cdc]
Posted by "melin (via GitHub)" <gi...@apache.org>.
melin commented on PR #3296:
URL: https://github.com/apache/flink-cdc/pull/3296#issuecomment-2264602222
support add/drop primary key event
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [FLINK-35243][cdc] Support table schema change events & PreSchema backfill [flink-cdc]
Posted by "yuxiqian (via GitHub)" <gi...@apache.org>.
yuxiqian commented on PR #3296:
URL: https://github.com/apache/flink-cdc/pull/3296#issuecomment-2100267362
@PatrickRen @ruanhang1993 PTAL
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org