You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "hailin0 (via GitHub)" <gi...@apache.org> on 2024/07/14 08:27:02 UTC
[I] [Feature][CDC] Support vitess cdc connector source [seatunnel]
hailin0 opened a new issue, #7197:
URL: https://github.com/apache/seatunnel/issues/7197
### Search before asking
- [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.
### Description
Currently, we don't support reading vitess change data capture (CDC), does anyone want to add support for vitess?
docs
https://github.com/debezium/debezium-connector-vitess/tree/1.9
reference
https://github.com/apache/seatunnel/tree/dev/seatunnel-connectors-v2/connector-cdc/connector-cdc-mysql
https://github.com/apache/seatunnel/tree/dev/seatunnel-e2e/seatunnel-connector-v2-e2e/connector-cdc-mysql-e2e
https://github.com/apache/seatunnel/tree/dev/docs
### Usage Scenario
_No response_
### Related issues
_No response_
### Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #7197:
URL: https://github.com/apache/seatunnel/issues/7197#issuecomment-2287491507
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #7197: [Feature][CDC] Support vitess cdc connector source
URL: https://github.com/apache/seatunnel/issues/7197
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]
Posted by "corgy-w (via GitHub)" <gi...@apache.org>.
corgy-w commented on issue #7197:
URL: https://github.com/apache/seatunnel/issues/7197#issuecomment-2655418628
> Can be assigned to me. I want to try it and need a little time.
Friends who are willing can continue to try this issue. I want to quit quietly. I hope my semi-finished product can help you.[https://github.com/corgy-w/seatunnel/tree/vitess-cdc]
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]
Posted by "davidzollo (via GitHub)" <gi...@apache.org>.
davidzollo commented on issue #7197:
URL: https://github.com/apache/seatunnel/issues/7197#issuecomment-4668222071
Superseded by #11050, which provides a new claimable implementation scope, explicit first-delivery boundary, suggested module touch points, and acceptance criteria for a Vitess CDC source connector.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]
Posted by "davidzollo (via GitHub)" <gi...@apache.org>.
davidzollo commented on issue #7197:
URL: https://github.com/apache/seatunnel/issues/7197#issuecomment-4667862120
This issue is still the right tracker for a Vitess CDC source connector, but it would help to narrow the expected delivery so a contributor can pick it up without ambiguity.
## Proposed scope
Add a dedicated `connector-cdc-vitess` source connector under `seatunnel-connectors-v2/connector-cdc`.
## Functional expectations
- Read change events from Vitess and map them into SeaTunnel's CDC row model.
- Support table discovery/capture for the tables explicitly configured by the job.
- Integrate with checkpoint/recovery so resumed jobs continue from a stable position.
- Provide connector docs in both `docs/en` and `docs/zh`.
- Add focused tests, including at least one runnable integration or E2E path.
## Suggested acceptance criteria
- A job can start from a consistent initial position and continue to consume incremental changes.
- Restart from checkpoint resumes from the correct offset/position without event loss or obvious duplication beyond the documented guarantees.
- Basic multi-table capture is validated.
- The connector documents required privileges, supported deployment assumptions, and current limitations.
## Out of scope for the first delivery
- Sink connector work.
- Broad CDC framework refactors that are not required for Vitess support.
- New schema evolution policies or transform DSL work.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #7197:
URL: https://github.com/apache/seatunnel/issues/7197#issuecomment-3064432823
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #7197:
URL: https://github.com/apache/seatunnel/issues/7197#issuecomment-2330371063
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #7197: [Feature][CDC] Support vitess cdc connector source
URL: https://github.com/apache/seatunnel/issues/7197
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #7197:
URL: https://github.com/apache/seatunnel/issues/7197#issuecomment-2309075317
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #7197: [Feature][CDC] Support vitess cdc connector source
URL: https://github.com/apache/seatunnel/issues/7197
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]
Posted by "corgy-w (via GitHub)" <gi...@apache.org>.
corgy-w commented on issue #7197:
URL: https://github.com/apache/seatunnel/issues/7197#issuecomment-2341238388
Can be assigned to me. I want to try it and need a little time.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #7197:
URL: https://github.com/apache/seatunnel/issues/7197#issuecomment-3092662216
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org