You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "hailin0 (via GitHub)" <gi...@apache.org> on 2024/07/14 08:27:02 UTC

[I] [Feature][CDC] Support vitess cdc connector source [seatunnel]

hailin0 opened a new issue, #7197:
URL: https://github.com/apache/seatunnel/issues/7197

   ### Search before asking
   
   - [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.
   
   
   ### Description
   
   Currently, we don't support reading vitess change data capture (CDC), does anyone want to add support for vitess?
   
   docs
   https://github.com/debezium/debezium-connector-vitess/tree/1.9
   
   reference
   https://github.com/apache/seatunnel/tree/dev/seatunnel-connectors-v2/connector-cdc/connector-cdc-mysql
   https://github.com/apache/seatunnel/tree/dev/seatunnel-e2e/seatunnel-connector-v2-e2e/connector-cdc-mysql-e2e
   https://github.com/apache/seatunnel/tree/dev/docs
   
   ### Usage Scenario
   
   _No response_
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #7197:
URL: https://github.com/apache/seatunnel/issues/7197#issuecomment-2287491507

   This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #7197: [Feature][CDC] Support vitess cdc connector source 
URL: https://github.com/apache/seatunnel/issues/7197


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]

Posted by "corgy-w (via GitHub)" <gi...@apache.org>.
corgy-w commented on issue #7197:
URL: https://github.com/apache/seatunnel/issues/7197#issuecomment-2655418628

   > Can be assigned to me. I want to try it and need a little time.
   
   Friends who are willing can continue to try this issue. I want to quit quietly. I hope my semi-finished product can help you.[https://github.com/corgy-w/seatunnel/tree/vitess-cdc]


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]

Posted by "davidzollo (via GitHub)" <gi...@apache.org>.
davidzollo commented on issue #7197:
URL: https://github.com/apache/seatunnel/issues/7197#issuecomment-4668222071

   Superseded by #11050, which provides a new claimable implementation scope, explicit first-delivery boundary, suggested module touch points, and acceptance criteria for a Vitess CDC source connector.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]

Posted by "davidzollo (via GitHub)" <gi...@apache.org>.
davidzollo commented on issue #7197:
URL: https://github.com/apache/seatunnel/issues/7197#issuecomment-4667862120

   This issue is still the right tracker for a Vitess CDC source connector, but it would help to narrow the expected delivery so a contributor can pick it up without ambiguity.
   
   ## Proposed scope
   Add a dedicated `connector-cdc-vitess` source connector under `seatunnel-connectors-v2/connector-cdc`.
   
   ## Functional expectations
   - Read change events from Vitess and map them into SeaTunnel's CDC row model.
   - Support table discovery/capture for the tables explicitly configured by the job.
   - Integrate with checkpoint/recovery so resumed jobs continue from a stable position.
   - Provide connector docs in both `docs/en` and `docs/zh`.
   - Add focused tests, including at least one runnable integration or E2E path.
   
   ## Suggested acceptance criteria
   - A job can start from a consistent initial position and continue to consume incremental changes.
   - Restart from checkpoint resumes from the correct offset/position without event loss or obvious duplication beyond the documented guarantees.
   - Basic multi-table capture is validated.
   - The connector documents required privileges, supported deployment assumptions, and current limitations.
   
   ## Out of scope for the first delivery
   - Sink connector work.
   - Broad CDC framework refactors that are not required for Vitess support.
   - New schema evolution policies or transform DSL work.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #7197:
URL: https://github.com/apache/seatunnel/issues/7197#issuecomment-3064432823

   This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #7197:
URL: https://github.com/apache/seatunnel/issues/7197#issuecomment-2330371063

   This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #7197: [Feature][CDC] Support vitess cdc connector source 
URL: https://github.com/apache/seatunnel/issues/7197


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #7197:
URL: https://github.com/apache/seatunnel/issues/7197#issuecomment-2309075317

   This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #7197: [Feature][CDC] Support vitess cdc connector source 
URL: https://github.com/apache/seatunnel/issues/7197


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]

Posted by "corgy-w (via GitHub)" <gi...@apache.org>.
corgy-w commented on issue #7197:
URL: https://github.com/apache/seatunnel/issues/7197#issuecomment-2341238388

   Can be assigned to me. I want to try it and need a little time.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Feature][CDC] Support vitess cdc connector source [seatunnel]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #7197:
URL: https://github.com/apache/seatunnel/issues/7197#issuecomment-3092662216

   This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org