You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by GitBox <gi...@apache.org> on 2022/01/04 05:26:17 UTC
[GitHub] [incubator-seatunnel] melin opened a new issue #946: [Feature][Spark] support debezium
melin opened a new issue #946:
URL: https://github.com/apache/incubator-seatunnel/issues/946
### Search before asking
- [X] I had searched in the [feature](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.
### Description
Integrated with Debezium to support realtime writing of data to hudi
### Usage Scenario
_No response_
### Related issues
_No response_
### Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] garyelephant commented on issue #946: [Feature][Spark] support debezium
Posted by GitBox <gi...@apache.org>.
garyelephant commented on issue #946:
URL: https://github.com/apache/incubator-seatunnel/issues/946#issuecomment-1007896027
duplicate of #963. we can discuss this in #963
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] garyelephant closed issue #946: [Feature][Spark] support debezium
Posted by GitBox <gi...@apache.org>.
garyelephant closed issue #946:
URL: https://github.com/apache/incubator-seatunnel/issues/946
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] garyelephant closed issue #946: [Feature][Spark] support debezium
Posted by GitBox <gi...@apache.org>.
garyelephant closed issue #946:
URL: https://github.com/apache/incubator-seatunnel/issues/946
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] xtr1993 commented on issue #946: [Feature][Spark] support debezium
Posted by GitBox <gi...@apache.org>.
xtr1993 commented on issue #946:
URL: https://github.com/apache/incubator-seatunnel/issues/946#issuecomment-1005540561
spark how to support debezium？you have done it?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] melin commented on issue #946: [Feature][Spark] support debezium
Posted by GitBox <gi...@apache.org>.
melin commented on issue #946:
URL: https://github.com/apache/incubator-seatunnel/issues/946#issuecomment-1006209522
The Flink CDC project uses Debezium Embedded directly to obtain binlog.
Spark can use the output of Debezium Embedded as a streaming data source
xtr_1993 ***@***.***> 于2022年1月5日周三 17:59写道：
> spark how to support debezium？you have done it?
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/incubator-seatunnel/issues/946#issuecomment-1005540561>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AAIXXZXJAPNACVY7IVTZ4ILUUQI73ANCNFSM5LGT7DXA>
> .
> Triage notifications on the go with GitHub Mobile for iOS
> <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675>
> or Android
> <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.
>
> You are receiving this because you authored the thread.Message ID:
> ***@***.***>
>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] melin commented on issue #946: [Feature][Spark] support debezium
Posted by GitBox <gi...@apache.org>.
melin commented on issue #946:
URL: https://github.com/apache/incubator-seatunnel/issues/946#issuecomment-1006586131
> spark how to support debezium？you have done it?
从flink 中抽取的mysql cdc 代码，有一个测试demo，比较关键是，整合spark checkpoint ，存储offset信息，https://github.com/melin/debezium-example
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] garyelephant commented on issue #946: [Feature][Spark] support debezium
Posted by GitBox <gi...@apache.org>.
garyelephant commented on issue #946:
URL: https://github.com/apache/incubator-seatunnel/issues/946#issuecomment-1007896027
duplicate of #963. we can discuss this in #963
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org