You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by "satyajit.mandal.barclays.com via user" <us...@ignite.apache.org> on 2022/11/10 04:22:26 UTC
Query regarding Debezium Ignite Sink connector
Hi Team,
Is there any Ignite Sink connector available which will sink the data from Kafka topic having output from Debezium source connector connecting to SQL server with CDC enabled.
Looks like we have the feature in GridGain but just wanted to check if similar connector can be used with Apache Ignite?
https://www.gridgain.com/sites/default/files/technical-presentations/Webinar-Change-Data-Capture-Using%20Debezium-Ignite-GridGain.pdf
Regards
Satyajit
Barclays Execution Services Limited registered in England. Registered No. 1767980. Registered office: 1 Churchill Place, London, E14 5HP
Barclays Execution Services Limited provides support and administrative services across Barclays group. Barclays Execution Services Limited is an appointed representative of Barclays Bank UK plc, Barclays Bank plc and Clydesdale Financial Services Limited. Barclays Bank UK plc and Barclays Bank plc are authorised by the Prudential Regulation Authority and regulated by the Financial Conduct Authority and the Prudential Regulation Authority. Clydesdale Financial Services Limited is authorised and regulated by the Financial Conduct Authority.
This email and any attachments are confidential and intended solely for the addressee and may also be privileged or exempt from disclosure under applicable law. If you are not the addressee, or have received this email in error, please notify the sender and immediately delete it and any attachments from your system. Do not copy, use, disclose or otherwise act on any part of this email or its attachments.
Internet communications are not guaranteed to be secure or virus-free. The Barclays group does not accept responsibility for any loss arising from unauthorised access to, or interference with, any internet communications by any third party, or from the transmission of any viruses. Replies to this email may be monitored by the Barclays group for operational or business reasons.
Any opinion or other information in this email or its attachments that does not relate to the business of the Barclays group is personal to the sender and is not given or endorsed by the Barclays group.
Unless specifically indicated, this e-mail is not an offer to buy or sell or a solicitation to buy or sell any securities, investment products or other financial product or service, an official confirmation of any transaction, or an official statement of Barclays.
RE: Query regarding Debezium Ignite Sink connector
Posted by "satyajit.mandal.barclays.com via user" <us...@ignite.apache.org>.
Hi Stephen,
Query was that Debezium persist complex envelop structure data in Kafka topics when it connects to SQL server with CDC enabled. So will ignite sink connector will be able to deserialize the envelope structure to simple tabular structure data? Can you please help on this?
From this doc looks like Gridgain has sink connector which supports that.Can you please confirm if Gridgain connector and Ignite sink connector does the same thing and no change in behavior?
https://www.gridgain.com/sites/default/files/technical-presentations/Webinar-Change-Data-Capture-Using%20Debezium-Ignite-GridGain.pdf<https://clicktime.symantec.com/15sM65sm1Pvd3gygHnJvk?h=6ar_Gun3iGvlyVKNixhICpjjdI3kT23Bs4dUH0_KaW4=&u=https://www.gridgain.com/sites/default/files/technical-presentations/Webinar-Change-Data-Capture-Using%2520Debezium-Ignite-GridGain.pdf>
https://www.gridgain.com/resources/blog/change-data-capture-between-mysql-and-gridgain-debezium
Regards
Satyajit
Restricted - External
From: Stephen Darlington <st...@gridgain.com>
Sent: Friday, November 11, 2022 3:35 PM
To: user <us...@ignite.apache.org>
Subject: Re: Query regarding Debezium Ignite Sink connector
CAUTION: This email originated from outside our organisation - stephen.darlington@gridgain.com<ma...@gridgain.com> Do not click on links, open attachments, or respond unless you recognize the sender and can validate the content is safe.
From the documentation: https://ignite.apache.org/docs/latest/extensions-and-integrations/streaming/kafka-streamer<https://clicktime.symantec.com/15sM1FgUYnF2dk9kkDun8?h=X41CcZtXPuGK4Jpc6o4tZXL8t7vwvMHmGkzEdRt6-So=&u=https://ignite.apache.org/docs/latest/extensions-and-integrations/streaming/kafka-streamer>
On 10 Nov 2022, at 04:22, satyajit.mandal.barclays.com<https://clicktime.symantec.com/15sLvRVC6AZSDoKqCfWdW?h=EGrdc5c4RMz-kXeT08DG8y_KKhAsFzCR8vk40qNTXiw=&u=http://satyajit.mandal.barclays.com> via user <us...@ignite.apache.org>> wrote:
Hi Team,
Is there any Ignite Sink connector available which will sink the data from Kafka topic having output from Debezium source connector connecting to SQL server with CDC enabled.
Looks like we have the feature in GridGain but just wanted to check if similar connector can be used with Apache Ignite?
https://www.gridgain.com/sites/default/files/technical-presentations/Webinar-Change-Data-Capture-Using%20Debezium-Ignite-GridGain.pdf<https://clicktime.symantec.com/15sM65sm1Pvd3gygHnJvk?h=6ar_Gun3iGvlyVKNixhICpjjdI3kT23Bs4dUH0_KaW4=&u=https://www.gridgain.com/sites/default/files/technical-presentations/Webinar-Change-Data-Capture-Using%2520Debezium-Ignite-GridGain.pdf>
Regards
Satyajit
Barclays Execution Services Limited registered in England. Registered No. 1767980. Registered office: 1 Churchill Place, London, E14 5HP
Barclays Execution Services Limited provides support and administrative services across Barclays group. Barclays Execution Services Limited is an appointed representative of Barclays Bank UK plc, Barclays Bank plc and Clydesdale Financial Services Limited. Barclays Bank UK plc and Barclays Bank plc are authorised by the Prudential Regulation Authority and regulated by the Financial Conduct Authority and the Prudential Regulation Authority. Clydesdale Financial Services Limited is authorised and regulated by the Financial Conduct Authority.
This email and any attachments are confidential and intended solely for the addressee and may also be privileged or exempt from disclosure under applicable law. If you are not the addressee, or have received this email in error, please notify the sender and immediately delete it and any attachments from your system. Do not copy, use, disclose or otherwise act on any part of this email or its attachments.
Internet communications are not guaranteed to be secure or virus-free. The Barclays group does not accept responsibility for any loss arising from unauthorised access to, or interference with, any internet communications by any third party, or from the transmission of any viruses. Replies to this email may be monitored by the Barclays group for operational or business reasons.
Any opinion or other information in this email or its attachments that does not relate to the business of the Barclays group is personal to the sender and is not given or endorsed by the Barclays group.
Unless specifically indicated, this e-mail is not an offer to buy or sell or a solicitation to buy or sell any securities, investment products or other financial product or service, an official confirmation of any transaction, or an official statement of Barclays.
Re: Query regarding Debezium Ignite Sink connector
Posted by Stephen Darlington <st...@gridgain.com>.
From the documentation: https://ignite.apache.org/docs/latest/extensions-and-integrations/streaming/kafka-streamer
> On 10 Nov 2022, at 04:22, satyajit.mandal.barclays.com via user <us...@ignite.apache.org> wrote:
>
> Hi Team,
>
> Is there any Ignite Sink connector available which will sink the data from Kafka topic having output from Debezium source connector connecting to SQL server with CDC enabled.
> Looks like we have the feature in GridGain but just wanted to check if similar connector can be used with Apache Ignite?
>
>
> https://www.gridgain.com/sites/default/files/technical-presentations/Webinar-Change-Data-Capture-Using%20Debezium-Ignite-GridGain.pdf <https://www.gridgain.com/sites/default/files/technical-presentations/Webinar-Change-Data-Capture-Using%20Debezium-Ignite-GridGain.pdf>
>
>
>
> Regards
> Satyajit