You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Uwe Geercken <uw...@web.de> on 2017/10/13 19:29:18 UTC
How to upsert a relational database from kafka
Hello,
I am looking for some advice or best practice: I want to update OR insert a relational database table from kafka messages. As in Kafka everything is an "insert", what is the best way to determine if I need to update or to insert the data?
Do I have to write some code (which would be ok)? But maybe there is something more straight ahead: can Kafka connect solve this?
I would be happy to get some guidance.
Rgds,
Uwe
Re: How to upsert a relational database from kafka
Posted by Avinash Shahdadpuri <av...@gmail.com>.
You should look at the kafka-connect-jdbc code. It is a kafka connector to
load data into a relational database.
https://github.com/confluentinc/kafka-connect-jdbc
The documentation is here -
https://docs.confluent.io/current/connect/connect-jdbc/docs/index.html
On Fri, Oct 13, 2017 at 12:29 PM, Uwe Geercken <uw...@web.de> wrote:
>
> Hello,
>
> I am looking for some advice or best practice: I want to update OR insert
> a relational database table from kafka messages. As in Kafka everything is
> an "insert", what is the best way to determine if I need to update or to
> insert the data?
>
> Do I have to write some code (which would be ok)? But maybe there is
> something more straight ahead: can Kafka connect solve this?
>
> I would be happy to get some guidance.
>
> Rgds,
>
> Uwe
>
Re: How to upsert a relational database from kafka
Posted by Avinash Shahdadpuri <av...@gmail.com>.
You should look at the kafka-connect-jdbc code. It is a kafka connector to
load data into a relational database.
https://github.com/confluentinc/kafka-connect-jdbc
The documentation is here -
https://docs.confluent.io/current/connect/connect-jdbc/docs/index.html
On Fri, Oct 13, 2017 at 12:29 PM, Uwe Geercken <uw...@web.de> wrote:
>
> Hello,
>
> I am looking for some advice or best practice: I want to update OR insert
> a relational database table from kafka messages. As in Kafka everything is
> an "insert", what is the best way to determine if I need to update or to
> insert the data?
>
> Do I have to write some code (which would be ok)? But maybe there is
> something more straight ahead: can Kafka connect solve this?
>
> I would be happy to get some guidance.
>
> Rgds,
>
> Uwe
>