You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by Kavitha Veluri <ka...@outlook.com> on 2016/04/01 03:43:00 UTC

Kafka connect to database to push consumed data

Hi,

I'm trying to use Kafka streams for my use case which consumes data from producer , processes it and pushes that data to database.

I spent time trying to find any similar examples but couldn't find one.

Can you please help me by sending a sample example code for my use case?

Any help is greatly appreciated .

Thanks ,
Kavitha veluri

Re: Kafka connect to database to push consumed data

Posted by Jay Kreps <ja...@confluent.io>.

There isn't a jdbc sink yet, though that is actually a very useful and easy
connector to write. I think it can be pretty efficient as long as it uses
prepared statements and batch insert...

-Jay

On Fri, Apr 1, 2016 at 6:06 AM, Kavitha Veluri <ka...@outlook.com>
wrote:

> Thank you for the guidance . Does Kafka connect JDBC also supports writing
> data into database. I understand it efficiently reads data from any
> relational database, but I'm looking for writing the consumed topics into
> database .
>
> Thanks,
> Kavitha veluri
>
> On Mar 31, 2016, at 10:51 PM, Surendra, Manchikanti <
> surendra.manchikanti@gmail.com<ma...@gmail.com>>
> wrote:
>
> Please look into Confluent Kafka connectors.
>
> http://www.confluent.io/developers/connectors
>
> -- Surendra Manchikanti
>
> On Thu, Mar 31, 2016 at 6:43 PM, Kavitha Veluri <
> kavitha.veluri@outlook.com<ma...@outlook.com>> wrote:
> Hi,
>
> I'm trying to use Kafka streams for my use case which consumes data from
> producer , processes it and pushes that data to database.
>
> I spent time trying to find any similar examples but couldn't find one.
>
> Can you please help me by sending a sample example code for my use case?
>
> Any help is greatly appreciated .
>
> Thanks ,
> Kavitha veluri
>
>

Re: Kafka connect to database to push consumed data

Posted by Kavitha Veluri <ka...@outlook.com>.

Thank you for the guidance . Does Kafka connect JDBC also supports writing data into database. I understand it efficiently reads data from any relational database, but I'm looking for writing the consumed topics into database .

Thanks,
Kavitha veluri

On Mar 31, 2016, at 10:51 PM, Surendra, Manchikanti <su...@gmail.com>> wrote:

Please look into Confluent Kafka connectors.

http://www.confluent.io/developers/connectors

-- Surendra Manchikanti

On Thu, Mar 31, 2016 at 6:43 PM, Kavitha Veluri <ka...@outlook.com>> wrote:
Hi,

I'm trying to use Kafka streams for my use case which consumes data from producer , processes it and pushes that data to database.

I spent time trying to find any similar examples but couldn't find one.

Can you please help me by sending a sample example code for my use case?

Any help is greatly appreciated .

Thanks ,
Kavitha veluri

Re: Kafka connect to database to push consumed data

Posted by "Surendra , Manchikanti" <su...@gmail.com>.

Please look into Confluent Kafka connectors.

http://www.confluent.io/developers/connectors

-- Surendra Manchikanti

On Thu, Mar 31, 2016 at 6:43 PM, Kavitha Veluri <ka...@outlook.com>
wrote:

> Hi,
>
> I'm trying to use Kafka streams for my use case which consumes data from
> producer , processes it and pushes that data to database.
>
> I spent time trying to find any similar examples but couldn't find one.
>
> Can you please help me by sending a sample example code for my use case?
>
> Any help is greatly appreciated .
>
> Thanks ,
> Kavitha veluri