Query regarding implementation of KStreams with Hbase

[Rohit M <rr...@gmail.com>]

Hi team,

There is lot in internet where Kstreams read data from topic , perform some
transformation and write it back to a topic. But I wonder if write to hbase
table is possible with KStream?. And what I mean by this is that we should
read data from topic using KStream , perform some operations like we do on
a dataframe and then write it to a hbase table
I didn't find any resources on internet implementing KStreams with hbase. I
would be glad if could get some help with a piece of code in scala
preferably to read from a topic or even a hbase table using KStream
application , perform some transformation and write it to a hbase table


Regards
Rohit M

Re: Query regarding implementation of KStreams with Hbase

["Matthias J. Sax" <mj...@apache.org>]

Kafka Streams is designed to read and write from a broker cluster. It's 
not designed to write data to different system like HBase.

If you want to get data from Kafka to HBase, you should use Kafka Connect.

Of course, it's possible (but not recommended) to implement your own 
`Processor` and do whatever you want with the data inside Kafka Streams.

HTH.

-Matthias

On 5/11/23 10:38 AM, Rohit M wrote:
> Hi team,
> 
> There is lot in internet where Kstreams read data from topic , perform some
> transformation and write it back to a topic. But I wonder if write to hbase
> table is possible with KStream?. And what I mean by this is that we should
> read data from topic using KStream , perform some operations like we do on
> a dataframe and then write it to a hbase table
> I didn't find any resources on internet implementing KStreams with hbase. I
> would be glad if could get some help with a piece of code in scala
> preferably to read from a topic or even a hbase table using KStream
> application , perform some transformation and write it to a hbase table
> 
> 
> Regards
> Rohit M
>