You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Will Du <wi...@gmail.com> on 2018/07/16 12:06:08 UTC

Kafka stream or ksql design question

Hi folks,
As far as I know, Kafka Stream is a separate process by reading data from topic, transform, and writing to another topic if needed. In this case, how this process supports high throughout stream as well as load balance in terms of message traffic and computing resource for stream processing?

Regarding to KSL, is there any query optimization in place or in roadmap?

Thanks,
Will


Re: Kafka stream or ksql design question

Posted by Guozhang Wang <wa...@gmail.com>.
Hello Will,

Your question is very high-level and hence I felt less guilty to give you a
general answer :)

You can read the web docs on on Kafka Streams achieve high throughput via
data parallelism here:

https://kafka.apache.org/11/documentation/streams/architecture


Regarding KSQL, you can look at the github issues for asked features and
tentative roadmap tasks:

https://github.com/confluentinc/ksql/issues


Guozhang


On Mon, Jul 16, 2018 at 5:06 AM, Will Du <wi...@gmail.com> wrote:

> Hi folks,
> As far as I know, Kafka Stream is a separate process by reading data from
> topic, transform, and writing to another topic if needed. In this case, how
> this process supports high throughout stream as well as load balance in
> terms of message traffic and computing resource for stream processing?
>
> Regarding to KSL, is there any query optimization in place or in roadmap?
>
> Thanks,
> Will
>
>


-- 
-- Guozhang