You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Will Du <wi...@gmail.com> on 2018/07/16 12:06:08 UTC
Kafka stream or ksql design question
Hi folks,
As far as I know, Kafka Stream is a separate process by reading data from topic, transform, and writing to another topic if needed. In this case, how this process supports high throughout stream as well as load balance in terms of message traffic and computing resource for stream processing?
Regarding to KSL, is there any query optimization in place or in roadmap?
Thanks,
Will
Re: Kafka stream or ksql design question
Posted by Guozhang Wang <wa...@gmail.com>.
Hello Will,
Your question is very high-level and hence I felt less guilty to give you a
general answer :)
You can read the web docs on on Kafka Streams achieve high throughput via
data parallelism here:
https://kafka.apache.org/11/documentation/streams/architecture
Regarding KSQL, you can look at the github issues for asked features and
tentative roadmap tasks:
https://github.com/confluentinc/ksql/issues
Guozhang
On Mon, Jul 16, 2018 at 5:06 AM, Will Du <wi...@gmail.com> wrote:
> Hi folks,
> As far as I know, Kafka Stream is a separate process by reading data from
> topic, transform, and writing to another topic if needed. In this case, how
> this process supports high throughout stream as well as load balance in
> terms of message traffic and computing resource for stream processing?
>
> Regarding to KSL, is there any query optimization in place or in roadmap?
>
> Thanks,
> Will
>
>
--
-- Guozhang