You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Guozhang Wang (JIRA)" <ji...@apache.org> on 2017/10/10 00:35:01 UTC
[jira] [Created] (KAFKA-6035) Avoid creating changelog topics for
state stores that are directly piped to a sink topic
Guozhang Wang created KAFKA-6035:
------------------------------------
Summary: Avoid creating changelog topics for state stores that are directly piped to a sink topic
Key: KAFKA-6035
URL: https://issues.apache.org/jira/browse/KAFKA-6035
Project: Kafka
Issue Type: Sub-task
Reporter: Guozhang Wang
Today Streams make all state stores to be backed by a changelog topic by default unless users overrides it by {{disableLogging}} when creating the state store / materializing the KTable. However there are a few cases where a separate changelog topic would not be required as we can re-use an existing topic for that. This ticket summarize a specific issue that can be optimized:
Consider the case when a KTable is materialized and then sent directly into a sink topic with the same key, e.g.
{code}
table1 = stream.groupBy(...).aggregate("state1").to("topic2");
{code}
Then we do not need to create a {{state1-changelog}} but can just use {{topic2}} as its changelog.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)