You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Sergey Zyrianov (Jira)" <ji...@apache.org> on 2021/05/02 08:48:00 UTC
[jira] [Updated] (KAFKA-12743) [Kafka Streams] - regex name for
state-store change-log topic
[ https://issues.apache.org/jira/browse/KAFKA-12743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sergey Zyrianov updated KAFKA-12743:
------------------------------------
Description:
Currently, when working with Kafka backed state stores in Kafka Streams, these log compacted topics are given a hardcoded name : _app_id-storename-changelog_
{noformat}
public static String storeChangelogTopic(String applicationId, String storeName) {
return applicationId + "-" + storeName + STATE_CHANGELOG_TOPIC_SUFFIX;
}{noformat}
MirrorMaker2(mm2) copies these topics to remote cluster under the name _src-cluster-alias.app_id-storename-changelog_
When remote app fails over to remote cluster it has troubles to find changelog topic of its state store since it was renamed - given source cluster prefix by mm2.
Whats the fix should be ? instruct mm2 to keep topic name or subscribe to regex *._app_id-storename-changelog_ topic name for the state's changelog.
was:
Currently, when working with Kafka backed state stores in Kafka Streams, these log compacted topics are given a hardcoded name : _app_id-storename-changelog_
{noformat}
public static String storeChangelogTopic(String applicationId, String storeName) {
return applicationId + "-" + storeName + STATE_CHANGELOG_TOPIC_SUFFIX;
}{noformat}
MirrorMaker2(mm2) copies these topics to remote cluster under the name _src-cluster-alias.app_id-storename-changelog_
When remote app fails over to remote cluster it has troubles to find changelog topic of its state store since it was renamed - given source cluster prefix by mm2.
Whats the fix should be ? instruct mm2 to keep topic name or subscribe to regex *._app_id-storename-changelog_ for the state's changelog.
> [Kafka Streams] - regex name for state-store change-log topic
> -------------------------------------------------------------
>
> Key: KAFKA-12743
> URL: https://issues.apache.org/jira/browse/KAFKA-12743
> Project: Kafka
> Issue Type: Improvement
> Components: streams
> Affects Versions: 2.8.0
> Reporter: Sergey Zyrianov
> Priority: Major
>
> Currently, when working with Kafka backed state stores in Kafka Streams, these log compacted topics are given a hardcoded name : _app_id-storename-changelog_
> {noformat}
> public static String storeChangelogTopic(String applicationId, String storeName) {
> return applicationId + "-" + storeName + STATE_CHANGELOG_TOPIC_SUFFIX;
> }{noformat}
>
> MirrorMaker2(mm2) copies these topics to remote cluster under the name _src-cluster-alias.app_id-storename-changelog_
>
> When remote app fails over to remote cluster it has troubles to find changelog topic of its state store since it was renamed - given source cluster prefix by mm2.
> Whats the fix should be ? instruct mm2 to keep topic name or subscribe to regex *._app_id-storename-changelog_ topic name for the state's changelog.
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)