You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ignite.apache.org by "Ilya Shishkov (Jira)" <ji...@apache.org> on 2023/01/16 07:19:00 UTC
[jira] [Updated] (IGNITE-18552) Fix TopicExistsException in CdcKafkaReplicationTest
[ https://issues.apache.org/jira/browse/IGNITE-18552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ilya Shishkov updated IGNITE-18552:
-----------------------------------
Description:
Test can fail with a following error:
{noformat}
java.lang.RuntimeException: java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TopicExistsException: Topic 'source-dest-meta' already exists.
at org.apache.kafka.streams.integration.utils.KafkaEmbedded.createTopic(KafkaEmbedded.java:187)
at org.apache.kafka.streams.integration.utils.EmbeddedKafkaCluster.createTopic(EmbeddedKafkaCluster.java:218)
at org.apache.kafka.streams.integration.utils.EmbeddedKafkaCluster.createTopic(EmbeddedKafkaCluster.java:203)
at org.apache.ignite.cdc.kafka.CdcKafkaReplicationTest.beforeTest(CdcKafkaReplicationTest.java:75)
at org.apache.ignite.cdc.kafka.CdcKafkaReplicationAppsTest.beforeTest(CdcKafkaReplicationAppsTest.java:91)
{noformat}
Reason should be investigated and fixed.
Build: [TC2 #346 at 14 Jan 09:49|https://ci2.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/6998555?hideProblemsFromDependencies=false&hideTestsFromDependencies=false&expandBuildProblemsSection=true&expandBuildTestsSection=true]
Build log: [^_TESTS_CDC_346.log.zip]
was:
Currently, there are flaky timeouts in an {{#afterTest}} method of {{CdcKafkaReplicationTest}}, {{CdcKafkaReplicationAppsTest}}.
Sometimes, tests stuck on waiting of topics deletion and thread dump is printed into log:
{quote}
[2023-01-13T08:13:22,320][INFO ][after-test-timeout-org.apache.ignite.cdc.kafka.CdcKafkaReplicationTest][] org.apache.ignite.cdc.kafka.CdcKafkaReplicationTest.{color:red}afterTest{color}() timed out, dumping threads (afterTest() still keeps running)
{quote}
As we can see in thread dump, method awaits topic deletion at line #92 of {{CdcKafkaReplicationTest.java}} [1]:
{quote}
[08:13:22] : [Step 3/3] Thread [name="main", id=1, state=TIMED_WAITING, blockCnt=460, waitCnt=3547]
[08:13:22] : [Step 3/3] at java.lang.Thread.sleep(Native Method)
[08:13:22] : [Step 3/3] at o.a.i.i.util.IgniteUtils.sleep(IgniteUtils.java:8266)
[08:13:22] : [Step 3/3] at o.a.i.testframework.GridTestUtils.waitForCondition(GridTestUtils.java:2055)
[08:13:22] : [Step 3/3] at o.a.i.testframework.GridTestUtils.waitForCondition(GridTestUtils.java:2023)
[08:13:22] : [Step 3/3] at o.a.i.testframework.GridTestUtils.waitForCondition(GridTestUtils.java:2004)
[08:13:22] : [Step 3/3] {color:red}at o.a.i.cdc.kafka.CdcKafkaReplicationTest.afterTest(CdcKafkaReplicationTest.java:92){color}
[08:13:22] : [Step 3/3] at o.a.i.testframework.junits.GridAbstractTest.runAfterTest(GridAbstractTest.java:762)
[08:13:22] : [Step 3/3] at o.a.i.testframework.junits.GridAbstractTest.cleanUpTestEnviroment(GridAbstractTest.java:739)
[08:13:22] : [Step 3/3] at o.a.i.testframework.junits.GridAbstractTest.runTest(GridAbstractTest.java:2555)
[08:13:22] : [Step 3/3] at o.a.i.testframework.junits.GridAbstractTest.access$600(GridAbstractTest.java:194)
[08:13:22] : [Step 3/3] at o.a.i.testframework.junits.GridAbstractTest$1.evaluate(GridAbstractTest.java:237)
[08:13:22] : [Step 3/3] at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
[08:13:22] : [Step 3/3] at o.a.i.testframework.junits.SystemPropertiesRule.lambda$methodStatement$1(SystemPropertiesRule.java:110)
[08:13:22] : [Step 3/3] at o.a.i.testframework.junits.SystemPropertiesRule$$Lambda$56/739582925.evaluate(Unknown Source)
[08:13:22] : [Step 3/3] at o.a.i.testframework.junits.DelegatingJUnitStatement.evaluate(DelegatingJUnitStatement.java:49)
{quote}
These timeouts leads to test execution over 5 minutes, as you can seen in [2-4] (sorted by test duration).
Reason should be investigated and fixed.
Links:
# https://github.com/apache/ignite-extensions/blob/master/modules/cdc-ext/src/test/java/org/apache/ignite/cdc/kafka/CdcKafkaReplicationTest.java#L92
# [TC1 Build #412 at 13 Jan 08:02|https://ci.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/7003974?buildTab=tests&orderBy=duration&order=desc], build log: [^_TESTS_CDC_412.log.zip]
# [TC1 Build #411 at 12 Jan 08:02|https://ci.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/7002590?buildTab=tests&orderBy=duration&order=desc], build log: [^_TESTS_CDC_411.log.zip]
# [TC1 Build #407 at 10 Jan 08:00|https://ci.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/6998391?buildTab=tests&orderBy=duration&order=desc], build log: [^_TESTS_CDC_407.log.zip]
> Fix TopicExistsException in CdcKafkaReplicationTest
> ---------------------------------------------------
>
> Key: IGNITE-18552
> URL: https://issues.apache.org/jira/browse/IGNITE-18552
> Project: Ignite
> Issue Type: Test
> Components: extensions
> Reporter: Ilya Shishkov
> Priority: Minor
> Labels: IEP-59, ise
> Attachments: _TESTS_CDC_346.log.zip
>
>
> Test can fail with a following error:
> {noformat}
> java.lang.RuntimeException: java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TopicExistsException: Topic 'source-dest-meta' already exists.
> at org.apache.kafka.streams.integration.utils.KafkaEmbedded.createTopic(KafkaEmbedded.java:187)
> at org.apache.kafka.streams.integration.utils.EmbeddedKafkaCluster.createTopic(EmbeddedKafkaCluster.java:218)
> at org.apache.kafka.streams.integration.utils.EmbeddedKafkaCluster.createTopic(EmbeddedKafkaCluster.java:203)
> at org.apache.ignite.cdc.kafka.CdcKafkaReplicationTest.beforeTest(CdcKafkaReplicationTest.java:75)
> at org.apache.ignite.cdc.kafka.CdcKafkaReplicationAppsTest.beforeTest(CdcKafkaReplicationAppsTest.java:91)
> {noformat}
> Reason should be investigated and fixed.
> Build: [TC2 #346 at 14 Jan 09:49|https://ci2.ignite.apache.org/buildConfiguration/IgniteExtensions_Tests_Cdc/6998555?hideProblemsFromDependencies=false&hideTestsFromDependencies=false&expandBuildProblemsSection=true&expandBuildTestsSection=true]
> Build log: [^_TESTS_CDC_346.log.zip]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)