You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Michael Semb Wever (Jira)" <ji...@apache.org> on 2021/01/24 11:18:00 UTC

[jira] [Comment Edited] (CASSANDRA-16239) Fix flaky test org.apache.cassandra.distributed.test.NetstatsRepairStreamingTest testWithCompressionDisabled

    [ https://issues.apache.org/jira/browse/CASSANDRA-16239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17270854#comment-17270854 ] 

Michael Semb Wever edited comment on CASSANDRA-16239 at 1/24/21, 11:17 AM:
---------------------------------------------------------------------------

bq. This test seems pretty solid and we don't have logs to look into. 

Providing similar links that won't expire:
 - [history|https://ci-cassandra.apache.org/job/Cassandra-trunk-jvm-dtest/lastCompletedBuild/jdk=jdk_1.8_latest,label=cassandra/testReport/org.apache.cassandra.distributed.test/NetstatsRepairStreamingTest/testWithCompressionDisabled/history/] (like [~Bereng]'s link above)
- [test result page with flakiness|https://ci-cassandra.apache.org/job/Cassandra-trunk-jvm-dtest/lastCompletedBuild/jdk=jdk_1.8_latest,label=cassandra/testReport/org.apache.cassandra.distributed.test/NetstatsRepairStreamingTest/testWithCompressionDisabled/]

h4. Searching nightlies.a.o
The logs for this test are archived at
{noformat}
https://nightlies.apache.org/cassandra/Cassandra-trunk-jvm-dtest/jdk=jdk_1.8_latest,label=cassandra/*/build/test/logs/org.apache.cassandra.distributed.test.NetstatsRepairStreamingTest/
{noformat}
for example https://nightlies.apache.org/cassandra/Cassandra-trunk-jvm-dtest/jdk=jdk_1.8_latest,label=cassandra/479/build/test/logs/org.apache.cassandra.distributed.test.NetstatsRepairStreamingTest/

To search in the archives, we can do…
{code}
# webdav mount https://nightlies.apache.org/cassandra/ to /Volumes/cassandra
cd /Volumes/cassandra

xzgrep "name=\"NetstatsRepairStreamingTest\"" Cassandra-trunk/*/TESTS-TestSuites.xml.xz
{code}
shows error (for the class) in builds:
- [Cassandra-trunk#83|https://nightlies.apache.org/cassandra/Cassandra-trunk/83]
- [Cassandra-trunk#108|https://nightlies.apache.org/cassandra/Cassandra-trunk/108]
- [Cassandra-trunk#117|https://nightlies.apache.org/cassandra/Cassandra-trunk/117]
- [Cassandra-trunk#153|https://nightlies.apache.org/cassandra/Cassandra-trunk/153]
- [Cassandra-trunk#161|https://nightlies.apache.org/cassandra/Cassandra-trunk/161]
- [Cassandra-trunk#166|https://nightlies.apache.org/cassandra/Cassandra-trunk/166]
- [Cassandra-trunk#171|https://nightlies.apache.org/cassandra/Cassandra-trunk/171]
- [Cassandra-trunk#195|https://nightlies.apache.org/cassandra/Cassandra-trunk/195]
- [Cassandra-trunk#216|https://nightlies.apache.org/cassandra/Cassandra-trunk/216]

From what I have searched the stage jobs to these failures (i.e. Cassandra-trunk-test builds) are older than the archives we have in nightlies. So only the information in the relevant {{TESTS-TestSuites.xml.xz}} (as linked to above) can be used.

Searching each of those builds reveals the same exception stack trace as described in the ticket description.
For example…
{code}
xzgrep -B1 "error message=\"Table does not match" Cassandra-trunk/216/TESTS-TestSuites.xml.xz 
{code}

Summarising, from the archives, from 154 Cassandra-trunk builds there are 9 failures of {{NetstatsRepairStreamingTest.testWithCompressionEnabled}}. That's a flakiness of ~6%, which corresponds to this [history link|jdk=jdk_1.8_latest,label=cassandra/testReport/org.apache.cassandra.distributed.test/NetstatsRepairStreamingTest/testWithCompressionEnabled/history/].


was (Author: michaelsembwever):
bq. This test seems pretty solid and we don't have logs to look into. 

Providing similar links that won't expire:
 - [history|jdk=jdk_1.8_latest,label=cassandra/testReport/org.apache.cassandra.distributed.test/NetstatsRepairStreamingTest/testWithCompressionDisabled/history/] (like [~Bereng]'s link above)
- [test result page with flakiness|https://ci-cassandra.apache.org/job/Cassandra-trunk-jvm-dtest/lastCompletedBuild/jdk=jdk_1.8_latest,label=cassandra/testReport/org.apache.cassandra.distributed.test/NetstatsRepairStreamingTest/testWithCompressionDisabled/]

h4. Searching nightlies.a.o
The logs for this test are archived at
{noformat}
https://nightlies.apache.org/cassandra/Cassandra-trunk-jvm-dtest/jdk=jdk_1.8_latest,label=cassandra/*/build/test/logs/org.apache.cassandra.distributed.test.NetstatsRepairStreamingTest/
{noformat}
for example https://nightlies.apache.org/cassandra/Cassandra-trunk-jvm-dtest/jdk=jdk_1.8_latest,label=cassandra/479/build/test/logs/org.apache.cassandra.distributed.test.NetstatsRepairStreamingTest/

To search in the archives, we can do…
{code}
# webdav mount https://nightlies.apache.org/cassandra/ to /Volumes/cassandra
cd /Volumes/cassandra

xzgrep "name=\"NetstatsRepairStreamingTest\"" Cassandra-trunk/*/TESTS-TestSuites.xml.xz
{code}
shows error (for the class) in builds:
- [Cassandra-trunk#83|https://nightlies.apache.org/cassandra/Cassandra-trunk/83]
- [Cassandra-trunk#108|https://nightlies.apache.org/cassandra/Cassandra-trunk/108]
- [Cassandra-trunk#117|https://nightlies.apache.org/cassandra/Cassandra-trunk/117]
- [Cassandra-trunk#153|https://nightlies.apache.org/cassandra/Cassandra-trunk/153]
- [Cassandra-trunk#161|https://nightlies.apache.org/cassandra/Cassandra-trunk/161]
- [Cassandra-trunk#166|https://nightlies.apache.org/cassandra/Cassandra-trunk/166]
- [Cassandra-trunk#171|https://nightlies.apache.org/cassandra/Cassandra-trunk/171]
- [Cassandra-trunk#195|https://nightlies.apache.org/cassandra/Cassandra-trunk/195]
- [Cassandra-trunk#216|https://nightlies.apache.org/cassandra/Cassandra-trunk/216]

From what I have searched the stage jobs to these failures (i.e. Cassandra-trunk-test builds) are older than the archives we have in nightlies. So only the information in the relevant {{TESTS-TestSuites.xml.xz}} (as linked to above) can be used.

Searching each of those builds reveals the same exception stack trace as described in the ticket description.
For example…
{code}
xzgrep -B1 "error message=\"Table does not match" Cassandra-trunk/216/TESTS-TestSuites.xml.xz 
{code}

Summarising, from the archives, from 154 Cassandra-trunk builds there are 9 failures of {{NetstatsRepairStreamingTest.testWithCompressionEnabled}}. That's a flakiness of ~6%, which corresponds to this [history link|jdk=jdk_1.8_latest,label=cassandra/testReport/org.apache.cassandra.distributed.test/NetstatsRepairStreamingTest/testWithCompressionEnabled/history/].

> Fix flaky test org.apache.cassandra.distributed.test.NetstatsRepairStreamingTest testWithCompressionDisabled
> ------------------------------------------------------------------------------------------------------------
>
>                 Key: CASSANDRA-16239
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-16239
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Test/dtest/java
>            Reporter: David Capwell
>            Assignee: Berenguer Blasi
>            Priority: Normal
>             Fix For: 4.0-beta
>
>
> {code}
> ava.lang.IllegalStateException: Table does not match - Active   Pending      Completed   Dropped
> 	at org.apache.cassandra.distributed.test.AbstractNetstatsStreaming$NetstatsOutputParser$SendingStatistics$SendingSSTable.parseTable(AbstractNetstatsStreaming.java:464)
> 	at org.apache.cassandra.distributed.test.AbstractNetstatsStreaming$NetstatsOutputParser$SendingStatistics.parseTable(AbstractNetstatsStreaming.java:349)
> 	at org.apache.cassandra.distributed.test.AbstractNetstatsStreaming$NetstatsOutputParser.parse(AbstractNetstatsStreaming.java:172)
> 	at org.apache.cassandra.distributed.test.NetstatsRepairStreamingTest.executeTest(NetstatsRepairStreamingTest.java:85)
> 	at org.apache.cassandra.distributed.test.NetstatsRepairStreamingTest.testWithCompressionDisabled(NetstatsRepairStreamingTest.java:47)
> 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org