You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Berenguer Blasi (Jira)" <ji...@apache.org> on 2021/03/31 08:41:00 UTC

[jira] [Commented] (CASSANDRA-16546) Flaky testRecoverOverflowedExpirationWithSSTableScrub

    [ https://issues.apache.org/jira/browse/CASSANDRA-16546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312189#comment-17312189 ] 

Berenguer Blasi commented on CASSANDRA-16546:
---------------------------------------------

Difficult to repro either locally and won't repro on the multiplexer. I manged to do it on a slow virtual env and only seldom yet.

The problem was that the test class expects to be ran as a tool with a stable env under it's feet. On a test class there are other async things happening such as test method cleanup logic. We can see the failure was the tool being ran for a specific ks.cf but complaining on a different one i.e.

{noformat}
[junit-timeout] Testcase: testRecoverOverflowedExpirationWithSSTableScrub(org.apache.cassandra.cql3.validation.operations.TTLTest):     FAILED
[junit-timeout] [org.apache.cassandra.tools.StandaloneScrubber,
[junit-timeout]     cql_test_keyspace,
[junit-timeout]     table_39]
[junit-timeout] exited with code 1
[junit-timeout] stderr:
[junit-timeout] Columns not found in schema table for cql_test_keyspace.table_26
[junit-timeout]
[junit-timeout] stdout:
[junit-timeout]
[junit-timeout] junit.framework.AssertionFailedError: [org.apache.cassandra.tools.StandaloneScrubber,
[junit-timeout]     cql_test_keyspace,
[junit-timeout]     table_39]
[junit-timeout] exited with code 1
[junit-timeout] stderr:
[junit-timeout] Columns not found in schema table for cql_test_keyspace.table_26
{noformat}

This came from the tool loading schema on startup from disk

{noformat}
ERROR [main] 2021-03-31 09:26:18,340 cql_test_keyspace:table_24 not found in the schema definitions keyspace.
java.lang.Exception: null
        at org.apache.cassandra.schema.SchemaKeyspace.fetchTable(SchemaKeyspace.java:956)
        at org.apache.cassandra.schema.SchemaKeyspace.fetchTables(SchemaKeyspace.java:921)
        at org.apache.cassandra.schema.SchemaKeyspace.fetchKeyspace(SchemaKeyspace.java:880)
        at org.apache.cassandra.schema.SchemaKeyspace.fetchKeyspacesWithout(SchemaKeyspace.java:871)
        at org.apache.cassandra.schema.SchemaKeyspace.fetchNonSystemKeyspaces(SchemaKeyspace.java:859)
        at org.apache.cassandra.schema.Schema.loadFromDisk(Schema.java:101)
        at org.apache.cassandra.tools.StandaloneScrubber.main(StandaloneScrubber.java:88)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.cassandra.tools.ToolRunner.runClassAsTool(ToolRunner.java:82)
        at org.apache.cassandra.tools.ToolRunner$2.get(ToolRunner.java:249)
        at org.apache.cassandra.tools.ToolRunner$2.get(ToolRunner.java:245)
        at org.apache.cassandra.tools.ToolRunner.invokeSupplier(ToolRunner.java:305)
        at org.apache.cassandra.tools.ToolRunner.invokeClass(ToolRunner.java:253)
        at org.apache.cassandra.tools.ToolRunner.invokeClass(ToolRunner.java:235)
        at org.apache.cassandra.cql3.validation.operations.TTLTest.testRecoverOverflowedExpirationWithScrub(TTLTest.java:424)
        at org.apache.cassandra.cql3.validation.operations.TTLTest.baseTestRecoverOverflowedExpiration(TTLTest.java:304)
        at org.apache.cassandra.cql3.validation.operations.TTLTest.testRecoverOverflowedExpirationWithSSTableScrub(TTLTest.java:227)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
        at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
        at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
        at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
        at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
        at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
        at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
        at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
        at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
        at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
        at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
        at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
        at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
        at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
        at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
        at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
        at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
        at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:38)
        at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:534)
        at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1196)
        at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:1041)
{noformat}

The proposed solution is to force drop tables in-between such tests and it doesn't repro anymore.

> Flaky testRecoverOverflowedExpirationWithSSTableScrub
> -----------------------------------------------------
>
>                 Key: CASSANDRA-16546
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-16546
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Test/unit
>            Reporter: Berenguer Blasi
>            Assignee: Berenguer Blasi
>            Priority: Normal
>             Fix For: 4.0-rc
>
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> See [here|https://ci-cassandra.apache.org/job/Cassandra-trunk-test/627/jdk=jdk_11_latest,label=cassandra,split=4/testReport/junit/org.apache.cassandra.cql3.validation.operations/TTLTest/testRecoverOverflowedExpirationWithSSTableScrub/]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org