You are viewing a plain text version of this content. The canonical link for it is here.
Posted to oak-issues@jackrabbit.apache.org by "Nitin Gupta (Jira)" <ji...@apache.org> on 2022/12/21 03:40:00 UTC

[jira] [Closed] (OAK-10010) Test org.apache.jackrabbit.oak.plugins.document.RandomizedClusterTest.addRemoveSet is Flaky

     [ https://issues.apache.org/jira/browse/OAK-10010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nitin Gupta closed OAK-10010.
-----------------------------

> Test org.apache.jackrabbit.oak.plugins.document.RandomizedClusterTest.addRemoveSet is Flaky
> -------------------------------------------------------------------------------------------
>
>                 Key: OAK-10010
>                 URL: https://issues.apache.org/jira/browse/OAK-10010
>             Project: Jackrabbit Oak
>          Issue Type: Bug
>          Components: documentmk
>            Reporter: Yichen
>            Assignee: Marcel Reutegger
>            Priority: Trivial
>             Fix For: 1.46.0
>
>         Attachments: org.apache.jackrabbit.oak.plugins.document.RandomizedClusterTest.txt
>
>
> {code:java}
> org.apache.jackrabbit.oak.plugins.document.RandomizedClusterTest.addRemoveSet {code}
> This is a flaky test, it can pass mvn test while but when run using the tool [NonDex|https://github.com/TestingResearchIllinois/NonDex], it fails. NonDex is a tool that will introduce non-determinism in certain java collections.The test shows below:
> {code:java}
> [INFO] Running org.apache.jackrabbit.oak.plugins.document.RandomizedClusterTest
> [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.615 s <<< FAILURE! - in org.apache.jackrabbit.oak.plugins.document.RandomizedClusterTest
> [ERROR] addRemoveSet(org.apache.jackrabbit.oak.plugins.document.RandomizedClusterTest)  Time elapsed: 1.601 s  <<< ERROR!
> java.lang.Exception: 
> log: 0: [1] + "t8": { "x": 3}
> 0: [1]  -> r184a581b34a-0-1,r184a581b37b-0-2
> 0: [1] get t8        at org.apache.jackrabbit.oak.plugins.document.RandomizedClusterTest.addRemoveSet(RandomizedClusterTest.java:240)
>         at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>         at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>         at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
>         at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
>         at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
>         at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
>         at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
>         at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
>         at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
>         at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
>         at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
>         at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
>         at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
>         at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
>         at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
>         at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
>         at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
>         at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
>         at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
>         at org.junit.runners.Suite.runChild(Suite.java:128)
>         at org.junit.runners.Suite.runChild(Suite.java:27)
>         at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
>         at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
>         at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
>         at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
>         at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
>         at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
>         at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
>         at org.apache.maven.surefire.junitcore.JUnitCore.run(JUnitCore.java:55)
>         at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:137)
>         at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
>         at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
>         at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
>         at org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:158)
>         at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
>         at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
>         at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
>         at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
> Caused by: org.junit.ComparisonFailure: expected:<{"[:childNodeCount":0,"x":3]}> but was:<{"[x":3,":childNodeCount":0]}>
>         at org.junit.Assert.assertEquals(Assert.java:117)
>         at org.junit.Assert.assertEquals(Assert.java:146)
>         at org.apache.jackrabbit.oak.plugins.document.RandomizedClusterTest.get(RandomizedClusterTest.java:330)
>         at org.apache.jackrabbit.oak.plugins.document.RandomizedClusterTest.get(RandomizedClusterTest.java:303)
>         at org.apache.jackrabbit.oak.plugins.document.RandomizedClusterTest.addRemoveSet(RandomizedClusterTest.java:220)
>         ... 40 more[INFO] 
> [INFO] Results:
> [INFO] 
> [ERROR] Errors: 
> [ERROR]   RandomizedClusterTest.addRemoveSet:240  log: 0: [1] + "t8": { "x": 3}
> 0: [1]  ...
> [INFO] 
> [ERROR] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0 {code}
> *Steps to reproduce the failure:*
> Run the following command in oak:
> First, build the module:
> {code:java}
> mvn install -pl oak-store-document -am -DskipTests{code}
> Then run the test using NonDex 
> {code:java}
> mvn -pl oak-store-document edu.illinois:nondex-maven-plugin:2.1:nondex -Dtest=org.apache.jackrabbit.oak.plugins.document.RandomizedClusterTest#addRemoveSet{code}
> The result will be saved under the module folder in .nondex



--
This message was sent by Atlassian Jira
(v8.20.10#820010)