You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Alex Petrov (JIRA)" <ji...@apache.org> on 2019/02/11 14:45:00 UTC

[jira] [Comment Edited] (CASSANDRA-15014) Unit tests failure on trunk

    [ https://issues.apache.org/jira/browse/CASSANDRA-15014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16764881#comment-16764881 ] 

Alex Petrov edited comment on CASSANDRA-15014 at 2/11/19 2:44 PM:
------------------------------------------------------------------

In summary, there was a problem with retention resulting from schema change: since it was executed on the main thread, we were retaining a bunch of thread locals. Attaching a screenshot showing that we retain mere 12mb after full test run. 

I did test it on several environments and it seems that circleci is still timing out because of GC pressure. I've decided to simplify runs and just have each test executing in its own JVM to avoid GC contention alltogether. 

I've also added an ant task to conveniently run distributed tests without test list and have improved a shutdown process. 

|[2.2|https://github.com/apache/cassandra/compare/2.2...ifesdjeen:CASSANDRA-15014-2.2]|[test run|https://circleci.com/workflow-run/8b1aae41-e279-405b-b5e5-12808179daa2]|
|[3.0|https://github.com/apache/cassandra/compare/3.0...ifesdjeen:CASSANDRA-15014-3.0]|[test run|https://circleci.com/workflow-run/53ad7477-7d5e-4c23-8634-be4def9e95b9]|
|[3.11|https://github.com/apache/cassandra/compare/3.11...ifesdjeen:CASSANDRA-15014-3.11]|[test run|https://circleci.com/workflow-run/e41d800f-e39d-4f1d-a2bd-99e61c8a0675]|
|[trunk|https://github.com/apache/cassandra/compare/trunk...ifesdjeen:CASSANDRA-15014-trunk]|[test run|https://circleci.com/workflow-run/6a326c41-8ffd-4307-b62f-b1bff3e15fce]|


was (Author: ifesdjeen):
In summary, there was a problem with retention resulting from schema change: since it was executed on the main thread, we were retaining a bunch of thread locals. Attaching a screenshot showing that we retain mere 12mb after full test run. 

I did test it on several environments and it seems that circleci is still timing out because of GC pressure. I've decided to simplify runs and just have each test executing in its own JVM to avoid GC contention alltogether. 

I've also added an ant task to conveniently run distributed tests without test list and have improved a shutdown process. 

|[patch|https://github.com/apache/cassandra/compare/2.2...ifesdjeen:CASSANDRA-15014-2.2]|[test run|https://circleci.com/workflow-run/8b1aae41-e279-405b-b5e5-12808179daa2]|
|[patch|https://github.com/apache/cassandra/compare/3.0...ifesdjeen:CASSANDRA-15014-3.0]|[test run|https://circleci.com/workflow-run/53ad7477-7d5e-4c23-8634-be4def9e95b9]|
|[patch|https://github.com/apache/cassandra/compare/3.11...ifesdjeen:CASSANDRA-15014-3.11]|[test run|https://circleci.com/workflow-run/e41d800f-e39d-4f1d-a2bd-99e61c8a0675]|
|[patch|https://github.com/apache/cassandra/compare/trunk...ifesdjeen:CASSANDRA-15014-trunk]|[test run|https://circleci.com/workflow-run/6a326c41-8ffd-4307-b62f-b1bff3e15fce]|

> Unit tests failure on trunk
> ---------------------------
>
>                 Key: CASSANDRA-15014
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-15014
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Test/unit
>            Reporter: Dinesh Joshi
>            Assignee: Alex Petrov
>            Priority: Major
>         Attachments: Screen Shot 2019-02-11 at 12.30.19.png
>
>
> Currently org.apache.cassandra.distributed.test.DistributedReadWritePathTest is failing on trunk with the following error -
> {code:java}
> [junit-timeout] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
> [junit-timeout] Testsuite: org.apache.cassandra.distributed.test.DistributedReadWritePathTest
> [junit-timeout] Exception in thread "main" java.lang.OutOfMemoryError: Metaspace
> [junit-timeout] Testsuite: org.apache.cassandra.distributed.test.DistributedReadWritePathTest
> [junit-timeout] Testsuite: org.apache.cassandra.distributed.test.DistributedReadWritePathTest Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0 sec
> [junit-timeout] 
> [junit-timeout] Testcase: org.apache.cassandra.distributed.test.DistributedReadWritePathTest:readWithSchemaDisagreement: Caused an ERROR
> [junit-timeout] Forked Java VM exited abnormally. Please note the time in the report does not reflect the time until the VM exit.
> [junit-timeout] junit.framework.AssertionFailedError: Forked Java VM exited abnormally. Please note the time in the report does not reflect the time until the VM exit.
> [junit-timeout] at java.util.Vector.forEach(Vector.java:1275)
> [junit-timeout] at java.util.Vector.forEach(Vector.java:1275)
> [junit-timeout] at java.lang.Thread.run(Thread.java:748)
> [junit-timeout] 
> [junit-timeout] 
> [junit-timeout] Test org.apache.cassandra.distributed.test.DistributedReadWritePathTest FAILED (crashed)
> [junitreport] Processing /tmp/cassandra/build/test/TESTS-TestSuites.xml to /tmp/null1041131060
> [junitreport] Loading stylesheet jar:file:/usr/share/ant/lib/ant-junit.jar!/org/apache/tools/ant/taskdefs/optional/junit/xsl/junit-frames.xsl
> [junitreport] Transform time: 277ms
> [junitreport] Deleting: /tmp/null1041131060{code}
> I have noticed sporadic failures in the org.apache.cassandra.distributed.test.* suite.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org