You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Paulo Motta (JIRA)" <ji...@apache.org> on 2015/08/27 18:27:46 UTC
[jira] [Commented] (CASSANDRA-10037) Auth upgrade test failing on
Windows 2.2
[ https://issues.apache.org/jira/browse/CASSANDRA-10037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14716991#comment-14716991 ]
Paulo Motta commented on CASSANDRA-10037:
-----------------------------------------
Reopening due to a [regression|http://cassci.datastax.com/view/cassandra-3.0/job/cassandra-3.0_dtest_win32/32/testReport/upgrade_internal_auth_test/TestAuthUpgrade/upgrade_to_22_test/history/] on this test:
{noformat}
Unexpected error in node3 node log: ['ERROR [InternalResponseStage:1] 2015-08-26 20:58:52,042 CassandraDaemon.java:223 Exception in thread Thread[InternalResponseStage:1,5,main] java.lang.RuntimeException: java.lang.RuntimeException: java.io.FileNotFoundException: d:\\temp\\dtest-h6pke6\\test\\node3\\data\\system\\schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697\\system-schema_columnfamilies-tmplink-ka-9-Data.db (The process cannot access the file because it is being used by another process)
at org.apache.cassandra.config.Schema.updateVersion(Schema.java:390) ~[main/:na]
at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:399) ~[main/:na]
at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:167) ~[main/:na]
at org.apache.cassandra.service.MigrationTask$1.response(MigrationTask.java:75) ~[main/:na]
at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:54) ~[main/:na]
at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:64) ~[main/:na]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[na:1.8.0_51]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[na:1.8.0_51]
at java.lang.Thread.run(Thread.java:745) ~[na:1.8.0_51] Caused by: java.lang.RuntimeException: java.io.FileNotFoundException: d:\\temp\\dtest-h6pke6\\test\\node3\\data\\system\\schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697\\system-schema_columnfamilies-tmplink-ka-9-Data.db (The process cannot access the file because it is being used by another process)
at org.apache.cassandra.io.compress.CompressedRandomAccessReader.open(CompressedRandomAccessReader.java:52) ~[main/:na]
at org.apache.cassandra.io.util.CompressedPoolingSegmentedFile.createReader(CompressedPoolingSegmentedFile.java:85) ~[main/:na]
at org.apache.cassandra.io.sstable.SSTableReader.openDataReader(SSTableReader.java:2063) ~[main/:na]
at org.apache.cassandra.io.sstable.SSTableScanner.<init>(SSTableScanner.java:84) ~[main/:na]
at org.apache.cassandra.io.sstable.SSTableScanner.getScanner(SSTableScanner.java:63) ~[main/:na]
at org.apache.cassandra.io.sstable.SSTableReader.getScanner(SSTableReader.java:1847) ~[main/:na]
at org.apache.cassandra.db.RowIteratorFactory.getIterator(RowIteratorFactory.java:67) ~[main/:na]
at org.apache.cassandra.db.ColumnFamilyStore.getSequentialIterator(ColumnFamilyStore.java:2106) ~[main/:na]
at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:2223) ~[main/:na]
at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:2155) ~[main/:na]
at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:786) ~[main/:na]
at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:773) ~[main/:na]
at org.apache.cassandra.config.Schema.updateVersion(Schema.java:374)
{noformat}
I was able to reproduce it locally and the error also happens on 2.1 before upgrading.
Instead of using the error whitelist approach, I added a new method to ccm {{node.mark_log_for_errors()}} on this [PR|https://github.com/pcmanus/ccm/pull/370], that ignore all errors before this mark on {{node.grep_log_for_errors()}}. With this in hand, the idea is to mark the log for errors just before upgrading to 2.2 on Windows, effectivelly ignoring all errors happening on 2.1. I create a [cassandra-dtest PR|https://github.com/riptano/cassandra-dtest/pull/515] with this modification. Do you have any objections against this approach [~JoshuaMcKenzie]?
> Auth upgrade test failing on Windows 2.2
> ----------------------------------------
>
> Key: CASSANDRA-10037
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10037
> Project: Cassandra
> Issue Type: Sub-task
> Reporter: Philip Thompson
> Assignee: Joshua McKenzie
> Labels: Windows
> Fix For: 2.2.1
>
>
> {{upgrade_internal_auth_test.TestAuthUpgrade.upgrade_to_22_test}} is failing on 2.2-HEAD, with the following error message:
> {code}
> Unexpected error in node1 node log: ["ERROR [NonPeriodicTasks:1] 2015-08-10 11:18:58,464 SSTableDeletingTask.java:85 - Unable to delete d:\\temp\\dtest-dwg3cr\\test\\node1\\data\\system\\schema_keyspaces-b0f2235744583cdb9631c43e59ce3676\\system-schema_keyspaces-tmplink-ka-9-Data.db (it will be removed on server restart; we'll also retry after GC) WARN [GossipTasks:1] 2015-08-10 11:18:58,466 FailureDetector.java:249 - Not marking nodes down due to local pause of 6214735232 > 5000000000", "ERROR [NonPeriodicTasks:1] 2015-08-10 11:19:27,625 SSTableDeletingTask.java:85 - Unable to delete d:\\temp\\dtest-dwg3cr\\test\\node1\\data\\system\\schema_columns-296e9c049bec3085827dc17d3df2122a\\system-schema_columns-tmplink-ka-9-Data.db (it will be removed on server restart; we'll also retry after GC)"]
> {code}
> I think this is largely due to the fact that it upgrades from 2.1, and this error occurs on 2.1. It doesn't seem to be a big issue, but letting you decide.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)