You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Brandon Williams (Jira)" <ji...@apache.org> on 2022/07/14 15:07:00 UTC

[jira] [Commented] (CASSANDRA-17749) Fix flaky dtest - dtest-upgrade.upgrade_tests.upgrade_through_versions_test.TestUpgrade_indev_4_0_x_To_indev_4_1_x.test_bootstrap_multidc

    [ https://issues.apache.org/jira/browse/CASSANDRA-17749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566877#comment-17566877 ] 

Brandon Williams commented on CASSANDRA-17749:
----------------------------------------------

I haven't been able to reproduce this because I believe it is very sensitive to timing.  We are forcing an update of the topology files [here|https://github.com/apache/cassandra-dtest/blob/trunk/upgrade_tests/upgrade_through_versions_test.py#L511] but this is being written in place.  If the timer task in the ResourceWatcher for PropertyFileSnitch fires while this happens, it may read an empty file, causing this error.  But this isn't a problem other than the log entry, since the file will be read again with the correct information after it is written.  [Patch|https://github.com/driftx/cassandra-dtest/tree/CASSANDRA-17749] to suppress the log, with [100 runs|https://app.circleci.com/pipelines/github/driftx/cassandra/544/workflows/954fcba1-be3a-47b5-8156-a1ce50afa4b4/jobs/6514].

> Fix flaky dtest - dtest-upgrade.upgrade_tests.upgrade_through_versions_test.TestUpgrade_indev_4_0_x_To_indev_4_1_x.test_bootstrap_multidc
> -----------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CASSANDRA-17749
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-17749
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Test/dtest/python
>            Reporter: Brandon Williams
>            Assignee: Brandon Williams
>            Priority: Normal
>             Fix For: 4.1-beta, 4.x
>
>
> https://ci-cassandra.apache.org/job/Cassandra-4.1/93/testReport/dtest-upgrade.upgrade_tests.upgrade_through_versions_test/TestUpgrade_indev_4_0_x_To_indev_4_1_x/test_bootstrap_multidc/
> Error Message
> test teardown failure
> Stacktrace
> Unexpected error found in node logs (see stdout for full details). Errors: [[node2] "ERROR [ScheduledTasks:1] 2022-07-11 22:53:45,982 ResourceWatcher.java:64 - Timed run of class org.apache.cassandra.locator.PropertyFileSnitch$1 failed.\norg.apache.cassandra.exceptions.ConfigurationException: Snitch definitions at cassandra-topology.properties do not define a location for this node's broadcast address /127.0.0.2:7000, nor does it provides a default\n\tat org.apache.cassandra.locator.PropertyFileSnitch.reloadConfiguration(PropertyFileSnitch.java:191)\n\tat org.apache.cassandra.locator.PropertyFileSnitch$1.runMayThrow(PropertyFileSnitch.java:78)\n\tat org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)\n\tat org.apache.cassandra.utils.ResourceWatcher$WatchedResource.run(ResourceWatcher.java:57)\n\tat org.apache.cassandra.concurrent.ExecutionFailure$1.run(ExecutionFailure.java:124)\n\tat java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)\n\tat java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)\n\tat java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)\n\tat java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)\n\tat io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)\n\tat java.lang.Thread.run(Thread.java:748)"]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org