You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Joseph Lynch (JIRA)" <ji...@apache.org> on 2017/11/20 23:46:00 UTC
[jira] [Commented] (CASSANDRA-14043) Lots of failures in
test_network_topology_strategy
[ https://issues.apache.org/jira/browse/CASSANDRA-14043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16260036#comment-16260036 ]
Joseph Lynch commented on CASSANDRA-14043:
------------------------------------------
[~mkjellman]
I'm trying to reproduce these failures/flakes so I can debug them, but these appear to pass locally for me against latest trunk running on Mac OSX (once I setup the 9 localhost aliases needed by Mac). Do these fail every time for you or is it more of a flakey experience?
e.g.
{noformat}
~/pg/cassandra-dtest-mirror(CASSANDRA-14043*) ยป nosetests --no-skip -x consistency_test.py
...........
----------------------------------------------------------------------
Ran 24 tests in 1388.105s
OK
{noformat}
> Lots of failures in test_network_topology_strategy
> --------------------------------------------------
>
> Key: CASSANDRA-14043
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14043
> Project: Cassandra
> Issue Type: Bug
> Components: Testing
> Reporter: Michael Kjellman
>
> There are lots of failures in test_network_topology_strategy... Creating one JIRA to track them all...
> test_network_topology_strategy - consistency_test.TestAvailability
> [Errno 2] No such file or directory: '/tmp/dtest-H1psQ0/test/node1/logs/system.log'
> -------------------- >> begin captured logging << --------------------
> dtest: DEBUG: cluster ccm directory: /tmp/dtest-H1psQ0
> dtest: DEBUG: Done setting configuration options:
> { 'initial_token': None,
> 'num_tokens': '32',
> 'phi_convict_threshold': 5,
> 'range_request_timeout_in_ms': 10000,
> 'read_request_timeout_in_ms': 10000,
> 'request_timeout_in_ms': 10000,
> 'truncate_request_timeout_in_ms': 10000,
> 'write_request_timeout_in_ms': 10000}
> --------------------- >> end captured logging << ---------------------
> File "/usr/lib/python2.7/unittest/case.py", line 358, in run
> self.tearDown()
> File "/home/cassandra/cassandra-dtest/dtest.py", line 597, in tearDown
> if not self.allow_log_errors and self.check_logs_for_errors():
> File "/home/cassandra/cassandra-dtest/dtest.py", line 614, in check_logs_for_errors
> ['\n'.join(msg) for msg in node.grep_log_for_errors()]))
> File "/home/cassandra/env/local/lib/python2.7/site-packages/ccmlib/node.py", line 386, in grep_log_for_errors
> return self.grep_log_for_errors_from(seek_start=getattr(self, 'error_mark', 0))
> File "/home/cassandra/env/local/lib/python2.7/site-packages/ccmlib/node.py", line 389, in grep_log_for_errors_from
> with open(os.path.join(self.get_path(), 'logs', filename)) as f:
> "[Errno 2] No such file or directory: '/tmp/dtest-H1psQ0/test/node1/logs/system.log'\n-------------------- >> begin captured logging << --------------------\ndtest: DEBUG: cluster ccm directory: /tmp/dtest-H1psQ0\ndtest: DEBUG: Done setting configuration options:\n{ 'initial_token': None,\n 'num_tokens': '32',\n 'phi_convict_threshold': 5,\n 'range_request_timeout_in_ms': 10000,\n 'read_request_timeout_in_ms': 10000,\n 'request_timeout_in_ms': 10000,\n 'truncate_request_timeout_in_ms': 10000,\n 'write_request_timeout_in_ms': 10000}\n--------------------- >> end captured logging << ---------------------"
> test_network_topology_strategy_counters - consistency_test.TestAccuracy
> Error starting node3.
> -------------------- >> begin captured logging << --------------------
> dtest: DEBUG: cluster ccm directory: /tmp/dtest-3px8TH
> dtest: DEBUG: Done setting configuration options:
> { 'initial_token': None,
> 'num_tokens': '32',
> 'phi_convict_threshold': 5,
> 'range_request_timeout_in_ms': 10000,
> 'read_request_timeout_in_ms': 10000,
> 'request_timeout_in_ms': 10000,
> 'truncate_request_timeout_in_ms': 10000,
> 'write_request_timeout_in_ms': 10000}
> dtest: DEBUG: Testing multiple dcs, counters
> --------------------- >> end captured logging << ---------------------
> File "/usr/lib/python2.7/unittest/case.py", line 329, in run
> testMethod()
> File "/home/cassandra/cassandra-dtest/consistency_test.py", line 753, in test_network_topology_strategy_counters
> self._run_test_function_in_parallel(TestAccuracy.Validation.validate_counters, self.nodes, self.rf.values(), combinations),
> File "/home/cassandra/cassandra-dtest/consistency_test.py", line 535, in _run_test_function_in_parallel
> self._start_cluster(save_sessions=True, requires_local_reads=requires_local_reads)
> File "/home/cassandra/cassandra-dtest/consistency_test.py", line 141, in _start_cluster
> cluster.start(wait_for_binary_proto=True, wait_other_notice=True)
> File "/home/cassandra/env/local/lib/python2.7/site-packages/ccmlib/cluster.py", line 423, in start
> raise NodeError("Error starting {0}.".format(node.name), p)
> "Error starting node3.\n-------------------- >> begin captured logging << --------------------\ndtest: DEBUG: cluster ccm directory: /tmp/dtest-3px8TH\ndtest: DEBUG: Done setting configuration options:\n{ 'initial_token': None,\n 'num_tokens': '32',\n 'phi_convict_threshold': 5,\n 'range_request_timeout_in_ms': 10000,\n 'read_request_timeout_in_ms': 10000,\n 'request_timeout_in_ms': 10000,\n 'truncate_request_timeout_in_ms': 10000,\n 'write_request_timeout_in_ms': 10000}\ndtest: DEBUG: Testing multiple dcs, counters\n--------------------- >> end captured logging << ---------------------"
> test_network_topology_strategy_each_quorum_counters - consistency_test.TestAccuracy
> Error starting node1.
> -------------------- >> begin captured logging << --------------------
> dtest: DEBUG: cluster ccm directory: /tmp/dtest-EkrtYq
> dtest: DEBUG: Done setting configuration options:
> { 'initial_token': None,
> 'num_tokens': '32',
> 'phi_convict_threshold': 5,
> 'range_request_timeout_in_ms': 10000,
> 'read_request_timeout_in_ms': 10000,
> 'request_timeout_in_ms': 10000,
> 'truncate_request_timeout_in_ms': 10000,
> 'write_request_timeout_in_ms': 10000}
> dtest: DEBUG: Testing multiple dcs, counters, each quorum reads
> --------------------- >> end captured logging << ---------------------
> File "/usr/lib/python2.7/unittest/case.py", line 329, in run
> testMethod()
> File "/home/cassandra/cassandra-dtest/tools/decorators.py", line 48, in wrapped
> f(obj)
> File "/home/cassandra/cassandra-dtest/consistency_test.py", line 772, in test_network_topology_strategy_each_quorum_counters
> self._run_test_function_in_parallel(TestAccuracy.Validation.validate_counters, self.nodes, self.rf.values(), combinations),
> File "/home/cassandra/cassandra-dtest/consistency_test.py", line 535, in _run_test_function_in_parallel
> self._start_cluster(save_sessions=True, requires_local_reads=requires_local_reads)
> File "/home/cassandra/cassandra-dtest/consistency_test.py", line 141, in _start_cluster
> cluster.start(wait_for_binary_proto=True, wait_other_notice=True)
> File "/home/cassandra/env/local/lib/python2.7/site-packages/ccmlib/cluster.py", line 423, in start
> raise NodeError("Error starting {0}.".format(node.name), p)
> "Error starting node1.\n-------------------- >> begin captured logging << --------------------\ndtest: DEBUG: cluster ccm directory: /tmp/dtest-EkrtYq\ndtest: DEBUG: Done setting configuration options:\n{ 'initial_token': None,\n 'num_tokens': '32',\n 'phi_convict_threshold': 5,\n 'range_request_timeout_in_ms': 10000,\n 'read_request_timeout_in_ms': 10000,\n 'request_timeout_in_ms': 10000,\n 'truncate_request_timeout_in_ms': 10000,\n 'write_request_timeout_in_ms': 10000}\ndtest: DEBUG: Testing multiple dcs, counters, each quorum reads\n--------------------- >> end captured logging << ---------------------"
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org