You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Jim Witschey (JIRA)" <ji...@apache.org> on 2016/03/17 21:47:33 UTC

[jira] [Created] (CASSANDRA-11377) dtest failure in topology_test.TestTopology.crash_during_decommission_test

Jim Witschey created CASSANDRA-11377:
----------------------------------------

             Summary: dtest failure in topology_test.TestTopology.crash_during_decommission_test
                 Key: CASSANDRA-11377
                 URL: https://issues.apache.org/jira/browse/CASSANDRA-11377
             Project: Cassandra
          Issue Type: Test
            Reporter: Jim Witschey
            Assignee: DS Test Eng


This has flapped once on 3.0:

http://cassci.datastax.com/job/cassandra-3.0_dtest/614/testReport/topology_test/TestTopology/crash_during_decommission_test

and more frequently on trunk:

http://cassci.datastax.com/job/trunk_dtest/1057/testReport/junit/topology_test/TestTopology/crash_during_decommission_test/

Message and trace:

{code}
Error Message

15 Mar 2016 10:48:55 [node1] Missing: ['127.0.0.2.* now UP']:
.....
See system.log for remainder
-------------------- >> begin captured logging << --------------------
dtest: DEBUG: cluster ccm directory: /mnt/tmp/dtest-EJfTo3
dtest: DEBUG: Custom init_config not found. Setting defaults.
dtest: DEBUG: Done setting configuration options:
{   'initial_token': None,
    'num_tokens': '32',
    'phi_convict_threshold': 5,
    'range_request_timeout_in_ms': 10000,
    'read_request_timeout_in_ms': 10000,
    'request_timeout_in_ms': 10000,
    'truncate_request_timeout_in_ms': 10000,
    'write_request_timeout_in_ms': 10000}
dtest: DEBUG: Status as reported by node 127.0.0.2
dtest: DEBUG: Datacenter: datacenter1
=======================
Status=Up/Down
|/ State=Normal/Leaving/Joining/Moving
--  Address    Load       Tokens       Owns (effective)  Host ID                               Rack
UN  127.0.0.1  112.85 KB  32           64.1%             d7d836bd-a0ff-474c-b04c-2c00bd2fc636  rack1
UN  127.0.0.2  127.25 KB  32           61.7%             68c5a8c4-8986-40df-afb2-ee0849814618  rack1
UN  127.0.0.3  112.68 KB  32           74.2%             6dd52315-53f4-444d-bace-a8a0d7c2b34e  rack1


dtest: DEBUG: Restarting node2
dtest: DEBUG: 
dtest: DEBUG: 
--------------------- >> end captured logging << ---------------------
Stacktrace

  File "/usr/lib/python2.7/unittest/case.py", line 329, in run
    testMethod()
  File "/home/automaton/cassandra-dtest/tools.py", line 253, in wrapped
    f(obj)
  File "/home/automaton/cassandra-dtest/topology_test.py", line 230, in crash_during_decommission_test
    node2.start(wait_for_binary_proto=True)
  File "/home/automaton/ccm/ccmlib/node.py", line 597, in start
    node.watch_log_for_alive(self, from_mark=mark)
  File "/home/automaton/ccm/ccmlib/node.py", line 449, in watch_log_for_alive
    self.watch_log_for(tofind, from_mark=from_mark, timeout=timeout, filename=filename)
  File "/home/automaton/ccm/ccmlib/node.py", line 417, in watch_log_for
    raise TimeoutError(time.strftime("%d %b %Y %H:%M:%S", time.gmtime()) + " [" + self.name + "] Missing: " + str([e.pattern for e in tofind]) + ":\n" + reads[:50] + ".....\nSee {} for remainder".format(filename))
"15 Mar 2016 10:48:55 [node1] Missing: ['127.0.0.2.* now UP']:\n.....\nSee system.log for remainder\n-------------------- >> begin captured logging << --------------------\ndtest: DEBUG: cluster ccm directory: /mnt/tmp/dtest-EJfTo3\ndtest: DEBUG: Custom init_config not found. Setting defaults.\ndtest: DEBUG: Done setting configuration options:\n{   'initial_token': None,\n    'num_tokens': '32',\n    'phi_convict_threshold': 5,\n    'range_request_timeout_in_ms': 10000,\n    'read_request_timeout_in_ms': 10000,\n    'request_timeout_in_ms': 10000,\n    'truncate_request_timeout_in_ms': 10000,\n    'write_request_timeout_in_ms': 10000}\ndtest: DEBUG: Status as reported by node 127.0.0.2\ndtest: DEBUG: Datacenter: datacenter1\n=======================\nStatus=Up/Down\n|/ State=Normal/Leaving/Joining/Moving\n--  Address    Load       Tokens       Owns (effective)  Host ID                               Rack\nUN  127.0.0.1  112.85 KB  32           64.1%             d7d836bd-a0ff-474c-b04c-2c00bd2fc636  rack1\nUN  127.0.0.2  127.25 KB  32           61.7%             68c5a8c4-8986-40df-afb2-ee0849814618  rack1\nUN  127.0.0.3  112.68 KB  32           74.2%             6dd52315-53f4-444d-bace-a8a0d7c2b34e  rack1\n\n\ndtest: DEBUG: Restarting node2\ndtest: DEBUG: \ndtest: DEBUG: \n--------------------- >> end captured logging << ---------------------"
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)