You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Cathy Daw (JIRA)" <ji...@apache.org> on 2011/04/22 00:32:05 UTC

[jira] [Created] (CASSANDRA-2534) CQL: CREATE CF, DROP CF, CREATE CF caused my cluster to crash

CQL: CREATE CF, DROP CF, CREATE CF caused my cluster to crash
-------------------------------------------------------------

                 Key: CASSANDRA-2534
                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2534
             Project: Cassandra
          Issue Type: Bug
    Affects Versions: 0.8.0
            Reporter: Cathy Daw
            Priority: Critical


The following test case of CREATE CF, DROP CF, CREATE CF caused my cluster to crash.

*CREATE/DROP/CREATE CF users*
{code}
cqlsh> CREATE COLUMNFAMILY users (
   ...   KEY varchar PRIMARY KEY,
   ...   password varchar);


cqlsh> drop columnfamily users;

cqlsh> CREATE COLUMNFAMILY users (
   ...   userkey varchar PRIMARY KEY,
   ...   password varchar);
Exception: TSocket read 0 bytes

{code}

*Cassandra CLI - session broken*
{code}
[default@clidb] describe keyspace cqldb;
java.net.SocketException: Broken pipe

{code}

*Nodetool - server down*
{code}
[cassandra@cdaw-qa1 bin]$ ./nodetool -h cdaw-qa1 -p 7199 ring
Error connection to remote JMX agent!
java.io.IOException: Failed to retrieve RMIServer stub: javax.naming.ServiceUnavailableException [Root exception is java.rmi.ConnectException: Connection refused to host: cdaw-qa1; nested exception is: 
	java.net.ConnectException: Connection refused]
	at javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:342)
	at javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:267)
	at org.apache.cassandra.tools.NodeProbe.connect(NodeProbe.java:139)
	at org.apache.cassandra.tools.NodeProbe.<init>(NodeProbe.java:109)
	at org.apache.cassandra.tools.NodeCmd.main(NodeCmd.java:525)
Caused by: javax.naming.ServiceUnavailableException [Root exception is java.rmi.ConnectException: Connection refused to host: cdaw-qa1; nested exception is: 
	java.net.ConnectException: Connection refused]
	at com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:118)
	at com.sun.jndi.toolkit.url.GenericURLContext.lookup(GenericURLContext.java:203)
	at javax.naming.InitialContext.lookup(InitialContext.java:409)
	at javax.management.remote.rmi.RMIConnector.findRMIServerJNDI(RMIConnector.java:1902)
	at javax.management.remote.rmi.RMIConnector.findRMIServer(RMIConnector.java:1871)
	at javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:276)
	... 4 more
Caused by: java.rmi.ConnectException: Connection refused to host: cdaw-qa1; nested exception is: 
	java.net.ConnectException: Connection refused
	at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:619)
	at sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:216)
	at sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
	at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:340)
	at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown Source)
	at com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:114)
	... 9 more
Caused by: java.net.ConnectException: Connection refused
	at java.net.PlainSocketImpl.socketConnect(Native Method)
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:310)
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:176)
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:163)
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)
	at java.net.Socket.connect(Socket.java:546)
	at java.net.Socket.connect(Socket.java:495)
	at java.net.Socket.<init>(Socket.java:392)
	at java.net.Socket.<init>(Socket.java:206)
	at sun.rmi.transport.proxy.RMIDirectSocketFactory.createSocket(RMIDirectSocketFactory.java:40)
	at sun.rmi.transport.proxy.RMIMasterSocketFactory.createSocket(RMIMasterSocketFactory.java:146)
	at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:613)
	... 14 more

{code}


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (CASSANDRA-2534) CQL: CREATE CF, DROP CF, CREATE CF caused my cluster to crash

Posted by "Cathy Daw (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-2534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022963#comment-13022963 ] 

Cathy Daw commented on CASSANDRA-2534:
--------------------------------------

*Here is the activity on the consoles for each node*

{noformat}
First Node (Seed): cdaw-qa1
 INFO 21:28:42,340 Completed flushing /var/lib/cassandra/data/system/Schema-f-39-Data.db (3549 bytes)
 INFO 21:36:53,342 Deleted /var/lib/cassandra/data/system/Schema-f-36
<console was disconnected>


Second Node: cdaw-qa2
 INFO 21:28:00,955 Completed flushing /var/lib/cassandra/data/system/Schema-f-39-Data.db (3549 bytes)
<console was disconnected>


Third Node: cdaw-qa3
 INFO 21:28:37,321 Completed flushing /var/lib/cassandra/data/system/Schema-f-39-Data.db (3549 bytes)
<console was disconnected>

{noformat}


> CQL: CREATE CF, DROP CF, CREATE CF caused my cluster to crash
> -------------------------------------------------------------
>
>                 Key: CASSANDRA-2534
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2534
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.8.0
>            Reporter: Cathy Daw
>            Priority: Critical
>              Labels: cql
>
> The following test case of CREATE CF, DROP CF, CREATE CF caused my cluster to crash.
> *CREATE/DROP/CREATE CF users*
> {code}
> cqlsh> CREATE COLUMNFAMILY users (
>    ...   KEY varchar PRIMARY KEY,
>    ...   password varchar);
> cqlsh> drop columnfamily users;
> cqlsh> CREATE COLUMNFAMILY users (
>    ...   userkey varchar PRIMARY KEY,
>    ...   password varchar);
> Exception: TSocket read 0 bytes
> {code}
> *Cassandra CLI - session broken*
> {code}
> [default@clidb] describe keyspace cqldb;
> java.net.SocketException: Broken pipe
> {code}
> *Nodetool - server down*
> {code}
> [cassandra@cdaw-qa1 bin]$ ./nodetool -h cdaw-qa1 -p 7199 ring
> Error connection to remote JMX agent!
> java.io.IOException: Failed to retrieve RMIServer stub: javax.naming.ServiceUnavailableException [Root exception is java.rmi.ConnectException: Connection refused to host: cdaw-qa1; nested exception is: 
> 	java.net.ConnectException: Connection refused]
> 	at javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:342)
> 	at javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:267)
> 	at org.apache.cassandra.tools.NodeProbe.connect(NodeProbe.java:139)
> 	at org.apache.cassandra.tools.NodeProbe.<init>(NodeProbe.java:109)
> 	at org.apache.cassandra.tools.NodeCmd.main(NodeCmd.java:525)
> Caused by: javax.naming.ServiceUnavailableException [Root exception is java.rmi.ConnectException: Connection refused to host: cdaw-qa1; nested exception is: 
> 	java.net.ConnectException: Connection refused]
> 	at com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:118)
> 	at com.sun.jndi.toolkit.url.GenericURLContext.lookup(GenericURLContext.java:203)
> 	at javax.naming.InitialContext.lookup(InitialContext.java:409)
> 	at javax.management.remote.rmi.RMIConnector.findRMIServerJNDI(RMIConnector.java:1902)
> 	at javax.management.remote.rmi.RMIConnector.findRMIServer(RMIConnector.java:1871)
> 	at javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:276)
> 	... 4 more
> Caused by: java.rmi.ConnectException: Connection refused to host: cdaw-qa1; nested exception is: 
> 	java.net.ConnectException: Connection refused
> 	at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:619)
> 	at sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:216)
> 	at sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
> 	at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:340)
> 	at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown Source)
> 	at com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:114)
> 	... 9 more
> Caused by: java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:310)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:176)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:163)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)
> 	at java.net.Socket.connect(Socket.java:546)
> 	at java.net.Socket.connect(Socket.java:495)
> 	at java.net.Socket.<init>(Socket.java:392)
> 	at java.net.Socket.<init>(Socket.java:206)
> 	at sun.rmi.transport.proxy.RMIDirectSocketFactory.createSocket(RMIDirectSocketFactory.java:40)
> 	at sun.rmi.transport.proxy.RMIMasterSocketFactory.createSocket(RMIMasterSocketFactory.java:146)
> 	at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:613)
> 	... 14 more
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Issue Comment Edited] (CASSANDRA-2534) CQL: CREATE CF, DROP CF, CREATE CF caused my cluster to crash

Posted by "Cathy Daw (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-2534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022963#comment-13022963 ] 

Cathy Daw edited comment on CASSANDRA-2534 at 4/21/11 10:43 PM:
----------------------------------------------------------------

*Here is the activity on the consoles for each node*

{noformat}
First Node (Seed): cdaw-qa1
 INFO 21:28:42,340 Completed flushing /var/lib/cassandra/data/system/Schema-f-39-Data.db (3549 bytes)
 INFO 21:36:53,342 Deleted /var/lib/cassandra/data/system/Schema-f-36
<console was disconnected>


Second Node: cdaw-qa2
 INFO 21:28:00,955 Completed flushing /var/lib/cassandra/data/system/Schema-f-39-Data.db (3549 bytes)
<console was disconnected>


Third Node: cdaw-qa3
 INFO 21:28:37,321 Completed flushing /var/lib/cassandra/data/system/Schema-f-39-Data.db (3549 bytes)
<console was disconnected>
{noformat}


* I was able to restart each node successfully *
{noformat}
[cassandra@cdaw-qa1 bin]$ ./nodetool -h cdaw-qa1 ring
Address         Status State   Load            Owns    Token                                       
                                                       113427455640312821154458202477256070484     
184.106.199.149 Up     Normal  319.69 KB       33.33%  0                                           
184.106.233.230 Up     Normal  323.97 KB       33.33%  56713727820156410577229101238628035242      
184.106.206.193 Up     Normal  323.97 KB       33.33%  113427455640312821154458202477256070484  
{noformat}

*From cassandra-cli, the CF has been dropped*
{noformat}
Keyspace: cqldb:
  Replication Strategy: org.apache.cassandra.locator.SimpleStrategy
    Options: [replication_factor:2]
  Column Families:
{noformat}



      was (Author: cdaw):
    *Here is the activity on the consoles for each node*

{noformat}
First Node (Seed): cdaw-qa1
 INFO 21:28:42,340 Completed flushing /var/lib/cassandra/data/system/Schema-f-39-Data.db (3549 bytes)
 INFO 21:36:53,342 Deleted /var/lib/cassandra/data/system/Schema-f-36
<console was disconnected>


Second Node: cdaw-qa2
 INFO 21:28:00,955 Completed flushing /var/lib/cassandra/data/system/Schema-f-39-Data.db (3549 bytes)
<console was disconnected>


Third Node: cdaw-qa3
 INFO 21:28:37,321 Completed flushing /var/lib/cassandra/data/system/Schema-f-39-Data.db (3549 bytes)
<console was disconnected>

{noformat}

  
> CQL: CREATE CF, DROP CF, CREATE CF caused my cluster to crash
> -------------------------------------------------------------
>
>                 Key: CASSANDRA-2534
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2534
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.8.0
>            Reporter: Cathy Daw
>            Priority: Critical
>              Labels: cql
>
> The following test case of CREATE CF, DROP CF, CREATE CF caused my cluster to crash.
> *CREATE/DROP/CREATE CF users*
> {code}
> cqlsh> CREATE COLUMNFAMILY users (
>    ...   KEY varchar PRIMARY KEY,
>    ...   password varchar);
> cqlsh> drop columnfamily users;
> cqlsh> CREATE COLUMNFAMILY users (
>    ...   userkey varchar PRIMARY KEY,
>    ...   password varchar);
> Exception: TSocket read 0 bytes
> {code}
> *Cassandra CLI - session broken*
> {code}
> [default@clidb] describe keyspace cqldb;
> java.net.SocketException: Broken pipe
> {code}
> *Nodetool - server down*
> {code}
> [cassandra@cdaw-qa1 bin]$ ./nodetool -h cdaw-qa1 -p 7199 ring
> Error connection to remote JMX agent!
> java.io.IOException: Failed to retrieve RMIServer stub: javax.naming.ServiceUnavailableException [Root exception is java.rmi.ConnectException: Connection refused to host: cdaw-qa1; nested exception is: 
> 	java.net.ConnectException: Connection refused]
> 	at javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:342)
> 	at javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:267)
> 	at org.apache.cassandra.tools.NodeProbe.connect(NodeProbe.java:139)
> 	at org.apache.cassandra.tools.NodeProbe.<init>(NodeProbe.java:109)
> 	at org.apache.cassandra.tools.NodeCmd.main(NodeCmd.java:525)
> Caused by: javax.naming.ServiceUnavailableException [Root exception is java.rmi.ConnectException: Connection refused to host: cdaw-qa1; nested exception is: 
> 	java.net.ConnectException: Connection refused]
> 	at com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:118)
> 	at com.sun.jndi.toolkit.url.GenericURLContext.lookup(GenericURLContext.java:203)
> 	at javax.naming.InitialContext.lookup(InitialContext.java:409)
> 	at javax.management.remote.rmi.RMIConnector.findRMIServerJNDI(RMIConnector.java:1902)
> 	at javax.management.remote.rmi.RMIConnector.findRMIServer(RMIConnector.java:1871)
> 	at javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:276)
> 	... 4 more
> Caused by: java.rmi.ConnectException: Connection refused to host: cdaw-qa1; nested exception is: 
> 	java.net.ConnectException: Connection refused
> 	at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:619)
> 	at sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:216)
> 	at sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
> 	at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:340)
> 	at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown Source)
> 	at com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:114)
> 	... 9 more
> Caused by: java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:310)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:176)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:163)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)
> 	at java.net.Socket.connect(Socket.java:546)
> 	at java.net.Socket.connect(Socket.java:495)
> 	at java.net.Socket.<init>(Socket.java:392)
> 	at java.net.Socket.<init>(Socket.java:206)
> 	at sun.rmi.transport.proxy.RMIDirectSocketFactory.createSocket(RMIDirectSocketFactory.java:40)
> 	at sun.rmi.transport.proxy.RMIMasterSocketFactory.createSocket(RMIMasterSocketFactory.java:146)
> 	at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:613)
> 	... 14 more
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Issue Comment Edited] (CASSANDRA-2534) CQL: CREATE CF, DROP CF, CREATE CF caused my cluster to crash

Posted by "Cathy Daw (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-2534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022963#comment-13022963 ] 

Cathy Daw edited comment on CASSANDRA-2534 at 4/21/11 10:46 PM:
----------------------------------------------------------------

*Here is the activity on the consoles for each node*

{noformat}
First Node (Seed): cdaw-qa1
 INFO 21:28:42,340 Completed flushing /var/lib/cassandra/data/system/Schema-f-39-Data.db (3549 bytes)
 INFO 21:36:53,342 Deleted /var/lib/cassandra/data/system/Schema-f-36
<console was disconnected>


Second Node: cdaw-qa2
 INFO 21:28:00,955 Completed flushing /var/lib/cassandra/data/system/Schema-f-39-Data.db (3549 bytes)
<console was disconnected>


Third Node: cdaw-qa3
 INFO 21:28:37,321 Completed flushing /var/lib/cassandra/data/system/Schema-f-39-Data.db (3549 bytes)
<console was disconnected>
{noformat}


*I was able to restart each node successfully *
{noformat}
[cassandra@cdaw-qa1 bin]$ ./nodetool -h cdaw-qa1 ring
Address         Status State   Load            Owns    Token                                       
                                                       113427455640312821154458202477256070484     
184.106.199.149 Up     Normal  319.69 KB       33.33%  0                                           
184.106.233.230 Up     Normal  323.97 KB       33.33%  56713727820156410577229101238628035242      
184.106.206.193 Up     Normal  323.97 KB       33.33%  113427455640312821154458202477256070484  
{noformat}

*From cassandra-cli, I can see the CF has been dropped*
{noformat}
Keyspace: cqldb:
  Replication Strategy: org.apache.cassandra.locator.SimpleStrategy
    Options: [replication_factor:2]
  Column Families:
{noformat}

*From cassandra-cli, I can do CREATE/DROP/CREATE CF successfully*
{noformat}
CREATE COLUMN FAMILY users with 
comparator = UTF8Type
and column_metadata = [
{column_name: password, validation_class: UTF8Type}];

DROP COLUMN FAMILY users;

CREATE COLUMN FAMILY users with 
comparator = UTF8Type
and column_metadata = [
{column_name: password, validation_class: UTF8Type}];

{noformat}



      was (Author: cdaw):
    *Here is the activity on the consoles for each node*

{noformat}
First Node (Seed): cdaw-qa1
 INFO 21:28:42,340 Completed flushing /var/lib/cassandra/data/system/Schema-f-39-Data.db (3549 bytes)
 INFO 21:36:53,342 Deleted /var/lib/cassandra/data/system/Schema-f-36
<console was disconnected>


Second Node: cdaw-qa2
 INFO 21:28:00,955 Completed flushing /var/lib/cassandra/data/system/Schema-f-39-Data.db (3549 bytes)
<console was disconnected>


Third Node: cdaw-qa3
 INFO 21:28:37,321 Completed flushing /var/lib/cassandra/data/system/Schema-f-39-Data.db (3549 bytes)
<console was disconnected>
{noformat}


* I was able to restart each node successfully *
{noformat}
[cassandra@cdaw-qa1 bin]$ ./nodetool -h cdaw-qa1 ring
Address         Status State   Load            Owns    Token                                       
                                                       113427455640312821154458202477256070484     
184.106.199.149 Up     Normal  319.69 KB       33.33%  0                                           
184.106.233.230 Up     Normal  323.97 KB       33.33%  56713727820156410577229101238628035242      
184.106.206.193 Up     Normal  323.97 KB       33.33%  113427455640312821154458202477256070484  
{noformat}

*From cassandra-cli, the CF has been dropped*
{noformat}
Keyspace: cqldb:
  Replication Strategy: org.apache.cassandra.locator.SimpleStrategy
    Options: [replication_factor:2]
  Column Families:
{noformat}


  
> CQL: CREATE CF, DROP CF, CREATE CF caused my cluster to crash
> -------------------------------------------------------------
>
>                 Key: CASSANDRA-2534
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2534
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.8.0
>            Reporter: Cathy Daw
>            Priority: Critical
>              Labels: cql
>
> The following test case of CREATE CF, DROP CF, CREATE CF caused my cluster to crash.
> *CREATE/DROP/CREATE CF users*
> {code}
> cqlsh> CREATE COLUMNFAMILY users (
>    ...   KEY varchar PRIMARY KEY,
>    ...   password varchar);
> cqlsh> drop columnfamily users;
> cqlsh> CREATE COLUMNFAMILY users (
>    ...   userkey varchar PRIMARY KEY,
>    ...   password varchar);
> Exception: TSocket read 0 bytes
> {code}
> *Cassandra CLI - session broken*
> {code}
> [default@clidb] describe keyspace cqldb;
> java.net.SocketException: Broken pipe
> {code}
> *Nodetool - server down*
> {code}
> [cassandra@cdaw-qa1 bin]$ ./nodetool -h cdaw-qa1 -p 7199 ring
> Error connection to remote JMX agent!
> java.io.IOException: Failed to retrieve RMIServer stub: javax.naming.ServiceUnavailableException [Root exception is java.rmi.ConnectException: Connection refused to host: cdaw-qa1; nested exception is: 
> 	java.net.ConnectException: Connection refused]
> 	at javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:342)
> 	at javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:267)
> 	at org.apache.cassandra.tools.NodeProbe.connect(NodeProbe.java:139)
> 	at org.apache.cassandra.tools.NodeProbe.<init>(NodeProbe.java:109)
> 	at org.apache.cassandra.tools.NodeCmd.main(NodeCmd.java:525)
> Caused by: javax.naming.ServiceUnavailableException [Root exception is java.rmi.ConnectException: Connection refused to host: cdaw-qa1; nested exception is: 
> 	java.net.ConnectException: Connection refused]
> 	at com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:118)
> 	at com.sun.jndi.toolkit.url.GenericURLContext.lookup(GenericURLContext.java:203)
> 	at javax.naming.InitialContext.lookup(InitialContext.java:409)
> 	at javax.management.remote.rmi.RMIConnector.findRMIServerJNDI(RMIConnector.java:1902)
> 	at javax.management.remote.rmi.RMIConnector.findRMIServer(RMIConnector.java:1871)
> 	at javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:276)
> 	... 4 more
> Caused by: java.rmi.ConnectException: Connection refused to host: cdaw-qa1; nested exception is: 
> 	java.net.ConnectException: Connection refused
> 	at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:619)
> 	at sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:216)
> 	at sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
> 	at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:340)
> 	at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown Source)
> 	at com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:114)
> 	... 9 more
> Caused by: java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:310)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:176)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:163)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)
> 	at java.net.Socket.connect(Socket.java:546)
> 	at java.net.Socket.connect(Socket.java:495)
> 	at java.net.Socket.<init>(Socket.java:392)
> 	at java.net.Socket.<init>(Socket.java:206)
> 	at sun.rmi.transport.proxy.RMIDirectSocketFactory.createSocket(RMIDirectSocketFactory.java:40)
> 	at sun.rmi.transport.proxy.RMIMasterSocketFactory.createSocket(RMIMasterSocketFactory.java:146)
> 	at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:613)
> 	... 14 more
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (CASSANDRA-2534) CQL: CREATE CF, DROP CF, CREATE CF caused my cluster to crash

Posted by "Cathy Daw (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-2534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Cathy Daw resolved CASSANDRA-2534.
----------------------------------

    Resolution: Cannot Reproduce

Not sure what the issue was here but could not reproduce on build from 4/22.  

> CQL: CREATE CF, DROP CF, CREATE CF caused my cluster to crash
> -------------------------------------------------------------
>
>                 Key: CASSANDRA-2534
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2534
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.8.0
>            Reporter: Cathy Daw
>            Priority: Critical
>              Labels: cql
>
> The following test case of CREATE CF, DROP CF, CREATE CF caused my cluster to crash.
> *CREATE/DROP/CREATE CF users*
> {code}
> cqlsh> CREATE COLUMNFAMILY users (
>    ...   KEY varchar PRIMARY KEY,
>    ...   password varchar);
> cqlsh> drop columnfamily users;
> cqlsh> CREATE COLUMNFAMILY users (
>    ...   userkey varchar PRIMARY KEY,
>    ...   password varchar);
> Exception: TSocket read 0 bytes
> {code}
> *Cassandra CLI - session broken*
> {code}
> [default@clidb] describe keyspace cqldb;
> java.net.SocketException: Broken pipe
> {code}
> *Nodetool - server down*
> {code}
> [cassandra@cdaw-qa1 bin]$ ./nodetool -h cdaw-qa1 -p 7199 ring
> Error connection to remote JMX agent!
> java.io.IOException: Failed to retrieve RMIServer stub: javax.naming.ServiceUnavailableException [Root exception is java.rmi.ConnectException: Connection refused to host: cdaw-qa1; nested exception is: 
> 	java.net.ConnectException: Connection refused]
> 	at javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:342)
> 	at javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:267)
> 	at org.apache.cassandra.tools.NodeProbe.connect(NodeProbe.java:139)
> 	at org.apache.cassandra.tools.NodeProbe.<init>(NodeProbe.java:109)
> 	at org.apache.cassandra.tools.NodeCmd.main(NodeCmd.java:525)
> Caused by: javax.naming.ServiceUnavailableException [Root exception is java.rmi.ConnectException: Connection refused to host: cdaw-qa1; nested exception is: 
> 	java.net.ConnectException: Connection refused]
> 	at com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:118)
> 	at com.sun.jndi.toolkit.url.GenericURLContext.lookup(GenericURLContext.java:203)
> 	at javax.naming.InitialContext.lookup(InitialContext.java:409)
> 	at javax.management.remote.rmi.RMIConnector.findRMIServerJNDI(RMIConnector.java:1902)
> 	at javax.management.remote.rmi.RMIConnector.findRMIServer(RMIConnector.java:1871)
> 	at javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:276)
> 	... 4 more
> Caused by: java.rmi.ConnectException: Connection refused to host: cdaw-qa1; nested exception is: 
> 	java.net.ConnectException: Connection refused
> 	at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:619)
> 	at sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:216)
> 	at sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
> 	at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:340)
> 	at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown Source)
> 	at com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:114)
> 	... 9 more
> Caused by: java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:310)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:176)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:163)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)
> 	at java.net.Socket.connect(Socket.java:546)
> 	at java.net.Socket.connect(Socket.java:495)
> 	at java.net.Socket.<init>(Socket.java:392)
> 	at java.net.Socket.<init>(Socket.java:206)
> 	at sun.rmi.transport.proxy.RMIDirectSocketFactory.createSocket(RMIDirectSocketFactory.java:40)
> 	at sun.rmi.transport.proxy.RMIMasterSocketFactory.createSocket(RMIMasterSocketFactory.java:146)
> 	at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:613)
> 	... 14 more
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Issue Comment Edited] (CASSANDRA-2534) CQL: CREATE CF, DROP CF, CREATE CF caused my cluster to crash

Posted by "Cathy Daw (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-2534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022963#comment-13022963 ] 

Cathy Daw edited comment on CASSANDRA-2534 at 4/21/11 10:47 PM:
----------------------------------------------------------------

*I was able to restart each node successfully*
{noformat}
[cassandra@cdaw-qa1 bin]$ ./nodetool -h cdaw-qa1 ring
Address         Status State   Load            Owns    Token                                       
                                                       113427455640312821154458202477256070484     
184.106.199.149 Up     Normal  319.69 KB       33.33%  0                                           
184.106.233.230 Up     Normal  323.97 KB       33.33%  56713727820156410577229101238628035242      
184.106.206.193 Up     Normal  323.97 KB       33.33%  113427455640312821154458202477256070484  
{noformat}

*From cassandra-cli, I can see the CF has been dropped from the cqldb keyspace*
{noformat}
Keyspace: cqldb:
  Replication Strategy: org.apache.cassandra.locator.SimpleStrategy
    Options: [replication_factor:2]
  Column Families:
{noformat}

*From cassandra-cli, I can do CREATE/DROP/CREATE CF successfully from the clidb keyspace*
{noformat}
CREATE COLUMN FAMILY users with 
comparator = UTF8Type
and column_metadata = [
{column_name: password, validation_class: UTF8Type}];

DROP COLUMN FAMILY users;

CREATE COLUMN FAMILY users with 
comparator = UTF8Type
and column_metadata = [
{column_name: password, validation_class: UTF8Type}];

{noformat}



      was (Author: cdaw):
    *Here is the activity on the consoles for each node*

{noformat}
First Node (Seed): cdaw-qa1
 INFO 21:28:42,340 Completed flushing /var/lib/cassandra/data/system/Schema-f-39-Data.db (3549 bytes)
 INFO 21:36:53,342 Deleted /var/lib/cassandra/data/system/Schema-f-36
<console was disconnected>


Second Node: cdaw-qa2
 INFO 21:28:00,955 Completed flushing /var/lib/cassandra/data/system/Schema-f-39-Data.db (3549 bytes)
<console was disconnected>


Third Node: cdaw-qa3
 INFO 21:28:37,321 Completed flushing /var/lib/cassandra/data/system/Schema-f-39-Data.db (3549 bytes)
<console was disconnected>
{noformat}


*I was able to restart each node successfully *
{noformat}
[cassandra@cdaw-qa1 bin]$ ./nodetool -h cdaw-qa1 ring
Address         Status State   Load            Owns    Token                                       
                                                       113427455640312821154458202477256070484     
184.106.199.149 Up     Normal  319.69 KB       33.33%  0                                           
184.106.233.230 Up     Normal  323.97 KB       33.33%  56713727820156410577229101238628035242      
184.106.206.193 Up     Normal  323.97 KB       33.33%  113427455640312821154458202477256070484  
{noformat}

*From cassandra-cli, I can see the CF has been dropped*
{noformat}
Keyspace: cqldb:
  Replication Strategy: org.apache.cassandra.locator.SimpleStrategy
    Options: [replication_factor:2]
  Column Families:
{noformat}

*From cassandra-cli, I can do CREATE/DROP/CREATE CF successfully*
{noformat}
CREATE COLUMN FAMILY users with 
comparator = UTF8Type
and column_metadata = [
{column_name: password, validation_class: UTF8Type}];

DROP COLUMN FAMILY users;

CREATE COLUMN FAMILY users with 
comparator = UTF8Type
and column_metadata = [
{column_name: password, validation_class: UTF8Type}];

{noformat}


  
> CQL: CREATE CF, DROP CF, CREATE CF caused my cluster to crash
> -------------------------------------------------------------
>
>                 Key: CASSANDRA-2534
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2534
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.8.0
>            Reporter: Cathy Daw
>            Priority: Critical
>              Labels: cql
>
> The following test case of CREATE CF, DROP CF, CREATE CF caused my cluster to crash.
> *CREATE/DROP/CREATE CF users*
> {code}
> cqlsh> CREATE COLUMNFAMILY users (
>    ...   KEY varchar PRIMARY KEY,
>    ...   password varchar);
> cqlsh> drop columnfamily users;
> cqlsh> CREATE COLUMNFAMILY users (
>    ...   userkey varchar PRIMARY KEY,
>    ...   password varchar);
> Exception: TSocket read 0 bytes
> {code}
> *Cassandra CLI - session broken*
> {code}
> [default@clidb] describe keyspace cqldb;
> java.net.SocketException: Broken pipe
> {code}
> *Nodetool - server down*
> {code}
> [cassandra@cdaw-qa1 bin]$ ./nodetool -h cdaw-qa1 -p 7199 ring
> Error connection to remote JMX agent!
> java.io.IOException: Failed to retrieve RMIServer stub: javax.naming.ServiceUnavailableException [Root exception is java.rmi.ConnectException: Connection refused to host: cdaw-qa1; nested exception is: 
> 	java.net.ConnectException: Connection refused]
> 	at javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:342)
> 	at javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:267)
> 	at org.apache.cassandra.tools.NodeProbe.connect(NodeProbe.java:139)
> 	at org.apache.cassandra.tools.NodeProbe.<init>(NodeProbe.java:109)
> 	at org.apache.cassandra.tools.NodeCmd.main(NodeCmd.java:525)
> Caused by: javax.naming.ServiceUnavailableException [Root exception is java.rmi.ConnectException: Connection refused to host: cdaw-qa1; nested exception is: 
> 	java.net.ConnectException: Connection refused]
> 	at com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:118)
> 	at com.sun.jndi.toolkit.url.GenericURLContext.lookup(GenericURLContext.java:203)
> 	at javax.naming.InitialContext.lookup(InitialContext.java:409)
> 	at javax.management.remote.rmi.RMIConnector.findRMIServerJNDI(RMIConnector.java:1902)
> 	at javax.management.remote.rmi.RMIConnector.findRMIServer(RMIConnector.java:1871)
> 	at javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:276)
> 	... 4 more
> Caused by: java.rmi.ConnectException: Connection refused to host: cdaw-qa1; nested exception is: 
> 	java.net.ConnectException: Connection refused
> 	at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:619)
> 	at sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:216)
> 	at sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
> 	at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:340)
> 	at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown Source)
> 	at com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:114)
> 	... 9 more
> Caused by: java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:310)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:176)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:163)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)
> 	at java.net.Socket.connect(Socket.java:546)
> 	at java.net.Socket.connect(Socket.java:495)
> 	at java.net.Socket.<init>(Socket.java:392)
> 	at java.net.Socket.<init>(Socket.java:206)
> 	at sun.rmi.transport.proxy.RMIDirectSocketFactory.createSocket(RMIDirectSocketFactory.java:40)
> 	at sun.rmi.transport.proxy.RMIMasterSocketFactory.createSocket(RMIMasterSocketFactory.java:146)
> 	at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:613)
> 	... 14 more
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (CASSANDRA-2534) CQL: CREATE CF, DROP CF, CREATE CF caused my cluster to crash

Posted by "Cathy Daw (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-2534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022971#comment-13022971 ] 

Cathy Daw commented on CASSANDRA-2534:
--------------------------------------

After restart, I can recreate the table successfully via cqlsh.

> CQL: CREATE CF, DROP CF, CREATE CF caused my cluster to crash
> -------------------------------------------------------------
>
>                 Key: CASSANDRA-2534
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2534
>             Project: Cassandra
>          Issue Type: Bug
>    Affects Versions: 0.8.0
>            Reporter: Cathy Daw
>            Priority: Critical
>              Labels: cql
>
> The following test case of CREATE CF, DROP CF, CREATE CF caused my cluster to crash.
> *CREATE/DROP/CREATE CF users*
> {code}
> cqlsh> CREATE COLUMNFAMILY users (
>    ...   KEY varchar PRIMARY KEY,
>    ...   password varchar);
> cqlsh> drop columnfamily users;
> cqlsh> CREATE COLUMNFAMILY users (
>    ...   userkey varchar PRIMARY KEY,
>    ...   password varchar);
> Exception: TSocket read 0 bytes
> {code}
> *Cassandra CLI - session broken*
> {code}
> [default@clidb] describe keyspace cqldb;
> java.net.SocketException: Broken pipe
> {code}
> *Nodetool - server down*
> {code}
> [cassandra@cdaw-qa1 bin]$ ./nodetool -h cdaw-qa1 -p 7199 ring
> Error connection to remote JMX agent!
> java.io.IOException: Failed to retrieve RMIServer stub: javax.naming.ServiceUnavailableException [Root exception is java.rmi.ConnectException: Connection refused to host: cdaw-qa1; nested exception is: 
> 	java.net.ConnectException: Connection refused]
> 	at javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:342)
> 	at javax.management.remote.JMXConnectorFactory.connect(JMXConnectorFactory.java:267)
> 	at org.apache.cassandra.tools.NodeProbe.connect(NodeProbe.java:139)
> 	at org.apache.cassandra.tools.NodeProbe.<init>(NodeProbe.java:109)
> 	at org.apache.cassandra.tools.NodeCmd.main(NodeCmd.java:525)
> Caused by: javax.naming.ServiceUnavailableException [Root exception is java.rmi.ConnectException: Connection refused to host: cdaw-qa1; nested exception is: 
> 	java.net.ConnectException: Connection refused]
> 	at com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:118)
> 	at com.sun.jndi.toolkit.url.GenericURLContext.lookup(GenericURLContext.java:203)
> 	at javax.naming.InitialContext.lookup(InitialContext.java:409)
> 	at javax.management.remote.rmi.RMIConnector.findRMIServerJNDI(RMIConnector.java:1902)
> 	at javax.management.remote.rmi.RMIConnector.findRMIServer(RMIConnector.java:1871)
> 	at javax.management.remote.rmi.RMIConnector.connect(RMIConnector.java:276)
> 	... 4 more
> Caused by: java.rmi.ConnectException: Connection refused to host: cdaw-qa1; nested exception is: 
> 	java.net.ConnectException: Connection refused
> 	at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:619)
> 	at sun.rmi.transport.tcp.TCPChannel.createConnection(TCPChannel.java:216)
> 	at sun.rmi.transport.tcp.TCPChannel.newConnection(TCPChannel.java:202)
> 	at sun.rmi.server.UnicastRef.newCall(UnicastRef.java:340)
> 	at sun.rmi.registry.RegistryImpl_Stub.lookup(Unknown Source)
> 	at com.sun.jndi.rmi.registry.RegistryContext.lookup(RegistryContext.java:114)
> 	... 9 more
> Caused by: java.net.ConnectException: Connection refused
> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:310)
> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:176)
> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:163)
> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:384)
> 	at java.net.Socket.connect(Socket.java:546)
> 	at java.net.Socket.connect(Socket.java:495)
> 	at java.net.Socket.<init>(Socket.java:392)
> 	at java.net.Socket.<init>(Socket.java:206)
> 	at sun.rmi.transport.proxy.RMIDirectSocketFactory.createSocket(RMIDirectSocketFactory.java:40)
> 	at sun.rmi.transport.proxy.RMIMasterSocketFactory.createSocket(RMIMasterSocketFactory.java:146)
> 	at sun.rmi.transport.tcp.TCPEndpoint.newSocket(TCPEndpoint.java:613)
> 	... 14 more
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira