You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@cassandra.apache.org by Thor Carpenter <tc...@mediosystems.com> on 2010/12/28 20:59:56 UTC

0.7RC1 local_quorum -> TimedOutException

Hi All,

I am a bit stumped.  When reading at a CL of local_quorum I get TimedOutExceptions however when reading at any other CL, including ALL, everything works as expected.  Any write CL, including local_quorum, also works as expected.

I am running a 4 node 0.7 RC1 cluster in datacenter "DC1".  "DC2" is planned for the future but currently has no nodes.  I am using Hector 0.7.0-20.  

Here is my testing schema:

create keyspace GlobalCacheKeyspaceDC1RF4 with 
    replication_factor = 4 and 
    placement_strategy = 'org.apache.cassandra.locator.NetworkTopologyStrategy' and
    strategy_options = [{DC1:4, DC2:0}];

use GlobalCacheKeyspaceDC1RF4;

create column family GlobalCacheCF with
    comment = 'General purpose cache' and
    column_type = 'Standard' and
    comparator = 'BytesType' and
    keys_cached = 200000 and
    rows_cached = 2000 and
    gc_grace = 0 and
    read_repair_chance = 0.0;


Here is my cassandra-topology.properties:

10.5.64.15=DC1:R1
10.5.64.28=DC1:R1
10.5.64.56=DC1:R1
10.5.64.39=DC1:R1

# default for unknown nodes
default=DC2:R1


Here is the exception I get when reading at a CL of local_quorum:

1:44:14.176 [main] ERROR m.p.c.connection.HConnectionManager - Could not fullfill request on this host CassandraClient<dlc05-sea:9160-50>
11:44:14.182 [main] ERROR m.p.c.connection.HConnectionManager - Exception: 
me.prettyprint.hector.api.exceptions.HTimedOutException: TimedOutException()
	at me.prettyprint.cassandra.service.ExceptionsTranslatorImpl.translate(ExceptionsTranslatorImpl.java:27) [hector-0.7.0-20.jar:na]
	at me.prettyprint.cassandra.service.KeyspaceServiceImpl$15.execute(KeyspaceServiceImpl.java:598) [hector-0.7.0-20.jar:na]
	at me.prettyprint.cassandra.service.KeyspaceServiceImpl$15.execute(KeyspaceServiceImpl.java:587) [hector-0.7.0-20.jar:na]
	at me.prettyprint.cassandra.service.Operation.executeAndSetResult(Operation.java:89) [hector-0.7.0-20.jar:na]
	at me.prettyprint.cassandra.connection.HConnectionManager.operateWithFailover(HConnectionManager.java:101) [hector-0.7.0-20.jar:na]
	at me.prettyprint.cassandra.service.KeyspaceServiceImpl.operateWithFailover(KeyspaceServiceImpl.java:129) [hector-0.7.0-20.jar:na]
	at me.prettyprint.cassandra.service.KeyspaceServiceImpl.getColumn(KeyspaceServiceImpl.java:604) [hector-0.7.0-20.jar:na]
	at me.prettyprint.cassandra.model.thrift.ThriftColumnQuery$1.doInKeyspace(ThriftColumnQuery.java:57) [hector-0.7.0-20.jar:na]
	at me.prettyprint.cassandra.model.thrift.ThriftColumnQuery$1.doInKeyspace(ThriftColumnQuery.java:52) [hector-0.7.0-20.jar:na]
	at me.prettyprint.cassandra.model.KeyspaceOperationCallback.doInKeyspaceAndMeasure(KeyspaceOperationCallback.java:20) [hector-0.7.0-20.jar:na]
	at me.prettyprint.cassandra.model.ExecutingKeyspace.doExecute(ExecutingKeyspace.java:65) [hector-0.7.0-20.jar:na]
	at me.prettyprint.cassandra.model.thrift.ThriftColumnQuery.execute(ThriftColumnQuery.java:51) [hector-0.7.0-20.jar:na]


There are no warnings or errors in cassandra.log.

Any guidance would be appreciated.

Thanks,
-Thor