You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Adeel Akbar <ad...@panasiangroup.com> on 2012/09/07 17:08:08 UTC

Issue after upgraded Cassandra 1.1.4

Hi, I have successfully upgraded 2 nodes ring Cassandra with latest 
version. After up-gradation, I found following exceptions. Please help 
me to resolve this issue.

[2012-09-07 19:36:44,232] |TimedOutException()
me.prettyprint.hector.api.exceptions.HTimedOutException: TimedOutException()
         at 
me.prettyprint.cassandra.service.ExceptionsTranslatorImpl.translate(ExceptionsTranslatorImpl.java:35)
         at 
me.prettyprint.cassandra.service.KeyspaceServiceImpl$11.execute(KeyspaceServiceImpl.java:432)
         at 
me.prettyprint.cassandra.service.KeyspaceServiceImpl$11.execute(KeyspaceServiceImpl.java:416)
         at 
me.prettyprint.cassandra.service.Operation.executeAndSetResult(Operation.java:103)
         at 
me.prettyprint.cassandra.connection.HConnectionManager.operateWithFailover(HConnectionManager.java:258)
         at 
me.prettyprint.cassandra.service.KeyspaceServiceImpl.operateWithFailover(KeyspaceServiceImpl.java:131)
         at 
me.prettyprint.cassandra.service.KeyspaceServiceImpl.getSuperSlice(KeyspaceServiceImpl.java:436)
         at 
me.prettyprint.cassandra.model.thrift.ThriftSuperSliceQuery$1.doInKeyspace(ThriftSuperSliceQuery.java:61)
         at 
me.prettyprint.cassandra.model.thrift.ThriftSuperSliceQuery$1.doInKeyspace(ThriftSuperSliceQuery.java:57)
         at 
me.prettyprint.cassandra.model.KeyspaceOperationCallback.doInKeyspaceAndMeasure(KeyspaceOperationCallback.java:20)
         at 
me.prettyprint.cassandra.model.ExecutingKeyspace.doExecute(ExecutingKeyspace.java:85)
         at 
me.prettyprint.cassandra.model.thrift.ThriftSuperSliceQuery.execute(ThriftSuperSliceQuery.java:56)
         at 
pringcore.database.dao.cassandra.PringerRecommendationDAOImp.getRecommendedToPringers(PringerRecommendationDAOImp.java:64)
         at 
pringcore.database.dao.cassandra.PringerRecommendationDAOImp.getRecommendations(PringerRecommendationDAOImp.java:75)
         at pringcore.database.Pringer.getRecommendations(Pringer.java:2109)
         at 
pringcore.database.Follower.getFollowerMessageOnStatus(Follower.java:459)
         at 
pringcore.commands.CoreFollowCommand.process(CoreFollowCommand.java:64)
         at 
smsprocessor.commands.FollowCommand.process(FollowCommand.java:34)
         at 
pringcore.processor.CoreCommandProcessor.process(CoreCommandProcessor.java:263)
         at 
smsprocessor.processor.CommandProcessor.run(CommandProcessor.java:164)
         at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
         at 
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
         at java.lang.Thread.run(Thread.java:722)
Caused by: TimedOutException()
         at 
org.apache.cassandra.thrift.Cassandra$get_slice_result.read(Cassandra.java:7212)
         at 
org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
         at 
org.apache.cassandra.thrift.Cassandra$Client.recv_get_slice(Cassandra.java:543)
         at 
org.apache.cassandra.thrift.Cassandra$Client.get_slice(Cassandra.java:527)
         at 
me.prettyprint.cassandra.service.KeyspaceServiceImpl$11.execute(KeyspaceServiceImpl.java:421)
         ... 24 more
-- 


Thanks & Regards

*Adeel**Akbar*


Re: Issue after upgraded Cassandra 1.1.4

Posted by aaron morton <aa...@thelastpickle.com>.
This is a server side timeout. 

Consistent Level nodes did not respond to the coordinator within rpc_timeout. The nodes may have been overloaded, check the nodetool tpstats. It will tell you if the node is backing up and if it has dropped messages. 

Cheers

-----------------
Aaron Morton
Freelance Developer
@aaronmorton
http://www.thelastpickle.com

On 8/09/2012, at 3:08 AM, Adeel Akbar <ad...@panasiangroup.com> wrote:

> Hi, I have successfully upgraded 2 nodes ring Cassandra with latest version. After up-gradation, I found following exceptions. Please help me to resolve this issue.
> 
> [2012-09-07 19:36:44,232] |TimedOutException() 
> me.prettyprint.hector.api.exceptions.HTimedOutException: TimedOutException()
>         at me.prettyprint.cassandra.service.ExceptionsTranslatorImpl.translate(ExceptionsTranslatorImpl.java:35)
>         at me.prettyprint.cassandra.service.KeyspaceServiceImpl$11.execute(KeyspaceServiceImpl.java:432)
>         at me.prettyprint.cassandra.service.KeyspaceServiceImpl$11.execute(KeyspaceServiceImpl.java:416)
>         at me.prettyprint.cassandra.service.Operation.executeAndSetResult(Operation.java:103)
>         at me.prettyprint.cassandra.connection.HConnectionManager.operateWithFailover(HConnectionManager.java:258)
>         at me.prettyprint.cassandra.service.KeyspaceServiceImpl.operateWithFailover(KeyspaceServiceImpl.java:131)
>         at me.prettyprint.cassandra.service.KeyspaceServiceImpl.getSuperSlice(KeyspaceServiceImpl.java:436)
>         at me.prettyprint.cassandra.model.thrift.ThriftSuperSliceQuery$1.doInKeyspace(ThriftSuperSliceQuery.java:61)
>         at me.prettyprint.cassandra.model.thrift.ThriftSuperSliceQuery$1.doInKeyspace(ThriftSuperSliceQuery.java:57)
>         at me.prettyprint.cassandra.model.KeyspaceOperationCallback.doInKeyspaceAndMeasure(KeyspaceOperationCallback.java:20)
>         at me.prettyprint.cassandra.model.ExecutingKeyspace.doExecute(ExecutingKeyspace.java:85)
>         at me.prettyprint.cassandra.model.thrift.ThriftSuperSliceQuery.execute(ThriftSuperSliceQuery.java:56)
>         at pringcore.database.dao.cassandra.PringerRecommendationDAOImp.getRecommendedToPringers(PringerRecommendationDAOImp.java:64)
>         at pringcore.database.dao.cassandra.PringerRecommendationDAOImp.getRecommendations(PringerRecommendationDAOImp.java:75)
>         at pringcore.database.Pringer.getRecommendations(Pringer.java:2109)
>         at pringcore.database.Follower.getFollowerMessageOnStatus(Follower.java:459)
>         at pringcore.commands.CoreFollowCommand.process(CoreFollowCommand.java:64)
>         at smsprocessor.commands.FollowCommand.process(FollowCommand.java:34)
>         at pringcore.processor.CoreCommandProcessor.process(CoreCommandProcessor.java:263)
>         at smsprocessor.processor.CommandProcessor.run(CommandProcessor.java:164)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:722)
> Caused by: TimedOutException()
>         at org.apache.cassandra.thrift.Cassandra$get_slice_result.read(Cassandra.java:7212)
>         at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
>         at org.apache.cassandra.thrift.Cassandra$Client.recv_get_slice(Cassandra.java:543)
>         at org.apache.cassandra.thrift.Cassandra$Client.get_slice(Cassandra.java:527)
>         at me.prettyprint.cassandra.service.KeyspaceServiceImpl$11.execute(KeyspaceServiceImpl.java:421)
>         ... 24 more
> -- 
> 
> Thanks & Regards
> 
> Adeel Akbar
>