You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Shamim Khan (JIRA)" <ji...@apache.org> on 2014/12/04 11:38:12 UTC
[jira] [Updated] (CASSANDRA-8420) Application getting time to open
on other node when one node goes down
[ https://issues.apache.org/jira/browse/CASSANDRA-8420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shamim Khan updated CASSANDRA-8420:
-----------------------------------
Description:
I have 3 node cluster my application is deployed on 3 node. When i put down one node then my application is taking around 5 mins to take up on other node and throwing below error.
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method) ~[na:1.7.0_51]
at java.net.SocketInputStream.read(SocketInputStream.java:152) ~[na:1.7.0_51]
at java.net.SocketInputStream.read(SocketInputStream.java:122) ~[na:1.7.0_51]
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235) ~[na:1.7.0_51]
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275) ~[na:1.7.0_51]
at java.io.BufferedInputStream.read(BufferedInputStream.java:334) ~[na:1.7.0_51]
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) ~[hector-client_3.5.1.jar:na]
... 45 common frames omitted
2014-12-04 13:59:41.179 ERROR m.p.c.c.ConcurrentHClientPool - Transport exception in re-opening client in release on <ConcurrentCassandraClientPoolByHost>:{host1_priv(12345):1234}
2014-12-04 13:59:41.179 ERROR m.p.c.c.ConcurrentHClientPool - Transport exception in re-opening client in release on <ConcurrentCassandraClientPoolByHost>:{host1_priv(12345):1234}
2014-12-04 13:59:45.850 WARN m.p.c.connection.HConnectionManager - Could not fullfill request on this host CassandraClient<host1_priv:1123456-1231>
2014-12-04 13:59:45.852 WARN m.p.c.connection.HConnectionManager - Exception:
me.prettyprint.hector.api.exceptions.HTimedOutException: org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at me.prettyprint.cassandra.service.ExceptionsTranslatorImpl.translate(ExceptionsTranslatorImpl.java:37) ~[hector-client_3.5.1.jar:na]
at me.prettyprint.cassandra.connection.HConnectionManager.operateWithFailover(HConnectionManager.java:265) ~[hector-client_3.5.1.jar:na]
at me.prettyprint.cassandra.service.KeyspaceServiceImpl.operateWithFailover(KeyspaceServiceImpl.java:132) [hector-client_3.5.1.jar:na]
at me.prettyprint.cassandra.service.KeyspaceServiceImpl.getSlice(KeyspaceServiceImpl.java:290) [hector-client_3.5.1.jar:na]
at me.prettyprint.cassandra.model.thrift.ThriftSliceQuery$1.doInKeyspace(ThriftSliceQuery.java:53) [hector-client_3.5.1.jar:na]
at me.prettyprint.cassandra.model.thrift.ThriftSliceQuery$1.doInKeyspace(ThriftSliceQuery.java:49) [hector-client_3.5.1.jar:na]
at me.prettyprint.cassandra.model.KeyspaceOperationCallback.doInKeyspaceAndMeasure(KeyspaceOperationCallback.java:20) [hector-client_3.5.1.jar:na]
at me.prettyprint.cassandra.model.ExecutingKeyspace.doExecute(ExecutingKeyspace.java:101) [hector-client_3.5.1.jar:na]
at me.prettyprint.cassandra.model.thrift.ThriftSliceQuery.execute(ThriftSliceQuery.java:48) [hector-client_3.5.1.jar:na]
at com.ericsson.rm.cassandra.xa.keyspace.row.KeyedRowQuery.execute(KeyedRowQuery.java:88) [cassandra.xa_3.5.1.jar:na]
was:
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method) ~[na:1.7.0_51]
at java.net.SocketInputStream.read(SocketInputStream.java:152) ~[na:1.7.0_51]
at java.net.SocketInputStream.read(SocketInputStream.java:122) ~[na:1.7.0_51]
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235) ~[na:1.7.0_51]
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275) ~[na:1.7.0_51]
at java.io.BufferedInputStream.read(BufferedInputStream.java:334) ~[na:1.7.0_51]
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) ~[hector-client_3.5.1.jar:na]
... 45 common frames omitted
2014-12-04 13:59:41.179 ERROR m.p.c.c.ConcurrentHClientPool - Transport exception in re-opening client in release on <ConcurrentCassandraClientPoolByHost>:{host1_priv(12345):1234}
2014-12-04 13:59:41.179 ERROR m.p.c.c.ConcurrentHClientPool - Transport exception in re-opening client in release on <ConcurrentCassandraClientPoolByHost>:{host1_priv(12345):1234}
2014-12-04 13:59:45.850 WARN m.p.c.connection.HConnectionManager - Could not fullfill request on this host CassandraClient<host1_priv:1123456-1231>
2014-12-04 13:59:45.852 WARN m.p.c.connection.HConnectionManager - Exception:
me.prettyprint.hector.api.exceptions.HTimedOutException: org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at me.prettyprint.cassandra.service.ExceptionsTranslatorImpl.translate(ExceptionsTranslatorImpl.java:37) ~[hector-client_3.5.1.jar:na]
at me.prettyprint.cassandra.connection.HConnectionManager.operateWithFailover(HConnectionManager.java:265) ~[hector-client_3.5.1.jar:na]
at me.prettyprint.cassandra.service.KeyspaceServiceImpl.operateWithFailover(KeyspaceServiceImpl.java:132) [hector-client_3.5.1.jar:na]
at me.prettyprint.cassandra.service.KeyspaceServiceImpl.getSlice(KeyspaceServiceImpl.java:290) [hector-client_3.5.1.jar:na]
at me.prettyprint.cassandra.model.thrift.ThriftSliceQuery$1.doInKeyspace(ThriftSliceQuery.java:53) [hector-client_3.5.1.jar:na]
at me.prettyprint.cassandra.model.thrift.ThriftSliceQuery$1.doInKeyspace(ThriftSliceQuery.java:49) [hector-client_3.5.1.jar:na]
at me.prettyprint.cassandra.model.KeyspaceOperationCallback.doInKeyspaceAndMeasure(KeyspaceOperationCallback.java:20) [hector-client_3.5.1.jar:na]
at me.prettyprint.cassandra.model.ExecutingKeyspace.doExecute(ExecutingKeyspace.java:101) [hector-client_3.5.1.jar:na]
at me.prettyprint.cassandra.model.thrift.ThriftSliceQuery.execute(ThriftSliceQuery.java:48) [hector-client_3.5.1.jar:na]
at com.ericsson.rm.cassandra.xa.keyspace.row.KeyedRowQuery.execute(KeyedRowQuery.java:88) [cassandra.xa_3.5.1.jar:na]
> Application getting time to open on other node when one node goes down
> ----------------------------------------------------------------------
>
> Key: CASSANDRA-8420
> URL: https://issues.apache.org/jira/browse/CASSANDRA-8420
> Project: Cassandra
> Issue Type: Bug
> Components: Packaging
> Reporter: Shamim Khan
> Labels: performance
>
> I have 3 node cluster my application is deployed on 3 node. When i put down one node then my application is taking around 5 mins to take up on other node and throwing below error.
> Caused by: java.net.SocketTimeoutException: Read timed out
> at java.net.SocketInputStream.socketRead0(Native Method) ~[na:1.7.0_51]
> at java.net.SocketInputStream.read(SocketInputStream.java:152) ~[na:1.7.0_51]
> at java.net.SocketInputStream.read(SocketInputStream.java:122) ~[na:1.7.0_51]
> at java.io.BufferedInputStream.fill(BufferedInputStream.java:235) ~[na:1.7.0_51]
> at java.io.BufferedInputStream.read1(BufferedInputStream.java:275) ~[na:1.7.0_51]
> at java.io.BufferedInputStream.read(BufferedInputStream.java:334) ~[na:1.7.0_51]
> at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) ~[hector-client_3.5.1.jar:na]
> ... 45 common frames omitted
> 2014-12-04 13:59:41.179 ERROR m.p.c.c.ConcurrentHClientPool - Transport exception in re-opening client in release on <ConcurrentCassandraClientPoolByHost>:{host1_priv(12345):1234}
> 2014-12-04 13:59:41.179 ERROR m.p.c.c.ConcurrentHClientPool - Transport exception in re-opening client in release on <ConcurrentCassandraClientPoolByHost>:{host1_priv(12345):1234}
> 2014-12-04 13:59:45.850 WARN m.p.c.connection.HConnectionManager - Could not fullfill request on this host CassandraClient<host1_priv:1123456-1231>
> 2014-12-04 13:59:45.852 WARN m.p.c.connection.HConnectionManager - Exception:
> me.prettyprint.hector.api.exceptions.HTimedOutException: org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
> at me.prettyprint.cassandra.service.ExceptionsTranslatorImpl.translate(ExceptionsTranslatorImpl.java:37) ~[hector-client_3.5.1.jar:na]
> at me.prettyprint.cassandra.connection.HConnectionManager.operateWithFailover(HConnectionManager.java:265) ~[hector-client_3.5.1.jar:na]
> at me.prettyprint.cassandra.service.KeyspaceServiceImpl.operateWithFailover(KeyspaceServiceImpl.java:132) [hector-client_3.5.1.jar:na]
> at me.prettyprint.cassandra.service.KeyspaceServiceImpl.getSlice(KeyspaceServiceImpl.java:290) [hector-client_3.5.1.jar:na]
> at me.prettyprint.cassandra.model.thrift.ThriftSliceQuery$1.doInKeyspace(ThriftSliceQuery.java:53) [hector-client_3.5.1.jar:na]
> at me.prettyprint.cassandra.model.thrift.ThriftSliceQuery$1.doInKeyspace(ThriftSliceQuery.java:49) [hector-client_3.5.1.jar:na]
> at me.prettyprint.cassandra.model.KeyspaceOperationCallback.doInKeyspaceAndMeasure(KeyspaceOperationCallback.java:20) [hector-client_3.5.1.jar:na]
> at me.prettyprint.cassandra.model.ExecutingKeyspace.doExecute(ExecutingKeyspace.java:101) [hector-client_3.5.1.jar:na]
> at me.prettyprint.cassandra.model.thrift.ThriftSliceQuery.execute(ThriftSliceQuery.java:48) [hector-client_3.5.1.jar:na]
> at com.ericsson.rm.cassandra.xa.keyspace.row.KeyedRowQuery.execute(KeyedRowQuery.java:88) [cassandra.xa_3.5.1.jar:na]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)