[jira] [Comment Edited] (ACCUMULO-2069) ThriftTransportPool too aggressive in closing connections

["Dave Marion (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ACCUMULO-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13861082#comment-13861082 ] 

Dave Marion edited comment on ACCUMULO-2069 at 1/3/14 1:41 AM:
---------------------------------------------------------------

Looking in 1.7.0 as to how/where to fix this. I thought initially about using some exponential backoff function instead of the 3 seconds, but instead realized that the I/O layer likely handles this for us (keepalive). Found a Thrift implementation[1] that uses this and sets the recv and send buffer sizes. Looks like we can just add those options in  org.apache.accumulo.core.util.TTimeoutTransport. Is that the only place in the client where thrift connections are created? What about server side?

Looks like this class goes back to 1.5.0.

[1] https://svn.apache.org/repos/asf/cassandra/trunk/src/java/org/apache/cassandra/thrift/TCustomServerSocket.java


was (Author: dlmarion):
Looking in 1.7.0 as to how/where to fix this. I thought initially about using some exponential backoff function instead of the 3 seconds, but instead realized that the I/O layer likely handles this for us (keepalive). Found a Thrift implementation[1] that uses this and sets the recv and send buffer sizes. Looks like we can just add those options in  org.apache.accumulo.core.util.TTimeoutTransport. Is that the only place in the client where thrift connections are created? What about server side?

[1] https://svn.apache.org/repos/asf/cassandra/trunk/src/java/org/apache/cassandra/thrift/TCustomServerSocket.java

> ThriftTransportPool too aggressive in closing connections
> ---------------------------------------------------------
>
>                 Key: ACCUMULO-2069
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-2069
>             Project: Accumulo
>          Issue Type: Bug
>          Components: client
>    Affects Versions: 1.4.4
>            Reporter: Dave Marion
>             Fix For: 1.7.0
>
>
> org.apache.accumulo.core.client.impl.ThriftTransportPool closes unused thrift connections after 3 seconds of inactivty. This can impact performance by causing tablet server connections to be constantly torn down and set up. Think of the case where you have a MTBW writer with a small number of threads and a moderate amount of tservers. Make the timeout configurable.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)