You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@accumulo.apache.org by "Eric Newton (JIRA)" <ji...@apache.org> on 2012/11/28 16:38:58 UTC

[jira] [Comment Edited] (ACCUMULO-883) evaluate different thrift components for performance

    [ https://issues.apache.org/jira/browse/ACCUMULO-883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13505546#comment-13505546 ] 

Eric Newton edited comment on ACCUMULO-883 at 11/28/12 3:37 PM:
----------------------------------------------------------------

I wrote a simple stand-alone test, ran it three times.  I chose the update method, called 100K times with a small {{Mutation}} with 200 columns:

||{{TServer}}||{{TProtocol}}||Times|| || || Average||
|{{THaHs}}|{{TCompactProtocol}}|8504|5748|6477|6909
| |{{TBinaryProtocol}}|7503|5994|7093|6863
|{{ThreadedSelector}}|{{TCompactProtocol}}|7760|6170|5970|6633
| |{{TBinaryProtocol}}|9293|7708|6428|7809
|{{TThreadPool}}|{{TCompactProtocol}}|3648|4307|3379|3778
| |{{TBinaryProtocol}}|3508|3431|2931|3290

Presently we are using THaHs with an adaptive thread pool and the TCompactProtocol; I'm leaning towards changing it to TThreadPool and TBinaryProtocol.
                
      was (Author: ecn):
    I wrote a simple test, ran it three times.  I chose the update method, with a small {{Mutation}} with 200 columns.

||{{TServer}}||{{TProtocol}}||Times|| || || Average||
|{{THaHs}}|{{TCompactProtocol}}|8504|5748|6477|6909
| |{{TBinaryProtocol}}|7503|5994|7093|6863
|{{ThreadedSelector}}|{{TCompactProtocol}}|7760|6170|5970|6633
| |{{TBinaryProtocol}}|9293|7708|6428|7809
|{{TThreadPool}}|{{TCompactProtocol}}|3648|4307|3379|3778
| |{{TBinaryProtocol}}|3508|3431|2931|3290

Presently we are using THaHs with an adaptive thread pool and the TCompactProtocol; I'm leaning towards changing it to TThreadPool and TBinaryProtocol.
                  
> evaluate different thrift components for performance
> ----------------------------------------------------
>
>                 Key: ACCUMULO-883
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-883
>             Project: Accumulo
>          Issue Type: Task
>          Components: master, tserver
>            Reporter: Eric Newton
>            Assignee: Eric Newton
>             Fix For: 1.5.0
>
>
> Now that we've upgraded to Thrift 0.9, evaluate the fastest combination of TServer and TProtocol on typical server hardware (many cores, lots of ram, fast networks).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira