You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Allan Yang (JIRA)" <ji...@apache.org> on 2018/05/18 12:17:00 UTC
[jira] [Created] (HBASE-20601) And multiPut support and other
miscellaneous to pe
Allan Yang created HBASE-20601:
----------------------------------
Summary: And multiPut support and other miscellaneous to pe
Key: HBASE-20601
URL: https://issues.apache.org/jira/browse/HBASE-20601
Project: HBase
Issue Type: Bug
Components: tooling
Affects Versions: 2.0.0
Reporter: Allan Yang
Assignee: Allan Yang
Fix For: 2.1.0
Add some useful stuff and some refinement to PE tool
1. And multiPut support
Though we have BufferedMutator, sometimes we need to benchmark batch put in a certain number.
Set --multiPut=number to enable batchput(meanwhile, --autoflush need be set to false)
2. And Connection Number support
Before, there is only on parameter to control the connection used by threads. oneCon=true means all threads use one connection, false means each thread has it own connection.
When thread number is high and oneCon=false, we noticed high context switch frequency in the machine which PE run on, disturbing the benchmark results(each connection has its own netty worker threads, 2*CPU IIRC).
So, added a new parameter conNum to PE. set --conNum=2 means all threads will share 2 connections.
3. And avg RT and avg TPS/QPS statstic for all threads
Useful when we want to meansure the total throughtput of the cluster
4. Delete some redundant code
Now RandomWriteTest is inherited from SequentialWrite.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)