[jira] [Closed] (HBASE-6981) multiple commit logs per region server

["Andrew Kyle Purtell (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HBASE-6981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Kyle Purtell closed HBASE-6981.
--------------------------------------
    Assignee:     (was: Liyin Tang)

> multiple commit logs per region server
> --------------------------------------
>
>                 Key: HBASE-6981
>                 URL: https://issues.apache.org/jira/browse/HBASE-6981
>             Project: HBase
>          Issue Type: New Feature
>            Reporter: Kannan Muthukkaruppan
>            Priority: Major
>
> For write dominated workloads, the fact that we have only 1 commit log per server  artificially limits the aggregate throughput to that of one disk (this is especially true if we do true FS level syncs on each datanode, or even frequent intermittent FS level syncs as data is being written to each block).
> We could consider allowing a configurable number of commit logs per server (perhaps something close to or slightly less than the number of disks per server), and we could shard regions on the server, by maybe just a simple modulo scheme, into those commit logs.
> [A quick way to experiment with the same might be to run multiple region server instances per server; but might be better operationally to package the feature into a single region server.]



--
This message was sent by Atlassian Jira
(v8.20.7#820007)