You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Sean Busbey (JIRA)" <ji...@apache.org> on 2014/12/18 16:51:14 UTC

[jira] [Created] (HBASE-12719) Add test WAL provider to quantify FSHLog overhead in the absence of HDFS.

Sean Busbey created HBASE-12719:
-----------------------------------

             Summary: Add test WAL provider to quantify FSHLog overhead in the absence of HDFS.
                 Key: HBASE-12719
                 URL: https://issues.apache.org/jira/browse/HBASE-12719
             Project: HBase
          Issue Type: Improvement
          Components: test, wal
            Reporter: Sean Busbey
            Assignee: Sean Busbey
            Priority: Minor
             Fix For: 2.0.0, 1.1.0


Discussion in HBASE-5699 included showing the max throughput for our WAL benchmark (using the DisabledWALProvider) compared to when we are actually dealing with synchronization and talking with HDFS.

What we can't see in that comparison is how much of the (sizable) gap is due to the coordination done in FSHLog to deal with multi-threading and how much of it is due to talking to HDFS.

Make a test-only provider that we can use to isolate the cost for HDFS appends, HDFS flush, and file rolling.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)