You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-issues@hadoop.apache.org by "Todd Lipcon (JIRA)" <ji...@apache.org> on 2010/05/12 11:02:41 UTC

[jira] Commented: (HDFS-1148) Convert FSDataset to ReadWriteLock

    [ https://issues.apache.org/jira/browse/HDFS-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12866515#action_12866515 ] 

Todd Lipcon commented on HDFS-1148:
-----------------------------------

YCSB output (same test setup as described in HDFS-941). This test is run with the HDFS-941 improvements plus FSDataset being converted to a readwrite lock.

[OVERALL],RunTime(ms), 94325
[OVERALL],Throughput(ops/sec), 10601.643254704479
[READ], Operations, 1000000
[READ], AverageLatency(ms), 3.747273
[READ], MinLatency(ms), 0
[READ], MaxLatency(ms), 1360
[READ], 95thPercentileLatency(ms), 10
[READ], 99thPercentileLatency(ms), 15
[READ], Return=0, 1000000


> Convert FSDataset to ReadWriteLock
> ----------------------------------
>
>                 Key: HDFS-1148
>                 URL: https://issues.apache.org/jira/browse/HDFS-1148
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: data-node
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>
> In benchmarking HDFS-941 I noticed that for the random read workload, the FSDataset lock is highly contended. After converting it to a ReentrantReadWriteLock, I saw a ~25% improvement on both latency and ops/second.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.