[jira] [Commented] (HDFS-9666) Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read

["Fangyuan Deng (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040361#comment-16040361 ] 

Fangyuan Deng commented on HDFS-9666:
-------------------------------------

we have tested on three machines [ 32 core cpu,  128G mem , 1000M network,  1.2T HDD,  800G SSD(intel P3600)  ].
with this feather, throughput of hbase table(ONE_SSD)  is double of which without this feather


> Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to improve random read
> -------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-9666
>                 URL: https://issues.apache.org/jira/browse/HDFS-9666
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: hdfs-client
>    Affects Versions: 2.6.0, 2.7.0
>            Reporter: ade
>            Assignee: ade
>         Attachments: HDFS-9666.0.patch
>
>
> We want to improve random read performance of HDFS for HBase, so enabled the heterogeneous storage in our cluster. But there are only ~50% of datanode & regionserver hosts with SSD. we can set hfile with only ONE_SSD not ALL_SSD storagepolicy and the regionserver on none-SSD host can only read the local disk replica . So we developed this feature in hdfs client to read even remote SSD/RAM prior to local disk replica.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org