You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2017/06/20 10:34:00 UTC
[jira] [Updated] (HADOOP-13783) Improve efficiency of WASB over
page blobs
[ https://issues.apache.org/jira/browse/HADOOP-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Steve Loughran updated HADOOP-13783:
------------------------------------
Issue Type: Sub-task (was: Bug)
Parent: HADOOP-14552
> Improve efficiency of WASB over page blobs
> ------------------------------------------
>
> Key: HADOOP-13783
> URL: https://issues.apache.org/jira/browse/HADOOP-13783
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
> Reporter: NITIN VERMA
> Assignee: NITIN VERMA
>
> 1) Add telemetry to WASB driver. WASB driver is lack of any log or telemetry which makes trouble shoot very difficult. For example, we don’t know where is high e2e latency between HBase and Azure storage came from when Azure storage server latency was very low. Also we don’t know why WASB can only do 166 IOPs which is way below azure storage 500 IOPs. And we had several incidents before related to storage latency, because of lacking logs, we couldn’t find the ownership of the incident quickly.
> 2) Resolving the hot spotting issue when WASB driver partition the azure page blobs by changing the key. Current key design is causing the hot spotting on azure storage.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org