You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@ozone.apache.org by "ChenXi (Jira)" <ji...@apache.org> on 2023/04/19 07:12:00 UTC

[jira] [Updated] (HDDS-8047) PutBlock request has lots of redundant metadata

     [ https://issues.apache.org/jira/browse/HDDS-8047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ChenXi updated HDDS-8047:
-------------------------
    Attachment: image-2023-04-19-15-11-23-576.png

> PutBlock request has lots of redundant metadata
> -----------------------------------------------
>
>                 Key: HDDS-8047
>                 URL: https://issues.apache.org/jira/browse/HDDS-8047
>             Project: Apache Ozone
>          Issue Type: Bug
>            Reporter: Wei-Chiu Chuang
>            Priority: Major
>         Attachments: hbase_rs.html, image-2023-04-19-15-11-23-576.png
>
>
> In a profile result, we found that the client PutBlock request has lots of redundancy, especially the BlockData structure. The data structure contains the metadata of every chunk in the block, which is not required because only the last two chunks matters.
> This is especially critical for small and frequent puts, such as hsync API called by HBase WAL files. We found that at least 60% of client CPU cycle during hsync call can be attributed to this problem, and potentially a huge impact to the latency.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org