[jira] [Created] (HDDS-8047) PutBlock request has lots of redundant metadata

["Wei-Chiu Chuang (Jira)" <ji...@apache.org>]

Wei-Chiu Chuang created HDDS-8047:
-------------------------------------

             Summary: PutBlock request has lots of redundant metadata
                 Key: HDDS-8047
                 URL: https://issues.apache.org/jira/browse/HDDS-8047
             Project: Apache Ozone
          Issue Type: Bug
            Reporter: Wei-Chiu Chuang
         Attachments: hbase_rs.html

In a profile result, we found that the client PutBlock request has lots of redundancy, especially the BlockData structure. The data structure contains the metadata of every chunk in the block, which is not required because only the last two chunks matters.

This is especially critical for small and frequent puts, such as hsync API called by HBase WAL files. We found that at least 60% of client CPU cycle during hsync call can be attributed to this problem, and potentially a huge impact to the latency.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org