[jira] [Created] (HUDI-7279) Make the sampling rate of object size estimation configurable

["Kong Wei (Jira)" <ji...@apache.org>]

Kong Wei created HUDI-7279:
------------------------------

             Summary: Make the sampling rate of object size estimation configurable
                 Key: HUDI-7279
                 URL: https://issues.apache.org/jira/browse/HUDI-7279
             Project: Apache Hudi
          Issue Type: Improvement
            Reporter: Kong Wei
         Attachments: image-2024-01-08-17-07-31-122.png

When writing data with BoundedInMemoryQueue,

As I tested, about 9% CPU is used to estimaze the object size to calculate the queue size. 

Currently the sampling rate is set to 64. If we can set the rate to 128, then we can save 4.5% CPU theoretically.

!image-2024-01-08-17-07-31-122.png!



--
This message was sent by Atlassian Jira
(v8.20.10#820010)