You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Kong Wei (Jira)" <ji...@apache.org> on 2024/01/08 09:13:00 UTC

[jira] [Updated] (HUDI-7279) Make the sampling rate of object size estimation configurable

     [ https://issues.apache.org/jira/browse/HUDI-7279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kong Wei updated HUDI-7279:
---------------------------
    Component/s: writer-core

> Make the sampling rate of object size estimation configurable
> -------------------------------------------------------------
>
>                 Key: HUDI-7279
>                 URL: https://issues.apache.org/jira/browse/HUDI-7279
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: writer-core
>            Reporter: Kong Wei
>            Priority: Major
>         Attachments: image-2024-01-08-17-07-31-122.png
>
>
> When writing data with BoundedInMemoryQueue,
> As I tested, about 9% CPU is used to estimaze the object size to calculate the queue size. 
> Currently the sampling rate is set to 64. If we can set the rate to 128, then we can save 4.5% CPU theoretically.
> !image-2024-01-08-17-07-31-122.png!



--
This message was sent by Atlassian Jira
(v8.20.10#820010)