You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Danny Chen (Jira)" <ji...@apache.org> on 2023/10/12 23:51:00 UTC

[jira] [Closed] (HUDI-6937) CopyOnWriteInsertHandler#consume will cause clustering performance degradation

     [ https://issues.apache.org/jira/browse/HUDI-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Danny Chen closed HUDI-6937.
----------------------------
    Resolution: Fixed

Fixed via master branch: af2f74ba50c250b1d830f800d960c01bf66f646a

> CopyOnWriteInsertHandler#consume will cause clustering performance degradation
> ------------------------------------------------------------------------------
>
>                 Key: HUDI-6937
>                 URL: https://issues.apache.org/jira/browse/HUDI-6937
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: spark
>            Reporter: kwang
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.0.0, 0.14.1
>
>         Attachments: hudi-0.12-flamegraph.png, hudi-0.12-log.png, hudi-0.14-flamegraph.png, hudi-0.14-log.png
>
>
> We upgraded Hudi from 0.12 to 0.14, and found that the offline clustering performance dropped by half. We compared and analyzed this two versions of flame graphs, found TypedProperties object instantiation takes too much time. This will cause clustering performance degradation.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)