You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Alexey Kudinkin (Jira)" <ji...@apache.org> on 2021/12/07 02:21:00 UTC

[jira] [Commented] (HUDI-2669) Upgrade jdk version to higher versions

    [ https://issues.apache.org/jira/browse/HUDI-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17454332#comment-17454332 ] 

Alexey Kudinkin commented on HUDI-2669:
---------------------------------------

While perf-tuning [Layout Optimization (Clustering) flow|https://issues.apache.org/jira/browse/HUDI-2949], i've (accidentally) ran a few benchmarks using JDK11 (after Metadata table got disabled by default, which was preventing us from running on JDK11 previously).
 
As expected, JDK11 performance has substantially exceeded JDK8, primarily due to substantially better GC (JDK11 has G1 as default GC, while JDK8 goes w/ Parallel):
 
| |Total Tasks Runtime (CPU)|GC|
|JDK8|78min|*16min*|
|JDK11|*60min* (30% less)|*2.9min* (5.5x less)|

> Upgrade jdk version to higher versions
> --------------------------------------
>
>                 Key: HUDI-2669
>                 URL: https://issues.apache.org/jira/browse/HUDI-2669
>             Project: Apache Hudi
>          Issue Type: Sub-task
>          Components: Code Cleanup
>            Reporter: sivabalan narayanan
>            Assignee: Alexey Kudinkin
>            Priority: Blocker
>             Fix For: 0.11.0
>
>
> There have been lot of newer versions of jdk released, but we have official support for java 8 and haven't done anything further. 
>  
> Let's look at supporting newer versions to benefit from more richer functionalities. 
> We should try out java 11 and 14 may be. 
>  
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)