You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Ethan Guo (Jira)" <ji...@apache.org> on 2022/01/03 06:37:00 UTC
[jira] [Commented] (HUDI-3127) Add a new HoodieHFileReader for Trino with Java 11
[ https://issues.apache.org/jira/browse/HUDI-3127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17467800#comment-17467800 ]
Ethan Guo commented on HUDI-3127:
---------------------------------
I tried two routes and hit issues:
(1) Add a new HudiHFileBootstrapIndex and a config for the meta client to use that for bootstrap index in Trino repo ([https://github.com/apache/hudi/pull/4494/files], [https://github.com/codope/trino/pull/11/files]). It hits the compatibility issue due to the comparator {{Caused by: java.lang.ClassCastException: class org.apache.hudi.common.bootstrap.index.HFileBootstrapIndex$HoodieKVComparator cannot be cast to class org.apache.hadoop.hbase.CellComparator}} [https://gist.github.com/yihua/f14d8edd3c876838f02a5e57e90ea4b0]. It looks like the custom comparator to work around shading causes this. Built-in KVComparator/CellComparators have its backward class name translation in {{FixedFileTrailer}} class
(2) Use HBase 1.7.1 at runtime for Trino Hudi connector ([https://github.com/codope/trino/pull/12]). Hitting another issue of guava: {{java.lang.NoSuchMethodError: 'com.google.common.base.Objects$ToStringHelper com.google.common.base.Objects.toStringHelper(java.lang.Object)'}} [https://gist.github.com/yihua/e3bc8ebc36aa0fc04127322677bde55a]
> Add a new HoodieHFileReader for Trino with Java 11
> --------------------------------------------------
>
> Key: HUDI-3127
> URL: https://issues.apache.org/jira/browse/HUDI-3127
> Project: Apache Hudi
> Issue Type: Sub-task
> Reporter: Ethan Guo
> Assignee: Ethan Guo
> Priority: Blocker
> Labels: pull-request-available
> Fix For: 0.11.0
>
>
> To address compatibility issues of HBase 1.2.3 with Java 11 for Hudi Trino connector
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)