[jira] [Created] (HUDI-7441) Decouple hive dependencies during flink streaming read hudi

["Rascal Wu (Jira)" <ji...@apache.org>]

Rascal Wu created HUDI-7441:
-------------------------------

             Summary: Decouple hive dependencies during flink streaming read hudi
                 Key: HUDI-7441
                 URL: https://issues.apache.org/jira/browse/HUDI-7441
             Project: Apache Hudi
          Issue Type: Improvement
            Reporter: Rascal Wu
         Attachments: image-2024-02-24-22-50-44-306.png, image-2024-02-24-22-51-01-355.png

Currently, the `IncrementalInputSplits#getReadPartitions` method will call `

HoodieInputFormatUtils.getWritePartitionPaths`, but `HoodieInputFormatUtils` class imports hive classes. So if flink engine streaming read a hudi table, and without any case need to integrate with hive, there is no need to include hive jar, because the `hudi-flink-bundle` doesn't contains hive classes defaultly.

 

It's better to move the required mehtod from HoodieInputFormatUtils(hudi-hadoop-mr module) to common module to decouple the hive dependencies.

 

!image-2024-02-24-22-50-44-306.png!

 

!image-2024-02-24-22-51-01-355.png!



--
This message was sent by Atlassian Jira
(v8.20.10#820010)