[GitHub] [hudi] CTTY commented on pull request #9221: [HUDI-6550] Add Hadoop conf to HiveConf for HiveSyncConfig

["CTTY (via GitHub)" <gi...@apache.org>]

CTTY commented on PR #9221:
URL: https://github.com/apache/hudi/pull/9221#issuecomment-1703694734

   Hi @xushiyan , regarding the Azure CI failure, I was able to reproduce locally but haven't got a chance to root cause it. 
   
   Issue:
   ```
   org.apache.hudi.hive.HoodieHiveSyncException: Failed to get the last replicated time from the table bar
   	at org.apache.hudi.hive.HoodieHiveSyncClient.getLastReplicatedTime(HoodieHiveSyncClient.java:305)
   	at org.apache.hudi.hive.replication.GlobalHiveSyncTool.getLastReplicatedTimeStampMap(GlobalHiveSyncTool.java:64)
   	at org.apache.hudi.hive.replication.ReplicationStateSync.<init>(ReplicationStateSync.java:37)
   	at org.apache.hudi.hive.replication.HiveSyncGlobalCommitTool.getReplicatedState(HiveSyncGlobalCommitTool.java:51)
   	at org.apache.hudi.hive.replication.HiveSyncGlobalCommitTool.<init>(HiveSyncGlobalCommitTool.java:100)
   	at org.apache.hudi.hive.replication.TestHiveSyncGlobalCommitTool.testHiveConfigShouldMatchClusterConf(TestHiveSyncGlobalCommitTool.java:113)
   	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   ```
   The issue above only show up when using `new HiveConf(hadoopConf, HiveConf.class)`. When it's reverted it to `HiveConf hiveConf = new HiveConf(); hiveConf.addResource(hadoopConf);` it works fine
   
   I think we should proceed with the first version of change if the order of loading hadoop conf doesn't break any Hudi components


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org