You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Raymond Xu (Jira)" <ji...@apache.org> on 2021/05/25 16:29:00 UTC

[jira] [Created] (HUDI-1932) Hive Sync should not always update last_commit_time_sync

Raymond Xu created HUDI-1932:
--------------------------------

             Summary: Hive Sync should not always update last_commit_time_sync
                 Key: HUDI-1932
                 URL: https://issues.apache.org/jira/browse/HUDI-1932
             Project: Apache Hudi
          Issue Type: Bug
          Components: Hive Integration
            Reporter: Raymond Xu
             Fix For: 0.9.0


In Hive Sync 

{{org.apache.hudi.hive.HiveSyncTool#syncHoodieTable()}}

it includes schema update and partition update.

Regardless of having update or not, the logic is to always update the table with a new timestamp for the last_commit_time_sync property.

This will result in having new versions in AWS Glue tables for example, which will eventually lead to exceeding table version limit.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)