You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Raymond Xu (Jira)" <ji...@apache.org> on 2021/11/21 07:09:00 UTC
[jira] [Resolved] (HUDI-1932) Hive Sync should not always update last_commit_time_sync
[ https://issues.apache.org/jira/browse/HUDI-1932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Raymond Xu resolved HUDI-1932.
------------------------------
> Hive Sync should not always update last_commit_time_sync
> --------------------------------------------------------
>
> Key: HUDI-1932
> URL: https://issues.apache.org/jira/browse/HUDI-1932
> Project: Apache Hudi
> Issue Type: Bug
> Components: Hive Integration
> Reporter: Raymond Xu
> Assignee: Raymond Xu
> Priority: Blocker
> Labels: AWS, pull-request-available
> Fix For: 0.10.0
>
>
> In Hive SyncÂ
> {{org.apache.hudi.hive.HiveSyncTool#syncHoodieTable()}}
> it includes schema update and partition update.
> Regardless of having update or not, the logic is to always update the table with a new timestamp for the last_commit_time_sync property.
> This will result in having new versions in AWS Glue tables for example, which will eventually lead to exceeding table version limit.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)