You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Kumud Kumar Srivatsava Tirupati (Jira)" <ji...@apache.org> on 2022/06/28 08:46:00 UTC

[jira] [Created] (HUDI-4335) AWSGlueCatalogSyncClient doesn't sync the metadata properly post schema evolution

|  ![](cid:jira-generated-image-avatar-13a9751a-7f1e-4793-af59-a7c8a7723d09) |
[Kumud Kumar Srivatsava
Tirupati](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=kumudkumartirupati)
**created** an issue  
---|---  
|  
---  
|  [Apache Hudi](https://issues.apache.org/jira/browse/HUDI) /
[![Bug](cid:jira-generated-image-
avatar-2f7583a0-6b6e-43fc-947d-961b9d53f2a8)](https://issues.apache.org/jira/browse/HUDI-4335)
[HUDI-4335](https://issues.apache.org/jira/browse/HUDI-4335)  
---  
[AWSGlueCatalogSyncClient doesn't sync the metadata properly post schema
evolution](https://issues.apache.org/jira/browse/HUDI-4335)  
| Issue Type: |  ![Bug](cid:jira-generated-image-
avatar-2f7583a0-6b6e-43fc-947d-961b9d53f2a8) Bug  
---|---  
Affects Versions: |  0.12.0  
Assignee: |  Unassigned  
Components: |  meta-sync  
Created: |  28/Jun/22 08:45  
Priority: |  ![Major](cid:jira-generated-image-static-
major-e56944a7-67ff-461f-b2f9-7dab2f1be264) Major  
Reporter: |  [Kumud Kumar Srivatsava
Tirupati](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=kumudkumartirupati)  
|

Bugs:

  * CreateTable filters out the partition column but updating the table doesn't filter the schema which leads to having duplicate columns and incompatible metadata in Hive.
  * Table properties not getting updated when schema changes because of the incorrect `nonEmpty` predicate check.
  * Update table parameters function overrides the `EXTERNAL` and `last_commit_time_sync` causing to reload all the partitions.

  
---  
|  |  [ ![Add Comment](cid:jira-generated-image-static-comment-
icon-5044afa9-18e0-4723-a438-607917f652cf)
](https://issues.apache.org/jira/browse/HUDI-4335#add-comment "Add Comment") |
[Add Comment](https://issues.apache.org/jira/browse/HUDI-4335#add-comment "Add
Comment")  
---|---  
  
|  This message was sent by Atlassian Jira (v8.20.10#820010-sha1:ace47f9) |  |
![Atlassian logo](https://issues.apache.org/jira/images/mail/atlassian-email-
logo.png)  
---