You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "parisni (via GitHub)" <gi...@apache.org> on 2023/08/14 19:30:36 UTC
[GitHub] [hudi] parisni commented on pull request #9071: [HUDI-6453] Cascade Glue schema changes to partitions
parisni commented on PR #9071:
URL: https://github.com/apache/hudi/pull/9071#issuecomment-1677939952
> If we want to support unordered addition of fields then let's restrict cascading to that case?
Unlike hive metastore, glue supports unordered addition of columns. It does not support unordered addition of struct fields.
I also don't know how glue handle struct evolution:
- new field -> should be added to the end
- field dropped -> ?
- field renamed -> ?
The current approach in this PR would handle any evolution. This might be then a good approach, but we definitely should trigger it in last resort (ie: when a struct evolves in a not supported way)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org