You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/06/10 18:53:55 UTC

[GitHub] [hudi] nsivabalan commented on issue #5685: [SUPPORT] Loading older data with old schema version into Hudi

nsivabalan commented on issue #5685:
URL: https://github.com/apache/hudi/issues/5685#issuecomment-1152644499

   @MikeTipico : Can you try enabling this config https://hudi.apache.org/docs/configurations/#hoodiedatasourcewritereconcileschema . This was initially added for the purpose you are talking about. But the schema evolution have some limitations. 
   
   for eg,
   schema1: col1, col2. 
   schema2: col1, col2, col3(default null)
   
   above one is ok. ie. once the table is upgraded to schema2, you can ingest records w/ schema1 and enable above config and things should be ok
   
   But below one may not work
   schema1: col1, col3
   schema2: col1, col2(default null), col3


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org