You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/11/03 13:59:45 UTC

[GitHub] [hudi] rvd8345 opened a new issue #2228: [SUPPORT] Question about Hudi Schema evolution - Column added in Middle

rvd8345 opened a new issue #2228:
URL: https://github.com/apache/hudi/issues/2228


   Hi Team,
   
   I tried upserting into an Hudi dataset after inserting a new field into the dataframe in between. So the original dataframe had 5 columns that was written in commit 1. Then before commit 2, I added a new column after column 1 of the original dataframe. 
   
   I was expecting Hudi to error out as new column was inserted in middle, but it did not. It gracefully re-wrote the files with new schema and performed Hive sync also. Hudi 0.52 is used. Is this something that has been recently enhanced in Hudi or did I miss something?
   
   thanks


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] bvaradar closed issue #2228: [SUPPORT] Question about Hudi Schema evolution - Column added in Middle

Posted by GitBox <gi...@apache.org>.
bvaradar closed issue #2228:
URL: https://github.com/apache/hudi/issues/2228


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] bvaradar commented on issue #2228: [SUPPORT] Question about Hudi Schema evolution - Column added in Middle

Posted by GitBox <gi...@apache.org>.
bvaradar commented on issue #2228:
URL: https://github.com/apache/hudi/issues/2228#issuecomment-721186955


   @rvd8345 : With 0.6.0 version, to check for schema compatibility for every single write, you need to enable the config hoodie.avro.schema.validate=true.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org