You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/05/14 16:45:00 UTC

[GitHub] [hudi] nsivabalan commented on pull request #2927: [HUDI-1129] Adding support to ingest records with old schema after table's schema is evolved

nsivabalan commented on pull request #2927:
URL: https://github.com/apache/hudi/pull/2927#issuecomment-841364349


   @n3nash : this needs some thoughts before we land. 
   
   whats expected behavior, if someone mistakenly ingested records w/ a missing column. we can't automatically fetch latest schema and try to convert records right. 
   I mean, 
   batch1: schema with 3 cols
   batch2: schema with 4 cols
   batch3: mistakenly sending records with only 3 columns. 
   
   again there could be two cases here: 
   if the missed out column does not have default null values set
   if the missed out column have default null values set. 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org