[GitHub] [hudi] bvaradar commented on issue #1971: Schema evoluation causes issue when using kafka source in hudi deltastreamer

[GitBox <gi...@apache.org>]

bvaradar commented on issue #1971:
URL: https://github.com/apache/hudi/issues/1971#issuecomment-678251962


   @sathyaprakashg : Sorry for the delay in responding. This was an earlier reported issue and we had suggested one workaround here : https://github.com/apache/hudi/issues/1845#issuecomment-665180775
   
   There are couple of jiras filed on this : https://issues.apache.org/jira/browse/HUDI-1128 and https://issues.apache.org/jira/browse/HUDI-1129  
   
   Regarding your approach to fixing bytesToAvro -> avroToBytes, it is a tricky change as the implementation could break the public API contructor of the payload but if it works, lets open a PR and discuss on how to best fix it.
   
   Regarding the issue https://issues.apache.org/jira/browse/HUDI-1129, we would need to fix AvroConversionUtils (which is mostly from spark-avro) to handle the case when there are fewer fields.  Is this something you can take a look at and see if this can be fixed ?  


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org