You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/08/25 09:20:52 UTC

[GitHub] [hudi] sbernauer commented on pull request #2012: HUDI-1129 Deltastreamer Add support for schema evaluation

sbernauer commented on pull request #2012:
URL: https://github.com/apache/hudi/pull/2012#issuecomment-679910464


   Hi @sathyaprakashg, thanks for your work!
   
   When i move the new field `evoluted_optional_union_field` to a place not at the end of the schema (somewhere in the middle) i get the following exception:
   `java.lang.ClassCastException: java.lang.Boolean cannot be cast to java.lang.Iterable.`
   This makes sense, since now the ids of the fields dont line up any more. So reducing the length to the minimum is not sufficient here.
   
   I suggest using the field names instead of the ids (which dont match up any more after a new field in the middle). See https://github.com/sbernauer/hudi/commit/1adbc7bddac431bb060880efab2d3979840765da#diff-3c046573a91f36ba0f12dad0e3395dc9R139
   
   Should i open a PR for this change or do you want to modify yours?
   
   Cheers,
   Sebastian


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org