You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/04/05 19:09:14 UTC

[GitHub] [incubator-hudi] xushiyan commented on issue #1480: [SUPPORT] Backwards Incompatible Schema Evolution

xushiyan commented on issue #1480: [SUPPORT] Backwards Incompatible Schema Evolution
URL: https://github.com/apache/incubator-hudi/issues/1480#issuecomment-609466504
 
 
   @vinothchandar Yes the exporter tool can be used for this purpose, with some changes. It currently supports copying Hudi dataset as is. With this migration use case, we could extend the feature to include transformation when `--output-format hudi`, using a custom `Transformer`.
   
   Though MOR is a bit troublesome with log files conversions, we could start with COW tables support? Does this work for your case? @symfrog 
   
   As for splitting/merging usecases, something feasible as well; some more logic to implement for exporter to take multiple source/target paths. Also some efforts to support multiple datasets in `Transformer` interface.
   
   @vinothchandar Are my thoughts above aligned with yours?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services