[GitHub] [hudi] xushiyan commented on issue #3737: how can we migrate a legacy COW table into MOR table

[GitBox <gi...@apache.org>]

xushiyan commented on issue #3737:
URL: https://github.com/apache/hudi/issues/3737#issuecomment-948241269


   as @nsivabalan mentioned, i think writing deltacommit straight to COW table is the best approach if works. you may need to manually edit the hoodie.properties to change the table type. I haven't tried this myself but sounds feasible.
   
   @qingyuan18 if you tried this way, please share the how it went. 
   Other approaches I can think of are of some manual processes: you could either run deltastreamer to do 1 time sync write to the new table, you can set SQLSource or Hudi source to read from old table, or use Hudi Exporter utility to dump the table to plain parquet files then bootstrap it as the new table (METADATA_ONLY mode so that data is not actually copied). In either case you'd need to ensure writing to the new table respects the checkpoint in the table and able to resume from it to ensure data completeness.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org