[GitHub] [hudi] xushiyan commented on pull request #9063: [HUDI-6448] Improve upgrade/downgrade for table ver. 6

["xushiyan (via GitHub)" <gi...@apache.org>]

xushiyan commented on PR #9063:
URL: https://github.com/apache/hudi/pull/9063#issuecomment-1613418110

   manually verified the flow 0.13.1 -> 0.14.0-SNAPSHOT (this PR)
   
   before upgrade
   
   ```
   hoodie.table.version=5
   hoodie.table.metadata.partitions=files
   ```
   
   upgrade
   
   ```
   ./hudi-cli.sh
   connect --path /tmp/hudi_trips_13_1_to_14_0_COPY_ON_WRITE
   upgrade table --toVersion 6 --sparkMaster 'local[2]'
   ```
   
   after upgrade
   
   ```
   hoodie.table.version=6
   hoodie.table.metadata.partitions=files
   ```
   
   write data with RLI enabled
   
   ```
   hoodie.table.version=6
   hoodie.table.metadata.partitions=files,record_index
   ```
   
   RLI partition and hfiles created
   
   downgrade
   
   ```
   downgrade table --toVersion 5 --sparkMaster 'local[2]'
   ```
   
   after downgrade
   
   ```
   hoodie.table.version=5
   hoodie.table.metadata.partitions=files
   ```
   
   RLI partition is removed
   
   ```
   ➜ ll /tmp/hudi_trips_13_1_to_14_0_COPY_ON_WRITE/.hoodie/metadata/record_index
   ls: /tmp/hudi_trips_13_1_to_14_0_COPY_ON_WRITE/.hoodie/metadata/record_index: No such file or directory
   ```
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org