You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/10/02 01:45:04 UTC

[GitHub] [hudi] prashantwason edited a comment on pull request #2064: WIP - [HUDI-842] Implementation of HUDI RFC-15.

prashantwason edited a comment on pull request #2064:
URL: https://github.com/apache/hudi/pull/2064#issuecomment-686688968


   Remaining work items:
   
   - [x] 1. Support for rollbacks in MOR Table
   - [ ] 2. Rollback of metadata if commit eventually fails on dataset 
   - [x] 3. HUDI-CLI extensions for metadata debugging
   - [ ] 4. Ensure partial rollbacks do not use metadata table as it does not contain partial info 
   - [ ] 5. Fix initialization when Async jobs are scheduled - these jobs have older timestamp than INIT timestamp on metadata table
   - [ ] 6. Check if MergedBlockReader will neglect log blocks based on uncommitted commits.
   - [x] 7. Unit test for rollback of partial commits
   - [x] 8. Schema evolution strategy for metadata table
   - [x] 9. Unit test for marker based rollback
   - [x] 10. Can all compaction strategies work off of metadata table itself? Does it have all the data
   - [ ] 11. Async Clean and Async Compaction - how will they work with metadata table updates - check multi writer
   - [ ] 12. Query-side use of metadata table
   - [ ] 13. How we are going to add new metadata partitions in the background, as writers/cleaner/compactors keep running.
   - [ ] 14. Fix the case when the table is non-partitioned
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org