[jira] [Created] (HUDI-419) Basic Implementation for verifying if bootstrapping works end to end

["Balaji Varadarajan (Jira)" <ji...@apache.org>]

Balaji Varadarajan created HUDI-419:
---------------------------------------

             Summary: Basic Implementation for verifying if bootstrapping works end to end
                 Key: HUDI-419
                 URL: https://issues.apache.org/jira/browse/HUDI-419
             Project: Apache Hudi (incubating)
          Issue Type: Sub-task
          Components: Common Core, Hive Integration, Write Client
            Reporter: Balaji Varadarajan


As part of prototyping, I have most of the core functionalities in 

[https://github.com/bvaradar/hudi/tree/vb_bootstrap]

 

This includes:
 # Timeline and FileSystem View changes
 # New Bootstrap Client to perform Bootstrap
 # DeltaStreamer Integration
 # Hive Parquet Read Optimized reader integration

 

Needs to be done:
 # Merge Handle changes to support upsert over bootstrap file slice (Read part similar to that of (4) functionally and write part same as that of current Hoodie MergeHandle.
 # Unit Testing 
 # Code cleanup as the current implementation has duplicated code.
 # Automated integration test
 # Hoodie CLI and Spark DataSource Write integration



--
This message was sent by Atlassian Jira
(v8.3.4#803005)