You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Balaji Varadarajan (Jira)" <ji...@apache.org> on 2020/05/25 18:49:00 UTC

[jira] [Updated] (HUDI-419) Basic Implementation for verifying if bootstrapping works end to end

     [ https://issues.apache.org/jira/browse/HUDI-419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Balaji Varadarajan updated HUDI-419:
------------------------------------
    Status: In Progress  (was: Open)

> Basic Implementation for verifying if bootstrapping works end to end
> --------------------------------------------------------------------
>
>                 Key: HUDI-419
>                 URL: https://issues.apache.org/jira/browse/HUDI-419
>             Project: Apache Hudi
>          Issue Type: Sub-task
>          Components: Common Core, Hive Integration, Writer Core
>            Reporter: Balaji Varadarajan
>            Assignee: Balaji Varadarajan
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 0.6.0
>
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> As part of prototyping, I have most of the core functionalities in 
> [https://github.com/bvaradar/hudi/tree/vb_bootstrap]
>  
> This includes:
>  # Timeline and FileSystem View changes
>  # New Bootstrap Client to perform Bootstrap
>  # DeltaStreamer Integration
>  # Hive Parquet Read Optimized reader integration
>  
> Needs to be done:
>  # Merge Handle changes to support upsert over bootstrap file slice (Read part similar to that of (4) functionally and write part same as that of current Hoodie MergeHandle.
>  # Unit Testing 
>  # Code cleanup as the current implementation has duplicated code.
>  # Automated integration test
>  # Hoodie CLI and Spark DataSource Write integration



--
This message was sent by Atlassian Jira
(v8.3.4#803005)