You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "leesf (Jira)" <ji...@apache.org> on 2020/01/08 09:56:00 UTC
[jira] [Updated] (HUDI-419) Basic Implementation for verifying if
bootstrapping works end to end
[ https://issues.apache.org/jira/browse/HUDI-419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
leesf updated HUDI-419:
-----------------------
Fix Version/s: 0.6.0
> Basic Implementation for verifying if bootstrapping works end to end
> --------------------------------------------------------------------
>
> Key: HUDI-419
> URL: https://issues.apache.org/jira/browse/HUDI-419
> Project: Apache Hudi (incubating)
> Issue Type: Sub-task
> Components: Common Core, Hive Integration, Writer Core
> Reporter: Balaji Varadarajan
> Assignee: Balaji Varadarajan
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.6.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> As part of prototyping, I have most of the core functionalities in
> [https://github.com/bvaradar/hudi/tree/vb_bootstrap]
>
> This includes:
> # Timeline and FileSystem View changes
> # New Bootstrap Client to perform Bootstrap
> # DeltaStreamer Integration
> # Hive Parquet Read Optimized reader integration
>
> Needs to be done:
> # Merge Handle changes to support upsert over bootstrap file slice (Read part similar to that of (4) functionally and write part same as that of current Hoodie MergeHandle.
> # Unit Testing
> # Code cleanup as the current implementation has duplicated code.
> # Automated integration test
> # Hoodie CLI and Spark DataSource Write integration
--
This message was sent by Atlassian Jira
(v8.3.4#803005)