[jira] [Commented] (HUDI-2478) Handle failure mid-way during init buckets

["Prashant Wason (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HUDI-2478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17428670#comment-17428670 ] 

Prashant Wason commented on HUDI-2478:
--------------------------------------

Since buckets are initialized only once, the simple fix may be to always delete existing ones when initializing. 

Checks needed to ensure - we have exact number of buckets and the user did not change count later (as it is not supported). The number of buckets for file-listing is 1 but for record index will be configurable.

> Handle failure mid-way during init buckets
> ------------------------------------------
>
>                 Key: HUDI-2478
>                 URL: https://issues.apache.org/jira/browse/HUDI-2478
>             Project: Apache Hudi
>          Issue Type: Sub-task
>            Reporter: sivabalan narayanan
>            Assignee: sivabalan narayanan
>            Priority: Major
>             Fix For: 0.10.0
>
>
> If process crashes mid-way while instantiating buckets, if tried again, it should work seamlessly. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)