You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Vinoth Chandar (Jira)" <ji...@apache.org> on 2019/08/22 04:55:00 UTC
[jira] [Assigned] (HUDI-204) Make MOR rollback idempotent and
disable using rolling stats for small file selection
[ https://issues.apache.org/jira/browse/HUDI-204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinoth Chandar reassigned HUDI-204:
-----------------------------------
Assignee: BALAJI VARADARAJAN
> Make MOR rollback idempotent and disable using rolling stats for small file selection
> -------------------------------------------------------------------------------------
>
> Key: HUDI-204
> URL: https://issues.apache.org/jira/browse/HUDI-204
> Project: Apache Hudi (incubating)
> Issue Type: Bug
> Components: Write Client
> Reporter: BALAJI VARADARAJAN
> Assignee: BALAJI VARADARAJAN
> Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> 1. Rollback assumes all fileIds that are affected by rollback to be always present. This breaks when rollback fails intermittently and is retried
> 2. Sometime Rolling stats wrongly tracks file sizes to be 0. We had earlier discussed to completely revisit rolling stats. We will disable using rolling stats to prevent wrong small file selection
--
This message was sent by Atlassian Jira
(v8.3.2#803003)