You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Vinoth Chandar (Jira)" <ji...@apache.org> on 2020/08/31 18:01:00 UTC

[jira] [Created] (HUDI-1258) Small file handling Merges can be handled without actual merging

Vinoth Chandar created HUDI-1258:
------------------------------------

             Summary: Small file handling Merges can be handled without actual merging
                 Key: HUDI-1258
                 URL: https://issues.apache.org/jira/browse/HUDI-1258
             Project: Apache Hudi
          Issue Type: Improvement
          Components: Writer Core
            Reporter: Vinoth Chandar
            Assignee: Vinoth Chandar
             Fix For: 0.7.0


If a file slice gets inserts into MergeHandle, for file sizing reasons, there is no reason to really build the hashmap and merge. 

 

This will also avoid the issue of insert with the same duplicate key overwriting the previous value 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)