You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Alexey Kudinkin (Jira)" <ji...@apache.org> on 2022/07/06 16:49:00 UTC
[jira] [Updated] (HUDI-4368) Make sure Hudi always does bulk-insert during the first commit into the table
[ https://issues.apache.org/jira/browse/HUDI-4368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alexey Kudinkin updated HUDI-4368:
----------------------------------
Description:
As a follow-up to the recent discussions in the community regarding out-of-the-box configuration (DB blog), i think we should adjust some aspects of our OOB configuration to stay in-line with other formats as it's inevitable that people would be comparing Hudi's performance against Delta and Iceberg:
For example, we should make sure that whenever someone is creating a table from scratch we always use "bulk_insert" instead of "upsert" as there's no reason for us to incur the overhead of upserting since we know the table was empty.
It could roughly go as following:
* If the table is empty, and
* There's no explicit operation configured, and
* There's no pre-combining configured
Then we treat it as "bulk_insert" case
was:
As a follow-up to the recent discussions in the community regarding out-of-the-box configuration (DB blog), i think we should adjust some aspects of our OOB configuration to stay in-line with other formats as it's inevitable that people would be comparing Hudi's performance against Delta and Iceberg:
For example, we should make sure that whenever someone is creating a table from scratch we always use "bulk_insert" instead of "upsert" as there's no reason for us to incur the overhead of upserting since we know the table was empty.
> Make sure Hudi always does bulk-insert during the first commit into the table
> -----------------------------------------------------------------------------
>
> Key: HUDI-4368
> URL: https://issues.apache.org/jira/browse/HUDI-4368
> Project: Apache Hudi
> Issue Type: Bug
> Reporter: Alexey Kudinkin
> Assignee: Raymond Xu
> Priority: Blocker
> Fix For: 0.12.0
>
>
> As a follow-up to the recent discussions in the community regarding out-of-the-box configuration (DB blog), i think we should adjust some aspects of our OOB configuration to stay in-line with other formats as it's inevitable that people would be comparing Hudi's performance against Delta and Iceberg:
> For example, we should make sure that whenever someone is creating a table from scratch we always use "bulk_insert" instead of "upsert" as there's no reason for us to incur the overhead of upserting since we know the table was empty.
>
> It could roughly go as following:
> * If the table is empty, and
> * There's no explicit operation configured, and
> * There's no pre-combining configured
> Then we treat it as "bulk_insert" case
--
This message was sent by Atlassian Jira
(v8.20.10#820010)