You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by si...@apache.org on 2021/08/06 18:35:47 UTC
[hudi] branch asf-site updated: [HUDI-2257] Adding note to set
Keygen class while deleting data (#3404)
This is an automated email from the ASF dual-hosted git repository.
sivabalan pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 1681070 [HUDI-2257] Adding note to set Keygen class while deleting data (#3404)
1681070 is described below
commit 1681070add7a56a50aaa7a533931e794364f94a6
Author: Vinay Patil <52...@users.noreply.github.com>
AuthorDate: Sat Aug 7 00:05:32 2021 +0530
[HUDI-2257] Adding note to set Keygen class while deleting data (#3404)
---
website/blog/2020-01-15-delete-support-in-hudi.md | 10 ++++++++++
website/docs/quick-start-guide.md | 12 ++++++++++++
2 files changed, 22 insertions(+)
diff --git a/website/blog/2020-01-15-delete-support-in-hudi.md b/website/blog/2020-01-15-delete-support-in-hudi.md
index 95afa4f..2b5fb93 100644
--- a/website/blog/2020-01-15-delete-support-in-hudi.md
+++ b/website/blog/2020-01-15-delete-support-in-hudi.md
@@ -56,6 +56,11 @@ df.write.format("org.apache.hudi").
mode(Overwrite).
save(basePath);
```
+**Note:** For non-partitioned table, set
+ ```
+ option(KEYGENERATOR_CLASS_PROP, "org.apache.hudi.keygen.NonpartitionedKeyGenerator")
+ ```
+ Checkout https://hudi.apache.org/blog/2021/02/13/hudi-key-generators for more options
**Step 4** : Query data. Load the data files into a DataFrame.
@@ -92,6 +97,11 @@ df.write.format("org.apache.hudi").
mode(Append).
save(basePath);
```
+**Note:** For non-partitioned table, set
+ ```
+ option(KEYGENERATOR_CLASS_PROP, "org.apache.hudi.keygen.NonpartitionedKeyGenerator")
+ ```
+ Checkout https://hudi.apache.org/blog/2021/02/13/hudi-key-generators for more options
**Step 7** : Reload the table and verify that the records are deleted
diff --git a/website/docs/quick-start-guide.md b/website/docs/quick-start-guide.md
index 2e1d9ec..3deb102 100644
--- a/website/docs/quick-start-guide.md
+++ b/website/docs/quick-start-guide.md
@@ -185,6 +185,12 @@ Here we are using the default write operation : `upsert`. If you have a workload
`insert` or `bulk_insert` operations which could be faster. To know more, refer to [Write operations](/docs/writing_data#write-operations)
:::
+**Note:** For non-partitioned table, set
+ ```
+ option(KEYGENERATOR_CLASS_PROP, "org.apache.hudi.keygen.NonpartitionedKeyGenerator")
+ ```
+ Checkout https://hudi.apache.org/blog/2021/02/13/hudi-key-generators for more options
+
## Query data
Load the data files into a DataFrame.
@@ -504,6 +510,12 @@ Only `Append` mode is supported for delete operation.
See the [deletion section](/docs/writing_data#deletes) of the writing data page for more details.
+**Note:** For non-partitioned table, set
+ ```
+ option(KEYGENERATOR_CLASS_PROP, "org.apache.hudi.keygen.NonpartitionedKeyGenerator")
+ ```
+ Checkout https://hudi.apache.org/blog/2021/02/13/hudi-key-generators for more options
+
## Insert Overwrite Table
Generate some new trips, overwrite the table logically at the Hudi metadata level. The Hudi cleaner will eventually