You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "nsivabalan (via GitHub)" <gi...@apache.org> on 2025/07/30 02:40:58 UTC
[PR] [MINOR][DOCS] Updating 1.x release to call out ComplexKeyGenerator regression [hudi]
nsivabalan opened a new pull request, #13648:
URL: https://github.com/apache/hudi/pull/13648
### Change Logs
Updating 1.x release docs to call out ComplexKeyGenerator regression
### Impact
Updating 1.x release docs to call out ComplexKeyGenerator regression
### Risk level (write none, low medium or high below)
This is a doc update patch.
### Documentation Update
_Describe any necessary documentation update if there is any new feature, config, or user-facing change. If not, put "none"._
- _The config description must be updated if new configs are added or the default value of the configs are changed_
- _Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the
ticket number here and follow the [instruction](https://hudi.apache.org/contribute/developer-setup#website) to make
changes to the website._
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR][DOCS] Updating 1.x release to call out ComplexKeyGenerator regression [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #13648:
URL: https://github.com/apache/hudi/pull/13648#discussion_r2246978981
##########
website/releases/release-0.14.1.md:
##########
@@ -36,7 +36,7 @@ We discovered a regression in Hudi 0.14.1 release related to Complex Key gen whe
It can silently ingest duplicates if table is upgraded from previous versions.
:::tip
-Avoid upgrading any existing table to 0.14.1 if you are using ComplexKeyGenerator and number of fields in record key is 1.
+Avoid upgrading any existing table to 0.14.1 if you are using ComplexKeyGenerator with single field as record key and multiple partition fields
Review Comment:
the end `.` is missing.
##########
website/releases/release-0.15.0.md:
##########
@@ -323,8 +323,7 @@ single field. This issue was also present in version 0.14.1. When upgrading a ta
it may silently ingest duplicate records.
:::tip
-Avoid upgrading any existing table to 0.14.1 and 0.15.0 from any prior version if you are using ComplexKeyGenerator and
-number of fields in record key is 1.
+Avoid upgrading any existing table to 0.14.1 and 0.15.0 from any prior version if you are using ComplexKeyGenerator with single field as record key and multiple partition fields
Review Comment:
the end `.` is missing.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR][DOCS] Updating 1.x release to call out ComplexKeyGenerator regression [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on PR #13648:
URL: https://github.com/apache/hudi/pull/13648#issuecomment-3142267028
@danny0405 : addressed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR][DOCS] Updating 1.x release to call out ComplexKeyGenerator regression [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #13648:
URL: https://github.com/apache/hudi/pull/13648#discussion_r2241917585
##########
website/releases/release-1.0.2.md:
##########
@@ -33,10 +33,17 @@ The 1.0.2 release primarily focuses on bug fixes, stability enhancements, and cr
* **Performance:** Optimizations in areas like log file writing, schema reuse, and metadata initialization.
* **Testing, CI, and Dependencies:** Fixes for flaky tests, improved code coverage, bundle validation, dependency cleanup (HBase removal), and extensive release testing.
+## Known Regressions
+We have a ComplexKeyGenerator related regression reported [here](release-0.14.1#known-regressions). Please refrain from migrating, if you have single field as a part of complex key generator.
Review Comment:
User don't really quite get what kind of key generator are been used especially for SQL users because the key generator is auto-inferred, maybe we just call out "single record key with multiple partition fields"?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR][DOCS] Updating 1.x release to call out ComplexKeyGenerator regression [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on PR #13648:
URL: https://github.com/apache/hudi/pull/13648#issuecomment-3134881560
<img width="895" height="221" alt="image" src="https://github.com/user-attachments/assets/f7fa5f96-90d6-493e-90c0-082befb6d535" />
I have updated. Does this look good? I have linked to 0.14.1 release page doc.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR][DOCS] Updating 1.x release to call out ComplexKeyGenerator regression [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 merged PR #13648:
URL: https://github.com/apache/hudi/pull/13648
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR][DOCS] Updating 1.x release to call out ComplexKeyGenerator regression [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on code in PR #13648:
URL: https://github.com/apache/hudi/pull/13648#discussion_r2244351205
##########
website/releases/release-1.0.2.md:
##########
@@ -33,10 +33,17 @@ The 1.0.2 release primarily focuses on bug fixes, stability enhancements, and cr
* **Performance:** Optimizations in areas like log file writing, schema reuse, and metadata initialization.
* **Testing, CI, and Dependencies:** Fixes for flaky tests, improved code coverage, bundle validation, dependency cleanup (HBase removal), and extensive release testing.
+## Known Regressions
+We have a ComplexKeyGenerator related regression reported [here](release-0.14.1#known-regressions). Please refrain from migrating, if you have single field as a part of complex key generator.
Review Comment:
sure.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [MINOR][DOCS] Updating 1.x release to call out ComplexKeyGenerator regression [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #13648:
URL: https://github.com/apache/hudi/pull/13648#discussion_r2241917585
##########
website/releases/release-1.0.2.md:
##########
@@ -33,10 +33,17 @@ The 1.0.2 release primarily focuses on bug fixes, stability enhancements, and cr
* **Performance:** Optimizations in areas like log file writing, schema reuse, and metadata initialization.
* **Testing, CI, and Dependencies:** Fixes for flaky tests, improved code coverage, bundle validation, dependency cleanup (HBase removal), and extensive release testing.
+## Known Regressions
+We have a ComplexKeyGenerator related regression reported [here](release-0.14.1#known-regressions). Please refrain from migrating, if you have single field as a part of complex key generator.
Review Comment:
User don't really quite get what kind of key generator are been used especially for SQL users because the key generator is auto inferred, maybe we just call out "single record key with multiple partition fields"?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org