You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "vortual (via GitHub)" <gi...@apache.org> on 2023/01/30 10:19:32 UTC
[GitHub] [hudi] vortual opened a new pull request, #7794: Add WRITE_BULK_INSERT_SORT_INPUT_BY_RECORD_KEY option
vortual opened a new pull request, #7794:
URL: https://github.com/apache/hudi/pull/7794
### Change Logs
BulkInsert 新增一个根据主键排序的选项:WRITE_BULK_INSERT_SORT_INPUT_BY_RECORD_KEY
BulkInsert adds an option to sort by primary key: WRITE_BULK_INSERT_SORT_INPUT_BY_RECORD_KEY
### Impact
数据根据主键排序的好处:后续新增数据时 flink 需要扫描的文件会变少,使用内存也会降低
The advantage of sorting data according to the primary key: Flink needs to scan fewer files when new data is added later, and the memory usage will also be reduced
### Risk level (write none, low medium or high below)
none
### Documentation Update
N/A
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] vortual closed pull request #7794: Add WRITE_BULK_INSERT_SORT_INPUT_BY_RECORD_KEY option
Posted by "vortual (via GitHub)" <gi...@apache.org>.
vortual closed pull request #7794: Add WRITE_BULK_INSERT_SORT_INPUT_BY_RECORD_KEY option
URL: https://github.com/apache/hudi/pull/7794
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org