You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 06:31:32 UTC
[I] Add hash partition [hudi]
hudi-bot opened a new issue, #15803:
URL: https://github.com/apache/hudi/issues/15803
It is often difficult to find an appropriate partition key in the existing data. Hash partitioning can easily solve this problem
When hash.partition.fields is specified and partition.fields contains _hoodie_hash_partition, a column named _hoodie_hash_partition will be added in this table as one of the partition key.
If predicates of hash.partition.fields appear in the query statement, the _hoodie_hash_partition = X predicate will be automatically added to the query statement for partition pruning.
The PR 7984 implements hash partitioning.
[https://github.com/apache/hudi/pull/7984]
How to use hash partition in spark data source can refer to hudi/hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala#testHashPartition
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-5810
- Type: New Feature
- Epic: https://issues.apache.org/jira/browse/HUDI-1297
---
## Comments
16/Feb/23 04:05;lvhu18@163.com;The PR 7984 implements hash partitioning.
https://github.com/apache/hudi/pull/7984
How to use hash partition in spark data source can refer to hudi/hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala#testHashPartition;;;
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add hash partition [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on issue #15803:
URL: https://github.com/apache/hudi/issues/15803#issuecomment-3630158167
### Linked PR(s)
- https://github.com/apache/hudi/pull/7984
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org