You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "CTTY (via GitHub)" <gi...@apache.org> on 2025/07/15 03:20:25 UTC
[I] Feature Request: Support Clustering in hudi-rs [hudi-rs]
CTTY opened a new issue, #400:
URL: https://github.com/apache/hudi-rs/issues/400
### Feature Description
Clustering is a core optimization feature in Apache Hudi, widely used to manage small files and improve query performance.
I’d love to see support for clustering in hudi-rs, which could handle this efficiently thanks to Rust’s performance. This would enable production-grade optimization workflows in native Rust pipelines.
### Why this matters
- Performance: Rust is expected to make compute-intensive operations like clustering much more performant
- Ease of migration: Users who are using standalone clustering should be able to migrate to hudi-rs clustering easily
- Ecosystem trend: Similar efforts are emerging in other formats, e.g. [Iceberg compaction](https://github.com/nimtable/iceberg-compaction/tree/main).
### Suggested Scope
Initial support might include:
- Reading clustering plans
- Executing clustering as a standalone action
- Supporting inline clustering in write paths (optional follow-up)
### Prerequisites
- hudi-rs doesn't have write overall support, it needs to be able to write and commit data before we implementing complicated table services
### Additional context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org