You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "yunchipang (via GitHub)" <gi...@apache.org> on 2025/10/09 17:55:39 UTC

[PR] feat: add filter transformation for `TimestampBasedKeyGenerator` partition pruning [hudi-rs]

yunchipang opened a new pull request, #462:
URL: https://github.com/apache/hudi-rs/pull/462

   ## Description
   
   <!--- Describe your changes in detail -->
   Implements filter transformation for `TimestampBasedKeyGenerator` to enable partition pruning when user filters use timestamp columns but partitions are organized by date components (year, month, day, hour).
   
   example 1
   - user filter: `ts_str >= "2024-01-15T00:00:00Z"`
   - transformed filter: `year >= "2024"`
   
   example 2
   - user filter: `ts_str = "2024-01-15T12:30:00Z"`
   - transformed filter: `year = "2024" AND month = "01" AND day = "15" AND hour = "12"`
   
   
   <!--- If it fixes an open issue, please link to the issue here. -->
   partially closes #286
   
   <!--- Please link any related issues and PRs as well. -->
   
   ## How are the changes test-covered
   
   - [ ] N/A
   - [x] Automated tests (unit and/or integration tests)
   - [ ] Manual tests
     - [ ] Details are described below
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] feat: add filter transformation for TimestampBasedKeyGenerator partition pruning [hudi-rs]

Posted by "xushiyan (via GitHub)" <gi...@apache.org>.
xushiyan merged PR #462:
URL: https://github.com/apache/hudi-rs/pull/462


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org