You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 13:24:18 UTC
[I] Incorrect partition pruning when TimestampBasedKeyGenerator is used in partition column [hudi]
hudi-bot opened a new issue, #17253:
URL: https://github.com/apache/hudi/issues/17253
Fix of ClassCastException in https://issues.apache.org/jira/browse/HUDI-7709 with nulls as partition columns values could lead to an empty query results.
HoodieFileIndex.listFiles() would return Seq of {color:#000000}PartitionDirectory with null values.{color}
{color:#000000}But there is another problem with range filters on partition column.{color}
{color:#000000}For instance, we have UNIX_TIMESTAMP in column ts.{color}
And the table is also partitioned by ts with
hoodie.keygen.timebased.output.dateformat = "yyyy-MM-dd HH"
{color:#000000}For execution of query like:{color}
SELECT ... WHERE ts BETWEEN 1078016000 and 1718953003 ...
it's not possible to filter rows properly.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-7952
- Type: Sub-task
- Parent: https://issues.apache.org/jira/browse/HUDI-9113
- Fix version(s):
- 1.1.0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Incorrect partition pruning when TimestampBasedKeyGenerator is used in partition column [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan closed issue #17253: Incorrect partition pruning when TimestampBasedKeyGenerator is used in partition column
URL: https://github.com/apache/hudi/issues/17253
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Incorrect partition pruning when TimestampBasedKeyGenerator is used in partition column [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on issue #17253:
URL: https://github.com/apache/hudi/issues/17253#issuecomment-4800823789
Closing as resolved. Tracked in [HUDI-7709](https://issues.apache.org/jira/browse/HUDI-7709) (fixVersions: 1.0.0). The change landed in PR [#11615](https://github.com/apache/hudi/pull/11615) (commit `e2860cddf549`). Please reopen if you can still reproduce on the latest release.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org