You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "hudi-bot (via GitHub)" <gi...@apache.org> on 2025/11/30 05:50:22 UTC
[I] [Reader] Push down filters in FSR [hudi]
hudi-bot opened a new issue, #15421:
URL: https://github.com/apache/hudi/issues/15421
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-5137
- Type: Task
- Epic: https://issues.apache.org/jira/browse/HUDI-4141
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Reader] Push down filters in FSR [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on issue #15421:
URL: https://github.com/apache/hudi/issues/15421#issuecomment-4795366773
Triage: this appears to have been resolved on master. Filter pushdown is now implemented in the FileGroupReader-based Spark read path:
- `HoodieFileGroupReaderBasedFileFormat` (hudi-spark-common) plumbs Spark `filters` and `requiredFilters` into the reader context.
- `SparkFileFormatInternalRowReaderContext` applies them via `getSchemaAndFiltersForRead`, with `bootstrapSafeFilters` / `morFilters` / `allFilters` variants depending on the read mode.
The relevant fixes landed under sibling JIRAs:
- HUDI-7053 — Fix the filter pushdown logic for file group reader (commit 4aed85f1b098)
- HUDI-7059 — Enable filter pushdown for positional merging (commit 55fe68efb527)
If there are still gaps you have in mind for HUDI-5137 (e.g., specific filter shapes or query types not pushed down), could you share a concrete repro? Otherwise this looks safe to close as completed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Reader] Push down filters in FSR [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan closed issue #15421: [Reader] Push down filters in FSR
URL: https://github.com/apache/hudi/issues/15421
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org