You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "xushiyan (via GitHub)" <gi...@apache.org> on 2026/05/11 03:35:30 UTC
[PR] feat(datafusion): support Lance scan and broaden MOR snapshot e2e coverage [hudi-rs]
xushiyan opened a new pull request, #608:
URL: https://github.com/apache/hudi-rs/pull/608
## Description
- Add `HudiScanExec`, a custom DataFusion `ExecutionPlan` that routes Lance base files and MOR snapshot reads through `FileGroupReader`, while Parquet COW and MOR read-optimized continue on DataFusion's native `ParquetSource`.
- Broaden e2e test coverage for MOR snapshot reads (base + log-file merging) across both base formats: Lance MOR snapshot, partitioned Parquet MOR snapshot with partition-filter pushdown and `input_partitions` propagation, and v9 txns MOR snapshot mode across 6 fixture variants.
## How are the changes test-covered
- [ ] N/A
- [x] Automated tests (unit and/or integration tests)
- [ ] Manual tests
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(datafusion): support Lance scan and broaden MOR snapshot e2e coverage [hudi-rs]
Posted by "codecov[bot] (via GitHub)" <gi...@apache.org>.
codecov[bot] commented on PR #608:
URL: https://github.com/apache/hudi-rs/pull/608#issuecomment-4417448719
## [Codecov](https://app.codecov.io/gh/apache/hudi-rs/pull/608?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:x: Patch coverage is `74.46809%` with `72 lines` in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 81.64%. Comparing base ([`150570a`](https://app.codecov.io/gh/apache/hudi-rs/commit/150570a24f6683d8f651350926d6d71f45bc7e1d?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`408a5ac`](https://app.codecov.io/gh/apache/hudi-rs/commit/408a5acef6b400d0c4d03e446aa503f70519f9f1?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
| [Files with missing lines](https://app.codecov.io/gh/apache/hudi-rs/pull/608?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
|---|---|---|
| [crates/datafusion/src/hudi\_exec.rs](https://app.codecov.io/gh/apache/hudi-rs/pull/608?src=pr&el=tree&filepath=crates%2Fdatafusion%2Fsrc%2Fhudi_exec.rs&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-Y3JhdGVzL2RhdGFmdXNpb24vc3JjL2h1ZGlfZXhlYy5ycw==) | 65.11% | [45 Missing :warning: ](https://app.codecov.io/gh/apache/hudi-rs/pull/608?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [crates/datafusion/src/lib.rs](https://app.codecov.io/gh/apache/hudi-rs/pull/608?src=pr&el=tree&filepath=crates%2Fdatafusion%2Fsrc%2Flib.rs&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-Y3JhdGVzL2RhdGFmdXNpb24vc3JjL2xpYi5ycw==) | 74.25% | [26 Missing :warning: ](https://app.codecov.io/gh/apache/hudi-rs/pull/608?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [crates/datafusion/tests/plan\_tests.rs](https://app.codecov.io/gh/apache/hudi-rs/pull/608?src=pr&el=tree&filepath=crates%2Fdatafusion%2Ftests%2Fplan_tests.rs&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-Y3JhdGVzL2RhdGFmdXNpb24vdGVzdHMvcGxhbl90ZXN0cy5ycw==) | 80.00% | [1 Missing :warning: ](https://app.codecov.io/gh/apache/hudi-rs/pull/608?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## main #608 +/- ##
==========================================
- Coverage 82.11% 81.64% -0.48%
==========================================
Files 81 83 +2
Lines 5788 6084 +296
==========================================
+ Hits 4753 4967 +214
- Misses 1035 1117 +82
```
</details>
[:umbrella: View full report in Codecov by Sentry](https://app.codecov.io/gh/apache/hudi-rs/pull/608?dropdown=coverage&src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache).
:loudspeaker: Have feedback on the report? [Share it here](https://about.codecov.io/codecov-pr-comment-feedback/?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache).
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(datafusion): support Lance scan and broaden MOR snapshot e2e coverage [hudi-rs]
Posted by "xushiyan (via GitHub)" <gi...@apache.org>.
xushiyan merged PR #608:
URL: https://github.com/apache/hudi-rs/pull/608
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org