You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "yihua (via GitHub)" <gi...@apache.org> on 2026/10/16 20:30:05 UTC
[PR] feat(benchmark): add a DuckDB leg to the TPC-H harness [hudi-rs]
yihua opened a new pull request, #826:
URL: https://github.com/apache/hudi-rs/pull/826
## Description
Adds a DuckDB leg to the TPC-H harness, so DuckDB's [hudi extension](https://github.com/alitrack/duckdb-hudi) (built on hudi-rs) can be timed and checked the same way as the DataFusion and Spark legs. `run.sh bench-duckdb` times `read_hudi` and `read_parquet` with the same query text, and `run.sh validate-duckdb` compares the two row by row. `make bench-tpch ENGINE=duckdb` calls the first. Each query runs in its own process, so a query that crashes DuckDB is recorded as failed and the run goes on. `--extension <path>` with `--label` times a locally built extension against the published one, and `--threads` caps DuckDB's cores.
Running it found that the published extension (v0.2.1) returns wrong results or crashes on 17 of the 22 queries, fixed in alitrack/duckdb-hudi#1. A streaming scan with projection pushdown on top of that, alitrack/duckdb-hudi#2, brings SF1 from 65.4 s to 4.2 s, against 1.31 s for `read_parquet`.
## How are the changes test-covered
- [ ] N/A
- [ ] Automated tests (unit and/or integration tests)
- [x] Manual tests
- [x] Details are described below
On DuckDB 1.5.6, at SF0.01 and SF1: `validate-duckdb` passes all 22 queries on a fixed extension build and reports the community build's crashes and differences per query. `bench-duckdb` runs with the community and local builds side by side, writing labelled result files that `compare --runs` reads. Also checked: `make bench-tpch ENGINE=duckdb`, rejection of a bad `--label` and of non-S3 cloud URLs, and a broken extension path reported once rather than once per query.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(benchmark): add a DuckDB leg to the TPC-H harness [hudi-rs]
Posted by "yihua (via GitHub) via commits" <co...@hudi.apache.org>.
yihua commented on PR #826:
URL: https://github.com/apache/hudi-rs/pull/826#issuecomment-6716885132
Pushed a minor revision in the latest commit, after merging main: the DuckDB leg now defaults to the per-SF DataFusion thread and memory budget, `environment.txt` records each extension build and the hudi-core release it embeds, an unloadable extension stops the run with one line, and the shared format/defaults parsing in `run.sh` moved into helpers. LGTM.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(benchmark): add a DuckDB leg to the TPC-H harness [hudi-rs]
Posted by "codecov[bot] (via GitHub)" <gi...@apache.org>.
codecov[bot] commented on PR #826:
URL: https://github.com/apache/hudi-rs/pull/826#issuecomment-6224425487
## [Codecov](https://app.codecov.io/gh/apache/hudi-rs/pull/826?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:white_check_mark: All modified and coverable lines are covered by tests.
:white_check_mark: Project coverage is 79.73%. Comparing base ([`ce1f6a3`](https://app.codecov.io/gh/apache/hudi-rs/commit/ce1f6a3e2b6adb34dc078eac7631316cd62c4a87?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`2f6fd7e`](https://app.codecov.io/gh/apache/hudi-rs/commit/2f6fd7ee7576d2e6e459a566b999783f04c9fabf?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## main #826 +/- ##
=======================================
Coverage 79.73% 79.73%
=======================================
Files 127 127
Lines 12533 12533
=======================================
Hits 9993 9993
Misses 2540 2540
```
</details>
[:umbrella: View full report in Codecov by Harness](https://app.codecov.io/gh/apache/hudi-rs/pull/826?dropdown=coverage&src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache).
:loudspeaker: Have feedback on the report? [Share it here](https://about.codecov.io/codecov-pr-comment-feedback/?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache).
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org