You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2026/07/07 23:00:49 UTC
(datafusion) branch main updated: docs: document ClickBench setup details (#23315)
This is an automated email from the ASF dual-hosted git repository.
github-merge-queue[bot] pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/datafusion.git
The following commit(s) were added to refs/heads/main by this push:
new 24a7300e96 docs: document ClickBench setup details (#23315)
24a7300e96 is described below
commit 24a7300e96b14acafd0858d94de3d7a65b83d35d
Author: ByteBaker <42...@users.noreply.github.com>
AuthorDate: Wed Jul 8 04:16:41 2026 +0530
docs: document ClickBench setup details (#23315)
## Which issue does this PR close?
- Closes #20007 .
## Rationale for this change
Docs consolidation. Explained in the issue.
## What changes are included in this PR?
Only documentation.
## Are these changes tested?
N/A. No code changes.
## Are there any user-facing changes?
None. Only documentations.
## LLM-generated code disclosure
This PR includes LLM-generated content. All of which was manually
reviewed.
---
benchmarks/README.md | 43 +++++++++++++++++++++++++++++++++++++++++++
1 file changed, 43 insertions(+)
diff --git a/benchmarks/README.md b/benchmarks/README.md
index 53a43755f4..de69875a2c 100644
--- a/benchmarks/README.md
+++ b/benchmarks/README.md
@@ -496,6 +496,49 @@ The ClickBench[1] benchmarks are widely cited in the industry and
focus on grouping / aggregation / filtering. This runner uses the
scripts and queries from [2].
+The runner applies two ClickBench-specific setup steps automatically:
+
+- ClickBench stores `EventDate` as `UInt16` days since `1970-01-01`.
+ The runner registers the parquet data as `hits_raw`, then creates a
+ `hits` view that casts `EventDate` through `INTEGER` to `DATE` for the
+ benchmark queries.
+- The source partitioned ClickBench dataset stores string columns without
+ the `string` Parquet logical type annotation. For partitioned runs, the
+ runner enables the parquet `binary_as_string` option so those columns
+ are read as strings.
+
+If you set up ClickBench manually through SQL, use the same `EventDate`
+view pattern:
+
+```sql
+CREATE EXTERNAL TABLE hits_raw
+STORED AS PARQUET
+LOCATION 'benchmarks/data/hits.parquet';
+
+CREATE VIEW hits AS
+SELECT * EXCEPT ("EventDate"),
+ CAST(CAST("EventDate" AS INTEGER) AS DATE) AS "EventDate"
+FROM hits_raw;
+```
+
+For the partitioned dataset, use `benchmarks/data/hits_partitioned` and
+add `OPTIONS ('binary_as_string' 'true')` to the external table statement.
+
+From the repository root, download data and run the default ClickBench
+queries against the single parquet file:
+
+```shell
+./benchmarks/bench.sh data clickbench_1
+./benchmarks/bench.sh run clickbench_1
+```
+
+Or run against the partitioned dataset:
+
+```shell
+./benchmarks/bench.sh data clickbench_partitioned
+./benchmarks/bench.sh run clickbench_partitioned
+```
+
[1]: https://github.com/ClickHouse/ClickBench
[2]: https://github.com/ClickHouse/ClickBench/tree/main/datafusion
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org