You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2026/07/16 19:46:46 UTC
(datafusion) branch gh-readonly-queue/main/pr-23637-7aab4e8bd387ff7ee602bac4789523c784e042b1 created (now 26ede8643e)
This is an automated email from the ASF dual-hosted git repository.
github-merge-queue[bot] pushed a change to branch gh-readonly-queue/main/pr-23637-7aab4e8bd387ff7ee602bac4789523c784e042b1
in repository https://gitbox.apache.org/repos/asf/datafusion.git
at 26ede8643e docs: add partitioned ClickBench SQL example (#23637)
This branch includes the following new commits:
new 26ede8643e docs: add partitioned ClickBench SQL example (#23637)
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org
(datafusion) 01/01: docs: add partitioned ClickBench SQL example (#23637)
Posted by gi...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
github-merge-queue[bot] pushed a commit to branch gh-readonly-queue/main/pr-23637-7aab4e8bd387ff7ee602bac4789523c784e042b1
in repository https://gitbox.apache.org/repos/asf/datafusion.git
commit 26ede8643e7e34cade67172f69ad4848db529d8c
Author: ByteBaker <42...@users.noreply.github.com>
AuthorDate: Fri Jul 17 01:16:23 2026 +0530
docs: add partitioned ClickBench SQL example (#23637)
Continuation of #23315
> It would also help (maybe as a follow on PR) to give an explicit
example of the SQL required for `hits_partitioned`
_Originally posted by @alamb in
https://github.com/apache/datafusion/pull/23315#discussion_r3539324289_
---
benchmarks/README.md | 22 +++++++++++++++++-----
1 file changed, 17 insertions(+), 5 deletions(-)
diff --git a/benchmarks/README.md b/benchmarks/README.md
index de69875a2c..34c67e5151 100644
--- a/benchmarks/README.md
+++ b/benchmarks/README.md
@@ -507,23 +507,35 @@ The runner applies two ClickBench-specific setup steps automatically:
runner enables the parquet `binary_as_string` option so those columns
are read as strings.
-If you set up ClickBench manually through SQL, use the same `EventDate`
-view pattern:
+If you set up ClickBench manually through SQL, register the single-file
+dataset as follows:
```sql
CREATE EXTERNAL TABLE hits_raw
STORED AS PARQUET
LOCATION 'benchmarks/data/hits.parquet';
+```
+
+For the partitioned dataset, register the directory and enable
+`binary_as_string`:
+
+```sql
+CREATE EXTERNAL TABLE hits_raw
+STORED AS PARQUET
+LOCATION 'benchmarks/data/hits_partitioned'
+OPTIONS ('binary_as_string' 'true');
+```
+
+After registering either dataset as `hits_raw`, create the `hits` view with
+the required `EventDate` conversion:
+```sql
CREATE VIEW hits AS
SELECT * EXCEPT ("EventDate"),
CAST(CAST("EventDate" AS INTEGER) AS DATE) AS "EventDate"
FROM hits_raw;
```
-For the partitioned dataset, use `benchmarks/data/hits_partitioned` and
-add `OPTIONS ('binary_as_string' 'true')` to the external table statement.
-
From the repository root, download data and run the default ClickBench
queries against the single parquet file:
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org