You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "Rich-T-kid (via GitHub)" <gi...@apache.org> on 2026/09/18 22:06:45 UTC
[PR] playground [datafusion]
Rich-T-kid opened a new pull request, #25487:
URL: https://github.com/apache/datafusion/pull/25487
## Which issue does this PR close?
<!--
We generally require a GitHub issue to be filed for all bug fixes and enhancements and this helps us generate change logs for our releases. You can link an issue to this PR using the GitHub syntax. For example `Closes #123` indicates that this PR will close issue #123.
-->
- Closes #.
## Rationale for this change
<!--
Why are you proposing this change? If this is already explained clearly in the issue then this section is not needed.
Explaining clearly why changes are proposed helps reviewers understand your changes and offer better suggestions for fixes.
Please explain the problem you are trying to solve in terms of the user-visible
behavior, rather than the implementation.
For example, "The code in `foo.rs` doesn't handle nulls" is a symptom of the
implementation. "COUNT(DISTINCT) returns wrong results when the column contains
nulls" is the user-visible problem.
-->
## What changes are included in this PR?
<!--
There is no need to duplicate the description in the issue here, but it is sometimes worth providing a summary of the individual changes in this PR.
-->
## What is the testing strategy for this PR?
<!--
We typically require tests for all PRs in order to:
1. Prevent the code from being accidentally broken by subsequent changes
2. Serve as another way to document the expected behavior of the code
Briefly describe how this PR is tested, and point to the specific tests you added. For example: 'This new feature is covered by the `sqllogictest` cases added in `foo.slt`'.
If this PR does not add tests, explain why. For example, if the change is already covered by existing tests, please mention it.
You should also check the `codecov` bot reply on this PR to confirm the changed code is exercised.
-->
## Are there any user-facing changes?
<!--
If there are user-facing changes then we may require documentation to be updated before approving the PR.
If there are any breaking changes to public APIs, please add the `api change` label.
-->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5736884642
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5736766135)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (76e1f1c24138317d60fc604b72283008fad49b6a) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..76e1f1c24138317d60fc604b72283008fad49b6a)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 6.09 ms β 5.91 ms β no change β
β QQuery 2 β 81.35 ms β 81.25 ms β no change β
β QQuery 3 β 29.91 ms β 29.16 ms β no change β
β QQuery 4 β 497.35 ms β 489.48 ms β no change β
β QQuery 5 β 51.48 ms β 52.15 ms β no change β
β QQuery 6 β 36.49 ms β 37.04 ms β no change β
β QQuery 7 β 75.19 ms β 75.92 ms β no change β
β QQuery 8 β 37.32 ms β 37.96 ms β no change β
β QQuery 9 β 52.65 ms β 52.41 ms β no change β
β QQuery 10 β 62.35 ms β 62.16 ms β no change β
β QQuery 11 β 303.17 ms β 311.17 ms β no change β
β QQuery 12 β 29.25 ms β 29.41 ms β no change β
β QQuery 13 β 117.68 ms β 120.85 ms β no change β
β QQuery 14 β 397.83 ms β 403.35 ms β no change β
β QQuery 15 β 60.56 ms β 59.60 ms β no change β
β QQuery 16 β 7.10 ms β 6.89 ms β no change β
β QQuery 17 β 80.39 ms β 79.98 ms β no change β
β QQuery 18 β 107.94 ms β 107.71 ms β no change β
β QQuery 19 β 42.08 ms β 42.85 ms β no change β
β QQuery 20 β 36.50 ms β 36.37 ms β no change β
β QQuery 21 β 17.18 ms β 17.35 ms β no change β
β QQuery 22 β 65.94 ms β 68.19 ms β no change β
β QQuery 23 β 328.65 ms β 336.11 ms β no change β
β QQuery 24 β 205.24 ms β 203.03 ms β no change β
β QQuery 25 β 109.81 ms β 111.86 ms β no change β
β QQuery 26 β 49.73 ms β 48.72 ms β no change β
β QQuery 27 β 6.60 ms β 6.53 ms β no change β
β QQuery 28 β 62.65 ms β 57.55 ms β +1.09x faster β
β QQuery 29 β 98.23 ms β 97.98 ms β no change β
β QQuery 30 β 35.04 ms β 33.46 ms β no change β
β QQuery 31 β 114.14 ms β 112.93 ms β no change β
β QQuery 32 β 22.01 ms β 21.46 ms β no change β
β QQuery 33 β 38.88 ms β 38.86 ms β no change β
β QQuery 34 β 10.71 ms β 10.91 ms β no change β
β QQuery 35 β 78.61 ms β 81.53 ms β no change β
β QQuery 36 β 6.33 ms β 6.44 ms β no change β
β QQuery 37 β 7.52 ms β 7.46 ms β no change β
β QQuery 38 β 67.29 ms β 66.95 ms β no change β
β QQuery 39 β 78.71 ms β 78.30 ms β no change β
β QQuery 40 β 25.33 ms β 25.32 ms β no change β
β QQuery 41 β 11.98 ms β 12.22 ms β no change β
β QQuery 42 β 25.19 ms β 25.36 ms β no change β
β QQuery 43 β 5.58 ms β 5.79 ms β no change β
β QQuery 44 β 9.92 ms β 9.66 ms β no change β
β QQuery 45 β 44.65 ms β 42.89 ms β no change β
β QQuery 46 β 12.45 ms β 12.15 ms β no change β
β QQuery 47 β 265.60 ms β 243.64 ms β +1.09x faster β
β QQuery 48 β 99.31 ms β 97.76 ms β no change β
β QQuery 49 β 75.40 ms β 72.18 ms β no change β
β QQuery 50 β 61.22 ms β 60.90 ms β no change β
β QQuery 51 β 98.24 ms β 94.63 ms β no change β
β QQuery 52 β 25.97 ms β 24.88 ms β no change β
β QQuery 53 β 30.96 ms β 29.93 ms β no change β
β QQuery 54 β 57.90 ms β 55.24 ms β no change β
β QQuery 55 β 25.72 ms β 24.50 ms β no change β
β QQuery 56 β 41.77 ms β 40.25 ms β no change β
β QQuery 57 β 185.20 ms β 176.84 ms β no change β
β QQuery 58 β 114.90 ms β 111.15 ms β no change β
β QQuery 59 β 120.46 ms β 117.82 ms β no change β
β QQuery 60 β 40.83 ms β 39.47 ms β no change β
β QQuery 61 β 12.68 ms β 11.99 ms β +1.06x faster β
β QQuery 62 β 45.89 ms β 44.71 ms β no change β
β QQuery 63 β 30.63 ms β 30.18 ms β no change β
β QQuery 64 β 384.91 ms β 370.66 ms β no change β
β QQuery 65 β 132.97 ms β 131.17 ms β no change β
β QQuery 66 β 81.52 ms β 77.90 ms β no change β
β QQuery 67 β 282.76 ms β 267.50 ms β +1.06x faster β
β QQuery 68 β 13.03 ms β 12.47 ms β no change β
β QQuery 69 β 57.93 ms β 58.20 ms β no change β
β QQuery 70 β 105.81 ms β 109.99 ms β no change β
β QQuery 71 β 36.54 ms β 37.15 ms β no change β
β QQuery 72 β 1613.48 ms β 1975.53 ms β 1.22x slower β
β QQuery 73 β 11.27 ms β 11.72 ms β no change β
β QQuery 74 β 188.77 ms β 219.20 ms β 1.16x slower β
β QQuery 75 β 147.69 ms β 161.85 ms β 1.10x slower β
β QQuery 76 β 35.88 ms β 39.27 ms β 1.09x slower β
β QQuery 77 β 62.77 ms β 67.37 ms β 1.07x slower β
β QQuery 78 β 175.61 ms β 183.51 ms β no change β
β QQuery 79 β 69.35 ms β 74.92 ms β 1.08x slower β
β QQuery 80 β 98.23 ms β 106.99 ms β 1.09x slower β
β QQuery 81 β 27.13 ms β 29.64 ms β 1.09x slower β
β QQuery 82 β 16.98 ms β 18.40 ms β 1.08x slower β
β QQuery 83 β 34.00 ms β 36.44 ms β 1.07x slower β
β QQuery 84 β 29.94 ms β 32.50 ms β 1.09x slower β
β QQuery 85 β 103.77 ms β 112.08 ms β 1.08x slower β
β QQuery 86 β 26.46 ms β 29.49 ms β 1.11x slower β
β QQuery 87 β 67.19 ms β 73.87 ms β 1.10x slower β
β QQuery 88 β 62.72 ms β 66.05 ms β 1.05x slower β
β QQuery 89 β 36.29 ms β 38.29 ms β 1.06x slower β
β QQuery 90 β 17.34 ms β 18.64 ms β 1.07x slower β
β QQuery 91 β 46.63 ms β 49.92 ms β 1.07x slower β
β QQuery 92 β 31.66 ms β 33.15 ms β no change β
β QQuery 93 β 50.65 ms β 54.82 ms β 1.08x slower β
β QQuery 94 β 40.45 ms β 42.24 ms β no change β
β QQuery 95 β 82.13 ms β 84.58 ms β no change β
β QQuery 96 β 24.02 ms β 25.07 ms β no change β
β QQuery 97 β 51.97 ms β 55.09 ms β 1.06x slower β
β QQuery 98 β 43.44 ms β 47.80 ms β 1.10x slower β
β QQuery 99 β 66.56 ms β 69.97 ms β 1.05x slower β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 9341.62ms β
β Total Time (rich-T-kid_coacler-benchmark) β 9760.15ms β
β Average Time (HEAD) β 94.36ms β
β Average Time (rich-T-kid_coacler-benchmark) β 98.59ms β
β Queries Faster β 4 β
β Queries Slower β 22 β
β Queries with No Change β 73 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 6.09 / 6.59 Β±0.93 / 8.45 ms β 5.91 / 6.43 Β±0.91 / 8.25 ms β no change β
β QQuery 2 β 81.35 / 81.94 Β±0.49 / 82.78 ms β 81.25 / 81.92 Β±0.35 / 82.21 ms β no change β
β QQuery 3 β 29.91 / 30.28 Β±0.19 / 30.47 ms β 29.16 / 29.43 Β±0.23 / 29.74 ms β no change β
β QQuery 4 β 497.35 / 503.13 Β±6.23 / 513.23 ms β 489.48 / 515.91 Β±14.47 / 531.42 ms β no change β
β QQuery 5 β 51.48 / 52.22 Β±0.40 / 52.58 ms β 52.15 / 52.50 Β±0.29 / 53.01 ms β no change β
β QQuery 6 β 36.49 / 37.20 Β±0.40 / 37.57 ms β 37.04 / 37.62 Β±0.36 / 38.16 ms β no change β
β QQuery 7 β 75.19 / 75.83 Β±0.57 / 76.81 ms β 75.92 / 76.26 Β±0.35 / 76.89 ms β no change β
β QQuery 8 β 37.32 / 38.04 Β±1.17 / 40.34 ms β 37.96 / 40.12 Β±2.97 / 45.94 ms β 1.05x slower β
β QQuery 9 β 52.65 / 54.29 Β±0.87 / 55.20 ms β 52.41 / 54.98 Β±1.44 / 56.61 ms β no change β
β QQuery 10 β 62.35 / 62.58 Β±0.27 / 63.10 ms β 62.16 / 62.65 Β±0.47 / 63.45 ms β no change β
β QQuery 11 β 303.17 / 310.49 Β±6.32 / 320.19 ms β 311.17 / 314.79 Β±3.39 / 320.38 ms β no change β
β QQuery 12 β 29.25 / 29.53 Β±0.21 / 29.78 ms β 29.41 / 29.81 Β±0.46 / 30.57 ms β no change β
β QQuery 13 β 117.68 / 119.09 Β±1.01 / 120.26 ms β 120.85 / 122.18 Β±1.27 / 124.58 ms β no change β
β QQuery 14 β 397.83 / 400.11 Β±1.99 / 403.49 ms β 403.35 / 407.18 Β±2.38 / 410.46 ms β no change β
β QQuery 15 β 60.56 / 61.91 Β±1.41 / 64.44 ms β 59.60 / 60.25 Β±0.68 / 61.50 ms β no change β
β QQuery 16 β 7.10 / 7.25 Β±0.09 / 7.35 ms β 6.89 / 7.02 Β±0.11 / 7.18 ms β no change β
β QQuery 17 β 80.39 / 82.53 Β±1.97 / 85.27 ms β 79.98 / 81.42 Β±2.39 / 86.19 ms β no change β
β QQuery 18 β 107.94 / 109.10 Β±0.76 / 109.86 ms β 107.71 / 110.48 Β±1.46 / 112.02 ms β no change β
β QQuery 19 β 42.08 / 42.96 Β±0.80 / 44.46 ms β 42.85 / 43.58 Β±0.52 / 44.47 ms β no change β
β QQuery 20 β 36.50 / 37.03 Β±0.34 / 37.53 ms β 36.37 / 37.92 Β±1.00 / 39.39 ms β no change β
β QQuery 21 β 17.18 / 17.91 Β±0.69 / 19.23 ms β 17.35 / 17.73 Β±0.21 / 17.91 ms β no change β
β QQuery 22 β 65.94 / 66.94 Β±0.62 / 67.66 ms β 68.19 / 69.66 Β±1.04 / 71.40 ms β no change β
β QQuery 23 β 328.65 / 332.83 Β±4.93 / 342.20 ms β 336.11 / 344.87 Β±8.45 / 360.72 ms β no change β
β QQuery 24 β 205.24 / 208.71 Β±3.50 / 215.11 ms β 203.03 / 209.79 Β±6.85 / 222.61 ms β no change β
β QQuery 25 β 109.81 / 110.65 Β±1.16 / 112.89 ms β 111.86 / 115.41 Β±4.56 / 124.24 ms β no change β
β QQuery 26 β 49.73 / 50.03 Β±0.23 / 50.37 ms β 48.72 / 50.91 Β±3.30 / 57.49 ms β no change β
β QQuery 27 β 6.60 / 6.74 Β±0.17 / 6.95 ms β 6.53 / 6.62 Β±0.14 / 6.89 ms β no change β
β QQuery 28 β 62.65 / 63.25 Β±0.46 / 63.88 ms β 57.55 / 60.59 Β±2.27 / 63.11 ms β no change β
β QQuery 29 β 98.23 / 101.08 Β±3.04 / 106.66 ms β 97.98 / 99.51 Β±1.78 / 102.66 ms β no change β
β QQuery 30 β 35.04 / 35.31 Β±0.18 / 35.49 ms β 33.46 / 35.10 Β±2.27 / 39.57 ms β no change β
β QQuery 31 β 114.14 / 116.39 Β±3.33 / 123.00 ms β 112.93 / 113.70 Β±0.53 / 114.42 ms β no change β
β QQuery 32 β 22.01 / 22.38 Β±0.25 / 22.68 ms β 21.46 / 21.81 Β±0.34 / 22.41 ms β no change β
β QQuery 33 β 38.88 / 39.24 Β±0.26 / 39.64 ms β 38.86 / 39.22 Β±0.32 / 39.77 ms β no change β
β QQuery 34 β 10.71 / 10.89 Β±0.18 / 11.22 ms β 10.91 / 11.10 Β±0.15 / 11.30 ms β no change β
β QQuery 35 β 78.61 / 80.50 Β±2.24 / 84.77 ms β 81.53 / 83.45 Β±1.84 / 85.78 ms β no change β
β QQuery 36 β 6.33 / 6.48 Β±0.14 / 6.66 ms β 6.44 / 6.56 Β±0.08 / 6.67 ms β no change β
β QQuery 37 β 7.52 / 7.61 Β±0.07 / 7.72 ms β 7.46 / 7.60 Β±0.20 / 8.00 ms β no change β
β QQuery 38 β 67.29 / 67.77 Β±0.40 / 68.45 ms β 66.95 / 67.61 Β±0.44 / 68.30 ms β no change β
β QQuery 39 β 78.71 / 80.17 Β±1.26 / 81.73 ms β 78.30 / 79.20 Β±1.16 / 81.44 ms β no change β
β QQuery 40 β 25.33 / 26.36 Β±0.60 / 27.03 ms β 25.32 / 26.70 Β±1.17 / 28.47 ms β no change β
β QQuery 41 β 11.98 / 12.14 Β±0.10 / 12.27 ms β 12.22 / 12.44 Β±0.15 / 12.65 ms β no change β
β QQuery 42 β 25.19 / 25.64 Β±0.36 / 26.15 ms β 25.36 / 25.90 Β±0.61 / 27.09 ms β no change β
β QQuery 43 β 5.58 / 5.68 Β±0.14 / 5.95 ms β 5.79 / 5.92 Β±0.12 / 6.12 ms β no change β
β QQuery 44 β 9.92 / 9.99 Β±0.06 / 10.06 ms β 9.66 / 10.02 Β±0.26 / 10.31 ms β no change β
β QQuery 45 β 44.65 / 45.40 Β±0.62 / 46.21 ms β 42.89 / 44.20 Β±0.87 / 45.39 ms β no change β
β QQuery 46 β 12.45 / 12.85 Β±0.40 / 13.60 ms β 12.15 / 12.58 Β±0.45 / 13.42 ms β no change β
β QQuery 47 β 265.60 / 278.37 Β±9.40 / 291.55 ms β 243.64 / 259.18 Β±9.64 / 271.74 ms β +1.07x faster β
β QQuery 48 β 99.31 / 100.56 Β±0.63 / 100.97 ms β 97.76 / 99.36 Β±1.06 / 101.06 ms β no change β
β QQuery 49 β 75.40 / 77.37 Β±1.31 / 78.73 ms β 72.18 / 72.70 Β±0.40 / 73.40 ms β +1.06x faster β
β QQuery 50 β 61.22 / 62.50 Β±0.87 / 63.94 ms β 60.90 / 63.98 Β±4.41 / 72.51 ms β no change β
β QQuery 51 β 98.24 / 99.39 Β±1.56 / 102.48 ms β 94.63 / 98.21 Β±2.94 / 103.59 ms β no change β
β QQuery 52 β 25.97 / 26.61 Β±0.73 / 28.03 ms β 24.88 / 25.67 Β±1.14 / 27.94 ms β no change β
β QQuery 53 β 30.96 / 33.08 Β±3.40 / 39.84 ms β 29.93 / 32.65 Β±4.70 / 42.03 ms β no change β
β QQuery 54 β 57.90 / 58.43 Β±0.36 / 58.93 ms β 55.24 / 56.45 Β±0.79 / 57.35 ms β no change β
β QQuery 55 β 25.72 / 26.56 Β±0.70 / 27.59 ms β 24.50 / 25.45 Β±0.75 / 26.21 ms β no change β
β QQuery 56 β 41.77 / 42.42 Β±0.51 / 43.34 ms β 40.25 / 40.40 Β±0.14 / 40.65 ms β no change β
β QQuery 57 β 185.20 / 189.36 Β±4.54 / 197.71 ms β 176.84 / 179.78 Β±2.45 / 183.10 ms β +1.05x faster β
β QQuery 58 β 114.90 / 116.95 Β±2.92 / 122.68 ms β 111.15 / 114.60 Β±3.12 / 120.37 ms β no change β
β QQuery 59 β 120.46 / 120.58 Β±0.10 / 120.71 ms β 117.82 / 119.15 Β±1.13 / 120.93 ms β no change β
β QQuery 60 β 40.83 / 42.84 Β±2.90 / 48.56 ms β 39.47 / 40.06 Β±0.36 / 40.46 ms β +1.07x faster β
β QQuery 61 β 12.68 / 12.86 Β±0.15 / 13.05 ms β 11.99 / 13.69 Β±3.08 / 19.85 ms β 1.06x slower β
β QQuery 62 β 45.89 / 46.66 Β±0.65 / 47.78 ms β 44.71 / 45.78 Β±1.34 / 48.40 ms β no change β
β QQuery 63 β 30.63 / 31.00 Β±0.28 / 31.36 ms β 30.18 / 30.56 Β±0.42 / 31.33 ms β no change β
β QQuery 64 β 384.91 / 388.32 Β±4.26 / 395.81 ms β 370.66 / 378.39 Β±4.92 / 384.92 ms β no change β
β QQuery 65 β 132.97 / 137.79 Β±3.80 / 143.46 ms β 131.17 / 132.83 Β±1.47 / 134.94 ms β no change β
β QQuery 66 β 81.52 / 81.84 Β±0.30 / 82.38 ms β 77.90 / 81.45 Β±3.67 / 88.17 ms β no change β
β QQuery 67 β 282.76 / 286.08 Β±3.95 / 293.63 ms β 267.50 / 270.75 Β±3.25 / 275.93 ms β +1.06x faster β
β QQuery 68 β 13.03 / 13.46 Β±0.29 / 13.80 ms β 12.47 / 12.70 Β±0.14 / 12.87 ms β +1.06x faster β
β QQuery 69 β 57.93 / 58.66 Β±0.56 / 59.34 ms β 58.20 / 60.52 Β±3.25 / 66.89 ms β no change β
β QQuery 70 β 105.81 / 108.13 Β±2.92 / 113.87 ms β 109.99 / 110.94 Β±0.73 / 111.72 ms β no change β
β QQuery 71 β 36.54 / 36.89 Β±0.35 / 37.49 ms β 37.15 / 37.98 Β±0.48 / 38.46 ms β no change β
β QQuery 72 β 1613.48 / 1759.91 Β±160.45 / 2015.58 ms β 1975.53 / 2098.98 Β±104.41 / 2228.62 ms β 1.19x slower β
β QQuery 73 β 11.27 / 11.50 Β±0.16 / 11.70 ms β 11.72 / 12.29 Β±0.36 / 12.82 ms β 1.07x slower β
β QQuery 74 β 188.77 / 197.50 Β±7.45 / 208.94 ms β 219.20 / 226.54 Β±5.12 / 231.87 ms β 1.15x slower β
β QQuery 75 β 147.69 / 149.85 Β±2.09 / 152.53 ms β 161.85 / 165.04 Β±4.28 / 173.37 ms β 1.10x slower β
β QQuery 76 β 35.88 / 36.42 Β±0.41 / 36.94 ms β 39.27 / 40.37 Β±0.59 / 40.86 ms β 1.11x slower β
β QQuery 77 β 62.77 / 65.62 Β±3.92 / 73.26 ms β 67.37 / 67.95 Β±0.54 / 68.68 ms β no change β
β QQuery 78 β 175.61 / 181.89 Β±5.96 / 191.55 ms β 183.51 / 192.25 Β±5.94 / 202.20 ms β 1.06x slower β
β QQuery 79 β 69.35 / 70.54 Β±0.68 / 71.25 ms β 74.92 / 78.70 Β±6.09 / 90.82 ms β 1.12x slower β
β QQuery 80 β 98.23 / 99.98 Β±1.05 / 101.39 ms β 106.99 / 109.64 Β±2.53 / 113.60 ms β 1.10x slower β
β QQuery 81 β 27.13 / 29.61 Β±3.01 / 34.67 ms β 29.64 / 30.22 Β±0.43 / 30.92 ms β no change β
β QQuery 82 β 16.98 / 17.42 Β±0.28 / 17.86 ms β 18.40 / 19.30 Β±1.28 / 21.80 ms β 1.11x slower β
β QQuery 83 β 34.00 / 34.23 Β±0.12 / 34.32 ms β 36.44 / 41.78 Β±7.22 / 56.00 ms β 1.22x slower β
β QQuery 84 β 29.94 / 30.28 Β±0.20 / 30.50 ms β 32.50 / 33.43 Β±1.23 / 35.79 ms β 1.10x slower β
β QQuery 85 β 103.77 / 105.47 Β±1.97 / 109.33 ms β 112.08 / 113.39 Β±1.15 / 115.38 ms β 1.08x slower β
β QQuery 86 β 26.46 / 28.27 Β±2.39 / 32.98 ms β 29.49 / 32.07 Β±4.13 / 40.29 ms β 1.13x slower β
β QQuery 87 β 67.19 / 67.86 Β±0.52 / 68.70 ms β 73.87 / 74.62 Β±1.06 / 76.72 ms β 1.10x slower β
β QQuery 88 β 62.72 / 63.04 Β±0.35 / 63.66 ms β 66.05 / 66.62 Β±0.36 / 67.15 ms β 1.06x slower β
β QQuery 89 β 36.29 / 36.69 Β±0.32 / 37.12 ms β 38.29 / 38.88 Β±0.34 / 39.23 ms β 1.06x slower β
β QQuery 90 β 17.34 / 17.93 Β±0.56 / 18.91 ms β 18.64 / 21.49 Β±5.19 / 31.87 ms β 1.20x slower β
β QQuery 91 β 46.63 / 47.36 Β±0.50 / 48.20 ms β 49.92 / 51.01 Β±1.68 / 54.32 ms β 1.08x slower β
β QQuery 92 β 31.66 / 32.83 Β±1.21 / 35.06 ms β 33.15 / 34.65 Β±0.98 / 35.89 ms β 1.06x slower β
β QQuery 93 β 50.65 / 52.56 Β±1.60 / 55.46 ms β 54.82 / 55.35 Β±0.47 / 55.98 ms β 1.05x slower β
β QQuery 94 β 40.45 / 41.01 Β±0.31 / 41.38 ms β 42.24 / 43.08 Β±0.57 / 43.97 ms β 1.05x slower β
β QQuery 95 β 82.13 / 83.95 Β±1.57 / 86.05 ms β 84.58 / 87.77 Β±3.42 / 94.37 ms β no change β
β QQuery 96 β 24.02 / 24.30 Β±0.40 / 25.08 ms β 25.07 / 25.28 Β±0.11 / 25.38 ms β no change β
β QQuery 97 β 51.97 / 52.66 Β±0.97 / 54.57 ms β 55.09 / 58.06 Β±2.11 / 60.79 ms β 1.10x slower β
β QQuery 98 β 43.44 / 43.72 Β±0.17 / 43.92 ms β 47.80 / 49.33 Β±1.77 / 52.75 ms β 1.13x slower β
β QQuery 99 β 66.56 / 68.30 Β±2.72 / 73.72 ms β 69.97 / 70.64 Β±0.54 / 71.59 ms β no change β
βββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 9632.42ms β
β Total Time (rich-T-kid_coacler-benchmark) β 10092.64ms β
β Average Time (HEAD) β 97.30ms β
β Average Time (rich-T-kid_coacler-benchmark) β 101.95ms β
β Queries Faster β 6 β
β Queries Slower β 25 β
β Queries with No Change β 68 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpcds β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 50.0s |
| Peak memory | 2.3 GiB |
| Avg memory | 1.6 GiB |
| CPU user | 202.8s |
| CPU sys | 6.3s |
| Peak spill | 0 B |
**tpcds β branch**
| Metric | Value |
|--------|-------|
| Wall time | 55.0s |
| Peak memory | 2.2 GiB |
| Avg memory | 1.4 GiB |
| CPU user | 225.9s |
| CPU sys | 7.0s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5736872976
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5736766800)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (76e1f1c24138317d60fc604b72283008fad49b6a) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..76e1f1c24138317d60fc604b72283008fad49b6a)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββ³βββββββββββββββββββββββββββββββ³βββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 43.37 ms β 43.39 ms β no change β
β QQuery 2 β 20.13 ms β 20.54 ms β no change β
β QQuery 3 β 31.17 ms β 31.60 ms β no change β
β QQuery 4 β 18.77 ms β 19.20 ms β no change β
β QQuery 5 β 39.79 ms β 40.94 ms β no change β
β QQuery 6 β 17.89 ms β 18.12 ms β no change β
β QQuery 7 β 47.92 ms β 48.56 ms β no change β
β QQuery 8 β 44.66 ms β 45.48 ms β no change β
β QQuery 9 β 56.08 ms β 56.79 ms β no change β
β QQuery 10 β 46.66 ms β 46.05 ms β no change β
β QQuery 11 β 15.64 ms β 15.64 ms β no change β
β QQuery 12 β 23.46 ms β 23.58 ms β no change β
β QQuery 13 β 49.31 ms β 49.18 ms β no change β
β QQuery 14 β 27.49 ms β 26.90 ms β no change β
β QQuery 15 β 34.59 ms β 34.48 ms β no change β
β QQuery 16 β 15.63 ms β 15.28 ms β no change β
β QQuery 17 β 90.74 ms β 87.06 ms β no change β
β QQuery 18 β 69.08 ms β 72.65 ms β 1.05x slower β
β QQuery 19 β 35.04 ms β 34.04 ms β no change β
β QQuery 20 β 34.79 ms β 34.23 ms β no change β
β QQuery 21 β 63.79 ms β 61.80 ms β no change β
β QQuery 22 β 15.46 ms β 15.80 ms β no change β
βββββββββββββ΄βββββββββββ΄βββββββββββββββββββββββββββββββ΄βββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 841.47ms β
β Total Time (rich-T-kid_coacler-benchmark) β 841.28ms β
β Average Time (HEAD) β 38.25ms β
β Average Time (rich-T-kid_coacler-benchmark) β 38.24ms β
β Queries Faster β 0 β
β Queries Slower β 1 β
β Queries with No Change β 21 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββ³ββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 43.37 / 44.75 Β±1.26 / 46.63 ms β 43.39 / 45.03 Β±1.20 / 46.57 ms β no change β
β QQuery 2 β 20.13 / 20.81 Β±0.76 / 22.24 ms β 20.54 / 20.79 Β±0.26 / 21.19 ms β no change β
β QQuery 3 β 31.17 / 31.88 Β±1.04 / 33.93 ms β 31.60 / 31.88 Β±0.17 / 32.06 ms β no change β
β QQuery 4 β 18.77 / 19.22 Β±0.36 / 19.83 ms β 19.20 / 19.39 Β±0.17 / 19.68 ms β no change β
β QQuery 5 β 39.79 / 40.39 Β±0.35 / 40.82 ms β 40.94 / 41.70 Β±0.52 / 42.27 ms β no change β
β QQuery 6 β 17.89 / 18.11 Β±0.14 / 18.28 ms β 18.12 / 18.34 Β±0.15 / 18.57 ms β no change β
β QQuery 7 β 47.92 / 50.41 Β±1.56 / 51.73 ms β 48.56 / 51.87 Β±2.25 / 54.75 ms β no change β
β QQuery 8 β 44.66 / 45.05 Β±0.35 / 45.63 ms β 45.48 / 45.95 Β±0.37 / 46.55 ms β no change β
β QQuery 9 β 56.08 / 57.33 Β±0.92 / 58.46 ms β 56.79 / 58.15 Β±0.95 / 59.29 ms β no change β
β QQuery 10 β 46.66 / 48.12 Β±1.43 / 50.04 ms β 46.05 / 46.58 Β±0.37 / 47.18 ms β no change β
β QQuery 11 β 15.64 / 15.93 Β±0.24 / 16.38 ms β 15.64 / 15.71 Β±0.06 / 15.81 ms β no change β
β QQuery 12 β 23.46 / 24.28 Β±1.12 / 26.46 ms β 23.58 / 24.62 Β±1.04 / 26.57 ms β no change β
β QQuery 13 β 49.31 / 50.92 Β±1.49 / 53.34 ms β 49.18 / 49.61 Β±0.36 / 50.14 ms β no change β
β QQuery 14 β 27.49 / 28.10 Β±0.67 / 29.17 ms β 26.90 / 28.04 Β±1.41 / 30.80 ms β no change β
β QQuery 15 β 34.59 / 34.81 Β±0.21 / 35.13 ms β 34.48 / 35.17 Β±0.77 / 36.60 ms β no change β
β QQuery 16 β 15.63 / 15.76 Β±0.11 / 15.90 ms β 15.28 / 15.72 Β±0.63 / 16.97 ms β no change β
β QQuery 17 β 90.74 / 93.02 Β±1.40 / 94.55 ms β 87.06 / 88.98 Β±1.86 / 92.23 ms β no change β
β QQuery 18 β 69.08 / 71.82 Β±1.58 / 73.76 ms β 72.65 / 75.21 Β±1.46 / 76.99 ms β no change β
β QQuery 19 β 35.04 / 35.68 Β±0.82 / 37.29 ms β 34.04 / 34.66 Β±0.85 / 36.32 ms β no change β
β QQuery 20 β 34.79 / 35.67 Β±0.73 / 36.98 ms β 34.23 / 34.58 Β±0.27 / 34.97 ms β no change β
β QQuery 21 β 63.79 / 65.83 Β±2.45 / 70.53 ms β 61.80 / 63.53 Β±1.60 / 66.30 ms β no change β
β QQuery 22 β 15.46 / 15.72 Β±0.30 / 16.30 ms β 15.80 / 16.08 Β±0.16 / 16.26 ms β no change β
βββββββββββββ΄βββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββ΄ββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 863.58ms β
β Total Time (rich-T-kid_coacler-benchmark) β 861.58ms β
β Average Time (HEAD) β 39.25ms β
β Average Time (rich-T-kid_coacler-benchmark) β 39.16ms β
β Queries Faster β 0 β
β Queries Slower β 0 β
β Queries with No Change β 22 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpch β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 5.0s |
| Peak memory | 1.1 GiB |
| Avg memory | 645.4 MiB |
| CPU user | 23.0s |
| CPU sys | 2.1s |
| Peak spill | 0 B |
**tpch β branch**
| Metric | Value |
|--------|-------|
| Wall time | 5.0s |
| Peak memory | 1.0 GiB |
| Avg memory | 635.3 MiB |
| CPU user | 23.3s |
| CPU sys | 2.2s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739446263
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739397449)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5739397449-2470-vtqlf 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739452572
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739398003)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5739398003-2474-2phwj 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739492372
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739398003)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.35 ms β 1.45 ms β 1.07x slower β
β QQuery 1 β 12.25 ms β 11.83 ms β no change β
β QQuery 2 β 38.12 ms β 37.93 ms β no change β
β QQuery 3 β 33.68 ms β 32.76 ms β no change β
β QQuery 4 β 280.62 ms β 234.28 ms β +1.20x faster β
β QQuery 5 β 273.43 ms β 276.37 ms β no change β
β QQuery 6 β 1.37 ms β 1.28 ms β +1.07x faster β
β QQuery 7 β 13.45 ms β 13.00 ms β no change β
β QQuery 8 β 328.47 ms β 337.36 ms β no change β
β QQuery 9 β 463.13 ms β 467.88 ms β no change β
β QQuery 10 β 64.06 ms β 64.17 ms β no change β
β QQuery 11 β 74.92 ms β 74.33 ms β no change β
β QQuery 12 β 261.57 ms β 265.50 ms β no change β
β QQuery 13 β 359.37 ms β 357.50 ms β no change β
β QQuery 14 β 282.43 ms β 277.68 ms β no change β
β QQuery 15 β 279.75 ms β 285.55 ms β no change β
β QQuery 16 β 624.92 ms β 619.01 ms β no change β
β QQuery 17 β 617.43 ms β 716.02 ms β 1.16x slower β
β QQuery 18 β 1253.24 ms β 1285.44 ms β no change β
β QQuery 19 β 27.19 ms β 27.63 ms β no change β
β QQuery 20 β 520.23 ms β 519.31 ms β no change β
β QQuery 21 β 503.92 ms β 512.99 ms β no change β
β QQuery 22 β 981.78 ms β 966.19 ms β no change β
β QQuery 23 β 3049.34 ms β 3048.02 ms β no change β
β QQuery 24 β 40.43 ms β 40.80 ms β no change β
β QQuery 25 β 104.97 ms β 104.13 ms β no change β
β QQuery 26 β 40.57 ms β 40.32 ms β no change β
β QQuery 27 β 505.68 ms β 511.03 ms β no change β
β QQuery 28 β 2908.12 ms β 2897.60 ms β no change β
β QQuery 29 β 43.65 ms β 41.83 ms β no change β
β QQuery 30 β 304.75 ms β 312.52 ms β no change β
β QQuery 31 β 277.51 ms β 280.03 ms β no change β
β QQuery 32 β 953.94 ms β 1081.67 ms β 1.13x slower β
β QQuery 33 β 1457.47 ms β 1475.53 ms β no change β
β QQuery 34 β 1453.93 ms β 1526.53 ms β no change β
β QQuery 35 β 292.92 ms β 297.55 ms β no change β
β QQuery 36 β 65.23 ms β 71.46 ms β 1.10x slower β
β QQuery 37 β 35.99 ms β 35.92 ms β no change β
β QQuery 38 β 42.31 ms β 41.30 ms β no change β
β QQuery 39 β 147.63 ms β 157.73 ms β 1.07x slower β
β QQuery 40 β 13.92 ms β 14.23 ms β no change β
β QQuery 41 β 13.57 ms β 13.81 ms β no change β
β QQuery 42 β 13.06 ms β 13.29 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 19061.67ms β
β Total Time (rich-T-kid_coacler-benchmark) β 19390.75ms β
β Average Time (HEAD) β 443.29ms β
β Average Time (rich-T-kid_coacler-benchmark) β 450.95ms β
β Queries Faster β 2 β
β Queries Slower β 5 β
β Queries with No Change β 36 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.35 / 4.46 Β±5.97 / 16.39 ms β 1.45 / 4.47 Β±5.76 / 15.99 ms β no change β
β QQuery 1 β 12.25 / 12.57 Β±0.22 / 12.80 ms β 11.83 / 12.33 Β±0.36 / 12.85 ms β no change β
β QQuery 2 β 38.12 / 38.39 Β±0.21 / 38.75 ms β 37.93 / 38.29 Β±0.31 / 38.84 ms β no change β
β QQuery 3 β 33.68 / 33.97 Β±0.30 / 34.54 ms β 32.76 / 33.37 Β±0.43 / 33.95 ms β no change β
β QQuery 4 β 280.62 / 285.52 Β±3.32 / 290.43 ms β 234.28 / 248.07 Β±16.71 / 275.15 ms β +1.15x faster β
β QQuery 5 β 273.43 / 275.25 Β±1.34 / 277.03 ms β 276.37 / 277.51 Β±1.06 / 279.41 ms β no change β
β QQuery 6 β 1.37 / 1.54 Β±0.24 / 2.00 ms β 1.28 / 1.44 Β±0.24 / 1.90 ms β +1.07x faster β
β QQuery 7 β 13.45 / 13.78 Β±0.26 / 14.05 ms β 13.00 / 14.95 Β±3.79 / 22.54 ms β 1.09x slower β
β QQuery 8 β 328.47 / 334.80 Β±4.77 / 341.55 ms β 337.36 / 341.81 Β±5.13 / 350.34 ms β no change β
β QQuery 9 β 463.13 / 479.21 Β±16.79 / 510.00 ms β 467.88 / 474.21 Β±9.06 / 492.09 ms β no change β
β QQuery 10 β 64.06 / 66.07 Β±1.81 / 68.99 ms β 64.17 / 69.40 Β±8.90 / 87.13 ms β 1.05x slower β
β QQuery 11 β 74.92 / 75.28 Β±0.40 / 75.96 ms β 74.33 / 75.20 Β±0.85 / 76.65 ms β no change β
β QQuery 12 β 261.57 / 262.67 Β±1.24 / 264.79 ms β 265.50 / 273.18 Β±10.62 / 293.65 ms β no change β
β QQuery 13 β 359.37 / 386.05 Β±22.54 / 419.70 ms β 357.50 / 373.64 Β±11.73 / 392.95 ms β no change β
β QQuery 14 β 282.43 / 298.73 Β±13.21 / 315.72 ms β 277.68 / 292.60 Β±18.01 / 327.18 ms β no change β
β QQuery 15 β 279.75 / 297.29 Β±13.01 / 315.80 ms β 285.55 / 301.99 Β±17.68 / 334.48 ms β no change β
β QQuery 16 β 624.92 / 626.62 Β±1.27 / 628.80 ms β 619.01 / 685.72 Β±54.25 / 754.30 ms β 1.09x slower β
β QQuery 17 β 617.43 / 624.45 Β±5.73 / 633.69 ms β 716.02 / 725.61 Β±6.54 / 734.06 ms β 1.16x slower β
β QQuery 18 β 1253.24 / 1319.83 Β±57.33 / 1405.56 ms β 1285.44 / 1352.95 Β±56.40 / 1448.84 ms β no change β
β QQuery 19 β 27.19 / 27.60 Β±0.28 / 27.99 ms β 27.63 / 30.06 Β±4.63 / 39.32 ms β 1.09x slower β
β QQuery 20 β 520.23 / 529.69 Β±14.00 / 557.48 ms β 519.31 / 528.03 Β±6.87 / 538.41 ms β no change β
β QQuery 21 β 503.92 / 508.17 Β±3.29 / 512.30 ms β 512.99 / 524.83 Β±11.71 / 541.11 ms β no change β
β QQuery 22 β 981.78 / 988.81 Β±6.56 / 1001.13 ms β 966.19 / 985.15 Β±12.89 / 999.93 ms β no change β
β QQuery 23 β 3049.34 / 3097.19 Β±45.79 / 3180.44 ms β 3048.02 / 3108.96 Β±48.46 / 3187.09 ms β no change β
β QQuery 24 β 40.43 / 42.82 Β±3.61 / 49.96 ms β 40.80 / 45.46 Β±6.58 / 58.44 ms β 1.06x slower β
β QQuery 25 β 104.97 / 106.26 Β±1.06 / 107.82 ms β 104.13 / 104.88 Β±0.68 / 106.10 ms β no change β
β QQuery 26 β 40.57 / 41.28 Β±0.70 / 42.55 ms β 40.32 / 41.43 Β±1.18 / 43.60 ms β no change β
β QQuery 27 β 505.68 / 523.95 Β±15.71 / 546.31 ms β 511.03 / 519.28 Β±10.22 / 539.10 ms β no change β
β QQuery 28 β 2908.12 / 2984.23 Β±72.82 / 3080.15 ms β 2897.60 / 2936.00 Β±24.00 / 2961.38 ms β no change β
β QQuery 29 β 43.65 / 44.10 Β±0.59 / 45.24 ms β 41.83 / 51.54 Β±8.39 / 61.34 ms β 1.17x slower β
β QQuery 30 β 304.75 / 324.39 Β±15.87 / 351.44 ms β 312.52 / 329.83 Β±24.75 / 378.79 ms β no change β
β QQuery 31 β 277.51 / 292.48 Β±11.79 / 313.04 ms β 280.03 / 289.48 Β±10.02 / 308.17 ms β no change β
β QQuery 32 β 953.94 / 997.29 Β±30.24 / 1046.85 ms β 1081.67 / 1105.33 Β±13.65 / 1120.36 ms β 1.11x slower β
β QQuery 33 β 1457.47 / 1520.65 Β±53.04 / 1618.77 ms β 1475.53 / 1588.85 Β±93.91 / 1737.70 ms β no change β
β QQuery 34 β 1453.93 / 1498.86 Β±26.40 / 1527.87 ms β 1526.53 / 1571.69 Β±52.21 / 1665.94 ms β no change β
β QQuery 35 β 292.92 / 354.90 Β±110.02 / 574.38 ms β 297.55 / 333.89 Β±42.93 / 410.92 ms β +1.06x faster β
β QQuery 36 β 65.23 / 71.50 Β±7.05 / 84.88 ms β 71.46 / 77.04 Β±4.77 / 85.65 ms β 1.08x slower β
β QQuery 37 β 35.99 / 42.87 Β±5.80 / 50.78 ms β 35.92 / 36.37 Β±0.66 / 37.66 ms β +1.18x faster β
β QQuery 38 β 42.31 / 47.68 Β±5.21 / 55.85 ms β 41.30 / 44.32 Β±2.36 / 47.47 ms β +1.08x faster β
β QQuery 39 β 147.63 / 154.92 Β±6.46 / 164.74 ms β 157.73 / 161.51 Β±4.23 / 166.76 ms β no change β
β QQuery 40 β 13.92 / 16.64 Β±3.28 / 23.05 ms β 14.23 / 14.41 Β±0.16 / 14.63 ms β +1.16x faster β
β QQuery 41 β 13.57 / 14.04 Β±0.54 / 15.06 ms β 13.81 / 16.71 Β±4.09 / 24.52 ms β 1.19x slower β
β QQuery 42 β 13.06 / 18.91 Β±10.65 / 40.20 ms β 13.29 / 14.44 Β±1.67 / 17.77 ms β +1.31x faster β
βββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 19685.71ms β
β Total Time (rich-T-kid_coacler-benchmark) β 20056.21ms β
β Average Time (HEAD) β 457.81ms β
β Average Time (rich-T-kid_coacler-benchmark) β 466.42ms β
β Queries Faster β 7 β
β Queries Slower β 10 β
β Queries with No Change β 26 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**clickbench_partitioned β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 100.0s |
| Peak memory | 12.4 GiB |
| Avg memory | 4.9 GiB |
| CPU user | 1008.3s |
| CPU sys | 70.1s |
| Peak spill | 0 B |
**clickbench_partitioned β branch**
| Metric | Value |
|--------|-------|
| Wall time | 105.0s |
| Peak memory | 12.0 GiB |
| Avg memory | 4.6 GiB |
| CPU user | 1019.1s |
| CPU sys | 75.5s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5736785788
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5736766135)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5736766135-2458-czh5t 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (76e1f1c24138317d60fc604b72283008fad49b6a) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..76e1f1c24138317d60fc604b72283008fad49b6a)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745474845
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745457778)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5745457778-2505-kr9lg 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745563700
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745546566)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5745546566-2507-wdg4p 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739826990
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739768986)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (dbfc4e87e81f5ae40f150fa37700863a165cd991) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..dbfc4e87e81f5ae40f150fa37700863a165cd991)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.28 ms β 1.24 ms β no change β
β QQuery 1 β 11.84 ms β 11.85 ms β no change β
β QQuery 2 β 37.13 ms β 36.86 ms β no change β
β QQuery 3 β 31.40 ms β 31.42 ms β no change β
β QQuery 4 β 242.32 ms β 235.32 ms β no change β
β QQuery 5 β 275.61 ms β 277.27 ms β no change β
β QQuery 6 β 1.29 ms β 1.31 ms β no change β
β QQuery 7 β 12.96 ms β 13.10 ms β no change β
β QQuery 8 β 332.76 ms β 328.57 ms β no change β
β QQuery 9 β 464.33 ms β 459.83 ms β no change β
β QQuery 10 β 64.69 ms β 64.08 ms β no change β
β QQuery 11 β 75.72 ms β 75.10 ms β no change β
β QQuery 12 β 271.40 ms β 260.75 ms β no change β
β QQuery 13 β 366.10 ms β 356.35 ms β no change β
β QQuery 14 β 286.54 ms β 276.82 ms β no change β
β QQuery 15 β 281.71 ms β 284.23 ms β no change β
β QQuery 16 β 623.72 ms β 615.28 ms β no change β
β QQuery 17 β 615.15 ms β 627.10 ms β no change β
β QQuery 18 β 1281.64 ms β 1257.35 ms β no change β
β QQuery 19 β 29.97 ms β 27.70 ms β +1.08x faster β
β QQuery 20 β 516.42 ms β 519.08 ms β no change β
β QQuery 21 β 505.68 ms β 506.25 ms β no change β
β QQuery 22 β 967.33 ms β 978.46 ms β no change β
β QQuery 23 β 3043.94 ms β 3057.22 ms β no change β
β QQuery 24 β 40.36 ms β 40.47 ms β no change β
β QQuery 25 β 104.01 ms β 103.67 ms β no change β
β QQuery 26 β 40.38 ms β 40.36 ms β no change β
β QQuery 27 β 511.86 ms β 517.73 ms β no change β
β QQuery 28 β 2901.82 ms β 2873.88 ms β no change β
β QQuery 29 β 41.94 ms β 42.04 ms β no change β
β QQuery 30 β 306.22 ms β 308.10 ms β no change β
β QQuery 31 β 274.47 ms β 274.60 ms β no change β
β QQuery 32 β 957.32 ms β 914.52 ms β no change β
β QQuery 33 β 1453.46 ms β 1417.00 ms β no change β
β QQuery 34 β 1471.02 ms β 1455.64 ms β no change β
β QQuery 35 β 294.87 ms β 281.67 ms β no change β
β QQuery 36 β 66.96 ms β 65.72 ms β no change β
β QQuery 37 β 35.50 ms β 35.15 ms β no change β
β QQuery 38 β 40.82 ms β 42.05 ms β no change β
β QQuery 39 β 144.43 ms β 135.21 ms β +1.07x faster β
β QQuery 40 β 14.17 ms β 14.40 ms β no change β
β QQuery 41 β 13.92 ms β 13.68 ms β no change β
β QQuery 42 β 13.48 ms β 13.24 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 19067.90ms β
β Total Time (rich-T-kid_coacler-benchmark) β 18891.67ms β
β Average Time (HEAD) β 443.44ms β
β Average Time (rich-T-kid_coacler-benchmark) β 439.34ms β
β Queries Faster β 2 β
β Queries Slower β 0 β
β Queries with No Change β 41 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.28 / 4.18 Β±5.65 / 15.48 ms β 1.24 / 4.04 Β±5.51 / 15.06 ms β no change β
β QQuery 1 β 11.84 / 12.19 Β±0.22 / 12.47 ms β 11.85 / 11.98 Β±0.12 / 12.17 ms β no change β
β QQuery 2 β 37.13 / 37.62 Β±0.28 / 37.96 ms β 36.86 / 37.07 Β±0.17 / 37.28 ms β no change β
β QQuery 3 β 31.40 / 32.14 Β±0.57 / 33.15 ms β 31.42 / 33.32 Β±1.99 / 37.09 ms β no change β
β QQuery 4 β 242.32 / 244.03 Β±1.41 / 246.26 ms β 235.32 / 238.51 Β±1.80 / 240.46 ms β no change β
β QQuery 5 β 275.61 / 278.65 Β±2.97 / 283.67 ms β 277.27 / 280.20 Β±2.53 / 283.72 ms β no change β
β QQuery 6 β 1.29 / 1.45 Β±0.24 / 1.92 ms β 1.31 / 1.48 Β±0.26 / 1.98 ms β no change β
β QQuery 7 β 12.96 / 13.26 Β±0.16 / 13.44 ms β 13.10 / 13.46 Β±0.31 / 14.04 ms β no change β
β QQuery 8 β 332.76 / 336.58 Β±2.36 / 339.15 ms β 328.57 / 336.06 Β±5.74 / 343.84 ms β no change β
β QQuery 9 β 464.33 / 470.53 Β±5.50 / 477.36 ms β 459.83 / 475.37 Β±14.19 / 500.36 ms β no change β
β QQuery 10 β 64.69 / 66.12 Β±1.28 / 68.48 ms β 64.08 / 66.13 Β±2.08 / 69.36 ms β no change β
β QQuery 11 β 75.72 / 76.20 Β±0.34 / 76.72 ms β 75.10 / 75.82 Β±0.47 / 76.52 ms β no change β
β QQuery 12 β 271.40 / 276.95 Β±4.19 / 281.41 ms β 260.75 / 266.37 Β±5.63 / 275.36 ms β no change β
β QQuery 13 β 366.10 / 374.39 Β±5.58 / 382.94 ms β 356.35 / 363.77 Β±7.51 / 377.11 ms β no change β
β QQuery 14 β 286.54 / 290.71 Β±3.64 / 297.00 ms β 276.82 / 281.63 Β±3.79 / 286.67 ms β no change β
β QQuery 15 β 281.71 / 284.83 Β±3.12 / 290.47 ms β 284.23 / 288.12 Β±2.17 / 289.89 ms β no change β
β QQuery 16 β 623.72 / 630.50 Β±5.17 / 639.32 ms β 615.28 / 628.10 Β±8.41 / 639.85 ms β no change β
β QQuery 17 β 615.15 / 629.56 Β±7.95 / 638.27 ms β 627.10 / 633.99 Β±5.65 / 641.37 ms β no change β
β QQuery 18 β 1281.64 / 1352.29 Β±65.31 / 1473.78 ms β 1257.35 / 1278.23 Β±14.67 / 1292.54 ms β +1.06x faster β
β QQuery 19 β 29.97 / 30.50 Β±0.53 / 31.34 ms β 27.70 / 28.38 Β±0.61 / 29.32 ms β +1.07x faster β
β QQuery 20 β 516.42 / 531.05 Β±15.16 / 552.07 ms β 519.08 / 525.40 Β±3.89 / 531.16 ms β no change β
β QQuery 21 β 505.68 / 511.04 Β±4.46 / 518.52 ms β 506.25 / 511.57 Β±4.61 / 519.97 ms β no change β
β QQuery 22 β 967.33 / 976.54 Β±8.09 / 991.21 ms β 978.46 / 990.46 Β±10.80 / 1006.54 ms β no change β
β QQuery 23 β 3043.94 / 3076.29 Β±20.78 / 3108.61 ms β 3057.22 / 3084.72 Β±17.97 / 3105.12 ms β no change β
β QQuery 24 β 40.36 / 41.23 Β±0.54 / 42.04 ms β 40.47 / 43.44 Β±1.89 / 46.41 ms β 1.05x slower β
β QQuery 25 β 104.01 / 105.38 Β±1.09 / 107.26 ms β 103.67 / 106.00 Β±2.82 / 111.31 ms β no change β
β QQuery 26 β 40.38 / 41.13 Β±0.82 / 42.61 ms β 40.36 / 42.43 Β±3.22 / 48.82 ms β no change β
β QQuery 27 β 511.86 / 525.95 Β±15.64 / 555.76 ms β 517.73 / 520.61 Β±3.10 / 526.36 ms β no change β
β QQuery 28 β 2901.82 / 2917.77 Β±12.03 / 2933.71 ms β 2873.88 / 2904.13 Β±20.01 / 2925.48 ms β no change β
β QQuery 29 β 41.94 / 60.86 Β±36.92 / 134.69 ms β 42.04 / 60.40 Β±10.24 / 72.70 ms β no change β
β QQuery 30 β 306.22 / 313.40 Β±6.50 / 322.72 ms β 308.10 / 313.44 Β±6.79 / 326.72 ms β no change β
β QQuery 31 β 274.47 / 298.94 Β±17.84 / 320.12 ms β 274.60 / 284.93 Β±5.96 / 290.81 ms β no change β
β QQuery 32 β 957.32 / 1003.39 Β±52.47 / 1090.88 ms β 914.52 / 962.79 Β±39.81 / 1023.71 ms β no change β
β QQuery 33 β 1453.46 / 1485.51 Β±18.26 / 1504.60 ms β 1417.00 / 1460.46 Β±25.80 / 1489.90 ms β no change β
β QQuery 34 β 1471.02 / 1489.22 Β±14.20 / 1509.25 ms β 1455.64 / 1514.47 Β±42.30 / 1572.18 ms β no change β
β QQuery 35 β 294.87 / 316.75 Β±20.42 / 343.06 ms β 281.67 / 326.20 Β±72.01 / 469.84 ms β no change β
β QQuery 36 β 66.96 / 73.88 Β±5.30 / 80.52 ms β 65.72 / 78.61 Β±17.06 / 110.92 ms β 1.06x slower β
β QQuery 37 β 35.50 / 38.16 Β±3.04 / 44.04 ms β 35.15 / 37.55 Β±3.35 / 44.17 ms β no change β
β QQuery 38 β 40.82 / 45.59 Β±5.45 / 55.45 ms β 42.05 / 46.51 Β±3.04 / 50.03 ms β no change β
β QQuery 39 β 144.43 / 155.34 Β±8.31 / 168.03 ms β 135.21 / 149.40 Β±11.97 / 167.74 ms β no change β
β QQuery 40 β 14.17 / 14.63 Β±0.27 / 14.89 ms β 14.40 / 14.91 Β±0.43 / 15.52 ms β no change β
β QQuery 41 β 13.92 / 15.00 Β±1.84 / 18.66 ms β 13.68 / 13.98 Β±0.26 / 14.38 ms β +1.07x faster β
β QQuery 42 β 13.48 / 13.61 Β±0.09 / 13.73 ms β 13.24 / 17.23 Β±4.62 / 23.06 ms β 1.27x slower β
βββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 19493.34ms β
β Total Time (rich-T-kid_coacler-benchmark) β 19351.67ms β
β Average Time (HEAD) β 453.33ms β
β Average Time (rich-T-kid_coacler-benchmark) β 450.04ms β
β Queries Faster β 3 β
β Queries Slower β 3 β
β Queries with No Change β 37 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**clickbench_partitioned β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 100.0s |
| Peak memory | 12.9 GiB |
| Avg memory | 4.3 GiB |
| CPU user | 1000.7s |
| CPU sys | 68.5s |
| Peak spill | 0 B |
**clickbench_partitioned β branch**
| Metric | Value |
|--------|-------|
| Wall time | 100.0s |
| Peak memory | 10.2 GiB |
| Avg memory | 4.4 GiB |
| CPU user | 986.5s |
| CPU sys | 68.4s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745607062
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745546566)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.50 ms β 1.48 ms β no change β
β QQuery 1 β 24.46 ms β 25.16 ms β no change β
β QQuery 2 β 47.17 ms β 49.45 ms β no change β
β QQuery 3 β 37.05 ms β 39.27 ms β 1.06x slower β
β QQuery 4 β 235.59 ms β 302.80 ms β 1.29x slower β
β QQuery 5 β 321.04 ms β 349.96 ms β 1.09x slower β
β QQuery 6 β 1.54 ms β 1.59 ms β no change β
β QQuery 7 β 63.18 ms β 59.58 ms β +1.06x faster β
β QQuery 8 β 374.47 ms β 456.96 ms β 1.22x slower β
β QQuery 9 β 402.15 ms β 400.57 ms β no change β
β QQuery 10 β 146.85 ms β 148.35 ms β no change β
β QQuery 11 β 157.70 ms β 161.82 ms β no change β
β QQuery 12 β 308.62 ms β 344.29 ms β 1.12x slower β
β QQuery 13 β 540.63 ms β 652.43 ms β 1.21x slower β
β QQuery 14 β 303.16 ms β 342.66 ms β 1.13x slower β
β QQuery 15 β 275.37 ms β 354.59 ms β 1.29x slower β
β QQuery 16 β 596.96 ms β 730.42 ms β 1.22x slower β
β QQuery 17 β 539.07 ms β 706.11 ms β 1.31x slower β
β QQuery 18 β 1120.10 ms β 1470.91 ms β 1.31x slower β
β QQuery 19 β 44.01 ms β 41.68 ms β +1.06x faster β
β QQuery 20 β 524.89 ms β 527.02 ms β no change β
β QQuery 21 β 555.76 ms β 563.79 ms β no change β
β QQuery 22 β 1037.10 ms β 993.12 ms β no change β
β QQuery 23 β 1515.41 ms β 1443.13 ms β no change β
β QQuery 24 β 51.24 ms β 50.21 ms β no change β
β QQuery 25 β 111.59 ms β 111.59 ms β no change β
β QQuery 26 β 49.89 ms β 50.74 ms β no change β
β QQuery 27 β 533.36 ms β 541.27 ms β no change β
β QQuery 28 β 2835.61 ms β 2803.15 ms β no change β
β QQuery 29 β 53.07 ms β 53.86 ms β no change β
β QQuery 30 β 332.41 ms β 366.10 ms β 1.10x slower β
β QQuery 31 β 366.38 ms β 442.01 ms β 1.21x slower β
β QQuery 32 β 1182.04 ms β 1747.46 ms β 1.48x slower β
β QQuery 33 β 1537.88 ms β 1679.14 ms β 1.09x slower β
β QQuery 34 β 1496.18 ms β 1676.54 ms β 1.12x slower β
β QQuery 35 β 266.37 ms β 340.42 ms β 1.28x slower β
β QQuery 36 β 120.15 ms β 120.68 ms β no change β
β QQuery 37 β 87.15 ms β 83.59 ms β no change β
β QQuery 38 β 94.98 ms β 92.85 ms β no change β
β QQuery 39 β 211.34 ms β 195.08 ms β +1.08x faster β
β QQuery 40 β 61.98 ms β 62.99 ms β no change β
β QQuery 41 β 64.65 ms β 60.69 ms β +1.07x faster β
β QQuery 42 β 62.39 ms β 60.95 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 18692.43ms β
β Total Time (rich-T-kid_coacler-benchmark) β 20706.46ms β
β Average Time (HEAD) β 434.71ms β
β Average Time (rich-T-kid_coacler-benchmark) β 481.55ms β
β Queries Faster β 4 β
β Queries Slower β 17 β
β Queries with No Change β 22 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.50 / 4.36 Β±5.55 / 15.45 ms β 1.48 / 4.30 Β±5.51 / 15.32 ms β no change β
β QQuery 1 β 24.46 / 27.25 Β±1.97 / 29.60 ms β 25.16 / 26.49 Β±0.91 / 27.81 ms β no change β
β QQuery 2 β 47.17 / 50.25 Β±1.67 / 51.97 ms β 49.45 / 50.43 Β±0.66 / 51.10 ms β no change β
β QQuery 3 β 37.05 / 38.43 Β±1.03 / 40.11 ms β 39.27 / 41.52 Β±1.61 / 43.95 ms β 1.08x slower β
β QQuery 4 β 235.59 / 242.45 Β±5.36 / 248.77 ms β 302.80 / 306.67 Β±3.61 / 312.21 ms β 1.26x slower β
β QQuery 5 β 321.04 / 324.25 Β±4.97 / 334.14 ms β 349.96 / 353.16 Β±4.77 / 362.55 ms β 1.09x slower β
β QQuery 6 β 1.54 / 1.75 Β±0.29 / 2.32 ms β 1.59 / 1.78 Β±0.31 / 2.39 ms β no change β
β QQuery 7 β 63.18 / 67.13 Β±5.02 / 76.92 ms β 59.58 / 65.69 Β±10.89 / 87.45 ms β no change β
β QQuery 8 β 374.47 / 388.79 Β±8.68 / 399.81 ms β 456.96 / 465.62 Β±9.05 / 482.91 ms β 1.20x slower β
β QQuery 9 β 402.15 / 422.56 Β±15.26 / 443.38 ms β 400.57 / 406.95 Β±4.09 / 411.89 ms β no change β
β QQuery 10 β 146.85 / 151.46 Β±3.49 / 155.39 ms β 148.35 / 149.67 Β±1.28 / 151.84 ms β no change β
β QQuery 11 β 157.70 / 164.77 Β±9.13 / 182.75 ms β 161.82 / 167.49 Β±8.39 / 183.99 ms β no change β
β QQuery 12 β 308.62 / 315.96 Β±5.65 / 325.66 ms β 344.29 / 347.85 Β±2.21 / 350.78 ms β 1.10x slower β
β QQuery 13 β 540.63 / 545.34 Β±4.89 / 553.80 ms β 652.43 / 679.37 Β±36.47 / 751.19 ms β 1.25x slower β
β QQuery 14 β 303.16 / 314.30 Β±14.96 / 343.70 ms β 342.66 / 365.28 Β±26.45 / 415.03 ms β 1.16x slower β
β QQuery 15 β 275.37 / 294.43 Β±22.48 / 334.56 ms β 354.59 / 373.48 Β±27.55 / 427.93 ms β 1.27x slower β
β QQuery 16 β 596.96 / 620.88 Β±15.00 / 641.87 ms β 730.42 / 763.62 Β±25.23 / 807.77 ms β 1.23x slower β
β QQuery 17 β 539.07 / 583.32 Β±33.52 / 623.44 ms β 706.11 / 731.11 Β±20.23 / 761.14 ms β 1.25x slower β
β QQuery 18 β 1120.10 / 1156.40 Β±30.23 / 1202.44 ms β 1470.91 / 1517.98 Β±40.65 / 1581.18 ms β 1.31x slower β
β QQuery 19 β 44.01 / 49.83 Β±9.90 / 69.56 ms β 41.68 / 85.73 Β±51.09 / 161.74 ms β 1.72x slower β
β QQuery 20 β 524.89 / 559.68 Β±21.84 / 593.52 ms β 527.02 / 549.75 Β±22.61 / 579.48 ms β no change β
β QQuery 21 β 555.76 / 582.12 Β±30.23 / 641.06 ms β 563.79 / 577.45 Β±13.70 / 596.32 ms β no change β
β QQuery 22 β 1037.10 / 1081.66 Β±38.36 / 1142.56 ms β 993.12 / 1013.90 Β±11.17 / 1026.44 ms β +1.07x faster β
β QQuery 23 β 1515.41 / 1743.83 Β±159.75 / 1961.04 ms β 1443.13 / 1780.18 Β±268.68 / 2232.55 ms β no change β
β QQuery 24 β 51.24 / 70.86 Β±18.76 / 103.15 ms β 50.21 / 52.24 Β±2.38 / 55.77 ms β +1.36x faster β
β QQuery 25 β 111.59 / 114.10 Β±2.82 / 118.26 ms β 111.59 / 114.79 Β±2.96 / 120.06 ms β no change β
β QQuery 26 β 49.89 / 54.14 Β±2.43 / 57.04 ms β 50.74 / 67.25 Β±26.98 / 121.08 ms β 1.24x slower β
β QQuery 27 β 533.36 / 561.15 Β±19.39 / 594.17 ms β 541.27 / 549.60 Β±8.32 / 565.29 ms β no change β
β QQuery 28 β 2835.61 / 2887.90 Β±48.23 / 2956.30 ms β 2803.15 / 2876.65 Β±57.93 / 2967.10 ms β no change β
β QQuery 29 β 53.07 / 68.42 Β±17.42 / 93.75 ms β 53.86 / 68.47 Β±17.34 / 94.11 ms β no change β
β QQuery 30 β 332.41 / 337.06 Β±4.06 / 344.57 ms β 366.10 / 376.57 Β±7.73 / 388.18 ms β 1.12x slower β
β QQuery 31 β 366.38 / 373.76 Β±8.58 / 390.29 ms β 442.01 / 462.13 Β±26.05 / 512.92 ms β 1.24x slower β
β QQuery 32 β 1182.04 / 1260.04 Β±70.42 / 1346.72 ms β 1747.46 / 1879.23 Β±150.08 / 2136.49 ms β 1.49x slower β
β QQuery 33 β 1537.88 / 1598.29 Β±49.38 / 1659.33 ms β 1679.14 / 1861.31 Β±141.26 / 2103.05 ms β 1.16x slower β
β QQuery 34 β 1496.18 / 1674.26 Β±151.17 / 1916.72 ms β 1676.54 / 1764.89 Β±102.71 / 1943.52 ms β 1.05x slower β
β QQuery 35 β 266.37 / 362.07 Β±150.46 / 659.04 ms β 340.42 / 380.91 Β±61.68 / 502.94 ms β 1.05x slower β
β QQuery 36 β 120.15 / 136.23 Β±18.73 / 170.12 ms β 120.68 / 129.02 Β±7.97 / 141.89 ms β +1.06x faster β
β QQuery 37 β 87.15 / 90.39 Β±4.84 / 99.89 ms β 83.59 / 87.32 Β±4.12 / 95.20 ms β no change β
β QQuery 38 β 94.98 / 107.09 Β±16.62 / 139.80 ms β 92.85 / 96.66 Β±4.74 / 105.51 ms β +1.11x faster β
β QQuery 39 β 211.34 / 223.62 Β±7.02 / 231.31 ms β 195.08 / 201.45 Β±3.75 / 205.88 ms β +1.11x faster β
β QQuery 40 β 61.98 / 67.58 Β±3.72 / 73.14 ms β 62.99 / 69.37 Β±6.87 / 81.84 ms β no change β
β QQuery 41 β 64.65 / 84.25 Β±25.56 / 133.65 ms β 60.69 / 67.98 Β±7.06 / 80.44 ms β +1.24x faster β
β QQuery 42 β 62.39 / 66.38 Β±3.58 / 72.45 ms β 60.95 / 67.77 Β±6.26 / 78.20 ms β no change β
βββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 19868.78ms β
β Total Time (rich-T-kid_coacler-benchmark) β 21999.07ms β
β Average Time (HEAD) β 462.06ms β
β Average Time (rich-T-kid_coacler-benchmark) β 511.61ms β
β Queries Faster β 6 β
β Queries Slower β 19 β
β Queries with No Change β 18 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**clickbench_partitioned β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 100.0s |
| Peak memory | 15.1 GiB |
| Avg memory | 8.0 GiB |
| CPU user | 927.4s |
| CPU sys | 98.3s |
| Peak spill | 0 B |
**clickbench_partitioned β branch**
| Metric | Value |
|--------|-------|
| Wall time | 115.0s |
| Peak memory | 15.2 GiB |
| Avg memory | 7.6 GiB |
| CPU user | 1055.2s |
| CPU sys | 99.7s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739813118
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739768986)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (dbfc4e87e81f5ae40f150fa37700863a165cd991) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..dbfc4e87e81f5ae40f150fa37700863a165cd991)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 5.62 ms β 5.53 ms β no change β
β QQuery 2 β 80.87 ms β 79.69 ms β no change β
β QQuery 3 β 28.69 ms β 28.03 ms β no change β
β QQuery 4 β 441.87 ms β 422.60 ms β no change β
β QQuery 5 β 50.38 ms β 50.01 ms β no change β
β QQuery 6 β 34.98 ms β 35.13 ms β no change β
β QQuery 7 β 73.56 ms β 74.25 ms β no change β
β QQuery 8 β 36.13 ms β 35.67 ms β no change β
β QQuery 9 β 52.40 ms β 50.88 ms β no change β
β QQuery 10 β 61.37 ms β 61.93 ms β no change β
β QQuery 11 β 274.26 ms β 258.97 ms β +1.06x faster β
β QQuery 12 β 29.51 ms β 27.98 ms β +1.05x faster β
β QQuery 13 β 120.35 ms β 116.03 ms β no change β
β QQuery 14 β 401.42 ms β 391.17 ms β no change β
β QQuery 15 β 57.76 ms β 52.18 ms β +1.11x faster β
β QQuery 16 β 6.87 ms β 6.29 ms β +1.09x faster β
β QQuery 17 β 79.34 ms β 76.44 ms β no change β
β QQuery 18 β 107.32 ms β 100.79 ms β +1.06x faster β
β QQuery 19 β 42.26 ms β 40.35 ms β no change β
β QQuery 20 β 36.83 ms β 35.00 ms β no change β
β QQuery 21 β 17.30 ms β 16.79 ms β no change β
β QQuery 22 β 66.21 ms β 62.42 ms β +1.06x faster β
β QQuery 23 β 324.45 ms β 302.46 ms β +1.07x faster β
β QQuery 24 β 202.25 ms β 189.26 ms β +1.07x faster β
β QQuery 25 β 107.75 ms β 107.12 ms β no change β
β QQuery 26 β 48.45 ms β 47.51 ms β no change β
β QQuery 27 β 6.23 ms β 5.96 ms β no change β
β QQuery 28 β 56.72 ms β 56.54 ms β no change β
β QQuery 29 β 94.85 ms β 95.70 ms β no change β
β QQuery 30 β 32.23 ms β 34.54 ms β 1.07x slower β
β QQuery 31 β 108.57 ms β 110.77 ms β no change β
β QQuery 32 β 20.54 ms β 21.05 ms β no change β
β QQuery 33 β 37.07 ms β 37.82 ms β no change β
β QQuery 34 β 9.88 ms β 10.49 ms β 1.06x slower β
β QQuery 35 β 72.06 ms β 74.76 ms β no change β
β QQuery 36 β 5.61 ms β 5.98 ms β 1.07x slower β
β QQuery 37 β 6.80 ms β 7.20 ms β 1.06x slower β
β QQuery 38 β 60.70 ms β 64.29 ms β 1.06x slower β
β QQuery 39 β 73.42 ms β 76.96 ms β no change β
β QQuery 40 β 23.43 ms β 25.06 ms β 1.07x slower β
β QQuery 41 β 11.07 ms β 11.53 ms β no change β
β QQuery 42 β 23.96 ms β 24.06 ms β no change β
β QQuery 43 β 5.31 ms β 5.30 ms β no change β
β QQuery 44 β 9.58 ms β 9.60 ms β no change β
β QQuery 45 β 39.75 ms β 41.42 ms β no change β
β QQuery 46 β 12.42 ms β 12.01 ms β no change β
β QQuery 47 β 232.52 ms β 246.12 ms β 1.06x slower β
β QQuery 48 β 94.11 ms β 95.07 ms β no change β
β QQuery 49 β 70.85 ms β 70.86 ms β no change β
β QQuery 50 β 57.93 ms β 59.11 ms β no change β
β QQuery 51 β 92.56 ms β 96.33 ms β no change β
β QQuery 52 β 23.96 ms β 24.25 ms β no change β
β QQuery 53 β 28.59 ms β 29.28 ms β no change β
β QQuery 54 β 53.19 ms β 54.78 ms β no change β
β QQuery 55 β 22.93 ms β 24.00 ms β no change β
β QQuery 56 β 37.86 ms β 38.88 ms β no change β
β QQuery 57 β 167.35 ms β 170.21 ms β no change β
β QQuery 58 β 107.98 ms β 108.23 ms β no change β
β QQuery 59 β 116.04 ms β 116.76 ms β no change β
β QQuery 60 β 38.54 ms β 38.26 ms β no change β
β QQuery 61 β 11.56 ms β 11.46 ms β no change β
β QQuery 62 β 44.00 ms β 43.95 ms β no change β
β QQuery 63 β 28.89 ms β 29.02 ms β no change β
β QQuery 64 β 355.13 ms β 362.12 ms β no change β
β QQuery 65 β 129.73 ms β 128.81 ms β no change β
β QQuery 66 β 76.65 ms β 77.09 ms β no change β
β QQuery 67 β 244.39 ms β 254.53 ms β no change β
β QQuery 68 β 11.61 ms β 12.37 ms β 1.07x slower β
β QQuery 69 β 55.47 ms β 57.08 ms β no change β
β QQuery 70 β 103.00 ms β 104.11 ms β no change β
β QQuery 71 β 34.60 ms β 35.31 ms β no change β
β QQuery 72 β 1669.10 ms β 1757.27 ms β 1.05x slower β
β QQuery 73 β 9.57 ms β 9.45 ms β no change β
β QQuery 74 β 153.18 ms β 152.35 ms β no change β
β QQuery 75 β 140.00 ms β 140.12 ms β no change β
β QQuery 76 β 34.61 ms β 34.25 ms β no change β
β QQuery 77 β 59.46 ms β 59.29 ms β no change β
β QQuery 78 β 161.71 ms β 159.49 ms β no change β
β QQuery 79 β 65.73 ms β 65.60 ms β no change β
β QQuery 80 β 94.19 ms β 93.66 ms β no change β
β QQuery 81 β 25.80 ms β 25.45 ms β no change β
β QQuery 82 β 16.19 ms β 16.18 ms β no change β
β QQuery 83 β 33.19 ms β 33.12 ms β no change β
β QQuery 84 β 29.99 ms β 29.49 ms β no change β
β QQuery 85 β 102.41 ms β 100.58 ms β no change β
β QQuery 86 β 24.48 ms β 24.26 ms β no change β
β QQuery 87 β 61.46 ms β 60.52 ms β no change β
β QQuery 88 β 60.60 ms β 60.42 ms β no change β
β QQuery 89 β 35.00 ms β 34.80 ms β no change β
β QQuery 90 β 16.34 ms β 16.19 ms β no change β
β QQuery 91 β 44.59 ms β 43.61 ms β no change β
β QQuery 92 β 29.30 ms β 27.98 ms β no change β
β QQuery 93 β 48.75 ms β 48.21 ms β no change β
β QQuery 94 β 37.70 ms β 37.75 ms β no change β
β QQuery 95 β 77.59 ms β 77.38 ms β no change β
β QQuery 96 β 23.23 ms β 22.98 ms β no change β
β QQuery 97 β 50.57 ms β 50.50 ms β no change β
β QQuery 98 β 42.89 ms β 41.84 ms β no change β
β QQuery 99 β 65.08 ms β 65.27 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 8950.55ms β
β Total Time (rich-T-kid_coacler-benchmark) β 8981.54ms β
β Average Time (HEAD) β 90.41ms β
β Average Time (rich-T-kid_coacler-benchmark) β 90.72ms β
β Queries Faster β 8 β
β Queries Slower β 9 β
β Queries with No Change β 82 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 5.62 / 6.25 Β±0.93 / 8.11 ms β 5.53 / 6.16 Β±0.98 / 8.12 ms β no change β
β QQuery 2 β 80.87 / 81.06 Β±0.17 / 81.36 ms β 79.69 / 80.22 Β±0.32 / 80.68 ms β no change β
β QQuery 3 β 28.69 / 28.92 Β±0.22 / 29.29 ms β 28.03 / 28.50 Β±0.37 / 29.13 ms β no change β
β QQuery 4 β 441.87 / 450.75 Β±5.99 / 457.43 ms β 422.60 / 431.89 Β±8.20 / 444.33 ms β no change β
β QQuery 5 β 50.38 / 52.10 Β±2.47 / 57.02 ms β 50.01 / 50.50 Β±0.37 / 51.07 ms β no change β
β QQuery 6 β 34.98 / 35.47 Β±0.37 / 36.06 ms β 35.13 / 35.70 Β±0.59 / 36.73 ms β no change β
β QQuery 7 β 73.56 / 74.03 Β±0.38 / 74.47 ms β 74.25 / 74.86 Β±0.64 / 76.08 ms β no change β
β QQuery 8 β 36.13 / 36.33 Β±0.16 / 36.63 ms β 35.67 / 36.08 Β±0.31 / 36.54 ms β no change β
β QQuery 9 β 52.40 / 54.40 Β±1.86 / 57.34 ms β 50.88 / 52.58 Β±0.91 / 53.49 ms β no change β
β QQuery 10 β 61.37 / 61.59 Β±0.15 / 61.80 ms β 61.93 / 63.28 Β±2.27 / 67.80 ms β no change β
β QQuery 11 β 274.26 / 285.55 Β±10.79 / 304.00 ms β 258.97 / 263.49 Β±3.60 / 268.93 ms β +1.08x faster β
β QQuery 12 β 29.51 / 29.79 Β±0.41 / 30.60 ms β 27.98 / 28.34 Β±0.28 / 28.75 ms β no change β
β QQuery 13 β 120.35 / 121.79 Β±2.21 / 126.17 ms β 116.03 / 118.47 Β±2.18 / 122.11 ms β no change β
β QQuery 14 β 401.42 / 406.91 Β±3.68 / 411.43 ms β 391.17 / 393.03 Β±1.54 / 395.52 ms β no change β
β QQuery 15 β 57.76 / 58.87 Β±0.56 / 59.29 ms β 52.18 / 53.51 Β±1.53 / 56.35 ms β +1.10x faster β
β QQuery 16 β 6.87 / 6.95 Β±0.12 / 7.17 ms β 6.29 / 6.53 Β±0.25 / 6.99 ms β +1.06x faster β
β QQuery 17 β 79.34 / 81.11 Β±1.15 / 82.62 ms β 76.44 / 76.89 Β±0.27 / 77.18 ms β +1.05x faster β
β QQuery 18 β 107.32 / 109.35 Β±2.09 / 113.33 ms β 100.79 / 102.11 Β±1.16 / 103.83 ms β +1.07x faster β
β QQuery 19 β 42.26 / 43.17 Β±1.45 / 46.07 ms β 40.35 / 40.59 Β±0.21 / 40.90 ms β +1.06x faster β
β QQuery 20 β 36.83 / 37.06 Β±0.14 / 37.23 ms β 35.00 / 35.78 Β±0.62 / 36.62 ms β no change β
β QQuery 21 β 17.30 / 17.64 Β±0.28 / 17.97 ms β 16.79 / 17.02 Β±0.16 / 17.25 ms β no change β
β QQuery 22 β 66.21 / 67.19 Β±0.63 / 68.11 ms β 62.42 / 62.88 Β±0.60 / 64.04 ms β +1.07x faster β
β QQuery 23 β 324.45 / 329.20 Β±3.79 / 333.09 ms β 302.46 / 307.20 Β±4.33 / 313.97 ms β +1.07x faster β
β QQuery 24 β 202.25 / 205.67 Β±2.52 / 210.10 ms β 189.26 / 194.04 Β±6.66 / 207.12 ms β +1.06x faster β
β QQuery 25 β 107.75 / 108.73 Β±0.85 / 110.13 ms β 107.12 / 108.39 Β±0.94 / 109.86 ms β no change β
β QQuery 26 β 48.45 / 49.38 Β±0.91 / 50.94 ms β 47.51 / 49.40 Β±3.28 / 55.96 ms β no change β
β QQuery 27 β 6.23 / 6.39 Β±0.18 / 6.75 ms β 5.96 / 6.07 Β±0.12 / 6.23 ms β +1.05x faster β
β QQuery 28 β 56.72 / 59.24 Β±1.90 / 61.27 ms β 56.54 / 59.24 Β±1.78 / 60.95 ms β no change β
β QQuery 29 β 94.85 / 96.14 Β±1.37 / 98.79 ms β 95.70 / 97.40 Β±1.53 / 100.29 ms β no change β
β QQuery 30 β 32.23 / 33.14 Β±0.76 / 34.33 ms β 34.54 / 38.02 Β±4.38 / 46.62 ms β 1.15x slower β
β QQuery 31 β 108.57 / 109.98 Β±2.19 / 114.28 ms β 110.77 / 112.57 Β±1.30 / 114.84 ms β no change β
β QQuery 32 β 20.54 / 20.68 Β±0.11 / 20.80 ms β 21.05 / 21.32 Β±0.17 / 21.48 ms β no change β
β QQuery 33 β 37.07 / 37.44 Β±0.31 / 37.87 ms β 37.82 / 38.23 Β±0.41 / 39.01 ms β no change β
β QQuery 34 β 9.88 / 10.29 Β±0.29 / 10.68 ms β 10.49 / 13.36 Β±4.46 / 22.19 ms β 1.30x slower β
β QQuery 35 β 72.06 / 73.25 Β±0.77 / 73.92 ms β 74.76 / 75.49 Β±0.71 / 76.39 ms β no change β
β QQuery 36 β 5.61 / 5.78 Β±0.22 / 6.20 ms β 5.98 / 6.13 Β±0.14 / 6.38 ms β 1.06x slower β
β QQuery 37 β 6.80 / 6.91 Β±0.10 / 7.07 ms β 7.20 / 7.25 Β±0.04 / 7.29 ms β no change β
β QQuery 38 β 60.70 / 61.31 Β±0.45 / 62.10 ms β 64.29 / 64.94 Β±0.75 / 66.38 ms β 1.06x slower β
β QQuery 39 β 73.42 / 74.69 Β±1.77 / 78.21 ms β 76.96 / 78.98 Β±2.90 / 84.65 ms β 1.06x slower β
β QQuery 40 β 23.43 / 23.80 Β±0.30 / 24.33 ms β 25.06 / 25.49 Β±0.46 / 26.35 ms β 1.07x slower β
β QQuery 41 β 11.07 / 11.27 Β±0.14 / 11.50 ms β 11.53 / 11.81 Β±0.18 / 12.10 ms β no change β
β QQuery 42 β 23.96 / 24.12 Β±0.09 / 24.23 ms β 24.06 / 24.45 Β±0.33 / 24.95 ms β no change β
β QQuery 43 β 5.31 / 5.41 Β±0.17 / 5.75 ms β 5.30 / 5.43 Β±0.11 / 5.60 ms β no change β
β QQuery 44 β 9.58 / 9.68 Β±0.10 / 9.86 ms β 9.60 / 10.09 Β±0.85 / 11.79 ms β no change β
β QQuery 45 β 39.75 / 40.99 Β±1.02 / 42.77 ms β 41.42 / 42.28 Β±0.69 / 43.33 ms β no change β
β QQuery 46 β 12.42 / 12.90 Β±0.37 / 13.54 ms β 12.01 / 12.34 Β±0.24 / 12.65 ms β no change β
β QQuery 47 β 232.52 / 236.06 Β±3.65 / 242.88 ms β 246.12 / 250.78 Β±4.28 / 257.46 ms β 1.06x slower β
β QQuery 48 β 94.11 / 95.20 Β±0.82 / 96.64 ms β 95.07 / 97.31 Β±1.91 / 100.64 ms β no change β
β QQuery 49 β 70.85 / 72.85 Β±3.52 / 79.88 ms β 70.86 / 71.50 Β±0.79 / 73.06 ms β no change β
β QQuery 50 β 57.93 / 58.35 Β±0.49 / 59.26 ms β 59.11 / 59.47 Β±0.24 / 59.76 ms β no change β
β QQuery 51 β 92.56 / 94.38 Β±1.52 / 96.36 ms β 96.33 / 98.26 Β±1.09 / 99.56 ms β no change β
β QQuery 52 β 23.96 / 25.47 Β±2.14 / 29.56 ms β 24.25 / 24.51 Β±0.19 / 24.81 ms β no change β
β QQuery 53 β 28.59 / 28.91 Β±0.16 / 29.03 ms β 29.28 / 31.84 Β±3.62 / 39.00 ms β 1.10x slower β
β QQuery 54 β 53.19 / 54.27 Β±1.17 / 56.51 ms β 54.78 / 55.73 Β±0.64 / 56.46 ms β no change β
β QQuery 55 β 22.93 / 23.44 Β±0.32 / 23.93 ms β 24.00 / 24.35 Β±0.30 / 24.72 ms β no change β
β QQuery 56 β 37.86 / 38.24 Β±0.38 / 38.93 ms β 38.88 / 39.21 Β±0.19 / 39.41 ms β no change β
β QQuery 57 β 167.35 / 170.82 Β±3.63 / 177.84 ms β 170.21 / 171.62 Β±1.02 / 173.31 ms β no change β
β QQuery 58 β 107.98 / 109.92 Β±2.06 / 113.73 ms β 108.23 / 109.92 Β±2.01 / 113.77 ms β no change β
β QQuery 59 β 116.04 / 117.10 Β±0.90 / 118.27 ms β 116.76 / 117.52 Β±1.07 / 119.62 ms β no change β
β QQuery 60 β 38.54 / 39.11 Β±0.32 / 39.49 ms β 38.26 / 39.17 Β±0.53 / 39.81 ms β no change β
β QQuery 61 β 11.56 / 12.98 Β±2.42 / 17.81 ms β 11.46 / 11.60 Β±0.16 / 11.89 ms β +1.12x faster β
β QQuery 62 β 44.00 / 44.28 Β±0.25 / 44.63 ms β 43.95 / 45.51 Β±2.99 / 51.48 ms β no change β
β QQuery 63 β 28.89 / 29.65 Β±0.53 / 30.54 ms β 29.02 / 29.39 Β±0.40 / 29.91 ms β no change β
β QQuery 64 β 355.13 / 359.99 Β±2.66 / 362.87 ms β 362.12 / 371.51 Β±8.06 / 385.74 ms β no change β
β QQuery 65 β 129.73 / 131.03 Β±1.50 / 133.84 ms β 128.81 / 131.10 Β±1.77 / 134.09 ms β no change β
β QQuery 66 β 76.65 / 79.63 Β±3.17 / 85.79 ms β 77.09 / 78.40 Β±1.63 / 81.59 ms β no change β
β QQuery 67 β 244.39 / 252.77 Β±9.32 / 269.53 ms β 254.53 / 263.38 Β±6.70 / 268.98 ms β no change β
β QQuery 68 β 11.61 / 11.84 Β±0.22 / 12.21 ms β 12.37 / 12.54 Β±0.12 / 12.73 ms β 1.06x slower β
β QQuery 69 β 55.47 / 55.80 Β±0.42 / 56.61 ms β 57.08 / 57.64 Β±0.60 / 58.75 ms β no change β
β QQuery 70 β 103.00 / 107.70 Β±4.77 / 116.75 ms β 104.11 / 107.33 Β±5.53 / 118.38 ms β no change β
β QQuery 71 β 34.60 / 34.95 Β±0.63 / 36.20 ms β 35.31 / 36.12 Β±0.87 / 37.74 ms β no change β
β QQuery 72 β 1669.10 / 1774.76 Β±56.03 / 1820.14 ms β 1757.27 / 1807.94 Β±46.44 / 1876.12 ms β no change β
β QQuery 73 β 9.57 / 9.94 Β±0.39 / 10.48 ms β 9.45 / 9.92 Β±0.32 / 10.36 ms β no change β
β QQuery 74 β 153.18 / 158.56 Β±3.53 / 164.29 ms β 152.35 / 157.76 Β±4.94 / 164.31 ms β no change β
β QQuery 75 β 140.00 / 140.69 Β±0.57 / 141.26 ms β 140.12 / 142.99 Β±3.20 / 149.23 ms β no change β
β QQuery 76 β 34.61 / 36.32 Β±3.16 / 42.64 ms β 34.25 / 34.84 Β±0.63 / 36.01 ms β no change β
β QQuery 77 β 59.46 / 60.52 Β±1.16 / 62.78 ms β 59.29 / 60.02 Β±0.64 / 61.04 ms β no change β
β QQuery 78 β 161.71 / 167.09 Β±5.53 / 177.37 ms β 159.49 / 163.06 Β±3.02 / 167.16 ms β no change β
β QQuery 79 β 65.73 / 66.54 Β±1.28 / 69.11 ms β 65.60 / 66.07 Β±0.33 / 66.48 ms β no change β
β QQuery 80 β 94.19 / 95.00 Β±0.60 / 95.96 ms β 93.66 / 98.54 Β±5.54 / 108.26 ms β no change β
β QQuery 81 β 25.80 / 25.94 Β±0.08 / 26.04 ms β 25.45 / 25.72 Β±0.33 / 26.35 ms β no change β
β QQuery 82 β 16.19 / 16.47 Β±0.30 / 17.05 ms β 16.18 / 16.36 Β±0.19 / 16.68 ms β no change β
β QQuery 83 β 33.19 / 34.06 Β±1.19 / 36.41 ms β 33.12 / 33.30 Β±0.11 / 33.42 ms β no change β
β QQuery 84 β 29.99 / 30.31 Β±0.36 / 30.81 ms β 29.49 / 30.09 Β±0.52 / 30.75 ms β no change β
β QQuery 85 β 102.41 / 106.27 Β±6.31 / 118.79 ms β 100.58 / 102.52 Β±2.59 / 107.63 ms β no change β
β QQuery 86 β 24.48 / 25.03 Β±0.35 / 25.52 ms β 24.26 / 24.67 Β±0.35 / 25.25 ms β no change β
β QQuery 87 β 61.46 / 61.98 Β±0.36 / 62.57 ms β 60.52 / 61.79 Β±1.04 / 63.46 ms β no change β
β QQuery 88 β 60.60 / 61.03 Β±0.26 / 61.39 ms β 60.42 / 60.75 Β±0.28 / 61.14 ms β no change β
β QQuery 89 β 35.00 / 37.32 Β±4.37 / 46.07 ms β 34.80 / 36.95 Β±3.64 / 44.20 ms β no change β
β QQuery 90 β 16.34 / 16.67 Β±0.17 / 16.85 ms β 16.19 / 16.41 Β±0.21 / 16.80 ms β no change β
β QQuery 91 β 44.59 / 45.31 Β±0.52 / 46.13 ms β 43.61 / 43.87 Β±0.19 / 44.12 ms β no change β
β QQuery 92 β 29.30 / 30.74 Β±1.73 / 34.12 ms β 27.98 / 28.31 Β±0.31 / 28.76 ms β +1.09x faster β
β QQuery 93 β 48.75 / 49.89 Β±0.91 / 51.41 ms β 48.21 / 49.90 Β±1.96 / 53.70 ms β no change β
β QQuery 94 β 37.70 / 38.31 Β±0.43 / 38.83 ms β 37.75 / 37.95 Β±0.21 / 38.35 ms β no change β
β QQuery 95 β 77.59 / 80.02 Β±1.44 / 82.04 ms β 77.38 / 79.76 Β±3.07 / 85.67 ms β no change β
β QQuery 96 β 23.23 / 23.57 Β±0.44 / 24.33 ms β 22.98 / 23.32 Β±0.40 / 24.08 ms β no change β
β QQuery 97 β 50.57 / 51.85 Β±1.12 / 53.24 ms β 50.50 / 51.99 Β±1.86 / 55.67 ms β no change β
β QQuery 98 β 42.89 / 43.51 Β±0.45 / 44.28 ms β 41.84 / 42.34 Β±0.36 / 42.87 ms β no change β
β QQuery 99 β 65.08 / 67.30 Β±3.12 / 73.46 ms β 65.27 / 65.59 Β±0.37 / 66.29 ms β no change β
βββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 9202.39ms β
β Total Time (rich-T-kid_coacler-benchmark) β 9176.76ms β
β Average Time (HEAD) β 92.95ms β
β Average Time (rich-T-kid_coacler-benchmark) β 92.69ms β
β Queries Faster β 12 β
β Queries Slower β 9 β
β Queries with No Change β 78 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpcds β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 50.0s |
| Peak memory | 1.7 GiB |
| Avg memory | 1.2 GiB |
| CPU user | 199.8s |
| CPU sys | 5.6s |
| Peak spill | 0 B |
**tpcds β branch**
| Metric | Value |
|--------|-------|
| Wall time | 50.0s |
| Peak memory | 2.0 GiB |
| Avg memory | 1.4 GiB |
| CPU user | 198.4s |
| CPU sys | 5.5s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746452967
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5746435338)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5746435338-2512-mftjg 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (50b4aadf9bd59b1681e8c222be535966e84155d7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..50b4aadf9bd59b1681e8c222be535966e84155d7)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745471023
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745457304)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5745457304-2500-ld48d 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745674873
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745657661)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5745657661-2509-d865q 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (50b4aadf9bd59b1681e8c222be535966e84155d7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..50b4aadf9bd59b1681e8c222be535966e84155d7)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746504055
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5746451749)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (50b4aadf9bd59b1681e8c222be535966e84155d7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..50b4aadf9bd59b1681e8c222be535966e84155d7)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 63.80 ms β 62.30 ms β no change β
β QQuery 2 β 319.09 ms β 306.32 ms β no change β
β QQuery 3 β 76.55 ms β 75.44 ms β no change β
β QQuery 4 β 738.35 ms β 753.29 ms β no change β
β QQuery 5 β 369.59 ms β 382.19 ms β no change β
β QQuery 6 β 154.33 ms β 156.79 ms β no change β
β QQuery 7 β 117.51 ms β 113.91 ms β no change β
β QQuery 8 β 160.46 ms β 156.85 ms β no change β
β QQuery 9 β 236.86 ms β 212.81 ms β +1.11x faster β
β QQuery 10 β 141.26 ms β 143.74 ms β no change β
β QQuery 11 β 469.86 ms β 471.81 ms β no change β
β QQuery 12 β 111.35 ms β 108.31 ms β no change β
β QQuery 13 β 266.85 ms β 275.75 ms β no change β
β QQuery 14 β 5378.36 ms β 1226.21 ms β +4.39x faster β
β QQuery 15 β 123.52 ms β 103.77 ms β +1.19x faster β
β QQuery 16 β 71.81 ms β 66.51 ms β +1.08x faster β
β QQuery 17 β 560.19 ms β 561.76 ms β no change β
β QQuery 18 β 525.10 ms β 521.20 ms β no change β
β QQuery 19 β 97.68 ms β 97.59 ms β no change β
β QQuery 20 β 115.49 ms β 114.58 ms β no change β
β QQuery 21 β 64.85 ms β 65.68 ms β no change β
β QQuery 22 β 122.26 ms β 120.67 ms β no change β
β QQuery 23 β 919.08 ms β 917.55 ms β no change β
β QQuery 24 β 534.33 ms β 537.15 ms β no change β
β QQuery 25 β 594.42 ms β 624.03 ms β no change β
β QQuery 26 β 88.65 ms β 87.21 ms β no change β
β QQuery 27 β 56.83 ms β 54.88 ms β no change β
β QQuery 28 β 122.24 ms β 116.87 ms β no change β
β QQuery 29 β 598.80 ms β 583.41 ms β no change β
β QQuery 30 β 185.62 ms β 176.90 ms β no change β
β QQuery 31 β 498.33 ms β 497.19 ms β no change β
β QQuery 32 β 78.72 ms β 79.03 ms β no change β
β QQuery 33 β 158.54 ms β 157.19 ms β no change β
β QQuery 34 β 63.30 ms β 66.64 ms β 1.05x slower β
β QQuery 35 β 155.06 ms β 166.38 ms β 1.07x slower β
β QQuery 36 β 89.70 ms β 91.35 ms β no change β
β QQuery 37 β 46.80 ms β 48.10 ms β no change β
β QQuery 38 β 210.04 ms β 213.82 ms β no change β
β QQuery 39 β 287.00 ms β 285.04 ms β no change β
β QQuery 40 β 76.68 ms β 75.92 ms β no change β
β QQuery 41 β 91.64 ms β 90.87 ms β no change β
β QQuery 42 β 70.51 ms β 68.05 ms β no change β
β QQuery 43 β 54.65 ms β 52.96 ms β no change β
β QQuery 44 β 158.64 ms β 144.83 ms β +1.10x faster β
β QQuery 45 β 95.07 ms β 96.65 ms β no change β
β QQuery 46 β 67.41 ms β 66.28 ms β no change β
β QQuery 47 β 506.02 ms β 501.14 ms β no change β
β QQuery 48 β 256.93 ms β 249.75 ms β no change β
β QQuery 49 β 279.68 ms β 282.22 ms β no change β
β QQuery 50 β 325.66 ms β 320.30 ms β no change β
β QQuery 51 β 335.63 ms β 312.82 ms β +1.07x faster β
β QQuery 52 β 69.09 ms β 69.18 ms β no change β
β QQuery 53 β 111.15 ms β 111.90 ms β no change β
β QQuery 54 β 277.57 ms β 283.84 ms β no change β
β QQuery 55 β 66.21 ms β 64.26 ms β no change β
β QQuery 56 β 121.13 ms β 124.18 ms β no change β
β QQuery 57 β 417.79 ms β 415.35 ms β no change β
β QQuery 58 β 240.83 ms β 254.09 ms β 1.06x slower β
β QQuery 59 β 224.32 ms β 218.20 ms β no change β
β QQuery 60 β 121.43 ms β 124.53 ms β no change β
β QQuery 61 β 34.40 ms β 32.43 ms β +1.06x faster β
β QQuery 62 β 101.87 ms β 102.51 ms β no change β
β QQuery 63 β 114.77 ms β 110.97 ms β no change β
β QQuery 64 β 2512.03 ms β 2540.55 ms β no change β
β QQuery 65 β 566.36 ms β 577.97 ms β no change β
β QQuery 66 β 226.22 ms β 214.34 ms β +1.06x faster β
β QQuery 67 β 386.53 ms β 376.11 ms β no change β
β QQuery 68 β 67.66 ms β 70.20 ms β no change β
β QQuery 69 β 146.47 ms β 145.94 ms β no change β
β QQuery 70 β 283.48 ms β 284.76 ms β no change β
β QQuery 71 β 101.89 ms β 106.43 ms β no change β
β QQuery 72 β 5615.08 ms β 5577.70 ms β no change β
β QQuery 73 β 61.55 ms β 62.54 ms β no change β
β QQuery 74 β 345.61 ms β 333.39 ms β no change β
β QQuery 75 β 877.80 ms β 895.90 ms β no change β
β QQuery 76 β 155.08 ms β 166.61 ms β 1.07x slower β
β QQuery 77 β 367.45 ms β 365.34 ms β no change β
β QQuery 78 β 343.15 ms β 340.28 ms β no change β
β QQuery 79 β 129.17 ms β 121.50 ms β +1.06x faster β
β QQuery 80 β 510.31 ms β 505.57 ms β no change β
β QQuery 81 β 185.08 ms β 186.31 ms β no change β
β QQuery 82 β 73.39 ms β 65.75 ms β +1.12x faster β
β QQuery 83 β 183.22 ms β 179.03 ms β no change β
β QQuery 84 β 73.64 ms β 71.97 ms β no change β
β QQuery 85 β 448.01 ms β 481.88 ms β 1.08x slower β
β QQuery 86 β 109.25 ms β 107.99 ms β no change β
β QQuery 87 β 204.67 ms β 219.22 ms β 1.07x slower β
β QQuery 88 β 158.39 ms β 169.79 ms β 1.07x slower β
β QQuery 89 β 123.87 ms β 123.31 ms β no change β
β QQuery 90 β 48.19 ms β 46.38 ms β no change β
β QQuery 91 β 108.73 ms β 107.29 ms β no change β
β QQuery 92 β 84.86 ms β 87.66 ms β no change β
β QQuery 93 β 232.63 ms β 234.65 ms β no change β
β QQuery 94 β 122.09 ms β 125.55 ms β no change β
β QQuery 95 β 463.91 ms β 476.13 ms β no change β
β QQuery 96 β 42.31 ms β 45.16 ms β 1.07x slower β
β QQuery 97 β 159.09 ms β 171.16 ms β 1.08x slower β
β QQuery 98 β 127.61 ms β 140.03 ms β 1.10x slower β
β QQuery 99 β 120.56 ms β 127.83 ms β 1.06x slower β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 34956.99ms β
β Total Time (rich-T-kid_coacler-benchmark) β 30825.62ms β
β Average Time (HEAD) β 353.10ms β
β Average Time (rich-T-kid_coacler-benchmark) β 311.37ms β
β Queries Faster β 10 β
β Queries Slower β 11 β
β Queries with No Change β 78 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 63.80 / 65.09 Β±1.31 / 67.54 ms β 62.30 / 63.28 Β±1.16 / 65.54 ms β no change β
β QQuery 2 β 319.09 / 343.03 Β±19.58 / 375.84 ms β 306.32 / 321.55 Β±12.36 / 339.29 ms β +1.07x faster β
β QQuery 3 β 76.55 / 80.20 Β±2.86 / 83.53 ms β 75.44 / 85.11 Β±14.23 / 113.14 ms β 1.06x slower β
β QQuery 4 β 738.35 / 771.90 Β±23.05 / 810.11 ms β 753.29 / 770.62 Β±15.44 / 797.43 ms β no change β
β QQuery 5 β 369.59 / 397.35 Β±37.31 / 470.85 ms β 382.19 / 401.85 Β±16.33 / 427.12 ms β no change β
β QQuery 6 β 154.33 / 160.31 Β±5.81 / 171.30 ms β 156.79 / 175.42 Β±11.82 / 190.33 ms β 1.09x slower β
β QQuery 7 β 117.51 / 122.55 Β±8.30 / 139.11 ms β 113.91 / 121.17 Β±11.56 / 144.18 ms β no change β
β QQuery 8 β 160.46 / 166.70 Β±7.30 / 178.21 ms β 156.85 / 168.92 Β±10.05 / 183.86 ms β no change β
β QQuery 9 β 236.86 / 243.89 Β±8.33 / 260.10 ms β 212.81 / 252.73 Β±22.71 / 275.32 ms β no change β
β QQuery 10 β 141.26 / 151.81 Β±11.45 / 171.88 ms β 143.74 / 149.31 Β±4.55 / 154.39 ms β no change β
β QQuery 11 β 469.86 / 511.99 Β±39.63 / 582.43 ms β 471.81 / 496.37 Β±16.20 / 519.77 ms β no change β
β QQuery 12 β 111.35 / 129.36 Β±21.94 / 169.49 ms β 108.31 / 114.88 Β±9.29 / 133.15 ms β +1.13x faster β
β QQuery 13 β 266.85 / 277.24 Β±9.21 / 294.29 ms β 275.75 / 282.71 Β±8.83 / 299.85 ms β no change β
β QQuery 14 β 5378.36 / 5654.51 Β±143.74 / 5753.69 ms β 1226.21 / 1299.66 Β±46.64 / 1354.92 ms β +4.35x faster β
β QQuery 15 β 123.52 / 127.91 Β±7.23 / 142.33 ms β 103.77 / 115.47 Β±12.39 / 134.12 ms β +1.11x faster β
β QQuery 16 β 71.81 / 77.16 Β±6.08 / 86.31 ms β 66.51 / 76.66 Β±15.94 / 108.42 ms β no change β
β QQuery 17 β 560.19 / 577.40 Β±21.10 / 613.60 ms β 561.76 / 576.64 Β±17.51 / 610.12 ms β no change β
β QQuery 18 β 525.10 / 538.77 Β±11.25 / 553.98 ms β 521.20 / 546.84 Β±25.77 / 596.11 ms β no change β
β QQuery 19 β 97.68 / 104.53 Β±4.91 / 111.80 ms β 97.59 / 104.10 Β±5.38 / 110.51 ms β no change β
β QQuery 20 β 115.49 / 123.12 Β±8.63 / 139.53 ms β 114.58 / 121.39 Β±6.88 / 132.89 ms β no change β
β QQuery 21 β 64.85 / 68.67 Β±2.55 / 72.02 ms β 65.68 / 68.88 Β±1.76 / 70.61 ms β no change β
β QQuery 22 β 122.26 / 125.31 Β±2.41 / 129.57 ms β 120.67 / 123.97 Β±2.21 / 127.43 ms β no change β
β QQuery 23 β 919.08 / 962.22 Β±33.20 / 994.65 ms β 917.55 / 962.06 Β±30.03 / 995.36 ms β no change β
β QQuery 24 β 534.33 / 569.07 Β±34.37 / 630.27 ms β 537.15 / 562.60 Β±30.85 / 619.99 ms β no change β
β QQuery 25 β 594.42 / 609.37 Β±16.07 / 629.45 ms β 624.03 / 635.79 Β±12.80 / 656.17 ms β no change β
β QQuery 26 β 88.65 / 92.97 Β±4.59 / 101.65 ms β 87.21 / 99.18 Β±11.03 / 114.85 ms β 1.07x slower β
β QQuery 27 β 56.83 / 61.55 Β±2.60 / 64.64 ms β 54.88 / 68.83 Β±14.11 / 95.33 ms β 1.12x slower β
β QQuery 28 β 122.24 / 126.13 Β±4.54 / 133.35 ms β 116.87 / 126.23 Β±5.20 / 132.48 ms β no change β
β QQuery 29 β 598.80 / 621.25 Β±19.69 / 649.56 ms β 583.41 / 609.73 Β±30.22 / 668.76 ms β no change β
β QQuery 30 β 185.62 / 193.80 Β±8.64 / 208.84 ms β 176.90 / 186.55 Β±8.33 / 197.72 ms β no change β
β QQuery 31 β 498.33 / 517.18 Β±10.45 / 528.71 ms β 497.19 / 502.29 Β±6.38 / 514.84 ms β no change β
β QQuery 32 β 78.72 / 86.20 Β±10.62 / 107.21 ms β 79.03 / 94.08 Β±13.87 / 111.30 ms β 1.09x slower β
β QQuery 33 β 158.54 / 169.02 Β±10.92 / 184.57 ms β 157.19 / 167.19 Β±16.01 / 199.03 ms β no change β
β QQuery 34 β 63.30 / 74.47 Β±10.97 / 94.99 ms β 66.64 / 74.20 Β±13.18 / 100.50 ms β no change β
β QQuery 35 β 155.06 / 177.71 Β±12.83 / 190.82 ms β 166.38 / 183.29 Β±16.72 / 205.93 ms β no change β
β QQuery 36 β 89.70 / 95.08 Β±4.60 / 101.16 ms β 91.35 / 98.05 Β±7.74 / 112.83 ms β no change β
β QQuery 37 β 46.80 / 48.64 Β±1.07 / 50.01 ms β 48.10 / 49.39 Β±1.72 / 52.77 ms β no change β
β QQuery 38 β 210.04 / 225.90 Β±10.71 / 240.99 ms β 213.82 / 227.69 Β±14.80 / 256.42 ms β no change β
β QQuery 39 β 287.00 / 304.72 Β±18.00 / 329.83 ms β 285.04 / 300.92 Β±12.63 / 315.59 ms β no change β
β QQuery 40 β 76.68 / 81.23 Β±6.34 / 93.59 ms β 75.92 / 78.82 Β±3.25 / 84.85 ms β no change β
β QQuery 41 β 91.64 / 95.55 Β±3.89 / 101.45 ms β 90.87 / 98.80 Β±11.50 / 121.57 ms β no change β
β QQuery 42 β 70.51 / 74.46 Β±2.81 / 79.03 ms β 68.05 / 73.14 Β±5.70 / 83.69 ms β no change β
β QQuery 43 β 54.65 / 56.02 Β±0.76 / 56.74 ms β 52.96 / 58.30 Β±5.18 / 66.87 ms β no change β
β QQuery 44 β 158.64 / 166.85 Β±5.84 / 176.88 ms β 144.83 / 158.88 Β±12.74 / 179.83 ms β no change β
β QQuery 45 β 95.07 / 101.44 Β±6.23 / 113.17 ms β 96.65 / 100.85 Β±2.93 / 105.15 ms β no change β
β QQuery 46 β 67.41 / 75.37 Β±7.27 / 86.60 ms β 66.28 / 70.08 Β±2.72 / 73.90 ms β +1.08x faster β
β QQuery 47 β 506.02 / 515.84 Β±7.55 / 525.77 ms β 501.14 / 515.55 Β±12.17 / 534.96 ms β no change β
β QQuery 48 β 256.93 / 265.04 Β±7.24 / 276.78 ms β 249.75 / 269.44 Β±15.53 / 294.70 ms β no change β
β QQuery 49 β 279.68 / 304.36 Β±20.02 / 340.38 ms β 282.22 / 292.87 Β±11.06 / 307.71 ms β no change β
β QQuery 50 β 325.66 / 336.33 Β±9.29 / 351.19 ms β 320.30 / 328.30 Β±9.01 / 345.34 ms β no change β
β QQuery 51 β 335.63 / 347.00 Β±8.69 / 359.71 ms β 312.82 / 320.55 Β±4.94 / 326.19 ms β +1.08x faster β
β QQuery 52 β 69.09 / 75.06 Β±4.04 / 79.23 ms β 69.18 / 78.49 Β±10.72 / 96.26 ms β no change β
β QQuery 53 β 111.15 / 117.14 Β±8.08 / 133.03 ms β 111.90 / 119.07 Β±5.33 / 126.68 ms β no change β
β QQuery 54 β 277.57 / 283.69 Β±6.58 / 295.47 ms β 283.84 / 292.73 Β±8.27 / 304.44 ms β no change β
β QQuery 55 β 66.21 / 73.66 Β±5.90 / 82.30 ms β 64.26 / 69.46 Β±3.54 / 75.24 ms β +1.06x faster β
β QQuery 56 β 121.13 / 129.15 Β±8.22 / 143.38 ms β 124.18 / 130.72 Β±9.31 / 148.72 ms β no change β
β QQuery 57 β 417.79 / 440.12 Β±21.94 / 466.93 ms β 415.35 / 439.65 Β±25.83 / 489.21 ms β no change β
β QQuery 58 β 240.83 / 252.64 Β±12.99 / 277.45 ms β 254.09 / 265.72 Β±9.30 / 279.40 ms β 1.05x slower β
β QQuery 59 β 224.32 / 230.85 Β±3.93 / 236.27 ms β 218.20 / 227.27 Β±13.42 / 253.93 ms β no change β
β QQuery 60 β 121.43 / 126.10 Β±2.53 / 128.28 ms β 124.53 / 131.77 Β±7.61 / 144.84 ms β no change β
β QQuery 61 β 34.40 / 43.15 Β±12.08 / 65.50 ms β 32.43 / 37.21 Β±7.81 / 52.78 ms β +1.16x faster β
β QQuery 62 β 101.87 / 106.41 Β±3.97 / 113.14 ms β 102.51 / 108.01 Β±9.63 / 127.24 ms β no change β
β QQuery 63 β 114.77 / 123.68 Β±7.06 / 131.38 ms β 110.97 / 118.40 Β±5.27 / 124.28 ms β no change β
β QQuery 64 β 2512.03 / 2573.10 Β±40.45 / 2634.41 ms β 2540.55 / 2606.69 Β±55.16 / 2700.51 ms β no change β
β QQuery 65 β 566.36 / 590.68 Β±26.19 / 638.69 ms β 577.97 / 599.68 Β±24.03 / 645.20 ms β no change β
β QQuery 66 β 226.22 / 234.52 Β±5.81 / 241.92 ms β 214.34 / 226.11 Β±8.58 / 239.25 ms β no change β
β QQuery 67 β 386.53 / 412.68 Β±14.86 / 427.42 ms β 376.11 / 393.61 Β±18.37 / 426.30 ms β no change β
β QQuery 68 β 67.66 / 84.69 Β±14.80 / 105.67 ms β 70.20 / 77.08 Β±12.03 / 101.10 ms β +1.10x faster β
β QQuery 69 β 146.47 / 152.70 Β±8.14 / 168.48 ms β 145.94 / 159.80 Β±12.77 / 183.25 ms β no change β
β QQuery 70 β 283.48 / 294.10 Β±10.67 / 307.79 ms β 284.76 / 300.25 Β±8.63 / 309.04 ms β no change β
β QQuery 71 β 101.89 / 107.34 Β±5.78 / 115.25 ms β 106.43 / 113.67 Β±6.79 / 125.08 ms β 1.06x slower β
β QQuery 72 β 5615.08 / 5689.16 Β±39.47 / 5734.04 ms β 5577.70 / 5698.02 Β±81.60 / 5789.40 ms β no change β
β QQuery 73 β 61.55 / 81.10 Β±21.08 / 108.82 ms β 62.54 / 64.89 Β±1.59 / 66.64 ms β +1.25x faster β
β QQuery 74 β 345.61 / 362.25 Β±12.13 / 379.69 ms β 333.39 / 370.80 Β±25.03 / 408.69 ms β no change β
β QQuery 75 β 877.80 / 913.42 Β±31.99 / 956.22 ms β 895.90 / 927.36 Β±23.44 / 952.12 ms β no change β
β QQuery 76 β 155.08 / 186.58 Β±32.37 / 248.57 ms β 166.61 / 189.56 Β±18.58 / 220.03 ms β no change β
β QQuery 77 β 367.45 / 393.96 Β±20.10 / 420.85 ms β 365.34 / 394.28 Β±22.26 / 429.02 ms β no change β
β QQuery 78 β 343.15 / 368.44 Β±25.06 / 407.94 ms β 340.28 / 356.05 Β±13.03 / 371.86 ms β no change β
β QQuery 79 β 129.17 / 135.85 Β±4.31 / 142.26 ms β 121.50 / 136.39 Β±10.31 / 147.99 ms β no change β
β QQuery 80 β 510.31 / 540.50 Β±28.05 / 584.10 ms β 505.57 / 549.97 Β±23.67 / 573.92 ms β no change β
β QQuery 81 β 185.08 / 213.31 Β±45.39 / 303.78 ms β 186.31 / 199.60 Β±13.73 / 225.61 ms β +1.07x faster β
β QQuery 82 β 73.39 / 75.55 Β±1.79 / 78.65 ms β 65.75 / 71.26 Β±6.49 / 83.92 ms β +1.06x faster β
β QQuery 83 β 183.22 / 197.28 Β±12.46 / 217.09 ms β 179.03 / 192.92 Β±15.93 / 213.98 ms β no change β
β QQuery 84 β 73.64 / 85.11 Β±10.85 / 102.96 ms β 71.97 / 79.19 Β±9.60 / 98.10 ms β +1.07x faster β
β QQuery 85 β 448.01 / 508.65 Β±62.47 / 607.92 ms β 481.88 / 533.83 Β±54.32 / 635.38 ms β no change β
β QQuery 86 β 109.25 / 119.75 Β±10.49 / 138.10 ms β 107.99 / 113.75 Β±7.48 / 128.02 ms β +1.05x faster β
β QQuery 87 β 204.67 / 218.08 Β±6.91 / 223.63 ms β 219.22 / 228.47 Β±5.93 / 237.70 ms β no change β
β QQuery 88 β 158.39 / 171.92 Β±9.37 / 183.91 ms β 169.79 / 172.78 Β±2.85 / 177.57 ms β no change β
β QQuery 89 β 123.87 / 131.44 Β±6.48 / 141.86 ms β 123.31 / 130.90 Β±4.06 / 135.31 ms β no change β
β QQuery 90 β 48.19 / 52.73 Β±6.80 / 66.19 ms β 46.38 / 51.84 Β±7.94 / 67.37 ms β no change β
β QQuery 91 β 108.73 / 113.78 Β±3.35 / 117.92 ms β 107.29 / 114.19 Β±4.71 / 120.09 ms β no change β
β QQuery 92 β 84.86 / 89.34 Β±3.64 / 95.14 ms β 87.66 / 92.63 Β±5.29 / 102.16 ms β no change β
β QQuery 93 β 232.63 / 238.85 Β±5.78 / 248.47 ms β 234.65 / 239.78 Β±3.23 / 243.91 ms β no change β
β QQuery 94 β 122.09 / 133.43 Β±10.49 / 153.27 ms β 125.55 / 130.64 Β±5.95 / 142.04 ms β no change β
β QQuery 95 β 463.91 / 486.78 Β±16.03 / 503.91 ms β 476.13 / 487.02 Β±9.43 / 500.96 ms β no change β
β QQuery 96 β 42.31 / 44.16 Β±1.46 / 46.17 ms β 45.16 / 51.75 Β±7.93 / 67.33 ms β 1.17x slower β
β QQuery 97 β 159.09 / 172.48 Β±7.00 / 177.67 ms β 171.16 / 177.82 Β±5.07 / 186.23 ms β no change β
β QQuery 98 β 127.61 / 135.68 Β±5.43 / 142.36 ms β 140.03 / 148.66 Β±13.05 / 174.29 ms β 1.10x slower β
β QQuery 99 β 120.56 / 127.94 Β±6.54 / 138.05 ms β 127.83 / 137.18 Β±6.43 / 147.23 ms β 1.07x slower β
βββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 36612.49ms β
β Total Time (rich-T-kid_coacler-benchmark) β 32288.06ms β
β Average Time (HEAD) β 369.82ms β
β Average Time (rich-T-kid_coacler-benchmark) β 326.14ms β
β Queries Faster β 14 β
β Queries Slower β 10 β
β Queries with No Change β 75 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpcds β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 185.0s |
| Peak memory | 9.6 GiB |
| Avg memory | 1.5 GiB |
| CPU user | 970.8s |
| CPU sys | 59.1s |
| Peak spill | 0 B |
**tpcds β branch**
| Metric | Value |
|--------|-------|
| Wall time | 165.0s |
| Peak memory | 11.2 GiB |
| Avg memory | 1.5 GiB |
| CPU user | 933.2s |
| CPU sys | 56.9s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746467444
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5746451749)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5746451749-2517-4rtsh 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (50b4aadf9bd59b1681e8c222be535966e84155d7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..50b4aadf9bd59b1681e8c222be535966e84155d7)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745518550
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745457778)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.49 ms β 1.52 ms β no change β
β QQuery 1 β 25.11 ms β 24.28 ms β no change β
β QQuery 2 β 47.38 ms β 46.87 ms β no change β
β QQuery 3 β 37.98 ms β 38.67 ms β no change β
β QQuery 4 β 235.44 ms β 296.26 ms β 1.26x slower β
β QQuery 5 β 315.61 ms β 347.24 ms β 1.10x slower β
β QQuery 6 β 1.55 ms β 1.55 ms β no change β
β QQuery 7 β 59.51 ms β 56.90 ms β no change β
β QQuery 8 β 371.54 ms β 443.69 ms β 1.19x slower β
β QQuery 9 β 394.96 ms β 400.33 ms β no change β
β QQuery 10 β 145.60 ms β 149.77 ms β no change β
β QQuery 11 β 158.45 ms β 161.94 ms β no change β
β QQuery 12 β 307.45 ms β 345.14 ms β 1.12x slower β
β QQuery 13 β 538.06 ms β 649.22 ms β 1.21x slower β
β QQuery 14 β 302.10 ms β 344.07 ms β 1.14x slower β
β QQuery 15 β 280.51 ms β 350.73 ms β 1.25x slower β
β QQuery 16 β 588.22 ms β 744.70 ms β 1.27x slower β
β QQuery 17 β 516.84 ms β 710.51 ms β 1.37x slower β
β QQuery 18 β 1106.09 ms β 1452.24 ms β 1.31x slower β
β QQuery 19 β 39.58 ms β 40.61 ms β no change β
β QQuery 20 β 538.09 ms β 509.81 ms β +1.06x faster β
β QQuery 21 β 562.74 ms β 546.16 ms β no change β
β QQuery 22 β 1041.07 ms β 1018.76 ms β no change β
β QQuery 23 β 1545.78 ms β 1437.43 ms β +1.08x faster β
β QQuery 24 β 49.42 ms β 53.19 ms β 1.08x slower β
β QQuery 25 β 117.94 ms β 115.53 ms β no change β
β QQuery 26 β 52.01 ms β 47.18 ms β +1.10x faster β
β QQuery 27 β 536.30 ms β 537.31 ms β no change β
β QQuery 28 β 2843.18 ms β 2799.42 ms β no change β
β QQuery 29 β 53.38 ms β 52.58 ms β no change β
β QQuery 30 β 327.92 ms β 366.73 ms β 1.12x slower β
β QQuery 31 β 363.25 ms β 442.11 ms β 1.22x slower β
β QQuery 32 β 1146.11 ms β 1689.45 ms β 1.47x slower β
β QQuery 33 β 1466.54 ms β 1605.67 ms β 1.09x slower β
β QQuery 34 β 1538.36 ms β 1646.39 ms β 1.07x slower β
β QQuery 35 β 260.52 ms β 333.51 ms β 1.28x slower β
β QQuery 36 β 114.51 ms β 113.50 ms β no change β
β QQuery 37 β 84.17 ms β 85.39 ms β no change β
β QQuery 38 β 92.63 ms β 90.16 ms β no change β
β QQuery 39 β 192.46 ms β 186.64 ms β no change β
β QQuery 40 β 63.19 ms β 61.89 ms β no change β
β QQuery 41 β 63.81 ms β 58.04 ms β +1.10x faster β
β QQuery 42 β 63.16 ms β 61.66 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 18590.03ms β
β Total Time (rich-T-kid_coacler-benchmark) β 20464.76ms β
β Average Time (HEAD) β 432.33ms β
β Average Time (rich-T-kid_coacler-benchmark) β 475.92ms β
β Queries Faster β 4 β
β Queries Slower β 17 β
β Queries with No Change β 22 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.49 / 4.21 Β±5.37 / 14.95 ms β 1.52 / 4.35 Β±5.53 / 15.40 ms β no change β
β QQuery 1 β 25.11 / 26.68 Β±1.71 / 28.83 ms β 24.28 / 26.41 Β±1.84 / 28.80 ms β no change β
β QQuery 2 β 47.38 / 49.05 Β±1.51 / 51.37 ms β 46.87 / 48.35 Β±1.30 / 50.28 ms β no change β
β QQuery 3 β 37.98 / 39.08 Β±1.06 / 41.05 ms β 38.67 / 40.98 Β±1.35 / 42.91 ms β no change β
β QQuery 4 β 235.44 / 239.37 Β±2.48 / 242.16 ms β 296.26 / 299.96 Β±2.92 / 303.53 ms β 1.25x slower β
β QQuery 5 β 315.61 / 323.79 Β±4.95 / 330.51 ms β 347.24 / 348.47 Β±1.25 / 350.67 ms β 1.08x slower β
β QQuery 6 β 1.55 / 1.76 Β±0.32 / 2.38 ms β 1.55 / 1.76 Β±0.31 / 2.37 ms β no change β
β QQuery 7 β 59.51 / 65.80 Β±6.10 / 75.19 ms β 56.90 / 60.94 Β±3.54 / 67.55 ms β +1.08x faster β
β QQuery 8 β 371.54 / 378.59 Β±4.83 / 386.43 ms β 443.69 / 456.08 Β±10.56 / 474.55 ms β 1.20x slower β
β QQuery 9 β 394.96 / 407.61 Β±8.47 / 418.26 ms β 400.33 / 414.73 Β±11.00 / 433.09 ms β no change β
β QQuery 10 β 145.60 / 150.89 Β±7.75 / 166.30 ms β 149.77 / 151.19 Β±1.51 / 154.10 ms β no change β
β QQuery 11 β 158.45 / 160.73 Β±3.07 / 166.67 ms β 161.94 / 166.70 Β±3.66 / 171.93 ms β no change β
β QQuery 12 β 307.45 / 314.17 Β±4.21 / 319.55 ms β 345.14 / 347.47 Β±2.32 / 351.60 ms β 1.11x slower β
β QQuery 13 β 538.06 / 549.54 Β±7.49 / 558.43 ms β 649.22 / 667.29 Β±14.21 / 683.69 ms β 1.21x slower β
β QQuery 14 β 302.10 / 309.09 Β±7.25 / 320.15 ms β 344.07 / 365.01 Β±30.26 / 424.79 ms β 1.18x slower β
β QQuery 15 β 280.51 / 295.09 Β±14.29 / 319.76 ms β 350.73 / 357.87 Β±5.14 / 364.78 ms β 1.21x slower β
β QQuery 16 β 588.22 / 605.29 Β±16.22 / 634.82 ms β 744.70 / 763.21 Β±22.59 / 807.50 ms β 1.26x slower β
β QQuery 17 β 516.84 / 582.09 Β±34.90 / 616.04 ms β 710.51 / 749.23 Β±57.96 / 864.27 ms β 1.29x slower β
β QQuery 18 β 1106.09 / 1160.46 Β±46.44 / 1242.42 ms β 1452.24 / 1473.02 Β±32.91 / 1537.66 ms β 1.27x slower β
β QQuery 19 β 39.58 / 51.21 Β±20.76 / 92.70 ms β 40.61 / 44.21 Β±4.06 / 51.82 ms β +1.16x faster β
β QQuery 20 β 538.09 / 592.19 Β±60.03 / 706.92 ms β 509.81 / 550.60 Β±34.39 / 599.67 ms β +1.08x faster β
β QQuery 21 β 562.74 / 590.15 Β±21.08 / 625.59 ms β 546.16 / 572.30 Β±18.79 / 597.81 ms β no change β
β QQuery 22 β 1041.07 / 1066.97 Β±38.66 / 1143.10 ms β 1018.76 / 1083.83 Β±71.41 / 1215.45 ms β no change β
β QQuery 23 β 1545.78 / 1785.25 Β±160.31 / 1984.45 ms β 1437.43 / 1631.06 Β±150.42 / 1834.79 ms β +1.09x faster β
β QQuery 24 β 49.42 / 52.11 Β±1.73 / 54.08 ms β 53.19 / 108.20 Β±107.94 / 324.08 ms β 2.08x slower β
β QQuery 25 β 117.94 / 121.97 Β±6.34 / 134.57 ms β 115.53 / 121.46 Β±7.83 / 136.71 ms β no change β
β QQuery 26 β 52.01 / 54.32 Β±1.88 / 57.26 ms β 47.18 / 49.70 Β±2.03 / 53.20 ms β +1.09x faster β
β QQuery 27 β 536.30 / 565.65 Β±16.95 / 586.26 ms β 537.31 / 549.60 Β±10.38 / 567.23 ms β no change β
β QQuery 28 β 2843.18 / 2904.26 Β±49.07 / 2966.07 ms β 2799.42 / 2887.42 Β±57.99 / 2959.92 ms β no change β
β QQuery 29 β 53.38 / 72.16 Β±20.72 / 100.48 ms β 52.58 / 73.58 Β±37.11 / 147.75 ms β no change β
β QQuery 30 β 327.92 / 351.63 Β±16.74 / 373.04 ms β 366.73 / 383.68 Β±11.18 / 399.13 ms β 1.09x slower β
β QQuery 31 β 363.25 / 388.17 Β±21.29 / 423.56 ms β 442.11 / 454.00 Β±9.19 / 468.90 ms β 1.17x slower β
β QQuery 32 β 1146.11 / 1239.99 Β±103.61 / 1434.35 ms β 1689.45 / 1737.98 Β±33.79 / 1784.48 ms β 1.40x slower β
β QQuery 33 β 1466.54 / 1559.54 Β±78.04 / 1687.73 ms β 1605.67 / 1740.38 Β±173.72 / 2076.96 ms β 1.12x slower β
β QQuery 34 β 1538.36 / 1692.80 Β±151.53 / 1958.88 ms β 1646.39 / 1673.39 Β±23.21 / 1712.95 ms β no change β
β QQuery 35 β 260.52 / 386.97 Β±241.32 / 869.57 ms β 333.51 / 370.36 Β±44.57 / 448.44 ms β no change β
β QQuery 36 β 114.51 / 120.32 Β±3.70 / 126.12 ms β 113.50 / 118.26 Β±3.82 / 123.97 ms β no change β
β QQuery 37 β 84.17 / 97.45 Β±23.85 / 145.07 ms β 85.39 / 87.83 Β±2.00 / 91.23 ms β +1.11x faster β
β QQuery 38 β 92.63 / 98.73 Β±6.13 / 110.19 ms β 90.16 / 96.54 Β±4.45 / 102.57 ms β no change β
β QQuery 39 β 192.46 / 214.01 Β±17.58 / 245.61 ms β 186.64 / 196.94 Β±11.61 / 217.67 ms β +1.09x faster β
β QQuery 40 β 63.19 / 67.40 Β±5.36 / 77.99 ms β 61.89 / 70.90 Β±13.54 / 97.66 ms β 1.05x slower β
β QQuery 41 β 63.81 / 79.00 Β±13.34 / 97.47 ms β 58.04 / 61.57 Β±3.00 / 66.99 ms β +1.28x faster β
β QQuery 42 β 63.16 / 63.64 Β±0.47 / 64.38 ms β 61.66 / 64.36 Β±2.22 / 67.32 ms β no change β
βββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 19879.15ms β
β Total Time (rich-T-kid_coacler-benchmark) β 21471.17ms β
β Average Time (HEAD) β 462.31ms β
β Average Time (rich-T-kid_coacler-benchmark) β 499.33ms β
β Queries Faster β 8 β
β Queries Slower β 16 β
β Queries with No Change β 19 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**clickbench_partitioned β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 100.0s |
| Peak memory | 14.6 GiB |
| Avg memory | 7.9 GiB |
| CPU user | 922.9s |
| CPU sys | 96.3s |
| Peak spill | 0 B |
**clickbench_partitioned β branch**
| Metric | Value |
|--------|-------|
| Wall time | 110.0s |
| Peak memory | 15.1 GiB |
| Avg memory | 8.2 GiB |
| CPU user | 1043.1s |
| CPU sys | 95.0s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745498358
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745457778)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³ββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 91.90 ms β 89.57 ms β no change β
β QQuery 2 β 97.73 ms β 94.43 ms β no change β
β QQuery 3 β 89.47 ms β 89.71 ms β no change β
β QQuery 4 β 69.16 ms β 65.40 ms β +1.06x faster β
β QQuery 5 β 95.24 ms β 97.12 ms β no change β
β QQuery 6 β 31.41 ms β 30.21 ms β no change β
β QQuery 7 β 270.17 ms β 271.02 ms β no change β
β QQuery 8 β 255.72 ms β 252.91 ms β no change β
β QQuery 9 β 393.05 ms β 417.87 ms β 1.06x slower β
β QQuery 10 β 101.02 ms β 107.09 ms β 1.06x slower β
β QQuery 11 β 88.91 ms β 95.55 ms β 1.07x slower β
β QQuery 12 β 367.03 ms β 213.44 ms β +1.72x faster β
β QQuery 13 β 135.17 ms β 134.03 ms β no change β
β QQuery 14 β 51.33 ms β 53.97 ms β 1.05x slower β
β QQuery 15 β 149.17 ms β 138.41 ms β +1.08x faster β
β QQuery 16 β 117.87 ms β 119.15 ms β no change β
β QQuery 17 β 234.44 ms β 253.04 ms β 1.08x slower β
β QQuery 18 β 359.83 ms β 466.24 ms β 1.30x slower β
β QQuery 19 β 59.66 ms β 57.12 ms β no change β
β QQuery 20 β 107.71 ms β 109.71 ms β no change β
β QQuery 21 β 144.85 ms β 138.45 ms β no change β
β QQuery 22 β 90.69 ms β 90.05 ms β no change β
βββββββββββββ΄ββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 3401.53ms β
β Total Time (rich-T-kid_coacler-benchmark) β 3384.50ms β
β Average Time (HEAD) β 154.62ms β
β Average Time (rich-T-kid_coacler-benchmark) β 153.84ms β
β Queries Faster β 3 β
β Queries Slower β 6 β
β Queries with No Change β 13 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 91.90 / 94.00 Β±2.23 / 97.68 ms β 89.57 / 91.96 Β±2.48 / 96.59 ms β no change β
β QQuery 2 β 97.73 / 100.88 Β±3.11 / 105.84 ms β 94.43 / 98.34 Β±4.00 / 105.85 ms β no change β
β QQuery 3 β 89.47 / 96.25 Β±3.62 / 99.89 ms β 89.71 / 94.63 Β±3.83 / 99.65 ms β no change β
β QQuery 4 β 69.16 / 70.28 Β±0.88 / 71.78 ms β 65.40 / 67.36 Β±1.73 / 70.54 ms β no change β
β QQuery 5 β 95.24 / 102.26 Β±5.16 / 111.27 ms β 97.12 / 100.73 Β±2.34 / 103.10 ms β no change β
β QQuery 6 β 31.41 / 33.54 Β±1.67 / 36.06 ms β 30.21 / 33.19 Β±1.56 / 34.45 ms β no change β
β QQuery 7 β 270.17 / 287.01 Β±16.76 / 310.07 ms β 271.02 / 305.63 Β±28.06 / 355.10 ms β 1.06x slower β
β QQuery 8 β 255.72 / 284.73 Β±20.48 / 319.81 ms β 252.91 / 276.02 Β±12.33 / 286.64 ms β no change β
β QQuery 9 β 393.05 / 402.72 Β±6.48 / 411.50 ms β 417.87 / 437.64 Β±31.86 / 500.77 ms β 1.09x slower β
β QQuery 10 β 101.02 / 108.31 Β±6.30 / 119.99 ms β 107.09 / 120.99 Β±16.87 / 149.93 ms β 1.12x slower β
β QQuery 11 β 88.91 / 96.28 Β±6.27 / 107.62 ms β 95.55 / 100.75 Β±5.15 / 110.15 ms β no change β
β QQuery 12 β 367.03 / 381.86 Β±13.55 / 402.20 ms β 213.44 / 233.53 Β±11.13 / 245.69 ms β +1.64x faster β
β QQuery 13 β 135.17 / 143.38 Β±11.31 / 165.38 ms β 134.03 / 138.83 Β±2.46 / 140.60 ms β no change β
β QQuery 14 β 51.33 / 57.64 Β±9.99 / 77.46 ms β 53.97 / 63.13 Β±5.85 / 71.91 ms β 1.10x slower β
β QQuery 15 β 149.17 / 152.51 Β±3.72 / 159.41 ms β 138.41 / 146.16 Β±5.01 / 152.78 ms β no change β
β QQuery 16 β 117.87 / 122.67 Β±3.61 / 127.34 ms β 119.15 / 126.76 Β±5.74 / 135.00 ms β no change β
β QQuery 17 β 234.44 / 238.53 Β±4.64 / 246.59 ms β 253.04 / 267.49 Β±9.96 / 283.13 ms β 1.12x slower β
β QQuery 18 β 359.83 / 378.16 Β±11.83 / 392.76 ms β 466.24 / 494.47 Β±21.17 / 525.73 ms β 1.31x slower β
β QQuery 19 β 59.66 / 64.87 Β±6.57 / 77.82 ms β 57.12 / 66.49 Β±14.18 / 94.64 ms β no change β
β QQuery 20 β 107.71 / 112.95 Β±3.66 / 116.56 ms β 109.71 / 116.45 Β±5.05 / 124.20 ms β no change β
β QQuery 21 β 144.85 / 157.16 Β±7.67 / 165.20 ms β 138.45 / 147.25 Β±6.72 / 157.92 ms β +1.07x faster β
β QQuery 22 β 90.69 / 96.28 Β±7.11 / 109.62 ms β 90.05 / 95.37 Β±3.48 / 99.15 ms β no change β
βββββββββββββ΄βββββββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 3582.29ms β
β Total Time (rich-T-kid_coacler-benchmark) β 3623.16ms β
β Average Time (HEAD) β 162.83ms β
β Average Time (rich-T-kid_coacler-benchmark) β 164.69ms β
β Queries Faster β 2 β
β Queries Slower β 6 β
β Queries with No Change β 14 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpch β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 20.0s |
| Peak memory | 2.7 GiB |
| Avg memory | 1.1 GiB |
| CPU user | 109.1s |
| CPU sys | 9.8s |
| Peak spill | 0 B |
**tpch β branch**
| Metric | Value |
|--------|-------|
| Wall time | 20.0s |
| Peak memory | 2.7 GiB |
| Avg memory | 1.3 GiB |
| CPU user | 103.9s |
| CPU sys | 10.2s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746435338
run benchmarks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746617112
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5746607186)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5746607186-2522-zf9sw 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (ef7543e040ffbfe7da6bd2c2b70bd2db2721cac7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ef7543e040ffbfe7da6bd2c2b70bd2db2721cac7)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch_mem10
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739408358
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739390843)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5739390843-2465-vvpcn 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739409898
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739391357)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5739391357-2469-gcz67 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739396992
doubled
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5743214675
run benchmarks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739475809
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739398003)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 5.49 ms β 6.08 ms β 1.11x slower β
β QQuery 2 β 80.12 ms β 80.71 ms β no change β
β QQuery 3 β 28.82 ms β 29.49 ms β no change β
β QQuery 4 β 479.45 ms β 504.29 ms β 1.05x slower β
β QQuery 5 β 50.93 ms β 51.47 ms β no change β
β QQuery 6 β 36.71 ms β 38.04 ms β no change β
β QQuery 7 β 74.94 ms β 75.32 ms β no change β
β QQuery 8 β 36.46 ms β 37.81 ms β no change β
β QQuery 9 β 52.13 ms β 54.89 ms β 1.05x slower β
β QQuery 10 β 62.83 ms β 61.99 ms β no change β
β QQuery 11 β 302.97 ms β 297.67 ms β no change β
β QQuery 12 β 29.95 ms β 29.37 ms β no change β
β QQuery 13 β 118.21 ms β 120.20 ms β no change β
β QQuery 14 β 396.22 ms β 398.55 ms β no change β
β QQuery 15 β 58.02 ms β 58.43 ms β no change β
β QQuery 16 β 6.90 ms β 6.70 ms β no change β
β QQuery 17 β 78.94 ms β 82.81 ms β no change β
β QQuery 18 β 105.21 ms β 108.45 ms β no change β
β QQuery 19 β 41.67 ms β 42.57 ms β no change β
β QQuery 20 β 36.43 ms β 37.12 ms β no change β
β QQuery 21 β 17.33 ms β 17.70 ms β no change β
β QQuery 22 β 64.53 ms β 67.80 ms β 1.05x slower β
β QQuery 23 β 320.23 ms β 333.42 ms β no change β
β QQuery 24 β 201.66 ms β 202.71 ms β no change β
β QQuery 25 β 107.75 ms β 111.67 ms β no change β
β QQuery 26 β 48.48 ms β 48.64 ms β no change β
β QQuery 27 β 6.41 ms β 6.46 ms β no change β
β QQuery 28 β 60.80 ms β 58.54 ms β no change β
β QQuery 29 β 96.31 ms β 98.15 ms β no change β
β QQuery 30 β 33.56 ms β 33.84 ms β no change β
β QQuery 31 β 111.48 ms β 112.04 ms β no change β
β QQuery 32 β 21.40 ms β 20.97 ms β no change β
β QQuery 33 β 37.76 ms β 37.38 ms β no change β
β QQuery 34 β 10.37 ms β 10.43 ms β no change β
β QQuery 35 β 75.58 ms β 74.38 ms β no change β
β QQuery 36 β 6.05 ms β 5.94 ms β no change β
β QQuery 37 β 7.22 ms β 7.50 ms β no change β
β QQuery 38 β 64.12 ms β 61.80 ms β no change β
β QQuery 39 β 76.35 ms β 74.35 ms β no change β
β QQuery 40 β 24.87 ms β 24.37 ms β no change β
β QQuery 41 β 11.92 ms β 11.50 ms β no change β
β QQuery 42 β 24.73 ms β 24.72 ms β no change β
β QQuery 43 β 5.40 ms β 5.02 ms β +1.08x faster β
β QQuery 44 β 9.91 ms β 9.16 ms β +1.08x faster β
β QQuery 45 β 42.38 ms β 39.02 ms β +1.09x faster β
β QQuery 46 β 12.40 ms β 11.70 ms β +1.06x faster β
β QQuery 47 β 246.84 ms β 229.92 ms β +1.07x faster β
β QQuery 48 β 96.48 ms β 94.73 ms β no change β
β QQuery 49 β 71.38 ms β 70.76 ms β no change β
β QQuery 50 β 58.87 ms β 59.08 ms β no change β
β QQuery 51 β 94.98 ms β 93.56 ms β no change β
β QQuery 52 β 24.51 ms β 24.15 ms β no change β
β QQuery 53 β 29.38 ms β 28.71 ms β no change β
β QQuery 54 β 54.65 ms β 54.57 ms β no change β
β QQuery 55 β 24.39 ms β 24.00 ms β no change β
β QQuery 56 β 39.29 ms β 38.57 ms β no change β
β QQuery 57 β 173.41 ms β 168.09 ms β no change β
β QQuery 58 β 109.35 ms β 109.90 ms β no change β
β QQuery 59 β 118.09 ms β 118.53 ms β no change β
β QQuery 60 β 39.39 ms β 38.80 ms β no change β
β QQuery 61 β 11.90 ms β 11.44 ms β no change β
β QQuery 62 β 44.79 ms β 44.01 ms β no change β
β QQuery 63 β 30.38 ms β 29.27 ms β no change β
β QQuery 64 β 371.57 ms β 366.33 ms β no change β
β QQuery 65 β 137.87 ms β 129.47 ms β +1.06x faster β
β QQuery 66 β 79.85 ms β 76.56 ms β no change β
β QQuery 67 β 263.30 ms β 257.75 ms β no change β
β QQuery 68 β 12.15 ms β 12.08 ms β no change β
β QQuery 69 β 57.12 ms β 56.37 ms β no change β
β QQuery 70 β 104.76 ms β 103.78 ms β no change β
β QQuery 71 β 35.74 ms β 35.05 ms β no change β
β QQuery 72 β 1874.00 ms β 1800.90 ms β no change β
β QQuery 73 β 10.75 ms β 10.24 ms β no change β
β QQuery 74 β 177.70 ms β 160.16 ms β +1.11x faster β
β QQuery 75 β 143.50 ms β 143.72 ms β no change β
β QQuery 76 β 34.93 ms β 35.54 ms β no change β
β QQuery 77 β 61.63 ms β 60.85 ms β no change β
β QQuery 78 β 168.60 ms β 165.44 ms β no change β
β QQuery 79 β 67.28 ms β 65.95 ms β no change β
β QQuery 80 β 96.61 ms β 98.43 ms β no change β
β QQuery 81 β 27.24 ms β 26.05 ms β no change β
β QQuery 82 β 16.86 ms β 16.76 ms β no change β
β QQuery 83 β 34.43 ms β 33.73 ms β no change β
β QQuery 84 β 30.12 ms β 29.75 ms β no change β
β QQuery 85 β 104.34 ms β 105.13 ms β no change β
β QQuery 86 β 25.91 ms β 25.85 ms β no change β
β QQuery 87 β 65.51 ms β 62.32 ms β no change β
β QQuery 88 β 62.08 ms β 61.58 ms β no change β
β QQuery 89 β 35.85 ms β 35.65 ms β no change β
β QQuery 90 β 17.03 ms β 17.16 ms β no change β
β QQuery 91 β 45.12 ms β 44.97 ms β no change β
β QQuery 92 β 29.78 ms β 29.93 ms β no change β
β QQuery 93 β 50.86 ms β 51.46 ms β no change β
β QQuery 94 β 40.36 ms β 39.26 ms β no change β
β QQuery 95 β 82.08 ms β 80.59 ms β no change β
β QQuery 96 β 24.08 ms β 24.13 ms β no change β
β QQuery 97 β 53.24 ms β 51.67 ms β no change β
β QQuery 98 β 46.38 ms β 43.03 ms β +1.08x faster β
β QQuery 99 β 66.33 ms β 65.41 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 9404.48ms β
β Total Time (rich-T-kid_coacler-benchmark) β 9292.33ms β
β Average Time (HEAD) β 94.99ms β
β Average Time (rich-T-kid_coacler-benchmark) β 93.86ms β
β Queries Faster β 8 β
β Queries Slower β 4 β
β Queries with No Change β 87 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 5.49 / 6.06 Β±0.96 / 7.99 ms β 6.08 / 6.66 Β±0.92 / 8.49 ms β 1.10x slower β
β QQuery 2 β 80.12 / 80.60 Β±0.25 / 80.85 ms β 80.71 / 81.71 Β±0.67 / 82.56 ms β no change β
β QQuery 3 β 28.82 / 29.24 Β±0.36 / 29.76 ms β 29.49 / 29.95 Β±0.24 / 30.21 ms β no change β
β QQuery 4 β 479.45 / 487.68 Β±6.47 / 495.91 ms β 504.29 / 512.10 Β±6.06 / 520.94 ms β 1.05x slower β
β QQuery 5 β 50.93 / 51.84 Β±0.77 / 53.14 ms β 51.47 / 52.23 Β±0.49 / 52.75 ms β no change β
β QQuery 6 β 36.71 / 37.10 Β±0.44 / 37.90 ms β 38.04 / 38.31 Β±0.19 / 38.54 ms β no change β
β QQuery 7 β 74.94 / 75.61 Β±0.95 / 77.42 ms β 75.32 / 76.33 Β±0.98 / 78.08 ms β no change β
β QQuery 8 β 36.46 / 37.70 Β±1.89 / 41.43 ms β 37.81 / 38.20 Β±0.45 / 39.03 ms β no change β
β QQuery 9 β 52.13 / 54.93 Β±2.62 / 58.94 ms β 54.89 / 56.69 Β±1.36 / 58.46 ms β no change β
β QQuery 10 β 62.83 / 63.51 Β±0.53 / 64.29 ms β 61.99 / 63.03 Β±0.66 / 63.76 ms β no change β
β QQuery 11 β 302.97 / 313.56 Β±6.27 / 322.34 ms β 297.67 / 307.02 Β±7.57 / 315.68 ms β no change β
β QQuery 12 β 29.95 / 30.58 Β±0.47 / 31.36 ms β 29.37 / 29.84 Β±0.37 / 30.29 ms β no change β
β QQuery 13 β 118.21 / 119.67 Β±1.16 / 121.51 ms β 120.20 / 121.02 Β±1.12 / 123.22 ms β no change β
β QQuery 14 β 396.22 / 401.10 Β±2.71 / 403.96 ms β 398.55 / 404.91 Β±3.42 / 408.15 ms β no change β
β QQuery 15 β 58.02 / 60.34 Β±1.62 / 63.04 ms β 58.43 / 59.62 Β±0.86 / 60.60 ms β no change β
β QQuery 16 β 6.90 / 7.12 Β±0.13 / 7.31 ms β 6.70 / 6.89 Β±0.15 / 7.15 ms β no change β
β QQuery 17 β 78.94 / 80.18 Β±1.19 / 82.00 ms β 82.81 / 83.64 Β±0.55 / 84.43 ms β no change β
β QQuery 18 β 105.21 / 106.80 Β±1.24 / 108.63 ms β 108.45 / 108.93 Β±0.39 / 109.58 ms β no change β
β QQuery 19 β 41.67 / 42.84 Β±0.79 / 43.99 ms β 42.57 / 43.12 Β±0.47 / 43.71 ms β no change β
β QQuery 20 β 36.43 / 37.56 Β±0.76 / 38.76 ms β 37.12 / 38.58 Β±0.74 / 39.20 ms β no change β
β QQuery 21 β 17.33 / 17.98 Β±0.75 / 19.37 ms β 17.70 / 18.65 Β±1.57 / 21.77 ms β no change β
β QQuery 22 β 64.53 / 65.62 Β±1.16 / 67.67 ms β 67.80 / 69.48 Β±1.45 / 71.78 ms β 1.06x slower β
β QQuery 23 β 320.23 / 323.76 Β±2.70 / 327.31 ms β 333.42 / 337.77 Β±3.23 / 341.69 ms β no change β
β QQuery 24 β 201.66 / 204.42 Β±2.11 / 207.68 ms β 202.71 / 208.77 Β±3.83 / 213.23 ms β no change β
β QQuery 25 β 107.75 / 110.83 Β±2.37 / 114.97 ms β 111.67 / 113.02 Β±1.41 / 115.62 ms β no change β
β QQuery 26 β 48.48 / 49.62 Β±0.75 / 50.53 ms β 48.64 / 49.16 Β±0.35 / 49.56 ms β no change β
β QQuery 27 β 6.41 / 6.54 Β±0.09 / 6.63 ms β 6.46 / 6.52 Β±0.05 / 6.58 ms β no change β
β QQuery 28 β 60.80 / 63.91 Β±3.31 / 70.27 ms β 58.54 / 61.72 Β±1.61 / 62.80 ms β no change β
β QQuery 29 β 96.31 / 98.54 Β±2.43 / 103.17 ms β 98.15 / 99.75 Β±2.16 / 103.93 ms β no change β
β QQuery 30 β 33.56 / 34.28 Β±0.54 / 35.10 ms β 33.84 / 34.33 Β±0.36 / 34.90 ms β no change β
β QQuery 31 β 111.48 / 114.70 Β±3.05 / 120.51 ms β 112.04 / 113.90 Β±1.91 / 117.55 ms β no change β
β QQuery 32 β 21.40 / 21.73 Β±0.25 / 22.03 ms β 20.97 / 21.30 Β±0.33 / 21.91 ms β no change β
β QQuery 33 β 37.76 / 38.48 Β±0.63 / 39.62 ms β 37.38 / 37.96 Β±0.45 / 38.63 ms β no change β
β QQuery 34 β 10.37 / 10.55 Β±0.19 / 10.83 ms β 10.43 / 10.62 Β±0.19 / 10.97 ms β no change β
β QQuery 35 β 75.58 / 77.90 Β±2.55 / 82.06 ms β 74.38 / 77.22 Β±3.09 / 82.12 ms β no change β
β QQuery 36 β 6.05 / 6.16 Β±0.15 / 6.45 ms β 5.94 / 6.72 Β±1.02 / 8.72 ms β 1.09x slower β
β QQuery 37 β 7.22 / 7.38 Β±0.10 / 7.48 ms β 7.50 / 7.65 Β±0.14 / 7.88 ms β no change β
β QQuery 38 β 64.12 / 65.14 Β±0.71 / 66.24 ms β 61.80 / 63.70 Β±1.94 / 67.40 ms β no change β
β QQuery 39 β 76.35 / 77.06 Β±0.60 / 77.78 ms β 74.35 / 77.18 Β±3.06 / 83.01 ms β no change β
β QQuery 40 β 24.87 / 25.53 Β±0.56 / 26.56 ms β 24.37 / 25.30 Β±0.71 / 26.48 ms β no change β
β QQuery 41 β 11.92 / 13.53 Β±2.91 / 19.36 ms β 11.50 / 11.70 Β±0.16 / 11.90 ms β +1.16x faster β
β QQuery 42 β 24.73 / 25.26 Β±0.31 / 25.59 ms β 24.72 / 25.39 Β±0.39 / 25.78 ms β no change β
β QQuery 43 β 5.40 / 5.53 Β±0.09 / 5.67 ms β 5.02 / 5.24 Β±0.16 / 5.50 ms β +1.06x faster β
β QQuery 44 β 9.91 / 10.45 Β±0.45 / 11.02 ms β 9.16 / 9.36 Β±0.12 / 9.51 ms β +1.12x faster β
β QQuery 45 β 42.38 / 45.77 Β±2.59 / 48.88 ms β 39.02 / 40.19 Β±0.81 / 41.33 ms β +1.14x faster β
β QQuery 46 β 12.40 / 12.90 Β±0.38 / 13.34 ms β 11.70 / 12.00 Β±0.32 / 12.39 ms β +1.08x faster β
β QQuery 47 β 246.84 / 258.26 Β±10.76 / 277.46 ms β 229.92 / 240.63 Β±8.57 / 251.40 ms β +1.07x faster β
β QQuery 48 β 96.48 / 100.03 Β±4.00 / 107.86 ms β 94.73 / 97.00 Β±2.15 / 100.81 ms β no change β
β QQuery 49 β 71.38 / 72.86 Β±2.04 / 76.78 ms β 70.76 / 71.67 Β±0.96 / 73.05 ms β no change β
β QQuery 50 β 58.87 / 59.27 Β±0.48 / 60.21 ms β 59.08 / 59.95 Β±0.92 / 61.69 ms β no change β
β QQuery 51 β 94.98 / 97.31 Β±2.27 / 100.29 ms β 93.56 / 97.01 Β±3.97 / 104.48 ms β no change β
β QQuery 52 β 24.51 / 25.01 Β±0.32 / 25.47 ms β 24.15 / 24.59 Β±0.36 / 24.98 ms β no change β
β QQuery 53 β 29.38 / 29.56 Β±0.19 / 29.92 ms β 28.71 / 29.08 Β±0.23 / 29.40 ms β no change β
β QQuery 54 β 54.65 / 55.71 Β±0.83 / 56.88 ms β 54.57 / 56.65 Β±2.98 / 62.38 ms β no change β
β QQuery 55 β 24.39 / 27.07 Β±4.17 / 35.32 ms β 24.00 / 24.84 Β±0.75 / 26.17 ms β +1.09x faster β
β QQuery 56 β 39.29 / 39.70 Β±0.42 / 40.49 ms β 38.57 / 39.67 Β±0.82 / 40.78 ms β no change β
β QQuery 57 β 173.41 / 177.47 Β±2.51 / 180.45 ms β 168.09 / 174.72 Β±4.27 / 180.87 ms β no change β
β QQuery 58 β 109.35 / 111.91 Β±1.38 / 113.52 ms β 109.90 / 111.35 Β±2.06 / 115.43 ms β no change β
β QQuery 59 β 118.09 / 120.05 Β±2.65 / 125.29 ms β 118.53 / 120.29 Β±2.77 / 125.80 ms β no change β
β QQuery 60 β 39.39 / 40.19 Β±0.55 / 40.93 ms β 38.80 / 39.51 Β±0.50 / 40.29 ms β no change β
β QQuery 61 β 11.90 / 12.08 Β±0.13 / 12.31 ms β 11.44 / 11.68 Β±0.21 / 12.05 ms β no change β
β QQuery 62 β 44.79 / 45.29 Β±0.42 / 45.76 ms β 44.01 / 44.42 Β±0.27 / 44.86 ms β no change β
β QQuery 63 β 30.38 / 30.71 Β±0.30 / 31.25 ms β 29.27 / 29.64 Β±0.25 / 30.03 ms β no change β
β QQuery 64 β 371.57 / 379.91 Β±8.54 / 392.04 ms β 366.33 / 375.91 Β±9.60 / 393.45 ms β no change β
β QQuery 65 β 137.87 / 140.79 Β±2.14 / 144.26 ms β 129.47 / 134.33 Β±2.53 / 136.34 ms β no change β
β QQuery 66 β 79.85 / 81.39 Β±1.32 / 83.43 ms β 76.56 / 77.91 Β±1.06 / 79.80 ms β no change β
β QQuery 67 β 263.30 / 277.63 Β±8.21 / 286.24 ms β 257.75 / 263.71 Β±5.32 / 271.51 ms β +1.05x faster β
β QQuery 68 β 12.15 / 12.29 Β±0.09 / 12.39 ms β 12.08 / 12.21 Β±0.13 / 12.44 ms β no change β
β QQuery 69 β 57.12 / 57.49 Β±0.24 / 57.88 ms β 56.37 / 56.75 Β±0.40 / 57.51 ms β no change β
β QQuery 70 β 104.76 / 109.39 Β±5.25 / 119.23 ms β 103.78 / 107.66 Β±4.82 / 116.91 ms β no change β
β QQuery 71 β 35.74 / 36.22 Β±0.62 / 37.44 ms β 35.05 / 36.68 Β±1.02 / 37.80 ms β no change β
β QQuery 72 β 1874.00 / 1968.67 Β±63.48 / 2053.72 ms β 1800.90 / 1879.93 Β±64.85 / 1988.37 ms β no change β
β QQuery 73 β 10.75 / 11.07 Β±0.17 / 11.27 ms β 10.24 / 10.63 Β±0.33 / 11.08 ms β no change β
β QQuery 74 β 177.70 / 184.53 Β±4.02 / 188.95 ms β 160.16 / 171.94 Β±7.06 / 180.48 ms β +1.07x faster β
β QQuery 75 β 143.50 / 145.03 Β±1.23 / 147.22 ms β 143.72 / 145.50 Β±1.81 / 148.81 ms β no change β
β QQuery 76 β 34.93 / 38.85 Β±5.24 / 49.12 ms β 35.54 / 36.07 Β±0.43 / 36.54 ms β +1.08x faster β
β QQuery 77 β 61.63 / 62.47 Β±0.69 / 63.31 ms β 60.85 / 61.41 Β±0.35 / 61.90 ms β no change β
β QQuery 78 β 168.60 / 177.22 Β±8.82 / 193.84 ms β 165.44 / 170.11 Β±3.70 / 175.91 ms β no change β
β QQuery 79 β 67.28 / 68.07 Β±0.42 / 68.52 ms β 65.95 / 66.79 Β±0.95 / 68.63 ms β no change β
β QQuery 80 β 96.61 / 102.02 Β±5.19 / 110.88 ms β 98.43 / 101.17 Β±1.80 / 103.22 ms β no change β
β QQuery 81 β 27.24 / 27.71 Β±0.71 / 29.11 ms β 26.05 / 26.32 Β±0.18 / 26.51 ms β +1.05x faster β
β QQuery 82 β 16.86 / 17.69 Β±1.01 / 19.68 ms β 16.76 / 17.48 Β±1.07 / 19.60 ms β no change β
β QQuery 83 β 34.43 / 35.25 Β±0.76 / 36.66 ms β 33.73 / 34.12 Β±0.27 / 34.50 ms β no change β
β QQuery 84 β 30.12 / 30.37 Β±0.19 / 30.69 ms β 29.75 / 30.14 Β±0.29 / 30.55 ms β no change β
β QQuery 85 β 104.34 / 109.26 Β±5.86 / 120.63 ms β 105.13 / 108.15 Β±4.63 / 117.24 ms β no change β
β QQuery 86 β 25.91 / 26.47 Β±0.34 / 26.94 ms β 25.85 / 25.93 Β±0.08 / 26.08 ms β no change β
β QQuery 87 β 65.51 / 67.36 Β±1.22 / 68.92 ms β 62.32 / 63.86 Β±0.93 / 64.86 ms β +1.05x faster β
β QQuery 88 β 62.08 / 65.60 Β±6.05 / 77.67 ms β 61.58 / 64.55 Β±4.39 / 73.04 ms β no change β
β QQuery 89 β 35.85 / 36.93 Β±0.99 / 38.77 ms β 35.65 / 36.34 Β±0.38 / 36.74 ms β no change β
β QQuery 90 β 17.03 / 17.27 Β±0.16 / 17.53 ms β 17.16 / 17.48 Β±0.25 / 17.90 ms β no change β
β QQuery 91 β 45.12 / 45.97 Β±0.77 / 47.31 ms β 44.97 / 45.56 Β±0.42 / 46.26 ms β no change β
β QQuery 92 β 29.78 / 30.67 Β±0.52 / 31.30 ms β 29.93 / 30.32 Β±0.28 / 30.74 ms β no change β
β QQuery 93 β 50.86 / 51.56 Β±0.61 / 52.47 ms β 51.46 / 53.84 Β±2.02 / 56.12 ms β no change β
β QQuery 94 β 40.36 / 42.83 Β±3.63 / 50.05 ms β 39.26 / 39.67 Β±0.35 / 40.12 ms β +1.08x faster β
β QQuery 95 β 82.08 / 84.37 Β±1.20 / 85.38 ms β 80.59 / 81.84 Β±0.71 / 82.49 ms β no change β
β QQuery 96 β 24.08 / 24.36 Β±0.19 / 24.62 ms β 24.13 / 24.28 Β±0.13 / 24.44 ms β no change β
β QQuery 97 β 53.24 / 54.40 Β±1.35 / 56.95 ms β 51.67 / 54.29 Β±3.65 / 61.49 ms β no change β
β QQuery 98 β 46.38 / 47.27 Β±0.78 / 48.65 ms β 43.03 / 44.15 Β±0.62 / 44.72 ms β +1.07x faster β
β QQuery 99 β 66.33 / 67.43 Β±1.02 / 69.14 ms β 65.41 / 66.12 Β±0.39 / 66.55 ms β no change β
βββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 9695.88ms β
β Total Time (rich-T-kid_coacler-benchmark) β 9549.20ms β
β Average Time (HEAD) β 97.94ms β
β Average Time (rich-T-kid_coacler-benchmark) β 96.46ms β
β Queries Faster β 14 β
β Queries Slower β 4 β
β Queries with No Change β 81 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpcds β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 50.0s |
| Peak memory | 2.1 GiB |
| Avg memory | 1.5 GiB |
| CPU user | 209.8s |
| CPU sys | 6.0s |
| Peak spill | 0 B |
**tpcds β branch**
| Metric | Value |
|--------|-------|
| Wall time | 50.0s |
| Peak memory | 2.2 GiB |
| Avg memory | 1.5 GiB |
| CPU user | 208.2s |
| CPU sys | 6.0s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739470816
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739397449)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³βββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 5.70 ms β 5.90 ms β no change β
β QQuery 2 β 79.89 ms β 80.96 ms β no change β
β QQuery 3 β 28.57 ms β 28.95 ms β no change β
β QQuery 4 β 470.58 ms β 466.47 ms β no change β
β QQuery 5 β 50.93 ms β 51.42 ms β no change β
β QQuery 6 β 35.63 ms β 35.15 ms β no change β
β QQuery 7 β 74.17 ms β 73.07 ms β no change β
β QQuery 8 β 36.09 ms β 36.01 ms β no change β
β QQuery 9 β 52.90 ms β 50.88 ms β no change β
β QQuery 10 β 61.37 ms β 61.52 ms β no change β
β QQuery 11 β 285.72 ms β 288.97 ms β no change β
β QQuery 12 β 29.47 ms β 29.19 ms β no change β
β QQuery 13 β 116.76 ms β 117.37 ms β no change β
β QQuery 14 β 393.03 ms β 393.66 ms β no change β
β QQuery 15 β 54.91 ms β 54.65 ms β no change β
β QQuery 16 β 6.32 ms β 6.60 ms β no change β
β QQuery 17 β 79.30 ms β 80.25 ms β no change β
β QQuery 18 β 104.54 ms β 105.52 ms β no change β
β QQuery 19 β 41.50 ms β 41.50 ms β no change β
β QQuery 20 β 36.18 ms β 36.46 ms β no change β
β QQuery 21 β 17.39 ms β 17.33 ms β no change β
β QQuery 22 β 65.33 ms β 63.58 ms β no change β
β QQuery 23 β 313.74 ms β 325.41 ms β no change β
β QQuery 24 β 200.16 ms β 200.40 ms β no change β
β QQuery 25 β 107.29 ms β 110.20 ms β no change β
β QQuery 26 β 48.05 ms β 48.39 ms β no change β
β QQuery 27 β 6.30 ms β 6.32 ms β no change β
β QQuery 28 β 57.14 ms β 57.11 ms β no change β
β QQuery 29 β 95.22 ms β 96.83 ms β no change β
β QQuery 30 β 33.41 ms β 33.28 ms β no change β
β QQuery 31 β 108.45 ms β 109.45 ms β no change β
β QQuery 32 β 21.14 ms β 20.57 ms β no change β
β QQuery 33 β 37.52 ms β 37.24 ms β no change β
β QQuery 34 β 10.37 ms β 10.43 ms β no change β
β QQuery 35 β 72.94 ms β 72.41 ms β no change β
β QQuery 36 β 5.84 ms β 5.78 ms β no change β
β QQuery 37 β 6.92 ms β 7.26 ms β no change β
β QQuery 38 β 61.51 ms β 62.07 ms β no change β
β QQuery 39 β 74.04 ms β 74.38 ms β no change β
β QQuery 40 β 23.93 ms β 23.96 ms β no change β
β QQuery 41 β 11.18 ms β 11.09 ms β no change β
β QQuery 42 β 23.83 ms β 23.95 ms β no change β
β QQuery 43 β 5.23 ms β 5.23 ms β no change β
β QQuery 44 β 9.57 ms β 9.44 ms β no change β
β QQuery 45 β 39.31 ms β 40.84 ms β no change β
β QQuery 46 β 11.87 ms β 12.34 ms β no change β
β QQuery 47 β 233.04 ms β 229.33 ms β no change β
β QQuery 48 β 94.14 ms β 94.04 ms β no change β
β QQuery 49 β 70.65 ms β 71.05 ms β no change β
β QQuery 50 β 58.36 ms β 59.08 ms β no change β
β QQuery 51 β 91.35 ms β 91.51 ms β no change β
β QQuery 52 β 24.21 ms β 24.30 ms β no change β
β QQuery 53 β 28.87 ms β 29.33 ms β no change β
β QQuery 54 β 53.58 ms β 54.34 ms β no change β
β QQuery 55 β 23.38 ms β 23.86 ms β no change β
β QQuery 56 β 38.39 ms β 38.79 ms β no change β
β QQuery 57 β 169.27 ms β 168.81 ms β no change β
β QQuery 58 β 108.63 ms β 109.73 ms β no change β
β QQuery 59 β 115.86 ms β 116.56 ms β no change β
β QQuery 60 β 39.57 ms β 39.61 ms β no change β
β QQuery 61 β 11.76 ms β 12.11 ms β no change β
β QQuery 62 β 44.30 ms β 44.54 ms β no change β
β QQuery 63 β 29.57 ms β 29.61 ms β no change β
β QQuery 64 β 362.68 ms β 361.75 ms β no change β
β QQuery 65 β 127.54 ms β 129.17 ms β no change β
β QQuery 66 β 77.28 ms β 76.77 ms β no change β
β QQuery 67 β 248.71 ms β 259.99 ms β no change β
β QQuery 68 β 11.95 ms β 12.19 ms β no change β
β QQuery 69 β 56.40 ms β 56.90 ms β no change β
β QQuery 70 β 103.54 ms β 104.52 ms β no change β
β QQuery 71 β 35.06 ms β 35.49 ms β no change β
β QQuery 72 β 1729.77 ms β 1817.37 ms β 1.05x slower β
β QQuery 73 β 10.21 ms β 10.17 ms β no change β
β QQuery 74 β 165.61 ms β 165.99 ms β no change β
β QQuery 75 β 142.72 ms β 142.08 ms β no change β
β QQuery 76 β 35.29 ms β 35.25 ms β no change β
β QQuery 77 β 60.95 ms β 60.93 ms β no change β
β QQuery 78 β 166.06 ms β 163.35 ms β no change β
β QQuery 79 β 67.25 ms β 67.53 ms β no change β
β QQuery 80 β 95.68 ms β 99.70 ms β no change β
β QQuery 81 β 26.12 ms β 27.02 ms β no change β
β QQuery 82 β 16.49 ms β 16.84 ms β no change β
β QQuery 83 β 34.31 ms β 34.48 ms β no change β
β QQuery 84 β 30.21 ms β 30.06 ms β no change β
β QQuery 85 β 104.05 ms β 104.85 ms β no change β
β QQuery 86 β 25.78 ms β 25.94 ms β no change β
β QQuery 87 β 61.75 ms β 64.08 ms β no change β
β QQuery 88 β 61.31 ms β 61.90 ms β no change β
β QQuery 89 β 35.08 ms β 35.51 ms β no change β
β QQuery 90 β 17.05 ms β 17.06 ms β no change β
β QQuery 91 β 44.97 ms β 44.92 ms β no change β
β QQuery 92 β 30.21 ms β 29.98 ms β no change β
β QQuery 93 β 48.98 ms β 51.67 ms β 1.05x slower β
β QQuery 94 β 39.41 ms β 39.55 ms β no change β
β QQuery 95 β 80.67 ms β 81.02 ms β no change β
β QQuery 96 β 23.92 ms β 23.95 ms β no change β
β QQuery 97 β 51.65 ms β 51.03 ms β no change β
β QQuery 98 β 43.30 ms β 42.52 ms β no change β
β QQuery 99 β 65.65 ms β 65.73 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄βββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 9083.81ms β
β Total Time (rich-T-kid_coacler-benchmark) β 9213.68ms β
β Average Time (HEAD) β 91.76ms β
β Average Time (rich-T-kid_coacler-benchmark) β 93.07ms β
β Queries Faster β 0 β
β Queries Slower β 2 β
β Queries with No Change β 97 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 5.70 / 6.29 Β±1.04 / 8.37 ms β 5.90 / 6.40 Β±0.86 / 8.11 ms β no change β
β QQuery 2 β 79.89 / 80.48 Β±0.41 / 81.18 ms β 80.96 / 81.40 Β±0.37 / 81.96 ms β no change β
β QQuery 3 β 28.57 / 28.82 Β±0.14 / 28.96 ms β 28.95 / 29.25 Β±0.23 / 29.65 ms β no change β
β QQuery 4 β 470.58 / 475.37 Β±5.79 / 486.42 ms β 466.47 / 474.37 Β±5.06 / 480.43 ms β no change β
β QQuery 5 β 50.93 / 53.91 Β±4.00 / 61.64 ms β 51.42 / 53.59 Β±3.34 / 60.22 ms β no change β
β QQuery 6 β 35.63 / 36.10 Β±0.56 / 37.18 ms β 35.15 / 36.18 Β±0.53 / 36.67 ms β no change β
β QQuery 7 β 74.17 / 74.42 Β±0.22 / 74.73 ms β 73.07 / 74.19 Β±0.66 / 75.03 ms β no change β
β QQuery 8 β 36.09 / 36.54 Β±0.32 / 36.94 ms β 36.01 / 36.32 Β±0.23 / 36.64 ms β no change β
β QQuery 9 β 52.90 / 57.00 Β±6.33 / 69.49 ms β 50.88 / 55.67 Β±4.39 / 62.96 ms β no change β
β QQuery 10 β 61.37 / 61.59 Β±0.25 / 62.03 ms β 61.52 / 62.20 Β±0.48 / 62.93 ms β no change β
β QQuery 11 β 285.72 / 288.31 Β±2.98 / 293.73 ms β 288.97 / 296.75 Β±4.96 / 302.85 ms β no change β
β QQuery 12 β 29.47 / 32.04 Β±3.85 / 39.70 ms β 29.19 / 29.79 Β±0.41 / 30.44 ms β +1.08x faster β
β QQuery 13 β 116.76 / 117.57 Β±0.72 / 118.81 ms β 117.37 / 118.21 Β±0.97 / 120.05 ms β no change β
β QQuery 14 β 393.03 / 397.74 Β±3.60 / 403.79 ms β 393.66 / 400.89 Β±3.88 / 404.66 ms β no change β
β QQuery 15 β 54.91 / 55.51 Β±0.50 / 56.34 ms β 54.65 / 57.84 Β±2.55 / 62.35 ms β no change β
β QQuery 16 β 6.32 / 7.93 Β±2.76 / 13.43 ms β 6.60 / 6.91 Β±0.24 / 7.34 ms β +1.15x faster β
β QQuery 17 β 79.30 / 80.06 Β±1.26 / 82.56 ms β 80.25 / 81.47 Β±1.00 / 83.05 ms β no change β
β QQuery 18 β 104.54 / 107.14 Β±1.85 / 110.27 ms β 105.52 / 106.80 Β±1.37 / 108.74 ms β no change β
β QQuery 19 β 41.50 / 41.82 Β±0.33 / 42.40 ms β 41.50 / 42.04 Β±0.48 / 42.78 ms β no change β
β QQuery 20 β 36.18 / 36.44 Β±0.17 / 36.67 ms β 36.46 / 37.02 Β±0.48 / 37.72 ms β no change β
β QQuery 21 β 17.39 / 17.68 Β±0.36 / 18.38 ms β 17.33 / 17.43 Β±0.07 / 17.51 ms β no change β
β QQuery 22 β 65.33 / 66.43 Β±0.72 / 67.33 ms β 63.58 / 65.78 Β±1.20 / 66.92 ms β no change β
β QQuery 23 β 313.74 / 319.01 Β±3.95 / 325.77 ms β 325.41 / 328.41 Β±2.04 / 331.78 ms β no change β
β QQuery 24 β 200.16 / 203.10 Β±2.10 / 206.43 ms β 200.40 / 203.31 Β±4.89 / 213.06 ms β no change β
β QQuery 25 β 107.29 / 109.55 Β±3.34 / 116.04 ms β 110.20 / 112.93 Β±2.48 / 116.48 ms β no change β
β QQuery 26 β 48.05 / 49.01 Β±0.50 / 49.42 ms β 48.39 / 49.23 Β±0.44 / 49.61 ms β no change β
β QQuery 27 β 6.30 / 6.42 Β±0.16 / 6.73 ms β 6.32 / 6.49 Β±0.15 / 6.78 ms β no change β
β QQuery 28 β 57.14 / 59.78 Β±1.56 / 61.10 ms β 57.11 / 60.82 Β±1.93 / 62.73 ms β no change β
β QQuery 29 β 95.22 / 99.87 Β±4.89 / 109.22 ms β 96.83 / 98.78 Β±1.44 / 100.15 ms β no change β
β QQuery 30 β 33.41 / 34.58 Β±0.92 / 36.08 ms β 33.28 / 33.72 Β±0.38 / 34.42 ms β no change β
β QQuery 31 β 108.45 / 111.16 Β±2.89 / 116.59 ms β 109.45 / 111.50 Β±2.38 / 115.88 ms β no change β
β QQuery 32 β 21.14 / 21.36 Β±0.20 / 21.66 ms β 20.57 / 20.92 Β±0.27 / 21.20 ms β no change β
β QQuery 33 β 37.52 / 38.57 Β±1.00 / 40.32 ms β 37.24 / 38.22 Β±1.39 / 40.99 ms β no change β
β QQuery 34 β 10.37 / 10.52 Β±0.13 / 10.74 ms β 10.43 / 10.61 Β±0.18 / 10.90 ms β no change β
β QQuery 35 β 72.94 / 74.05 Β±0.86 / 75.27 ms β 72.41 / 72.82 Β±0.35 / 73.39 ms β no change β
β QQuery 36 β 5.84 / 6.03 Β±0.16 / 6.30 ms β 5.78 / 5.94 Β±0.19 / 6.32 ms β no change β
β QQuery 37 β 6.92 / 7.03 Β±0.14 / 7.29 ms β 7.26 / 8.32 Β±1.88 / 12.07 ms β 1.18x slower β
β QQuery 38 β 61.51 / 64.80 Β±3.33 / 71.17 ms β 62.07 / 63.52 Β±1.15 / 65.03 ms β no change β
β QQuery 39 β 74.04 / 75.77 Β±1.21 / 77.78 ms β 74.38 / 75.58 Β±1.63 / 78.76 ms β no change β
β QQuery 40 β 23.93 / 24.37 Β±0.31 / 24.73 ms β 23.96 / 24.44 Β±0.37 / 25.09 ms β no change β
β QQuery 41 β 11.18 / 11.39 Β±0.13 / 11.53 ms β 11.09 / 11.29 Β±0.15 / 11.44 ms β no change β
β QQuery 42 β 23.83 / 24.14 Β±0.26 / 24.48 ms β 23.95 / 26.00 Β±3.00 / 31.90 ms β 1.08x slower β
β QQuery 43 β 5.23 / 6.53 Β±2.27 / 11.06 ms β 5.23 / 5.37 Β±0.17 / 5.69 ms β +1.22x faster β
β QQuery 44 β 9.57 / 9.66 Β±0.05 / 9.70 ms β 9.44 / 9.57 Β±0.13 / 9.79 ms β no change β
β QQuery 45 β 39.31 / 40.27 Β±0.86 / 41.68 ms β 40.84 / 41.25 Β±0.49 / 42.09 ms β no change β
β QQuery 46 β 11.87 / 12.17 Β±0.35 / 12.85 ms β 12.34 / 12.51 Β±0.11 / 12.62 ms β no change β
β QQuery 47 β 233.04 / 233.80 Β±0.53 / 234.66 ms β 229.33 / 231.20 Β±2.41 / 235.68 ms β no change β
β QQuery 48 β 94.14 / 94.86 Β±0.51 / 95.49 ms β 94.04 / 94.80 Β±0.60 / 95.51 ms β no change β
β QQuery 49 β 70.65 / 71.69 Β±1.35 / 74.32 ms β 71.05 / 72.99 Β±3.33 / 79.64 ms β no change β
β QQuery 50 β 58.36 / 58.95 Β±0.41 / 59.44 ms β 59.08 / 60.73 Β±1.97 / 64.55 ms β no change β
β QQuery 51 β 91.35 / 98.28 Β±7.15 / 112.04 ms β 91.51 / 94.66 Β±2.01 / 97.22 ms β no change β
β QQuery 52 β 24.21 / 24.41 Β±0.20 / 24.76 ms β 24.30 / 24.62 Β±0.21 / 24.97 ms β no change β
β QQuery 53 β 28.87 / 29.20 Β±0.24 / 29.53 ms β 29.33 / 29.82 Β±0.62 / 31.02 ms β no change β
β QQuery 54 β 53.58 / 54.43 Β±0.83 / 55.58 ms β 54.34 / 55.37 Β±0.84 / 56.45 ms β no change β
β QQuery 55 β 23.38 / 23.56 Β±0.12 / 23.70 ms β 23.86 / 24.08 Β±0.23 / 24.52 ms β no change β
β QQuery 56 β 38.39 / 38.68 Β±0.18 / 38.95 ms β 38.79 / 39.37 Β±0.36 / 39.90 ms β no change β
β QQuery 57 β 169.27 / 171.73 Β±1.92 / 174.70 ms β 168.81 / 172.68 Β±5.11 / 182.80 ms β no change β
β QQuery 58 β 108.63 / 110.10 Β±0.93 / 111.35 ms β 109.73 / 111.05 Β±1.66 / 114.33 ms β no change β
β QQuery 59 β 115.86 / 117.34 Β±1.35 / 119.68 ms β 116.56 / 117.94 Β±1.47 / 120.79 ms β no change β
β QQuery 60 β 39.57 / 40.95 Β±1.39 / 43.49 ms β 39.61 / 40.82 Β±1.46 / 43.57 ms β no change β
β QQuery 61 β 11.76 / 12.01 Β±0.22 / 12.40 ms β 12.11 / 12.29 Β±0.18 / 12.61 ms β no change β
β QQuery 62 β 44.30 / 44.78 Β±0.38 / 45.44 ms β 44.54 / 45.51 Β±1.05 / 47.54 ms β no change β
β QQuery 63 β 29.57 / 30.06 Β±0.54 / 31.09 ms β 29.61 / 29.92 Β±0.40 / 30.67 ms β no change β
β QQuery 64 β 362.68 / 366.49 Β±3.89 / 373.92 ms β 361.75 / 368.46 Β±7.23 / 381.88 ms β no change β
β QQuery 65 β 127.54 / 133.18 Β±3.58 / 138.04 ms β 129.17 / 132.22 Β±2.66 / 137.01 ms β no change β
β QQuery 66 β 77.28 / 77.80 Β±0.57 / 78.84 ms β 76.77 / 78.11 Β±1.04 / 79.94 ms β no change β
β QQuery 67 β 248.71 / 254.96 Β±4.40 / 260.04 ms β 259.99 / 267.69 Β±7.75 / 282.53 ms β no change β
β QQuery 68 β 11.95 / 12.10 Β±0.10 / 12.20 ms β 12.19 / 12.33 Β±0.14 / 12.55 ms β no change β
β QQuery 69 β 56.40 / 58.08 Β±2.53 / 63.12 ms β 56.90 / 58.23 Β±2.22 / 62.64 ms β no change β
β QQuery 70 β 103.54 / 104.70 Β±0.72 / 105.43 ms β 104.52 / 105.46 Β±0.54 / 106.19 ms β no change β
β QQuery 71 β 35.06 / 36.21 Β±1.24 / 38.58 ms β 35.49 / 36.74 Β±1.36 / 39.22 ms β no change β
β QQuery 72 β 1729.77 / 1815.96 Β±85.23 / 1950.46 ms β 1817.37 / 1929.71 Β±59.40 / 1980.35 ms β 1.06x slower β
β QQuery 73 β 10.21 / 10.30 Β±0.06 / 10.36 ms β 10.17 / 10.49 Β±0.29 / 10.86 ms β no change β
β QQuery 74 β 165.61 / 169.28 Β±3.02 / 174.54 ms β 165.99 / 168.62 Β±2.29 / 172.31 ms β no change β
β QQuery 75 β 142.72 / 146.02 Β±4.03 / 153.94 ms β 142.08 / 146.19 Β±5.79 / 157.40 ms β no change β
β QQuery 76 β 35.29 / 35.70 Β±0.27 / 36.12 ms β 35.25 / 35.48 Β±0.18 / 35.80 ms β no change β
β QQuery 77 β 60.95 / 61.33 Β±0.49 / 62.25 ms β 60.93 / 62.01 Β±0.86 / 63.51 ms β no change β
β QQuery 78 β 166.06 / 170.85 Β±3.17 / 174.99 ms β 163.35 / 167.99 Β±3.18 / 172.15 ms β no change β
β QQuery 79 β 67.25 / 68.09 Β±0.60 / 69.08 ms β 67.53 / 68.68 Β±1.56 / 71.75 ms β no change β
β QQuery 80 β 95.68 / 97.48 Β±1.45 / 99.99 ms β 99.70 / 103.97 Β±3.31 / 109.48 ms β 1.07x slower β
β QQuery 81 β 26.12 / 26.51 Β±0.28 / 26.80 ms β 27.02 / 27.95 Β±1.21 / 30.34 ms β 1.05x slower β
β QQuery 82 β 16.49 / 17.51 Β±1.47 / 20.44 ms β 16.84 / 17.01 Β±0.16 / 17.24 ms β no change β
β QQuery 83 β 34.31 / 34.50 Β±0.21 / 34.91 ms β 34.48 / 34.68 Β±0.16 / 34.91 ms β no change β
β QQuery 84 β 30.21 / 31.78 Β±2.13 / 35.93 ms β 30.06 / 30.31 Β±0.29 / 30.78 ms β no change β
β QQuery 85 β 104.05 / 105.23 Β±1.13 / 107.35 ms β 104.85 / 107.31 Β±3.27 / 113.21 ms β no change β
β QQuery 86 β 25.78 / 26.47 Β±0.83 / 28.09 ms β 25.94 / 27.09 Β±1.43 / 29.80 ms β no change β
β QQuery 87 β 61.75 / 63.47 Β±1.24 / 65.55 ms β 64.08 / 64.97 Β±0.63 / 65.80 ms β no change β
β QQuery 88 β 61.31 / 61.63 Β±0.20 / 61.93 ms β 61.90 / 62.69 Β±1.11 / 64.88 ms β no change β
β QQuery 89 β 35.08 / 36.03 Β±0.76 / 37.32 ms β 35.51 / 36.26 Β±0.53 / 37.11 ms β no change β
β QQuery 90 β 17.05 / 17.25 Β±0.13 / 17.40 ms β 17.06 / 17.84 Β±1.12 / 20.03 ms β no change β
β QQuery 91 β 44.97 / 45.30 Β±0.26 / 45.62 ms β 44.92 / 45.19 Β±0.23 / 45.51 ms β no change β
β QQuery 92 β 30.21 / 31.32 Β±1.97 / 35.25 ms β 29.98 / 30.61 Β±0.49 / 31.14 ms β no change β
β QQuery 93 β 48.98 / 49.93 Β±0.56 / 50.63 ms β 51.67 / 53.50 Β±1.33 / 55.55 ms β 1.07x slower β
β QQuery 94 β 39.41 / 40.41 Β±0.68 / 41.51 ms β 39.55 / 40.20 Β±0.81 / 41.66 ms β no change β
β QQuery 95 β 80.67 / 81.36 Β±0.53 / 82.04 ms β 81.02 / 82.03 Β±0.95 / 83.23 ms β no change β
β QQuery 96 β 23.92 / 24.42 Β±0.64 / 25.66 ms β 23.95 / 24.15 Β±0.17 / 24.46 ms β no change β
β QQuery 97 β 51.65 / 52.99 Β±1.59 / 55.56 ms β 51.03 / 52.39 Β±1.00 / 54.05 ms β no change β
β QQuery 98 β 43.30 / 44.41 Β±0.59 / 44.92 ms β 42.52 / 43.26 Β±0.58 / 43.82 ms β no change β
β QQuery 99 β 65.65 / 66.29 Β±0.39 / 66.82 ms β 65.73 / 66.20 Β±0.64 / 67.48 ms β no change β
βββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 9308.46ms β
β Total Time (rich-T-kid_coacler-benchmark) β 9475.94ms β
β Average Time (HEAD) β 94.02ms β
β Average Time (rich-T-kid_coacler-benchmark) β 95.72ms β
β Queries Faster β 3 β
β Queries Slower β 6 β
β Queries with No Change β 90 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpcds β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 50.0s |
| Peak memory | 2.3 GiB |
| Avg memory | 1.5 GiB |
| CPU user | 199.1s |
| CPU sys | 5.4s |
| Peak spill | 0 B |
**tpcds β branch**
| Metric | Value |
|--------|-------|
| Wall time | 50.0s |
| Peak memory | 2.1 GiB |
| Avg memory | 1.5 GiB |
| CPU user | 204.6s |
| CPU sys | 5.7s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739805963
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739768539)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (dbfc4e87e81f5ae40f150fa37700863a165cd991) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..dbfc4e87e81f5ae40f150fa37700863a165cd991)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 40.62 ms β 40.48 ms β no change β
β QQuery 2 β 18.43 ms β 18.25 ms β no change β
β QQuery 3 β 28.52 ms β 28.52 ms β no change β
β QQuery 4 β 17.00 ms β 17.06 ms β no change β
β QQuery 5 β 34.92 ms β 35.06 ms β no change β
β QQuery 6 β 16.08 ms β 16.31 ms β no change β
β QQuery 7 β 40.63 ms β 38.93 ms β no change β
β QQuery 8 β 40.82 ms β 40.17 ms β no change β
β QQuery 9 β 47.77 ms β 49.61 ms β no change β
β QQuery 10 β 40.24 ms β 39.85 ms β no change β
β QQuery 11 β 13.27 ms β 13.30 ms β no change β
β QQuery 12 β 20.64 ms β 21.00 ms β no change β
β QQuery 13 β 39.34 ms β 39.07 ms β no change β
β QQuery 14 β 24.34 ms β 24.60 ms β no change β
β QQuery 15 β 30.71 ms β 30.91 ms β no change β
β QQuery 16 β 14.23 ms β 13.97 ms β no change β
β QQuery 17 β 71.57 ms β 67.14 ms β +1.07x faster β
β QQuery 18 β 61.03 ms β 59.76 ms β no change β
β QQuery 19 β 31.58 ms β 31.88 ms β no change β
β QQuery 20 β 32.23 ms β 31.93 ms β no change β
β QQuery 21 β 54.57 ms β 54.61 ms β no change β
β QQuery 22 β 13.68 ms β 13.86 ms β no change β
βββββββββββββ΄βββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 732.24ms β
β Total Time (rich-T-kid_coacler-benchmark) β 726.27ms β
β Average Time (HEAD) β 33.28ms β
β Average Time (rich-T-kid_coacler-benchmark) β 33.01ms β
β Queries Faster β 1 β
β Queries Slower β 0 β
β Queries with No Change β 21 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 40.62 / 41.72 Β±1.19 / 43.88 ms β 40.48 / 41.75 Β±1.33 / 43.63 ms β no change β
β QQuery 2 β 18.43 / 19.06 Β±0.86 / 20.77 ms β 18.25 / 18.85 Β±0.47 / 19.70 ms β no change β
β QQuery 3 β 28.52 / 29.66 Β±1.21 / 31.44 ms β 28.52 / 29.36 Β±0.96 / 31.20 ms β no change β
β QQuery 4 β 17.00 / 17.27 Β±0.21 / 17.55 ms β 17.06 / 17.52 Β±0.28 / 17.82 ms β no change β
β QQuery 5 β 34.92 / 35.08 Β±0.09 / 35.16 ms β 35.06 / 35.24 Β±0.14 / 35.49 ms β no change β
β QQuery 6 β 16.08 / 16.20 Β±0.11 / 16.37 ms β 16.31 / 17.36 Β±0.97 / 18.54 ms β 1.07x slower β
β QQuery 7 β 40.63 / 41.42 Β±0.46 / 41.85 ms β 38.93 / 40.92 Β±2.65 / 46.14 ms β no change β
β QQuery 8 β 40.82 / 41.91 Β±1.02 / 43.22 ms β 40.17 / 41.04 Β±1.03 / 42.91 ms β no change β
β QQuery 9 β 47.77 / 50.34 Β±1.59 / 52.24 ms β 49.61 / 50.52 Β±0.55 / 51.14 ms β no change β
β QQuery 10 β 40.24 / 40.54 Β±0.36 / 41.23 ms β 39.85 / 40.28 Β±0.30 / 40.59 ms β no change β
β QQuery 11 β 13.27 / 13.72 Β±0.64 / 14.93 ms β 13.30 / 13.77 Β±0.53 / 14.76 ms β no change β
β QQuery 12 β 20.64 / 21.59 Β±0.74 / 22.53 ms β 21.00 / 21.38 Β±0.47 / 22.29 ms β no change β
β QQuery 13 β 39.34 / 40.59 Β±1.43 / 43.22 ms β 39.07 / 40.46 Β±1.41 / 42.86 ms β no change β
β QQuery 14 β 24.34 / 24.64 Β±0.24 / 24.96 ms β 24.60 / 25.11 Β±0.48 / 25.97 ms β no change β
β QQuery 15 β 30.71 / 31.50 Β±0.65 / 32.67 ms β 30.91 / 32.01 Β±0.87 / 32.84 ms β no change β
β QQuery 16 β 14.23 / 14.32 Β±0.12 / 14.55 ms β 13.97 / 14.16 Β±0.12 / 14.31 ms β no change β
β QQuery 17 β 71.57 / 73.52 Β±1.92 / 76.41 ms β 67.14 / 68.18 Β±1.56 / 71.24 ms β +1.08x faster β
β QQuery 18 β 61.03 / 61.82 Β±0.54 / 62.50 ms β 59.76 / 61.10 Β±1.10 / 62.64 ms β no change β
β QQuery 19 β 31.58 / 31.75 Β±0.16 / 32.04 ms β 31.88 / 32.81 Β±1.14 / 34.71 ms β no change β
β QQuery 20 β 32.23 / 32.54 Β±0.47 / 33.45 ms β 31.93 / 32.28 Β±0.30 / 32.70 ms β no change β
β QQuery 21 β 54.57 / 55.56 Β±0.67 / 56.62 ms β 54.61 / 55.56 Β±1.19 / 57.79 ms β no change β
β QQuery 22 β 13.68 / 14.27 Β±0.43 / 14.82 ms β 13.86 / 14.05 Β±0.21 / 14.36 ms β no change β
βββββββββββββ΄βββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 749.02ms β
β Total Time (rich-T-kid_coacler-benchmark) β 743.71ms β
β Average Time (HEAD) β 34.05ms β
β Average Time (rich-T-kid_coacler-benchmark) β 33.81ms β
β Queries Faster β 1 β
β Queries Slower β 1 β
β Queries with No Change β 20 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpch β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 5.0s |
| Peak memory | 1.3 GiB |
| Avg memory | 517.2 MiB |
| CPU user | 20.9s |
| CPU sys | 1.6s |
| Peak spill | 0 B |
**tpch β branch**
| Metric | Value |
|--------|-------|
| Wall time | 5.0s |
| Peak memory | 1.3 GiB |
| Avg memory | 533.8 MiB |
| CPU user | 20.4s |
| CPU sys | 1.7s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5736871192
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5736766135)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (76e1f1c24138317d60fc604b72283008fad49b6a) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..76e1f1c24138317d60fc604b72283008fad49b6a)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββ³βββββββββββββββββββββββββββββββ³βββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 40.97 ms β 41.36 ms β no change β
β QQuery 2 β 18.82 ms β 19.45 ms β no change β
β QQuery 3 β 28.98 ms β 30.04 ms β no change β
β QQuery 4 β 17.84 ms β 18.13 ms β no change β
β QQuery 5 β 36.77 ms β 38.09 ms β no change β
β QQuery 6 β 16.90 ms β 17.40 ms β no change β
β QQuery 7 β 43.98 ms β 46.08 ms β no change β
β QQuery 8 β 41.69 ms β 41.83 ms β no change β
β QQuery 9 β 51.01 ms β 53.06 ms β no change β
β QQuery 10 β 42.41 ms β 42.41 ms β no change β
β QQuery 11 β 14.29 ms β 14.30 ms β no change β
β QQuery 12 β 21.26 ms β 22.00 ms β no change β
β QQuery 13 β 44.74 ms β 44.57 ms β no change β
β QQuery 14 β 25.70 ms β 25.80 ms β no change β
β QQuery 15 β 32.68 ms β 33.13 ms β no change β
β QQuery 16 β 14.85 ms β 15.12 ms β no change β
β QQuery 17 β 76.72 ms β 83.95 ms β 1.09x slower β
β QQuery 18 β 62.88 ms β 73.25 ms β 1.16x slower β
β QQuery 19 β 33.01 ms β 33.85 ms β no change β
β QQuery 20 β 34.25 ms β 33.97 ms β no change β
β QQuery 21 β 59.72 ms β 62.71 ms β 1.05x slower β
β QQuery 22 β 15.06 ms β 15.44 ms β no change β
βββββββββββββ΄βββββββββββ΄βββββββββββββββββββββββββββββββ΄βββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 774.55ms β
β Total Time (rich-T-kid_coacler-benchmark) β 805.93ms β
β Average Time (HEAD) β 35.21ms β
β Average Time (rich-T-kid_coacler-benchmark) β 36.63ms β
β Queries Faster β 0 β
β Queries Slower β 3 β
β Queries with No Change β 19 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³ββββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 40.97 / 46.84 Β±11.19 / 69.22 ms β 41.36 / 42.04 Β±1.03 / 44.08 ms β +1.11x faster β
β QQuery 2 β 18.82 / 19.07 Β±0.20 / 19.43 ms β 19.45 / 20.03 Β±0.48 / 20.70 ms β no change β
β QQuery 3 β 28.98 / 29.33 Β±0.58 / 30.49 ms β 30.04 / 30.74 Β±0.85 / 32.40 ms β no change β
β QQuery 4 β 17.84 / 18.01 Β±0.19 / 18.36 ms β 18.13 / 18.39 Β±0.16 / 18.53 ms β no change β
β QQuery 5 β 36.77 / 37.08 Β±0.25 / 37.44 ms β 38.09 / 39.64 Β±1.73 / 42.28 ms β 1.07x slower β
β QQuery 6 β 16.90 / 17.20 Β±0.45 / 18.10 ms β 17.40 / 17.97 Β±1.04 / 20.04 ms β no change β
β QQuery 7 β 43.98 / 45.70 Β±1.64 / 48.02 ms β 46.08 / 50.87 Β±3.24 / 54.49 ms β 1.11x slower β
β QQuery 8 β 41.69 / 41.89 Β±0.24 / 42.34 ms β 41.83 / 42.37 Β±0.40 / 43.03 ms β no change β
β QQuery 9 β 51.01 / 52.40 Β±1.24 / 54.58 ms β 53.06 / 54.05 Β±1.64 / 57.32 ms β no change β
β QQuery 10 β 42.41 / 42.70 Β±0.15 / 42.83 ms β 42.41 / 44.06 Β±1.02 / 45.60 ms β no change β
β QQuery 11 β 14.29 / 14.44 Β±0.12 / 14.58 ms β 14.30 / 14.63 Β±0.17 / 14.79 ms β no change β
β QQuery 12 β 21.26 / 21.86 Β±0.39 / 22.48 ms β 22.00 / 22.29 Β±0.26 / 22.68 ms β no change β
β QQuery 13 β 44.74 / 45.59 Β±0.79 / 47.08 ms β 44.57 / 45.11 Β±0.33 / 45.50 ms β no change β
β QQuery 14 β 25.70 / 26.08 Β±0.34 / 26.57 ms β 25.80 / 25.92 Β±0.07 / 26.02 ms β no change β
β QQuery 15 β 32.68 / 32.92 Β±0.18 / 33.21 ms β 33.13 / 33.44 Β±0.37 / 34.15 ms β no change β
β QQuery 16 β 14.85 / 15.30 Β±0.45 / 15.86 ms β 15.12 / 15.22 Β±0.07 / 15.29 ms β no change β
β QQuery 17 β 76.72 / 78.87 Β±1.52 / 80.95 ms β 83.95 / 86.02 Β±2.13 / 89.89 ms β 1.09x slower β
β QQuery 18 β 62.88 / 65.25 Β±1.65 / 67.68 ms β 73.25 / 76.03 Β±3.04 / 81.24 ms β 1.17x slower β
β QQuery 19 β 33.01 / 33.88 Β±1.30 / 36.46 ms β 33.85 / 34.64 Β±1.45 / 37.55 ms β no change β
β QQuery 20 β 34.25 / 34.68 Β±0.38 / 35.35 ms β 33.97 / 34.47 Β±0.50 / 35.19 ms β no change β
β QQuery 21 β 59.72 / 60.17 Β±0.34 / 60.75 ms β 62.71 / 64.50 Β±2.41 / 69.13 ms β 1.07x slower β
β QQuery 22 β 15.06 / 15.19 Β±0.10 / 15.34 ms β 15.44 / 15.60 Β±0.15 / 15.80 ms β no change β
βββββββββββββ΄ββββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 794.45ms β
β Total Time (rich-T-kid_coacler-benchmark) β 828.01ms β
β Average Time (HEAD) β 36.11ms β
β Average Time (rich-T-kid_coacler-benchmark) β 37.64ms β
β Queries Faster β 1 β
β Queries Slower β 5 β
β Queries with No Change β 16 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpch β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 5.0s |
| Peak memory | 1.2 GiB |
| Avg memory | 491.9 MiB |
| CPU user | 22.5s |
| CPU sys | 2.1s |
| Peak spill | 0 B |
**tpch β branch**
| Metric | Value |
|--------|-------|
| Wall time | 5.0s |
| Peak memory | 1.1 GiB |
| Avg memory | 654.6 MiB |
| CPU user | 23.4s |
| CPU sys | 1.9s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739779439
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739768986)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5739768986-2479-d5w29 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (dbfc4e87e81f5ae40f150fa37700863a165cd991) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..dbfc4e87e81f5ae40f150fa37700863a165cd991)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739827502
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739768539)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (dbfc4e87e81f5ae40f150fa37700863a165cd991) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..dbfc4e87e81f5ae40f150fa37700863a165cd991)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.34 ms β 1.25 ms β +1.07x faster β
β QQuery 1 β 12.04 ms β 11.58 ms β no change β
β QQuery 2 β 37.43 ms β 36.36 ms β no change β
β QQuery 3 β 31.35 ms β 30.81 ms β no change β
β QQuery 4 β 251.12 ms β 234.73 ms β +1.07x faster β
β QQuery 5 β 270.62 ms β 273.00 ms β no change β
β QQuery 6 β 1.29 ms β 1.29 ms β no change β
β QQuery 7 β 12.91 ms β 12.88 ms β no change β
β QQuery 8 β 334.22 ms β 330.33 ms β no change β
β QQuery 9 β 463.44 ms β 470.01 ms β no change β
β QQuery 10 β 64.11 ms β 63.43 ms β no change β
β QQuery 11 β 74.88 ms β 74.55 ms β no change β
β QQuery 12 β 260.75 ms β 267.18 ms β no change β
β QQuery 13 β 361.52 ms β 362.47 ms β no change β
β QQuery 14 β 280.69 ms β 281.42 ms β no change β
β QQuery 15 β 279.35 ms β 275.55 ms β no change β
β QQuery 16 β 602.91 ms β 622.46 ms β no change β
β QQuery 17 β 604.91 ms β 626.11 ms β no change β
β QQuery 18 β 1264.54 ms β 1252.26 ms β no change β
β QQuery 19 β 28.20 ms β 26.99 ms β no change β
β QQuery 20 β 522.03 ms β 514.32 ms β no change β
β QQuery 21 β 516.95 ms β 512.69 ms β no change β
β QQuery 22 β 1009.92 ms β 983.38 ms β no change β
β QQuery 23 β 3106.08 ms β 3181.35 ms β no change β
β QQuery 24 β 40.59 ms β 40.96 ms β no change β
β QQuery 25 β 106.19 ms β 106.34 ms β no change β
β QQuery 26 β 41.17 ms β 41.11 ms β no change β
β QQuery 27 β 521.53 ms β 516.88 ms β no change β
β QQuery 28 β 2927.65 ms β 2890.44 ms β no change β
β QQuery 29 β 41.69 ms β 43.02 ms β no change β
β QQuery 30 β 311.94 ms β 321.57 ms β no change β
β QQuery 31 β 275.90 ms β 283.49 ms β no change β
β QQuery 32 β 960.11 ms β 974.91 ms β no change β
β QQuery 33 β 1421.43 ms β 1480.59 ms β no change β
β QQuery 34 β 1445.44 ms β 1454.67 ms β no change β
β QQuery 35 β 291.51 ms β 321.08 ms β 1.10x slower β
β QQuery 36 β 67.47 ms β 69.82 ms β no change β
β QQuery 37 β 35.28 ms β 36.86 ms β no change β
β QQuery 38 β 42.45 ms β 43.36 ms β no change β
β QQuery 39 β 133.25 ms β 156.99 ms β 1.18x slower β
β QQuery 40 β 14.11 ms β 14.94 ms β 1.06x slower β
β QQuery 41 β 13.47 ms β 14.59 ms β 1.08x slower β
β QQuery 42 β 13.08 ms β 14.33 ms β 1.10x slower β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 19096.85ms β
β Total Time (rich-T-kid_coacler-benchmark) β 19272.35ms β
β Average Time (HEAD) β 444.11ms β
β Average Time (rich-T-kid_coacler-benchmark) β 448.19ms β
β Queries Faster β 2 β
β Queries Slower β 5 β
β Queries with No Change β 36 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.34 / 4.45 Β±6.05 / 16.55 ms β 1.25 / 3.99 Β±5.42 / 14.83 ms β +1.12x faster β
β QQuery 1 β 12.04 / 12.30 Β±0.17 / 12.50 ms β 11.58 / 11.73 Β±0.10 / 11.86 ms β no change β
β QQuery 2 β 37.43 / 37.93 Β±0.43 / 38.63 ms β 36.36 / 36.79 Β±0.30 / 37.27 ms β no change β
β QQuery 3 β 31.35 / 32.29 Β±0.95 / 34.12 ms β 30.81 / 31.44 Β±0.41 / 32.04 ms β no change β
β QQuery 4 β 251.12 / 255.01 Β±2.40 / 258.48 ms β 234.73 / 238.15 Β±1.93 / 240.51 ms β +1.07x faster β
β QQuery 5 β 270.62 / 277.94 Β±5.08 / 286.10 ms β 273.00 / 278.59 Β±3.74 / 284.11 ms β no change β
β QQuery 6 β 1.29 / 1.44 Β±0.24 / 1.92 ms β 1.29 / 1.44 Β±0.23 / 1.89 ms β no change β
β QQuery 7 β 12.91 / 13.30 Β±0.34 / 13.91 ms β 12.88 / 13.32 Β±0.23 / 13.58 ms β no change β
β QQuery 8 β 334.22 / 337.47 Β±4.23 / 345.65 ms β 330.33 / 340.53 Β±7.20 / 351.33 ms β no change β
β QQuery 9 β 463.44 / 472.90 Β±8.86 / 487.43 ms β 470.01 / 477.96 Β±6.08 / 488.78 ms β no change β
β QQuery 10 β 64.11 / 65.03 Β±0.98 / 66.94 ms β 63.43 / 65.05 Β±1.21 / 67.18 ms β no change β
β QQuery 11 β 74.88 / 75.56 Β±0.43 / 76.11 ms β 74.55 / 75.62 Β±0.93 / 77.27 ms β no change β
β QQuery 12 β 260.75 / 267.22 Β±5.09 / 274.76 ms β 267.18 / 273.06 Β±4.45 / 279.10 ms β no change β
β QQuery 13 β 361.52 / 379.69 Β±10.25 / 392.32 ms β 362.47 / 366.29 Β±3.47 / 371.05 ms β no change β
β QQuery 14 β 280.69 / 285.41 Β±4.50 / 292.05 ms β 281.42 / 290.10 Β±12.49 / 314.21 ms β no change β
β QQuery 15 β 279.35 / 289.61 Β±7.60 / 301.48 ms β 275.55 / 287.44 Β±11.09 / 307.54 ms β no change β
β QQuery 16 β 602.91 / 623.20 Β±17.23 / 654.31 ms β 622.46 / 637.52 Β±8.32 / 646.01 ms β no change β
β QQuery 17 β 604.91 / 626.65 Β±12.16 / 639.31 ms β 626.11 / 636.58 Β±8.20 / 649.36 ms β no change β
β QQuery 18 β 1264.54 / 1313.07 Β±57.57 / 1426.29 ms β 1252.26 / 1285.24 Β±25.82 / 1318.51 ms β no change β
β QQuery 19 β 28.20 / 28.58 Β±0.26 / 28.98 ms β 26.99 / 27.27 Β±0.25 / 27.66 ms β no change β
β QQuery 20 β 522.03 / 535.40 Β±13.27 / 557.71 ms β 514.32 / 525.30 Β±12.42 / 548.06 ms β no change β
β QQuery 21 β 516.95 / 521.39 Β±6.04 / 533.32 ms β 512.69 / 518.88 Β±4.56 / 526.13 ms β no change β
β QQuery 22 β 1009.92 / 1012.71 Β±2.08 / 1016.03 ms β 983.38 / 998.30 Β±8.67 / 1007.46 ms β no change β
β QQuery 23 β 3106.08 / 3162.00 Β±53.13 / 3233.89 ms β 3181.35 / 3210.02 Β±22.23 / 3240.14 ms β no change β
β QQuery 24 β 40.59 / 42.99 Β±3.75 / 50.44 ms β 40.96 / 41.76 Β±1.03 / 43.65 ms β no change β
β QQuery 25 β 106.19 / 113.27 Β±13.42 / 140.10 ms β 106.34 / 109.54 Β±2.88 / 113.97 ms β no change β
β QQuery 26 β 41.17 / 41.44 Β±0.20 / 41.77 ms β 41.11 / 41.61 Β±0.55 / 42.60 ms β no change β
β QQuery 27 β 521.53 / 530.08 Β±7.99 / 543.87 ms β 516.88 / 526.06 Β±7.34 / 536.49 ms β no change β
β QQuery 28 β 2927.65 / 2950.12 Β±14.57 / 2967.55 ms β 2890.44 / 2924.76 Β±28.34 / 2975.79 ms β no change β
β QQuery 29 β 41.69 / 42.38 Β±0.72 / 43.26 ms β 43.02 / 49.82 Β±13.03 / 75.88 ms β 1.18x slower β
β QQuery 30 β 311.94 / 316.71 Β±3.21 / 320.48 ms β 321.57 / 327.62 Β±7.17 / 339.47 ms β no change β
β QQuery 31 β 275.90 / 291.68 Β±12.21 / 309.22 ms β 283.49 / 292.80 Β±9.70 / 309.71 ms β no change β
β QQuery 32 β 960.11 / 978.90 Β±11.87 / 993.17 ms β 974.91 / 1006.32 Β±31.04 / 1065.04 ms β no change β
β QQuery 33 β 1421.43 / 1470.64 Β±42.05 / 1542.46 ms β 1480.59 / 1495.29 Β±10.92 / 1507.43 ms β no change β
β QQuery 34 β 1445.44 / 1493.31 Β±38.60 / 1545.67 ms β 1454.67 / 1593.83 Β±72.30 / 1653.34 ms β 1.07x slower β
β QQuery 35 β 291.51 / 309.94 Β±19.55 / 345.79 ms β 321.08 / 374.39 Β±86.97 / 546.41 ms β 1.21x slower β
β QQuery 36 β 67.47 / 71.35 Β±4.03 / 78.45 ms β 69.82 / 93.76 Β±25.82 / 143.85 ms β 1.31x slower β
β QQuery 37 β 35.28 / 35.79 Β±0.47 / 36.56 ms β 36.86 / 37.53 Β±0.49 / 38.13 ms β no change β
β QQuery 38 β 42.45 / 43.93 Β±0.82 / 44.95 ms β 43.36 / 45.18 Β±1.63 / 48.04 ms β no change β
β QQuery 39 β 133.25 / 154.72 Β±11.48 / 166.87 ms β 156.99 / 168.23 Β±10.80 / 187.12 ms β 1.09x slower β
β QQuery 40 β 14.11 / 14.39 Β±0.25 / 14.82 ms β 14.94 / 15.88 Β±1.69 / 19.25 ms β 1.10x slower β
β QQuery 41 β 13.47 / 14.27 Β±0.83 / 15.67 ms β 14.59 / 14.76 Β±0.13 / 14.95 ms β no change β
β QQuery 42 β 13.08 / 15.66 Β±4.88 / 25.41 ms β 14.33 / 14.96 Β±0.81 / 16.51 ms β no change β
βββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 19562.14ms β
β Total Time (rich-T-kid_coacler-benchmark) β 19804.72ms β
β Average Time (HEAD) β 454.93ms β
β Average Time (rich-T-kid_coacler-benchmark) β 460.57ms β
β Queries Faster β 2 β
β Queries Slower β 6 β
β Queries with No Change β 35 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**clickbench_partitioned β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 100.0s |
| Peak memory | 12.0 GiB |
| Avg memory | 4.4 GiB |
| CPU user | 1005.9s |
| CPU sys | 69.2s |
| Peak spill | 0 B |
**clickbench_partitioned β branch**
| Metric | Value |
|--------|-------|
| Wall time | 100.0s |
| Peak memory | 11.6 GiB |
| Avg memory | 4.6 GiB |
| CPU user | 1010.2s |
| CPU sys | 72.9s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5736785629
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5736766135)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5736766135-2459-9f4xq 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (76e1f1c24138317d60fc604b72283008fad49b6a) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..76e1f1c24138317d60fc604b72283008fad49b6a)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5736791958
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5736766800)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5736766800-2463-m8sdh 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (76e1f1c24138317d60fc604b72283008fad49b6a) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..76e1f1c24138317d60fc604b72283008fad49b6a)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745741040
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745657661)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (50b4aadf9bd59b1681e8c222be535966e84155d7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..50b4aadf9bd59b1681e8c222be535966e84155d7)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 2.33 ms β 2.08 ms β +1.12x faster β
β QQuery 1 β 26.40 ms β 25.76 ms β no change β
β QQuery 2 β 49.32 ms β 47.46 ms β no change β
β QQuery 3 β 41.44 ms β 39.57 ms β no change β
β QQuery 4 β 255.80 ms β 242.73 ms β +1.05x faster β
β QQuery 5 β 351.84 ms β 340.02 ms β no change β
β QQuery 6 β 2.27 ms β 2.51 ms β 1.11x slower β
β QQuery 7 β 64.64 ms β 61.18 ms β +1.06x faster β
β QQuery 8 β 395.43 ms β 393.90 ms β no change β
β QQuery 9 β 459.21 ms β 474.40 ms β no change β
β QQuery 10 β 162.09 ms β 161.82 ms β no change β
β QQuery 11 β 164.64 ms β 173.78 ms β 1.06x slower β
β QQuery 12 β 371.90 ms β 362.90 ms β no change β
β QQuery 13 β 628.50 ms β 580.39 ms β +1.08x faster β
β QQuery 14 β 343.19 ms β 335.57 ms β no change β
β QQuery 15 β 311.99 ms β 288.04 ms β +1.08x faster β
β QQuery 16 β 668.97 ms β 650.90 ms β no change β
β QQuery 17 β 614.68 ms β 560.74 ms β +1.10x faster β
β QQuery 18 β 1352.62 ms β 1253.35 ms β +1.08x faster β
β QQuery 19 β 43.92 ms β 40.29 ms β +1.09x faster β
β QQuery 20 β 543.62 ms β 543.53 ms β no change β
β QQuery 21 β 595.89 ms β 585.55 ms β no change β
β QQuery 22 β 1084.02 ms β 1106.93 ms β no change β
β QQuery 23 β 1675.16 ms β 1697.36 ms β no change β
β QQuery 24 β 60.26 ms β 49.70 ms β +1.21x faster β
β QQuery 25 β 128.66 ms β 114.17 ms β +1.13x faster β
β QQuery 26 β 55.04 ms β 53.79 ms β no change β
β QQuery 27 β 603.31 ms β 547.80 ms β +1.10x faster β
β QQuery 28 β 3092.72 ms β 3009.14 ms β no change β
β QQuery 29 β 58.99 ms β 57.29 ms β no change β
β QQuery 30 β 379.69 ms β 360.28 ms β +1.05x faster β
β QQuery 31 β 413.61 ms β 402.58 ms β no change β
β QQuery 32 β 1300.50 ms β 1241.79 ms β no change β
β QQuery 33 β 1824.21 ms β 1716.56 ms β +1.06x faster β
β QQuery 34 β 1854.14 ms β 1825.52 ms β no change β
β QQuery 35 β 314.19 ms β 287.01 ms β +1.09x faster β
β QQuery 36 β 139.76 ms β 129.07 ms β +1.08x faster β
β QQuery 37 β 90.60 ms β 89.51 ms β no change β
β QQuery 38 β 100.67 ms β 101.48 ms β no change β
β QQuery 39 β 257.29 ms β 260.19 ms β no change β
β QQuery 40 β 72.34 ms β 71.34 ms β no change β
β QQuery 41 β 67.93 ms β 67.95 ms β no change β
β QQuery 42 β 68.72 ms β 69.43 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 21092.48ms β
β Total Time (rich-T-kid_coacler-benchmark) β 20425.35ms β
β Average Time (HEAD) β 490.52ms β
β Average Time (rich-T-kid_coacler-benchmark) β 475.01ms β
β Queries Faster β 15 β
β Queries Slower β 2 β
β Queries with No Change β 26 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 2.33 / 5.47 Β±6.04 / 17.55 ms β 2.08 / 5.06 Β±5.80 / 16.65 ms β +1.08x faster β
β QQuery 1 β 26.40 / 28.76 Β±2.32 / 32.63 ms β 25.76 / 27.75 Β±1.08 / 29.07 ms β no change β
β QQuery 2 β 49.32 / 51.36 Β±1.12 / 52.63 ms β 47.46 / 50.21 Β±1.45 / 51.75 ms β no change β
β QQuery 3 β 41.44 / 43.57 Β±1.41 / 45.72 ms β 39.57 / 41.09 Β±0.98 / 42.66 ms β +1.06x faster β
β QQuery 4 β 255.80 / 268.36 Β±9.99 / 278.16 ms β 242.73 / 247.24 Β±4.81 / 256.05 ms β +1.09x faster β
β QQuery 5 β 351.84 / 355.30 Β±2.60 / 359.46 ms β 340.02 / 344.90 Β±2.60 / 347.46 ms β no change β
β QQuery 6 β 2.27 / 2.40 Β±0.16 / 2.70 ms β 2.51 / 2.63 Β±0.13 / 2.87 ms β 1.09x slower β
β QQuery 7 β 64.64 / 69.55 Β±6.66 / 82.75 ms β 61.18 / 66.22 Β±3.75 / 72.59 ms β no change β
β QQuery 8 β 395.43 / 401.22 Β±4.45 / 407.19 ms β 393.90 / 401.35 Β±6.42 / 412.70 ms β no change β
β QQuery 9 β 459.21 / 474.14 Β±11.45 / 490.88 ms β 474.40 / 499.65 Β±19.80 / 527.28 ms β 1.05x slower β
β QQuery 10 β 162.09 / 170.78 Β±9.54 / 182.79 ms β 161.82 / 177.73 Β±13.58 / 199.93 ms β no change β
β QQuery 11 β 164.64 / 176.44 Β±8.88 / 192.20 ms β 173.78 / 178.53 Β±3.52 / 183.93 ms β no change β
β QQuery 12 β 371.90 / 384.01 Β±14.78 / 412.56 ms β 362.90 / 385.87 Β±25.42 / 433.88 ms β no change β
β QQuery 13 β 628.50 / 646.33 Β±17.28 / 677.92 ms β 580.39 / 622.77 Β±42.10 / 685.26 ms β no change β
β QQuery 14 β 343.19 / 359.48 Β±11.64 / 373.30 ms β 335.57 / 361.11 Β±14.90 / 378.90 ms β no change β
β QQuery 15 β 311.99 / 331.91 Β±21.52 / 369.75 ms β 288.04 / 318.87 Β±25.76 / 363.76 ms β no change β
β QQuery 16 β 668.97 / 713.83 Β±32.38 / 764.04 ms β 650.90 / 661.29 Β±9.02 / 673.90 ms β +1.08x faster β
β QQuery 17 β 614.68 / 657.59 Β±28.55 / 695.31 ms β 560.74 / 620.42 Β±48.61 / 672.44 ms β +1.06x faster β
β QQuery 18 β 1352.62 / 1445.59 Β±118.08 / 1677.02 ms β 1253.35 / 1316.06 Β±44.68 / 1389.74 ms β +1.10x faster β
β QQuery 19 β 43.92 / 48.48 Β±5.40 / 59.06 ms β 40.29 / 65.51 Β±28.05 / 101.10 ms β 1.35x slower β
β QQuery 20 β 543.62 / 635.89 Β±115.67 / 862.92 ms β 543.53 / 614.20 Β±57.63 / 719.13 ms β no change β
β QQuery 21 β 595.89 / 615.77 Β±18.95 / 647.14 ms β 585.55 / 609.21 Β±18.03 / 638.69 ms β no change β
β QQuery 22 β 1084.02 / 1112.04 Β±43.91 / 1199.61 ms β 1106.93 / 1163.70 Β±66.67 / 1284.67 ms β no change β
β QQuery 23 β 1675.16 / 2005.28 Β±226.33 / 2382.43 ms β 1697.36 / 1888.19 Β±99.97 / 1962.49 ms β +1.06x faster β
β QQuery 24 β 60.26 / 115.86 Β±60.49 / 225.09 ms β 49.70 / 58.00 Β±9.43 / 76.10 ms β +2.00x faster β
β QQuery 25 β 128.66 / 134.98 Β±6.67 / 147.03 ms β 114.17 / 131.10 Β±16.68 / 160.63 ms β no change β
β QQuery 26 β 55.04 / 64.97 Β±10.66 / 85.38 ms β 53.79 / 56.06 Β±1.82 / 58.28 ms β +1.16x faster β
β QQuery 27 β 603.31 / 652.22 Β±38.93 / 705.35 ms β 547.80 / 580.80 Β±29.01 / 631.14 ms β +1.12x faster β
β QQuery 28 β 3092.72 / 3140.08 Β±35.47 / 3185.45 ms β 3009.14 / 3089.17 Β±54.16 / 3152.96 ms β no change β
β QQuery 29 β 58.99 / 100.67 Β±77.83 / 256.26 ms β 57.29 / 95.43 Β±43.70 / 175.78 ms β +1.05x faster β
β QQuery 30 β 379.69 / 410.91 Β±28.98 / 464.03 ms β 360.28 / 371.63 Β±11.08 / 387.58 ms β +1.11x faster β
β QQuery 31 β 413.61 / 440.11 Β±27.06 / 487.11 ms β 402.58 / 449.61 Β±58.92 / 565.51 ms β no change β
β QQuery 32 β 1300.50 / 1415.25 Β±135.76 / 1680.45 ms β 1241.79 / 1397.09 Β±141.10 / 1645.53 ms β no change β
β QQuery 33 β 1824.21 / 1935.08 Β±81.50 / 2036.99 ms β 1716.56 / 1829.66 Β±117.08 / 2046.79 ms β +1.06x faster β
β QQuery 34 β 1854.14 / 1942.88 Β±89.85 / 2078.14 ms β 1825.52 / 2125.39 Β±214.87 / 2494.18 ms β 1.09x slower β
β QQuery 35 β 314.19 / 391.00 Β±125.80 / 641.09 ms β 287.01 / 325.53 Β±43.11 / 408.69 ms β +1.20x faster β
β QQuery 36 β 139.76 / 148.81 Β±11.93 / 172.15 ms β 129.07 / 137.73 Β±5.18 / 144.00 ms β +1.08x faster β
β QQuery 37 β 90.60 / 93.42 Β±3.20 / 98.43 ms β 89.51 / 95.14 Β±5.40 / 102.72 ms β no change β
β QQuery 38 β 100.67 / 108.24 Β±4.09 / 112.05 ms β 101.48 / 106.00 Β±4.77 / 114.55 ms β no change β
β QQuery 39 β 257.29 / 268.38 Β±7.48 / 278.18 ms β 260.19 / 268.45 Β±7.70 / 280.32 ms β no change β
β QQuery 40 β 72.34 / 79.99 Β±6.45 / 88.21 ms β 71.34 / 76.21 Β±8.55 / 93.31 ms β no change β
β QQuery 41 β 67.93 / 78.92 Β±10.82 / 97.99 ms β 67.95 / 74.17 Β±9.53 / 93.17 ms β +1.06x faster β
β QQuery 42 β 68.72 / 71.29 Β±2.56 / 75.48 ms β 69.43 / 81.03 Β±19.03 / 118.80 ms β 1.14x slower β
βββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 22596.62ms β
β Total Time (rich-T-kid_coacler-benchmark) β 22017.77ms β
β Average Time (HEAD) β 525.50ms β
β Average Time (rich-T-kid_coacler-benchmark) β 512.04ms β
β Queries Faster β 16 β
β Queries Slower β 5 β
β Queries with No Change β 22 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**clickbench_partitioned β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 115.0s |
| Peak memory | 14.4 GiB |
| Avg memory | 7.5 GiB |
| CPU user | 1035.6s |
| CPU sys | 122.5s |
| Peak spill | 0 B |
**clickbench_partitioned β branch**
| Metric | Value |
|--------|-------|
| Wall time | 115.0s |
| Peak memory | 14.0 GiB |
| Avg memory | 7.1 GiB |
| CPU user | 1013.0s |
| CPU sys | 113.5s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5743267815
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5743214675)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 40.54 ms β 40.39 ms β no change β
β QQuery 2 β 18.33 ms β 18.29 ms β no change β
β QQuery 3 β 28.56 ms β 28.02 ms β no change β
β QQuery 4 β 17.33 ms β 17.10 ms β no change β
β QQuery 5 β 35.18 ms β 34.72 ms β no change β
β QQuery 6 β 16.07 ms β 16.32 ms β no change β
β QQuery 7 β 41.12 ms β 40.60 ms β no change β
β QQuery 8 β 40.54 ms β 40.02 ms β no change β
β QQuery 9 β 48.38 ms β 49.88 ms β no change β
β QQuery 10 β 40.31 ms β 39.95 ms β no change β
β QQuery 11 β 13.21 ms β 13.34 ms β no change β
β QQuery 12 β 20.93 ms β 20.83 ms β no change β
β QQuery 13 β 39.34 ms β 39.36 ms β no change β
β QQuery 14 β 24.44 ms β 24.38 ms β no change β
β QQuery 15 β 30.59 ms β 30.46 ms β no change β
β QQuery 16 β 14.00 ms β 13.76 ms β no change β
β QQuery 17 β 72.26 ms β 67.46 ms β +1.07x faster β
β QQuery 18 β 60.60 ms β 63.56 ms β no change β
β QQuery 19 β 31.66 ms β 31.67 ms β no change β
β QQuery 20 β 31.90 ms β 32.04 ms β no change β
β QQuery 21 β 55.00 ms β 53.74 ms β no change β
β QQuery 22 β 13.65 ms β 13.68 ms β no change β
βββββββββββββ΄βββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 733.94ms β
β Total Time (rich-T-kid_coacler-benchmark) β 729.59ms β
β Average Time (HEAD) β 33.36ms β
β Average Time (rich-T-kid_coacler-benchmark) β 33.16ms β
β Queries Faster β 1 β
β Queries Slower β 0 β
β Queries with No Change β 21 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 40.54 / 41.93 Β±1.63 / 44.62 ms β 40.39 / 41.85 Β±1.76 / 44.97 ms β no change β
β QQuery 2 β 18.33 / 18.71 Β±0.41 / 19.51 ms β 18.29 / 18.69 Β±0.25 / 19.09 ms β no change β
β QQuery 3 β 28.56 / 28.67 Β±0.11 / 28.86 ms β 28.02 / 28.34 Β±0.18 / 28.56 ms β no change β
β QQuery 4 β 17.33 / 17.77 Β±0.61 / 18.95 ms β 17.10 / 17.44 Β±0.43 / 18.27 ms β no change β
β QQuery 5 β 35.18 / 35.25 Β±0.05 / 35.31 ms β 34.72 / 34.94 Β±0.17 / 35.17 ms β no change β
β QQuery 6 β 16.07 / 16.46 Β±0.38 / 17.16 ms β 16.32 / 16.55 Β±0.34 / 17.21 ms β no change β
β QQuery 7 β 41.12 / 41.91 Β±0.92 / 43.69 ms β 40.60 / 43.15 Β±1.96 / 44.90 ms β no change β
β QQuery 8 β 40.54 / 40.90 Β±0.25 / 41.23 ms β 40.02 / 40.45 Β±0.38 / 41.01 ms β no change β
β QQuery 9 β 48.38 / 50.30 Β±1.29 / 51.93 ms β 49.88 / 50.58 Β±0.75 / 51.93 ms β no change β
β QQuery 10 β 40.31 / 41.07 Β±1.10 / 43.21 ms β 39.95 / 40.27 Β±0.17 / 40.48 ms β no change β
β QQuery 11 β 13.21 / 13.40 Β±0.19 / 13.74 ms β 13.34 / 13.90 Β±0.55 / 14.69 ms β no change β
β QQuery 12 β 20.93 / 21.08 Β±0.17 / 21.39 ms β 20.83 / 21.09 Β±0.20 / 21.40 ms β no change β
β QQuery 13 β 39.34 / 40.85 Β±1.79 / 43.80 ms β 39.36 / 40.97 Β±3.07 / 47.11 ms β no change β
β QQuery 14 β 24.44 / 24.77 Β±0.17 / 24.93 ms β 24.38 / 24.58 Β±0.16 / 24.78 ms β no change β
β QQuery 15 β 30.59 / 31.82 Β±1.04 / 33.27 ms β 30.46 / 31.15 Β±0.79 / 32.66 ms β no change β
β QQuery 16 β 14.00 / 14.09 Β±0.07 / 14.21 ms β 13.76 / 13.94 Β±0.09 / 14.02 ms β no change β
β QQuery 17 β 72.26 / 73.40 Β±1.36 / 76.06 ms β 67.46 / 68.57 Β±1.19 / 70.37 ms β +1.07x faster β
β QQuery 18 β 60.60 / 62.86 Β±2.12 / 66.61 ms β 63.56 / 64.51 Β±1.12 / 66.25 ms β no change β
β QQuery 19 β 31.66 / 32.27 Β±0.81 / 33.84 ms β 31.67 / 32.20 Β±0.86 / 33.91 ms β no change β
β QQuery 20 β 31.90 / 32.04 Β±0.10 / 32.18 ms β 32.04 / 32.30 Β±0.22 / 32.64 ms β no change β
β QQuery 21 β 55.00 / 55.84 Β±0.97 / 57.68 ms β 53.74 / 54.37 Β±0.46 / 54.75 ms β no change β
β QQuery 22 β 13.65 / 13.83 Β±0.12 / 14.03 ms β 13.68 / 14.07 Β±0.54 / 15.12 ms β no change β
βββββββββββββ΄βββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 749.21ms β
β Total Time (rich-T-kid_coacler-benchmark) β 743.88ms β
β Average Time (HEAD) β 34.05ms β
β Average Time (rich-T-kid_coacler-benchmark) β 33.81ms β
β Queries Faster β 1 β
β Queries Slower β 0 β
β Queries with No Change β 21 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpch β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 5.0s |
| Peak memory | 1.3 GiB |
| Avg memory | 513.0 MiB |
| CPU user | 20.8s |
| CPU sys | 1.7s |
| Peak spill | 0 B |
**tpch β branch**
| Metric | Value |
|--------|-------|
| Wall time | 5.0s |
| Peak memory | 1.5 GiB |
| Avg memory | 571.2 MiB |
| CPU user | 20.7s |
| CPU sys | 1.8s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5743230228
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5743214675)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5743214675-2488-m5ccj 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746605348
run benchmark tpch10
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745585003
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745546566)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³ββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 84.02 ms β 83.13 ms β no change β
β QQuery 2 β 88.58 ms β 83.37 ms β +1.06x faster β
β QQuery 3 β 87.56 ms β 84.93 ms β no change β
β QQuery 4 β 62.67 ms β 59.03 ms β +1.06x faster β
β QQuery 5 β 81.65 ms β 86.93 ms β 1.06x slower β
β QQuery 6 β 28.73 ms β 26.72 ms β +1.08x faster β
β QQuery 7 β 246.27 ms β 254.62 ms β no change β
β QQuery 8 β 238.16 ms β 241.65 ms β no change β
β QQuery 9 β 376.08 ms β 376.23 ms β no change β
β QQuery 10 β 96.84 ms β 87.91 ms β +1.10x faster β
β QQuery 11 β 81.69 ms β 81.06 ms β no change β
β QQuery 12 β 351.10 ms β 189.26 ms β +1.86x faster β
β QQuery 13 β 125.43 ms β 118.17 ms β +1.06x faster β
β QQuery 14 β 45.50 ms β 46.91 ms β no change β
β QQuery 15 β 129.91 ms β 127.93 ms β no change β
β QQuery 16 β 105.27 ms β 107.84 ms β no change β
β QQuery 17 β 214.34 ms β 231.05 ms β 1.08x slower β
β QQuery 18 β 335.92 ms β 438.00 ms β 1.30x slower β
β QQuery 19 β 53.18 ms β 53.63 ms β no change β
β QQuery 20 β 101.35 ms β 92.68 ms β +1.09x faster β
β QQuery 21 β 122.87 ms β 125.58 ms β no change β
β QQuery 22 β 82.76 ms β 78.77 ms β no change β
βββββββββββββ΄ββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 3139.90ms β
β Total Time (rich-T-kid_coacler-benchmark) β 3075.40ms β
β Average Time (HEAD) β 142.72ms β
β Average Time (rich-T-kid_coacler-benchmark) β 139.79ms β
β Queries Faster β 7 β
β Queries Slower β 3 β
β Queries with No Change β 12 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 84.02 / 87.35 Β±1.86 / 89.26 ms β 83.13 / 85.05 Β±1.89 / 88.14 ms β no change β
β QQuery 2 β 88.58 / 94.06 Β±3.58 / 98.34 ms β 83.37 / 87.47 Β±3.28 / 92.26 ms β +1.08x faster β
β QQuery 3 β 87.56 / 88.44 Β±0.67 / 89.55 ms β 84.93 / 86.58 Β±1.22 / 88.62 ms β no change β
β QQuery 4 β 62.67 / 66.25 Β±3.63 / 73.22 ms β 59.03 / 63.12 Β±3.35 / 68.07 ms β no change β
β QQuery 5 β 81.65 / 91.21 Β±5.37 / 96.11 ms β 86.93 / 88.80 Β±1.94 / 92.26 ms β no change β
β QQuery 6 β 28.73 / 30.31 Β±1.10 / 31.83 ms β 26.72 / 28.69 Β±1.28 / 30.71 ms β +1.06x faster β
β QQuery 7 β 246.27 / 255.73 Β±5.53 / 261.63 ms β 254.62 / 273.11 Β±19.54 / 310.10 ms β 1.07x slower β
β QQuery 8 β 238.16 / 250.87 Β±10.54 / 265.08 ms β 241.65 / 247.70 Β±4.36 / 253.10 ms β no change β
β QQuery 9 β 376.08 / 381.66 Β±3.82 / 386.29 ms β 376.23 / 394.85 Β±15.99 / 423.76 ms β no change β
β QQuery 10 β 96.84 / 101.79 Β±5.63 / 112.76 ms β 87.91 / 99.28 Β±7.41 / 109.51 ms β no change β
β QQuery 11 β 81.69 / 87.28 Β±5.29 / 95.74 ms β 81.06 / 84.38 Β±3.08 / 88.01 ms β no change β
β QQuery 12 β 351.10 / 367.14 Β±13.70 / 389.81 ms β 189.26 / 197.44 Β±5.84 / 206.68 ms β +1.86x faster β
β QQuery 13 β 125.43 / 129.71 Β±2.74 / 133.53 ms β 118.17 / 128.10 Β±8.67 / 142.53 ms β no change β
β QQuery 14 β 45.50 / 48.82 Β±2.27 / 52.13 ms β 46.91 / 48.83 Β±1.72 / 52.08 ms β no change β
β QQuery 15 β 129.91 / 137.24 Β±9.31 / 155.21 ms β 127.93 / 133.70 Β±4.82 / 141.78 ms β no change β
β QQuery 16 β 105.27 / 112.73 Β±6.53 / 124.84 ms β 107.84 / 111.92 Β±5.07 / 121.86 ms β no change β
β QQuery 17 β 214.34 / 228.02 Β±10.51 / 241.44 ms β 231.05 / 234.82 Β±4.89 / 244.21 ms β no change β
β QQuery 18 β 335.92 / 349.15 Β±10.36 / 361.27 ms β 438.00 / 449.70 Β±9.40 / 462.57 ms β 1.29x slower β
β QQuery 19 β 53.18 / 54.00 Β±0.75 / 54.87 ms β 53.63 / 58.11 Β±6.64 / 71.27 ms β 1.08x slower β
β QQuery 20 β 101.35 / 112.15 Β±12.59 / 133.68 ms β 92.68 / 99.90 Β±4.14 / 104.94 ms β +1.12x faster β
β QQuery 21 β 122.87 / 128.71 Β±7.53 / 143.14 ms β 125.58 / 129.23 Β±2.80 / 133.97 ms β no change β
β QQuery 22 β 82.76 / 89.36 Β±6.66 / 100.84 ms β 78.77 / 89.17 Β±9.60 / 106.25 ms β no change β
βββββββββββββ΄βββββββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 3291.97ms β
β Total Time (rich-T-kid_coacler-benchmark) β 3219.95ms β
β Average Time (HEAD) β 149.63ms β
β Average Time (rich-T-kid_coacler-benchmark) β 146.36ms β
β Queries Faster β 4 β
β Queries Slower β 3 β
β Queries with No Change β 15 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpch β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 20.0s |
| Peak memory | 2.1 GiB |
| Avg memory | 997.6 MiB |
| CPU user | 102.2s |
| CPU sys | 8.6s |
| Peak spill | 0 B |
**tpch β branch**
| Metric | Value |
|--------|-------|
| Wall time | 20.0s |
| Peak memory | 2.4 GiB |
| Avg memory | 1.1 GiB |
| CPU user | 95.5s |
| CPU sys | 8.5s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745563328
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745546566)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5745546566-2506-srsz9 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5736969558
## [Codecov](https://app.codecov.io/gh/apache/datafusion/pull/25487?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:white_check_mark: All modified and coverable lines are covered by tests.
:white_check_mark: Project coverage is 82.36%. Comparing base ([`6e4d9ba`](https://app.codecov.io/gh/apache/datafusion/commit/6e4d9bae3c63585cfd920d6364c0c438028acac1?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`76e1f1c`](https://app.codecov.io/gh/apache/datafusion/commit/76e1f1c24138317d60fc604b72283008fad49b6a?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## main #25487 +/- ##
==========================================
- Coverage 82.36% 82.36% -0.01%
==========================================
Files 1137 1137
Lines 433123 433123
Branches 433123 433123
==========================================
- Hits 356746 356739 -7
- Misses 54846 54851 +5
- Partials 21531 21533 +2
```
</details>
[:umbrella: View full report in Codecov by Harness](https://app.codecov.io/gh/apache/datafusion/pull/25487?dropdown=coverage&src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache).
:loudspeaker: Have feedback on the report? [Share it here](https://about.codecov.io/codecov-pr-comment-feedback/?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache).
<details><summary> :rocket: New features to boost your workflow: </summary>
- :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
- :package: [JS Bundle Analysis](https://docs.codecov.com/docs/javascript-bundle-analysis): Save yourself from yourself by tracking and limiting bundle sizes in JS merges.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746471541
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5746435338)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (50b4aadf9bd59b1681e8c222be535966e84155d7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..50b4aadf9bd59b1681e8c222be535966e84155d7)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 5.39 ms β 5.36 ms β no change β
β QQuery 2 β 79.76 ms β 80.35 ms β no change β
β QQuery 3 β 28.78 ms β 28.66 ms β no change β
β QQuery 4 β 442.33 ms β 441.50 ms β no change β
β QQuery 5 β 50.80 ms β 50.23 ms β no change β
β QQuery 6 β 35.56 ms β 35.35 ms β no change β
β QQuery 7 β 74.00 ms β 74.30 ms β no change β
β QQuery 8 β 35.76 ms β 36.30 ms β no change β
β QQuery 9 β 51.98 ms β 51.61 ms β no change β
β QQuery 10 β 61.24 ms β 61.05 ms β no change β
β QQuery 11 β 270.67 ms β 269.38 ms β no change β
β QQuery 12 β 28.65 ms β 28.61 ms β no change β
β QQuery 13 β 117.27 ms β 116.97 ms β no change β
β QQuery 14 β 391.56 ms β 390.20 ms β no change β
β QQuery 15 β 52.59 ms β 53.07 ms β no change β
β QQuery 16 β 6.37 ms β 6.40 ms β no change β
β QQuery 17 β 77.25 ms β 76.64 ms β no change β
β QQuery 18 β 102.44 ms β 102.31 ms β no change β
β QQuery 19 β 40.98 ms β 41.18 ms β no change β
β QQuery 20 β 35.08 ms β 35.38 ms β no change β
β QQuery 21 β 16.74 ms β 16.72 ms β no change β
β QQuery 22 β 63.37 ms β 63.18 ms β no change β
β QQuery 23 β 307.97 ms β 309.92 ms β no change β
β QQuery 24 β 192.51 ms β 192.09 ms β no change β
β QQuery 25 β 106.46 ms β 106.59 ms β no change β
β QQuery 26 β 47.69 ms β 47.74 ms β no change β
β QQuery 27 β 5.90 ms β 5.75 ms β no change β
β QQuery 28 β 56.48 ms β 56.75 ms β no change β
β QQuery 29 β 94.66 ms β 94.04 ms β no change β
β QQuery 30 β 32.30 ms β 32.35 ms β no change β
β QQuery 31 β 107.92 ms β 107.96 ms β no change β
β QQuery 32 β 20.26 ms β 20.05 ms β no change β
β QQuery 33 β 37.21 ms β 37.34 ms β no change β
β QQuery 34 β 9.76 ms β 9.90 ms β no change β
β QQuery 35 β 71.19 ms β 71.11 ms β no change β
β QQuery 36 β 6.03 ms β 5.57 ms β +1.08x faster β
β QQuery 37 β 6.80 ms β 6.70 ms β no change β
β QQuery 38 β 61.65 ms β 60.15 ms β no change β
β QQuery 39 β 73.04 ms β 73.22 ms β no change β
β QQuery 40 β 23.38 ms β 23.29 ms β no change β
β QQuery 41 β 11.08 ms β 10.81 ms β no change β
β QQuery 42 β 23.83 ms β 23.48 ms β no change β
β QQuery 43 β 5.14 ms β 4.95 ms β no change β
β QQuery 44 β 9.15 ms β 8.99 ms β no change β
β QQuery 45 β 37.30 ms β 38.12 ms β no change β
β QQuery 46 β 11.78 ms β 11.90 ms β no change β
β QQuery 47 β 219.11 ms β 221.85 ms β no change β
β QQuery 48 β 93.78 ms β 94.35 ms β no change β
β QQuery 49 β 70.18 ms β 70.30 ms β no change β
β QQuery 50 β 57.56 ms β 57.24 ms β no change β
β QQuery 51 β 92.65 ms β 91.35 ms β no change β
β QQuery 52 β 24.23 ms β 24.09 ms β no change β
β QQuery 53 β 28.97 ms β 28.97 ms β no change β
β QQuery 54 β 54.08 ms β 53.84 ms β no change β
β QQuery 55 β 23.72 ms β 23.37 ms β no change β
β QQuery 56 β 38.02 ms β 37.83 ms β no change β
β QQuery 57 β 166.55 ms β 167.24 ms β no change β
β QQuery 58 β 109.15 ms β 107.89 ms β no change β
β QQuery 59 β 116.15 ms β 115.76 ms β no change β
β QQuery 60 β 38.42 ms β 38.42 ms β no change β
β QQuery 61 β 11.44 ms β 11.36 ms β no change β
β QQuery 62 β 43.88 ms β 43.91 ms β no change β
β QQuery 63 β 29.13 ms β 29.62 ms β no change β
β QQuery 64 β 358.30 ms β 354.72 ms β no change β
β QQuery 65 β 134.00 ms β 131.68 ms β no change β
β QQuery 66 β 77.38 ms β 76.50 ms β no change β
β QQuery 67 β 248.04 ms β 243.69 ms β no change β
β QQuery 68 β 11.67 ms β 11.75 ms β no change β
β QQuery 69 β 55.86 ms β 56.35 ms β no change β
β QQuery 70 β 103.26 ms β 103.09 ms β no change β
β QQuery 71 β 35.67 ms β 35.28 ms β no change β
β QQuery 72 β 1693.58 ms β 1695.41 ms β no change β
β QQuery 73 β 9.85 ms β 9.93 ms β no change β
β QQuery 74 β 157.17 ms β 154.20 ms β no change β
β QQuery 75 β 141.53 ms β 141.30 ms β no change β
β QQuery 76 β 34.73 ms β 34.32 ms β no change β
β QQuery 77 β 60.47 ms β 59.41 ms β no change β
β QQuery 78 β 163.21 ms β 161.20 ms β no change β
β QQuery 79 β 66.16 ms β 67.11 ms β no change β
β QQuery 80 β 95.87 ms β 95.20 ms β no change β
β QQuery 81 β 25.72 ms β 25.63 ms β no change β
β QQuery 82 β 17.03 ms β 16.44 ms β no change β
β QQuery 83 β 34.00 ms β 33.23 ms β no change β
β QQuery 84 β 29.69 ms β 29.52 ms β no change β
β QQuery 85 β 102.87 ms β 102.56 ms β no change β
β QQuery 86 β 25.67 ms β 24.71 ms β no change β
β QQuery 87 β 61.69 ms β 60.31 ms β no change β
β QQuery 88 β 60.51 ms β 59.93 ms β no change β
β QQuery 89 β 35.22 ms β 34.94 ms β no change β
β QQuery 90 β 16.36 ms β 16.19 ms β no change β
β QQuery 91 β 44.34 ms β 43.53 ms β no change β
β QQuery 92 β 29.46 ms β 28.24 ms β no change β
β QQuery 93 β 49.34 ms β 49.04 ms β no change β
β QQuery 94 β 38.65 ms β 37.79 ms β no change β
β QQuery 95 β 79.99 ms β 78.87 ms β no change β
β QQuery 96 β 23.97 ms β 23.21 ms β no change β
β QQuery 97 β 50.40 ms β 50.81 ms β no change β
β QQuery 98 β 42.71 ms β 42.89 ms β no change β
β QQuery 99 β 65.50 ms β 65.11 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 8924.97ms β
β Total Time (rich-T-kid_coacler-benchmark) β 8895.04ms β
β Average Time (HEAD) β 90.15ms β
β Average Time (rich-T-kid_coacler-benchmark) β 89.85ms β
β Queries Faster β 1 β
β Queries Slower β 0 β
β Queries with No Change β 98 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 5.39 / 6.01 Β±0.96 / 7.91 ms β 5.36 / 6.00 Β±0.97 / 7.93 ms β no change β
β QQuery 2 β 79.76 / 80.26 Β±0.32 / 80.62 ms β 80.35 / 80.52 Β±0.16 / 80.81 ms β no change β
β QQuery 3 β 28.78 / 28.96 Β±0.12 / 29.10 ms β 28.66 / 28.88 Β±0.12 / 28.98 ms β no change β
β QQuery 4 β 442.33 / 445.39 Β±2.44 / 449.17 ms β 441.50 / 445.15 Β±3.25 / 450.75 ms β no change β
β QQuery 5 β 50.80 / 52.14 Β±1.66 / 55.40 ms β 50.23 / 52.18 Β±2.41 / 56.71 ms β no change β
β QQuery 6 β 35.56 / 35.79 Β±0.18 / 36.06 ms β 35.35 / 35.91 Β±0.50 / 36.83 ms β no change β
β QQuery 7 β 74.00 / 74.93 Β±0.64 / 75.88 ms β 74.30 / 74.98 Β±0.85 / 76.63 ms β no change β
β QQuery 8 β 35.76 / 36.20 Β±0.39 / 36.75 ms β 36.30 / 36.57 Β±0.24 / 37.01 ms β no change β
β QQuery 9 β 51.98 / 54.39 Β±1.46 / 56.06 ms β 51.61 / 53.95 Β±1.78 / 56.28 ms β no change β
β QQuery 10 β 61.24 / 61.85 Β±0.53 / 62.85 ms β 61.05 / 61.83 Β±0.49 / 62.57 ms β no change β
β QQuery 11 β 270.67 / 274.29 Β±2.56 / 278.59 ms β 269.38 / 276.51 Β±5.00 / 281.79 ms β no change β
β QQuery 12 β 28.65 / 28.86 Β±0.15 / 29.04 ms β 28.61 / 28.84 Β±0.18 / 29.15 ms β no change β
β QQuery 13 β 117.27 / 118.39 Β±1.14 / 120.09 ms β 116.97 / 118.33 Β±1.23 / 120.40 ms β no change β
β QQuery 14 β 391.56 / 394.93 Β±2.46 / 399.20 ms β 390.20 / 392.98 Β±1.79 / 395.65 ms β no change β
β QQuery 15 β 52.59 / 53.52 Β±1.02 / 55.39 ms β 53.07 / 53.83 Β±0.53 / 54.72 ms β no change β
β QQuery 16 β 6.37 / 6.57 Β±0.24 / 7.04 ms β 6.40 / 6.58 Β±0.18 / 6.89 ms β no change β
β QQuery 17 β 77.25 / 79.53 Β±3.10 / 85.59 ms β 76.64 / 78.48 Β±2.08 / 82.47 ms β no change β
β QQuery 18 β 102.44 / 104.44 Β±1.47 / 106.26 ms β 102.31 / 103.64 Β±0.83 / 104.71 ms β no change β
β QQuery 19 β 40.98 / 41.47 Β±0.30 / 41.81 ms β 41.18 / 41.71 Β±0.37 / 42.20 ms β no change β
β QQuery 20 β 35.08 / 35.69 Β±0.95 / 37.57 ms β 35.38 / 36.39 Β±1.32 / 38.81 ms β no change β
β QQuery 21 β 16.74 / 16.92 Β±0.12 / 17.11 ms β 16.72 / 16.86 Β±0.14 / 17.13 ms β no change β
β QQuery 22 β 63.37 / 64.18 Β±0.76 / 65.47 ms β 63.18 / 64.68 Β±1.53 / 67.38 ms β no change β
β QQuery 23 β 307.97 / 310.72 Β±2.94 / 316.32 ms β 309.92 / 313.57 Β±4.37 / 321.93 ms β no change β
β QQuery 24 β 192.51 / 194.85 Β±3.01 / 200.69 ms β 192.09 / 198.11 Β±6.59 / 210.74 ms β no change β
β QQuery 25 β 106.46 / 108.95 Β±3.20 / 114.83 ms β 106.59 / 109.28 Β±2.09 / 112.10 ms β no change β
β QQuery 26 β 47.69 / 47.91 Β±0.16 / 48.14 ms β 47.74 / 48.10 Β±0.22 / 48.42 ms β no change β
β QQuery 27 β 5.90 / 6.05 Β±0.19 / 6.42 ms β 5.75 / 6.05 Β±0.22 / 6.44 ms β no change β
β QQuery 28 β 56.48 / 59.57 Β±2.14 / 61.64 ms β 56.75 / 60.50 Β±1.95 / 62.43 ms β no change β
β QQuery 29 β 94.66 / 97.43 Β±3.07 / 102.63 ms β 94.04 / 95.76 Β±1.69 / 98.60 ms β no change β
β QQuery 30 β 32.30 / 32.49 Β±0.18 / 32.72 ms β 32.35 / 32.93 Β±0.70 / 34.31 ms β no change β
β QQuery 31 β 107.92 / 108.50 Β±0.47 / 109.35 ms β 107.96 / 108.91 Β±0.89 / 110.52 ms β no change β
β QQuery 32 β 20.26 / 22.25 Β±3.51 / 29.25 ms β 20.05 / 20.31 Β±0.27 / 20.64 ms β +1.10x faster β
β QQuery 33 β 37.21 / 37.81 Β±0.56 / 38.55 ms β 37.34 / 37.69 Β±0.22 / 37.97 ms β no change β
β QQuery 34 β 9.76 / 10.63 Β±0.60 / 11.32 ms β 9.90 / 10.22 Β±0.41 / 11.01 ms β no change β
β QQuery 35 β 71.19 / 72.15 Β±0.58 / 72.92 ms β 71.11 / 72.11 Β±1.27 / 74.57 ms β no change β
β QQuery 36 β 6.03 / 6.77 Β±1.08 / 8.90 ms β 5.57 / 5.74 Β±0.23 / 6.20 ms β +1.18x faster β
β QQuery 37 β 6.80 / 6.91 Β±0.08 / 7.00 ms β 6.70 / 6.87 Β±0.12 / 7.04 ms β no change β
β QQuery 38 β 61.65 / 61.99 Β±0.26 / 62.43 ms β 60.15 / 60.83 Β±0.48 / 61.60 ms β no change β
β QQuery 39 β 73.04 / 73.59 Β±0.47 / 74.39 ms β 73.22 / 74.50 Β±1.23 / 76.55 ms β no change β
β QQuery 40 β 23.38 / 24.04 Β±0.62 / 25.14 ms β 23.29 / 24.10 Β±0.55 / 24.72 ms β no change β
β QQuery 41 β 11.08 / 11.49 Β±0.35 / 11.90 ms β 10.81 / 11.09 Β±0.24 / 11.43 ms β no change β
β QQuery 42 β 23.83 / 24.19 Β±0.43 / 25.03 ms β 23.48 / 23.86 Β±0.43 / 24.68 ms β no change β
β QQuery 43 β 5.14 / 5.30 Β±0.25 / 5.80 ms β 4.95 / 5.07 Β±0.18 / 5.43 ms β no change β
β QQuery 44 β 9.15 / 9.27 Β±0.10 / 9.44 ms β 8.99 / 9.15 Β±0.12 / 9.36 ms β no change β
β QQuery 45 β 37.30 / 37.71 Β±0.26 / 38.01 ms β 38.12 / 38.55 Β±0.32 / 38.91 ms β no change β
β QQuery 46 β 11.78 / 12.95 Β±1.74 / 16.33 ms β 11.90 / 12.22 Β±0.22 / 12.53 ms β +1.06x faster β
β QQuery 47 β 219.11 / 221.12 Β±2.38 / 225.64 ms β 221.85 / 227.64 Β±5.77 / 237.75 ms β no change β
β QQuery 48 β 93.78 / 94.56 Β±0.67 / 95.75 ms β 94.35 / 95.09 Β±0.85 / 96.68 ms β no change β
β QQuery 49 β 70.18 / 71.31 Β±1.67 / 74.63 ms β 70.30 / 71.22 Β±1.21 / 73.56 ms β no change β
β QQuery 50 β 57.56 / 60.47 Β±4.47 / 69.36 ms β 57.24 / 59.86 Β±3.29 / 66.24 ms β no change β
β QQuery 51 β 92.65 / 95.24 Β±1.85 / 98.19 ms β 91.35 / 93.99 Β±1.43 / 95.63 ms β no change β
β QQuery 52 β 24.23 / 24.38 Β±0.10 / 24.49 ms β 24.09 / 24.38 Β±0.15 / 24.50 ms β no change β
β QQuery 53 β 28.97 / 29.07 Β±0.08 / 29.19 ms β 28.97 / 29.38 Β±0.39 / 29.86 ms β no change β
β QQuery 54 β 54.08 / 57.02 Β±4.46 / 65.90 ms β 53.84 / 56.06 Β±3.52 / 63.05 ms β no change β
β QQuery 55 β 23.72 / 24.01 Β±0.24 / 24.30 ms β 23.37 / 23.86 Β±0.41 / 24.39 ms β no change β
β QQuery 56 β 38.02 / 38.66 Β±0.40 / 39.29 ms β 37.83 / 38.60 Β±0.43 / 39.01 ms β no change β
β QQuery 57 β 166.55 / 170.26 Β±2.95 / 175.33 ms β 167.24 / 171.18 Β±4.48 / 179.80 ms β no change β
β QQuery 58 β 109.15 / 110.36 Β±0.74 / 111.41 ms β 107.89 / 109.20 Β±0.73 / 109.86 ms β no change β
β QQuery 59 β 116.15 / 117.41 Β±1.40 / 120.03 ms β 115.76 / 117.73 Β±2.21 / 122.06 ms β no change β
β QQuery 60 β 38.42 / 38.99 Β±0.38 / 39.46 ms β 38.42 / 39.07 Β±0.62 / 39.93 ms β no change β
β QQuery 61 β 11.44 / 11.62 Β±0.21 / 12.02 ms β 11.36 / 11.53 Β±0.16 / 11.81 ms β no change β
β QQuery 62 β 43.88 / 45.59 Β±2.61 / 50.76 ms β 43.91 / 44.10 Β±0.16 / 44.30 ms β no change β
β QQuery 63 β 29.13 / 29.76 Β±0.46 / 30.51 ms β 29.62 / 30.66 Β±1.84 / 34.33 ms β no change β
β QQuery 64 β 358.30 / 361.45 Β±2.40 / 365.14 ms β 354.72 / 360.60 Β±4.78 / 367.77 ms β no change β
β QQuery 65 β 134.00 / 137.07 Β±1.91 / 139.77 ms β 131.68 / 135.61 Β±2.15 / 138.00 ms β no change β
β QQuery 66 β 77.38 / 80.20 Β±3.48 / 86.94 ms β 76.50 / 77.53 Β±0.62 / 78.44 ms β no change β
β QQuery 67 β 248.04 / 251.86 Β±3.19 / 257.43 ms β 243.69 / 245.70 Β±1.43 / 247.39 ms β no change β
β QQuery 68 β 11.67 / 11.99 Β±0.27 / 12.45 ms β 11.75 / 12.04 Β±0.18 / 12.26 ms β no change β
β QQuery 69 β 55.86 / 56.53 Β±0.69 / 57.82 ms β 56.35 / 56.70 Β±0.26 / 57.10 ms β no change β
β QQuery 70 β 103.26 / 106.53 Β±4.80 / 116.00 ms β 103.09 / 104.82 Β±2.28 / 109.27 ms β no change β
β QQuery 71 β 35.67 / 36.27 Β±0.73 / 37.65 ms β 35.28 / 35.89 Β±0.39 / 36.34 ms β no change β
β QQuery 72 β 1693.58 / 1778.37 Β±53.83 / 1863.67 ms β 1695.41 / 1775.63 Β±46.61 / 1829.09 ms β no change β
β QQuery 73 β 9.85 / 10.22 Β±0.36 / 10.88 ms β 9.93 / 10.39 Β±0.34 / 10.80 ms β no change β
β QQuery 74 β 157.17 / 158.86 Β±1.27 / 160.58 ms β 154.20 / 156.06 Β±1.76 / 159.23 ms β no change β
β QQuery 75 β 141.53 / 143.00 Β±0.81 / 143.70 ms β 141.30 / 145.63 Β±4.37 / 153.22 ms β no change β
β QQuery 76 β 34.73 / 35.21 Β±0.44 / 36.00 ms β 34.32 / 34.57 Β±0.16 / 34.77 ms β no change β
β QQuery 77 β 60.47 / 62.49 Β±3.63 / 69.74 ms β 59.41 / 63.11 Β±4.31 / 71.32 ms β no change β
β QQuery 78 β 163.21 / 168.24 Β±6.20 / 180.07 ms β 161.20 / 163.98 Β±2.90 / 169.39 ms β no change β
β QQuery 79 β 66.16 / 66.29 Β±0.10 / 66.42 ms β 67.11 / 68.59 Β±2.71 / 74.01 ms β no change β
β QQuery 80 β 95.87 / 97.21 Β±0.72 / 97.96 ms β 95.20 / 97.32 Β±1.90 / 100.39 ms β no change β
β QQuery 81 β 25.72 / 26.22 Β±0.27 / 26.50 ms β 25.63 / 25.74 Β±0.15 / 26.04 ms β no change β
β QQuery 82 β 17.03 / 17.33 Β±0.25 / 17.67 ms β 16.44 / 16.58 Β±0.15 / 16.79 ms β no change β
β QQuery 83 β 34.00 / 34.15 Β±0.12 / 34.32 ms β 33.23 / 35.13 Β±3.50 / 42.13 ms β no change β
β QQuery 84 β 29.69 / 30.78 Β±1.38 / 33.50 ms β 29.52 / 30.28 Β±0.70 / 31.15 ms β no change β
β QQuery 85 β 102.87 / 103.79 Β±0.98 / 105.53 ms β 102.56 / 103.38 Β±0.73 / 104.74 ms β no change β
β QQuery 86 β 25.67 / 27.98 Β±3.45 / 34.74 ms β 24.71 / 25.21 Β±0.37 / 25.72 ms β +1.11x faster β
β QQuery 87 β 61.69 / 62.92 Β±0.70 / 63.87 ms β 60.31 / 63.18 Β±4.43 / 71.95 ms β no change β
β QQuery 88 β 60.51 / 61.05 Β±0.66 / 62.31 ms β 59.93 / 61.28 Β±1.65 / 64.50 ms β no change β
β QQuery 89 β 35.22 / 35.55 Β±0.25 / 35.92 ms β 34.94 / 35.50 Β±0.36 / 35.95 ms β no change β
β QQuery 90 β 16.36 / 16.63 Β±0.22 / 17.03 ms β 16.19 / 16.43 Β±0.22 / 16.81 ms β no change β
β QQuery 91 β 44.34 / 45.25 Β±0.83 / 46.70 ms β 43.53 / 45.55 Β±2.81 / 51.13 ms β no change β
β QQuery 92 β 29.46 / 29.75 Β±0.36 / 30.45 ms β 28.24 / 28.99 Β±0.66 / 30.13 ms β no change β
β QQuery 93 β 49.34 / 50.26 Β±0.97 / 51.99 ms β 49.04 / 49.97 Β±0.69 / 51.05 ms β no change β
β QQuery 94 β 38.65 / 39.05 Β±0.39 / 39.75 ms β 37.79 / 38.73 Β±0.84 / 40.11 ms β no change β
β QQuery 95 β 79.99 / 81.82 Β±2.20 / 85.61 ms β 78.87 / 81.75 Β±2.90 / 87.26 ms β no change β
β QQuery 96 β 23.97 / 24.01 Β±0.04 / 24.08 ms β 23.21 / 23.60 Β±0.27 / 24.01 ms β no change β
β QQuery 97 β 50.40 / 52.55 Β±1.55 / 54.38 ms β 50.81 / 51.87 Β±1.48 / 54.70 ms β no change β
β QQuery 98 β 42.71 / 43.31 Β±0.39 / 43.76 ms β 42.89 / 43.82 Β±0.59 / 44.39 ms β no change β
β QQuery 99 β 65.50 / 68.40 Β±4.37 / 77.07 ms β 65.11 / 65.25 Β±0.10 / 65.39 ms β no change β
βββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 9130.70ms β
β Total Time (rich-T-kid_coacler-benchmark) β 9110.27ms β
β Average Time (HEAD) β 92.23ms β
β Average Time (rich-T-kid_coacler-benchmark) β 92.02ms β
β Queries Faster β 4 β
β Queries Slower β 0 β
β Queries with No Change β 95 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpcds β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 50.0s |
| Peak memory | 2.1 GiB |
| Avg memory | 1.4 GiB |
| CPU user | 196.1s |
| CPU sys | 5.5s |
| Peak spill | 0 B |
**tpcds β branch**
| Metric | Value |
|--------|-------|
| Wall time | 50.0s |
| Peak memory | 2.0 GiB |
| Avg memory | 1.4 GiB |
| CPU user | 194.7s |
| CPU sys | 5.5s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746501044
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5746451749)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (50b4aadf9bd59b1681e8c222be535966e84155d7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..50b4aadf9bd59b1681e8c222be535966e84155d7)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.50 ms β 1.50 ms β no change β
β QQuery 1 β 24.73 ms β 23.46 ms β +1.05x faster β
β QQuery 2 β 46.93 ms β 47.40 ms β no change β
β QQuery 3 β 36.21 ms β 40.14 ms β 1.11x slower β
β QQuery 4 β 237.55 ms β 234.33 ms β no change β
β QQuery 5 β 317.59 ms β 314.86 ms β no change β
β QQuery 6 β 1.53 ms β 1.52 ms β no change β
β QQuery 7 β 59.48 ms β 60.43 ms β no change β
β QQuery 8 β 374.90 ms β 371.60 ms β no change β
β QQuery 9 β 410.28 ms β 402.64 ms β no change β
β QQuery 10 β 147.84 ms β 147.69 ms β no change β
β QQuery 11 β 159.24 ms β 159.01 ms β no change β
β QQuery 12 β 316.47 ms β 308.87 ms β no change β
β QQuery 13 β 538.18 ms β 534.80 ms β no change β
β QQuery 14 β 305.48 ms β 304.07 ms β no change β
β QQuery 15 β 279.54 ms β 269.90 ms β no change β
β QQuery 16 β 598.22 ms β 590.02 ms β no change β
β QQuery 17 β 567.06 ms β 491.84 ms β +1.15x faster β
β QQuery 18 β 1145.56 ms β 1096.08 ms β no change β
β QQuery 19 β 39.10 ms β 38.99 ms β no change β
β QQuery 20 β 511.76 ms β 506.15 ms β no change β
β QQuery 21 β 569.73 ms β 554.54 ms β no change β
β QQuery 22 β 1037.28 ms β 1034.15 ms β no change β
β QQuery 23 β 1453.85 ms β 1554.90 ms β 1.07x slower β
β QQuery 24 β 45.95 ms β 49.19 ms β 1.07x slower β
β QQuery 25 β 111.99 ms β 111.12 ms β no change β
β QQuery 26 β 49.56 ms β 48.75 ms β no change β
β QQuery 27 β 532.63 ms β 548.68 ms β no change β
β QQuery 28 β 2855.71 ms β 2832.74 ms β no change β
β QQuery 29 β 52.87 ms β 53.02 ms β no change β
β QQuery 30 β 329.66 ms β 333.54 ms β no change β
β QQuery 31 β 364.61 ms β 365.55 ms β no change β
β QQuery 32 β 1148.24 ms β 1062.00 ms β +1.08x faster β
β QQuery 33 β 1514.84 ms β 1490.55 ms β no change β
β QQuery 34 β 1588.25 ms β 1463.45 ms β +1.09x faster β
β QQuery 35 β 260.04 ms β 273.84 ms β 1.05x slower β
β QQuery 36 β 119.92 ms β 116.82 ms β no change β
β QQuery 37 β 84.66 ms β 84.20 ms β no change β
β QQuery 38 β 93.48 ms β 83.47 ms β +1.12x faster β
β QQuery 39 β 213.41 ms β 204.14 ms β no change β
β QQuery 40 β 64.34 ms β 64.02 ms β no change β
β QQuery 41 β 63.81 ms β 66.42 ms β no change β
β QQuery 42 β 63.57 ms β 64.73 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 18737.54ms β
β Total Time (rich-T-kid_coacler-benchmark) β 18405.17ms β
β Average Time (HEAD) β 435.76ms β
β Average Time (rich-T-kid_coacler-benchmark) β 428.03ms β
β Queries Faster β 5 β
β Queries Slower β 4 β
β Queries with No Change β 34 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.50 / 4.38 Β±5.64 / 15.66 ms β 1.50 / 4.39 Β±5.60 / 15.59 ms β no change β
β QQuery 1 β 24.73 / 25.74 Β±1.07 / 27.45 ms β 23.46 / 26.90 Β±2.15 / 30.20 ms β no change β
β QQuery 2 β 46.93 / 49.82 Β±2.23 / 53.12 ms β 47.40 / 49.44 Β±1.61 / 51.66 ms β no change β
β QQuery 3 β 36.21 / 39.56 Β±2.77 / 42.99 ms β 40.14 / 41.31 Β±0.63 / 41.99 ms β no change β
β QQuery 4 β 237.55 / 241.37 Β±2.92 / 244.65 ms β 234.33 / 235.37 Β±0.70 / 236.50 ms β no change β
β QQuery 5 β 317.59 / 325.79 Β±8.10 / 337.45 ms β 314.86 / 320.01 Β±4.32 / 327.64 ms β no change β
β QQuery 6 β 1.53 / 1.73 Β±0.31 / 2.34 ms β 1.52 / 1.73 Β±0.30 / 2.31 ms β no change β
β QQuery 7 β 59.48 / 64.22 Β±5.33 / 74.16 ms β 60.43 / 63.93 Β±5.04 / 73.86 ms β no change β
β QQuery 8 β 374.90 / 379.38 Β±4.37 / 387.50 ms β 371.60 / 378.37 Β±9.07 / 396.15 ms β no change β
β QQuery 9 β 410.28 / 422.99 Β±8.90 / 433.69 ms β 402.64 / 413.58 Β±6.30 / 419.57 ms β no change β
β QQuery 10 β 147.84 / 152.57 Β±4.60 / 161.18 ms β 147.69 / 157.08 Β±9.74 / 172.65 ms β no change β
β QQuery 11 β 159.24 / 162.81 Β±1.91 / 164.90 ms β 159.01 / 163.23 Β±2.28 / 165.61 ms β no change β
β QQuery 12 β 316.47 / 323.20 Β±6.38 / 334.29 ms β 308.87 / 317.12 Β±6.73 / 324.97 ms β no change β
β QQuery 13 β 538.18 / 556.87 Β±14.73 / 582.09 ms β 534.80 / 553.77 Β±20.98 / 593.27 ms β no change β
β QQuery 14 β 305.48 / 326.99 Β±15.54 / 341.95 ms β 304.07 / 315.02 Β±12.92 / 340.38 ms β no change β
β QQuery 15 β 279.54 / 293.69 Β±20.12 / 333.13 ms β 269.90 / 285.03 Β±21.47 / 327.38 ms β no change β
β QQuery 16 β 598.22 / 608.53 Β±9.11 / 619.56 ms β 590.02 / 596.10 Β±5.49 / 604.82 ms β no change β
β QQuery 17 β 567.06 / 589.63 Β±14.02 / 604.14 ms β 491.84 / 572.02 Β±51.34 / 632.01 ms β no change β
β QQuery 18 β 1145.56 / 1190.40 Β±44.79 / 1268.10 ms β 1096.08 / 1117.43 Β±20.28 / 1142.43 ms β +1.07x faster β
β QQuery 19 β 39.10 / 41.40 Β±1.45 / 43.21 ms β 38.99 / 45.01 Β±8.65 / 62.07 ms β 1.09x slower β
β QQuery 20 β 511.76 / 582.43 Β±76.34 / 715.16 ms β 506.15 / 551.51 Β±47.45 / 637.77 ms β +1.06x faster β
β QQuery 21 β 569.73 / 588.12 Β±19.55 / 620.98 ms β 554.54 / 575.56 Β±20.14 / 613.55 ms β no change β
β QQuery 22 β 1037.28 / 1070.28 Β±21.28 / 1094.02 ms β 1034.15 / 1078.18 Β±35.88 / 1138.61 ms β no change β
β QQuery 23 β 1453.85 / 1759.45 Β±170.79 / 1931.10 ms β 1554.90 / 1748.09 Β±178.46 / 2035.98 ms β no change β
β QQuery 24 β 45.95 / 54.31 Β±6.92 / 63.63 ms β 49.19 / 67.30 Β±29.39 / 125.59 ms β 1.24x slower β
β QQuery 25 β 111.99 / 118.19 Β±4.42 / 124.18 ms β 111.12 / 127.87 Β±16.25 / 158.94 ms β 1.08x slower β
β QQuery 26 β 49.56 / 52.97 Β±2.47 / 56.62 ms β 48.75 / 52.32 Β±3.64 / 58.82 ms β no change β
β QQuery 27 β 532.63 / 567.82 Β±34.40 / 629.44 ms β 548.68 / 578.59 Β±23.41 / 616.37 ms β no change β
β QQuery 28 β 2855.71 / 2891.85 Β±28.47 / 2928.81 ms β 2832.74 / 2875.09 Β±32.75 / 2914.23 ms β no change β
β QQuery 29 β 52.87 / 58.30 Β±6.82 / 71.67 ms β 53.02 / 56.39 Β±3.22 / 61.90 ms β no change β
β QQuery 30 β 329.66 / 351.53 Β±39.70 / 430.89 ms β 333.54 / 340.49 Β±6.06 / 348.94 ms β no change β
β QQuery 31 β 364.61 / 372.81 Β±11.21 / 394.95 ms β 365.55 / 394.45 Β±30.43 / 451.97 ms β 1.06x slower β
β QQuery 32 β 1148.24 / 1256.63 Β±126.93 / 1492.49 ms β 1062.00 / 1208.89 Β±186.27 / 1574.90 ms β no change β
β QQuery 33 β 1514.84 / 1591.58 Β±98.64 / 1785.10 ms β 1490.55 / 1620.16 Β±106.03 / 1801.07 ms β no change β
β QQuery 34 β 1588.25 / 1682.90 Β±71.83 / 1783.62 ms β 1463.45 / 1500.21 Β±29.15 / 1544.92 ms β +1.12x faster β
β QQuery 35 β 260.04 / 373.72 Β±209.22 / 792.05 ms β 273.84 / 304.37 Β±34.77 / 362.34 ms β +1.23x faster β
β QQuery 36 β 119.92 / 127.49 Β±10.30 / 147.52 ms β 116.82 / 126.36 Β±10.20 / 144.97 ms β no change β
β QQuery 37 β 84.66 / 87.77 Β±2.18 / 90.74 ms β 84.20 / 92.22 Β±5.37 / 97.73 ms β 1.05x slower β
β QQuery 38 β 93.48 / 112.57 Β±26.43 / 164.05 ms β 83.47 / 93.61 Β±6.53 / 101.57 ms β +1.20x faster β
β QQuery 39 β 213.41 / 224.06 Β±8.64 / 238.09 ms β 204.14 / 220.52 Β±14.54 / 247.28 ms β no change β
β QQuery 40 β 64.34 / 66.26 Β±1.90 / 69.80 ms β 64.02 / 68.78 Β±4.92 / 77.86 ms β no change β
β QQuery 41 β 63.81 / 83.48 Β±35.63 / 154.67 ms β 66.42 / 71.65 Β±5.60 / 81.65 ms β +1.17x faster β
β QQuery 42 β 63.57 / 71.36 Β±7.79 / 85.27 ms β 64.73 / 71.74 Β±5.62 / 79.12 ms β no change β
βββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 19946.95ms β
β Total Time (rich-T-kid_coacler-benchmark) β 19481.20ms β
β Average Time (HEAD) β 463.88ms β
β Average Time (rich-T-kid_coacler-benchmark) β 453.05ms β
β Queries Faster β 6 β
β Queries Slower β 5 β
β Queries with No Change β 32 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**clickbench_partitioned β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 105.0s |
| Peak memory | 14.8 GiB |
| Avg memory | 7.5 GiB |
| CPU user | 925.7s |
| CPU sys | 99.6s |
| Peak spill | 0 B |
**clickbench_partitioned β branch**
| Metric | Value |
|--------|-------|
| Wall time | 100.0s |
| Peak memory | 15.4 GiB |
| Avg memory | 8.0 GiB |
| CPU user | 920.5s |
| CPU sys | 86.4s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746484257
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5746451749)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (50b4aadf9bd59b1681e8c222be535966e84155d7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..50b4aadf9bd59b1681e8c222be535966e84155d7)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³ββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 85.61 ms β 86.95 ms β no change β
β QQuery 2 β 89.21 ms β 89.60 ms β no change β
β QQuery 3 β 84.08 ms β 83.92 ms β no change β
β QQuery 4 β 63.72 ms β 65.31 ms β no change β
β QQuery 5 β 90.70 ms β 91.04 ms β no change β
β QQuery 6 β 28.29 ms β 28.06 ms β no change β
β QQuery 7 β 247.09 ms β 249.63 ms β no change β
β QQuery 8 β 245.50 ms β 242.09 ms β no change β
β QQuery 9 β 378.98 ms β 373.81 ms β no change β
β QQuery 10 β 94.28 ms β 96.59 ms β no change β
β QQuery 11 β 81.58 ms β 85.01 ms β no change β
β QQuery 12 β 353.86 ms β 201.86 ms β +1.75x faster β
β QQuery 13 β 120.96 ms β 120.14 ms β no change β
β QQuery 14 β 44.06 ms β 45.38 ms β no change β
β QQuery 15 β 128.95 ms β 130.88 ms β no change β
β QQuery 16 β 108.51 ms β 108.32 ms β no change β
β QQuery 17 β 213.61 ms β 190.78 ms β +1.12x faster β
β QQuery 18 β 337.84 ms β 336.73 ms β no change β
β QQuery 19 β 53.03 ms β 51.79 ms β no change β
β QQuery 20 β 99.08 ms β 99.75 ms β no change β
β QQuery 21 β 128.48 ms β 124.13 ms β no change β
β QQuery 22 β 83.79 ms β 81.09 ms β no change β
βββββββββββββ΄ββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 3161.23ms β
β Total Time (rich-T-kid_coacler-benchmark) β 2982.87ms β
β Average Time (HEAD) β 143.69ms β
β Average Time (rich-T-kid_coacler-benchmark) β 135.58ms β
β Queries Faster β 2 β
β Queries Slower β 0 β
β Queries with No Change β 20 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 85.61 / 87.60 Β±1.56 / 89.99 ms β 86.95 / 87.95 Β±1.00 / 89.55 ms β no change β
β QQuery 2 β 89.21 / 94.69 Β±2.89 / 97.67 ms β 89.60 / 94.32 Β±2.68 / 96.83 ms β no change β
β QQuery 3 β 84.08 / 88.89 Β±4.48 / 94.48 ms β 83.92 / 91.71 Β±4.49 / 96.41 ms β no change β
β QQuery 4 β 63.72 / 65.82 Β±1.86 / 69.28 ms β 65.31 / 66.53 Β±1.30 / 69.05 ms β no change β
β QQuery 5 β 90.70 / 93.47 Β±2.04 / 96.08 ms β 91.04 / 95.14 Β±5.23 / 104.49 ms β no change β
β QQuery 6 β 28.29 / 30.35 Β±1.30 / 32.04 ms β 28.06 / 29.24 Β±1.04 / 31.12 ms β no change β
β QQuery 7 β 247.09 / 258.68 Β±6.76 / 266.22 ms β 249.63 / 256.92 Β±7.15 / 270.37 ms β no change β
β QQuery 8 β 245.50 / 255.05 Β±8.65 / 268.76 ms β 242.09 / 252.48 Β±10.35 / 270.43 ms β no change β
β QQuery 9 β 378.98 / 398.18 Β±23.19 / 443.63 ms β 373.81 / 391.02 Β±22.06 / 433.48 ms β no change β
β QQuery 10 β 94.28 / 97.77 Β±3.23 / 101.69 ms β 96.59 / 102.23 Β±6.64 / 115.01 ms β no change β
β QQuery 11 β 81.58 / 85.21 Β±2.10 / 87.76 ms β 85.01 / 87.78 Β±2.33 / 91.24 ms β no change β
β QQuery 12 β 353.86 / 365.58 Β±8.06 / 372.58 ms β 201.86 / 203.99 Β±1.74 / 207.08 ms β +1.79x faster β
β QQuery 13 β 120.96 / 126.44 Β±4.09 / 132.79 ms β 120.14 / 130.10 Β±9.39 / 147.54 ms β no change β
β QQuery 14 β 44.06 / 47.30 Β±1.89 / 49.36 ms β 45.38 / 48.84 Β±2.07 / 50.89 ms β no change β
β QQuery 15 β 128.95 / 141.13 Β±12.22 / 162.89 ms β 130.88 / 135.92 Β±2.79 / 138.85 ms β no change β
β QQuery 16 β 108.51 / 114.55 Β±4.72 / 122.25 ms β 108.32 / 109.63 Β±1.00 / 111.11 ms β no change β
β QQuery 17 β 213.61 / 218.56 Β±3.07 / 222.62 ms β 190.78 / 196.13 Β±3.48 / 201.25 ms β +1.11x faster β
β QQuery 18 β 337.84 / 346.39 Β±9.05 / 362.61 ms β 336.73 / 342.09 Β±5.84 / 353.37 ms β no change β
β QQuery 19 β 53.03 / 53.67 Β±0.54 / 54.32 ms β 51.79 / 52.60 Β±0.49 / 53.09 ms β no change β
β QQuery 20 β 99.08 / 110.94 Β±15.24 / 141.02 ms β 99.75 / 107.04 Β±12.31 / 131.61 ms β no change β
β QQuery 21 β 128.48 / 132.02 Β±5.02 / 141.99 ms β 124.13 / 127.82 Β±3.12 / 132.44 ms β no change β
β QQuery 22 β 83.79 / 87.48 Β±2.49 / 91.37 ms β 81.09 / 85.51 Β±2.45 / 88.66 ms β no change β
βββββββββββββ΄βββββββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 3299.76ms β
β Total Time (rich-T-kid_coacler-benchmark) β 3095.01ms β
β Average Time (HEAD) β 149.99ms β
β Average Time (rich-T-kid_coacler-benchmark) β 140.68ms β
β Queries Faster β 2 β
β Queries Slower β 0 β
β Queries with No Change β 20 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpch β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 20.0s |
| Peak memory | 2.3 GiB |
| Avg memory | 1022.7 MiB |
| CPU user | 104.6s |
| CPU sys | 8.7s |
| Peak spill | 0 B |
**tpch β branch**
| Metric | Value |
|--------|-------|
| Wall time | 20.0s |
| Peak memory | 2.3 GiB |
| Avg memory | 1.0 GiB |
| CPU user | 93.0s |
| CPU sys | 8.6s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739439043
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739390843)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 40.84 ms β 41.00 ms β no change β
β QQuery 2 β 18.43 ms β 18.80 ms β no change β
β QQuery 3 β 28.73 ms β 28.50 ms β no change β
β QQuery 4 β 17.44 ms β 17.39 ms β no change β
β QQuery 5 β 35.23 ms β 35.18 ms β no change β
β QQuery 6 β 16.22 ms β 16.38 ms β no change β
β QQuery 7 β 42.06 ms β 42.57 ms β no change β
β QQuery 8 β 39.92 ms β 40.99 ms β no change β
β QQuery 9 β 49.89 ms β 50.23 ms β no change β
β QQuery 10 β 40.56 ms β 40.57 ms β no change β
β QQuery 11 β 13.49 ms β 13.61 ms β no change β
β QQuery 12 β 21.26 ms β 21.06 ms β no change β
β QQuery 13 β 40.13 ms β 41.30 ms β no change β
β QQuery 14 β 24.81 ms β 24.85 ms β no change β
β QQuery 15 β 31.08 ms β 31.08 ms β no change β
β QQuery 16 β 14.19 ms β 14.00 ms β no change β
β QQuery 17 β 73.41 ms β 67.83 ms β +1.08x faster β
β QQuery 18 β 62.10 ms β 62.07 ms β no change β
β QQuery 19 β 31.96 ms β 31.88 ms β no change β
β QQuery 20 β 32.26 ms β 31.92 ms β no change β
β QQuery 21 β 55.65 ms β 55.02 ms β no change β
β QQuery 22 β 14.07 ms β 14.04 ms β no change β
βββββββββββββ΄βββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 743.75ms β
β Total Time (rich-T-kid_coacler-benchmark) β 740.27ms β
β Average Time (HEAD) β 33.81ms β
β Average Time (rich-T-kid_coacler-benchmark) β 33.65ms β
β Queries Faster β 1 β
β Queries Slower β 0 β
β Queries with No Change β 21 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 40.84 / 42.31 Β±0.97 / 43.50 ms β 41.00 / 42.46 Β±1.55 / 44.59 ms β no change β
β QQuery 2 β 18.43 / 19.05 Β±0.72 / 20.40 ms β 18.80 / 19.10 Β±0.26 / 19.55 ms β no change β
β QQuery 3 β 28.73 / 29.02 Β±0.32 / 29.61 ms β 28.50 / 28.85 Β±0.21 / 29.12 ms β no change β
β QQuery 4 β 17.44 / 17.82 Β±0.53 / 18.85 ms β 17.39 / 17.53 Β±0.14 / 17.80 ms β no change β
β QQuery 5 β 35.23 / 36.09 Β±1.35 / 38.77 ms β 35.18 / 35.63 Β±0.25 / 35.90 ms β no change β
β QQuery 6 β 16.22 / 16.36 Β±0.08 / 16.45 ms β 16.38 / 16.73 Β±0.38 / 17.34 ms β no change β
β QQuery 7 β 42.06 / 43.68 Β±1.10 / 45.40 ms β 42.57 / 44.06 Β±1.58 / 46.07 ms β no change β
β QQuery 8 β 39.92 / 40.36 Β±0.29 / 40.75 ms β 40.99 / 41.77 Β±0.76 / 42.89 ms β no change β
β QQuery 9 β 49.89 / 50.73 Β±0.84 / 51.89 ms β 50.23 / 51.45 Β±1.07 / 53.29 ms β no change β
β QQuery 10 β 40.56 / 40.96 Β±0.46 / 41.85 ms β 40.57 / 40.72 Β±0.11 / 40.85 ms β no change β
β QQuery 11 β 13.49 / 13.63 Β±0.14 / 13.85 ms β 13.61 / 13.78 Β±0.21 / 14.17 ms β no change β
β QQuery 12 β 21.26 / 21.71 Β±0.58 / 22.79 ms β 21.06 / 21.75 Β±0.63 / 22.81 ms β no change β
β QQuery 13 β 40.13 / 42.61 Β±1.94 / 45.15 ms β 41.30 / 45.01 Β±2.84 / 49.28 ms β 1.06x slower β
β QQuery 14 β 24.81 / 24.91 Β±0.08 / 25.05 ms β 24.85 / 24.96 Β±0.06 / 25.03 ms β no change β
β QQuery 15 β 31.08 / 31.78 Β±0.85 / 33.41 ms β 31.08 / 31.91 Β±1.02 / 33.86 ms β no change β
β QQuery 16 β 14.19 / 14.37 Β±0.13 / 14.59 ms β 14.00 / 14.27 Β±0.17 / 14.50 ms β no change β
β QQuery 17 β 73.41 / 73.72 Β±0.23 / 74.12 ms β 67.83 / 68.49 Β±0.52 / 69.40 ms β +1.08x faster β
β QQuery 18 β 62.10 / 64.37 Β±2.74 / 69.12 ms β 62.07 / 67.54 Β±3.48 / 71.03 ms β no change β
β QQuery 19 β 31.96 / 32.15 Β±0.14 / 32.37 ms β 31.88 / 32.80 Β±1.00 / 34.68 ms β no change β
β QQuery 20 β 32.26 / 32.57 Β±0.30 / 33.11 ms β 31.92 / 32.34 Β±0.25 / 32.60 ms β no change β
β QQuery 21 β 55.65 / 56.38 Β±0.75 / 57.61 ms β 55.02 / 57.15 Β±1.84 / 59.55 ms β no change β
β QQuery 22 β 14.07 / 14.39 Β±0.26 / 14.73 ms β 14.04 / 14.20 Β±0.11 / 14.35 ms β no change β
βββββββββββββ΄βββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 758.97ms β
β Total Time (rich-T-kid_coacler-benchmark) β 762.47ms β
β Average Time (HEAD) β 34.50ms β
β Average Time (rich-T-kid_coacler-benchmark) β 34.66ms β
β Queries Faster β 1 β
β Queries Slower β 1 β
β Queries with No Change β 20 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpch β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 5.0s |
| Peak memory | 1.3 GiB |
| Avg memory | 519.8 MiB |
| CPU user | 21.5s |
| CPU sys | 1.7s |
| Peak spill | 0 B |
**tpch β branch**
| Metric | Value |
|--------|-------|
| Wall time | 5.0s |
| Peak memory | 1.3 GiB |
| Avg memory | 536.6 MiB |
| CPU user | 21.3s |
| CPU sys | 1.7s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739476658
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739398003)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5739398003-2475-nv2h7 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745670725
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745657661)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5745657661-2510-dfdn7 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (50b4aadf9bd59b1681e8c222be535966e84155d7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..50b4aadf9bd59b1681e8c222be535966e84155d7)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746462905
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5746451749)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5746451749-2516-rtx85 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (50b4aadf9bd59b1681e8c222be535966e84155d7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..50b4aadf9bd59b1681e8c222be535966e84155d7)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5743304599
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5743214143)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.33 ms β 1.35 ms β no change β
β QQuery 1 β 12.03 ms β 11.95 ms β no change β
β QQuery 2 β 37.43 ms β 37.49 ms β no change β
β QQuery 3 β 32.25 ms β 32.01 ms β no change β
β QQuery 4 β 260.93 ms β 271.76 ms β no change β
β QQuery 5 β 296.19 ms β 302.72 ms β no change β
β QQuery 6 β 1.47 ms β 1.38 ms β +1.07x faster β
β QQuery 7 β 13.80 ms β 13.49 ms β no change β
β QQuery 8 β 369.68 ms β 371.04 ms β no change β
β QQuery 9 β 515.39 ms β 518.97 ms β no change β
β QQuery 10 β 66.91 ms β 65.99 ms β no change β
β QQuery 11 β 79.78 ms β 78.18 ms β no change β
β QQuery 12 β 286.58 ms β 293.63 ms β no change β
β QQuery 13 β 395.39 ms β 414.27 ms β no change β
β QQuery 14 β 302.97 ms β 311.62 ms β no change β
β QQuery 15 β 316.36 ms β 329.27 ms β no change β
β QQuery 16 β 662.21 ms β 693.16 ms β no change β
β QQuery 17 β 675.59 ms β 699.55 ms β no change β
β QQuery 18 β 1350.89 ms β 1366.39 ms β no change β
β QQuery 19 β 28.39 ms β 28.89 ms β no change β
β QQuery 20 β 522.15 ms β 524.10 ms β no change β
β QQuery 21 β 519.22 ms β 516.41 ms β no change β
β QQuery 22 β 1017.20 ms β 1002.70 ms β no change β
β QQuery 23 β 3182.95 ms β 3217.41 ms β no change β
β QQuery 24 β 41.65 ms β 41.77 ms β no change β
β QQuery 25 β 108.68 ms β 108.12 ms β no change β
β QQuery 26 β 42.28 ms β 42.47 ms β no change β
β QQuery 27 β 520.15 ms β 525.69 ms β no change β
β QQuery 28 β 2981.11 ms β 2994.53 ms β no change β
β QQuery 29 β 42.79 ms β 43.13 ms β no change β
β QQuery 30 β 329.72 ms β 335.63 ms β no change β
β QQuery 31 β 297.97 ms β 309.01 ms β no change β
β QQuery 32 β 1022.38 ms β 1108.12 ms β 1.08x slower β
β QQuery 33 β 1591.10 ms β 1605.84 ms β no change β
β QQuery 34 β 1603.32 ms β 1625.41 ms β no change β
β QQuery 35 β 340.65 ms β 342.77 ms β no change β
β QQuery 36 β 70.62 ms β 72.65 ms β no change β
β QQuery 37 β 37.40 ms β 37.02 ms β no change β
β QQuery 38 β 46.10 ms β 42.14 ms β +1.09x faster β
β QQuery 39 β 148.30 ms β 134.26 ms β +1.10x faster β
β QQuery 40 β 15.33 ms β 15.39 ms β no change β
β QQuery 41 β 14.78 ms β 14.76 ms β no change β
β QQuery 42 β 14.49 ms β 14.31 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 20215.91ms β
β Total Time (rich-T-kid_coacler-benchmark) β 20516.74ms β
β Average Time (HEAD) β 470.14ms β
β Average Time (rich-T-kid_coacler-benchmark) β 477.13ms β
β Queries Faster β 3 β
β Queries Slower β 1 β
β Queries with No Change β 39 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.33 / 4.31 Β±5.78 / 15.88 ms β 1.35 / 4.27 Β±5.67 / 15.60 ms β no change β
β QQuery 1 β 12.03 / 12.33 Β±0.19 / 12.62 ms β 11.95 / 12.11 Β±0.11 / 12.24 ms β no change β
β QQuery 2 β 37.43 / 37.89 Β±0.39 / 38.40 ms β 37.49 / 37.91 Β±0.32 / 38.42 ms β no change β
β QQuery 3 β 32.25 / 32.98 Β±0.79 / 34.30 ms β 32.01 / 32.24 Β±0.20 / 32.55 ms β no change β
β QQuery 4 β 260.93 / 267.18 Β±3.15 / 269.13 ms β 271.76 / 274.12 Β±1.95 / 277.14 ms β no change β
β QQuery 5 β 296.19 / 302.73 Β±4.61 / 309.05 ms β 302.72 / 303.55 Β±0.52 / 304.19 ms β no change β
β QQuery 6 β 1.47 / 1.61 Β±0.20 / 2.01 ms β 1.38 / 1.55 Β±0.22 / 1.98 ms β no change β
β QQuery 7 β 13.80 / 13.96 Β±0.10 / 14.08 ms β 13.49 / 13.66 Β±0.14 / 13.86 ms β no change β
β QQuery 8 β 369.68 / 374.34 Β±4.10 / 381.76 ms β 371.04 / 373.90 Β±2.73 / 378.87 ms β no change β
β QQuery 9 β 515.39 / 524.74 Β±7.76 / 537.63 ms β 518.97 / 538.51 Β±13.05 / 558.41 ms β no change β
β QQuery 10 β 66.91 / 70.32 Β±5.28 / 80.78 ms β 65.99 / 66.83 Β±0.64 / 67.75 ms β no change β
β QQuery 11 β 79.78 / 80.71 Β±0.85 / 82.11 ms β 78.18 / 83.93 Β±10.67 / 105.25 ms β no change β
β QQuery 12 β 286.58 / 299.60 Β±9.20 / 314.30 ms β 293.63 / 298.66 Β±5.04 / 307.87 ms β no change β
β QQuery 13 β 395.39 / 402.73 Β±9.14 / 420.58 ms β 414.27 / 428.61 Β±11.36 / 445.69 ms β 1.06x slower β
β QQuery 14 β 302.97 / 306.84 Β±2.14 / 309.03 ms β 311.62 / 317.32 Β±3.11 / 320.17 ms β no change β
β QQuery 15 β 316.36 / 321.13 Β±2.43 / 323.15 ms β 329.27 / 334.32 Β±5.45 / 342.82 ms β no change β
β QQuery 16 β 662.21 / 672.50 Β±6.81 / 683.64 ms β 693.16 / 699.69 Β±5.81 / 708.97 ms β no change β
β QQuery 17 β 675.59 / 685.80 Β±9.52 / 699.14 ms β 699.55 / 707.70 Β±6.04 / 717.39 ms β no change β
β QQuery 18 β 1350.89 / 1391.81 Β±31.20 / 1447.18 ms β 1366.39 / 1418.97 Β±43.72 / 1491.63 ms β no change β
β QQuery 19 β 28.39 / 32.57 Β±4.53 / 39.93 ms β 28.89 / 38.86 Β±19.17 / 77.18 ms β 1.19x slower β
β QQuery 20 β 522.15 / 539.01 Β±16.40 / 560.44 ms β 524.10 / 547.24 Β±31.50 / 609.47 ms β no change β
β QQuery 21 β 519.22 / 524.37 Β±3.75 / 530.35 ms β 516.41 / 525.28 Β±9.31 / 542.34 ms β no change β
β QQuery 22 β 1017.20 / 1023.73 Β±6.32 / 1035.11 ms β 1002.70 / 1028.31 Β±17.74 / 1054.75 ms β no change β
β QQuery 23 β 3182.95 / 3241.73 Β±31.44 / 3272.42 ms β 3217.41 / 3240.53 Β±17.83 / 3266.59 ms β no change β
β QQuery 24 β 41.65 / 46.55 Β±5.31 / 55.59 ms β 41.77 / 43.39 Β±2.90 / 49.18 ms β +1.07x faster β
β QQuery 25 β 108.68 / 112.87 Β±3.77 / 119.40 ms β 108.12 / 112.96 Β±5.20 / 122.93 ms β no change β
β QQuery 26 β 42.28 / 44.28 Β±2.73 / 49.67 ms β 42.47 / 44.35 Β±2.94 / 50.16 ms β no change β
β QQuery 27 β 520.15 / 533.43 Β±8.13 / 543.90 ms β 525.69 / 531.95 Β±4.63 / 537.44 ms β no change β
β QQuery 28 β 2981.11 / 3011.34 Β±24.97 / 3040.43 ms β 2994.53 / 3011.55 Β±14.17 / 3029.53 ms β no change β
β QQuery 29 β 42.79 / 43.04 Β±0.16 / 43.19 ms β 43.13 / 50.63 Β±6.90 / 60.11 ms β 1.18x slower β
β QQuery 30 β 329.72 / 336.66 Β±4.41 / 341.46 ms β 335.63 / 342.53 Β±6.91 / 355.21 ms β no change β
β QQuery 31 β 297.97 / 311.80 Β±7.07 / 317.60 ms β 309.01 / 313.94 Β±4.26 / 320.88 ms β no change β
β QQuery 32 β 1022.38 / 1056.51 Β±19.79 / 1079.30 ms β 1108.12 / 1133.86 Β±31.10 / 1191.17 ms β 1.07x slower β
β QQuery 33 β 1591.10 / 1634.92 Β±26.07 / 1670.43 ms β 1605.84 / 1628.51 Β±19.24 / 1660.68 ms β no change β
β QQuery 34 β 1603.32 / 1656.80 Β±31.95 / 1699.20 ms β 1625.41 / 1673.93 Β±60.23 / 1788.89 ms β no change β
β QQuery 35 β 340.65 / 375.40 Β±37.59 / 435.70 ms β 342.77 / 363.74 Β±21.16 / 401.04 ms β no change β
β QQuery 36 β 70.62 / 77.21 Β±8.32 / 93.39 ms β 72.65 / 79.45 Β±4.17 / 84.95 ms β no change β
β QQuery 37 β 37.40 / 42.93 Β±7.06 / 55.64 ms β 37.02 / 37.79 Β±0.58 / 38.66 ms β +1.14x faster β
β QQuery 38 β 46.10 / 48.76 Β±3.40 / 55.43 ms β 42.14 / 49.59 Β±6.67 / 58.44 ms β no change β
β QQuery 39 β 148.30 / 164.99 Β±10.01 / 178.93 ms β 134.26 / 150.42 Β±8.91 / 160.03 ms β +1.10x faster β
β QQuery 40 β 15.33 / 18.05 Β±3.57 / 25.12 ms β 15.39 / 18.18 Β±2.70 / 22.72 ms β no change β
β QQuery 41 β 14.78 / 15.61 Β±0.98 / 17.48 ms β 14.76 / 18.85 Β±6.54 / 31.68 ms β 1.21x slower β
β QQuery 42 β 14.49 / 15.85 Β±2.23 / 20.29 ms β 14.31 / 15.07 Β±1.39 / 17.84 ms β no change β
βββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 20711.95ms β
β Total Time (rich-T-kid_coacler-benchmark) β 20948.75ms β
β Average Time (HEAD) β 481.67ms β
β Average Time (rich-T-kid_coacler-benchmark) β 487.18ms β
β Queries Faster β 3 β
β Queries Slower β 5 β
β Queries with No Change β 35 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**clickbench_partitioned β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 105.0s |
| Peak memory | 12.4 GiB |
| Avg memory | 4.8 GiB |
| CPU user | 1061.8s |
| CPU sys | 74.8s |
| Peak spill | 0 B |
**clickbench_partitioned β branch**
| Metric | Value |
|--------|-------|
| Wall time | 110.0s |
| Peak memory | 12.1 GiB |
| Avg memory | 4.2 GiB |
| CPU user | 1081.2s |
| CPU sys | 79.3s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745739297
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745657661)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (50b4aadf9bd59b1681e8c222be535966e84155d7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..50b4aadf9bd59b1681e8c222be535966e84155d7)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 60.74 ms β 62.10 ms β no change β
β QQuery 2 β 319.68 ms β 314.29 ms β no change β
β QQuery 3 β 76.33 ms β 71.36 ms β +1.07x faster β
β QQuery 4 β 714.37 ms β 742.08 ms β no change β
β QQuery 5 β 363.35 ms β 373.57 ms β no change β
β QQuery 6 β 151.56 ms β 164.69 ms β 1.09x slower β
β QQuery 7 β 113.12 ms β 115.87 ms β no change β
β QQuery 8 β 149.56 ms β 162.27 ms β 1.08x slower β
β QQuery 9 β 223.23 ms β 239.04 ms β 1.07x slower β
β QQuery 10 β 137.10 ms β 141.09 ms β no change β
β QQuery 11 β 446.22 ms β 470.11 ms β 1.05x slower β
β QQuery 12 β 109.06 ms β 105.34 ms β no change β
β QQuery 13 β 262.46 ms β 267.62 ms β no change β
β QQuery 14 β 5352.81 ms β 1201.60 ms β +4.45x faster β
β QQuery 15 β 101.19 ms β 102.05 ms β no change β
β QQuery 16 β 63.56 ms β 61.54 ms β no change β
β QQuery 17 β 552.09 ms β 558.66 ms β no change β
β QQuery 18 β 524.23 ms β 521.48 ms β no change β
β QQuery 19 β 95.65 ms β 102.49 ms β 1.07x slower β
β QQuery 20 β 112.64 ms β 113.11 ms β no change β
β QQuery 21 β 65.02 ms β 67.31 ms β no change β
β QQuery 22 β 115.42 ms β 122.53 ms β 1.06x slower β
β QQuery 23 β 914.73 ms β 903.32 ms β no change β
β QQuery 24 β 511.26 ms β 522.96 ms β no change β
β QQuery 25 β 585.07 ms β 597.59 ms β no change β
β QQuery 26 β 85.65 ms β 88.80 ms β no change β
β QQuery 27 β 56.99 ms β 52.28 ms β +1.09x faster β
β QQuery 28 β 119.35 ms β 119.14 ms β no change β
β QQuery 29 β 580.78 ms β 581.51 ms β no change β
β QQuery 30 β 177.69 ms β 176.91 ms β no change β
β QQuery 31 β 462.13 ms β 488.83 ms β 1.06x slower β
β QQuery 32 β 75.56 ms β 76.89 ms β no change β
β QQuery 33 β 149.90 ms β 156.89 ms β no change β
β QQuery 34 β 60.99 ms β 61.47 ms β no change β
β QQuery 35 β 164.55 ms β 164.11 ms β no change β
β QQuery 36 β 89.89 ms β 87.15 ms β no change β
β QQuery 37 β 46.11 ms β 45.72 ms β no change β
β QQuery 38 β 203.28 ms β 205.90 ms β no change β
β QQuery 39 β 286.30 ms β 278.24 ms β no change β
β QQuery 40 β 74.21 ms β 73.12 ms β no change β
β QQuery 41 β 88.41 ms β 88.49 ms β no change β
β QQuery 42 β 66.79 ms β 65.10 ms β no change β
β QQuery 43 β 51.68 ms β 51.79 ms β no change β
β QQuery 44 β 156.70 ms β 145.21 ms β +1.08x faster β
β QQuery 45 β 90.11 ms β 99.94 ms β 1.11x slower β
β QQuery 46 β 65.19 ms β 65.83 ms β no change β
β QQuery 47 β 506.44 ms β 487.62 ms β no change β
β QQuery 48 β 251.19 ms β 245.51 ms β no change β
β QQuery 49 β 288.06 ms β 266.02 ms β +1.08x faster β
β QQuery 50 β 315.82 ms β 317.96 ms β no change β
β QQuery 51 β 296.74 ms β 294.45 ms β no change β
β QQuery 52 β 65.86 ms β 67.95 ms β no change β
β QQuery 53 β 110.79 ms β 107.73 ms β no change β
β QQuery 54 β 273.60 ms β 260.85 ms β no change β
β QQuery 55 β 71.08 ms β 68.37 ms β no change β
β QQuery 56 β 121.68 ms β 126.21 ms β no change β
β QQuery 57 β 409.13 ms β 407.42 ms β no change β
β QQuery 58 β 249.35 ms β 249.75 ms β no change β
β QQuery 59 β 221.56 ms β 215.63 ms β no change β
β QQuery 60 β 122.36 ms β 124.50 ms β no change β
β QQuery 61 β 32.71 ms β 32.46 ms β no change β
β QQuery 62 β 101.53 ms β 100.62 ms β no change β
β QQuery 63 β 109.88 ms β 110.11 ms β no change β
β QQuery 64 β 2515.91 ms β 2507.18 ms β no change β
β QQuery 65 β 573.41 ms β 561.80 ms β no change β
β QQuery 66 β 209.36 ms β 207.85 ms β no change β
β QQuery 67 β 361.36 ms β 373.04 ms β no change β
β QQuery 68 β 67.56 ms β 63.16 ms β +1.07x faster β
β QQuery 69 β 137.67 ms β 137.03 ms β no change β
β QQuery 70 β 262.56 ms β 264.98 ms β no change β
β QQuery 71 β 98.88 ms β 98.78 ms β no change β
β QQuery 72 β 5582.52 ms β 5573.31 ms β no change β
β QQuery 73 β 60.12 ms β 60.33 ms β no change β
β QQuery 74 β 320.33 ms β 352.19 ms β 1.10x slower β
β QQuery 75 β 881.57 ms β 1012.40 ms β 1.15x slower β
β QQuery 76 β 156.08 ms β 168.78 ms β 1.08x slower β
β QQuery 77 β 364.47 ms β 371.94 ms β no change β
β QQuery 78 β 329.69 ms β 352.38 ms β 1.07x slower β
β QQuery 79 β 132.60 ms β 124.31 ms β +1.07x faster β
β QQuery 80 β 508.90 ms β 511.59 ms β no change β
β QQuery 81 β 177.00 ms β 170.70 ms β no change β
β QQuery 82 β 69.50 ms β 66.35 ms β no change β
β QQuery 83 β 179.61 ms β 175.63 ms β no change β
β QQuery 84 β 66.15 ms β 73.34 ms β 1.11x slower β
β QQuery 85 β 450.08 ms β 448.37 ms β no change β
β QQuery 86 β 103.82 ms β 104.02 ms β no change β
β QQuery 87 β 207.26 ms β 200.37 ms β no change β
β QQuery 88 β 155.26 ms β 156.37 ms β no change β
β QQuery 89 β 122.69 ms β 124.74 ms β no change β
β QQuery 90 β 46.84 ms β 45.45 ms β no change β
β QQuery 91 β 106.73 ms β 101.69 ms β no change β
β QQuery 92 β 83.12 ms β 89.31 ms β 1.07x slower β
β QQuery 93 β 225.82 ms β 228.21 ms β no change β
β QQuery 94 β 118.93 ms β 121.30 ms β no change β
β QQuery 95 β 460.06 ms β 465.68 ms β no change β
β QQuery 96 β 39.99 ms β 39.22 ms β no change β
β QQuery 97 β 157.74 ms β 156.07 ms β no change β
β QQuery 98 β 124.03 ms β 126.64 ms β no change β
β QQuery 99 β 120.69 ms β 119.92 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 34398.75ms β
β Total Time (rich-T-kid_coacler-benchmark) β 30514.99ms β
β Average Time (HEAD) β 347.46ms β
β Average Time (rich-T-kid_coacler-benchmark) β 308.23ms β
β Queries Faster β 7 β
β Queries Slower β 14 β
β Queries with No Change β 78 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 60.74 / 62.04 Β±1.83 / 65.66 ms β 62.10 / 63.15 Β±1.35 / 65.78 ms β no change β
β QQuery 2 β 319.68 / 324.23 Β±6.57 / 337.26 ms β 314.29 / 321.02 Β±5.81 / 331.58 ms β no change β
β QQuery 3 β 76.33 / 83.71 Β±7.41 / 97.98 ms β 71.36 / 80.34 Β±11.17 / 102.28 ms β no change β
β QQuery 4 β 714.37 / 739.17 Β±21.70 / 768.84 ms β 742.08 / 773.05 Β±24.11 / 803.84 ms β no change β
β QQuery 5 β 363.35 / 395.54 Β±45.38 / 485.55 ms β 373.57 / 396.74 Β±25.81 / 441.07 ms β no change β
β QQuery 6 β 151.56 / 169.47 Β±15.04 / 193.87 ms β 164.69 / 173.22 Β±11.87 / 196.11 ms β no change β
β QQuery 7 β 113.12 / 126.75 Β±10.74 / 145.59 ms β 115.87 / 131.51 Β±13.28 / 151.45 ms β no change β
β QQuery 8 β 149.56 / 167.03 Β±16.59 / 197.20 ms β 162.27 / 173.69 Β±9.37 / 183.58 ms β no change β
β QQuery 9 β 223.23 / 249.48 Β±17.58 / 270.49 ms β 239.04 / 248.43 Β±8.94 / 264.17 ms β no change β
β QQuery 10 β 137.10 / 149.72 Β±12.98 / 174.63 ms β 141.09 / 147.54 Β±5.46 / 156.74 ms β no change β
β QQuery 11 β 446.22 / 491.69 Β±24.88 / 515.10 ms β 470.11 / 483.29 Β±10.58 / 497.76 ms β no change β
β QQuery 12 β 109.06 / 121.85 Β±20.41 / 162.31 ms β 105.34 / 108.70 Β±2.68 / 112.76 ms β +1.12x faster β
β QQuery 13 β 262.46 / 276.68 Β±7.89 / 285.32 ms β 267.62 / 277.00 Β±8.75 / 292.72 ms β no change β
β QQuery 14 β 5352.81 / 5580.42 Β±137.43 / 5779.17 ms β 1201.60 / 1292.60 Β±72.53 / 1391.90 ms β +4.32x faster β
β QQuery 15 β 101.19 / 104.81 Β±3.38 / 110.78 ms β 102.05 / 111.07 Β±9.48 / 128.71 ms β 1.06x slower β
β QQuery 16 β 63.56 / 71.97 Β±7.89 / 83.22 ms β 61.54 / 64.54 Β±1.79 / 67.01 ms β +1.12x faster β
β QQuery 17 β 552.09 / 574.44 Β±18.33 / 601.65 ms β 558.66 / 579.05 Β±20.82 / 616.47 ms β no change β
β QQuery 18 β 524.23 / 548.91 Β±20.16 / 584.80 ms β 521.48 / 531.98 Β±8.07 / 545.46 ms β no change β
β QQuery 19 β 95.65 / 108.80 Β±6.85 / 114.01 ms β 102.49 / 108.13 Β±4.73 / 114.98 ms β no change β
β QQuery 20 β 112.64 / 116.33 Β±2.83 / 120.66 ms β 113.11 / 119.07 Β±8.01 / 134.88 ms β no change β
β QQuery 21 β 65.02 / 72.67 Β±12.19 / 96.95 ms β 67.31 / 73.54 Β±4.20 / 79.90 ms β no change β
β QQuery 22 β 115.42 / 124.44 Β±7.81 / 136.69 ms β 122.53 / 131.05 Β±10.68 / 151.81 ms β 1.05x slower β
β QQuery 23 β 914.73 / 943.31 Β±22.12 / 969.67 ms β 903.32 / 949.99 Β±29.83 / 977.95 ms β no change β
β QQuery 24 β 511.26 / 552.26 Β±31.64 / 599.08 ms β 522.96 / 544.96 Β±18.85 / 579.40 ms β no change β
β QQuery 25 β 585.07 / 602.32 Β±10.44 / 616.31 ms β 597.59 / 615.96 Β±12.21 / 634.58 ms β no change β
β QQuery 26 β 85.65 / 97.18 Β±12.26 / 113.46 ms β 88.80 / 95.14 Β±11.26 / 117.59 ms β no change β
β QQuery 27 β 56.99 / 59.23 Β±1.53 / 61.60 ms β 52.28 / 64.13 Β±8.84 / 77.74 ms β 1.08x slower β
β QQuery 28 β 119.35 / 122.67 Β±3.09 / 127.49 ms β 119.14 / 120.82 Β±1.31 / 122.63 ms β no change β
β QQuery 29 β 580.78 / 600.47 Β±16.77 / 630.34 ms β 581.51 / 602.10 Β±18.52 / 631.65 ms β no change β
β QQuery 30 β 177.69 / 187.96 Β±9.37 / 204.08 ms β 176.91 / 192.79 Β±14.40 / 219.29 ms β no change β
β QQuery 31 β 462.13 / 475.80 Β±8.12 / 485.71 ms β 488.83 / 502.91 Β±12.94 / 521.22 ms β 1.06x slower β
β QQuery 32 β 75.56 / 89.61 Β±14.63 / 108.01 ms β 76.89 / 85.41 Β±11.25 / 107.54 ms β no change β
β QQuery 33 β 149.90 / 160.94 Β±11.25 / 182.09 ms β 156.89 / 165.70 Β±9.61 / 182.03 ms β no change β
β QQuery 34 β 60.99 / 70.12 Β±9.69 / 88.53 ms β 61.47 / 68.68 Β±10.41 / 89.13 ms β no change β
β QQuery 35 β 164.55 / 170.22 Β±5.12 / 178.06 ms β 164.11 / 171.69 Β±9.28 / 189.49 ms β no change β
β QQuery 36 β 89.89 / 92.91 Β±3.06 / 97.05 ms β 87.15 / 89.03 Β±1.06 / 90.31 ms β no change β
β QQuery 37 β 46.11 / 47.55 Β±1.12 / 49.24 ms β 45.72 / 52.44 Β±11.34 / 75.06 ms β 1.10x slower β
β QQuery 38 β 203.28 / 215.87 Β±12.49 / 239.84 ms β 205.90 / 211.91 Β±4.43 / 217.69 ms β no change β
β QQuery 39 β 286.30 / 302.90 Β±12.29 / 324.51 ms β 278.24 / 294.77 Β±13.09 / 313.16 ms β no change β
β QQuery 40 β 74.21 / 79.91 Β±6.69 / 92.79 ms β 73.12 / 80.20 Β±6.68 / 92.16 ms β no change β
β QQuery 41 β 88.41 / 91.68 Β±2.00 / 94.45 ms β 88.49 / 93.44 Β±3.73 / 98.62 ms β no change β
β QQuery 42 β 66.79 / 74.60 Β±4.61 / 81.03 ms β 65.10 / 67.41 Β±2.41 / 71.13 ms β +1.11x faster β
β QQuery 43 β 51.68 / 52.66 Β±0.81 / 53.69 ms β 51.79 / 57.62 Β±5.65 / 66.86 ms β 1.09x slower β
β QQuery 44 β 156.70 / 167.66 Β±9.02 / 182.17 ms β 145.21 / 152.01 Β±6.93 / 164.40 ms β +1.10x faster β
β QQuery 45 β 90.11 / 96.35 Β±4.55 / 101.62 ms β 99.94 / 105.27 Β±5.10 / 112.05 ms β 1.09x slower β
β QQuery 46 β 65.19 / 70.97 Β±5.72 / 80.71 ms β 65.83 / 67.74 Β±2.55 / 72.73 ms β no change β
β QQuery 47 β 506.44 / 520.84 Β±10.89 / 539.37 ms β 487.62 / 493.70 Β±5.04 / 500.21 ms β +1.05x faster β
β QQuery 48 β 251.19 / 266.44 Β±8.59 / 277.24 ms β 245.51 / 260.24 Β±9.25 / 269.17 ms β no change β
β QQuery 49 β 288.06 / 296.56 Β±8.11 / 311.31 ms β 266.02 / 303.53 Β±29.67 / 356.52 ms β no change β
β QQuery 50 β 315.82 / 319.65 Β±3.92 / 326.47 ms β 317.96 / 327.73 Β±8.52 / 341.22 ms β no change β
β QQuery 51 β 296.74 / 320.06 Β±15.21 / 338.50 ms β 294.45 / 305.35 Β±5.75 / 310.04 ms β no change β
β QQuery 52 β 65.86 / 77.14 Β±10.90 / 97.87 ms β 67.95 / 70.91 Β±2.37 / 73.78 ms β +1.09x faster β
β QQuery 53 β 110.79 / 114.35 Β±2.39 / 117.99 ms β 107.73 / 111.39 Β±2.93 / 116.17 ms β no change β
β QQuery 54 β 273.60 / 289.67 Β±14.02 / 306.60 ms β 260.85 / 290.57 Β±15.53 / 302.89 ms β no change β
β QQuery 55 β 71.08 / 74.80 Β±2.96 / 78.99 ms β 68.37 / 70.70 Β±1.81 / 73.70 ms β +1.06x faster β
β QQuery 56 β 121.68 / 127.91 Β±7.46 / 142.54 ms β 126.21 / 131.96 Β±5.07 / 138.71 ms β no change β
β QQuery 57 β 409.13 / 433.26 Β±15.95 / 459.07 ms β 407.42 / 424.72 Β±14.14 / 445.99 ms β no change β
β QQuery 58 β 249.35 / 265.48 Β±14.93 / 290.15 ms β 249.75 / 259.65 Β±9.87 / 274.22 ms β no change β
β QQuery 59 β 221.56 / 230.35 Β±10.27 / 249.83 ms β 215.63 / 225.32 Β±10.66 / 241.15 ms β no change β
β QQuery 60 β 122.36 / 131.65 Β±8.99 / 148.29 ms β 124.50 / 139.80 Β±11.82 / 160.90 ms β 1.06x slower β
β QQuery 61 β 32.71 / 33.39 Β±0.62 / 34.23 ms β 32.46 / 33.11 Β±0.45 / 33.76 ms β no change β
β QQuery 62 β 101.53 / 111.68 Β±10.47 / 130.10 ms β 100.62 / 107.96 Β±7.31 / 117.00 ms β no change β
β QQuery 63 β 109.88 / 114.33 Β±2.93 / 118.80 ms β 110.11 / 122.06 Β±14.70 / 149.37 ms β 1.07x slower β
β QQuery 64 β 2515.91 / 2554.22 Β±37.92 / 2618.82 ms β 2507.18 / 2589.01 Β±51.21 / 2642.26 ms β no change β
β QQuery 65 β 573.41 / 581.61 Β±4.97 / 588.18 ms β 561.80 / 580.63 Β±12.51 / 600.36 ms β no change β
β QQuery 66 β 209.36 / 217.96 Β±5.98 / 226.40 ms β 207.85 / 216.36 Β±7.50 / 228.80 ms β no change β
β QQuery 67 β 361.36 / 396.69 Β±28.79 / 429.81 ms β 373.04 / 388.41 Β±9.33 / 397.29 ms β no change β
β QQuery 68 β 67.56 / 75.14 Β±13.05 / 101.21 ms β 63.16 / 73.91 Β±12.03 / 95.56 ms β no change β
β QQuery 69 β 137.67 / 151.23 Β±22.78 / 196.74 ms β 137.03 / 153.16 Β±9.68 / 161.63 ms β no change β
β QQuery 70 β 262.56 / 280.33 Β±11.06 / 291.96 ms β 264.98 / 278.40 Β±8.00 / 287.81 ms β no change β
β QQuery 71 β 98.88 / 102.70 Β±2.01 / 104.85 ms β 98.78 / 110.35 Β±11.21 / 129.86 ms β 1.07x slower β
β QQuery 72 β 5582.52 / 5616.05 Β±21.59 / 5644.97 ms β 5573.31 / 5643.15 Β±45.20 / 5714.13 ms β no change β
β QQuery 73 β 60.12 / 62.18 Β±1.17 / 63.64 ms β 60.33 / 68.68 Β±10.83 / 90.02 ms β 1.10x slower β
β QQuery 74 β 320.33 / 361.16 Β±38.24 / 432.04 ms β 352.19 / 367.67 Β±14.69 / 389.27 ms β no change β
β QQuery 75 β 881.57 / 933.41 Β±43.59 / 1003.20 ms β 1012.40 / 1028.99 Β±13.24 / 1049.39 ms β 1.10x slower β
β QQuery 76 β 156.08 / 181.30 Β±15.34 / 197.41 ms β 168.78 / 183.94 Β±18.58 / 218.69 ms β no change β
β QQuery 77 β 364.47 / 379.68 Β±13.13 / 400.17 ms β 371.94 / 385.51 Β±10.68 / 399.27 ms β no change β
β QQuery 78 β 329.69 / 340.93 Β±9.82 / 358.10 ms β 352.38 / 359.78 Β±6.33 / 370.73 ms β 1.06x slower β
β QQuery 79 β 132.60 / 142.10 Β±8.01 / 154.31 ms β 124.31 / 133.95 Β±7.49 / 145.64 ms β +1.06x faster β
β QQuery 80 β 508.90 / 539.66 Β±26.05 / 573.97 ms β 511.59 / 532.65 Β±24.33 / 579.98 ms β no change β
β QQuery 81 β 177.00 / 195.26 Β±27.83 / 250.49 ms β 170.70 / 200.25 Β±19.36 / 226.10 ms β no change β
β QQuery 82 β 69.50 / 74.61 Β±5.21 / 81.32 ms β 66.35 / 75.53 Β±12.37 / 99.85 ms β no change β
β QQuery 83 β 179.61 / 191.87 Β±8.27 / 204.00 ms β 175.63 / 185.15 Β±8.50 / 198.10 ms β no change β
β QQuery 84 β 66.15 / 70.47 Β±3.08 / 75.20 ms β 73.34 / 76.86 Β±5.27 / 87.27 ms β 1.09x slower β
β QQuery 85 β 450.08 / 498.89 Β±53.77 / 575.29 ms β 448.37 / 501.18 Β±61.61 / 602.01 ms β no change β
β QQuery 86 β 103.82 / 110.00 Β±5.45 / 119.47 ms β 104.02 / 109.92 Β±7.06 / 123.49 ms β no change β
β QQuery 87 β 207.26 / 221.66 Β±13.62 / 246.94 ms β 200.37 / 213.08 Β±9.49 / 226.50 ms β no change β
β QQuery 88 β 155.26 / 168.12 Β±10.18 / 185.19 ms β 156.37 / 171.75 Β±16.96 / 204.61 ms β no change β
β QQuery 89 β 122.69 / 129.65 Β±4.42 / 134.40 ms β 124.74 / 128.53 Β±3.75 / 134.89 ms β no change β
β QQuery 90 β 46.84 / 47.53 Β±0.71 / 48.87 ms β 45.45 / 46.80 Β±1.29 / 49.04 ms β no change β
β QQuery 91 β 106.73 / 109.58 Β±2.92 / 113.73 ms β 101.69 / 107.31 Β±3.07 / 110.99 ms β no change β
β QQuery 92 β 83.12 / 90.24 Β±7.61 / 104.13 ms β 89.31 / 96.35 Β±6.99 / 107.95 ms β 1.07x slower β
β QQuery 93 β 225.82 / 235.24 Β±7.40 / 243.92 ms β 228.21 / 238.46 Β±7.09 / 247.00 ms β no change β
β QQuery 94 β 118.93 / 132.11 Β±10.22 / 149.44 ms β 121.30 / 127.98 Β±9.85 / 147.39 ms β no change β
β QQuery 95 β 460.06 / 487.91 Β±15.31 / 502.77 ms β 465.68 / 486.58 Β±17.08 / 513.50 ms β no change β
β QQuery 96 β 39.99 / 41.83 Β±1.05 / 43.05 ms β 39.22 / 40.57 Β±1.10 / 41.92 ms β no change β
β QQuery 97 β 157.74 / 170.40 Β±13.36 / 196.26 ms β 156.07 / 165.28 Β±4.85 / 170.44 ms β no change β
β QQuery 98 β 124.03 / 134.78 Β±10.97 / 155.25 ms β 126.64 / 139.29 Β±13.29 / 164.86 ms β no change β
β QQuery 99 β 120.69 / 123.84 Β±2.24 / 125.67 ms β 119.92 / 123.42 Β±3.01 / 128.20 ms β no change β
βββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 35963.24ms β
β Total Time (rich-T-kid_coacler-benchmark) β 31848.36ms β
β Average Time (HEAD) β 363.27ms β
β Average Time (rich-T-kid_coacler-benchmark) β 321.70ms β
β Queries Faster β 9 β
β Queries Slower β 15 β
β Queries with No Change β 75 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpcds β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 185.0s |
| Peak memory | 9.7 GiB |
| Avg memory | 1.5 GiB |
| CPU user | 959.9s |
| CPU sys | 58.2s |
| Peak spill | 0 B |
**tpcds β branch**
| Metric | Value |
|--------|-------|
| Wall time | 160.0s |
| Peak memory | 11.5 GiB |
| Avg memory | 1.5 GiB |
| CPU user | 929.8s |
| CPU sys | 56.6s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746673932
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5746603297)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (ef7543e040ffbfe7da6bd2c2b70bd2db2721cac7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ef7543e040ffbfe7da6bd2c2b70bd2db2721cac7)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 61.41 ms β 59.88 ms β no change β
β QQuery 2 β 322.09 ms β 287.17 ms β +1.12x faster β
β QQuery 3 β 70.93 ms β 68.77 ms β no change β
β QQuery 4 β 702.50 ms β 704.57 ms β no change β
β QQuery 5 β 369.53 ms β 350.91 ms β +1.05x faster β
β QQuery 6 β 159.10 ms β 153.84 ms β no change β
β QQuery 7 β 112.19 ms β 110.27 ms β no change β
β QQuery 8 β 150.79 ms β 147.85 ms β no change β
β QQuery 9 β 230.22 ms β 244.08 ms β 1.06x slower β
β QQuery 10 β 139.04 ms β 138.01 ms β no change β
β QQuery 11 β 461.28 ms β 467.55 ms β no change β
β QQuery 12 β 108.87 ms β 99.57 ms β +1.09x faster β
β QQuery 13 β 261.34 ms β 270.26 ms β no change β
β QQuery 14 β 5301.23 ms β 5351.22 ms β no change β
β QQuery 15 β 100.92 ms β 103.97 ms β no change β
β QQuery 16 β 61.31 ms β 63.97 ms β no change β
β QQuery 17 β 554.42 ms β 556.76 ms β no change β
β QQuery 18 β 520.76 ms β 536.97 ms β no change β
β QQuery 19 β 95.33 ms β 92.35 ms β no change β
β QQuery 20 β 114.24 ms β 109.88 ms β no change β
β QQuery 21 β 66.09 ms β 64.27 ms β no change β
β QQuery 22 β 119.73 ms β 115.79 ms β no change β
β QQuery 23 β 912.28 ms β 912.45 ms β no change β
β QQuery 24 β 520.91 ms β 528.00 ms β no change β
β QQuery 25 β 587.82 ms β 587.65 ms β no change β
β QQuery 26 β 86.93 ms β 84.75 ms β no change β
β QQuery 27 β 52.07 ms β 52.61 ms β no change β
β QQuery 28 β 121.35 ms β 118.33 ms β no change β
β QQuery 29 β 577.98 ms β 591.99 ms β no change β
β QQuery 30 β 178.07 ms β 173.76 ms β no change β
β QQuery 31 β 477.30 ms β 468.85 ms β no change β
β QQuery 32 β 77.06 ms β 76.07 ms β no change β
β QQuery 33 β 143.73 ms β 144.83 ms β no change β
β QQuery 34 β 61.00 ms β 59.69 ms β no change β
β QQuery 35 β 168.94 ms β 164.99 ms β no change β
β QQuery 36 β 85.43 ms β 83.33 ms β no change β
β QQuery 37 β 44.90 ms β 44.30 ms β no change β
β QQuery 38 β 212.04 ms β 196.81 ms β +1.08x faster β
β QQuery 39 β 291.24 ms β 270.22 ms β +1.08x faster β
β QQuery 40 β 72.95 ms β 68.85 ms β +1.06x faster β
β QQuery 41 β 89.48 ms β 87.33 ms β no change β
β QQuery 42 β 67.95 ms β 64.40 ms β +1.06x faster β
β QQuery 43 β 52.30 ms β 50.94 ms β no change β
β QQuery 44 β 151.04 ms β 155.44 ms β no change β
β QQuery 45 β 96.10 ms β 86.94 ms β +1.11x faster β
β QQuery 46 β 66.62 ms β 63.53 ms β no change β
β QQuery 47 β 496.97 ms β 485.54 ms β no change β
β QQuery 48 β 255.76 ms β 246.80 ms β no change β
β QQuery 49 β 276.66 ms β 273.64 ms β no change β
β QQuery 50 β 314.96 ms β 324.13 ms β no change β
β QQuery 51 β 303.57 ms β 305.34 ms β no change β
β QQuery 52 β 71.94 ms β 63.40 ms β +1.13x faster β
β QQuery 53 β 112.51 ms β 104.03 ms β +1.08x faster β
β QQuery 54 β 282.07 ms β 270.37 ms β no change β
β QQuery 55 β 68.28 ms β 66.18 ms β no change β
β QQuery 56 β 118.48 ms β 118.26 ms β no change β
β QQuery 57 β 415.80 ms β 409.39 ms β no change β
β QQuery 58 β 242.42 ms β 237.72 ms β no change β
β QQuery 59 β 220.42 ms β 213.25 ms β no change β
β QQuery 60 β 120.13 ms β 119.10 ms β no change β
β QQuery 61 β 32.67 ms β 31.91 ms β no change β
β QQuery 62 β 101.74 ms β 97.08 ms β no change β
β QQuery 63 β 111.37 ms β 104.23 ms β +1.07x faster β
β QQuery 64 β 2470.68 ms β 2559.96 ms β no change β
β QQuery 65 β 569.14 ms β 557.01 ms β no change β
β QQuery 66 β 218.97 ms β 212.65 ms β no change β
β QQuery 67 β 363.01 ms β 345.75 ms β no change β
β QQuery 68 β 65.25 ms β 64.79 ms β no change β
β QQuery 69 β 142.98 ms β 139.94 ms β no change β
β QQuery 70 β 262.96 ms β 258.33 ms β no change β
β QQuery 71 β 94.65 ms β 99.20 ms β no change β
β QQuery 72 β 5607.19 ms β 5611.70 ms β no change β
β QQuery 73 β 62.08 ms β 56.65 ms β +1.10x faster β
β QQuery 74 β 346.50 ms β 343.65 ms β no change β
β QQuery 75 β 951.00 ms β 953.34 ms β no change β
β QQuery 76 β 173.05 ms β 151.50 ms β +1.14x faster β
β QQuery 77 β 356.27 ms β 355.18 ms β no change β
β QQuery 78 β 328.05 ms β 329.68 ms β no change β
β QQuery 79 β 124.11 ms β 120.88 ms β no change β
β QQuery 80 β 499.62 ms β 511.32 ms β no change β
β QQuery 81 β 171.32 ms β 166.99 ms β no change β
β QQuery 82 β 67.69 ms β 62.99 ms β +1.07x faster β
β QQuery 83 β 181.38 ms β 170.62 ms β +1.06x faster β
β QQuery 84 β 68.49 ms β 65.39 ms β no change β
β QQuery 85 β 453.25 ms β 414.45 ms β +1.09x faster β
β QQuery 86 β 106.27 ms β 101.69 ms β no change β
β QQuery 87 β 209.14 ms β 188.11 ms β +1.11x faster β
β QQuery 88 β 161.69 ms β 153.14 ms β +1.06x faster β
β QQuery 89 β 123.05 ms β 119.57 ms β no change β
β QQuery 90 β 45.43 ms β 44.50 ms β no change β
β QQuery 91 β 106.37 ms β 97.21 ms β +1.09x faster β
β QQuery 92 β 81.43 ms β 80.80 ms β no change β
β QQuery 93 β 220.19 ms β 220.22 ms β no change β
β QQuery 94 β 117.33 ms β 118.93 ms β no change β
β QQuery 95 β 466.55 ms β 515.71 ms β 1.11x slower β
β QQuery 96 β 38.36 ms β 37.91 ms β no change β
β QQuery 97 β 159.75 ms β 166.51 ms β no change β
β QQuery 98 β 132.07 ms β 123.38 ms β +1.07x faster β
β QQuery 99 β 120.12 ms β 121.67 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 34489.98ms β
β Total Time (rich-T-kid_coacler-benchmark) β 34345.64ms β
β Average Time (HEAD) β 348.38ms β
β Average Time (rich-T-kid_coacler-benchmark) β 346.93ms β
β Queries Faster β 20 β
β Queries Slower β 2 β
β Queries with No Change β 77 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 61.41 / 62.56 Β±1.66 / 65.86 ms β 59.88 / 61.10 Β±1.43 / 63.86 ms β no change β
β QQuery 2 β 322.09 / 334.16 Β±16.17 / 365.83 ms β 287.17 / 292.46 Β±4.27 / 297.42 ms β +1.14x faster β
β QQuery 3 β 70.93 / 81.17 Β±12.23 / 105.16 ms β 68.77 / 72.96 Β±4.03 / 80.60 ms β +1.11x faster β
β QQuery 4 β 702.50 / 743.22 Β±29.70 / 790.20 ms β 704.57 / 733.01 Β±31.94 / 795.16 ms β no change β
β QQuery 5 β 369.53 / 386.55 Β±19.41 / 412.77 ms β 350.91 / 374.28 Β±18.00 / 401.81 ms β no change β
β QQuery 6 β 159.10 / 172.12 Β±11.16 / 192.12 ms β 153.84 / 162.10 Β±8.37 / 177.93 ms β +1.06x faster β
β QQuery 7 β 112.19 / 123.02 Β±12.44 / 146.62 ms β 110.27 / 123.84 Β±12.87 / 147.12 ms β no change β
β QQuery 8 β 150.79 / 160.68 Β±7.86 / 174.11 ms β 147.85 / 159.21 Β±9.83 / 172.87 ms β no change β
β QQuery 9 β 230.22 / 247.59 Β±14.23 / 269.63 ms β 244.08 / 256.60 Β±7.06 / 263.57 ms β no change β
β QQuery 10 β 139.04 / 154.97 Β±11.88 / 174.70 ms β 138.01 / 143.64 Β±4.86 / 152.56 ms β +1.08x faster β
β QQuery 11 β 461.28 / 485.46 Β±24.07 / 521.81 ms β 467.55 / 479.70 Β±12.98 / 504.33 ms β no change β
β QQuery 12 β 108.87 / 109.63 Β±0.42 / 110.10 ms β 99.57 / 111.22 Β±11.34 / 130.05 ms β no change β
β QQuery 13 β 261.34 / 268.90 Β±4.39 / 272.91 ms β 270.26 / 284.18 Β±12.17 / 306.02 ms β 1.06x slower β
β QQuery 14 β 5301.23 / 5623.62 Β±179.57 / 5816.05 ms β 5351.22 / 5637.32 Β±161.67 / 5780.14 ms β no change β
β QQuery 15 β 100.92 / 127.01 Β±26.87 / 176.35 ms β 103.97 / 124.16 Β±30.08 / 182.66 ms β no change β
β QQuery 16 β 61.31 / 67.13 Β±3.07 / 69.63 ms β 63.97 / 66.15 Β±1.86 / 68.65 ms β no change β
β QQuery 17 β 554.42 / 578.04 Β±22.58 / 620.37 ms β 556.76 / 569.68 Β±11.91 / 589.55 ms β no change β
β QQuery 18 β 520.76 / 530.77 Β±9.20 / 547.45 ms β 536.97 / 546.61 Β±7.53 / 557.63 ms β no change β
β QQuery 19 β 95.33 / 107.96 Β±8.43 / 120.83 ms β 92.35 / 106.87 Β±13.08 / 130.72 ms β no change β
β QQuery 20 β 114.24 / 120.77 Β±3.54 / 124.39 ms β 109.88 / 114.66 Β±3.81 / 119.46 ms β +1.05x faster β
β QQuery 21 β 66.09 / 69.62 Β±3.21 / 74.47 ms β 64.27 / 69.41 Β±4.74 / 75.30 ms β no change β
β QQuery 22 β 119.73 / 122.90 Β±5.30 / 133.46 ms β 115.79 / 119.55 Β±3.95 / 126.30 ms β no change β
β QQuery 23 β 912.28 / 931.42 Β±18.26 / 964.20 ms β 912.45 / 968.68 Β±36.53 / 1016.22 ms β no change β
β QQuery 24 β 520.91 / 550.86 Β±19.68 / 579.59 ms β 528.00 / 549.17 Β±17.94 / 579.32 ms β no change β
β QQuery 25 β 587.82 / 602.32 Β±10.03 / 615.47 ms β 587.65 / 602.01 Β±9.42 / 614.58 ms β no change β
β QQuery 26 β 86.93 / 93.74 Β±5.83 / 101.58 ms β 84.75 / 88.23 Β±4.26 / 96.53 ms β +1.06x faster β
β QQuery 27 β 52.07 / 61.62 Β±10.47 / 81.99 ms β 52.61 / 61.67 Β±9.98 / 79.11 ms β no change β
β QQuery 28 β 121.35 / 125.66 Β±5.01 / 132.86 ms β 118.33 / 122.32 Β±2.48 / 125.64 ms β no change β
β QQuery 29 β 577.98 / 599.33 Β±19.49 / 630.88 ms β 591.99 / 613.06 Β±13.73 / 630.41 ms β no change β
β QQuery 30 β 178.07 / 189.55 Β±7.17 / 196.87 ms β 173.76 / 189.24 Β±24.71 / 238.35 ms β no change β
β QQuery 31 β 477.30 / 485.25 Β±8.49 / 498.08 ms β 468.85 / 477.29 Β±6.42 / 486.57 ms β no change β
β QQuery 32 β 77.06 / 85.29 Β±7.93 / 99.56 ms β 76.07 / 88.65 Β±13.35 / 113.17 ms β no change β
β QQuery 33 β 143.73 / 161.60 Β±14.67 / 179.89 ms β 144.83 / 172.49 Β±29.45 / 229.08 ms β 1.07x slower β
β QQuery 34 β 61.00 / 65.29 Β±5.10 / 75.25 ms β 59.69 / 61.40 Β±2.54 / 66.37 ms β +1.06x faster β
β QQuery 35 β 168.94 / 177.19 Β±5.41 / 183.78 ms β 164.99 / 172.14 Β±9.24 / 189.77 ms β no change β
β QQuery 36 β 85.43 / 89.80 Β±4.59 / 98.39 ms β 83.33 / 87.46 Β±2.93 / 91.80 ms β no change β
β QQuery 37 β 44.90 / 45.83 Β±0.53 / 46.52 ms β 44.30 / 47.23 Β±2.70 / 52.26 ms β no change β
β QQuery 38 β 212.04 / 220.90 Β±10.14 / 240.57 ms β 196.81 / 216.69 Β±13.26 / 231.24 ms β no change β
β QQuery 39 β 291.24 / 295.20 Β±2.56 / 298.86 ms β 270.22 / 289.25 Β±14.17 / 310.88 ms β no change β
β QQuery 40 β 72.95 / 78.16 Β±5.89 / 87.00 ms β 68.85 / 74.65 Β±8.43 / 91.15 ms β no change β
β QQuery 41 β 89.48 / 98.94 Β±10.89 / 118.77 ms β 87.33 / 94.34 Β±9.14 / 112.09 ms β no change β
β QQuery 42 β 67.95 / 70.13 Β±3.77 / 77.65 ms β 64.40 / 67.73 Β±2.51 / 70.24 ms β no change β
β QQuery 43 β 52.30 / 53.85 Β±1.07 / 55.30 ms β 50.94 / 52.42 Β±2.02 / 56.34 ms β no change β
β QQuery 44 β 151.04 / 161.78 Β±12.66 / 186.46 ms β 155.44 / 162.35 Β±6.55 / 173.58 ms β no change β
β QQuery 45 β 96.10 / 99.37 Β±3.26 / 105.18 ms β 86.94 / 101.43 Β±10.24 / 114.29 ms β no change β
β QQuery 46 β 66.62 / 69.33 Β±2.80 / 73.43 ms β 63.53 / 66.11 Β±2.14 / 69.56 ms β no change β
β QQuery 47 β 496.97 / 511.50 Β±11.79 / 532.90 ms β 485.54 / 513.59 Β±21.80 / 540.45 ms β no change β
β QQuery 48 β 255.76 / 260.30 Β±5.42 / 270.74 ms β 246.80 / 256.89 Β±7.79 / 266.45 ms β no change β
β QQuery 49 β 276.66 / 297.64 Β±13.65 / 317.58 ms β 273.64 / 281.83 Β±6.06 / 290.24 ms β +1.06x faster β
β QQuery 50 β 314.96 / 324.96 Β±7.37 / 334.21 ms β 324.13 / 344.45 Β±19.09 / 378.06 ms β 1.06x slower β
β QQuery 51 β 303.57 / 308.86 Β±5.44 / 317.43 ms β 305.34 / 322.66 Β±21.03 / 363.23 ms β no change β
β QQuery 52 β 71.94 / 75.48 Β±2.36 / 79.17 ms β 63.40 / 75.07 Β±11.12 / 94.55 ms β no change β
β QQuery 53 β 112.51 / 118.95 Β±8.45 / 135.14 ms β 104.03 / 111.69 Β±5.41 / 118.48 ms β +1.06x faster β
β QQuery 54 β 282.07 / 286.80 Β±4.42 / 294.25 ms β 270.37 / 278.95 Β±7.45 / 289.77 ms β no change β
β QQuery 55 β 68.28 / 76.36 Β±6.37 / 84.06 ms β 66.18 / 70.52 Β±3.25 / 74.89 ms β +1.08x faster β
β QQuery 56 β 118.48 / 130.01 Β±12.65 / 153.62 ms β 118.26 / 125.65 Β±4.02 / 129.56 ms β no change β
β QQuery 57 β 415.80 / 427.82 Β±11.34 / 449.18 ms β 409.39 / 426.02 Β±17.33 / 457.25 ms β no change β
β QQuery 58 β 242.42 / 257.35 Β±9.83 / 272.97 ms β 237.72 / 252.34 Β±18.17 / 287.77 ms β no change β
β QQuery 59 β 220.42 / 230.82 Β±14.18 / 258.42 ms β 213.25 / 217.77 Β±5.57 / 228.26 ms β +1.06x faster β
β QQuery 60 β 120.13 / 124.94 Β±4.79 / 131.03 ms β 119.10 / 133.38 Β±23.91 / 181.01 ms β 1.07x slower β
β QQuery 61 β 32.67 / 36.58 Β±4.52 / 43.76 ms β 31.91 / 32.58 Β±0.54 / 33.36 ms β +1.12x faster β
β QQuery 62 β 101.74 / 109.82 Β±9.38 / 126.32 ms β 97.08 / 100.65 Β±5.22 / 110.86 ms β +1.09x faster β
β QQuery 63 β 111.37 / 115.55 Β±4.04 / 123.12 ms β 104.23 / 109.95 Β±4.11 / 116.73 ms β no change β
β QQuery 64 β 2470.68 / 2561.82 Β±52.06 / 2619.54 ms β 2559.96 / 2618.68 Β±32.75 / 2644.56 ms β no change β
β QQuery 65 β 569.14 / 576.41 Β±6.23 / 586.81 ms β 557.01 / 568.28 Β±6.49 / 577.29 ms β no change β
β QQuery 66 β 218.97 / 225.83 Β±6.05 / 235.05 ms β 212.65 / 231.40 Β±17.85 / 264.51 ms β no change β
β QQuery 67 β 363.01 / 382.08 Β±15.60 / 403.31 ms β 345.75 / 358.92 Β±13.07 / 383.54 ms β +1.06x faster β
β QQuery 68 β 65.25 / 72.27 Β±9.53 / 91.15 ms β 64.79 / 71.26 Β±5.23 / 77.90 ms β no change β
β QQuery 69 β 142.98 / 151.61 Β±13.35 / 178.05 ms β 139.94 / 147.42 Β±7.20 / 160.65 ms β no change β
β QQuery 70 β 262.96 / 287.76 Β±15.54 / 306.15 ms β 258.33 / 277.69 Β±11.04 / 289.45 ms β no change β
β QQuery 71 β 94.65 / 107.36 Β±10.84 / 127.26 ms β 99.20 / 108.19 Β±8.06 / 120.36 ms β no change β
β QQuery 72 β 5607.19 / 5651.62 Β±40.14 / 5716.15 ms β 5611.70 / 5671.63 Β±50.83 / 5758.54 ms β no change β
β QQuery 73 β 62.08 / 64.69 Β±1.89 / 67.53 ms β 56.65 / 65.77 Β±13.31 / 92.06 ms β no change β
β QQuery 74 β 346.50 / 373.77 Β±21.11 / 410.03 ms β 343.65 / 375.37 Β±30.63 / 427.83 ms β no change β
β QQuery 75 β 951.00 / 998.17 Β±45.51 / 1065.78 ms β 953.34 / 1023.80 Β±49.29 / 1106.01 ms β no change β
β QQuery 76 β 173.05 / 186.71 Β±15.31 / 209.87 ms β 151.50 / 171.38 Β±10.76 / 181.71 ms β +1.09x faster β
β QQuery 77 β 356.27 / 382.33 Β±14.66 / 398.78 ms β 355.18 / 364.35 Β±6.24 / 371.75 ms β no change β
β QQuery 78 β 328.05 / 349.16 Β±20.32 / 376.44 ms β 329.68 / 358.98 Β±29.52 / 409.78 ms β no change β
β QQuery 79 β 124.11 / 137.98 Β±12.59 / 158.69 ms β 120.88 / 131.33 Β±6.51 / 139.95 ms β no change β
β QQuery 80 β 499.62 / 527.70 Β±21.49 / 564.11 ms β 511.32 / 564.93 Β±42.47 / 618.80 ms β 1.07x slower β
β QQuery 81 β 171.32 / 189.43 Β±20.05 / 226.66 ms β 166.99 / 176.23 Β±9.00 / 192.53 ms β +1.07x faster β
β QQuery 82 β 67.69 / 76.86 Β±11.64 / 98.05 ms β 62.99 / 70.35 Β±11.58 / 93.40 ms β +1.09x faster β
β QQuery 83 β 181.38 / 197.57 Β±15.41 / 218.79 ms β 170.62 / 182.27 Β±11.37 / 200.09 ms β +1.08x faster β
β QQuery 84 β 68.49 / 72.27 Β±2.19 / 74.75 ms β 65.39 / 70.94 Β±3.86 / 77.47 ms β no change β
β QQuery 85 β 453.25 / 499.06 Β±52.78 / 590.29 ms β 414.45 / 439.70 Β±22.23 / 471.85 ms β +1.14x faster β
β QQuery 86 β 106.27 / 115.72 Β±6.71 / 127.04 ms β 101.69 / 104.13 Β±1.83 / 106.95 ms β +1.11x faster β
β QQuery 87 β 209.14 / 221.45 Β±11.83 / 240.62 ms β 188.11 / 204.54 Β±12.16 / 223.59 ms β +1.08x faster β
β QQuery 88 β 161.69 / 173.18 Β±8.54 / 182.10 ms β 153.14 / 163.68 Β±9.04 / 179.94 ms β +1.06x faster β
β QQuery 89 β 123.05 / 129.25 Β±4.19 / 136.07 ms β 119.57 / 126.38 Β±5.73 / 134.18 ms β no change β
β QQuery 90 β 45.43 / 48.86 Β±4.88 / 58.41 ms β 44.50 / 45.41 Β±0.94 / 47.19 ms β +1.08x faster β
β QQuery 91 β 106.37 / 108.97 Β±3.54 / 115.88 ms β 97.21 / 104.74 Β±6.13 / 115.86 ms β no change β
β QQuery 92 β 81.43 / 91.50 Β±7.88 / 105.54 ms β 80.80 / 83.59 Β±2.19 / 87.33 ms β +1.09x faster β
β QQuery 93 β 220.19 / 229.46 Β±6.77 / 240.15 ms β 220.22 / 234.41 Β±15.52 / 263.94 ms β no change β
β QQuery 94 β 117.33 / 126.86 Β±12.71 / 152.02 ms β 118.93 / 126.24 Β±6.54 / 134.65 ms β no change β
β QQuery 95 β 466.55 / 482.52 Β±8.35 / 489.18 ms β 515.71 / 530.81 Β±8.31 / 537.30 ms β 1.10x slower β
β QQuery 96 β 38.36 / 40.77 Β±1.58 / 42.78 ms β 37.91 / 42.67 Β±3.17 / 47.87 ms β no change β
β QQuery 97 β 159.75 / 166.80 Β±6.75 / 179.65 ms β 166.51 / 171.24 Β±5.58 / 181.93 ms β no change β
β QQuery 98 β 132.07 / 137.09 Β±8.00 / 152.98 ms β 123.38 / 133.21 Β±8.19 / 143.06 ms β no change β
β QQuery 99 β 120.12 / 123.52 Β±2.00 / 125.87 ms β 121.67 / 126.21 Β±4.03 / 133.64 ms β no change β
βββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 36052.45ms β
β Total Time (rich-T-kid_coacler-benchmark) β 35934.81ms β
β Average Time (HEAD) β 364.17ms β
β Average Time (rich-T-kid_coacler-benchmark) β 362.98ms β
β Queries Faster β 24 β
β Queries Slower β 6 β
β Queries with No Change β 69 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpcds β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 185.0s |
| Peak memory | 9.8 GiB |
| Avg memory | 1.6 GiB |
| CPU user | 955.1s |
| CPU sys | 60.0s |
| Peak spill | 0 B |
**tpcds β branch**
| Metric | Value |
|--------|-------|
| Wall time | 185.0s |
| Peak memory | 4.3 GiB |
| Avg memory | 1.6 GiB |
| CPU user | 993.1s |
| CPU sys | 66.5s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739390843
run benchmarks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5743267695
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5743214143)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββ³βββββββββββββββββββββββββββββββ³βββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 42.22 ms β 40.54 ms β no change β
β QQuery 2 β 18.88 ms β 18.69 ms β no change β
β QQuery 3 β 28.98 ms β 28.14 ms β no change β
β QQuery 4 β 17.32 ms β 16.83 ms β no change β
β QQuery 5 β 35.73 ms β 34.67 ms β no change β
β QQuery 6 β 16.11 ms β 15.95 ms β no change β
β QQuery 7 β 41.93 ms β 41.62 ms β no change β
β QQuery 8 β 40.77 ms β 40.53 ms β no change β
β QQuery 9 β 49.69 ms β 51.06 ms β no change β
β QQuery 10 β 40.05 ms β 40.70 ms β no change β
β QQuery 11 β 13.19 ms β 13.75 ms β no change β
β QQuery 12 β 20.49 ms β 21.45 ms β no change β
β QQuery 13 β 39.33 ms β 41.71 ms β 1.06x slower β
β QQuery 14 β 24.31 ms β 25.68 ms β 1.06x slower β
β QQuery 15 β 30.90 ms β 31.52 ms β no change β
β QQuery 16 β 14.03 ms β 14.02 ms β no change β
β QQuery 17 β 72.11 ms β 73.30 ms β no change β
β QQuery 18 β 59.49 ms β 64.81 ms β 1.09x slower β
β QQuery 19 β 32.00 ms β 32.94 ms β no change β
β QQuery 20 β 31.95 ms β 32.65 ms β no change β
β QQuery 21 β 54.27 ms β 56.90 ms β no change β
β QQuery 22 β 13.84 ms β 13.93 ms β no change β
βββββββββββββ΄βββββββββββ΄βββββββββββββββββββββββββββββββ΄βββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 737.58ms β
β Total Time (rich-T-kid_coacler-benchmark) β 751.38ms β
β Average Time (HEAD) β 33.53ms β
β Average Time (rich-T-kid_coacler-benchmark) β 34.15ms β
β Queries Faster β 0 β
β Queries Slower β 3 β
β Queries with No Change β 19 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 42.22 / 42.98 Β±0.94 / 44.84 ms β 40.54 / 41.81 Β±1.25 / 44.01 ms β no change β
β QQuery 2 β 18.88 / 19.74 Β±0.60 / 20.58 ms β 18.69 / 19.34 Β±0.45 / 19.91 ms β no change β
β QQuery 3 β 28.98 / 29.99 Β±0.62 / 30.87 ms β 28.14 / 28.94 Β±0.86 / 30.53 ms β no change β
β QQuery 4 β 17.32 / 18.06 Β±0.85 / 19.47 ms β 16.83 / 16.99 Β±0.14 / 17.22 ms β +1.06x faster β
β QQuery 5 β 35.73 / 37.63 Β±1.47 / 39.73 ms β 34.67 / 34.88 Β±0.16 / 35.09 ms β +1.08x faster β
β QQuery 6 β 16.11 / 16.97 Β±1.00 / 18.85 ms β 15.95 / 16.66 Β±1.07 / 18.78 ms β no change β
β QQuery 7 β 41.93 / 44.86 Β±2.21 / 48.68 ms β 41.62 / 42.14 Β±0.38 / 42.57 ms β +1.06x faster β
β QQuery 8 β 40.77 / 42.53 Β±1.35 / 44.68 ms β 40.53 / 41.49 Β±0.65 / 42.33 ms β no change β
β QQuery 9 β 49.69 / 51.65 Β±1.57 / 53.63 ms β 51.06 / 53.29 Β±1.29 / 54.68 ms β no change β
β QQuery 10 β 40.05 / 40.25 Β±0.23 / 40.63 ms β 40.70 / 42.98 Β±1.65 / 45.79 ms β 1.07x slower β
β QQuery 11 β 13.19 / 13.93 Β±0.68 / 14.90 ms β 13.75 / 14.89 Β±0.82 / 16.17 ms β 1.07x slower β
β QQuery 12 β 20.49 / 21.64 Β±1.03 / 23.55 ms β 21.45 / 22.42 Β±1.13 / 24.52 ms β no change β
β QQuery 13 β 39.33 / 39.82 Β±0.37 / 40.38 ms β 41.71 / 43.59 Β±1.62 / 46.02 ms β 1.09x slower β
β QQuery 14 β 24.31 / 25.56 Β±0.88 / 26.29 ms β 25.68 / 26.30 Β±0.35 / 26.62 ms β no change β
β QQuery 15 β 30.90 / 32.41 Β±1.30 / 34.74 ms β 31.52 / 32.39 Β±0.72 / 33.54 ms β no change β
β QQuery 16 β 14.03 / 14.79 Β±0.55 / 15.44 ms β 14.02 / 14.32 Β±0.29 / 14.86 ms β no change β
β QQuery 17 β 72.11 / 76.34 Β±2.98 / 79.93 ms β 73.30 / 78.66 Β±3.86 / 82.56 ms β no change β
β QQuery 18 β 59.49 / 60.91 Β±1.01 / 62.40 ms β 64.81 / 70.14 Β±4.17 / 75.52 ms β 1.15x slower β
β QQuery 19 β 32.00 / 33.52 Β±0.99 / 34.54 ms β 32.94 / 33.88 Β±0.62 / 34.63 ms β no change β
β QQuery 20 β 31.95 / 33.74 Β±1.00 / 34.63 ms β 32.65 / 34.59 Β±1.76 / 37.75 ms β no change β
β QQuery 21 β 54.27 / 58.14 Β±3.48 / 62.12 ms β 56.90 / 60.81 Β±2.48 / 63.87 ms β no change β
β QQuery 22 β 13.84 / 13.89 Β±0.07 / 14.02 ms β 13.93 / 14.88 Β±0.67 / 15.65 ms β 1.07x slower β
βββββββββββββ΄βββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 769.35ms β
β Total Time (rich-T-kid_coacler-benchmark) β 785.39ms β
β Average Time (HEAD) β 34.97ms β
β Average Time (rich-T-kid_coacler-benchmark) β 35.70ms β
β Queries Faster β 3 β
β Queries Slower β 5 β
β Queries with No Change β 14 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpch β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 5.0s |
| Peak memory | 1.3 GiB |
| Avg memory | 512.9 MiB |
| CPU user | 21.6s |
| CPU sys | 1.8s |
| Peak spill | 0 B |
**tpch β branch**
| Metric | Value |
|--------|-------|
| Wall time | 5.0s |
| Peak memory | 1.5 GiB |
| Avg memory | 559.7 MiB |
| CPU user | 22.1s |
| CPU sys | 1.9s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746488716
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5746435338)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (50b4aadf9bd59b1681e8c222be535966e84155d7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..50b4aadf9bd59b1681e8c222be535966e84155d7)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.30 ms β 1.27 ms β no change β
β QQuery 1 β 11.88 ms β 11.81 ms β no change β
β QQuery 2 β 37.30 ms β 36.72 ms β no change β
β QQuery 3 β 31.59 ms β 31.27 ms β no change β
β QQuery 4 β 244.72 ms β 239.18 ms β no change β
β QQuery 5 β 276.76 ms β 276.79 ms β no change β
β QQuery 6 β 1.32 ms β 1.32 ms β no change β
β QQuery 7 β 13.51 ms β 13.15 ms β no change β
β QQuery 8 β 331.45 ms β 339.00 ms β no change β
β QQuery 9 β 462.51 ms β 486.85 ms β 1.05x slower β
β QQuery 10 β 65.13 ms β 65.58 ms β no change β
β QQuery 11 β 76.92 ms β 75.66 ms β no change β
β QQuery 12 β 266.50 ms β 264.63 ms β no change β
β QQuery 13 β 372.90 ms β 361.80 ms β no change β
β QQuery 14 β 279.43 ms β 284.87 ms β no change β
β QQuery 15 β 290.38 ms β 288.42 ms β no change β
β QQuery 16 β 621.28 ms β 626.65 ms β no change β
β QQuery 17 β 638.49 ms β 640.22 ms β no change β
β QQuery 18 β 1262.93 ms β 1262.15 ms β no change β
β QQuery 19 β 27.59 ms β 27.73 ms β no change β
β QQuery 20 β 524.22 ms β 520.93 ms β no change β
β QQuery 21 β 507.45 ms β 509.00 ms β no change β
β QQuery 22 β 977.75 ms β 981.73 ms β no change β
β QQuery 23 β 3101.99 ms β 3125.46 ms β no change β
β QQuery 24 β 40.87 ms β 40.61 ms β no change β
β QQuery 25 β 104.21 ms β 105.38 ms β no change β
β QQuery 26 β 41.18 ms β 41.12 ms β no change β
β QQuery 27 β 510.60 ms β 517.06 ms β no change β
β QQuery 28 β 2900.61 ms β 2886.88 ms β no change β
β QQuery 29 β 42.00 ms β 41.78 ms β no change β
β QQuery 30 β 312.05 ms β 309.13 ms β no change β
β QQuery 31 β 281.36 ms β 286.81 ms β no change β
β QQuery 32 β 957.25 ms β 980.60 ms β no change β
β QQuery 33 β 1500.02 ms β 1495.39 ms β no change β
β QQuery 34 β 1507.28 ms β 1495.76 ms β no change β
β QQuery 35 β 299.87 ms β 297.83 ms β no change β
β QQuery 36 β 69.83 ms β 66.09 ms β +1.06x faster β
β QQuery 37 β 36.19 ms β 35.34 ms β no change β
β QQuery 38 β 40.48 ms β 44.14 ms β 1.09x slower β
β QQuery 39 β 142.52 ms β 146.01 ms β no change β
β QQuery 40 β 14.19 ms β 14.67 ms β no change β
β QQuery 41 β 14.46 ms β 14.02 ms β no change β
β QQuery 42 β 13.77 ms β 13.65 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 19254.05ms β
β Total Time (rich-T-kid_coacler-benchmark) β 19304.45ms β
β Average Time (HEAD) β 447.77ms β
β Average Time (rich-T-kid_coacler-benchmark) β 448.94ms β
β Queries Faster β 1 β
β Queries Slower β 2 β
β Queries with No Change β 40 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.30 / 4.19 Β±5.65 / 15.49 ms β 1.27 / 4.12 Β±5.58 / 15.28 ms β no change β
β QQuery 1 β 11.88 / 12.12 Β±0.15 / 12.27 ms β 11.81 / 12.05 Β±0.15 / 12.23 ms β no change β
β QQuery 2 β 37.30 / 37.48 Β±0.11 / 37.61 ms β 36.72 / 36.93 Β±0.14 / 37.13 ms β no change β
β QQuery 3 β 31.59 / 32.23 Β±0.72 / 33.61 ms β 31.27 / 31.52 Β±0.24 / 31.95 ms β no change β
β QQuery 4 β 244.72 / 249.81 Β±3.65 / 253.49 ms β 239.18 / 242.21 Β±3.20 / 247.82 ms β no change β
β QQuery 5 β 276.76 / 281.51 Β±2.95 / 285.79 ms β 276.79 / 281.66 Β±3.97 / 287.10 ms β no change β
β QQuery 6 β 1.32 / 1.46 Β±0.24 / 1.94 ms β 1.32 / 1.47 Β±0.24 / 1.95 ms β no change β
β QQuery 7 β 13.51 / 14.59 Β±1.89 / 18.36 ms β 13.15 / 13.44 Β±0.16 / 13.58 ms β +1.09x faster β
β QQuery 8 β 331.45 / 343.95 Β±7.07 / 353.10 ms β 339.00 / 341.88 Β±2.26 / 344.49 ms β no change β
β QQuery 9 β 462.51 / 484.77 Β±11.56 / 494.02 ms β 486.85 / 496.27 Β±7.81 / 507.16 ms β no change β
β QQuery 10 β 65.13 / 66.94 Β±0.97 / 67.74 ms β 65.58 / 68.81 Β±5.55 / 79.89 ms β no change β
β QQuery 11 β 76.92 / 77.27 Β±0.33 / 77.76 ms β 75.66 / 76.53 Β±0.59 / 77.51 ms β no change β
β QQuery 12 β 266.50 / 271.78 Β±4.64 / 280.15 ms β 264.63 / 270.42 Β±5.26 / 278.33 ms β no change β
β QQuery 13 β 372.90 / 379.64 Β±7.28 / 390.09 ms β 361.80 / 386.46 Β±17.96 / 415.80 ms β no change β
β QQuery 14 β 279.43 / 289.11 Β±7.44 / 301.20 ms β 284.87 / 295.19 Β±6.83 / 304.49 ms β no change β
β QQuery 15 β 290.38 / 294.38 Β±5.45 / 305.13 ms β 288.42 / 301.58 Β±9.64 / 316.81 ms β no change β
β QQuery 16 β 621.28 / 642.56 Β±24.37 / 688.50 ms β 626.65 / 641.87 Β±12.89 / 665.77 ms β no change β
β QQuery 17 β 638.49 / 649.12 Β±6.65 / 656.80 ms β 640.22 / 662.78 Β±20.84 / 695.84 ms β no change β
β QQuery 18 β 1262.93 / 1308.18 Β±24.51 / 1329.98 ms β 1262.15 / 1304.25 Β±34.10 / 1347.35 ms β no change β
β QQuery 19 β 27.59 / 30.72 Β±5.66 / 42.03 ms β 27.73 / 28.02 Β±0.28 / 28.38 ms β +1.10x faster β
β QQuery 20 β 524.22 / 533.59 Β±11.72 / 555.64 ms β 520.93 / 529.65 Β±6.72 / 541.59 ms β no change β
β QQuery 21 β 507.45 / 518.62 Β±6.58 / 526.70 ms β 509.00 / 522.47 Β±13.47 / 547.67 ms β no change β
β QQuery 22 β 977.75 / 1004.31 Β±14.06 / 1016.44 ms β 981.73 / 1003.05 Β±14.97 / 1026.33 ms β no change β
β QQuery 23 β 3101.99 / 3113.27 Β±8.11 / 3122.20 ms β 3125.46 / 3141.29 Β±18.17 / 3170.70 ms β no change β
β QQuery 24 β 40.87 / 41.23 Β±0.35 / 41.87 ms β 40.61 / 41.44 Β±1.16 / 43.72 ms β no change β
β QQuery 25 β 104.21 / 107.75 Β±4.76 / 116.89 ms β 105.38 / 109.14 Β±3.77 / 116.11 ms β no change β
β QQuery 26 β 41.18 / 43.59 Β±3.43 / 50.36 ms β 41.12 / 43.06 Β±3.13 / 49.28 ms β no change β
β QQuery 27 β 510.60 / 520.41 Β±5.69 / 528.20 ms β 517.06 / 526.56 Β±5.42 / 531.81 ms β no change β
β QQuery 28 β 2900.61 / 2913.69 Β±8.53 / 2927.53 ms β 2886.88 / 2930.58 Β±23.22 / 2953.31 ms β no change β
β QQuery 29 β 42.00 / 45.29 Β±5.83 / 56.94 ms β 41.78 / 42.61 Β±0.65 / 43.72 ms β +1.06x faster β
β QQuery 30 β 312.05 / 315.96 Β±4.36 / 324.44 ms β 309.13 / 318.70 Β±8.10 / 330.79 ms β no change β
β QQuery 31 β 281.36 / 299.25 Β±18.63 / 334.20 ms β 286.81 / 290.12 Β±2.84 / 294.63 ms β no change β
β QQuery 32 β 957.25 / 1005.87 Β±45.57 / 1091.79 ms β 980.60 / 990.65 Β±9.47 / 1003.97 ms β no change β
β QQuery 33 β 1500.02 / 1572.03 Β±91.04 / 1732.89 ms β 1495.39 / 1513.94 Β±15.52 / 1532.40 ms β no change β
β QQuery 34 β 1507.28 / 1553.82 Β±37.43 / 1604.87 ms β 1495.76 / 1533.71 Β±31.96 / 1574.90 ms β no change β
β QQuery 35 β 299.87 / 320.54 Β±22.76 / 354.46 ms β 297.83 / 338.29 Β±49.03 / 413.50 ms β 1.06x slower β
β QQuery 36 β 69.83 / 76.84 Β±5.03 / 84.97 ms β 66.09 / 70.87 Β±3.74 / 75.74 ms β +1.08x faster β
β QQuery 37 β 36.19 / 39.13 Β±3.06 / 43.66 ms β 35.34 / 38.50 Β±3.50 / 44.17 ms β no change β
β QQuery 38 β 40.48 / 42.56 Β±1.42 / 44.50 ms β 44.14 / 47.86 Β±3.92 / 53.28 ms β 1.12x slower β
β QQuery 39 β 142.52 / 149.68 Β±4.54 / 155.31 ms β 146.01 / 159.91 Β±10.37 / 176.17 ms β 1.07x slower β
β QQuery 40 β 14.19 / 15.86 Β±2.47 / 20.78 ms β 14.67 / 15.30 Β±0.49 / 15.94 ms β no change β
β QQuery 41 β 14.46 / 14.81 Β±0.29 / 15.23 ms β 14.02 / 17.33 Β±5.56 / 28.41 ms β 1.17x slower β
β QQuery 42 β 13.77 / 15.03 Β±2.38 / 19.78 ms β 13.65 / 17.51 Β±7.21 / 31.92 ms β 1.16x slower β
βββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 19734.98ms β
β Total Time (rich-T-kid_coacler-benchmark) β 19739.99ms β
β Average Time (HEAD) β 458.95ms β
β Average Time (rich-T-kid_coacler-benchmark) β 459.07ms β
β Queries Faster β 4 β
β Queries Slower β 5 β
β Queries with No Change β 34 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**clickbench_partitioned β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 100.0s |
| Peak memory | 11.4 GiB |
| Avg memory | 4.8 GiB |
| CPU user | 1011.5s |
| CPU sys | 70.0s |
| Peak spill | 0 B |
**clickbench_partitioned β branch**
| Metric | Value |
|--------|-------|
| Wall time | 100.0s |
| Peak memory | 12.2 GiB |
| Avg memory | 4.5 GiB |
| CPU user | 1003.1s |
| CPU sys | 73.0s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746449666
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5746435338)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5746435338-2513-srhqr 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (50b4aadf9bd59b1681e8c222be535966e84155d7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..50b4aadf9bd59b1681e8c222be535966e84155d7)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746451749
run benchmarks
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: 256
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5743278850
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5743214143)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 5.42 ms β 5.46 ms β no change β
β QQuery 2 β 80.56 ms β 80.01 ms β no change β
β QQuery 3 β 28.53 ms β 28.56 ms β no change β
β QQuery 4 β 432.31 ms β 428.45 ms β no change β
β QQuery 5 β 50.41 ms β 50.72 ms β no change β
β QQuery 6 β 35.67 ms β 35.21 ms β no change β
β QQuery 7 β 73.72 ms β 73.65 ms β no change β
β QQuery 8 β 36.17 ms β 35.93 ms β no change β
β QQuery 9 β 53.84 ms β 50.96 ms β +1.06x faster β
β QQuery 10 β 61.83 ms β 61.54 ms β no change β
β QQuery 11 β 265.00 ms β 266.39 ms β no change β
β QQuery 12 β 28.30 ms β 28.20 ms β no change β
β QQuery 13 β 115.46 ms β 116.81 ms β no change β
β QQuery 14 β 392.59 ms β 393.49 ms β no change β
β QQuery 15 β 53.35 ms β 51.73 ms β no change β
β QQuery 16 β 6.41 ms β 6.35 ms β no change β
β QQuery 17 β 78.05 ms β 78.44 ms β no change β
β QQuery 18 β 101.27 ms β 103.05 ms β no change β
β QQuery 19 β 40.90 ms β 40.99 ms β no change β
β QQuery 20 β 35.04 ms β 34.79 ms β no change β
β QQuery 21 β 16.85 ms β 16.61 ms β no change β
β QQuery 22 β 62.24 ms β 63.07 ms β no change β
β QQuery 23 β 307.31 ms β 313.16 ms β no change β
β QQuery 24 β 190.44 ms β 191.08 ms β no change β
β QQuery 25 β 106.66 ms β 106.83 ms β no change β
β QQuery 26 β 47.01 ms β 47.22 ms β no change β
β QQuery 27 β 5.93 ms β 6.10 ms β no change β
β QQuery 28 β 55.87 ms β 56.89 ms β no change β
β QQuery 29 β 93.50 ms β 94.08 ms β no change β
β QQuery 30 β 31.92 ms β 32.38 ms β no change β
β QQuery 31 β 107.02 ms β 107.86 ms β no change β
β QQuery 32 β 19.79 ms β 19.98 ms β no change β
β QQuery 33 β 37.01 ms β 36.68 ms β no change β
β QQuery 34 β 10.09 ms β 9.73 ms β no change β
β QQuery 35 β 70.69 ms β 70.96 ms β no change β
β QQuery 36 β 5.60 ms β 5.60 ms β no change β
β QQuery 37 β 6.74 ms β 6.61 ms β no change β
β QQuery 38 β 60.66 ms β 62.23 ms β no change β
β QQuery 39 β 73.39 ms β 72.70 ms β no change β
β QQuery 40 β 23.08 ms β 23.06 ms β no change β
β QQuery 41 β 10.95 ms β 10.60 ms β no change β
β QQuery 42 β 23.44 ms β 23.35 ms β no change β
β QQuery 43 β 5.07 ms β 5.11 ms β no change β
β QQuery 44 β 9.08 ms β 9.19 ms β no change β
β QQuery 45 β 37.73 ms β 38.17 ms β no change β
β QQuery 46 β 11.56 ms β 11.57 ms β no change β
β QQuery 47 β 216.96 ms β 216.48 ms β no change β
β QQuery 48 β 93.63 ms β 93.91 ms β no change β
β QQuery 49 β 68.98 ms β 69.67 ms β no change β
β QQuery 50 β 57.04 ms β 59.55 ms β no change β
β QQuery 51 β 92.93 ms β 91.76 ms β no change β
β QQuery 52 β 23.51 ms β 24.04 ms β no change β
β QQuery 53 β 28.22 ms β 28.73 ms β no change β
β QQuery 54 β 53.22 ms β 53.61 ms β no change β
β QQuery 55 β 23.15 ms β 23.41 ms β no change β
β QQuery 56 β 37.72 ms β 38.08 ms β no change β
β QQuery 57 β 165.86 ms β 166.82 ms β no change β
β QQuery 58 β 107.86 ms β 108.02 ms β no change β
β QQuery 59 β 115.98 ms β 115.67 ms β no change β
β QQuery 60 β 38.25 ms β 38.46 ms β no change β
β QQuery 61 β 11.37 ms β 11.52 ms β no change β
β QQuery 62 β 43.75 ms β 43.64 ms β no change β
β QQuery 63 β 28.73 ms β 29.03 ms β no change β
β QQuery 64 β 354.69 ms β 354.74 ms β no change β
β QQuery 65 β 132.19 ms β 131.59 ms β no change β
β QQuery 66 β 76.09 ms β 76.88 ms β no change β
β QQuery 67 β 241.29 ms β 239.59 ms β no change β
β QQuery 68 β 12.08 ms β 11.58 ms β no change β
β QQuery 69 β 55.67 ms β 55.33 ms β no change β
β QQuery 70 β 102.54 ms β 102.35 ms β no change β
β QQuery 71 β 35.33 ms β 34.40 ms β no change β
β QQuery 72 β 1748.93 ms β 1677.41 ms β no change β
β QQuery 73 β 9.79 ms β 9.85 ms β no change β
β QQuery 74 β 155.04 ms β 155.23 ms β no change β
β QQuery 75 β 139.58 ms β 140.01 ms β no change β
β QQuery 76 β 33.55 ms β 34.39 ms β no change β
β QQuery 77 β 59.28 ms β 59.48 ms β no change β
β QQuery 78 β 158.86 ms β 158.73 ms β no change β
β QQuery 79 β 66.28 ms β 65.43 ms β no change β
β QQuery 80 β 95.23 ms β 95.90 ms β no change β
β QQuery 81 β 25.24 ms β 26.01 ms β no change β
β QQuery 82 β 16.25 ms β 16.23 ms β no change β
β QQuery 83 β 33.27 ms β 33.05 ms β no change β
β QQuery 84 β 29.25 ms β 29.20 ms β no change β
β QQuery 85 β 101.64 ms β 99.40 ms β no change β
β QQuery 86 β 24.81 ms β 25.05 ms β no change β
β QQuery 87 β 60.55 ms β 60.99 ms β no change β
β QQuery 88 β 59.81 ms β 60.24 ms β no change β
β QQuery 89 β 34.52 ms β 34.76 ms β no change β
β QQuery 90 β 16.31 ms β 16.34 ms β no change β
β QQuery 91 β 44.09 ms β 43.68 ms β no change β
β QQuery 92 β 29.01 ms β 28.97 ms β no change β
β QQuery 93 β 48.56 ms β 49.98 ms β no change β
β QQuery 94 β 38.11 ms β 37.76 ms β no change β
β QQuery 95 β 78.27 ms β 79.99 ms β no change β
β QQuery 96 β 23.36 ms β 23.55 ms β no change β
β QQuery 97 β 50.71 ms β 50.93 ms β no change β
β QQuery 98 β 42.16 ms β 42.83 ms β no change β
β QQuery 99 β 64.97 ms β 65.69 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 8908.96ms β
β Total Time (rich-T-kid_coacler-benchmark) β 8851.43ms β
β Average Time (HEAD) β 89.99ms β
β Average Time (rich-T-kid_coacler-benchmark) β 89.41ms β
β Queries Faster β 1 β
β Queries Slower β 0 β
β Queries with No Change β 98 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 5.42 / 5.99 Β±0.97 / 7.93 ms β 5.46 / 6.02 Β±1.00 / 8.01 ms β no change β
β QQuery 2 β 80.56 / 81.18 Β±0.59 / 82.05 ms β 80.01 / 80.23 Β±0.20 / 80.61 ms β no change β
β QQuery 3 β 28.53 / 28.77 Β±0.19 / 29.04 ms β 28.56 / 28.84 Β±0.20 / 29.17 ms β no change β
β QQuery 4 β 432.31 / 441.16 Β±4.47 / 443.82 ms β 428.45 / 437.77 Β±6.13 / 446.62 ms β no change β
β QQuery 5 β 50.41 / 53.19 Β±5.10 / 63.38 ms β 50.72 / 50.87 Β±0.09 / 51.00 ms β no change β
β QQuery 6 β 35.67 / 36.25 Β±0.47 / 36.81 ms β 35.21 / 35.72 Β±0.38 / 36.29 ms β no change β
β QQuery 7 β 73.72 / 74.98 Β±0.96 / 76.49 ms β 73.65 / 74.31 Β±0.41 / 74.93 ms β no change β
β QQuery 8 β 36.17 / 36.45 Β±0.28 / 36.94 ms β 35.93 / 36.09 Β±0.11 / 36.24 ms β no change β
β QQuery 9 β 53.84 / 57.63 Β±3.78 / 64.16 ms β 50.96 / 53.18 Β±1.43 / 55.20 ms β +1.08x faster β
β QQuery 10 β 61.83 / 62.09 Β±0.22 / 62.45 ms β 61.54 / 61.99 Β±0.31 / 62.33 ms β no change β
β QQuery 11 β 265.00 / 268.87 Β±2.63 / 272.27 ms β 266.39 / 269.95 Β±3.62 / 276.87 ms β no change β
β QQuery 12 β 28.30 / 28.93 Β±0.42 / 29.57 ms β 28.20 / 28.51 Β±0.24 / 28.84 ms β no change β
β QQuery 13 β 115.46 / 116.86 Β±1.75 / 120.16 ms β 116.81 / 117.35 Β±0.50 / 118.14 ms β no change β
β QQuery 14 β 392.59 / 394.60 Β±2.77 / 399.95 ms β 393.49 / 395.91 Β±2.74 / 399.80 ms β no change β
β QQuery 15 β 53.35 / 53.99 Β±0.49 / 54.74 ms β 51.73 / 53.50 Β±1.39 / 55.47 ms β no change β
β QQuery 16 β 6.41 / 6.86 Β±0.47 / 7.72 ms β 6.35 / 6.54 Β±0.21 / 6.92 ms β no change β
β QQuery 17 β 78.05 / 79.03 Β±0.88 / 80.47 ms β 78.44 / 80.19 Β±2.09 / 84.04 ms β no change β
β QQuery 18 β 101.27 / 104.40 Β±3.79 / 111.83 ms β 103.05 / 104.12 Β±0.96 / 105.59 ms β no change β
β QQuery 19 β 40.90 / 41.50 Β±0.36 / 41.93 ms β 40.99 / 41.53 Β±0.49 / 42.34 ms β no change β
β QQuery 20 β 35.04 / 35.57 Β±0.33 / 35.94 ms β 34.79 / 35.23 Β±0.29 / 35.65 ms β no change β
β QQuery 21 β 16.85 / 17.16 Β±0.27 / 17.60 ms β 16.61 / 16.82 Β±0.15 / 17.04 ms β no change β
β QQuery 22 β 62.24 / 63.05 Β±0.84 / 64.68 ms β 63.07 / 63.68 Β±0.45 / 64.14 ms β no change β
β QQuery 23 β 307.31 / 310.71 Β±3.31 / 316.62 ms β 313.16 / 318.22 Β±8.32 / 334.82 ms β no change β
β QQuery 24 β 190.44 / 192.47 Β±1.36 / 194.24 ms β 191.08 / 196.61 Β±8.21 / 212.89 ms β no change β
β QQuery 25 β 106.66 / 108.10 Β±1.27 / 109.93 ms β 106.83 / 107.98 Β±1.00 / 109.75 ms β no change β
β QQuery 26 β 47.01 / 47.95 Β±0.52 / 48.58 ms β 47.22 / 47.74 Β±0.34 / 48.16 ms β no change β
β QQuery 27 β 5.93 / 6.14 Β±0.20 / 6.51 ms β 6.10 / 6.30 Β±0.17 / 6.56 ms β no change β
β QQuery 28 β 55.87 / 59.77 Β±1.96 / 61.13 ms β 56.89 / 60.36 Β±1.85 / 61.96 ms β no change β
β QQuery 29 β 93.50 / 95.19 Β±2.15 / 98.96 ms β 94.08 / 96.63 Β±3.69 / 103.97 ms β no change β
β QQuery 30 β 31.92 / 32.43 Β±0.38 / 33.01 ms β 32.38 / 32.81 Β±0.47 / 33.58 ms β no change β
β QQuery 31 β 107.02 / 108.25 Β±1.38 / 110.93 ms β 107.86 / 109.40 Β±1.14 / 111.25 ms β no change β
β QQuery 32 β 19.79 / 20.04 Β±0.22 / 20.43 ms β 19.98 / 20.39 Β±0.37 / 21.05 ms β no change β
β QQuery 33 β 37.01 / 37.34 Β±0.26 / 37.72 ms β 36.68 / 37.32 Β±0.37 / 37.80 ms β no change β
β QQuery 34 β 10.09 / 10.30 Β±0.20 / 10.57 ms β 9.73 / 10.11 Β±0.26 / 10.55 ms β no change β
β QQuery 35 β 70.69 / 71.62 Β±0.53 / 72.20 ms β 70.96 / 71.69 Β±0.46 / 72.41 ms β no change β
β QQuery 36 β 5.60 / 5.79 Β±0.23 / 6.23 ms β 5.60 / 5.71 Β±0.19 / 6.09 ms β no change β
β QQuery 37 β 6.74 / 6.83 Β±0.10 / 7.00 ms β 6.61 / 6.74 Β±0.09 / 6.86 ms β no change β
β QQuery 38 β 60.66 / 61.20 Β±0.41 / 61.83 ms β 62.23 / 63.47 Β±1.00 / 65.25 ms β no change β
β QQuery 39 β 73.39 / 74.96 Β±2.69 / 80.34 ms β 72.70 / 73.41 Β±0.75 / 74.52 ms β no change β
β QQuery 40 β 23.08 / 23.37 Β±0.17 / 23.56 ms β 23.06 / 23.38 Β±0.25 / 23.70 ms β no change β
β QQuery 41 β 10.95 / 11.11 Β±0.16 / 11.34 ms β 10.60 / 10.76 Β±0.18 / 11.11 ms β no change β
β QQuery 42 β 23.44 / 23.55 Β±0.15 / 23.84 ms β 23.35 / 23.72 Β±0.37 / 24.43 ms β no change β
β QQuery 43 β 5.07 / 5.18 Β±0.13 / 5.44 ms β 5.11 / 5.21 Β±0.15 / 5.51 ms β no change β
β QQuery 44 β 9.08 / 9.44 Β±0.48 / 10.38 ms β 9.19 / 9.89 Β±1.15 / 12.17 ms β no change β
β QQuery 45 β 37.73 / 38.11 Β±0.43 / 38.95 ms β 38.17 / 39.63 Β±1.35 / 42.19 ms β no change β
β QQuery 46 β 11.56 / 11.82 Β±0.18 / 12.12 ms β 11.57 / 12.27 Β±0.44 / 12.63 ms β no change β
β QQuery 47 β 216.96 / 220.09 Β±3.23 / 224.26 ms β 216.48 / 220.64 Β±4.14 / 226.51 ms β no change β
β QQuery 48 β 93.63 / 94.70 Β±1.19 / 96.94 ms β 93.91 / 94.52 Β±0.46 / 95.23 ms β no change β
β QQuery 49 β 68.98 / 69.62 Β±0.49 / 70.21 ms β 69.67 / 71.23 Β±1.50 / 73.23 ms β no change β
β QQuery 50 β 57.04 / 58.53 Β±1.55 / 61.53 ms β 59.55 / 60.18 Β±0.71 / 61.34 ms β no change β
β QQuery 51 β 92.93 / 94.48 Β±0.88 / 95.32 ms β 91.76 / 95.07 Β±1.99 / 97.12 ms β no change β
β QQuery 52 β 23.51 / 24.01 Β±0.35 / 24.50 ms β 24.04 / 24.59 Β±0.53 / 25.58 ms β no change β
β QQuery 53 β 28.22 / 29.77 Β±2.54 / 34.84 ms β 28.73 / 31.41 Β±4.42 / 40.23 ms β 1.05x slower β
β QQuery 54 β 53.22 / 54.65 Β±1.70 / 57.86 ms β 53.61 / 54.27 Β±0.74 / 55.70 ms β no change β
β QQuery 55 β 23.15 / 23.51 Β±0.35 / 23.97 ms β 23.41 / 23.64 Β±0.19 / 23.89 ms β no change β
β QQuery 56 β 37.72 / 38.39 Β±0.60 / 39.46 ms β 38.08 / 38.49 Β±0.42 / 39.18 ms β no change β
β QQuery 57 β 165.86 / 168.86 Β±2.94 / 174.32 ms β 166.82 / 169.86 Β±2.98 / 175.20 ms β no change β
β QQuery 58 β 107.86 / 108.98 Β±0.84 / 110.43 ms β 108.02 / 110.74 Β±3.48 / 117.53 ms β no change β
β QQuery 59 β 115.98 / 117.01 Β±1.04 / 118.99 ms β 115.67 / 116.98 Β±0.79 / 118.03 ms β no change β
β QQuery 60 β 38.25 / 39.22 Β±0.70 / 39.97 ms β 38.46 / 38.81 Β±0.32 / 39.26 ms β no change β
β QQuery 61 β 11.37 / 11.76 Β±0.43 / 12.54 ms β 11.52 / 11.64 Β±0.15 / 11.94 ms β no change β
β QQuery 62 β 43.75 / 44.02 Β±0.25 / 44.49 ms β 43.64 / 46.12 Β±3.73 / 53.55 ms β no change β
β QQuery 63 β 28.73 / 28.92 Β±0.16 / 29.11 ms β 29.03 / 29.31 Β±0.37 / 30.01 ms β no change β
β QQuery 64 β 354.69 / 359.33 Β±4.27 / 366.26 ms β 354.74 / 361.47 Β±5.99 / 371.70 ms β no change β
β QQuery 65 β 132.19 / 134.66 Β±2.28 / 138.84 ms β 131.59 / 132.99 Β±0.89 / 134.40 ms β no change β
β QQuery 66 β 76.09 / 76.62 Β±0.39 / 77.05 ms β 76.88 / 80.13 Β±4.03 / 87.58 ms β no change β
β QQuery 67 β 241.29 / 246.63 Β±4.56 / 253.56 ms β 239.59 / 245.22 Β±3.63 / 249.89 ms β no change β
β QQuery 68 β 12.08 / 12.82 Β±1.31 / 15.44 ms β 11.58 / 11.79 Β±0.22 / 12.20 ms β +1.09x faster β
β QQuery 69 β 55.67 / 55.98 Β±0.26 / 56.43 ms β 55.33 / 55.72 Β±0.24 / 56.04 ms β no change β
β QQuery 70 β 102.54 / 103.20 Β±0.70 / 104.56 ms β 102.35 / 106.17 Β±4.47 / 114.72 ms β no change β
β QQuery 71 β 35.33 / 39.86 Β±6.02 / 51.37 ms β 34.40 / 35.03 Β±0.33 / 35.36 ms β +1.14x faster β
β QQuery 72 β 1748.93 / 1787.74 Β±31.55 / 1827.47 ms β 1677.41 / 1822.25 Β±98.37 / 1959.17 ms β no change β
β QQuery 73 β 9.79 / 10.86 Β±1.47 / 13.79 ms β 9.85 / 10.31 Β±0.42 / 11.05 ms β +1.05x faster β
β QQuery 74 β 155.04 / 157.12 Β±1.77 / 160.37 ms β 155.23 / 157.28 Β±1.57 / 159.53 ms β no change β
β QQuery 75 β 139.58 / 142.46 Β±3.06 / 148.14 ms β 140.01 / 141.16 Β±0.97 / 142.52 ms β no change β
β QQuery 76 β 33.55 / 34.14 Β±0.37 / 34.67 ms β 34.39 / 34.98 Β±0.67 / 36.29 ms β no change β
β QQuery 77 β 59.28 / 61.87 Β±4.09 / 70.02 ms β 59.48 / 59.99 Β±0.41 / 60.63 ms β no change β
β QQuery 78 β 158.86 / 165.08 Β±8.24 / 181.28 ms β 158.73 / 162.11 Β±4.27 / 170.48 ms β no change β
β QQuery 79 β 66.28 / 68.91 Β±3.60 / 75.77 ms β 65.43 / 65.79 Β±0.33 / 66.25 ms β no change β
β QQuery 80 β 95.23 / 96.12 Β±0.77 / 97.44 ms β 95.90 / 96.81 Β±1.03 / 98.37 ms β no change β
β QQuery 81 β 25.24 / 26.01 Β±0.40 / 26.43 ms β 26.01 / 26.19 Β±0.14 / 26.38 ms β no change β
β QQuery 82 β 16.25 / 16.39 Β±0.09 / 16.47 ms β 16.23 / 16.56 Β±0.17 / 16.69 ms β no change β
β QQuery 83 β 33.27 / 34.02 Β±0.91 / 35.76 ms β 33.05 / 33.19 Β±0.12 / 33.36 ms β no change β
β QQuery 84 β 29.25 / 30.00 Β±0.69 / 31.08 ms β 29.20 / 29.45 Β±0.19 / 29.70 ms β no change β
β QQuery 85 β 101.64 / 102.68 Β±0.70 / 103.65 ms β 99.40 / 101.62 Β±1.29 / 103.09 ms β no change β
β QQuery 86 β 24.81 / 25.14 Β±0.28 / 25.55 ms β 25.05 / 25.57 Β±0.56 / 26.53 ms β no change β
β QQuery 87 β 60.55 / 61.86 Β±1.92 / 65.66 ms β 60.99 / 61.70 Β±0.64 / 62.71 ms β no change β
β QQuery 88 β 59.81 / 60.69 Β±0.50 / 61.33 ms β 60.24 / 60.61 Β±0.29 / 61.00 ms β no change β
β QQuery 89 β 34.52 / 34.82 Β±0.17 / 34.99 ms β 34.76 / 37.90 Β±5.04 / 47.94 ms β 1.09x slower β
β QQuery 90 β 16.31 / 16.82 Β±0.63 / 18.01 ms β 16.34 / 16.51 Β±0.13 / 16.73 ms β no change β
β QQuery 91 β 44.09 / 44.37 Β±0.35 / 45.03 ms β 43.68 / 44.47 Β±0.80 / 46.00 ms β no change β
β QQuery 92 β 29.01 / 30.61 Β±1.86 / 34.18 ms β 28.97 / 29.79 Β±0.71 / 31.03 ms β no change β
β QQuery 93 β 48.56 / 49.69 Β±0.98 / 51.51 ms β 49.98 / 50.63 Β±0.50 / 51.37 ms β no change β
β QQuery 94 β 38.11 / 38.43 Β±0.24 / 38.82 ms β 37.76 / 38.97 Β±1.24 / 41.19 ms β no change β
β QQuery 95 β 78.27 / 79.37 Β±0.68 / 80.09 ms β 79.99 / 81.90 Β±1.78 / 85.20 ms β no change β
β QQuery 96 β 23.36 / 24.60 Β±2.06 / 28.70 ms β 23.55 / 23.81 Β±0.21 / 24.14 ms β no change β
β QQuery 97 β 50.71 / 52.60 Β±2.26 / 57.03 ms β 50.93 / 52.26 Β±1.61 / 54.69 ms β no change β
β QQuery 98 β 42.16 / 42.85 Β±0.72 / 43.76 ms β 42.83 / 44.76 Β±2.39 / 49.40 ms β no change β
β QQuery 99 β 64.97 / 65.80 Β±0.67 / 66.68 ms β 65.69 / 67.73 Β±3.35 / 74.41 ms β no change β
βββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 9076.84ms β
β Total Time (rich-T-kid_coacler-benchmark) β 9128.37ms β
β Average Time (HEAD) β 91.69ms β
β Average Time (rich-T-kid_coacler-benchmark) β 92.21ms β
β Queries Faster β 4 β
β Queries Slower β 2 β
β Queries with No Change β 93 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpcds β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 50.0s |
| Peak memory | 2.3 GiB |
| Avg memory | 1.5 GiB |
| CPU user | 196.1s |
| CPU sys | 5.2s |
| Peak spill | 0 B |
**tpcds β branch**
| Metric | Value |
|--------|-------|
| Wall time | 50.0s |
| Peak memory | 2.0 GiB |
| Avg memory | 1.4 GiB |
| CPU user | 200.2s |
| CPU sys | 5.9s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746618214
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5746603297)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5746603297-2518-99mnm 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (ef7543e040ffbfe7da6bd2c2b70bd2db2721cac7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ef7543e040ffbfe7da6bd2c2b70bd2db2721cac7)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5743232637
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5743214143)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5743214143-2486-t9j6q 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746654734
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5746605348)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (ef7543e040ffbfe7da6bd2c2b70bd2db2721cac7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ef7543e040ffbfe7da6bd2c2b70bd2db2721cac7)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch10
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf10.json
--------------------
βββββββββββββ³ββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 345.68 ms β 338.62 ms β no change β
β QQuery 2 β 93.92 ms β 95.16 ms β no change β
β QQuery 3 β 236.26 ms β 248.75 ms β 1.05x slower β
β QQuery 4 β 120.04 ms β 131.62 ms β 1.10x slower β
β QQuery 5 β 387.60 ms β 393.46 ms β no change β
β QQuery 6 β 132.82 ms β 134.92 ms β no change β
β QQuery 7 β 504.74 ms β 510.38 ms β no change β
β QQuery 8 β 379.52 ms β 377.14 ms β no change β
β QQuery 9 β 574.18 ms β 573.43 ms β no change β
β QQuery 10 β 314.52 ms β 316.03 ms β no change β
β QQuery 11 β 67.12 ms β 68.55 ms β no change β
β QQuery 12 β 167.69 ms β 160.14 ms β no change β
β QQuery 13 β 353.48 ms β 342.29 ms β no change β
β QQuery 14 β 188.73 ms β 185.36 ms β no change β
β QQuery 15 β 341.55 ms β 320.89 ms β +1.06x faster β
β QQuery 16 β 72.06 ms β 70.02 ms β no change β
β QQuery 17 β 734.60 ms β 714.26 ms β no change β
β QQuery 18 β 855.65 ms β 864.86 ms β no change β
β QQuery 19 β 243.81 ms β 248.57 ms β no change β
β QQuery 20 β 278.52 ms β 293.48 ms β 1.05x slower β
β QQuery 21 β 741.85 ms β 803.90 ms β 1.08x slower β
β QQuery 22 β 63.40 ms β 66.39 ms β no change β
βββββββββββββ΄ββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 7197.76ms β
β Total Time (rich-T-kid_coacler-benchmark) β 7258.22ms β
β Average Time (HEAD) β 327.17ms β
β Average Time (rich-T-kid_coacler-benchmark) β 329.92ms β
β Queries Faster β 1 β
β Queries Slower β 4 β
β Queries with No Change β 17 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf10.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 345.68 / 350.41 Β±4.28 / 357.46 ms β 338.62 / 342.25 Β±3.19 / 347.30 ms β no change β
β QQuery 2 β 93.92 / 97.04 Β±2.53 / 100.91 ms β 95.16 / 97.10 Β±1.58 / 99.08 ms β no change β
β QQuery 3 β 236.26 / 239.34 Β±2.33 / 243.31 ms β 248.75 / 256.63 Β±4.38 / 262.20 ms β 1.07x slower β
β QQuery 4 β 120.04 / 122.16 Β±1.22 / 123.79 ms β 131.62 / 133.77 Β±1.74 / 136.50 ms β 1.10x slower β
β QQuery 5 β 387.60 / 394.70 Β±5.99 / 401.91 ms β 393.46 / 401.07 Β±6.67 / 411.66 ms β no change β
β QQuery 6 β 132.82 / 135.33 Β±1.52 / 137.07 ms β 134.92 / 136.67 Β±1.68 / 139.87 ms β no change β
β QQuery 7 β 504.74 / 517.77 Β±12.59 / 539.44 ms β 510.38 / 522.35 Β±11.53 / 541.94 ms β no change β
β QQuery 8 β 379.52 / 386.74 Β±6.81 / 398.89 ms β 377.14 / 384.68 Β±5.85 / 394.02 ms β no change β
β QQuery 9 β 574.18 / 597.34 Β±12.84 / 609.26 ms β 573.43 / 588.87 Β±20.31 / 626.94 ms β no change β
β QQuery 10 β 314.52 / 318.37 Β±5.01 / 328.16 ms β 316.03 / 327.73 Β±8.69 / 340.91 ms β no change β
β QQuery 11 β 67.12 / 71.49 Β±6.13 / 83.58 ms β 68.55 / 75.32 Β±6.81 / 87.88 ms β 1.05x slower β
β QQuery 12 β 167.69 / 173.28 Β±7.59 / 188.21 ms β 160.14 / 168.75 Β±8.49 / 183.54 ms β no change β
β QQuery 13 β 353.48 / 364.55 Β±10.98 / 383.92 ms β 342.29 / 360.85 Β±10.83 / 374.01 ms β no change β
β QQuery 14 β 188.73 / 194.65 Β±7.72 / 209.76 ms β 185.36 / 190.37 Β±3.64 / 195.47 ms β no change β
β QQuery 15 β 341.55 / 344.78 Β±3.79 / 352.03 ms β 320.89 / 326.15 Β±4.09 / 332.53 ms β +1.06x faster β
β QQuery 16 β 72.06 / 74.09 Β±1.61 / 76.13 ms β 70.02 / 76.87 Β±8.95 / 94.51 ms β no change β
β QQuery 17 β 734.60 / 752.48 Β±20.17 / 788.60 ms β 714.26 / 755.62 Β±21.66 / 776.54 ms β no change β
β QQuery 18 β 855.65 / 887.66 Β±18.95 / 914.42 ms β 864.86 / 874.65 Β±4.91 / 877.51 ms β no change β
β QQuery 19 β 243.81 / 255.36 Β±14.33 / 281.38 ms β 248.57 / 260.23 Β±13.93 / 287.63 ms β no change β
β QQuery 20 β 278.52 / 293.78 Β±8.53 / 303.44 ms β 293.48 / 316.81 Β±15.06 / 336.61 ms β 1.08x slower β
β QQuery 21 β 741.85 / 760.39 Β±15.17 / 784.89 ms β 803.90 / 814.91 Β±12.38 / 838.24 ms β 1.07x slower β
β QQuery 22 β 63.40 / 67.53 Β±2.99 / 72.34 ms β 66.39 / 68.72 Β±2.99 / 74.62 ms β no change β
βββββββββββββ΄βββββββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 7399.23ms β
β Total Time (rich-T-kid_coacler-benchmark) β 7480.37ms β
β Average Time (HEAD) β 336.33ms β
β Average Time (rich-T-kid_coacler-benchmark) β 340.02ms β
β Queries Faster β 1 β
β Queries Slower β 5 β
β Queries with No Change β 16 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpch10 β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 40.0s |
| Peak memory | 4.7 GiB |
| Avg memory | 1.5 GiB |
| CPU user | 375.5s |
| CPU sys | 23.9s |
| Peak spill | 0 B |
**tpch10 β branch**
| Metric | Value |
|--------|-------|
| Wall time | 40.0s |
| Peak memory | 4.7 GiB |
| Avg memory | 1.5 GiB |
| CPU user | 387.1s |
| CPU sys | 23.2s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid closed pull request #25487: playground
URL: https://github.com/apache/datafusion/pull/25487
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739439576
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739391357)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 41.33 ms β 40.85 ms β no change β
β QQuery 2 β 18.86 ms β 18.73 ms β no change β
β QQuery 3 β 29.22 ms β 28.67 ms β no change β
β QQuery 4 β 17.68 ms β 17.56 ms β no change β
β QQuery 5 β 35.86 ms β 36.38 ms β no change β
β QQuery 6 β 16.42 ms β 16.38 ms β no change β
β QQuery 7 β 42.65 ms β 41.60 ms β no change β
β QQuery 8 β 40.97 ms β 40.29 ms β no change β
β QQuery 9 β 49.51 ms β 51.09 ms β no change β
β QQuery 10 β 40.87 ms β 41.07 ms β no change β
β QQuery 11 β 13.89 ms β 14.13 ms β no change β
β QQuery 12 β 21.43 ms β 21.23 ms β no change β
β QQuery 13 β 40.90 ms β 41.02 ms β no change β
β QQuery 14 β 24.81 ms β 25.27 ms β no change β
β QQuery 15 β 31.52 ms β 32.47 ms β no change β
β QQuery 16 β 14.18 ms β 14.79 ms β no change β
β QQuery 17 β 73.43 ms β 72.79 ms β no change β
β QQuery 18 β 63.16 ms β 62.62 ms β no change β
β QQuery 19 β 32.00 ms β 32.65 ms β no change β
β QQuery 20 β 32.00 ms β 32.97 ms β no change β
β QQuery 21 β 56.66 ms β 56.79 ms β no change β
β QQuery 22 β 14.64 ms β 14.41 ms β no change β
βββββββββββββ΄βββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 752.00ms β
β Total Time (rich-T-kid_coacler-benchmark) β 753.74ms β
β Average Time (HEAD) β 34.18ms β
β Average Time (rich-T-kid_coacler-benchmark) β 34.26ms β
β Queries Faster β 0 β
β Queries Slower β 0 β
β Queries with No Change β 22 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββ³ββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 41.33 / 43.33 Β±2.13 / 46.92 ms β 40.85 / 41.60 Β±0.93 / 43.38 ms β no change β
β QQuery 2 β 18.86 / 19.39 Β±0.84 / 21.06 ms β 18.73 / 18.97 Β±0.25 / 19.45 ms β no change β
β QQuery 3 β 29.22 / 29.52 Β±0.33 / 30.11 ms β 28.67 / 30.03 Β±1.03 / 31.47 ms β no change β
β QQuery 4 β 17.68 / 18.71 Β±0.67 / 19.39 ms β 17.56 / 18.12 Β±0.73 / 19.56 ms β no change β
β QQuery 5 β 35.86 / 36.38 Β±0.62 / 37.59 ms β 36.38 / 37.10 Β±0.47 / 37.55 ms β no change β
β QQuery 6 β 16.42 / 16.51 Β±0.12 / 16.74 ms β 16.38 / 16.69 Β±0.18 / 16.94 ms β no change β
β QQuery 7 β 42.65 / 45.83 Β±4.34 / 54.36 ms β 41.60 / 44.28 Β±2.24 / 47.75 ms β no change β
β QQuery 8 β 40.97 / 41.74 Β±0.99 / 43.69 ms β 40.29 / 41.04 Β±0.73 / 42.22 ms β no change β
β QQuery 9 β 49.51 / 50.72 Β±0.74 / 51.43 ms β 51.09 / 51.96 Β±1.45 / 54.86 ms β no change β
β QQuery 10 β 40.87 / 41.27 Β±0.27 / 41.70 ms β 41.07 / 41.36 Β±0.23 / 41.78 ms β no change β
β QQuery 11 β 13.89 / 14.80 Β±1.10 / 16.78 ms β 14.13 / 14.29 Β±0.16 / 14.56 ms β no change β
β QQuery 12 β 21.43 / 21.64 Β±0.24 / 22.02 ms β 21.23 / 21.79 Β±0.40 / 22.48 ms β no change β
β QQuery 13 β 40.90 / 42.61 Β±2.65 / 47.88 ms β 41.02 / 42.97 Β±1.99 / 46.68 ms β no change β
β QQuery 14 β 24.81 / 25.24 Β±0.38 / 25.88 ms β 25.27 / 25.42 Β±0.16 / 25.66 ms β no change β
β QQuery 15 β 31.52 / 31.85 Β±0.27 / 32.18 ms β 32.47 / 32.93 Β±0.55 / 33.95 ms β no change β
β QQuery 16 β 14.18 / 14.44 Β±0.21 / 14.69 ms β 14.79 / 14.90 Β±0.11 / 15.10 ms β no change β
β QQuery 17 β 73.43 / 74.99 Β±0.99 / 76.55 ms β 72.79 / 74.07 Β±0.90 / 75.52 ms β no change β
β QQuery 18 β 63.16 / 63.99 Β±0.83 / 65.55 ms β 62.62 / 66.12 Β±2.91 / 70.88 ms β no change β
β QQuery 19 β 32.00 / 32.17 Β±0.12 / 32.37 ms β 32.65 / 33.15 Β±0.27 / 33.43 ms β no change β
β QQuery 20 β 32.00 / 32.37 Β±0.22 / 32.63 ms β 32.97 / 33.22 Β±0.24 / 33.65 ms β no change β
β QQuery 21 β 56.66 / 58.28 Β±1.34 / 60.10 ms β 56.79 / 57.76 Β±0.92 / 59.03 ms β no change β
β QQuery 22 β 14.64 / 14.87 Β±0.19 / 15.18 ms β 14.41 / 14.56 Β±0.17 / 14.81 ms β no change β
βββββββββββββ΄βββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββ΄ββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 770.67ms β
β Total Time (rich-T-kid_coacler-benchmark) β 772.33ms β
β Average Time (HEAD) β 35.03ms β
β Average Time (rich-T-kid_coacler-benchmark) β 35.11ms β
β Queries Faster β 0 β
β Queries Slower β 0 β
β Queries with No Change β 22 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpch β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 5.0s |
| Peak memory | 1.2 GiB |
| Avg memory | 484.9 MiB |
| CPU user | 21.6s |
| CPU sys | 1.9s |
| Peak spill | 0 B |
**tpch β branch**
| Metric | Value |
|--------|-------|
| Wall time | 5.0s |
| Peak memory | 1.2 GiB |
| Avg memory | 518.9 MiB |
| CPU user | 21.6s |
| CPU sys | 1.8s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739446636
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739397449)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5739397449-2471-tvlmp 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739456586
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739397449)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5739397449-2472-gt2gd 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5736791546
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5736766800)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5736766800-2461-lxx55 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (76e1f1c24138317d60fc604b72283008fad49b6a) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..76e1f1c24138317d60fc604b72283008fad49b6a)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5736912789
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5736766800)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (76e1f1c24138317d60fc604b72283008fad49b6a) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..76e1f1c24138317d60fc604b72283008fad49b6a)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.42 ms β 1.49 ms β no change β
β QQuery 1 β 12.16 ms β 12.23 ms β no change β
β QQuery 2 β 38.00 ms β 37.65 ms β no change β
β QQuery 3 β 32.59 ms β 33.12 ms β no change β
β QQuery 4 β 267.07 ms β 257.83 ms β no change β
β QQuery 5 β 304.97 ms β 285.50 ms β +1.07x faster β
β QQuery 6 β 1.70 ms β 1.31 ms β +1.30x faster β
β QQuery 7 β 14.39 ms β 13.79 ms β no change β
β QQuery 8 β 399.95 ms β 343.57 ms β +1.16x faster β
β QQuery 9 β 554.68 ms β 497.62 ms β +1.11x faster β
β QQuery 10 β 71.53 ms β 70.40 ms β no change β
β QQuery 11 β 83.84 ms β 80.93 ms β no change β
β QQuery 12 β 324.42 ms β 306.37 ms β +1.06x faster β
β QQuery 13 β 417.89 ms β 401.14 ms β no change β
β QQuery 14 β 325.33 ms β 305.65 ms β +1.06x faster β
β QQuery 15 β 336.24 ms β 310.00 ms β +1.08x faster β
β QQuery 16 β 713.37 ms β 658.38 ms β +1.08x faster β
β QQuery 17 β 670.22 ms β 697.53 ms β no change β
β QQuery 18 β 1362.97 ms β 1363.63 ms β no change β
β QQuery 19 β 29.68 ms β 28.13 ms β +1.06x faster β
β QQuery 20 β 531.32 ms β 519.68 ms β no change β
β QQuery 21 β 527.08 ms β 519.61 ms β no change β
β QQuery 22 β 1005.42 ms β 1027.04 ms β no change β
β QQuery 23 β 3203.41 ms β 3196.40 ms β no change β
β QQuery 24 β 43.13 ms β 40.92 ms β +1.05x faster β
β QQuery 25 β 108.82 ms β 105.86 ms β no change β
β QQuery 26 β 41.51 ms β 41.11 ms β no change β
β QQuery 27 β 531.66 ms β 519.56 ms β no change β
β QQuery 28 β 2981.48 ms β 2964.05 ms β no change β
β QQuery 29 β 44.65 ms β 43.83 ms β no change β
β QQuery 30 β 345.68 ms β 355.59 ms β no change β
β QQuery 31 β 313.38 ms β 314.19 ms β no change β
β QQuery 32 β 977.84 ms β 1091.35 ms β 1.12x slower β
β QQuery 33 β 1519.37 ms β 1523.11 ms β no change β
β QQuery 34 β 1671.57 ms β 1597.28 ms β no change β
β QQuery 35 β 356.41 ms β 337.14 ms β +1.06x faster β
β QQuery 36 β 78.30 ms β 69.37 ms β +1.13x faster β
β QQuery 37 β 39.54 ms β 35.98 ms β +1.10x faster β
β QQuery 38 β 48.79 ms β 43.32 ms β +1.13x faster β
β QQuery 39 β 180.92 ms β 142.32 ms β +1.27x faster β
β QQuery 40 β 16.68 ms β 14.54 ms β +1.15x faster β
β QQuery 41 β 15.63 ms β 14.26 ms β +1.10x faster β
β QQuery 42 β 15.10 ms β 13.70 ms β +1.10x faster β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 20560.09ms β
β Total Time (rich-T-kid_coacler-benchmark) β 20236.49ms β
β Average Time (HEAD) β 478.14ms β
β Average Time (rich-T-kid_coacler-benchmark) β 470.62ms β
β Queries Faster β 18 β
β Queries Slower β 1 β
β Queries with No Change β 24 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.42 / 4.38 Β±5.69 / 15.77 ms β 1.49 / 4.52 Β±5.88 / 16.29 ms β no change β
β QQuery 1 β 12.16 / 12.41 Β±0.14 / 12.56 ms β 12.23 / 12.32 Β±0.09 / 12.46 ms β no change β
β QQuery 2 β 38.00 / 38.37 Β±0.51 / 39.33 ms β 37.65 / 37.81 Β±0.17 / 38.11 ms β no change β
β QQuery 3 β 32.59 / 33.67 Β±0.75 / 34.60 ms β 33.12 / 33.23 Β±0.10 / 33.39 ms β no change β
β QQuery 4 β 267.07 / 277.27 Β±8.10 / 289.07 ms β 257.83 / 266.14 Β±6.10 / 275.76 ms β no change β
β QQuery 5 β 304.97 / 317.52 Β±7.52 / 327.34 ms β 285.50 / 289.55 Β±2.88 / 294.48 ms β +1.10x faster β
β QQuery 6 β 1.70 / 1.88 Β±0.16 / 2.16 ms β 1.31 / 1.47 Β±0.26 / 1.97 ms β +1.28x faster β
β QQuery 7 β 14.39 / 14.49 Β±0.08 / 14.62 ms β 13.79 / 13.89 Β±0.12 / 14.08 ms β no change β
β QQuery 8 β 399.95 / 424.28 Β±13.03 / 437.35 ms β 343.57 / 354.69 Β±9.57 / 368.12 ms β +1.20x faster β
β QQuery 9 β 554.68 / 570.16 Β±13.35 / 592.55 ms β 497.62 / 522.24 Β±20.08 / 553.25 ms β +1.09x faster β
β QQuery 10 β 71.53 / 74.49 Β±4.71 / 83.88 ms β 70.40 / 70.79 Β±0.27 / 71.07 ms β no change β
β QQuery 11 β 83.84 / 88.22 Β±7.54 / 103.26 ms β 80.93 / 82.62 Β±1.33 / 84.69 ms β +1.07x faster β
β QQuery 12 β 324.42 / 335.46 Β±13.15 / 359.92 ms β 306.37 / 314.59 Β±7.31 / 326.97 ms β +1.07x faster β
β QQuery 13 β 417.89 / 441.25 Β±13.37 / 458.60 ms β 401.14 / 421.67 Β±13.50 / 442.30 ms β no change β
β QQuery 14 β 325.33 / 330.26 Β±5.76 / 341.22 ms β 305.65 / 317.64 Β±13.10 / 336.94 ms β no change β
β QQuery 15 β 336.24 / 346.90 Β±7.52 / 358.52 ms β 310.00 / 318.79 Β±7.20 / 328.24 ms β +1.09x faster β
β QQuery 16 β 713.37 / 726.14 Β±12.30 / 742.78 ms β 658.38 / 669.11 Β±7.96 / 679.31 ms β +1.09x faster β
β QQuery 17 β 670.22 / 690.65 Β±24.02 / 737.70 ms β 697.53 / 725.03 Β±15.79 / 741.64 ms β no change β
β QQuery 18 β 1362.97 / 1457.32 Β±49.99 / 1509.17 ms β 1363.63 / 1489.64 Β±123.21 / 1722.87 ms β no change β
β QQuery 19 β 29.68 / 38.60 Β±15.81 / 70.20 ms β 28.13 / 34.95 Β±11.51 / 57.75 ms β +1.10x faster β
β QQuery 20 β 531.32 / 546.81 Β±16.57 / 577.59 ms β 519.68 / 526.68 Β±5.68 / 534.57 ms β no change β
β QQuery 21 β 527.08 / 535.50 Β±4.66 / 540.48 ms β 519.61 / 532.91 Β±7.17 / 538.73 ms β no change β
β QQuery 22 β 1005.42 / 1020.88 Β±9.72 / 1029.90 ms β 1027.04 / 1037.42 Β±7.81 / 1047.95 ms β no change β
β QQuery 23 β 3203.41 / 3283.97 Β±55.88 / 3376.62 ms β 3196.40 / 3308.75 Β±69.09 / 3369.75 ms β no change β
β QQuery 24 β 43.13 / 51.46 Β±10.99 / 71.68 ms β 40.92 / 48.00 Β±7.44 / 59.48 ms β +1.07x faster β
β QQuery 25 β 108.82 / 119.80 Β±20.08 / 159.93 ms β 105.86 / 111.74 Β±9.81 / 131.30 ms β +1.07x faster β
β QQuery 26 β 41.51 / 45.92 Β±6.42 / 58.52 ms β 41.11 / 42.79 Β±1.72 / 45.94 ms β +1.07x faster β
β QQuery 27 β 531.66 / 538.67 Β±7.90 / 553.49 ms β 519.56 / 525.66 Β±4.53 / 531.41 ms β no change β
β QQuery 28 β 2981.48 / 3027.21 Β±32.90 / 3078.70 ms β 2964.05 / 3042.63 Β±44.81 / 3088.10 ms β no change β
β QQuery 29 β 44.65 / 68.18 Β±18.97 / 91.03 ms β 43.83 / 56.98 Β±7.72 / 66.49 ms β +1.20x faster β
β QQuery 30 β 345.68 / 366.32 Β±13.95 / 379.71 ms β 355.59 / 366.13 Β±7.14 / 373.72 ms β no change β
β QQuery 31 β 313.38 / 335.20 Β±29.81 / 392.30 ms β 314.19 / 338.66 Β±20.69 / 362.77 ms β no change β
β QQuery 32 β 977.84 / 1038.73 Β±52.25 / 1108.44 ms β 1091.35 / 1142.42 Β±53.31 / 1240.06 ms β 1.10x slower β
β QQuery 33 β 1519.37 / 1622.26 Β±70.18 / 1712.68 ms β 1523.11 / 1654.18 Β±68.37 / 1708.52 ms β no change β
β QQuery 34 β 1671.57 / 1722.46 Β±40.85 / 1771.09 ms β 1597.28 / 1675.88 Β±46.89 / 1738.32 ms β no change β
β QQuery 35 β 356.41 / 441.13 Β±125.48 / 689.17 ms β 337.14 / 384.28 Β±67.13 / 514.12 ms β +1.15x faster β
β QQuery 36 β 78.30 / 82.14 Β±2.27 / 85.01 ms β 69.37 / 73.63 Β±2.95 / 77.91 ms β +1.12x faster β
β QQuery 37 β 39.54 / 46.50 Β±10.00 / 65.96 ms β 35.98 / 37.72 Β±2.81 / 43.32 ms β +1.23x faster β
β QQuery 38 β 48.79 / 51.72 Β±2.84 / 56.09 ms β 43.32 / 45.42 Β±2.12 / 49.33 ms β +1.14x faster β
β QQuery 39 β 180.92 / 193.82 Β±20.83 / 235.12 ms β 142.32 / 152.19 Β±7.23 / 162.25 ms β +1.27x faster β
β QQuery 40 β 16.68 / 17.12 Β±0.45 / 17.92 ms β 14.54 / 14.79 Β±0.15 / 14.99 ms β +1.16x faster β
β QQuery 41 β 15.63 / 15.93 Β±0.20 / 16.22 ms β 14.26 / 14.35 Β±0.10 / 14.53 ms β +1.11x faster β
β QQuery 42 β 15.10 / 15.27 Β±0.15 / 15.53 ms β 13.70 / 16.42 Β±3.14 / 21.11 ms β 1.08x slower β
βββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 21410.74ms β
β Total Time (rich-T-kid_coacler-benchmark) β 21130.33ms β
β Average Time (HEAD) β 497.92ms β
β Average Time (rich-T-kid_coacler-benchmark) β 491.40ms β
β Queries Faster β 20 β
β Queries Slower β 2 β
β Queries with No Change β 21 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**clickbench_partitioned β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 110.0s |
| Peak memory | 10.0 GiB |
| Avg memory | 4.3 GiB |
| CPU user | 1087.7s |
| CPU sys | 84.0s |
| Peak spill | 0 B |
**clickbench_partitioned β branch**
| Metric | Value |
|--------|-------|
| Wall time | 110.0s |
| Peak memory | 12.0 GiB |
| Avg memory | 4.5 GiB |
| CPU user | 1077.4s |
| CPU sys | 82.5s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739408505
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739390843)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5739390843-2466-bwzcl 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745474466
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745457304)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5745457304-2502-sd4fl 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745457778
run benchmarks
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: 256
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746603297
run benchmarks
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: 256
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739782409
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739768539)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5739768539-2478-swlx2 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (dbfc4e87e81f5ae40f150fa37700863a165cd991) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..dbfc4e87e81f5ae40f150fa37700863a165cd991)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739779419
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739768539)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5739768539-2477-rwgnj 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (dbfc4e87e81f5ae40f150fa37700863a165cd991) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..dbfc4e87e81f5ae40f150fa37700863a165cd991)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739463462
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739391357)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³βββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.21 ms β 1.20 ms β no change β
β QQuery 1 β 11.58 ms β 11.62 ms β no change β
β QQuery 2 β 36.84 ms β 37.30 ms β no change β
β QQuery 3 β 31.27 ms β 31.14 ms β no change β
β QQuery 4 β 242.20 ms β 239.57 ms β no change β
β QQuery 5 β 273.93 ms β 277.41 ms β no change β
β QQuery 6 β 1.28 ms β 1.29 ms β no change β
β QQuery 7 β 13.17 ms β 13.24 ms β no change β
β QQuery 8 β 336.31 ms β 339.00 ms β no change β
β QQuery 9 β 470.96 ms β 482.87 ms β no change β
β QQuery 10 β 63.43 ms β 65.82 ms β no change β
β QQuery 11 β 75.03 ms β 74.46 ms β no change β
β QQuery 12 β 266.70 ms β 262.95 ms β no change β
β QQuery 13 β 369.91 ms β 378.56 ms β no change β
β QQuery 14 β 281.80 ms β 282.48 ms β no change β
β QQuery 15 β 293.94 ms β 297.96 ms β no change β
β QQuery 16 β 630.50 ms β 635.71 ms β no change β
β QQuery 17 β 648.20 ms β 633.69 ms β no change β
β QQuery 18 β 1291.80 ms β 1327.82 ms β no change β
β QQuery 19 β 28.26 ms β 28.12 ms β no change β
β QQuery 20 β 510.37 ms β 521.28 ms β no change β
β QQuery 21 β 512.27 ms β 511.94 ms β no change β
β QQuery 22 β 981.84 ms β 987.75 ms β no change β
β QQuery 23 β 3137.24 ms β 3094.60 ms β no change β
β QQuery 24 β 40.00 ms β 40.23 ms β no change β
β QQuery 25 β 104.67 ms β 105.10 ms β no change β
β QQuery 26 β 40.70 ms β 40.54 ms β no change β
β QQuery 27 β 502.70 ms β 512.52 ms β no change β
β QQuery 28 β 2912.98 ms β 2942.87 ms β no change β
β QQuery 29 β 41.59 ms β 42.28 ms β no change β
β QQuery 30 β 317.94 ms β 324.50 ms β no change β
β QQuery 31 β 276.52 ms β 290.77 ms β 1.05x slower β
β QQuery 32 β 957.75 ms β 999.62 ms β no change β
β QQuery 33 β 1496.12 ms β 1517.48 ms β no change β
β QQuery 34 β 1511.32 ms β 1554.56 ms β no change β
β QQuery 35 β 300.76 ms β 309.09 ms β no change β
β QQuery 36 β 72.66 ms β 71.34 ms β no change β
β QQuery 37 β 36.22 ms β 36.69 ms β no change β
β QQuery 38 β 41.86 ms β 41.69 ms β no change β
β QQuery 39 β 148.98 ms β 156.29 ms β no change β
β QQuery 40 β 15.07 ms β 14.41 ms β no change β
β QQuery 41 β 14.74 ms β 14.90 ms β no change β
β QQuery 42 β 13.07 ms β 13.45 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄βββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 19355.69ms β
β Total Time (rich-T-kid_coacler-benchmark) β 19566.11ms β
β Average Time (HEAD) β 450.13ms β
β Average Time (rich-T-kid_coacler-benchmark) β 455.03ms β
β Queries Faster β 0 β
β Queries Slower β 1 β
β Queries with No Change β 42 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.21 / 4.14 Β±5.67 / 15.48 ms β 1.20 / 3.98 Β±5.41 / 14.79 ms β no change β
β QQuery 1 β 11.58 / 11.94 Β±0.31 / 12.31 ms β 11.62 / 11.91 Β±0.17 / 12.15 ms β no change β
β QQuery 2 β 36.84 / 37.57 Β±0.61 / 38.24 ms β 37.30 / 37.73 Β±0.26 / 37.96 ms β no change β
β QQuery 3 β 31.27 / 31.75 Β±0.53 / 32.77 ms β 31.14 / 31.35 Β±0.24 / 31.73 ms β no change β
β QQuery 4 β 242.20 / 246.66 Β±4.67 / 253.85 ms β 239.57 / 246.03 Β±5.84 / 255.67 ms β no change β
β QQuery 5 β 273.93 / 283.49 Β±8.96 / 297.86 ms β 277.41 / 284.45 Β±4.61 / 288.52 ms β no change β
β QQuery 6 β 1.28 / 1.44 Β±0.25 / 1.93 ms β 1.29 / 1.44 Β±0.23 / 1.90 ms β no change β
β QQuery 7 β 13.17 / 15.23 Β±3.21 / 21.63 ms β 13.24 / 14.51 Β±2.27 / 19.05 ms β no change β
β QQuery 8 β 336.31 / 349.93 Β±10.36 / 365.96 ms β 339.00 / 354.48 Β±8.55 / 361.79 ms β no change β
β QQuery 9 β 470.96 / 487.68 Β±12.34 / 506.41 ms β 482.87 / 493.45 Β±9.92 / 510.80 ms β no change β
β QQuery 10 β 63.43 / 68.35 Β±7.72 / 83.70 ms β 65.82 / 71.35 Β±10.62 / 92.58 ms β no change β
β QQuery 11 β 75.03 / 76.00 Β±1.01 / 77.84 ms β 74.46 / 76.29 Β±1.29 / 77.86 ms β no change β
β QQuery 12 β 266.70 / 271.69 Β±3.24 / 276.35 ms β 262.95 / 278.91 Β±12.34 / 300.19 ms β no change β
β QQuery 13 β 369.91 / 391.06 Β±13.49 / 406.87 ms β 378.56 / 391.21 Β±15.65 / 422.07 ms β no change β
β QQuery 14 β 281.80 / 290.60 Β±5.12 / 296.73 ms β 282.48 / 296.87 Β±12.72 / 320.20 ms β no change β
β QQuery 15 β 293.94 / 300.10 Β±5.52 / 310.40 ms β 297.96 / 306.71 Β±6.53 / 317.79 ms β no change β
β QQuery 16 β 630.50 / 644.41 Β±7.61 / 652.19 ms β 635.71 / 661.83 Β±23.80 / 699.31 ms β no change β
β QQuery 17 β 648.20 / 661.63 Β±11.56 / 678.73 ms β 633.69 / 659.33 Β±15.07 / 673.94 ms β no change β
β QQuery 18 β 1291.80 / 1318.06 Β±15.63 / 1334.33 ms β 1327.82 / 1341.50 Β±9.57 / 1354.40 ms β no change β
β QQuery 19 β 28.26 / 39.48 Β±14.25 / 62.93 ms β 28.12 / 29.25 Β±0.69 / 30.15 ms β +1.35x faster β
β QQuery 20 β 510.37 / 522.44 Β±7.97 / 533.51 ms β 521.28 / 529.39 Β±7.32 / 542.38 ms β no change β
β QQuery 21 β 512.27 / 514.96 Β±2.37 / 519.03 ms β 511.94 / 521.11 Β±8.99 / 538.15 ms β no change β
β QQuery 22 β 981.84 / 994.95 Β±10.52 / 1007.21 ms β 987.75 / 1004.65 Β±18.79 / 1041.28 ms β no change β
β QQuery 23 β 3137.24 / 3158.45 Β±15.93 / 3183.99 ms β 3094.60 / 3114.28 Β±23.68 / 3155.95 ms β no change β
β QQuery 24 β 40.00 / 41.08 Β±0.97 / 42.77 ms β 40.23 / 44.35 Β±4.47 / 50.40 ms β 1.08x slower β
β QQuery 25 β 104.67 / 111.16 Β±6.65 / 122.49 ms β 105.10 / 109.08 Β±3.62 / 113.90 ms β no change β
β QQuery 26 β 40.70 / 42.18 Β±1.62 / 45.09 ms β 40.54 / 42.51 Β±2.82 / 47.98 ms β no change β
β QQuery 27 β 502.70 / 518.18 Β±8.71 / 527.16 ms β 512.52 / 517.12 Β±3.56 / 522.04 ms β no change β
β QQuery 28 β 2912.98 / 2941.96 Β±19.09 / 2968.85 ms β 2942.87 / 2970.99 Β±20.35 / 2993.93 ms β no change β
β QQuery 29 β 41.59 / 42.23 Β±0.43 / 42.76 ms β 42.28 / 57.73 Β±13.86 / 77.82 ms β 1.37x slower β
β QQuery 30 β 317.94 / 327.65 Β±9.08 / 344.65 ms β 324.50 / 329.07 Β±3.96 / 335.80 ms β no change β
β QQuery 31 β 276.52 / 289.54 Β±7.17 / 295.68 ms β 290.77 / 297.89 Β±6.40 / 307.89 ms β no change β
β QQuery 32 β 957.75 / 995.67 Β±20.34 / 1014.53 ms β 999.62 / 1023.15 Β±26.55 / 1073.57 ms β no change β
β QQuery 33 β 1496.12 / 1544.25 Β±28.28 / 1574.86 ms β 1517.48 / 1529.71 Β±9.68 / 1540.14 ms β no change β
β QQuery 34 β 1511.32 / 1539.02 Β±16.24 / 1562.16 ms β 1554.56 / 1599.78 Β±32.44 / 1651.37 ms β no change β
β QQuery 35 β 300.76 / 319.83 Β±17.33 / 351.39 ms β 309.09 / 348.82 Β±50.20 / 446.36 ms β 1.09x slower β
β QQuery 36 β 72.66 / 78.55 Β±3.48 / 83.36 ms β 71.34 / 75.63 Β±2.87 / 80.16 ms β no change β
β QQuery 37 β 36.22 / 41.54 Β±4.62 / 47.31 ms β 36.69 / 40.12 Β±3.68 / 46.20 ms β no change β
β QQuery 38 β 41.86 / 42.99 Β±0.70 / 43.75 ms β 41.69 / 46.42 Β±5.40 / 56.14 ms β 1.08x slower β
β QQuery 39 β 148.98 / 159.71 Β±6.38 / 165.81 ms β 156.29 / 166.96 Β±11.11 / 186.40 ms β no change β
β QQuery 40 β 15.07 / 15.89 Β±0.71 / 16.99 ms β 14.41 / 17.96 Β±6.03 / 29.98 ms β 1.13x slower β
β QQuery 41 β 14.74 / 15.13 Β±0.37 / 15.69 ms β 14.90 / 16.18 Β±1.09 / 17.52 ms β 1.07x slower β
β QQuery 42 β 13.07 / 14.94 Β±2.69 / 20.27 ms β 13.45 / 14.35 Β±0.56 / 15.12 ms β no change β
βββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 19803.54ms β
β Total Time (rich-T-kid_coacler-benchmark) β 20009.85ms β
β Average Time (HEAD) β 460.55ms β
β Average Time (rich-T-kid_coacler-benchmark) β 465.35ms β
β Queries Faster β 1 β
β Queries Slower β 6 β
β Queries with No Change β 36 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**clickbench_partitioned β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 100.0s |
| Peak memory | 10.6 GiB |
| Avg memory | 4.6 GiB |
| CPU user | 1018.9s |
| CPU sys | 70.7s |
| Peak spill | 0 B |
**clickbench_partitioned β branch**
| Metric | Value |
|--------|-------|
| Wall time | 105.0s |
| Peak memory | 12.0 GiB |
| Avg memory | 4.5 GiB |
| CPU user | 1019.2s |
| CPU sys | 73.4s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739463087
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739390843)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.22 ms β 1.26 ms β no change β
β QQuery 1 β 11.59 ms β 11.73 ms β no change β
β QQuery 2 β 36.70 ms β 37.56 ms β no change β
β QQuery 3 β 30.97 ms β 32.58 ms β 1.05x slower β
β QQuery 4 β 233.97 ms β 236.28 ms β no change β
β QQuery 5 β 278.93 ms β 273.47 ms β no change β
β QQuery 6 β 1.37 ms β 1.35 ms β no change β
β QQuery 7 β 13.47 ms β 13.81 ms β no change β
β QQuery 8 β 343.76 ms β 326.99 ms β no change β
β QQuery 9 β 467.77 ms β 468.65 ms β no change β
β QQuery 10 β 64.30 ms β 63.61 ms β no change β
β QQuery 11 β 75.52 ms β 74.54 ms β no change β
β QQuery 12 β 256.14 ms β 266.46 ms β no change β
β QQuery 13 β 360.06 ms β 363.73 ms β no change β
β QQuery 14 β 295.16 ms β 278.01 ms β +1.06x faster β
β QQuery 15 β 278.72 ms β 280.79 ms β no change β
β QQuery 16 β 623.74 ms β 621.66 ms β no change β
β QQuery 17 β 624.88 ms β 622.84 ms β no change β
β QQuery 18 β 1264.71 ms β 1263.91 ms β no change β
β QQuery 19 β 27.38 ms β 27.43 ms β no change β
β QQuery 20 β 518.81 ms β 520.47 ms β no change β
β QQuery 21 β 505.31 ms β 506.70 ms β no change β
β QQuery 22 β 981.16 ms β 977.75 ms β no change β
β QQuery 23 β 3063.00 ms β 3037.44 ms β no change β
β QQuery 24 β 40.14 ms β 41.75 ms β no change β
β QQuery 25 β 103.98 ms β 103.83 ms β no change β
β QQuery 26 β 40.63 ms β 40.62 ms β no change β
β QQuery 27 β 508.54 ms β 523.80 ms β no change β
β QQuery 28 β 2914.37 ms β 2930.68 ms β no change β
β QQuery 29 β 41.29 ms β 41.71 ms β no change β
β QQuery 30 β 320.88 ms β 304.60 ms β +1.05x faster β
β QQuery 31 β 284.01 ms β 272.27 ms β no change β
β QQuery 32 β 960.44 ms β 955.86 ms β no change β
β QQuery 33 β 1448.99 ms β 1445.50 ms β no change β
β QQuery 34 β 1475.05 ms β 1489.05 ms β no change β
β QQuery 35 β 342.99 ms β 289.25 ms β +1.19x faster β
β QQuery 36 β 69.62 ms β 67.94 ms β no change β
β QQuery 37 β 38.25 ms β 35.46 ms β +1.08x faster β
β QQuery 38 β 44.29 ms β 45.12 ms β no change β
β QQuery 39 β 147.55 ms β 136.93 ms β +1.08x faster β
β QQuery 40 β 15.64 ms β 13.98 ms β +1.12x faster β
β QQuery 41 β 15.15 ms β 13.47 ms β +1.12x faster β
β QQuery 42 β 14.75 ms β 13.12 ms β +1.12x faster β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 19185.19ms β
β Total Time (rich-T-kid_coacler-benchmark) β 19073.97ms β
β Average Time (HEAD) β 446.17ms β
β Average Time (rich-T-kid_coacler-benchmark) β 443.58ms β
β Queries Faster β 8 β
β Queries Slower β 1 β
β Queries with No Change β 34 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.22 / 4.00 Β±5.45 / 14.91 ms β 1.26 / 3.99 Β±5.38 / 14.74 ms β no change β
β QQuery 1 β 11.59 / 11.86 Β±0.28 / 12.41 ms β 11.73 / 12.44 Β±0.43 / 12.94 ms β no change β
β QQuery 2 β 36.70 / 36.94 Β±0.21 / 37.23 ms β 37.56 / 37.91 Β±0.31 / 38.47 ms β no change β
β QQuery 3 β 30.97 / 31.54 Β±0.57 / 32.47 ms β 32.58 / 33.24 Β±0.55 / 33.97 ms β 1.05x slower β
β QQuery 4 β 233.97 / 238.49 Β±4.20 / 245.11 ms β 236.28 / 271.11 Β±17.84 / 283.65 ms β 1.14x slower β
β QQuery 5 β 278.93 / 289.65 Β±5.64 / 294.32 ms β 273.47 / 289.53 Β±13.11 / 305.03 ms β no change β
β QQuery 6 β 1.37 / 1.54 Β±0.25 / 2.01 ms β 1.35 / 1.52 Β±0.22 / 1.96 ms β no change β
β QQuery 7 β 13.47 / 13.86 Β±0.21 / 14.07 ms β 13.81 / 14.06 Β±0.18 / 14.30 ms β no change β
β QQuery 8 β 343.76 / 351.99 Β±10.47 / 371.86 ms β 326.99 / 343.07 Β±19.57 / 381.33 ms β no change β
β QQuery 9 β 467.77 / 479.62 Β±8.85 / 491.61 ms β 468.65 / 484.96 Β±26.70 / 538.12 ms β no change β
β QQuery 10 β 64.30 / 67.74 Β±4.10 / 75.22 ms β 63.61 / 67.18 Β±5.89 / 78.88 ms β no change β
β QQuery 11 β 75.52 / 75.74 Β±0.27 / 76.26 ms β 74.54 / 75.40 Β±0.67 / 76.16 ms β no change β
β QQuery 12 β 256.14 / 266.24 Β±6.19 / 273.82 ms β 266.46 / 286.01 Β±11.09 / 297.54 ms β 1.07x slower β
β QQuery 13 β 360.06 / 368.99 Β±11.71 / 392.14 ms β 363.73 / 384.02 Β±14.33 / 401.57 ms β no change β
β QQuery 14 β 295.16 / 298.70 Β±2.94 / 303.56 ms β 278.01 / 287.22 Β±7.11 / 295.81 ms β no change β
β QQuery 15 β 278.72 / 294.33 Β±17.36 / 323.24 ms β 280.79 / 293.95 Β±10.19 / 307.62 ms β no change β
β QQuery 16 β 623.74 / 644.53 Β±13.24 / 659.05 ms β 621.66 / 639.00 Β±18.46 / 672.23 ms β no change β
β QQuery 17 β 624.88 / 630.08 Β±6.18 / 641.97 ms β 622.84 / 645.96 Β±15.15 / 667.35 ms β no change β
β QQuery 18 β 1264.71 / 1284.47 Β±22.04 / 1324.40 ms β 1263.91 / 1325.37 Β±51.64 / 1407.31 ms β no change β
β QQuery 19 β 27.38 / 27.77 Β±0.41 / 28.46 ms β 27.43 / 28.57 Β±0.77 / 29.44 ms β no change β
β QQuery 20 β 518.81 / 527.77 Β±8.89 / 538.51 ms β 520.47 / 528.96 Β±8.56 / 542.09 ms β no change β
β QQuery 21 β 505.31 / 516.86 Β±7.78 / 526.63 ms β 506.70 / 514.75 Β±5.43 / 520.04 ms β no change β
β QQuery 22 β 981.16 / 1015.01 Β±20.24 / 1035.10 ms β 977.75 / 980.95 Β±2.33 / 983.38 ms β no change β
β QQuery 23 β 3063.00 / 3164.94 Β±81.33 / 3280.34 ms β 3037.44 / 3106.34 Β±52.70 / 3178.31 ms β no change β
β QQuery 24 β 40.14 / 45.80 Β±8.49 / 62.70 ms β 41.75 / 42.63 Β±0.71 / 43.74 ms β +1.07x faster β
β QQuery 25 β 103.98 / 105.87 Β±2.32 / 110.20 ms β 103.83 / 106.45 Β±2.48 / 110.42 ms β no change β
β QQuery 26 β 40.63 / 41.35 Β±0.84 / 42.72 ms β 40.62 / 43.23 Β±2.58 / 47.66 ms β no change β
β QQuery 27 β 508.54 / 522.92 Β±11.30 / 540.71 ms β 523.80 / 533.71 Β±7.29 / 545.74 ms β no change β
β QQuery 28 β 2914.37 / 2930.26 Β±14.73 / 2951.84 ms β 2930.68 / 2989.57 Β±38.97 / 3035.54 ms β no change β
β QQuery 29 β 41.29 / 41.84 Β±0.68 / 43.12 ms β 41.71 / 48.29 Β±12.35 / 72.98 ms β 1.15x slower β
β QQuery 30 β 320.88 / 331.65 Β±8.28 / 345.04 ms β 304.60 / 314.54 Β±6.67 / 323.06 ms β +1.05x faster β
β QQuery 31 β 284.01 / 290.72 Β±4.75 / 297.85 ms β 272.27 / 287.32 Β±10.48 / 302.17 ms β no change β
β QQuery 32 β 960.44 / 1007.07 Β±41.71 / 1074.64 ms β 955.86 / 973.82 Β±18.73 / 1006.88 ms β no change β
β QQuery 33 β 1448.99 / 1496.36 Β±24.91 / 1514.60 ms β 1445.50 / 1517.31 Β±50.48 / 1584.65 ms β no change β
β QQuery 34 β 1475.05 / 1531.13 Β±51.25 / 1617.49 ms β 1489.05 / 1531.55 Β±41.88 / 1598.96 ms β no change β
β QQuery 35 β 342.99 / 355.11 Β±10.05 / 366.87 ms β 289.25 / 315.20 Β±17.80 / 335.39 ms β +1.13x faster β
β QQuery 36 β 69.62 / 78.14 Β±6.42 / 84.94 ms β 67.94 / 70.30 Β±1.80 / 72.81 ms β +1.11x faster β
β QQuery 37 β 38.25 / 41.01 Β±2.38 / 44.31 ms β 35.46 / 40.11 Β±3.11 / 43.88 ms β no change β
β QQuery 38 β 44.29 / 46.94 Β±2.43 / 51.11 ms β 45.12 / 49.77 Β±3.38 / 54.59 ms β 1.06x slower β
β QQuery 39 β 147.55 / 169.27 Β±11.26 / 178.13 ms β 136.93 / 158.72 Β±14.15 / 174.44 ms β +1.07x faster β
β QQuery 40 β 15.64 / 17.86 Β±2.03 / 21.56 ms β 13.98 / 15.94 Β±3.45 / 22.83 ms β +1.12x faster β
β QQuery 41 β 15.15 / 15.52 Β±0.20 / 15.72 ms β 13.47 / 13.76 Β±0.23 / 14.15 ms β +1.13x faster β
β QQuery 42 β 14.75 / 14.92 Β±0.11 / 15.07 ms β 13.12 / 15.65 Β±4.54 / 24.71 ms β no change β
βββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 19726.40ms β
β Total Time (rich-T-kid_coacler-benchmark) β 19723.39ms β
β Average Time (HEAD) β 458.75ms β
β Average Time (rich-T-kid_coacler-benchmark) β 458.68ms β
β Queries Faster β 7 β
β Queries Slower β 5 β
β Queries with No Change β 31 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**clickbench_partitioned β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 100.0s |
| Peak memory | 10.8 GiB |
| Avg memory | 4.2 GiB |
| CPU user | 1006.5s |
| CPU sys | 73.2s |
| Peak spill | 0 B |
**clickbench_partitioned β branch**
| Metric | Value |
|--------|-------|
| Wall time | 100.0s |
| Peak memory | 12.2 GiB |
| Avg memory | 4.8 GiB |
| CPU user | 1004.4s |
| CPU sys | 72.8s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5743228749
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5743214675)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5743214675-2487-mp67t 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745564226
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745546566)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5745546566-2508-5nbz6 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745546566
run benchmarks
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: 256
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746455684
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5746435338)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5746435338-2514-24kf8 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (50b4aadf9bd59b1681e8c222be535966e84155d7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..50b4aadf9bd59b1681e8c222be535966e84155d7)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5736766135
run benchmarks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5743278526
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5743214675)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 5.59 ms β 5.46 ms β no change β
β QQuery 2 β 80.33 ms β 80.96 ms β no change β
β QQuery 3 β 28.67 ms β 29.09 ms β no change β
β QQuery 4 β 451.20 ms β 452.87 ms β no change β
β QQuery 5 β 51.00 ms β 50.68 ms β no change β
β QQuery 6 β 35.09 ms β 35.19 ms β no change β
β QQuery 7 β 74.02 ms β 73.87 ms β no change β
β QQuery 8 β 35.85 ms β 36.37 ms β no change β
β QQuery 9 β 51.32 ms β 50.71 ms β no change β
β QQuery 10 β 61.15 ms β 61.68 ms β no change β
β QQuery 11 β 279.88 ms β 278.64 ms β no change β
β QQuery 12 β 28.88 ms β 28.61 ms β no change β
β QQuery 13 β 116.40 ms β 117.11 ms β no change β
β QQuery 14 β 391.42 ms β 391.50 ms β no change β
β QQuery 15 β 53.04 ms β 53.13 ms β no change β
β QQuery 16 β 6.46 ms β 6.30 ms β no change β
β QQuery 17 β 78.14 ms β 77.68 ms β no change β
β QQuery 18 β 103.57 ms β 104.14 ms β no change β
β QQuery 19 β 41.62 ms β 41.35 ms β no change β
β QQuery 20 β 35.19 ms β 34.93 ms β no change β
β QQuery 21 β 16.94 ms β 16.92 ms β no change β
β QQuery 22 β 64.11 ms β 62.83 ms β no change β
β QQuery 23 β 311.32 ms β 315.49 ms β no change β
β QQuery 24 β 193.67 ms β 193.25 ms β no change β
β QQuery 25 β 108.07 ms β 106.77 ms β no change β
β QQuery 26 β 47.64 ms β 48.43 ms β no change β
β QQuery 27 β 5.85 ms β 6.09 ms β no change β
β QQuery 28 β 61.02 ms β 60.47 ms β no change β
β QQuery 29 β 93.85 ms β 95.11 ms β no change β
β QQuery 30 β 32.76 ms β 33.13 ms β no change β
β QQuery 31 β 108.61 ms β 108.98 ms β no change β
β QQuery 32 β 20.93 ms β 20.53 ms β no change β
β QQuery 33 β 37.25 ms β 37.61 ms β no change β
β QQuery 34 β 10.44 ms β 10.29 ms β no change β
β QQuery 35 β 71.67 ms β 71.90 ms β no change β
β QQuery 36 β 5.83 ms β 5.55 ms β no change β
β QQuery 37 β 6.83 ms β 6.55 ms β no change β
β QQuery 38 β 61.17 ms β 60.19 ms β no change β
β QQuery 39 β 73.54 ms β 73.47 ms β no change β
β QQuery 40 β 23.39 ms β 23.56 ms β no change β
β QQuery 41 β 11.15 ms β 10.67 ms β no change β
β QQuery 42 β 23.50 ms β 24.07 ms β no change β
β QQuery 43 β 5.00 ms β 5.14 ms β no change β
β QQuery 44 β 9.11 ms β 9.23 ms β no change β
β QQuery 45 β 37.06 ms β 36.84 ms β no change β
β QQuery 46 β 11.44 ms β 11.86 ms β no change β
β QQuery 47 β 224.80 ms β 224.37 ms β no change β
β QQuery 48 β 93.89 ms β 94.73 ms β no change β
β QQuery 49 β 69.56 ms β 70.78 ms β no change β
β QQuery 50 β 57.80 ms β 58.82 ms β no change β
β QQuery 51 β 94.11 ms β 93.54 ms β no change β
β QQuery 52 β 24.35 ms β 24.06 ms β no change β
β QQuery 53 β 29.46 ms β 29.07 ms β no change β
β QQuery 54 β 53.81 ms β 53.47 ms β no change β
β QQuery 55 β 23.45 ms β 23.49 ms β no change β
β QQuery 56 β 38.31 ms β 38.30 ms β no change β
β QQuery 57 β 167.90 ms β 168.09 ms β no change β
β QQuery 58 β 108.33 ms β 109.07 ms β no change β
β QQuery 59 β 116.05 ms β 116.29 ms β no change β
β QQuery 60 β 38.14 ms β 39.04 ms β no change β
β QQuery 61 β 11.61 ms β 11.56 ms β no change β
β QQuery 62 β 44.12 ms β 44.18 ms β no change β
β QQuery 63 β 29.61 ms β 29.32 ms β no change β
β QQuery 64 β 356.78 ms β 354.61 ms β no change β
β QQuery 65 β 127.97 ms β 128.17 ms β no change β
β QQuery 66 β 76.72 ms β 77.74 ms β no change β
β QQuery 67 β 250.89 ms β 247.35 ms β no change β
β QQuery 68 β 11.96 ms β 12.07 ms β no change β
β QQuery 69 β 56.10 ms β 55.95 ms β no change β
β QQuery 70 β 103.62 ms β 103.26 ms β no change β
β QQuery 71 β 35.18 ms β 35.57 ms β no change β
β QQuery 72 β 1722.86 ms β 1716.52 ms β no change β
β QQuery 73 β 10.15 ms β 9.78 ms β no change β
β QQuery 74 β 159.59 ms β 158.60 ms β no change β
β QQuery 75 β 142.32 ms β 141.66 ms β no change β
β QQuery 76 β 34.58 ms β 34.68 ms β no change β
β QQuery 77 β 60.79 ms β 60.43 ms β no change β
β QQuery 78 β 161.31 ms β 161.92 ms β no change β
β QQuery 79 β 65.85 ms β 65.80 ms β no change β
β QQuery 80 β 95.68 ms β 96.70 ms β no change β
β QQuery 81 β 26.15 ms β 25.99 ms β no change β
β QQuery 82 β 16.76 ms β 16.27 ms β no change β
β QQuery 83 β 33.93 ms β 33.48 ms β no change β
β QQuery 84 β 29.75 ms β 29.63 ms β no change β
β QQuery 85 β 103.48 ms β 99.88 ms β no change β
β QQuery 86 β 25.96 ms β 25.27 ms β no change β
β QQuery 87 β 61.75 ms β 61.32 ms β no change β
β QQuery 88 β 61.65 ms β 61.25 ms β no change β
β QQuery 89 β 35.69 ms β 35.00 ms β no change β
β QQuery 90 β 17.00 ms β 17.03 ms β no change β
β QQuery 91 β 44.90 ms β 44.60 ms β no change β
β QQuery 92 β 29.94 ms β 30.00 ms β no change β
β QQuery 93 β 48.96 ms β 50.79 ms β no change β
β QQuery 94 β 38.74 ms β 38.04 ms β no change β
β QQuery 95 β 79.53 ms β 81.61 ms β no change β
β QQuery 96 β 24.07 ms β 23.91 ms β no change β
β QQuery 97 β 51.40 ms β 51.57 ms β no change β
β QQuery 98 β 42.81 ms β 42.44 ms β no change β
β QQuery 99 β 66.27 ms β 65.60 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 8997.35ms β
β Total Time (rich-T-kid_coacler-benchmark) β 8987.91ms β
β Average Time (HEAD) β 90.88ms β
β Average Time (rich-T-kid_coacler-benchmark) β 90.79ms β
β Queries Faster β 0 β
β Queries Slower β 0 β
β Queries with No Change β 99 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³βββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 5.59 / 6.15 Β±0.99 / 8.12 ms β 5.46 / 6.07 Β±1.02 / 8.08 ms β no change β
β QQuery 2 β 80.33 / 80.90 Β±0.29 / 81.14 ms β 80.96 / 81.28 Β±0.23 / 81.55 ms β no change β
β QQuery 3 β 28.67 / 29.13 Β±0.48 / 30.00 ms β 29.09 / 29.41 Β±0.20 / 29.61 ms β no change β
β QQuery 4 β 451.20 / 454.20 Β±2.23 / 457.35 ms β 452.87 / 455.82 Β±1.71 / 457.43 ms β no change β
β QQuery 5 β 51.00 / 52.71 Β±2.04 / 56.66 ms β 50.68 / 51.55 Β±1.01 / 53.53 ms β no change β
β QQuery 6 β 35.09 / 35.40 Β±0.28 / 35.91 ms β 35.19 / 35.50 Β±0.16 / 35.63 ms β no change β
β QQuery 7 β 74.02 / 74.49 Β±0.43 / 75.25 ms β 73.87 / 74.67 Β±0.50 / 75.29 ms β no change β
β QQuery 8 β 35.85 / 36.20 Β±0.20 / 36.44 ms β 36.37 / 36.54 Β±0.18 / 36.83 ms β no change β
β QQuery 9 β 51.32 / 55.52 Β±3.70 / 62.22 ms β 50.71 / 53.60 Β±2.19 / 56.65 ms β no change β
β QQuery 10 β 61.15 / 61.52 Β±0.35 / 62.14 ms β 61.68 / 61.79 Β±0.10 / 61.94 ms β no change β
β QQuery 11 β 279.88 / 282.23 Β±1.63 / 284.30 ms β 278.64 / 283.33 Β±3.65 / 288.33 ms β no change β
β QQuery 12 β 28.88 / 29.10 Β±0.19 / 29.39 ms β 28.61 / 28.95 Β±0.23 / 29.21 ms β no change β
β QQuery 13 β 116.40 / 117.65 Β±1.42 / 120.38 ms β 117.11 / 119.59 Β±3.02 / 125.30 ms β no change β
β QQuery 14 β 391.42 / 397.93 Β±3.64 / 401.89 ms β 391.50 / 396.05 Β±4.42 / 403.15 ms β no change β
β QQuery 15 β 53.04 / 53.86 Β±0.49 / 54.58 ms β 53.13 / 53.81 Β±0.77 / 55.18 ms β no change β
β QQuery 16 β 6.46 / 6.60 Β±0.19 / 6.97 ms β 6.30 / 6.53 Β±0.23 / 6.95 ms β no change β
β QQuery 17 β 78.14 / 80.25 Β±3.24 / 86.68 ms β 77.68 / 78.55 Β±0.59 / 79.29 ms β no change β
β QQuery 18 β 103.57 / 104.08 Β±0.32 / 104.49 ms β 104.14 / 105.36 Β±1.39 / 108.06 ms β no change β
β QQuery 19 β 41.62 / 42.11 Β±0.34 / 42.62 ms β 41.35 / 41.56 Β±0.20 / 41.83 ms β no change β
β QQuery 20 β 35.19 / 36.10 Β±0.63 / 37.14 ms β 34.93 / 35.30 Β±0.34 / 35.79 ms β no change β
β QQuery 21 β 16.94 / 17.11 Β±0.10 / 17.19 ms β 16.92 / 17.22 Β±0.16 / 17.38 ms β no change β
β QQuery 22 β 64.11 / 64.95 Β±1.23 / 67.40 ms β 62.83 / 64.13 Β±0.73 / 65.02 ms β no change β
β QQuery 23 β 311.32 / 312.87 Β±1.38 / 315.45 ms β 315.49 / 318.85 Β±3.64 / 325.92 ms β no change β
β QQuery 24 β 193.67 / 200.93 Β±5.93 / 211.69 ms β 193.25 / 197.90 Β±4.01 / 205.34 ms β no change β
β QQuery 25 β 108.07 / 108.77 Β±0.81 / 110.12 ms β 106.77 / 110.40 Β±3.68 / 116.77 ms β no change β
β QQuery 26 β 47.64 / 48.10 Β±0.33 / 48.50 ms β 48.43 / 48.75 Β±0.31 / 49.30 ms β no change β
β QQuery 27 β 5.85 / 6.14 Β±0.24 / 6.53 ms β 6.09 / 6.27 Β±0.16 / 6.53 ms β no change β
β QQuery 28 β 61.02 / 61.23 Β±0.19 / 61.55 ms β 60.47 / 61.44 Β±0.62 / 62.28 ms β no change β
β QQuery 29 β 93.85 / 98.34 Β±5.87 / 109.84 ms β 95.11 / 97.77 Β±3.20 / 103.76 ms β no change β
β QQuery 30 β 32.76 / 32.90 Β±0.15 / 33.18 ms β 33.13 / 33.41 Β±0.25 / 33.84 ms β no change β
β QQuery 31 β 108.61 / 111.26 Β±2.30 / 114.42 ms β 108.98 / 109.50 Β±0.61 / 110.48 ms β no change β
β QQuery 32 β 20.93 / 21.13 Β±0.17 / 21.32 ms β 20.53 / 23.29 Β±4.65 / 32.56 ms β 1.10x slower β
β QQuery 33 β 37.25 / 37.88 Β±0.52 / 38.78 ms β 37.61 / 38.26 Β±0.59 / 39.29 ms β no change β
β QQuery 34 β 10.44 / 10.57 Β±0.09 / 10.68 ms β 10.29 / 10.54 Β±0.21 / 10.85 ms β no change β
β QQuery 35 β 71.67 / 73.36 Β±1.22 / 75.22 ms β 71.90 / 72.90 Β±0.59 / 73.65 ms β no change β
β QQuery 36 β 5.83 / 5.97 Β±0.19 / 6.32 ms β 5.55 / 5.70 Β±0.16 / 6.00 ms β no change β
β QQuery 37 β 6.83 / 6.96 Β±0.10 / 7.10 ms β 6.55 / 6.68 Β±0.10 / 6.83 ms β no change β
β QQuery 38 β 61.17 / 62.00 Β±0.48 / 62.43 ms β 60.19 / 61.24 Β±0.70 / 62.21 ms β no change β
β QQuery 39 β 73.54 / 74.27 Β±0.56 / 75.13 ms β 73.47 / 73.79 Β±0.25 / 74.17 ms β no change β
β QQuery 40 β 23.39 / 24.36 Β±1.00 / 26.27 ms β 23.56 / 23.98 Β±0.28 / 24.45 ms β no change β
β QQuery 41 β 11.15 / 11.40 Β±0.14 / 11.55 ms β 10.67 / 10.90 Β±0.19 / 11.21 ms β no change β
β QQuery 42 β 23.50 / 23.88 Β±0.37 / 24.50 ms β 24.07 / 24.58 Β±0.35 / 25.12 ms β no change β
β QQuery 43 β 5.00 / 5.14 Β±0.19 / 5.52 ms β 5.14 / 5.31 Β±0.23 / 5.77 ms β no change β
β QQuery 44 β 9.11 / 9.28 Β±0.12 / 9.48 ms β 9.23 / 9.29 Β±0.04 / 9.35 ms β no change β
β QQuery 45 β 37.06 / 38.97 Β±2.06 / 42.98 ms β 36.84 / 38.31 Β±0.81 / 39.35 ms β no change β
β QQuery 46 β 11.44 / 11.95 Β±0.33 / 12.37 ms β 11.86 / 13.50 Β±2.58 / 18.53 ms β 1.13x slower β
β QQuery 47 β 224.80 / 227.69 Β±1.57 / 229.13 ms β 224.37 / 229.10 Β±4.49 / 236.75 ms β no change β
β QQuery 48 β 93.89 / 94.34 Β±0.37 / 94.86 ms β 94.73 / 95.66 Β±0.78 / 96.76 ms β no change β
β QQuery 49 β 69.56 / 72.98 Β±5.06 / 83.03 ms β 70.78 / 72.77 Β±3.20 / 79.10 ms β no change β
β QQuery 50 β 57.80 / 58.12 Β±0.31 / 58.62 ms β 58.82 / 59.72 Β±0.82 / 60.95 ms β no change β
β QQuery 51 β 94.11 / 95.41 Β±0.84 / 96.77 ms β 93.54 / 94.68 Β±1.11 / 96.00 ms β no change β
β QQuery 52 β 24.35 / 24.54 Β±0.10 / 24.65 ms β 24.06 / 24.39 Β±0.21 / 24.69 ms β no change β
β QQuery 53 β 29.46 / 31.30 Β±3.04 / 37.35 ms β 29.07 / 31.57 Β±4.56 / 40.68 ms β no change β
β QQuery 54 β 53.81 / 54.59 Β±0.60 / 55.25 ms β 53.47 / 54.77 Β±0.80 / 56.01 ms β no change β
β QQuery 55 β 23.45 / 24.05 Β±0.41 / 24.66 ms β 23.49 / 23.97 Β±0.51 / 24.90 ms β no change β
β QQuery 56 β 38.31 / 39.08 Β±0.58 / 40.07 ms β 38.30 / 38.72 Β±0.35 / 39.10 ms β no change β
β QQuery 57 β 167.90 / 169.67 Β±1.14 / 170.97 ms β 168.09 / 170.06 Β±1.90 / 173.01 ms β no change β
β QQuery 58 β 108.33 / 110.40 Β±2.09 / 114.18 ms β 109.07 / 111.17 Β±3.38 / 117.85 ms β no change β
β QQuery 59 β 116.05 / 116.68 Β±0.53 / 117.54 ms β 116.29 / 116.83 Β±0.50 / 117.59 ms β no change β
β QQuery 60 β 38.14 / 38.95 Β±0.56 / 39.88 ms β 39.04 / 39.80 Β±0.44 / 40.31 ms β no change β
β QQuery 61 β 11.61 / 11.81 Β±0.19 / 12.15 ms β 11.56 / 11.70 Β±0.18 / 12.01 ms β no change β
β QQuery 62 β 44.12 / 46.30 Β±2.92 / 52.03 ms β 44.18 / 45.57 Β±2.50 / 50.57 ms β no change β
β QQuery 63 β 29.61 / 29.95 Β±0.27 / 30.28 ms β 29.32 / 29.62 Β±0.21 / 29.86 ms β no change β
β QQuery 64 β 356.78 / 360.75 Β±2.98 / 365.60 ms β 354.61 / 362.93 Β±6.13 / 373.52 ms β no change β
β QQuery 65 β 127.97 / 130.61 Β±2.15 / 133.20 ms β 128.17 / 130.79 Β±1.60 / 132.82 ms β no change β
β QQuery 66 β 76.72 / 78.18 Β±2.28 / 82.68 ms β 77.74 / 80.04 Β±4.11 / 88.25 ms β no change β
β QQuery 67 β 250.89 / 256.64 Β±6.34 / 269.01 ms β 247.35 / 251.52 Β±4.01 / 259.07 ms β no change β
β QQuery 68 β 11.96 / 12.06 Β±0.10 / 12.18 ms β 12.07 / 12.28 Β±0.16 / 12.55 ms β no change β
β QQuery 69 β 56.10 / 56.44 Β±0.43 / 57.16 ms β 55.95 / 56.82 Β±0.90 / 58.40 ms β no change β
β QQuery 70 β 103.62 / 106.60 Β±3.42 / 111.96 ms β 103.26 / 108.13 Β±8.99 / 126.11 ms β no change β
β QQuery 71 β 35.18 / 35.69 Β±0.26 / 35.89 ms β 35.57 / 36.17 Β±0.51 / 36.92 ms β no change β
β QQuery 72 β 1722.86 / 1779.90 Β±56.82 / 1885.69 ms β 1716.52 / 1810.93 Β±65.65 / 1889.95 ms β no change β
β QQuery 73 β 10.15 / 10.77 Β±0.70 / 11.99 ms β 9.78 / 10.73 Β±0.61 / 11.63 ms β no change β
β QQuery 74 β 159.59 / 162.94 Β±2.52 / 166.44 ms β 158.60 / 163.55 Β±3.56 / 169.41 ms β no change β
β QQuery 75 β 142.32 / 143.19 Β±1.26 / 145.69 ms β 141.66 / 143.23 Β±1.13 / 145.04 ms β no change β
β QQuery 76 β 34.58 / 35.02 Β±0.34 / 35.56 ms β 34.68 / 35.29 Β±0.60 / 36.28 ms β no change β
β QQuery 77 β 60.79 / 61.47 Β±0.78 / 62.77 ms β 60.43 / 61.25 Β±0.97 / 63.00 ms β no change β
β QQuery 78 β 161.31 / 164.94 Β±2.00 / 166.95 ms β 161.92 / 167.67 Β±8.02 / 183.56 ms β no change β
β QQuery 79 β 65.85 / 67.02 Β±1.57 / 70.07 ms β 65.80 / 66.98 Β±1.55 / 69.96 ms β no change β
β QQuery 80 β 95.68 / 96.74 Β±0.65 / 97.71 ms β 96.70 / 99.60 Β±2.99 / 104.42 ms β no change β
β QQuery 81 β 26.15 / 26.51 Β±0.25 / 26.82 ms β 25.99 / 26.36 Β±0.30 / 26.91 ms β no change β
β QQuery 82 β 16.76 / 16.96 Β±0.15 / 17.21 ms β 16.27 / 16.67 Β±0.23 / 16.92 ms β no change β
β QQuery 83 β 33.93 / 34.19 Β±0.22 / 34.58 ms β 33.48 / 34.51 Β±1.00 / 36.27 ms β no change β
β QQuery 84 β 29.75 / 30.48 Β±0.90 / 32.21 ms β 29.63 / 29.82 Β±0.18 / 30.05 ms β no change β
β QQuery 85 β 103.48 / 106.15 Β±2.06 / 108.63 ms β 99.88 / 104.18 Β±6.59 / 117.31 ms β no change β
β QQuery 86 β 25.96 / 26.48 Β±0.42 / 27.02 ms β 25.27 / 25.94 Β±0.47 / 26.56 ms β no change β
β QQuery 87 β 61.75 / 63.10 Β±0.93 / 64.09 ms β 61.32 / 61.87 Β±0.58 / 62.94 ms β no change β
β QQuery 88 β 61.65 / 61.88 Β±0.18 / 62.15 ms β 61.25 / 61.68 Β±0.39 / 62.39 ms β no change β
β QQuery 89 β 35.69 / 36.00 Β±0.38 / 36.73 ms β 35.00 / 36.59 Β±1.67 / 39.78 ms β no change β
β QQuery 90 β 17.00 / 17.25 Β±0.14 / 17.40 ms β 17.03 / 17.16 Β±0.10 / 17.28 ms β no change β
β QQuery 91 β 44.90 / 45.41 Β±0.35 / 45.98 ms β 44.60 / 44.85 Β±0.21 / 45.23 ms β no change β
β QQuery 92 β 29.94 / 30.57 Β±0.62 / 31.70 ms β 30.00 / 30.30 Β±0.31 / 30.90 ms β no change β
β QQuery 93 β 48.96 / 49.83 Β±0.80 / 51.13 ms β 50.79 / 51.70 Β±0.51 / 52.33 ms β no change β
β QQuery 94 β 38.74 / 39.17 Β±0.23 / 39.39 ms β 38.04 / 40.20 Β±3.31 / 46.77 ms β no change β
β QQuery 95 β 79.53 / 82.67 Β±2.83 / 87.96 ms β 81.61 / 82.66 Β±0.69 / 83.50 ms β no change β
β QQuery 96 β 24.07 / 24.24 Β±0.15 / 24.47 ms β 23.91 / 24.21 Β±0.25 / 24.67 ms β no change β
β QQuery 97 β 51.40 / 52.84 Β±1.28 / 54.97 ms β 51.57 / 53.36 Β±1.51 / 55.69 ms β no change β
β QQuery 98 β 42.81 / 43.12 Β±0.36 / 43.78 ms β 42.44 / 44.29 Β±2.29 / 48.74 ms β no change β
β QQuery 99 β 66.27 / 67.56 Β±1.74 / 71.01 ms β 65.60 / 66.04 Β±0.31 / 66.44 ms β no change β
βββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 9175.02ms β
β Total Time (rich-T-kid_coacler-benchmark) β 9219.61ms β
β Average Time (HEAD) β 92.68ms β
β Average Time (rich-T-kid_coacler-benchmark) β 93.13ms β
β Queries Faster β 0 β
β Queries Slower β 2 β
β Queries with No Change β 97 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpcds β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 50.0s |
| Peak memory | 2.2 GiB |
| Avg memory | 1.5 GiB |
| CPU user | 195.2s |
| CPU sys | 5.4s |
| Peak spill | 0 B |
**tpcds β branch**
| Metric | Value |
|--------|-------|
| Wall time | 50.0s |
| Peak memory | 2.1 GiB |
| Avg memory | 1.4 GiB |
| CPU user | 200.6s |
| CPU sys | 6.4s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746620914
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5746603297)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5746603297-2519-znslm 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (ef7543e040ffbfe7da6bd2c2b70bd2db2721cac7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ef7543e040ffbfe7da6bd2c2b70bd2db2721cac7)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746607186
run benchmark tpch_mem10
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5743238473
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5743214675)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5743214675-2489-twpnt 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5743214143
run benchmarks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745471050
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745457778)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5745457778-2504-whftg 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745457304
run benchmarks
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: 256
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746667013
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5746603297)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (ef7543e040ffbfe7da6bd2c2b70bd2db2721cac7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ef7543e040ffbfe7da6bd2c2b70bd2db2721cac7)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.50 ms β 1.48 ms β no change β
β QQuery 1 β 23.62 ms β 26.98 ms β 1.14x slower β
β QQuery 2 β 46.97 ms β 46.80 ms β no change β
β QQuery 3 β 39.49 ms β 38.15 ms β no change β
β QQuery 4 β 239.13 ms β 302.46 ms β 1.26x slower β
β QQuery 5 β 317.88 ms β 353.00 ms β 1.11x slower β
β QQuery 6 β 1.58 ms β 1.58 ms β no change β
β QQuery 7 β 61.84 ms β 56.85 ms β +1.09x faster β
β QQuery 8 β 374.84 ms β 457.01 ms β 1.22x slower β
β QQuery 9 β 410.84 ms β 388.99 ms β +1.06x faster β
β QQuery 10 β 146.65 ms β 148.09 ms β no change β
β QQuery 11 β 160.72 ms β 159.97 ms β no change β
β QQuery 12 β 308.31 ms β 352.45 ms β 1.14x slower β
β QQuery 13 β 541.08 ms β 668.23 ms β 1.23x slower β
β QQuery 14 β 302.39 ms β 351.93 ms β 1.16x slower β
β QQuery 15 β 279.54 ms β 360.42 ms β 1.29x slower β
β QQuery 16 β 608.93 ms β 764.98 ms β 1.26x slower β
β QQuery 17 β 561.65 ms β 727.74 ms β 1.30x slower β
β QQuery 18 β 1119.22 ms β 1509.63 ms β 1.35x slower β
β QQuery 19 β 39.89 ms β 37.77 ms β +1.06x faster β
β QQuery 20 β 525.51 ms β 510.39 ms β no change β
β QQuery 21 β 555.58 ms β 545.14 ms β no change β
β QQuery 22 β 1051.50 ms β 1014.13 ms β no change β
β QQuery 23 β 1728.05 ms β 1555.83 ms β +1.11x faster β
β QQuery 24 β 46.70 ms β 46.91 ms β no change β
β QQuery 25 β 110.97 ms β 116.46 ms β no change β
β QQuery 26 β 45.58 ms β 46.51 ms β no change β
β QQuery 27 β 538.25 ms β 536.39 ms β no change β
β QQuery 28 β 2827.67 ms β 2800.36 ms β no change β
β QQuery 29 β 55.23 ms β 53.99 ms β no change β
β QQuery 30 β 334.94 ms β 367.30 ms β 1.10x slower β
β QQuery 31 β 367.88 ms β 436.86 ms β 1.19x slower β
β QQuery 32 β 1123.21 ms β 1750.20 ms β 1.56x slower β
β QQuery 33 β 1448.18 ms β 1620.14 ms β 1.12x slower β
β QQuery 34 β 1473.45 ms β 1609.62 ms β 1.09x slower β
β QQuery 35 β 258.67 ms β 334.99 ms β 1.30x slower β
β QQuery 36 β 119.23 ms β 112.71 ms β +1.06x faster β
β QQuery 37 β 81.80 ms β 82.43 ms β no change β
β QQuery 38 β 89.34 ms β 87.44 ms β no change β
β QQuery 39 β 206.52 ms β 177.69 ms β +1.16x faster β
β QQuery 40 β 64.72 ms β 61.68 ms β no change β
β QQuery 41 β 66.14 ms β 57.82 ms β +1.14x faster β
β QQuery 42 β 60.80 ms β 61.84 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 18766.02ms β
β Total Time (rich-T-kid_coacler-benchmark) β 20741.34ms β
β Average Time (HEAD) β 436.42ms β
β Average Time (rich-T-kid_coacler-benchmark) β 482.36ms β
β Queries Faster β 7 β
β Queries Slower β 17 β
β Queries with No Change β 19 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.50 / 4.23 Β±5.39 / 15.01 ms β 1.48 / 4.24 Β±5.44 / 15.12 ms β no change β
β QQuery 1 β 23.62 / 26.92 Β±2.59 / 30.12 ms β 26.98 / 28.04 Β±0.87 / 29.47 ms β no change β
β QQuery 2 β 46.97 / 49.42 Β±1.49 / 50.72 ms β 46.80 / 49.78 Β±1.93 / 52.47 ms β no change β
β QQuery 3 β 39.49 / 41.64 Β±1.36 / 43.28 ms β 38.15 / 40.22 Β±1.83 / 42.98 ms β no change β
β QQuery 4 β 239.13 / 243.54 Β±3.19 / 248.75 ms β 302.46 / 307.96 Β±3.65 / 313.55 ms β 1.26x slower β
β QQuery 5 β 317.88 / 327.93 Β±13.22 / 354.12 ms β 353.00 / 359.42 Β±6.08 / 368.44 ms β 1.10x slower β
β QQuery 6 β 1.58 / 1.80 Β±0.33 / 2.44 ms β 1.58 / 1.79 Β±0.31 / 2.40 ms β no change β
β QQuery 7 β 61.84 / 64.66 Β±3.18 / 70.83 ms β 56.85 / 59.12 Β±1.75 / 61.28 ms β +1.09x faster β
β QQuery 8 β 374.84 / 381.54 Β±7.53 / 395.82 ms β 457.01 / 461.10 Β±3.39 / 465.03 ms β 1.21x slower β
β QQuery 9 β 410.84 / 420.98 Β±7.75 / 430.99 ms β 388.99 / 411.75 Β±11.93 / 421.59 ms β no change β
β QQuery 10 β 146.65 / 155.14 Β±8.33 / 167.13 ms β 148.09 / 150.66 Β±2.23 / 154.15 ms β no change β
β QQuery 11 β 160.72 / 162.13 Β±1.53 / 164.02 ms β 159.97 / 165.94 Β±8.17 / 182.05 ms β no change β
β QQuery 12 β 308.31 / 319.96 Β±13.12 / 344.41 ms β 352.45 / 360.30 Β±7.03 / 372.35 ms β 1.13x slower β
β QQuery 13 β 541.08 / 550.79 Β±6.33 / 557.81 ms β 668.23 / 676.40 Β±9.90 / 691.21 ms β 1.23x slower β
β QQuery 14 β 302.39 / 308.32 Β±6.60 / 320.34 ms β 351.93 / 366.02 Β±13.44 / 387.06 ms β 1.19x slower β
β QQuery 15 β 279.54 / 294.66 Β±15.47 / 319.18 ms β 360.42 / 370.32 Β±8.11 / 383.81 ms β 1.26x slower β
β QQuery 16 β 608.93 / 613.74 Β±4.62 / 620.87 ms β 764.98 / 825.40 Β±57.12 / 919.49 ms β 1.34x slower β
β QQuery 17 β 561.65 / 583.10 Β±15.38 / 598.05 ms β 727.74 / 763.66 Β±37.14 / 828.50 ms β 1.31x slower β
β QQuery 18 β 1119.22 / 1175.12 Β±39.12 / 1239.48 ms β 1509.63 / 1613.63 Β±122.79 / 1841.67 ms β 1.37x slower β
β QQuery 19 β 39.89 / 42.24 Β±3.36 / 48.81 ms β 37.77 / 42.23 Β±3.14 / 46.82 ms β no change β
β QQuery 20 β 525.51 / 573.61 Β±38.80 / 643.10 ms β 510.39 / 549.28 Β±51.97 / 649.43 ms β no change β
β QQuery 21 β 555.58 / 574.73 Β±13.92 / 596.03 ms β 545.14 / 571.83 Β±18.42 / 599.13 ms β no change β
β QQuery 22 β 1051.50 / 1082.70 Β±43.57 / 1168.79 ms β 1014.13 / 1095.63 Β±73.81 / 1227.77 ms β no change β
β QQuery 23 β 1728.05 / 1801.96 Β±70.91 / 1892.47 ms β 1555.83 / 1694.43 Β±141.51 / 1943.85 ms β +1.06x faster β
β QQuery 24 β 46.70 / 53.45 Β±7.81 / 68.69 ms β 46.91 / 58.69 Β±14.44 / 87.02 ms β 1.10x slower β
β QQuery 25 β 110.97 / 130.22 Β±26.04 / 181.48 ms β 116.46 / 129.35 Β±14.74 / 157.35 ms β no change β
β QQuery 26 β 45.58 / 54.27 Β±5.80 / 63.73 ms β 46.51 / 52.32 Β±3.85 / 57.89 ms β no change β
β QQuery 27 β 538.25 / 552.22 Β±9.93 / 562.71 ms β 536.39 / 562.01 Β±24.54 / 607.11 ms β no change β
β QQuery 28 β 2827.67 / 2863.82 Β±31.03 / 2920.01 ms β 2800.36 / 2872.05 Β±58.66 / 2964.28 ms β no change β
β QQuery 29 β 55.23 / 62.92 Β±7.16 / 75.72 ms β 53.99 / 68.91 Β±18.90 / 105.99 ms β 1.10x slower β
β QQuery 30 β 334.94 / 357.46 Β±17.14 / 384.59 ms β 367.30 / 387.91 Β±12.96 / 407.23 ms β 1.09x slower β
β QQuery 31 β 367.88 / 382.03 Β±11.00 / 400.91 ms β 436.86 / 456.50 Β±14.33 / 476.45 ms β 1.19x slower β
β QQuery 32 β 1123.21 / 1207.98 Β±103.17 / 1405.79 ms β 1750.20 / 1843.05 Β±115.22 / 2067.89 ms β 1.53x slower β
β QQuery 33 β 1448.18 / 1497.09 Β±30.76 / 1536.37 ms β 1620.14 / 1835.77 Β±162.58 / 2103.50 ms β 1.23x slower β
β QQuery 34 β 1473.45 / 1629.44 Β±186.42 / 1993.38 ms β 1609.62 / 1654.81 Β±40.80 / 1729.68 ms β no change β
β QQuery 35 β 258.67 / 365.16 Β±191.80 / 748.38 ms β 334.99 / 457.30 Β±201.52 / 858.24 ms β 1.25x slower β
β QQuery 36 β 119.23 / 130.53 Β±14.42 / 158.23 ms β 112.71 / 123.63 Β±7.61 / 136.00 ms β +1.06x faster β
β QQuery 37 β 81.80 / 89.34 Β±8.50 / 105.35 ms β 82.43 / 86.80 Β±6.81 / 100.36 ms β no change β
β QQuery 38 β 89.34 / 97.59 Β±11.08 / 119.28 ms β 87.44 / 99.62 Β±17.25 / 133.52 ms β no change β
β QQuery 39 β 206.52 / 217.67 Β±8.73 / 231.43 ms β 177.69 / 196.85 Β±10.91 / 210.92 ms β +1.11x faster β
β QQuery 40 β 64.72 / 71.55 Β±6.73 / 81.91 ms β 61.68 / 65.43 Β±3.74 / 71.97 ms β +1.09x faster β
β QQuery 41 β 66.14 / 72.80 Β±8.35 / 88.78 ms β 57.82 / 59.94 Β±1.22 / 61.31 ms β +1.21x faster β
β QQuery 42 β 60.80 / 64.78 Β±4.51 / 73.00 ms β 61.84 / 71.67 Β±8.94 / 83.85 ms β 1.11x slower β
βββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 19701.19ms β
β Total Time (rich-T-kid_coacler-benchmark) β 22051.74ms β
β Average Time (HEAD) β 458.17ms β
β Average Time (rich-T-kid_coacler-benchmark) β 512.83ms β
β Queries Faster β 6 β
β Queries Slower β 18 β
β Queries with No Change β 19 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**clickbench_partitioned β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 100.0s |
| Peak memory | 15.1 GiB |
| Avg memory | 8.2 GiB |
| CPU user | 926.4s |
| CPU sys | 94.7s |
| Peak spill | 0 B |
**clickbench_partitioned β branch**
| Metric | Value |
|--------|-------|
| Wall time | 115.0s |
| Peak memory | 15.7 GiB |
| Avg memory | 7.8 GiB |
| CPU user | 1063.1s |
| CPU sys | 98.5s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746647585
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5746603297)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (ef7543e040ffbfe7da6bd2c2b70bd2db2721cac7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ef7543e040ffbfe7da6bd2c2b70bd2db2721cac7)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³ββββββββββββ³βββββββββββββββββββββββββββββββ³βββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 90.08 ms β 89.97 ms β no change β
β QQuery 2 β 95.28 ms β 92.37 ms β no change β
β QQuery 3 β 87.43 ms β 87.28 ms β no change β
β QQuery 4 β 68.29 ms β 66.79 ms β no change β
β QQuery 5 β 93.35 ms β 94.80 ms β no change β
β QQuery 6 β 31.54 ms β 30.04 ms β no change β
β QQuery 7 β 266.74 ms β 288.11 ms β 1.08x slower β
β QQuery 8 β 264.95 ms β 275.80 ms β no change β
β QQuery 9 β 388.25 ms β 415.10 ms β 1.07x slower β
β QQuery 10 β 97.43 ms β 102.16 ms β no change β
β QQuery 11 β 89.07 ms β 91.13 ms β no change β
β QQuery 12 β 370.49 ms β 368.19 ms β no change β
β QQuery 13 β 133.08 ms β 128.59 ms β no change β
β QQuery 14 β 49.49 ms β 51.98 ms β 1.05x slower β
β QQuery 15 β 145.04 ms β 140.65 ms β no change β
β QQuery 16 β 119.77 ms β 117.11 ms β no change β
β QQuery 17 β 228.74 ms β 272.19 ms β 1.19x slower β
β QQuery 18 β 366.44 ms β 479.73 ms β 1.31x slower β
β QQuery 19 β 55.33 ms β 56.08 ms β no change β
β QQuery 20 β 107.50 ms β 109.67 ms β no change β
β QQuery 21 β 137.88 ms β 131.22 ms β no change β
β QQuery 22 β 89.82 ms β 90.74 ms β no change β
βββββββββββββ΄ββββββββββββ΄βββββββββββββββββββββββββββββββ΄βββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 3376.01ms β
β Total Time (rich-T-kid_coacler-benchmark) β 3579.72ms β
β Average Time (HEAD) β 153.46ms β
β Average Time (rich-T-kid_coacler-benchmark) β 162.71ms β
β Queries Faster β 0 β
β Queries Slower β 5 β
β Queries with No Change β 17 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 90.08 / 91.99 Β±2.25 / 96.31 ms β 89.97 / 91.66 Β±2.31 / 96.24 ms β no change β
β QQuery 2 β 95.28 / 100.84 Β±2.82 / 102.77 ms β 92.37 / 97.27 Β±4.30 / 103.35 ms β no change β
β QQuery 3 β 87.43 / 90.38 Β±2.42 / 92.80 ms β 87.28 / 92.71 Β±2.84 / 95.06 ms β no change β
β QQuery 4 β 68.29 / 68.89 Β±0.61 / 69.80 ms β 66.79 / 69.22 Β±2.21 / 72.84 ms β no change β
β QQuery 5 β 93.35 / 94.80 Β±0.89 / 95.95 ms β 94.80 / 98.40 Β±3.16 / 103.31 ms β no change β
β QQuery 6 β 31.54 / 32.18 Β±0.53 / 32.79 ms β 30.04 / 31.81 Β±1.03 / 32.81 ms β no change β
β QQuery 7 β 266.74 / 270.34 Β±3.23 / 276.23 ms β 288.11 / 302.38 Β±19.60 / 341.26 ms β 1.12x slower β
β QQuery 8 β 264.95 / 277.62 Β±9.95 / 293.86 ms β 275.80 / 285.66 Β±13.56 / 312.49 ms β no change β
β QQuery 9 β 388.25 / 393.96 Β±5.10 / 403.52 ms β 415.10 / 441.25 Β±26.95 / 483.20 ms β 1.12x slower β
β QQuery 10 β 97.43 / 101.14 Β±2.88 / 106.10 ms β 102.16 / 115.04 Β±14.69 / 142.91 ms β 1.14x slower β
β QQuery 11 β 89.07 / 95.31 Β±6.93 / 108.64 ms β 91.13 / 94.18 Β±1.95 / 96.60 ms β no change β
β QQuery 12 β 370.49 / 380.45 Β±6.85 / 391.74 ms β 368.19 / 380.68 Β±10.80 / 400.45 ms β no change β
β QQuery 13 β 133.08 / 140.90 Β±7.90 / 153.37 ms β 128.59 / 137.08 Β±8.85 / 154.23 ms β no change β
β QQuery 14 β 49.49 / 51.23 Β±1.73 / 53.60 ms β 51.98 / 58.97 Β±7.66 / 71.11 ms β 1.15x slower β
β QQuery 15 β 145.04 / 153.63 Β±6.29 / 164.49 ms β 140.65 / 147.85 Β±5.16 / 156.73 ms β no change β
β QQuery 16 β 119.77 / 123.79 Β±6.88 / 137.48 ms β 117.11 / 121.13 Β±4.30 / 129.20 ms β no change β
β QQuery 17 β 228.74 / 232.29 Β±2.84 / 236.91 ms β 272.19 / 285.78 Β±7.57 / 295.17 ms β 1.23x slower β
β QQuery 18 β 366.44 / 374.02 Β±6.12 / 385.04 ms β 479.73 / 512.89 Β±25.95 / 559.58 ms β 1.37x slower β
β QQuery 19 β 55.33 / 56.73 Β±1.05 / 58.53 ms β 56.08 / 57.72 Β±1.65 / 60.77 ms β no change β
β QQuery 20 β 107.50 / 119.80 Β±19.61 / 158.91 ms β 109.67 / 116.12 Β±9.30 / 134.52 ms β no change β
β QQuery 21 β 137.88 / 142.23 Β±3.44 / 146.20 ms β 131.22 / 143.89 Β±10.74 / 163.63 ms β no change β
β QQuery 22 β 89.82 / 99.29 Β±6.73 / 107.99 ms β 90.74 / 93.34 Β±2.17 / 97.33 ms β +1.06x faster β
βββββββββββββ΄βββββββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 3491.79ms β
β Total Time (rich-T-kid_coacler-benchmark) β 3775.03ms β
β Average Time (HEAD) β 158.72ms β
β Average Time (rich-T-kid_coacler-benchmark) β 171.59ms β
β Queries Faster β 1 β
β Queries Slower β 6 β
β Queries with No Change β 15 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpch β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 20.0s |
| Peak memory | 2.5 GiB |
| Avg memory | 1.0 GiB |
| CPU user | 109.2s |
| CPU sys | 9.6s |
| Peak spill | 0 B |
**tpch β branch**
| Metric | Value |
|--------|-------|
| Wall time | 20.0s |
| Peak memory | 2.2 GiB |
| Avg memory | 1.1 GiB |
| CPU user | 114.9s |
| CPU sys | 10.5s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739492011
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739398003)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 41.76 ms β 41.01 ms β no change β
β QQuery 2 β 19.13 ms β 18.96 ms β no change β
β QQuery 3 β 29.08 ms β 29.00 ms β no change β
β QQuery 4 β 17.92 ms β 17.72 ms β no change β
β QQuery 5 β 36.77 ms β 36.09 ms β no change β
β QQuery 6 β 16.47 ms β 16.55 ms β no change β
β QQuery 7 β 42.20 ms β 40.83 ms β no change β
β QQuery 8 β 40.60 ms β 40.52 ms β no change β
β QQuery 9 β 50.23 ms β 50.46 ms β no change β
β QQuery 10 β 41.24 ms β 41.17 ms β no change β
β QQuery 11 β 14.14 ms β 13.90 ms β no change β
β QQuery 12 β 21.38 ms β 21.11 ms β no change β
β QQuery 13 β 41.16 ms β 41.26 ms β no change β
β QQuery 14 β 25.05 ms β 24.78 ms β no change β
β QQuery 15 β 31.42 ms β 31.31 ms β no change β
β QQuery 16 β 14.50 ms β 14.22 ms β no change β
β QQuery 17 β 74.96 ms β 68.92 ms β +1.09x faster β
β QQuery 18 β 61.45 ms β 62.78 ms β no change β
β QQuery 19 β 32.54 ms β 32.05 ms β no change β
β QQuery 20 β 32.61 ms β 31.86 ms β no change β
β QQuery 21 β 56.89 ms β 54.96 ms β no change β
β QQuery 22 β 14.63 ms β 14.06 ms β no change β
βββββββββββββ΄βββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 756.12ms β
β Total Time (rich-T-kid_coacler-benchmark) β 743.50ms β
β Average Time (HEAD) β 34.37ms β
β Average Time (rich-T-kid_coacler-benchmark) β 33.80ms β
β Queries Faster β 1 β
β Queries Slower β 0 β
β Queries with No Change β 21 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 41.76 / 42.69 Β±0.68 / 43.31 ms β 41.01 / 42.67 Β±1.41 / 44.64 ms β no change β
β QQuery 2 β 19.13 / 19.42 Β±0.38 / 20.15 ms β 18.96 / 19.24 Β±0.24 / 19.64 ms β no change β
β QQuery 3 β 29.08 / 29.31 Β±0.17 / 29.52 ms β 29.00 / 29.41 Β±0.29 / 29.73 ms β no change β
β QQuery 4 β 17.92 / 18.22 Β±0.41 / 19.03 ms β 17.72 / 18.14 Β±0.71 / 19.57 ms β no change β
β QQuery 5 β 36.77 / 37.92 Β±1.37 / 40.28 ms β 36.09 / 37.40 Β±1.45 / 39.89 ms β no change β
β QQuery 6 β 16.47 / 16.74 Β±0.17 / 16.95 ms β 16.55 / 16.68 Β±0.11 / 16.84 ms β no change β
β QQuery 7 β 42.20 / 44.84 Β±4.04 / 52.84 ms β 40.83 / 43.92 Β±4.71 / 53.29 ms β no change β
β QQuery 8 β 40.60 / 41.51 Β±0.62 / 42.46 ms β 40.52 / 41.19 Β±0.41 / 41.74 ms β no change β
β QQuery 9 β 50.23 / 51.44 Β±1.13 / 53.22 ms β 50.46 / 50.65 Β±0.24 / 51.09 ms β no change β
β QQuery 10 β 41.24 / 42.00 Β±0.79 / 43.44 ms β 41.17 / 42.07 Β±1.10 / 44.21 ms β no change β
β QQuery 11 β 14.14 / 14.92 Β±0.82 / 15.95 ms β 13.90 / 14.08 Β±0.13 / 14.25 ms β +1.06x faster β
β QQuery 12 β 21.38 / 21.62 Β±0.22 / 21.98 ms β 21.11 / 21.35 Β±0.16 / 21.51 ms β no change β
β QQuery 13 β 41.16 / 41.35 Β±0.16 / 41.56 ms β 41.26 / 42.77 Β±1.18 / 44.45 ms β no change β
β QQuery 14 β 25.05 / 25.44 Β±0.33 / 26.03 ms β 24.78 / 25.11 Β±0.21 / 25.37 ms β no change β
β QQuery 15 β 31.42 / 32.15 Β±1.09 / 34.27 ms β 31.31 / 32.20 Β±0.72 / 33.34 ms β no change β
β QQuery 16 β 14.50 / 14.66 Β±0.12 / 14.82 ms β 14.22 / 14.27 Β±0.05 / 14.35 ms β no change β
β QQuery 17 β 74.96 / 76.75 Β±1.62 / 79.57 ms β 68.92 / 69.30 Β±0.33 / 69.79 ms β +1.11x faster β
β QQuery 18 β 61.45 / 64.11 Β±3.18 / 70.28 ms β 62.78 / 63.53 Β±0.68 / 64.79 ms β no change β
β QQuery 19 β 32.54 / 33.29 Β±1.12 / 35.51 ms β 32.05 / 33.01 Β±0.98 / 34.81 ms β no change β
β QQuery 20 β 32.61 / 32.98 Β±0.48 / 33.94 ms β 31.86 / 32.64 Β±0.74 / 33.76 ms β no change β
β QQuery 21 β 56.89 / 57.57 Β±1.08 / 59.70 ms β 54.96 / 55.78 Β±0.63 / 56.75 ms β no change β
β QQuery 22 β 14.63 / 14.74 Β±0.07 / 14.85 ms β 14.06 / 14.27 Β±0.17 / 14.56 ms β no change β
βββββββββββββ΄βββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 773.66ms β
β Total Time (rich-T-kid_coacler-benchmark) β 759.69ms β
β Average Time (HEAD) β 35.17ms β
β Average Time (rich-T-kid_coacler-benchmark) β 34.53ms β
β Queries Faster β 2 β
β Queries Slower β 0 β
β Queries with No Change β 20 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpch β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 5.0s |
| Peak memory | 1.3 GiB |
| Avg memory | 517.5 MiB |
| CPU user | 21.7s |
| CPU sys | 1.9s |
| Peak spill | 0 B |
**tpch β branch**
| Metric | Value |
|--------|-------|
| Wall time | 5.0s |
| Peak memory | 1.3 GiB |
| Avg memory | 527.5 MiB |
| CPU user | 21.1s |
| CPU sys | 1.8s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739472370
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739397449)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββ³βββββββββββββββββββββββββββββββ³βββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 40.71 ms β 41.61 ms β no change β
β QQuery 2 β 18.46 ms β 19.19 ms β no change β
β QQuery 3 β 28.55 ms β 29.35 ms β no change β
β QQuery 4 β 17.61 ms β 17.96 ms β no change β
β QQuery 5 β 35.05 ms β 37.48 ms β 1.07x slower β
β QQuery 6 β 16.17 ms β 16.20 ms β no change β
β QQuery 7 β 40.95 ms β 40.73 ms β no change β
β QQuery 8 β 40.16 ms β 40.28 ms β no change β
β QQuery 9 β 50.31 ms β 50.62 ms β no change β
β QQuery 10 β 40.35 ms β 40.77 ms β no change β
β QQuery 11 β 13.50 ms β 13.53 ms β no change β
β QQuery 12 β 20.92 ms β 20.66 ms β no change β
β QQuery 13 β 39.44 ms β 40.12 ms β no change β
β QQuery 14 β 24.55 ms β 24.60 ms β no change β
β QQuery 15 β 30.73 ms β 30.91 ms β no change β
β QQuery 16 β 14.06 ms β 14.10 ms β no change β
β QQuery 17 β 71.07 ms β 67.73 ms β no change β
β QQuery 18 β 60.76 ms β 62.08 ms β no change β
β QQuery 19 β 31.52 ms β 31.85 ms β no change β
β QQuery 20 β 31.60 ms β 32.02 ms β no change β
β QQuery 21 β 55.32 ms β 54.55 ms β no change β
β QQuery 22 β 13.76 ms β 13.98 ms β no change β
βββββββββββββ΄βββββββββββ΄βββββββββββββββββββββββββββββββ΄βββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 735.54ms β
β Total Time (rich-T-kid_coacler-benchmark) β 740.31ms β
β Average Time (HEAD) β 33.43ms β
β Average Time (rich-T-kid_coacler-benchmark) β 33.65ms β
β Queries Faster β 0 β
β Queries Slower β 1 β
β Queries with No Change β 21 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββ³βββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 40.71 / 42.52 Β±1.44 / 44.00 ms β 41.61 / 42.28 Β±0.96 / 44.17 ms β no change β
β QQuery 2 β 18.46 / 19.02 Β±0.50 / 19.76 ms β 19.19 / 19.92 Β±0.74 / 21.31 ms β no change β
β QQuery 3 β 28.55 / 29.19 Β±0.88 / 30.92 ms β 29.35 / 29.54 Β±0.22 / 29.93 ms β no change β
β QQuery 4 β 17.61 / 18.29 Β±0.57 / 19.16 ms β 17.96 / 18.39 Β±0.52 / 19.40 ms β no change β
β QQuery 5 β 35.05 / 36.38 Β±1.68 / 39.48 ms β 37.48 / 38.22 Β±0.82 / 39.79 ms β 1.05x slower β
β QQuery 6 β 16.17 / 16.91 Β±0.96 / 18.78 ms β 16.20 / 16.85 Β±0.42 / 17.51 ms β no change β
β QQuery 7 β 40.95 / 43.46 Β±1.71 / 46.03 ms β 40.73 / 44.44 Β±5.38 / 55.13 ms β no change β
β QQuery 8 β 40.16 / 41.87 Β±1.85 / 44.50 ms β 40.28 / 40.65 Β±0.31 / 41.07 ms β no change β
β QQuery 9 β 50.31 / 51.54 Β±1.43 / 54.19 ms β 50.62 / 51.32 Β±1.15 / 53.61 ms β no change β
β QQuery 10 β 40.35 / 42.05 Β±1.74 / 44.44 ms β 40.77 / 42.87 Β±1.12 / 43.86 ms β no change β
β QQuery 11 β 13.50 / 13.59 Β±0.07 / 13.69 ms β 13.53 / 13.64 Β±0.09 / 13.78 ms β no change β
β QQuery 12 β 20.92 / 21.32 Β±0.25 / 21.61 ms β 20.66 / 21.15 Β±0.29 / 21.57 ms β no change β
β QQuery 13 β 39.44 / 40.84 Β±1.52 / 43.76 ms β 40.12 / 41.04 Β±1.34 / 43.69 ms β no change β
β QQuery 14 β 24.55 / 24.98 Β±0.24 / 25.28 ms β 24.60 / 25.79 Β±0.92 / 27.15 ms β no change β
β QQuery 15 β 30.73 / 30.91 Β±0.18 / 31.24 ms β 30.91 / 31.63 Β±0.60 / 32.62 ms β no change β
β QQuery 16 β 14.06 / 14.32 Β±0.23 / 14.74 ms β 14.10 / 14.60 Β±0.42 / 15.29 ms β no change β
β QQuery 17 β 71.07 / 75.83 Β±3.96 / 81.94 ms β 67.73 / 72.97 Β±4.75 / 78.75 ms β no change β
β QQuery 18 β 60.76 / 62.96 Β±2.80 / 68.06 ms β 62.08 / 63.74 Β±2.11 / 67.77 ms β no change β
β QQuery 19 β 31.52 / 32.24 Β±0.73 / 33.63 ms β 31.85 / 32.12 Β±0.38 / 32.85 ms β no change β
β QQuery 20 β 31.60 / 32.35 Β±1.06 / 34.43 ms β 32.02 / 32.92 Β±0.89 / 34.15 ms β no change β
β QQuery 21 β 55.32 / 57.14 Β±2.21 / 61.33 ms β 54.55 / 56.88 Β±2.28 / 60.53 ms β no change β
β QQuery 22 β 13.76 / 13.99 Β±0.15 / 14.20 ms β 13.98 / 14.29 Β±0.53 / 15.36 ms β no change β
βββββββββββββ΄βββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββ΄βββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 761.71ms β
β Total Time (rich-T-kid_coacler-benchmark) β 765.25ms β
β Average Time (HEAD) β 34.62ms β
β Average Time (rich-T-kid_coacler-benchmark) β 34.78ms β
β Queries Faster β 0 β
β Queries Slower β 1 β
β Queries with No Change β 21 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpch β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 5.0s |
| Peak memory | 1.2 GiB |
| Avg memory | 497.6 MiB |
| CPU user | 21.3s |
| CPU sys | 1.8s |
| Peak spill | 0 B |
**tpch β branch**
| Metric | Value |
|--------|-------|
| Wall time | 5.0s |
| Peak memory | 1.3 GiB |
| Avg memory | 517.6 MiB |
| CPU user | 21.2s |
| CPU sys | 1.8s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739454923
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739398003)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5739398003-2473-25t4f 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739733836
new PR below
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5736910039
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5736766135)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (76e1f1c24138317d60fc604b72283008fad49b6a) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..76e1f1c24138317d60fc604b72283008fad49b6a)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.22 ms β 1.25 ms β no change β
β QQuery 1 β 11.78 ms β 11.65 ms β no change β
β QQuery 2 β 36.79 ms β 36.82 ms β no change β
β QQuery 3 β 31.52 ms β 31.61 ms β no change β
β QQuery 4 β 237.43 ms β 241.28 ms β no change β
β QQuery 5 β 269.13 ms β 274.86 ms β no change β
β QQuery 6 β 1.30 ms β 1.30 ms β no change β
β QQuery 7 β 13.19 ms β 13.15 ms β no change β
β QQuery 8 β 332.54 ms β 334.04 ms β no change β
β QQuery 9 β 468.85 ms β 467.53 ms β no change β
β QQuery 10 β 64.01 ms β 63.93 ms β no change β
β QQuery 11 β 75.34 ms β 74.63 ms β no change β
β QQuery 12 β 260.25 ms β 264.82 ms β no change β
β QQuery 13 β 360.18 ms β 364.45 ms β no change β
β QQuery 14 β 279.39 ms β 279.47 ms β no change β
β QQuery 15 β 280.62 ms β 297.64 ms β 1.06x slower β
β QQuery 16 β 608.80 ms β 623.90 ms β no change β
β QQuery 17 β 617.65 ms β 626.16 ms β no change β
β QQuery 18 β 1260.23 ms β 1279.29 ms β no change β
β QQuery 19 β 28.00 ms β 27.88 ms β no change β
β QQuery 20 β 518.55 ms β 518.09 ms β no change β
β QQuery 21 β 504.14 ms β 512.19 ms β no change β
β QQuery 22 β 970.01 ms β 990.79 ms β no change β
β QQuery 23 β 3003.47 ms β 3092.98 ms β no change β
β QQuery 24 β 41.00 ms β 40.48 ms β no change β
β QQuery 25 β 106.31 ms β 105.95 ms β no change β
β QQuery 26 β 41.86 ms β 41.12 ms β no change β
β QQuery 27 β 511.02 ms β 512.40 ms β no change β
β QQuery 28 β 2907.80 ms β 2893.95 ms β no change β
β QQuery 29 β 42.02 ms β 42.36 ms β no change β
β QQuery 30 β 311.58 ms β 311.14 ms β no change β
β QQuery 31 β 287.08 ms β 287.03 ms β no change β
β QQuery 32 β 962.68 ms β 1036.34 ms β 1.08x slower β
β QQuery 33 β 1480.66 ms β 1473.90 ms β no change β
β QQuery 34 β 1503.86 ms β 1525.50 ms β no change β
β QQuery 35 β 304.49 ms β 305.12 ms β no change β
β QQuery 36 β 74.88 ms β 66.05 ms β +1.13x faster β
β QQuery 37 β 36.12 ms β 35.55 ms β no change β
β QQuery 38 β 41.11 ms β 40.61 ms β no change β
β QQuery 39 β 146.52 ms β 142.54 ms β no change β
β QQuery 40 β 14.75 ms β 14.60 ms β no change β
β QQuery 41 β 14.19 ms β 14.30 ms β no change β
β QQuery 42 β 13.84 ms β 13.89 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 19076.19ms β
β Total Time (rich-T-kid_coacler-benchmark) β 19332.55ms β
β Average Time (HEAD) β 443.63ms β
β Average Time (rich-T-kid_coacler-benchmark) β 449.59ms β
β Queries Faster β 1 β
β Queries Slower β 2 β
β Queries with No Change β 40 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.22 / 4.10 Β±5.59 / 15.27 ms β 1.25 / 4.09 Β±5.54 / 15.16 ms β no change β
β QQuery 1 β 11.78 / 11.92 Β±0.10 / 12.08 ms β 11.65 / 11.93 Β±0.20 / 12.21 ms β no change β
β QQuery 2 β 36.79 / 37.46 Β±0.79 / 39.00 ms β 36.82 / 37.06 Β±0.23 / 37.41 ms β no change β
β QQuery 3 β 31.52 / 32.08 Β±0.77 / 33.54 ms β 31.61 / 32.04 Β±0.34 / 32.65 ms β no change β
β QQuery 4 β 237.43 / 239.70 Β±2.31 / 243.31 ms β 241.28 / 246.58 Β±4.36 / 252.75 ms β no change β
β QQuery 5 β 269.13 / 274.00 Β±3.51 / 279.63 ms β 274.86 / 276.90 Β±1.93 / 279.82 ms β no change β
β QQuery 6 β 1.30 / 1.48 Β±0.25 / 1.97 ms β 1.30 / 1.46 Β±0.26 / 1.96 ms β no change β
β QQuery 7 β 13.19 / 13.33 Β±0.09 / 13.46 ms β 13.15 / 13.30 Β±0.11 / 13.47 ms β no change β
β QQuery 8 β 332.54 / 333.85 Β±1.20 / 335.90 ms β 334.04 / 347.37 Β±7.89 / 358.68 ms β no change β
β QQuery 9 β 468.85 / 477.44 Β±5.64 / 485.65 ms β 467.53 / 475.65 Β±5.90 / 483.62 ms β no change β
β QQuery 10 β 64.01 / 65.20 Β±0.89 / 66.48 ms β 63.93 / 71.61 Β±13.50 / 98.57 ms β 1.10x slower β
β QQuery 11 β 75.34 / 76.18 Β±0.85 / 77.76 ms β 74.63 / 78.06 Β±5.28 / 88.57 ms β no change β
β QQuery 12 β 260.25 / 266.10 Β±3.79 / 271.61 ms β 264.82 / 269.94 Β±5.98 / 279.12 ms β no change β
β QQuery 13 β 360.18 / 369.80 Β±6.08 / 377.71 ms β 364.45 / 381.57 Β±13.86 / 398.55 ms β no change β
β QQuery 14 β 279.39 / 283.36 Β±3.64 / 288.04 ms β 279.47 / 285.48 Β±6.30 / 296.64 ms β no change β
β QQuery 15 β 280.62 / 289.69 Β±9.93 / 308.81 ms β 297.64 / 303.93 Β±5.76 / 314.32 ms β no change β
β QQuery 16 β 608.80 / 626.46 Β±10.07 / 637.02 ms β 623.90 / 658.11 Β±49.83 / 756.88 ms β 1.05x slower β
β QQuery 17 β 617.65 / 626.32 Β±6.57 / 637.65 ms β 626.16 / 673.85 Β±56.85 / 784.39 ms β 1.08x slower β
β QQuery 18 β 1260.23 / 1284.67 Β±25.36 / 1319.50 ms β 1279.29 / 1318.65 Β±45.07 / 1406.71 ms β no change β
β QQuery 19 β 28.00 / 33.42 Β±9.35 / 52.09 ms β 27.88 / 31.08 Β±5.70 / 42.45 ms β +1.08x faster β
β QQuery 20 β 518.55 / 538.38 Β±20.73 / 570.86 ms β 518.09 / 543.89 Β±37.87 / 617.53 ms β no change β
β QQuery 21 β 504.14 / 508.89 Β±3.01 / 512.81 ms β 512.19 / 519.03 Β±11.36 / 541.67 ms β no change β
β QQuery 22 β 970.01 / 975.22 Β±4.81 / 983.77 ms β 990.79 / 996.52 Β±4.61 / 1001.90 ms β no change β
β QQuery 23 β 3003.47 / 3073.48 Β±46.08 / 3124.63 ms β 3092.98 / 3111.07 Β±13.85 / 3134.20 ms β no change β
β QQuery 24 β 41.00 / 51.79 Β±14.40 / 78.95 ms β 40.48 / 41.19 Β±0.92 / 42.96 ms β +1.26x faster β
β QQuery 25 β 106.31 / 107.24 Β±0.62 / 108.18 ms β 105.95 / 107.11 Β±1.46 / 109.92 ms β no change β
β QQuery 26 β 41.86 / 43.54 Β±2.44 / 48.32 ms β 41.12 / 45.14 Β±7.36 / 59.85 ms β no change β
β QQuery 27 β 511.02 / 522.01 Β±7.18 / 532.04 ms β 512.40 / 521.30 Β±7.90 / 534.27 ms β no change β
β QQuery 28 β 2907.80 / 2949.21 Β±26.61 / 2990.61 ms β 2893.95 / 2910.31 Β±12.08 / 2929.19 ms β no change β
β QQuery 29 β 42.02 / 55.23 Β±14.19 / 79.67 ms β 42.36 / 46.11 Β±5.72 / 57.40 ms β +1.20x faster β
β QQuery 30 β 311.58 / 320.49 Β±10.61 / 341.23 ms β 311.14 / 315.91 Β±3.82 / 322.51 ms β no change β
β QQuery 31 β 287.08 / 297.80 Β±10.35 / 317.15 ms β 287.03 / 300.31 Β±11.23 / 316.03 ms β no change β
β QQuery 32 β 962.68 / 974.91 Β±11.84 / 990.47 ms β 1036.34 / 1080.21 Β±34.16 / 1124.04 ms β 1.11x slower β
β QQuery 33 β 1480.66 / 1504.45 Β±24.23 / 1551.13 ms β 1473.90 / 1520.02 Β±34.42 / 1567.01 ms β no change β
β QQuery 34 β 1503.86 / 1531.76 Β±24.36 / 1574.36 ms β 1525.50 / 1549.15 Β±24.46 / 1587.42 ms β no change β
β QQuery 35 β 304.49 / 323.76 Β±29.29 / 381.23 ms β 305.12 / 362.13 Β±88.12 / 535.75 ms β 1.12x slower β
β QQuery 36 β 74.88 / 77.20 Β±2.45 / 81.85 ms β 66.05 / 77.59 Β±12.89 / 101.72 ms β no change β
β QQuery 37 β 36.12 / 37.68 Β±2.00 / 41.61 ms β 35.55 / 37.79 Β±3.25 / 44.25 ms β no change β
β QQuery 38 β 41.11 / 44.99 Β±4.10 / 52.52 ms β 40.61 / 46.19 Β±6.11 / 56.25 ms β no change β
β QQuery 39 β 146.52 / 154.96 Β±8.11 / 166.34 ms β 142.54 / 153.85 Β±7.61 / 165.58 ms β no change β
β QQuery 40 β 14.75 / 16.55 Β±2.99 / 22.53 ms β 14.60 / 14.80 Β±0.16 / 15.01 ms β +1.12x faster β
β QQuery 41 β 14.19 / 14.29 Β±0.06 / 14.38 ms β 14.30 / 16.01 Β±3.02 / 22.05 ms β 1.12x slower β
β QQuery 42 β 13.84 / 14.02 Β±0.20 / 14.39 ms β 13.89 / 15.25 Β±2.44 / 20.12 ms β 1.09x slower β
βββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 19484.40ms β
β Total Time (rich-T-kid_coacler-benchmark) β 19849.55ms β
β Average Time (HEAD) β 453.13ms β
β Average Time (rich-T-kid_coacler-benchmark) β 461.62ms β
β Queries Faster β 4 β
β Queries Slower β 7 β
β Queries with No Change β 32 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**clickbench_partitioned β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 100.0s |
| Peak memory | 11.6 GiB |
| Avg memory | 4.4 GiB |
| CPU user | 998.6s |
| CPU sys | 69.7s |
| Peak spill | 0 B |
**clickbench_partitioned β branch**
| Metric | Value |
|--------|-------|
| Wall time | 100.0s |
| Peak memory | 12.1 GiB |
| Avg memory | 4.7 GiB |
| CPU user | 1009.8s |
| CPU sys | 73.2s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739409348
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739391357)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5739391357-2468-2zd2r 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739398003
run benchmarks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739391357
run benchmarks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739803868
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739768986)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (dbfc4e87e81f5ae40f150fa37700863a165cd991) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..dbfc4e87e81f5ae40f150fa37700863a165cd991)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 40.73 ms β 40.63 ms β no change β
β QQuery 2 β 18.57 ms β 18.50 ms β no change β
β QQuery 3 β 28.51 ms β 28.40 ms β no change β
β QQuery 4 β 17.01 ms β 17.28 ms β no change β
β QQuery 5 β 35.22 ms β 35.37 ms β no change β
β QQuery 6 β 16.33 ms β 16.28 ms β no change β
β QQuery 7 β 40.92 ms β 39.69 ms β no change β
β QQuery 8 β 40.29 ms β 40.08 ms β no change β
β QQuery 9 β 49.46 ms β 49.99 ms β no change β
β QQuery 10 β 40.50 ms β 40.18 ms β no change β
β QQuery 11 β 13.56 ms β 13.33 ms β no change β
β QQuery 12 β 21.25 ms β 20.76 ms β no change β
β QQuery 13 β 39.60 ms β 39.48 ms β no change β
β QQuery 14 β 24.45 ms β 24.66 ms β no change β
β QQuery 15 β 30.78 ms β 30.78 ms β no change β
β QQuery 16 β 13.96 ms β 14.07 ms β no change β
β QQuery 17 β 72.28 ms β 66.99 ms β +1.08x faster β
β QQuery 18 β 59.87 ms β 60.49 ms β no change β
β QQuery 19 β 31.62 ms β 31.75 ms β no change β
β QQuery 20 β 31.47 ms β 31.78 ms β no change β
β QQuery 21 β 54.82 ms β 54.60 ms β no change β
β QQuery 22 β 14.06 ms β 13.23 ms β +1.06x faster β
βββββββββββββ΄βββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 735.26ms β
β Total Time (rich-T-kid_coacler-benchmark) β 728.33ms β
β Average Time (HEAD) β 33.42ms β
β Average Time (rich-T-kid_coacler-benchmark) β 33.11ms β
β Queries Faster β 2 β
β Queries Slower β 0 β
β Queries with No Change β 20 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 40.73 / 41.51 Β±0.95 / 43.23 ms β 40.63 / 41.51 Β±1.04 / 43.52 ms β no change β
β QQuery 2 β 18.57 / 19.38 Β±1.00 / 21.10 ms β 18.50 / 18.78 Β±0.40 / 19.57 ms β no change β
β QQuery 3 β 28.51 / 29.68 Β±1.80 / 33.26 ms β 28.40 / 28.71 Β±0.21 / 29.03 ms β no change β
β QQuery 4 β 17.01 / 17.38 Β±0.42 / 18.16 ms β 17.28 / 18.16 Β±1.18 / 20.45 ms β no change β
β QQuery 5 β 35.22 / 35.62 Β±0.31 / 36.18 ms β 35.37 / 36.22 Β±0.88 / 37.91 ms β no change β
β QQuery 6 β 16.33 / 17.26 Β±1.16 / 19.04 ms β 16.28 / 16.46 Β±0.14 / 16.59 ms β no change β
β QQuery 7 β 40.92 / 42.91 Β±1.68 / 45.91 ms β 39.69 / 40.88 Β±0.71 / 41.69 ms β no change β
β QQuery 8 β 40.29 / 40.94 Β±0.50 / 41.68 ms β 40.08 / 40.88 Β±1.05 / 42.91 ms β no change β
β QQuery 9 β 49.46 / 50.77 Β±0.94 / 52.32 ms β 49.99 / 50.77 Β±0.58 / 51.75 ms β no change β
β QQuery 10 β 40.50 / 40.93 Β±0.52 / 41.93 ms β 40.18 / 40.34 Β±0.11 / 40.52 ms β no change β
β QQuery 11 β 13.56 / 14.45 Β±0.65 / 15.31 ms β 13.33 / 13.76 Β±0.52 / 14.75 ms β no change β
β QQuery 12 β 21.25 / 22.00 Β±0.76 / 22.98 ms β 20.76 / 22.38 Β±1.13 / 24.15 ms β no change β
β QQuery 13 β 39.60 / 40.28 Β±0.53 / 41.07 ms β 39.48 / 40.53 Β±1.32 / 43.09 ms β no change β
β QQuery 14 β 24.45 / 24.64 Β±0.15 / 24.90 ms β 24.66 / 24.75 Β±0.06 / 24.84 ms β no change β
β QQuery 15 β 30.78 / 31.19 Β±0.52 / 32.21 ms β 30.78 / 31.58 Β±0.45 / 32.05 ms β no change β
β QQuery 16 β 13.96 / 14.28 Β±0.40 / 15.05 ms β 14.07 / 14.30 Β±0.23 / 14.64 ms β no change β
β QQuery 17 β 72.28 / 73.12 Β±0.71 / 74.42 ms β 66.99 / 68.30 Β±1.07 / 69.99 ms β +1.07x faster β
β QQuery 18 β 59.87 / 61.84 Β±0.99 / 62.48 ms β 60.49 / 62.66 Β±1.15 / 63.83 ms β no change β
β QQuery 19 β 31.62 / 32.46 Β±1.19 / 34.82 ms β 31.75 / 32.03 Β±0.23 / 32.43 ms β no change β
β QQuery 20 β 31.47 / 32.25 Β±0.82 / 33.56 ms β 31.78 / 32.03 Β±0.26 / 32.45 ms β no change β
β QQuery 21 β 54.82 / 55.65 Β±0.93 / 56.93 ms β 54.60 / 55.92 Β±1.05 / 57.31 ms β no change β
β QQuery 22 β 14.06 / 14.19 Β±0.09 / 14.34 ms β 13.23 / 13.83 Β±0.31 / 14.06 ms β no change β
βββββββββββββ΄βββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 752.74ms β
β Total Time (rich-T-kid_coacler-benchmark) β 744.76ms β
β Average Time (HEAD) β 34.22ms β
β Average Time (rich-T-kid_coacler-benchmark) β 33.85ms β
β Queries Faster β 1 β
β Queries Slower β 0 β
β Queries with No Change β 21 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpch β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 5.0s |
| Peak memory | 1.3 GiB |
| Avg memory | 521.4 MiB |
| CPU user | 21.0s |
| CPU sys | 1.7s |
| Peak spill | 0 B |
**tpch β branch**
| Metric | Value |
|--------|-------|
| Wall time | 5.0s |
| Peak memory | 1.3 GiB |
| Avg memory | 504.9 MiB |
| CPU user | 20.7s |
| CPU sys | 1.6s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745526315
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745457304)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 64.76 ms β 64.64 ms β no change β
β QQuery 2 β 325.03 ms β 306.22 ms β +1.06x faster β
β QQuery 3 β 83.78 ms β 75.77 ms β +1.11x faster β
β QQuery 4 β 826.97 ms β 848.40 ms β no change β
β QQuery 5 β 398.23 ms β 387.20 ms β no change β
β QQuery 6 β 173.76 ms β 164.86 ms β +1.05x faster β
β QQuery 7 β 124.50 ms β 121.64 ms β no change β
β QQuery 8 β 160.29 ms β 165.37 ms β no change β
β QQuery 9 β 256.14 ms β 249.68 ms β no change β
β QQuery 10 β 147.90 ms β 148.38 ms β no change β
β QQuery 11 β 548.07 ms β 522.90 ms β no change β
β QQuery 12 β 123.14 ms β 107.58 ms β +1.14x faster β
β QQuery 13 β 282.48 ms β 271.28 ms β no change β
β QQuery 14 β 5550.87 ms β 1340.52 ms β +4.14x faster β
β QQuery 15 β 122.72 ms β 113.40 ms β +1.08x faster β
β QQuery 16 β 69.90 ms β 67.10 ms β no change β
β QQuery 17 β 586.79 ms β 579.27 ms β no change β
β QQuery 18 β 546.36 ms β 555.51 ms β no change β
β QQuery 19 β 104.42 ms β 101.12 ms β no change β
β QQuery 20 β 122.45 ms β 113.63 ms β +1.08x faster β
β QQuery 21 β 70.31 ms β 67.23 ms β no change β
β QQuery 22 β 125.47 ms β 123.63 ms β no change β
β QQuery 23 β 910.55 ms β 1013.97 ms β 1.11x slower β
β QQuery 24 β 570.12 ms β 550.60 ms β no change β
β QQuery 25 β 624.56 ms β 617.08 ms β no change β
β QQuery 26 β 96.04 ms β 97.00 ms β no change β
β QQuery 27 β 61.41 ms β 66.80 ms β 1.09x slower β
β QQuery 28 β 127.46 ms β 129.61 ms β no change β
β QQuery 29 β 617.88 ms β 636.06 ms β no change β
β QQuery 30 β 192.17 ms β 195.35 ms β no change β
β QQuery 31 β 473.02 ms β 495.50 ms β no change β
β QQuery 32 β 81.64 ms β 80.95 ms β no change β
β QQuery 33 β 155.50 ms β 168.56 ms β 1.08x slower β
β QQuery 34 β 67.50 ms β 67.11 ms β no change β
β QQuery 35 β 181.53 ms β 167.78 ms β +1.08x faster β
β QQuery 36 β 96.06 ms β 92.33 ms β no change β
β QQuery 37 β 54.97 ms β 50.50 ms β +1.09x faster β
β QQuery 38 β 223.21 ms β 215.83 ms β no change β
β QQuery 39 β 303.13 ms β 277.93 ms β +1.09x faster β
β QQuery 40 β 79.62 ms β 77.90 ms β no change β
β QQuery 41 β 95.16 ms β 91.94 ms β no change β
β QQuery 42 β 74.87 ms β 70.95 ms β +1.06x faster β
β QQuery 43 β 57.80 ms β 56.52 ms β no change β
β QQuery 44 β 158.70 ms β 161.11 ms β no change β
β QQuery 45 β 102.36 ms β 106.41 ms β no change β
β QQuery 46 β 75.46 ms β 70.60 ms β +1.07x faster β
β QQuery 47 β 564.83 ms β 525.66 ms β +1.07x faster β
β QQuery 48 β 258.75 ms β 258.46 ms β no change β
β QQuery 49 β 305.38 ms β 272.99 ms β +1.12x faster β
β QQuery 50 β 343.26 ms β 336.02 ms β no change β
β QQuery 51 β 322.94 ms β 316.51 ms β no change β
β QQuery 52 β 71.39 ms β 71.54 ms β no change β
β QQuery 53 β 118.27 ms β 112.15 ms β +1.05x faster β
β QQuery 54 β 290.49 ms β 272.66 ms β +1.07x faster β
β QQuery 55 β 76.78 ms β 71.18 ms β +1.08x faster β
β QQuery 56 β 134.31 ms β 125.48 ms β +1.07x faster β
β QQuery 57 β 464.08 ms β 452.99 ms β no change β
β QQuery 58 β 269.55 ms β 253.39 ms β +1.06x faster β
β QQuery 59 β 230.68 ms β 218.84 ms β +1.05x faster β
β QQuery 60 β 132.42 ms β 125.43 ms β +1.06x faster β
β QQuery 61 β 38.75 ms β 36.62 ms β +1.06x faster β
β QQuery 62 β 111.49 ms β 105.94 ms β no change β
β QQuery 63 β 124.60 ms β 116.55 ms β +1.07x faster β
β QQuery 64 β 2560.11 ms β 2675.31 ms β no change β
β QQuery 65 β 586.63 ms β 596.58 ms β no change β
β QQuery 66 β 242.35 ms β 227.74 ms β +1.06x faster β
β QQuery 67 β 435.68 ms β 374.41 ms β +1.16x faster β
β QQuery 68 β 73.69 ms β 70.92 ms β no change β
β QQuery 69 β 153.00 ms β 147.25 ms β no change β
β QQuery 70 β 288.52 ms β 286.83 ms β no change β
β QQuery 71 β 105.54 ms β 100.97 ms β no change β
β QQuery 72 β 5984.31 ms β 5895.84 ms β no change β
β QQuery 73 β 66.00 ms β 64.17 ms β no change β
β QQuery 74 β 395.61 ms β 395.29 ms β no change β
β QQuery 75 β 953.66 ms β 890.26 ms β +1.07x faster β
β QQuery 76 β 182.35 ms β 168.62 ms β +1.08x faster β
β QQuery 77 β 387.78 ms β 367.42 ms β +1.06x faster β
β QQuery 78 β 365.41 ms β 360.64 ms β no change β
β QQuery 79 β 130.41 ms β 124.67 ms β no change β
β QQuery 80 β 522.68 ms β 533.17 ms β no change β
β QQuery 81 β 191.52 ms β 169.55 ms β +1.13x faster β
β QQuery 82 β 69.30 ms β 69.61 ms β no change β
β QQuery 83 β 191.84 ms β 171.64 ms β +1.12x faster β
β QQuery 84 β 71.99 ms β 77.70 ms β 1.08x slower β
β QQuery 85 β 451.26 ms β 431.88 ms β no change β
β QQuery 86 β 114.65 ms β 112.53 ms β no change β
β QQuery 87 β 215.26 ms β 216.48 ms β no change β
β QQuery 88 β 166.08 ms β 162.10 ms β no change β
β QQuery 89 β 122.42 ms β 126.74 ms β no change β
β QQuery 90 β 48.69 ms β 52.51 ms β 1.08x slower β
β QQuery 91 β 110.38 ms β 109.16 ms β no change β
β QQuery 92 β 86.89 ms β 86.03 ms β no change β
β QQuery 93 β 230.31 ms β 235.96 ms β no change β
β QQuery 94 β 126.59 ms β 126.86 ms β no change β
β QQuery 95 β 494.66 ms β 528.64 ms β 1.07x slower β
β QQuery 96 β 41.76 ms β 43.93 ms β 1.05x slower β
β QQuery 97 β 164.66 ms β 170.83 ms β no change β
β QQuery 98 β 134.85 ms β 130.62 ms β no change β
β QQuery 99 β 127.58 ms β 128.00 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 36747.52ms β
β Total Time (rich-T-kid_coacler-benchmark) β 32157.00ms β
β Average Time (HEAD) β 371.19ms β
β Average Time (rich-T-kid_coacler-benchmark) β 324.82ms β
β Queries Faster β 30 β
β Queries Slower β 7 β
β Queries with No Change β 62 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 64.76 / 65.73 Β±1.30 / 68.21 ms β 64.64 / 65.66 Β±1.54 / 68.73 ms β no change β
β QQuery 2 β 325.03 / 356.79 Β±18.19 / 374.86 ms β 306.22 / 328.83 Β±22.56 / 371.92 ms β +1.09x faster β
β QQuery 3 β 83.78 / 85.25 Β±1.45 / 87.98 ms β 75.77 / 79.96 Β±3.54 / 85.69 ms β +1.07x faster β
β QQuery 4 β 826.97 / 842.89 Β±17.35 / 868.03 ms β 848.40 / 857.01 Β±8.66 / 869.98 ms β no change β
β QQuery 5 β 398.23 / 416.98 Β±20.33 / 454.00 ms β 387.20 / 427.47 Β±32.71 / 468.66 ms β no change β
β QQuery 6 β 173.76 / 188.62 Β±15.75 / 216.96 ms β 164.86 / 185.16 Β±23.53 / 227.01 ms β no change β
β QQuery 7 β 124.50 / 134.91 Β±13.16 / 158.11 ms β 121.64 / 126.66 Β±5.93 / 136.79 ms β +1.07x faster β
β QQuery 8 β 160.29 / 173.44 Β±7.96 / 181.10 ms β 165.37 / 179.13 Β±9.27 / 192.99 ms β no change β
β QQuery 9 β 256.14 / 271.01 Β±12.59 / 291.98 ms β 249.68 / 265.11 Β±13.07 / 284.97 ms β no change β
β QQuery 10 β 147.90 / 158.36 Β±10.04 / 176.79 ms β 148.38 / 149.56 Β±0.93 / 151.26 ms β +1.06x faster β
β QQuery 11 β 548.07 / 566.73 Β±18.00 / 597.78 ms β 522.90 / 547.86 Β±28.07 / 601.10 ms β no change β
β QQuery 12 β 123.14 / 126.30 Β±2.24 / 128.59 ms β 107.58 / 110.87 Β±3.26 / 116.44 ms β +1.14x faster β
β QQuery 13 β 282.48 / 305.91 Β±14.32 / 320.16 ms β 271.28 / 282.65 Β±9.61 / 299.98 ms β +1.08x faster β
β QQuery 14 β 5550.87 / 5914.69 Β±194.31 / 6088.50 ms β 1340.52 / 1395.54 Β±35.79 / 1429.65 ms β +4.24x faster β
β QQuery 15 β 122.72 / 124.88 Β±2.51 / 129.49 ms β 113.40 / 120.85 Β±12.26 / 145.26 ms β no change β
β QQuery 16 β 69.90 / 79.16 Β±13.67 / 106.19 ms β 67.10 / 70.18 Β±3.19 / 76.03 ms β +1.13x faster β
β QQuery 17 β 586.79 / 608.27 Β±21.05 / 634.25 ms β 579.27 / 612.12 Β±33.91 / 673.08 ms β no change β
β QQuery 18 β 546.36 / 556.59 Β±12.60 / 580.62 ms β 555.51 / 560.85 Β±3.60 / 564.83 ms β no change β
β QQuery 19 β 104.42 / 112.11 Β±6.98 / 124.28 ms β 101.12 / 111.88 Β±9.61 / 129.38 ms β no change β
β QQuery 20 β 122.45 / 126.96 Β±5.34 / 137.13 ms β 113.63 / 122.35 Β±10.45 / 142.72 ms β no change β
β QQuery 21 β 70.31 / 80.67 Β±11.37 / 101.56 ms β 67.23 / 72.33 Β±5.87 / 83.31 ms β +1.12x faster β
β QQuery 22 β 125.47 / 131.71 Β±4.22 / 136.65 ms β 123.63 / 128.36 Β±3.23 / 132.87 ms β no change β
β QQuery 23 β 910.55 / 971.39 Β±39.23 / 1017.91 ms β 1013.97 / 1052.92 Β±32.61 / 1103.87 ms β 1.08x slower β
β QQuery 24 β 570.12 / 599.33 Β±23.40 / 633.63 ms β 550.60 / 587.04 Β±24.79 / 621.83 ms β no change β
β QQuery 25 β 624.56 / 641.50 Β±10.59 / 655.30 ms β 617.08 / 639.80 Β±21.99 / 678.07 ms β no change β
β QQuery 26 β 96.04 / 105.63 Β±17.92 / 141.47 ms β 97.00 / 105.38 Β±7.35 / 115.72 ms β no change β
β QQuery 27 β 61.41 / 71.52 Β±14.33 / 99.95 ms β 66.80 / 79.45 Β±22.27 / 123.90 ms β 1.11x slower β
β QQuery 28 β 127.46 / 132.63 Β±5.60 / 143.06 ms β 129.61 / 138.18 Β±11.42 / 160.59 ms β no change β
β QQuery 29 β 617.88 / 638.22 Β±19.98 / 668.78 ms β 636.06 / 668.83 Β±30.27 / 709.81 ms β no change β
β QQuery 30 β 192.17 / 200.63 Β±8.96 / 217.05 ms β 195.35 / 206.47 Β±8.87 / 220.95 ms β no change β
β QQuery 31 β 473.02 / 509.75 Β±30.11 / 555.57 ms β 495.50 / 504.44 Β±5.98 / 512.69 ms β no change β
β QQuery 32 β 81.64 / 93.27 Β±16.25 / 125.36 ms β 80.95 / 95.27 Β±24.87 / 144.82 ms β no change β
β QQuery 33 β 155.50 / 186.93 Β±31.37 / 226.01 ms β 168.56 / 179.07 Β±9.56 / 195.90 ms β no change β
β QQuery 34 β 67.50 / 71.48 Β±6.26 / 83.87 ms β 67.11 / 68.73 Β±1.40 / 71.25 ms β no change β
β QQuery 35 β 181.53 / 188.47 Β±4.53 / 193.53 ms β 167.78 / 174.45 Β±6.27 / 185.94 ms β +1.08x faster β
β QQuery 36 β 96.06 / 99.68 Β±2.91 / 104.74 ms β 92.33 / 98.00 Β±7.23 / 111.52 ms β no change β
β QQuery 37 β 54.97 / 55.45 Β±0.42 / 56.14 ms β 50.50 / 52.95 Β±2.82 / 58.06 ms β no change β
β QQuery 38 β 223.21 / 238.60 Β±11.05 / 253.03 ms β 215.83 / 228.45 Β±9.47 / 237.84 ms β no change β
β QQuery 39 β 303.13 / 317.69 Β±12.22 / 337.25 ms β 277.93 / 299.10 Β±26.84 / 349.31 ms β +1.06x faster β
β QQuery 40 β 79.62 / 83.53 Β±5.46 / 94.30 ms β 77.90 / 93.05 Β±17.06 / 117.71 ms β 1.11x slower β
β QQuery 41 β 95.16 / 106.72 Β±13.60 / 129.91 ms β 91.94 / 94.63 Β±1.93 / 97.75 ms β +1.13x faster β
β QQuery 42 β 74.87 / 77.24 Β±2.75 / 81.65 ms β 70.95 / 78.95 Β±12.27 / 103.32 ms β no change β
β QQuery 43 β 57.80 / 60.96 Β±2.76 / 65.94 ms β 56.52 / 63.49 Β±7.43 / 77.50 ms β no change β
β QQuery 44 β 158.70 / 171.43 Β±9.88 / 187.83 ms β 161.11 / 176.64 Β±10.76 / 191.65 ms β no change β
β QQuery 45 β 102.36 / 110.41 Β±5.75 / 119.71 ms β 106.41 / 113.76 Β±5.55 / 123.64 ms β no change β
β QQuery 46 β 75.46 / 77.81 Β±1.57 / 80.33 ms β 70.60 / 73.30 Β±2.02 / 76.10 ms β +1.06x faster β
β QQuery 47 β 564.83 / 578.52 Β±7.13 / 584.55 ms β 525.66 / 548.52 Β±21.21 / 581.71 ms β +1.05x faster β
β QQuery 48 β 258.75 / 272.64 Β±12.76 / 292.13 ms β 258.46 / 259.43 Β±1.12 / 261.31 ms β no change β
β QQuery 49 β 305.38 / 322.50 Β±18.54 / 356.39 ms β 272.99 / 302.83 Β±25.41 / 333.72 ms β +1.06x faster β
β QQuery 50 β 343.26 / 358.95 Β±12.26 / 376.38 ms β 336.02 / 341.09 Β±3.22 / 345.06 ms β no change β
β QQuery 51 β 322.94 / 337.01 Β±8.31 / 348.67 ms β 316.51 / 325.26 Β±9.19 / 340.55 ms β no change β
β QQuery 52 β 71.39 / 86.24 Β±11.97 / 101.53 ms β 71.54 / 79.31 Β±11.02 / 100.71 ms β +1.09x faster β
β QQuery 53 β 118.27 / 121.89 Β±3.09 / 126.50 ms β 112.15 / 119.89 Β±8.70 / 136.04 ms β no change β
β QQuery 54 β 290.49 / 301.95 Β±10.95 / 322.48 ms β 272.66 / 290.97 Β±14.03 / 312.90 ms β no change β
β QQuery 55 β 76.78 / 85.92 Β±7.99 / 96.31 ms β 71.18 / 74.84 Β±3.67 / 81.17 ms β +1.15x faster β
β QQuery 56 β 134.31 / 151.21 Β±24.63 / 199.71 ms β 125.48 / 135.76 Β±9.68 / 154.18 ms β +1.11x faster β
β QQuery 57 β 464.08 / 474.24 Β±7.30 / 484.19 ms β 452.99 / 472.57 Β±18.40 / 504.84 ms β no change β
β QQuery 58 β 269.55 / 284.78 Β±10.93 / 296.92 ms β 253.39 / 277.21 Β±19.10 / 306.27 ms β no change β
β QQuery 59 β 230.68 / 242.38 Β±9.86 / 255.04 ms β 218.84 / 227.61 Β±6.55 / 236.08 ms β +1.06x faster β
β QQuery 60 β 132.42 / 143.29 Β±13.24 / 168.97 ms β 125.43 / 138.00 Β±13.28 / 160.30 ms β no change β
β QQuery 61 β 38.75 / 41.28 Β±3.14 / 47.45 ms β 36.62 / 37.40 Β±0.56 / 38.08 ms β +1.10x faster β
β QQuery 62 β 111.49 / 115.20 Β±4.37 / 123.76 ms β 105.94 / 110.72 Β±7.23 / 125.10 ms β no change β
β QQuery 63 β 124.60 / 128.41 Β±3.28 / 133.28 ms β 116.55 / 127.22 Β±9.18 / 142.85 ms β no change β
β QQuery 64 β 2560.11 / 2642.40 Β±68.05 / 2759.22 ms β 2675.31 / 2735.38 Β±49.00 / 2821.45 ms β no change β
β QQuery 65 β 586.63 / 605.41 Β±14.80 / 629.63 ms β 596.58 / 620.81 Β±22.95 / 650.67 ms β no change β
β QQuery 66 β 242.35 / 254.43 Β±11.95 / 277.08 ms β 227.74 / 238.11 Β±7.44 / 248.78 ms β +1.07x faster β
β QQuery 67 β 435.68 / 445.39 Β±8.75 / 460.07 ms β 374.41 / 394.26 Β±10.82 / 405.90 ms β +1.13x faster β
β QQuery 68 β 73.69 / 88.47 Β±16.86 / 116.60 ms β 70.92 / 78.78 Β±9.87 / 95.64 ms β +1.12x faster β
β QQuery 69 β 153.00 / 158.77 Β±5.26 / 165.64 ms β 147.25 / 157.47 Β±7.74 / 167.70 ms β no change β
β QQuery 70 β 288.52 / 301.10 Β±10.46 / 320.01 ms β 286.83 / 308.00 Β±18.90 / 338.06 ms β no change β
β QQuery 71 β 105.54 / 115.51 Β±9.42 / 132.09 ms β 100.97 / 110.58 Β±9.29 / 127.74 ms β no change β
β QQuery 72 β 5984.31 / 6125.19 Β±107.52 / 6313.27 ms β 5895.84 / 6152.04 Β±136.15 / 6284.50 ms β no change β
β QQuery 73 β 66.00 / 67.99 Β±1.62 / 70.72 ms β 64.17 / 75.43 Β±21.35 / 118.10 ms β 1.11x slower β
β QQuery 74 β 395.61 / 432.46 Β±37.51 / 496.83 ms β 395.29 / 411.25 Β±10.26 / 423.69 ms β no change β
β QQuery 75 β 953.66 / 988.07 Β±33.34 / 1041.68 ms β 890.26 / 939.28 Β±31.44 / 989.66 ms β no change β
β QQuery 76 β 182.35 / 203.60 Β±22.41 / 245.38 ms β 168.62 / 203.77 Β±29.94 / 256.03 ms β no change β
β QQuery 77 β 387.78 / 407.77 Β±21.89 / 440.93 ms β 367.42 / 382.86 Β±8.18 / 390.75 ms β +1.07x faster β
β QQuery 78 β 365.41 / 411.77 Β±36.22 / 472.20 ms β 360.64 / 379.09 Β±21.69 / 420.08 ms β +1.09x faster β
β QQuery 79 β 130.41 / 152.56 Β±24.37 / 199.07 ms β 124.67 / 134.55 Β±11.20 / 154.59 ms β +1.13x faster β
β QQuery 80 β 522.68 / 587.40 Β±42.23 / 626.76 ms β 533.17 / 584.92 Β±43.52 / 650.58 ms β no change β
β QQuery 81 β 191.52 / 199.24 Β±4.81 / 204.36 ms β 169.55 / 195.69 Β±18.73 / 223.85 ms β no change β
β QQuery 82 β 69.30 / 72.43 Β±1.70 / 73.96 ms β 69.61 / 71.35 Β±1.10 / 72.44 ms β no change β
β QQuery 83 β 191.84 / 196.52 Β±5.07 / 206.19 ms β 171.64 / 186.83 Β±10.06 / 201.07 ms β no change β
β QQuery 84 β 71.99 / 78.78 Β±3.68 / 81.99 ms β 77.70 / 86.07 Β±8.40 / 99.76 ms β 1.09x slower β
β QQuery 85 β 451.26 / 523.35 Β±67.01 / 608.60 ms β 431.88 / 459.48 Β±25.70 / 496.56 ms β +1.14x faster β
β QQuery 86 β 114.65 / 119.32 Β±2.93 / 122.11 ms β 112.53 / 125.59 Β±10.39 / 140.66 ms β 1.05x slower β
β QQuery 87 β 215.26 / 229.28 Β±12.51 / 248.22 ms β 216.48 / 226.63 Β±5.95 / 234.03 ms β no change β
β QQuery 88 β 166.08 / 172.95 Β±4.38 / 177.65 ms β 162.10 / 178.93 Β±12.34 / 195.93 ms β no change β
β QQuery 89 β 122.42 / 127.00 Β±3.39 / 132.35 ms β 126.74 / 131.59 Β±4.33 / 138.17 ms β no change β
β QQuery 90 β 48.69 / 50.92 Β±1.40 / 52.57 ms β 52.51 / 56.67 Β±3.29 / 60.84 ms β 1.11x slower β
β QQuery 91 β 110.38 / 117.62 Β±6.30 / 128.25 ms β 109.16 / 115.49 Β±4.97 / 120.84 ms β no change β
β QQuery 92 β 86.89 / 91.47 Β±3.61 / 96.01 ms β 86.03 / 90.99 Β±4.05 / 97.27 ms β no change β
β QQuery 93 β 230.31 / 236.71 Β±4.31 / 242.69 ms β 235.96 / 247.53 Β±9.28 / 258.63 ms β no change β
β QQuery 94 β 126.59 / 130.25 Β±2.88 / 133.86 ms β 126.86 / 139.44 Β±12.39 / 162.67 ms β 1.07x slower β
β QQuery 95 β 494.66 / 513.64 Β±10.89 / 528.65 ms β 528.64 / 559.53 Β±19.99 / 581.86 ms β 1.09x slower β
β QQuery 96 β 41.76 / 47.87 Β±5.54 / 55.88 ms β 43.93 / 47.01 Β±2.98 / 52.48 ms β no change β
β QQuery 97 β 164.66 / 177.39 Β±7.96 / 186.33 ms β 170.83 / 181.31 Β±7.91 / 194.40 ms β no change β
β QQuery 98 β 134.85 / 141.14 Β±3.70 / 146.12 ms β 130.62 / 144.16 Β±15.37 / 173.79 ms β no change β
β QQuery 99 β 127.58 / 132.34 Β±3.82 / 138.03 ms β 128.00 / 130.95 Β±1.78 / 133.06 ms β no change β
βββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 38631.12ms β
β Total Time (rich-T-kid_coacler-benchmark) β 33823.22ms β
β Average Time (HEAD) β 390.21ms β
β Average Time (rich-T-kid_coacler-benchmark) β 341.65ms β
β Queries Faster β 27 β
β Queries Slower β 9 β
β Queries with No Change β 63 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpcds β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 195.0s |
| Peak memory | 10.0 GiB |
| Avg memory | 1.6 GiB |
| CPU user | 1026.3s |
| CPU sys | 66.3s |
| Peak spill | 0 B |
**tpcds β branch**
| Metric | Value |
|--------|-------|
| Wall time | 170.0s |
| Peak memory | 2.8 GiB |
| Avg memory | 1.3 GiB |
| CPU user | 1023.7s |
| CPU sys | 63.2s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745521688
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745457304)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 2.65 ms β 2.40 ms β +1.10x faster β
β QQuery 1 β 26.79 ms β 23.13 ms β +1.16x faster β
β QQuery 2 β 47.43 ms β 50.75 ms β 1.07x slower β
β QQuery 3 β 42.66 ms β 42.34 ms β no change β
β QQuery 4 β 261.08 ms β 334.98 ms β 1.28x slower β
β QQuery 5 β 368.57 ms β 385.91 ms β no change β
β QQuery 6 β 2.72 ms β 2.40 ms β +1.13x faster β
β QQuery 7 β 69.35 ms β 62.50 ms β +1.11x faster β
β QQuery 8 β 406.47 ms β 498.68 ms β 1.23x slower β
β QQuery 9 β 452.91 ms β 497.84 ms β 1.10x slower β
β QQuery 10 β 160.61 ms β 172.06 ms β 1.07x slower β
β QQuery 11 β 177.87 ms β 187.01 ms β 1.05x slower β
β QQuery 12 β 361.87 ms β 403.49 ms β 1.12x slower β
β QQuery 13 β 612.66 ms β 734.01 ms β 1.20x slower β
β QQuery 14 β 363.99 ms β 399.03 ms β 1.10x slower β
β QQuery 15 β 309.61 ms β 422.12 ms β 1.36x slower β
β QQuery 16 β 679.99 ms β 833.77 ms β 1.23x slower β
β QQuery 17 β 651.67 ms β 845.97 ms β 1.30x slower β
β QQuery 18 β 1291.92 ms β 1772.29 ms β 1.37x slower β
β QQuery 19 β 45.07 ms β 43.60 ms β no change β
β QQuery 20 β 545.93 ms β 576.13 ms β 1.06x slower β
β QQuery 21 β 613.88 ms β 633.51 ms β no change β
β QQuery 22 β 1105.66 ms β 1125.85 ms β no change β
β QQuery 23 β 1909.57 ms β 1793.93 ms β +1.06x faster β
β QQuery 24 β 58.44 ms β 53.79 ms β +1.09x faster β
β QQuery 25 β 131.29 ms β 120.51 ms β +1.09x faster β
β QQuery 26 β 56.24 ms β 56.00 ms β no change β
β QQuery 27 β 633.98 ms β 599.37 ms β +1.06x faster β
β QQuery 28 β 3120.61 ms β 3051.07 ms β no change β
β QQuery 29 β 59.66 ms β 57.94 ms β no change β
β QQuery 30 β 377.36 ms β 418.09 ms β 1.11x slower β
β QQuery 31 β 408.59 ms β 480.15 ms β 1.18x slower β
β QQuery 32 β 1344.21 ms β 2044.43 ms β 1.52x slower β
β QQuery 33 β 1826.76 ms β 2044.11 ms β 1.12x slower β
β QQuery 34 β 1791.86 ms β 1950.54 ms β 1.09x slower β
β QQuery 35 β 303.17 ms β 405.82 ms β 1.34x slower β
β QQuery 36 β 137.90 ms β 133.47 ms β no change β
β QQuery 37 β 98.71 ms β 97.24 ms β no change β
β QQuery 38 β 102.71 ms β 101.21 ms β no change β
β QQuery 39 β 267.73 ms β 236.41 ms β +1.13x faster β
β QQuery 40 β 73.69 ms β 68.15 ms β +1.08x faster β
β QQuery 41 β 73.20 ms β 68.38 ms β +1.07x faster β
β QQuery 42 β 75.95 ms β 68.12 ms β +1.11x faster β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 21452.99ms β
β Total Time (rich-T-kid_coacler-benchmark) β 23898.48ms β
β Average Time (HEAD) β 498.91ms β
β Average Time (rich-T-kid_coacler-benchmark) β 555.78ms β
β Queries Faster β 12 β
β Queries Slower β 20 β
β Queries with No Change β 11 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 2.65 / 5.84 Β±6.14 / 18.12 ms β 2.40 / 5.55 Β±6.08 / 17.70 ms β +1.05x faster β
β QQuery 1 β 26.79 / 28.38 Β±1.06 / 29.73 ms β 23.13 / 27.36 Β±2.33 / 29.61 ms β no change β
β QQuery 2 β 47.43 / 52.01 Β±2.31 / 53.78 ms β 50.75 / 51.40 Β±0.43 / 51.85 ms β no change β
β QQuery 3 β 42.66 / 43.85 Β±1.36 / 46.36 ms β 42.34 / 43.29 Β±0.52 / 43.80 ms β no change β
β QQuery 4 β 261.08 / 265.59 Β±5.64 / 276.32 ms β 334.98 / 343.90 Β±6.10 / 350.97 ms β 1.29x slower β
β QQuery 5 β 368.57 / 374.50 Β±4.86 / 381.52 ms β 385.91 / 392.06 Β±4.37 / 396.78 ms β no change β
β QQuery 6 β 2.72 / 2.84 Β±0.16 / 3.15 ms β 2.40 / 2.52 Β±0.15 / 2.81 ms β +1.13x faster β
β QQuery 7 β 69.35 / 71.50 Β±2.25 / 75.67 ms β 62.50 / 68.54 Β±7.19 / 82.63 ms β no change β
β QQuery 8 β 406.47 / 415.73 Β±5.27 / 421.74 ms β 498.68 / 504.60 Β±4.55 / 511.69 ms β 1.21x slower β
β QQuery 9 β 452.91 / 487.35 Β±26.08 / 521.59 ms β 497.84 / 517.28 Β±14.26 / 537.63 ms β 1.06x slower β
β QQuery 10 β 160.61 / 163.18 Β±2.16 / 166.56 ms β 172.06 / 186.37 Β±17.35 / 218.62 ms β 1.14x slower β
β QQuery 11 β 177.87 / 181.77 Β±5.13 / 191.88 ms β 187.01 / 194.68 Β±7.35 / 208.03 ms β 1.07x slower β
β QQuery 12 β 361.87 / 371.83 Β±9.37 / 389.16 ms β 403.49 / 419.32 Β±15.18 / 446.21 ms β 1.13x slower β
β QQuery 13 β 612.66 / 645.85 Β±26.91 / 688.58 ms β 734.01 / 765.88 Β±23.60 / 794.68 ms β 1.19x slower β
β QQuery 14 β 363.99 / 372.46 Β±9.27 / 385.72 ms β 399.03 / 416.88 Β±15.16 / 444.39 ms β 1.12x slower β
β QQuery 15 β 309.61 / 327.09 Β±14.48 / 347.58 ms β 422.12 / 437.88 Β±11.70 / 454.51 ms β 1.34x slower β
β QQuery 16 β 679.99 / 720.92 Β±26.30 / 761.66 ms β 833.77 / 856.11 Β±19.78 / 890.46 ms β 1.19x slower β
β QQuery 17 β 651.67 / 670.54 Β±12.01 / 688.73 ms β 845.97 / 877.81 Β±19.43 / 898.21 ms β 1.31x slower β
β QQuery 18 β 1291.92 / 1359.30 Β±49.19 / 1440.36 ms β 1772.29 / 1820.39 Β±30.74 / 1861.05 ms β 1.34x slower β
β QQuery 19 β 45.07 / 78.66 Β±51.99 / 180.52 ms β 43.60 / 61.96 Β±28.10 / 117.86 ms β +1.27x faster β
β QQuery 20 β 545.93 / 584.90 Β±33.70 / 634.88 ms β 576.13 / 626.10 Β±58.06 / 737.74 ms β 1.07x slower β
β QQuery 21 β 613.88 / 647.38 Β±24.39 / 678.33 ms β 633.51 / 668.27 Β±35.44 / 718.64 ms β no change β
β QQuery 22 β 1105.66 / 1215.39 Β±91.41 / 1375.17 ms β 1125.85 / 1164.52 Β±22.09 / 1190.01 ms β no change β
β QQuery 23 β 1909.57 / 2010.40 Β±58.22 / 2070.68 ms β 1793.93 / 2104.26 Β±174.79 / 2331.62 ms β no change β
β QQuery 24 β 58.44 / 114.83 Β±51.37 / 198.85 ms β 53.79 / 74.18 Β±23.44 / 110.81 ms β +1.55x faster β
β QQuery 25 β 131.29 / 134.66 Β±4.58 / 143.58 ms β 120.51 / 134.28 Β±22.71 / 179.49 ms β no change β
β QQuery 26 β 56.24 / 59.97 Β±4.06 / 67.52 ms β 56.00 / 58.35 Β±2.38 / 62.44 ms β no change β
β QQuery 27 β 633.98 / 654.48 Β±14.82 / 679.15 ms β 599.37 / 616.16 Β±16.88 / 641.90 ms β +1.06x faster β
β QQuery 28 β 3120.61 / 3174.38 Β±31.23 / 3206.05 ms β 3051.07 / 3146.76 Β±71.59 / 3234.46 ms β no change β
β QQuery 29 β 59.66 / 66.23 Β±9.77 / 85.23 ms β 57.94 / 94.04 Β±44.53 / 164.06 ms β 1.42x slower β
β QQuery 30 β 377.36 / 400.92 Β±25.77 / 449.46 ms β 418.09 / 431.63 Β±9.21 / 442.01 ms β 1.08x slower β
β QQuery 31 β 408.59 / 427.21 Β±25.76 / 477.80 ms β 480.15 / 538.85 Β±53.23 / 626.20 ms β 1.26x slower β
β QQuery 32 β 1344.21 / 1478.74 Β±166.75 / 1800.46 ms β 2044.43 / 2079.72 Β±26.55 / 2122.15 ms β 1.41x slower β
β QQuery 33 β 1826.76 / 1988.57 Β±129.12 / 2179.59 ms β 2044.11 / 2287.71 Β±323.79 / 2915.80 ms β 1.15x slower β
β QQuery 34 β 1791.86 / 1909.85 Β±105.99 / 2042.20 ms β 1950.54 / 2386.67 Β±623.22 / 3592.99 ms β 1.25x slower β
β QQuery 35 β 303.17 / 410.04 Β±124.41 / 608.94 ms β 405.82 / 424.25 Β±15.98 / 447.81 ms β no change β
β QQuery 36 β 137.90 / 143.90 Β±4.61 / 152.08 ms β 133.47 / 138.27 Β±5.31 / 147.81 ms β no change β
β QQuery 37 β 98.71 / 105.45 Β±6.24 / 115.10 ms β 97.24 / 118.24 Β±30.69 / 179.01 ms β 1.12x slower β
β QQuery 38 β 102.71 / 114.81 Β±12.67 / 137.08 ms β 101.21 / 106.37 Β±2.75 / 109.16 ms β +1.08x faster β
β QQuery 39 β 267.73 / 285.63 Β±10.94 / 301.15 ms β 236.41 / 243.70 Β±7.01 / 253.27 ms β +1.17x faster β
β QQuery 40 β 73.69 / 74.74 Β±0.98 / 76.41 ms β 68.15 / 71.55 Β±2.16 / 74.86 ms β no change β
β QQuery 41 β 73.20 / 92.25 Β±25.27 / 141.26 ms β 68.38 / 72.25 Β±3.37 / 77.43 ms β +1.28x faster β
β QQuery 42 β 75.95 / 82.47 Β±8.56 / 99.13 ms β 68.12 / 75.17 Β±6.87 / 84.30 ms β +1.10x faster β
βββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 22816.42ms β
β Total Time (rich-T-kid_coacler-benchmark) β 25655.09ms β
β Average Time (HEAD) β 530.61ms β
β Average Time (rich-T-kid_coacler-benchmark) β 596.63ms β
β Queries Faster β 9 β
β Queries Slower β 20 β
β Queries with No Change β 14 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**clickbench_partitioned β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 115.0s |
| Peak memory | 14.6 GiB |
| Avg memory | 8.0 GiB |
| CPU user | 1049.7s |
| CPU sys | 121.7s |
| Peak spill | 0 B |
**clickbench_partitioned β branch**
| Metric | Value |
|--------|-------|
| Wall time | 130.0s |
| Peak memory | 14.8 GiB |
| Avg memory | 7.7 GiB |
| CPU user | 1205.2s |
| CPU sys | 130.4s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745495711
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745457304)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³ββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 87.68 ms β 82.63 ms β +1.06x faster β
β QQuery 2 β 93.63 ms β 86.77 ms β +1.08x faster β
β QQuery 3 β 87.29 ms β 87.68 ms β no change β
β QQuery 4 β 64.08 ms β 61.54 ms β no change β
β QQuery 5 β 96.35 ms β 93.10 ms β no change β
β QQuery 6 β 28.74 ms β 26.61 ms β +1.08x faster β
β QQuery 7 β 253.02 ms β 259.37 ms β no change β
β QQuery 8 β 246.68 ms β 241.98 ms β no change β
β QQuery 9 β 384.96 ms β 387.44 ms β no change β
β QQuery 10 β 101.62 ms β 96.81 ms β no change β
β QQuery 11 β 85.97 ms β 83.14 ms β no change β
β QQuery 12 β 362.56 ms β 199.72 ms β +1.82x faster β
β QQuery 13 β 127.69 ms β 123.92 ms β no change β
β QQuery 14 β 47.71 ms β 46.70 ms β no change β
β QQuery 15 β 141.92 ms β 132.57 ms β +1.07x faster β
β QQuery 16 β 109.04 ms β 113.64 ms β no change β
β QQuery 17 β 219.50 ms β 236.83 ms β 1.08x slower β
β QQuery 18 β 347.13 ms β 450.69 ms β 1.30x slower β
β QQuery 19 β 53.72 ms β 52.86 ms β no change β
β QQuery 20 β 105.79 ms β 101.54 ms β no change β
β QQuery 21 β 130.48 ms β 126.41 ms β no change β
β QQuery 22 β 88.11 ms β 79.52 ms β +1.11x faster β
βββββββββββββ΄ββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 3263.68ms β
β Total Time (rich-T-kid_coacler-benchmark) β 3171.48ms β
β Average Time (HEAD) β 148.35ms β
β Average Time (rich-T-kid_coacler-benchmark) β 144.16ms β
β Queries Faster β 6 β
β Queries Slower β 2 β
β Queries with No Change β 14 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 87.68 / 89.88 Β±2.11 / 92.92 ms β 82.63 / 86.33 Β±2.68 / 89.39 ms β no change β
β QQuery 2 β 93.63 / 96.45 Β±2.99 / 101.49 ms β 86.77 / 93.30 Β±4.12 / 98.84 ms β no change β
β QQuery 3 β 87.29 / 92.10 Β±4.26 / 98.52 ms β 87.68 / 89.45 Β±1.25 / 91.48 ms β no change β
β QQuery 4 β 64.08 / 68.45 Β±3.87 / 74.82 ms β 61.54 / 65.39 Β±2.31 / 68.32 ms β no change β
β QQuery 5 β 96.35 / 97.89 Β±1.96 / 101.60 ms β 93.10 / 95.14 Β±1.46 / 96.61 ms β no change β
β QQuery 6 β 28.74 / 31.65 Β±2.87 / 36.46 ms β 26.61 / 29.54 Β±2.25 / 31.96 ms β +1.07x faster β
β QQuery 7 β 253.02 / 261.79 Β±7.04 / 273.87 ms β 259.37 / 271.99 Β±8.35 / 284.20 ms β no change β
β QQuery 8 β 246.68 / 265.08 Β±11.13 / 277.37 ms β 241.98 / 258.65 Β±11.10 / 271.03 ms β no change β
β QQuery 9 β 384.96 / 398.10 Β±10.09 / 413.62 ms β 387.44 / 404.07 Β±17.78 / 437.79 ms β no change β
β QQuery 10 β 101.62 / 107.37 Β±8.92 / 125.11 ms β 96.81 / 101.12 Β±3.41 / 106.56 ms β +1.06x faster β
β QQuery 11 β 85.97 / 88.73 Β±3.26 / 95.13 ms β 83.14 / 90.98 Β±8.10 / 102.16 ms β no change β
β QQuery 12 β 362.56 / 371.71 Β±8.86 / 383.34 ms β 199.72 / 211.81 Β±8.23 / 222.43 ms β +1.75x faster β
β QQuery 13 β 127.69 / 131.20 Β±3.03 / 135.76 ms β 123.92 / 128.22 Β±4.85 / 137.44 ms β no change β
β QQuery 14 β 47.71 / 51.23 Β±4.61 / 60.04 ms β 46.70 / 51.96 Β±4.73 / 60.12 ms β no change β
β QQuery 15 β 141.92 / 147.59 Β±6.76 / 158.98 ms β 132.57 / 144.87 Β±14.59 / 172.93 ms β no change β
β QQuery 16 β 109.04 / 114.09 Β±4.83 / 122.38 ms β 113.64 / 119.02 Β±4.94 / 128.07 ms β no change β
β QQuery 17 β 219.50 / 224.24 Β±3.34 / 228.58 ms β 236.83 / 242.26 Β±5.71 / 252.80 ms β 1.08x slower β
β QQuery 18 β 347.13 / 356.24 Β±10.21 / 374.22 ms β 450.69 / 458.75 Β±10.80 / 480.14 ms β 1.29x slower β
β QQuery 19 β 53.72 / 55.45 Β±1.66 / 58.49 ms β 52.86 / 54.75 Β±1.09 / 55.76 ms β no change β
β QQuery 20 β 105.79 / 113.13 Β±9.58 / 132.03 ms β 101.54 / 109.44 Β±9.02 / 126.91 ms β no change β
β QQuery 21 β 130.48 / 134.52 Β±2.76 / 138.67 ms β 126.41 / 136.28 Β±9.36 / 150.84 ms β no change β
β QQuery 22 β 88.11 / 96.53 Β±8.52 / 111.95 ms β 79.52 / 88.42 Β±6.20 / 98.03 ms β +1.09x faster β
βββββββββββββ΄βββββββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 3393.41ms β
β Total Time (rich-T-kid_coacler-benchmark) β 3331.73ms β
β Average Time (HEAD) β 154.25ms β
β Average Time (rich-T-kid_coacler-benchmark) β 151.44ms β
β Queries Faster β 4 β
β Queries Slower β 2 β
β Queries with No Change β 16 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpch β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 20.0s |
| Peak memory | 2.6 GiB |
| Avg memory | 1.1 GiB |
| CPU user | 106.0s |
| CPU sys | 9.0s |
| Peak spill | 0 B |
**tpch β branch**
| Metric | Value |
|--------|-------|
| Wall time | 20.0s |
| Peak memory | 2.6 GiB |
| Avg memory | 1.1 GiB |
| CPU user | 100.2s |
| CPU sys | 8.9s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745612476
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745546566)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 62.73 ms β 64.12 ms β no change β
β QQuery 2 β 312.69 ms β 311.59 ms β no change β
β QQuery 3 β 75.94 ms β 71.66 ms β +1.06x faster β
β QQuery 4 β 790.32 ms β 786.62 ms β no change β
β QQuery 5 β 376.49 ms β 355.80 ms β +1.06x faster β
β QQuery 6 β 160.69 ms β 151.90 ms β +1.06x faster β
β QQuery 7 β 115.57 ms β 113.02 ms β no change β
β QQuery 8 β 154.04 ms β 148.49 ms β no change β
β QQuery 9 β 237.89 ms β 237.29 ms β no change β
β QQuery 10 β 145.47 ms β 142.19 ms β no change β
β QQuery 11 β 508.92 ms β 508.55 ms β no change β
β QQuery 12 β 112.00 ms β 108.93 ms β no change β
β QQuery 13 β 268.87 ms β 276.99 ms β no change β
β QQuery 14 β 5393.08 ms β 1283.72 ms β +4.20x faster β
β QQuery 15 β 111.41 ms β 111.63 ms β no change β
β QQuery 16 β 65.41 ms β 65.08 ms β no change β
β QQuery 17 β 555.42 ms β 561.51 ms β no change β
β QQuery 18 β 536.68 ms β 537.32 ms β no change β
β QQuery 19 β 94.10 ms β 98.47 ms β no change β
β QQuery 20 β 118.35 ms β 112.37 ms β +1.05x faster β
β QQuery 21 β 67.89 ms β 68.96 ms β no change β
β QQuery 22 β 126.99 ms β 119.06 ms β +1.07x faster β
β QQuery 23 β 922.12 ms β 972.44 ms β 1.05x slower β
β QQuery 24 β 549.76 ms β 515.47 ms β +1.07x faster β
β QQuery 25 β 593.19 ms β 593.45 ms β no change β
β QQuery 26 β 92.90 ms β 88.37 ms β no change β
β QQuery 27 β 62.50 ms β 59.48 ms β no change β
β QQuery 28 β 124.15 ms β 120.42 ms β no change β
β QQuery 29 β 592.53 ms β 602.79 ms β no change β
β QQuery 30 β 188.41 ms β 175.97 ms β +1.07x faster β
β QQuery 31 β 473.43 ms β 460.47 ms β no change β
β QQuery 32 β 78.82 ms β 74.41 ms β +1.06x faster β
β QQuery 33 β 156.01 ms β 150.40 ms β no change β
β QQuery 34 β 65.66 ms β 63.43 ms β no change β
β QQuery 35 β 171.38 ms β 159.11 ms β +1.08x faster β
β QQuery 36 β 93.32 ms β 89.71 ms β no change β
β QQuery 37 β 49.78 ms β 46.21 ms β +1.08x faster β
β QQuery 38 β 207.98 ms β 201.84 ms β no change β
β QQuery 39 β 304.86 ms β 280.78 ms β +1.09x faster β
β QQuery 40 β 79.50 ms β 78.77 ms β no change β
β QQuery 41 β 93.47 ms β 88.04 ms β +1.06x faster β
β QQuery 42 β 71.16 ms β 70.56 ms β no change β
β QQuery 43 β 57.57 ms β 55.17 ms β no change β
β QQuery 44 β 159.33 ms β 138.70 ms β +1.15x faster β
β QQuery 45 β 104.83 ms β 101.53 ms β no change β
β QQuery 46 β 69.89 ms β 71.92 ms β no change β
β QQuery 47 β 541.32 ms β 516.31 ms β no change β
β QQuery 48 β 262.07 ms β 239.61 ms β +1.09x faster β
β QQuery 49 β 286.96 ms β 269.40 ms β +1.07x faster β
β QQuery 50 β 322.10 ms β 327.44 ms β no change β
β QQuery 51 β 322.03 ms β 324.96 ms β no change β
β QQuery 52 β 73.53 ms β 71.37 ms β no change β
β QQuery 53 β 116.60 ms β 111.05 ms β no change β
β QQuery 54 β 284.14 ms β 268.69 ms β +1.06x faster β
β QQuery 55 β 72.95 ms β 69.59 ms β no change β
β QQuery 56 β 126.72 ms β 122.96 ms β no change β
β QQuery 57 β 448.35 ms β 427.13 ms β no change β
β QQuery 58 β 252.59 ms β 244.91 ms β no change β
β QQuery 59 β 221.64 ms β 219.25 ms β no change β
β QQuery 60 β 124.47 ms β 120.68 ms β no change β
β QQuery 61 β 35.45 ms β 34.26 ms β no change β
β QQuery 62 β 105.08 ms β 105.87 ms β no change β
β QQuery 63 β 116.48 ms β 112.24 ms β no change β
β QQuery 64 β 2574.69 ms β 2569.20 ms β no change β
β QQuery 65 β 582.26 ms β 566.63 ms β no change β
β QQuery 66 β 207.83 ms β 218.52 ms β 1.05x slower β
β QQuery 67 β 400.61 ms β 366.79 ms β +1.09x faster β
β QQuery 68 β 72.79 ms β 68.35 ms β +1.06x faster β
β QQuery 69 β 140.88 ms β 137.44 ms β no change β
β QQuery 70 β 271.46 ms β 278.49 ms β no change β
β QQuery 71 β 104.85 ms β 98.78 ms β +1.06x faster β
β QQuery 72 β 5774.81 ms β 5775.39 ms β no change β
β QQuery 73 β 64.39 ms β 60.42 ms β +1.07x faster β
β QQuery 74 β 382.43 ms β 357.41 ms β +1.07x faster β
β QQuery 75 β 914.64 ms β 875.97 ms β no change β
β QQuery 76 β 171.60 ms β 165.66 ms β no change β
β QQuery 77 β 367.60 ms β 347.80 ms β +1.06x faster β
β QQuery 78 β 360.36 ms β 354.33 ms β no change β
β QQuery 79 β 132.85 ms β 128.54 ms β no change β
β QQuery 80 β 516.21 ms β 518.59 ms β no change β
β QQuery 81 β 180.32 ms β 175.50 ms β no change β
β QQuery 82 β 70.97 ms β 66.13 ms β +1.07x faster β
β QQuery 83 β 187.78 ms β 179.85 ms β no change β
β QQuery 84 β 74.07 ms β 71.73 ms β no change β
β QQuery 85 β 476.41 ms β 427.17 ms β +1.12x faster β
β QQuery 86 β 111.95 ms β 108.21 ms β no change β
β QQuery 87 β 221.85 ms β 199.98 ms β +1.11x faster β
β QQuery 88 β 169.31 ms β 162.38 ms β no change β
β QQuery 89 β 128.01 ms β 120.47 ms β +1.06x faster β
β QQuery 90 β 49.18 ms β 49.66 ms β no change β
β QQuery 91 β 106.98 ms β 107.49 ms β no change β
β QQuery 92 β 89.18 ms β 87.33 ms β no change β
β QQuery 93 β 227.64 ms β 227.77 ms β no change β
β QQuery 94 β 126.46 ms β 120.19 ms β no change β
β QQuery 95 β 483.44 ms β 516.46 ms β 1.07x slower β
β QQuery 96 β 41.60 ms β 42.15 ms β no change β
β QQuery 97 β 166.34 ms β 169.45 ms β no change β
β QQuery 98 β 125.05 ms β 124.34 ms β no change β
β QQuery 99 β 123.45 ms β 124.60 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 35666.21ms β
β Total Time (rich-T-kid_coacler-benchmark) β 31049.62ms β
β Average Time (HEAD) β 360.26ms β
β Average Time (rich-T-kid_coacler-benchmark) β 313.63ms β
β Queries Faster β 27 β
β Queries Slower β 3 β
β Queries with No Change β 69 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 62.73 / 64.28 Β±1.29 / 66.45 ms β 64.12 / 65.13 Β±1.15 / 67.33 ms β no change β
β QQuery 2 β 312.69 / 332.01 Β±15.53 / 360.00 ms β 311.59 / 321.48 Β±14.30 / 349.46 ms β no change β
β QQuery 3 β 75.94 / 78.42 Β±2.03 / 80.96 ms β 71.66 / 83.89 Β±13.41 / 109.62 ms β 1.07x slower β
β QQuery 4 β 790.32 / 803.74 Β±12.03 / 823.26 ms β 786.62 / 822.45 Β±24.55 / 862.15 ms β no change β
β QQuery 5 β 376.49 / 401.49 Β±15.95 / 418.15 ms β 355.80 / 391.22 Β±26.41 / 430.41 ms β no change β
β QQuery 6 β 160.69 / 171.31 Β±11.61 / 193.48 ms β 151.90 / 177.00 Β±23.58 / 211.00 ms β no change β
β QQuery 7 β 115.57 / 121.55 Β±9.71 / 140.90 ms β 113.02 / 118.81 Β±7.90 / 134.30 ms β no change β
β QQuery 8 β 154.04 / 158.40 Β±3.35 / 163.30 ms β 148.49 / 156.51 Β±5.75 / 165.95 ms β no change β
β QQuery 9 β 237.89 / 251.90 Β±12.81 / 274.73 ms β 237.29 / 253.55 Β±18.30 / 288.99 ms β no change β
β QQuery 10 β 145.47 / 152.02 Β±7.13 / 165.07 ms β 142.19 / 147.98 Β±4.40 / 154.79 ms β no change β
β QQuery 11 β 508.92 / 534.76 Β±20.17 / 562.39 ms β 508.55 / 551.28 Β±23.20 / 575.57 ms β no change β
β QQuery 12 β 112.00 / 120.33 Β±10.22 / 139.77 ms β 108.93 / 115.50 Β±10.10 / 135.54 ms β no change β
β QQuery 13 β 268.87 / 272.98 Β±3.19 / 278.02 ms β 276.99 / 286.46 Β±11.54 / 306.03 ms β no change β
β QQuery 14 β 5393.08 / 5754.89 Β±189.46 / 5938.10 ms β 1283.72 / 1351.61 Β±55.47 / 1445.37 ms β +4.26x faster β
β QQuery 15 β 111.41 / 127.93 Β±28.82 / 185.52 ms β 111.63 / 119.22 Β±12.13 / 143.37 ms β +1.07x faster β
β QQuery 16 β 65.41 / 72.99 Β±6.68 / 85.43 ms β 65.08 / 76.96 Β±14.01 / 103.64 ms β 1.05x slower β
β QQuery 17 β 555.42 / 582.60 Β±26.46 / 623.86 ms β 561.51 / 582.02 Β±11.07 / 593.35 ms β no change β
β QQuery 18 β 536.68 / 555.69 Β±14.69 / 577.13 ms β 537.32 / 550.46 Β±7.34 / 558.58 ms β no change β
β QQuery 19 β 94.10 / 102.26 Β±4.87 / 109.22 ms β 98.47 / 111.31 Β±12.59 / 134.59 ms β 1.09x slower β
β QQuery 20 β 118.35 / 126.76 Β±11.45 / 149.37 ms β 112.37 / 122.57 Β±10.40 / 139.79 ms β no change β
β QQuery 21 β 67.89 / 71.86 Β±3.25 / 77.66 ms β 68.96 / 73.40 Β±5.55 / 84.12 ms β no change β
β QQuery 22 β 126.99 / 139.60 Β±16.48 / 171.69 ms β 119.06 / 131.39 Β±11.51 / 150.31 ms β +1.06x faster β
β QQuery 23 β 922.12 / 965.75 Β±29.65 / 1014.59 ms β 972.44 / 987.57 Β±12.48 / 1010.15 ms β no change β
β QQuery 24 β 549.76 / 586.61 Β±29.36 / 628.59 ms β 515.47 / 526.03 Β±11.35 / 547.82 ms β +1.12x faster β
β QQuery 25 β 593.19 / 611.94 Β±17.72 / 635.23 ms β 593.45 / 608.22 Β±13.78 / 626.92 ms β no change β
β QQuery 26 β 92.90 / 102.05 Β±8.94 / 117.36 ms β 88.37 / 100.86 Β±16.31 / 133.12 ms β no change β
β QQuery 27 β 62.50 / 63.85 Β±0.88 / 64.75 ms β 59.48 / 67.33 Β±9.73 / 86.50 ms β 1.05x slower β
β QQuery 28 β 124.15 / 133.68 Β±10.79 / 153.90 ms β 120.42 / 123.46 Β±2.30 / 126.54 ms β +1.08x faster β
β QQuery 29 β 592.53 / 608.25 Β±16.21 / 634.95 ms β 602.79 / 635.23 Β±26.24 / 665.83 ms β no change β
β QQuery 30 β 188.41 / 197.98 Β±8.71 / 211.35 ms β 175.97 / 196.20 Β±17.58 / 219.93 ms β no change β
β QQuery 31 β 473.43 / 497.96 Β±20.83 / 523.50 ms β 460.47 / 482.28 Β±17.50 / 504.48 ms β no change β
β QQuery 32 β 78.82 / 89.48 Β±13.90 / 116.66 ms β 74.41 / 82.52 Β±12.32 / 106.83 ms β +1.08x faster β
β QQuery 33 β 156.01 / 177.33 Β±18.13 / 206.18 ms β 150.40 / 176.38 Β±21.63 / 207.26 ms β no change β
β QQuery 34 β 65.66 / 69.25 Β±3.28 / 75.40 ms β 63.43 / 67.02 Β±5.17 / 77.01 ms β no change β
β QQuery 35 β 171.38 / 183.95 Β±9.68 / 196.59 ms β 159.11 / 167.81 Β±9.16 / 185.49 ms β +1.10x faster β
β QQuery 36 β 93.32 / 98.83 Β±9.86 / 118.52 ms β 89.71 / 92.54 Β±4.14 / 100.72 ms β +1.07x faster β
β QQuery 37 β 49.78 / 52.81 Β±2.19 / 55.90 ms β 46.21 / 47.93 Β±0.91 / 48.87 ms β +1.10x faster β
β QQuery 38 β 207.98 / 222.36 Β±8.09 / 229.58 ms β 201.84 / 216.12 Β±8.69 / 227.89 ms β no change β
β QQuery 39 β 304.86 / 320.87 Β±13.24 / 339.45 ms β 280.78 / 306.20 Β±18.47 / 323.58 ms β no change β
β QQuery 40 β 79.50 / 84.90 Β±3.69 / 89.47 ms β 78.77 / 81.19 Β±2.01 / 84.19 ms β no change β
β QQuery 41 β 93.47 / 100.93 Β±7.71 / 115.84 ms β 88.04 / 92.36 Β±3.17 / 97.92 ms β +1.09x faster β
β QQuery 42 β 71.16 / 77.96 Β±7.28 / 91.42 ms β 70.56 / 74.93 Β±5.51 / 85.68 ms β no change β
β QQuery 43 β 57.57 / 60.44 Β±3.05 / 66.28 ms β 55.17 / 61.66 Β±9.38 / 79.89 ms β no change β
β QQuery 44 β 159.33 / 167.18 Β±6.26 / 175.15 ms β 138.70 / 158.81 Β±14.02 / 181.85 ms β +1.05x faster β
β QQuery 45 β 104.83 / 110.56 Β±6.25 / 122.67 ms β 101.53 / 104.94 Β±2.32 / 108.06 ms β +1.05x faster β
β QQuery 46 β 69.89 / 76.74 Β±5.93 / 87.40 ms β 71.92 / 76.93 Β±9.20 / 95.32 ms β no change β
β QQuery 47 β 541.32 / 551.84 Β±8.47 / 563.38 ms β 516.31 / 531.07 Β±8.90 / 540.86 ms β no change β
β QQuery 48 β 262.07 / 273.06 Β±7.24 / 284.32 ms β 239.61 / 252.58 Β±8.48 / 263.25 ms β +1.08x faster β
β QQuery 49 β 286.96 / 310.10 Β±25.42 / 359.41 ms β 269.40 / 284.54 Β±15.74 / 309.62 ms β +1.09x faster β
β QQuery 50 β 322.10 / 331.11 Β±6.57 / 340.79 ms β 327.44 / 337.49 Β±9.25 / 353.69 ms β no change β
β QQuery 51 β 322.03 / 329.79 Β±6.69 / 342.22 ms β 324.96 / 341.67 Β±17.04 / 365.37 ms β no change β
β QQuery 52 β 73.53 / 81.19 Β±8.16 / 95.99 ms β 71.37 / 78.28 Β±10.26 / 98.67 ms β no change β
β QQuery 53 β 116.60 / 122.47 Β±10.06 / 142.56 ms β 111.05 / 113.46 Β±2.33 / 117.10 ms β +1.08x faster β
β QQuery 54 β 284.14 / 295.03 Β±7.91 / 304.33 ms β 268.69 / 273.99 Β±5.49 / 284.11 ms β +1.08x faster β
β QQuery 55 β 72.95 / 80.82 Β±8.98 / 98.19 ms β 69.59 / 71.91 Β±1.72 / 74.27 ms β +1.12x faster β
β QQuery 56 β 126.72 / 137.10 Β±7.89 / 146.90 ms β 122.96 / 135.11 Β±17.08 / 168.58 ms β no change β
β QQuery 57 β 448.35 / 459.10 Β±8.32 / 470.38 ms β 427.13 / 444.19 Β±13.90 / 461.27 ms β no change β
β QQuery 58 β 252.59 / 262.72 Β±10.02 / 281.48 ms β 244.91 / 261.01 Β±12.92 / 281.52 ms β no change β
β QQuery 59 β 221.64 / 233.40 Β±9.88 / 250.95 ms β 219.25 / 234.40 Β±13.03 / 255.46 ms β no change β
β QQuery 60 β 124.47 / 127.81 Β±2.69 / 131.58 ms β 120.68 / 130.46 Β±7.31 / 140.23 ms β no change β
β QQuery 61 β 35.45 / 36.50 Β±1.08 / 38.45 ms β 34.26 / 44.11 Β±15.93 / 75.89 ms β 1.21x slower β
β QQuery 62 β 105.08 / 107.88 Β±4.78 / 117.37 ms β 105.87 / 109.73 Β±5.23 / 119.68 ms β no change β
β QQuery 63 β 116.48 / 122.46 Β±7.41 / 136.80 ms β 112.24 / 116.01 Β±2.99 / 120.88 ms β +1.06x faster β
β QQuery 64 β 2574.69 / 2590.83 Β±11.18 / 2609.77 ms β 2569.20 / 2625.34 Β±36.69 / 2684.61 ms β no change β
β QQuery 65 β 582.26 / 604.14 Β±12.02 / 616.07 ms β 566.63 / 587.60 Β±16.58 / 617.43 ms β no change β
β QQuery 66 β 207.83 / 227.20 Β±11.13 / 240.59 ms β 218.52 / 238.37 Β±28.61 / 294.53 ms β no change β
β QQuery 67 β 400.61 / 413.14 Β±10.84 / 432.34 ms β 366.79 / 377.63 Β±9.03 / 392.81 ms β +1.09x faster β
β QQuery 68 β 72.79 / 77.06 Β±5.45 / 87.14 ms β 68.35 / 73.54 Β±5.91 / 84.67 ms β no change β
β QQuery 69 β 140.88 / 157.64 Β±15.31 / 182.02 ms β 137.44 / 153.25 Β±13.25 / 177.46 ms β no change β
β QQuery 70 β 271.46 / 289.47 Β±13.24 / 311.07 ms β 278.49 / 291.07 Β±9.41 / 303.03 ms β no change β
β QQuery 71 β 104.85 / 113.50 Β±11.31 / 135.48 ms β 98.78 / 108.30 Β±11.17 / 130.12 ms β no change β
β QQuery 72 β 5774.81 / 5850.50 Β±39.20 / 5887.20 ms β 5775.39 / 5827.01 Β±36.76 / 5877.18 ms β no change β
β QQuery 73 β 64.39 / 71.01 Β±10.85 / 92.65 ms β 60.42 / 62.38 Β±1.14 / 63.56 ms β +1.14x faster β
β QQuery 74 β 382.43 / 394.55 Β±9.03 / 410.19 ms β 357.41 / 391.56 Β±33.79 / 455.13 ms β no change β
β QQuery 75 β 914.64 / 939.94 Β±19.82 / 963.73 ms β 875.97 / 897.02 Β±22.28 / 938.44 ms β no change β
β QQuery 76 β 171.60 / 183.18 Β±14.22 / 210.39 ms β 165.66 / 176.24 Β±13.43 / 202.18 ms β no change β
β QQuery 77 β 367.60 / 395.80 Β±28.83 / 446.59 ms β 347.80 / 371.17 Β±30.06 / 430.04 ms β +1.07x faster β
β QQuery 78 β 360.36 / 369.49 Β±9.09 / 386.31 ms β 354.33 / 369.91 Β±8.14 / 377.69 ms β no change β
β QQuery 79 β 132.85 / 140.17 Β±11.71 / 163.40 ms β 128.54 / 143.30 Β±16.92 / 172.30 ms β no change β
β QQuery 80 β 516.21 / 568.33 Β±39.64 / 618.03 ms β 518.59 / 543.56 Β±23.14 / 582.34 ms β no change β
β QQuery 81 β 180.32 / 184.19 Β±3.96 / 190.62 ms β 175.50 / 197.04 Β±20.04 / 224.01 ms β 1.07x slower β
β QQuery 82 β 70.97 / 74.31 Β±3.35 / 80.66 ms β 66.13 / 73.10 Β±4.97 / 80.87 ms β no change β
β QQuery 83 β 187.78 / 198.29 Β±15.77 / 229.46 ms β 179.85 / 187.62 Β±8.17 / 203.48 ms β +1.06x faster β
β QQuery 84 β 74.07 / 77.31 Β±2.41 / 80.94 ms β 71.73 / 74.63 Β±1.72 / 76.78 ms β no change β
β QQuery 85 β 476.41 / 531.86 Β±42.48 / 584.56 ms β 427.17 / 440.14 Β±13.53 / 459.32 ms β +1.21x faster β
β QQuery 86 β 111.95 / 116.71 Β±5.38 / 125.80 ms β 108.21 / 113.40 Β±6.35 / 125.63 ms β no change β
β QQuery 87 β 221.85 / 237.98 Β±11.41 / 257.14 ms β 199.98 / 221.37 Β±16.91 / 248.72 ms β +1.08x faster β
β QQuery 88 β 169.31 / 171.55 Β±2.67 / 176.31 ms β 162.38 / 173.95 Β±8.42 / 184.33 ms β no change β
β QQuery 89 β 128.01 / 136.56 Β±5.97 / 145.99 ms β 120.47 / 127.15 Β±5.73 / 137.55 ms β +1.07x faster β
β QQuery 90 β 49.18 / 50.89 Β±1.27 / 52.93 ms β 49.66 / 56.27 Β±8.11 / 71.78 ms β 1.11x slower β
β QQuery 91 β 106.98 / 111.94 Β±3.53 / 117.88 ms β 107.49 / 109.70 Β±1.29 / 111.30 ms β no change β
β QQuery 92 β 89.18 / 91.19 Β±2.05 / 94.02 ms β 87.33 / 90.97 Β±2.31 / 94.14 ms β no change β
β QQuery 93 β 227.64 / 236.65 Β±8.71 / 253.05 ms β 227.77 / 234.32 Β±7.40 / 248.70 ms β no change β
β QQuery 94 β 126.46 / 137.94 Β±12.00 / 160.46 ms β 120.19 / 127.00 Β±5.36 / 136.32 ms β +1.09x faster β
β QQuery 95 β 483.44 / 495.80 Β±7.23 / 502.65 ms β 516.46 / 527.22 Β±6.37 / 533.49 ms β 1.06x slower β
β QQuery 96 β 41.60 / 50.24 Β±14.10 / 78.16 ms β 42.15 / 43.88 Β±1.36 / 45.88 ms β +1.15x faster β
β QQuery 97 β 166.34 / 169.19 Β±2.75 / 174.33 ms β 169.45 / 176.64 Β±9.80 / 195.89 ms β no change β
β QQuery 98 β 125.05 / 134.63 Β±10.01 / 153.89 ms β 124.34 / 130.26 Β±3.01 / 132.30 ms β no change β
β QQuery 99 β 123.45 / 132.87 Β±10.69 / 153.78 ms β 124.60 / 127.67 Β±3.16 / 133.59 ms β no change β
βββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 37247.85ms β
β Total Time (rich-T-kid_coacler-benchmark) β 32374.29ms β
β Average Time (HEAD) β 376.24ms β
β Average Time (rich-T-kid_coacler-benchmark) β 327.01ms β
β Queries Faster β 27 β
β Queries Slower β 8 β
β Queries with No Change β 64 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpcds β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 190.0s |
| Peak memory | 10.1 GiB |
| Avg memory | 1.6 GiB |
| CPU user | 979.1s |
| CPU sys | 60.3s |
| Peak spill | 0 B |
**tpcds β branch**
| Metric | Value |
|--------|-------|
| Wall time | 165.0s |
| Peak memory | 2.6 GiB |
| Avg memory | 1.4 GiB |
| CPU user | 977.3s |
| CPU sys | 58.0s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745675964
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745657661)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5745657661-2511-5bz6c 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (50b4aadf9bd59b1681e8c222be535966e84155d7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..50b4aadf9bd59b1681e8c222be535966e84155d7)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745657661
run benchmarks
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: 256
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746617182
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5746605348)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5746605348-2521-2rtnr 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (ef7543e040ffbfe7da6bd2c2b70bd2db2721cac7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ef7543e040ffbfe7da6bd2c2b70bd2db2721cac7)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch10
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746470019
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5746435338)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (50b4aadf9bd59b1681e8c222be535966e84155d7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..50b4aadf9bd59b1681e8c222be535966e84155d7)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 41.22 ms β 40.87 ms β no change β
β QQuery 2 β 19.14 ms β 18.83 ms β no change β
β QQuery 3 β 29.11 ms β 28.67 ms β no change β
β QQuery 4 β 17.54 ms β 17.60 ms β no change β
β QQuery 5 β 35.76 ms β 36.31 ms β no change β
β QQuery 6 β 16.54 ms β 16.31 ms β no change β
β QQuery 7 β 42.78 ms β 40.98 ms β no change β
β QQuery 8 β 40.96 ms β 40.72 ms β no change β
β QQuery 9 β 51.08 ms β 50.58 ms β no change β
β QQuery 10 β 41.34 ms β 40.80 ms β no change β
β QQuery 11 β 13.82 ms β 13.81 ms β no change β
β QQuery 12 β 21.18 ms β 21.13 ms β no change β
β QQuery 13 β 40.75 ms β 41.56 ms β no change β
β QQuery 14 β 24.91 ms β 25.03 ms β no change β
β QQuery 15 β 32.16 ms β 31.61 ms β no change β
β QQuery 16 β 14.45 ms β 14.56 ms β no change β
β QQuery 17 β 76.27 ms β 71.06 ms β +1.07x faster β
β QQuery 18 β 62.90 ms β 62.59 ms β no change β
β QQuery 19 β 32.27 ms β 32.13 ms β no change β
β QQuery 20 β 32.51 ms β 32.52 ms β no change β
β QQuery 21 β 57.24 ms β 57.22 ms β no change β
β QQuery 22 β 14.36 ms β 14.44 ms β no change β
βββββββββββββ΄βββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 758.30ms β
β Total Time (rich-T-kid_coacler-benchmark) β 749.31ms β
β Average Time (HEAD) β 34.47ms β
β Average Time (rich-T-kid_coacler-benchmark) β 34.06ms β
β Queries Faster β 1 β
β Queries Slower β 0 β
β Queries with No Change β 21 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 41.22 / 41.73 Β±0.77 / 43.24 ms β 40.87 / 41.65 Β±1.09 / 43.80 ms β no change β
β QQuery 2 β 19.14 / 19.81 Β±0.70 / 21.14 ms β 18.83 / 19.27 Β±0.38 / 19.97 ms β no change β
β QQuery 3 β 29.11 / 29.74 Β±0.85 / 31.40 ms β 28.67 / 28.93 Β±0.24 / 29.34 ms β no change β
β QQuery 4 β 17.54 / 17.96 Β±0.57 / 19.08 ms β 17.60 / 18.04 Β±0.56 / 19.14 ms β no change β
β QQuery 5 β 35.76 / 36.23 Β±0.34 / 36.76 ms β 36.31 / 36.99 Β±1.15 / 39.29 ms β no change β
β QQuery 6 β 16.54 / 16.59 Β±0.05 / 16.68 ms β 16.31 / 16.73 Β±0.48 / 17.67 ms β no change β
β QQuery 7 β 42.78 / 44.93 Β±2.78 / 50.40 ms β 40.98 / 42.54 Β±1.09 / 43.79 ms β +1.06x faster β
β QQuery 8 β 40.96 / 41.74 Β±0.81 / 43.31 ms β 40.72 / 41.40 Β±0.82 / 43.02 ms β no change β
β QQuery 9 β 51.08 / 51.72 Β±1.08 / 53.87 ms β 50.58 / 51.07 Β±0.37 / 51.49 ms β no change β
β QQuery 10 β 41.34 / 42.30 Β±0.97 / 43.83 ms β 40.80 / 41.29 Β±0.30 / 41.56 ms β no change β
β QQuery 11 β 13.82 / 14.09 Β±0.16 / 14.26 ms β 13.81 / 14.18 Β±0.51 / 15.19 ms β no change β
β QQuery 12 β 21.18 / 21.68 Β±0.36 / 22.20 ms β 21.13 / 21.48 Β±0.21 / 21.80 ms β no change β
β QQuery 13 β 40.75 / 41.46 Β±0.41 / 41.90 ms β 41.56 / 42.77 Β±2.07 / 46.90 ms β no change β
β QQuery 14 β 24.91 / 25.05 Β±0.17 / 25.36 ms β 25.03 / 25.30 Β±0.15 / 25.48 ms β no change β
β QQuery 15 β 32.16 / 33.40 Β±0.69 / 34.23 ms β 31.61 / 32.24 Β±0.65 / 33.27 ms β no change β
β QQuery 16 β 14.45 / 14.76 Β±0.16 / 14.91 ms β 14.56 / 14.71 Β±0.14 / 14.89 ms β no change β
β QQuery 17 β 76.27 / 77.90 Β±1.43 / 80.37 ms β 71.06 / 74.27 Β±3.21 / 79.93 ms β no change β
β QQuery 18 β 62.90 / 64.29 Β±0.96 / 65.43 ms β 62.59 / 64.05 Β±1.35 / 66.33 ms β no change β
β QQuery 19 β 32.27 / 32.52 Β±0.19 / 32.75 ms β 32.13 / 32.51 Β±0.21 / 32.74 ms β no change β
β QQuery 20 β 32.51 / 32.74 Β±0.19 / 33.02 ms β 32.52 / 32.86 Β±0.22 / 33.17 ms β no change β
β QQuery 21 β 57.24 / 58.88 Β±1.90 / 62.61 ms β 57.22 / 59.38 Β±1.32 / 60.99 ms β no change β
β QQuery 22 β 14.36 / 14.61 Β±0.20 / 14.95 ms β 14.44 / 14.57 Β±0.08 / 14.65 ms β no change β
βββββββββββββ΄βββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 774.14ms β
β Total Time (rich-T-kid_coacler-benchmark) β 766.24ms β
β Average Time (HEAD) β 35.19ms β
β Average Time (rich-T-kid_coacler-benchmark) β 34.83ms β
β Queries Faster β 1 β
β Queries Slower β 0 β
β Queries with No Change β 21 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpch β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 5.0s |
| Peak memory | 1.3 GiB |
| Avg memory | 507.3 MiB |
| CPU user | 21.8s |
| CPU sys | 1.8s |
| Peak spill | 0 B |
**tpch β branch**
| Metric | Value |
|--------|-------|
| Wall time | 5.0s |
| Peak memory | 1.3 GiB |
| Avg memory | 533.4 MiB |
| CPU user | 21.4s |
| CPU sys | 1.8s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739782489
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739768539)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5739768539-2476-6lqdt 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (dbfc4e87e81f5ae40f150fa37700863a165cd991) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..dbfc4e87e81f5ae40f150fa37700863a165cd991)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739782484
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739768986)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5739768986-2480-hlmc6 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (dbfc4e87e81f5ae40f150fa37700863a165cd991) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..dbfc4e87e81f5ae40f150fa37700863a165cd991)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5736766800
run benchmarks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5736881952
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5736766800)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (76e1f1c24138317d60fc604b72283008fad49b6a) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..76e1f1c24138317d60fc604b72283008fad49b6a)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³βββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 5.41 ms β 5.43 ms β no change β
β QQuery 2 β 79.74 ms β 80.26 ms β no change β
β QQuery 3 β 28.35 ms β 28.89 ms β no change β
β QQuery 4 β 426.71 ms β 448.58 ms β 1.05x slower β
β QQuery 5 β 50.62 ms β 51.03 ms β no change β
β QQuery 6 β 34.88 ms β 35.93 ms β no change β
β QQuery 7 β 73.85 ms β 74.93 ms β no change β
β QQuery 8 β 35.41 ms β 36.63 ms β no change β
β QQuery 9 β 53.40 ms β 52.95 ms β no change β
β QQuery 10 β 61.39 ms β 61.95 ms β no change β
β QQuery 11 β 256.28 ms β 285.98 ms β 1.12x slower β
β QQuery 12 β 28.12 ms β 29.34 ms β no change β
β QQuery 13 β 116.66 ms β 115.98 ms β no change β
β QQuery 14 β 389.18 ms β 392.59 ms β no change β
β QQuery 15 β 51.96 ms β 52.76 ms β no change β
β QQuery 16 β 6.39 ms β 6.33 ms β no change β
β QQuery 17 β 77.27 ms β 78.44 ms β no change β
β QQuery 18 β 101.97 ms β 102.76 ms β no change β
β QQuery 19 β 40.55 ms β 41.47 ms β no change β
β QQuery 20 β 34.58 ms β 35.16 ms β no change β
β QQuery 21 β 16.34 ms β 16.59 ms β no change β
β QQuery 22 β 62.31 ms β 63.31 ms β no change β
β QQuery 23 β 304.35 ms β 307.64 ms β no change β
β QQuery 24 β 188.63 ms β 190.73 ms β no change β
β QQuery 25 β 106.96 ms β 110.44 ms β no change β
β QQuery 26 β 47.86 ms β 47.30 ms β no change β
β QQuery 27 β 5.84 ms β 5.81 ms β no change β
β QQuery 28 β 57.04 ms β 60.23 ms β 1.06x slower β
β QQuery 29 β 92.67 ms β 95.99 ms β no change β
β QQuery 30 β 32.83 ms β 32.52 ms β no change β
β QQuery 31 β 107.10 ms β 110.47 ms β no change β
β QQuery 32 β 19.87 ms β 20.52 ms β no change β
β QQuery 33 β 36.78 ms β 37.95 ms β no change β
β QQuery 34 β 10.35 ms β 10.61 ms β no change β
β QQuery 35 β 72.21 ms β 72.52 ms β no change β
β QQuery 36 β 5.55 ms β 5.68 ms β no change β
β QQuery 37 β 6.60 ms β 6.77 ms β no change β
β QQuery 38 β 59.71 ms β 62.07 ms β no change β
β QQuery 39 β 72.25 ms β 73.20 ms β no change β
β QQuery 40 β 23.53 ms β 24.26 ms β no change β
β QQuery 41 β 10.92 ms β 11.58 ms β 1.06x slower β
β QQuery 42 β 23.49 ms β 24.10 ms β no change β
β QQuery 43 β 4.97 ms β 5.09 ms β no change β
β QQuery 44 β 8.94 ms β 9.15 ms β no change β
β QQuery 45 β 36.91 ms β 37.63 ms β no change β
β QQuery 46 β 11.34 ms β 12.05 ms β 1.06x slower β
β QQuery 47 β 217.74 ms β 224.12 ms β no change β
β QQuery 48 β 92.86 ms β 94.85 ms β no change β
β QQuery 49 β 70.14 ms β 69.94 ms β no change β
β QQuery 50 β 57.20 ms β 58.14 ms β no change β
β QQuery 51 β 92.10 ms β 93.19 ms β no change β
β QQuery 52 β 23.89 ms β 24.48 ms β no change β
β QQuery 53 β 28.34 ms β 29.65 ms β no change β
β QQuery 54 β 53.10 ms β 54.56 ms β no change β
β QQuery 55 β 23.20 ms β 23.95 ms β no change β
β QQuery 56 β 38.83 ms β 39.36 ms β no change β
β QQuery 57 β 167.53 ms β 169.58 ms β no change β
β QQuery 58 β 107.75 ms β 110.16 ms β no change β
β QQuery 59 β 115.34 ms β 117.70 ms β no change β
β QQuery 60 β 38.48 ms β 39.38 ms β no change β
β QQuery 61 β 11.26 ms β 11.93 ms β 1.06x slower β
β QQuery 62 β 43.40 ms β 44.33 ms β no change β
β QQuery 63 β 28.40 ms β 29.46 ms β no change β
β QQuery 64 β 356.80 ms β 361.38 ms β no change β
β QQuery 65 β 131.11 ms β 135.20 ms β no change β
β QQuery 66 β 75.83 ms β 77.34 ms β no change β
β QQuery 67 β 242.35 ms β 256.83 ms β 1.06x slower β
β QQuery 68 β 11.70 ms β 12.10 ms β no change β
β QQuery 69 β 56.10 ms β 56.77 ms β no change β
β QQuery 70 β 102.64 ms β 105.25 ms β no change β
β QQuery 71 β 34.69 ms β 35.73 ms β no change β
β QQuery 72 β 1801.14 ms β 1785.34 ms β no change β
β QQuery 73 β 9.68 ms β 10.18 ms β 1.05x slower β
β QQuery 74 β 151.34 ms β 169.74 ms β 1.12x slower β
β QQuery 75 β 141.15 ms β 145.05 ms β no change β
β QQuery 76 β 33.97 ms β 34.54 ms β no change β
β QQuery 77 β 59.60 ms β 60.83 ms β no change β
β QQuery 78 β 157.44 ms β 162.68 ms β no change β
β QQuery 79 β 66.06 ms β 66.37 ms β no change β
β QQuery 80 β 94.29 ms β 97.25 ms β no change β
β QQuery 81 β 25.43 ms β 26.20 ms β no change β
β QQuery 82 β 16.14 ms β 16.50 ms β no change β
β QQuery 83 β 32.85 ms β 33.72 ms β no change β
β QQuery 84 β 29.10 ms β 30.06 ms β no change β
β QQuery 85 β 101.90 ms β 103.49 ms β no change β
β QQuery 86 β 24.97 ms β 25.69 ms β no change β
β QQuery 87 β 60.30 ms β 62.81 ms β no change β
β QQuery 88 β 60.12 ms β 61.31 ms β no change β
β QQuery 89 β 35.08 ms β 34.96 ms β no change β
β QQuery 90 β 16.18 ms β 16.79 ms β no change β
β QQuery 91 β 43.76 ms β 44.25 ms β no change β
β QQuery 92 β 28.77 ms β 29.71 ms β no change β
β QQuery 93 β 47.89 ms β 49.99 ms β no change β
β QQuery 94 β 37.50 ms β 38.32 ms β no change β
β QQuery 95 β 77.87 ms β 75.43 ms β no change β
β QQuery 96 β 23.07 ms β 23.88 ms β no change β
β QQuery 97 β 50.51 ms β 51.10 ms β no change β
β QQuery 98 β 42.53 ms β 43.84 ms β no change β
β QQuery 99 β 65.00 ms β 65.79 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄βββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 8932.47ms β
β Total Time (rich-T-kid_coacler-benchmark) β 9112.78ms β
β Average Time (HEAD) β 90.23ms β
β Average Time (rich-T-kid_coacler-benchmark) β 92.05ms β
β Queries Faster β 0 β
β Queries Slower β 9 β
β Queries with No Change β 90 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 5.41 / 5.99 Β±1.02 / 8.02 ms β 5.43 / 6.03 Β±0.94 / 7.89 ms β no change β
β QQuery 2 β 79.74 / 79.94 Β±0.19 / 80.19 ms β 80.26 / 80.47 Β±0.11 / 80.57 ms β no change β
β QQuery 3 β 28.35 / 28.59 Β±0.21 / 28.90 ms β 28.89 / 29.14 Β±0.18 / 29.39 ms β no change β
β QQuery 4 β 426.71 / 429.53 Β±2.89 / 434.81 ms β 448.58 / 454.26 Β±4.55 / 458.73 ms β 1.06x slower β
β QQuery 5 β 50.62 / 50.78 Β±0.18 / 51.13 ms β 51.03 / 53.07 Β±2.46 / 57.77 ms β no change β
β QQuery 6 β 34.88 / 35.49 Β±0.40 / 36.01 ms β 35.93 / 36.47 Β±0.39 / 36.95 ms β no change β
β QQuery 7 β 73.85 / 75.48 Β±1.69 / 78.60 ms β 74.93 / 75.86 Β±1.03 / 77.86 ms β no change β
β QQuery 8 β 35.41 / 35.80 Β±0.31 / 36.27 ms β 36.63 / 36.83 Β±0.17 / 37.08 ms β no change β
β QQuery 9 β 53.40 / 54.03 Β±0.74 / 55.47 ms β 52.95 / 55.22 Β±1.63 / 57.44 ms β no change β
β QQuery 10 β 61.39 / 62.55 Β±1.19 / 64.83 ms β 61.95 / 62.18 Β±0.19 / 62.44 ms β no change β
β QQuery 11 β 256.28 / 260.02 Β±3.73 / 266.76 ms β 285.98 / 306.65 Β±14.44 / 324.45 ms β 1.18x slower β
β QQuery 12 β 28.12 / 28.38 Β±0.39 / 29.15 ms β 29.34 / 30.93 Β±2.24 / 35.36 ms β 1.09x slower β
β QQuery 13 β 116.66 / 117.12 Β±0.50 / 118.06 ms β 115.98 / 117.77 Β±1.32 / 119.75 ms β no change β
β QQuery 14 β 389.18 / 394.09 Β±3.57 / 400.08 ms β 392.59 / 399.59 Β±6.30 / 410.48 ms β no change β
β QQuery 15 β 51.96 / 52.89 Β±0.87 / 54.52 ms β 52.76 / 53.36 Β±0.41 / 53.98 ms β no change β
β QQuery 16 β 6.39 / 6.52 Β±0.18 / 6.87 ms β 6.33 / 7.98 Β±2.60 / 13.15 ms β 1.22x slower β
β QQuery 17 β 77.27 / 77.84 Β±0.38 / 78.46 ms β 78.44 / 80.27 Β±1.85 / 83.82 ms β no change β
β QQuery 18 β 101.97 / 103.41 Β±1.33 / 105.13 ms β 102.76 / 104.45 Β±1.98 / 108.02 ms β no change β
β QQuery 19 β 40.55 / 40.93 Β±0.33 / 41.43 ms β 41.47 / 41.87 Β±0.27 / 42.31 ms β no change β
β QQuery 20 β 34.58 / 34.98 Β±0.38 / 35.62 ms β 35.16 / 35.55 Β±0.33 / 35.92 ms β no change β
β QQuery 21 β 16.34 / 17.13 Β±0.67 / 18.36 ms β 16.59 / 16.85 Β±0.27 / 17.35 ms β no change β
β QQuery 22 β 62.31 / 63.05 Β±0.71 / 64.39 ms β 63.31 / 64.62 Β±1.98 / 68.56 ms β no change β
β QQuery 23 β 304.35 / 310.83 Β±5.84 / 321.85 ms β 307.64 / 309.96 Β±1.27 / 311.11 ms β no change β
β QQuery 24 β 188.63 / 191.08 Β±2.30 / 194.67 ms β 190.73 / 192.18 Β±0.81 / 193.02 ms β no change β
β QQuery 25 β 106.96 / 107.49 Β±0.30 / 107.79 ms β 110.44 / 111.92 Β±1.23 / 113.61 ms β no change β
β QQuery 26 β 47.86 / 48.26 Β±0.28 / 48.66 ms β 47.30 / 47.83 Β±0.42 / 48.45 ms β no change β
β QQuery 27 β 5.84 / 5.99 Β±0.18 / 6.34 ms β 5.81 / 6.07 Β±0.23 / 6.48 ms β no change β
β QQuery 28 β 57.04 / 59.32 Β±1.49 / 60.86 ms β 60.23 / 60.83 Β±0.59 / 61.96 ms β no change β
β QQuery 29 β 92.67 / 94.13 Β±0.83 / 94.99 ms β 95.99 / 99.97 Β±4.74 / 108.55 ms β 1.06x slower β
β QQuery 30 β 32.83 / 35.05 Β±3.07 / 41.05 ms β 32.52 / 32.87 Β±0.25 / 33.19 ms β +1.07x faster β
β QQuery 31 β 107.10 / 107.99 Β±0.87 / 109.54 ms β 110.47 / 111.94 Β±2.28 / 116.48 ms β no change β
β QQuery 32 β 19.87 / 20.07 Β±0.20 / 20.45 ms β 20.52 / 21.15 Β±0.73 / 22.47 ms β 1.05x slower β
β QQuery 33 β 36.78 / 37.12 Β±0.33 / 37.70 ms β 37.95 / 38.52 Β±0.47 / 39.19 ms β no change β
β QQuery 34 β 10.35 / 12.26 Β±3.39 / 19.03 ms β 10.61 / 10.81 Β±0.20 / 11.20 ms β +1.13x faster β
β QQuery 35 β 72.21 / 73.52 Β±0.91 / 74.91 ms β 72.52 / 74.15 Β±1.46 / 76.80 ms β no change β
β QQuery 36 β 5.55 / 5.69 Β±0.26 / 6.21 ms β 5.68 / 5.89 Β±0.19 / 6.24 ms β no change β
β QQuery 37 β 6.60 / 6.70 Β±0.06 / 6.78 ms β 6.77 / 6.91 Β±0.15 / 7.11 ms β no change β
β QQuery 38 β 59.71 / 60.68 Β±0.68 / 61.79 ms β 62.07 / 62.90 Β±0.71 / 63.99 ms β no change β
β QQuery 39 β 72.25 / 74.59 Β±3.46 / 81.48 ms β 73.20 / 74.13 Β±0.50 / 74.59 ms β no change β
β QQuery 40 β 23.53 / 23.77 Β±0.18 / 24.03 ms β 24.26 / 24.70 Β±0.34 / 25.02 ms β no change β
β QQuery 41 β 10.92 / 11.05 Β±0.11 / 11.22 ms β 11.58 / 11.64 Β±0.06 / 11.74 ms β 1.05x slower β
β QQuery 42 β 23.49 / 23.82 Β±0.29 / 24.18 ms β 24.10 / 24.43 Β±0.35 / 25.08 ms β no change β
β QQuery 43 β 4.97 / 5.10 Β±0.20 / 5.49 ms β 5.09 / 5.28 Β±0.23 / 5.73 ms β no change β
β QQuery 44 β 8.94 / 9.01 Β±0.08 / 9.11 ms β 9.15 / 9.38 Β±0.23 / 9.82 ms β no change β
β QQuery 45 β 36.91 / 38.43 Β±1.16 / 40.10 ms β 37.63 / 39.47 Β±2.94 / 45.32 ms β no change β
β QQuery 46 β 11.34 / 11.98 Β±0.50 / 12.56 ms β 12.05 / 12.75 Β±0.43 / 13.22 ms β 1.06x slower β
β QQuery 47 β 217.74 / 222.21 Β±4.97 / 231.50 ms β 224.12 / 230.46 Β±3.32 / 233.75 ms β no change β
β QQuery 48 β 92.86 / 94.85 Β±2.09 / 98.55 ms β 94.85 / 95.25 Β±0.38 / 95.97 ms β no change β
β QQuery 49 β 70.14 / 70.55 Β±0.37 / 71.05 ms β 69.94 / 73.11 Β±3.67 / 80.27 ms β no change β
β QQuery 50 β 57.20 / 57.91 Β±0.45 / 58.58 ms β 58.14 / 58.36 Β±0.22 / 58.74 ms β no change β
β QQuery 51 β 92.10 / 94.68 Β±3.24 / 100.96 ms β 93.19 / 94.75 Β±1.27 / 96.80 ms β no change β
β QQuery 52 β 23.89 / 24.14 Β±0.27 / 24.61 ms β 24.48 / 24.79 Β±0.22 / 25.05 ms β no change β
β QQuery 53 β 28.34 / 28.74 Β±0.42 / 29.55 ms β 29.65 / 31.63 Β±3.37 / 38.35 ms β 1.10x slower β
β QQuery 54 β 53.10 / 53.33 Β±0.23 / 53.67 ms β 54.56 / 55.06 Β±0.38 / 55.64 ms β no change β
β QQuery 55 β 23.20 / 26.04 Β±3.75 / 33.47 ms β 23.95 / 24.37 Β±0.26 / 24.73 ms β +1.07x faster β
β QQuery 56 β 38.83 / 39.30 Β±0.53 / 40.33 ms β 39.36 / 39.86 Β±0.62 / 41.09 ms β no change β
β QQuery 57 β 167.53 / 170.62 Β±3.16 / 175.67 ms β 169.58 / 171.34 Β±2.91 / 177.13 ms β no change β
β QQuery 58 β 107.75 / 109.09 Β±1.01 / 110.57 ms β 110.16 / 111.38 Β±1.04 / 112.70 ms β no change β
β QQuery 59 β 115.34 / 117.85 Β±3.11 / 123.85 ms β 117.70 / 118.08 Β±0.32 / 118.55 ms β no change β
β QQuery 60 β 38.48 / 39.51 Β±0.92 / 40.82 ms β 39.38 / 40.59 Β±0.76 / 41.77 ms β no change β
β QQuery 61 β 11.26 / 11.47 Β±0.22 / 11.88 ms β 11.93 / 12.02 Β±0.10 / 12.19 ms β no change β
β QQuery 62 β 43.40 / 44.52 Β±1.22 / 46.86 ms β 44.33 / 46.26 Β±3.04 / 52.32 ms β no change β
β QQuery 63 β 28.40 / 28.70 Β±0.32 / 29.14 ms β 29.46 / 29.91 Β±0.31 / 30.37 ms β no change β
β QQuery 64 β 356.80 / 364.45 Β±6.41 / 375.16 ms β 361.38 / 368.64 Β±5.19 / 377.60 ms β no change β
β QQuery 65 β 131.11 / 133.29 Β±1.55 / 135.63 ms β 135.20 / 137.01 Β±1.68 / 140.13 ms β no change β
β QQuery 66 β 75.83 / 76.45 Β±0.57 / 77.31 ms β 77.34 / 79.85 Β±3.50 / 86.72 ms β no change β
β QQuery 67 β 242.35 / 246.90 Β±2.72 / 249.30 ms β 256.83 / 262.96 Β±4.15 / 268.95 ms β 1.07x slower β
β QQuery 68 β 11.70 / 14.91 Β±5.55 / 25.98 ms β 12.10 / 12.25 Β±0.11 / 12.43 ms β +1.22x faster β
β QQuery 69 β 56.10 / 56.59 Β±0.39 / 57.11 ms β 56.77 / 57.07 Β±0.24 / 57.46 ms β no change β
β QQuery 70 β 102.64 / 105.19 Β±1.68 / 107.15 ms β 105.25 / 109.76 Β±6.00 / 121.49 ms β no change β
β QQuery 71 β 34.69 / 37.77 Β±4.10 / 45.72 ms β 35.73 / 36.08 Β±0.32 / 36.64 ms β no change β
β QQuery 72 β 1801.14 / 1854.19 Β±44.69 / 1907.50 ms β 1785.34 / 1834.41 Β±40.81 / 1891.61 ms β no change β
β QQuery 73 β 9.68 / 10.15 Β±0.48 / 11.03 ms β 10.18 / 10.72 Β±0.36 / 11.27 ms β 1.06x slower β
β QQuery 74 β 151.34 / 155.27 Β±3.54 / 161.41 ms β 169.74 / 171.77 Β±3.15 / 178.02 ms β 1.11x slower β
β QQuery 75 β 141.15 / 141.93 Β±0.62 / 142.98 ms β 145.05 / 146.18 Β±0.75 / 147.23 ms β no change β
β QQuery 76 β 33.97 / 34.13 Β±0.09 / 34.24 ms β 34.54 / 35.53 Β±0.68 / 36.48 ms β no change β
β QQuery 77 β 59.60 / 60.44 Β±0.76 / 61.81 ms β 60.83 / 61.24 Β±0.39 / 61.96 ms β no change β
β QQuery 78 β 157.44 / 163.73 Β±5.63 / 173.35 ms β 162.68 / 167.55 Β±3.81 / 174.30 ms β no change β
β QQuery 79 β 66.06 / 66.99 Β±1.25 / 69.41 ms β 66.37 / 69.50 Β±5.52 / 80.51 ms β no change β
β QQuery 80 β 94.29 / 95.68 Β±1.02 / 96.86 ms β 97.25 / 99.12 Β±1.39 / 101.29 ms β no change β
β QQuery 81 β 25.43 / 27.67 Β±3.70 / 35.06 ms β 26.20 / 26.56 Β±0.43 / 27.39 ms β no change β
β QQuery 82 β 16.14 / 16.33 Β±0.16 / 16.50 ms β 16.50 / 16.69 Β±0.13 / 16.89 ms β no change β
β QQuery 83 β 32.85 / 33.14 Β±0.21 / 33.43 ms β 33.72 / 33.95 Β±0.17 / 34.21 ms β no change β
β QQuery 84 β 29.10 / 29.43 Β±0.43 / 30.26 ms β 30.06 / 32.26 Β±3.94 / 40.12 ms β 1.10x slower β
β QQuery 85 β 101.90 / 103.28 Β±1.24 / 105.48 ms β 103.49 / 104.92 Β±0.75 / 105.67 ms β no change β
β QQuery 86 β 24.97 / 27.76 Β±4.72 / 37.16 ms β 25.69 / 26.15 Β±0.34 / 26.73 ms β +1.06x faster β
β QQuery 87 β 60.30 / 61.49 Β±1.10 / 63.34 ms β 62.81 / 64.36 Β±2.51 / 69.35 ms β no change β
β QQuery 88 β 60.12 / 60.84 Β±0.79 / 62.24 ms β 61.31 / 62.09 Β±0.42 / 62.53 ms β no change β
β QQuery 89 β 35.08 / 35.44 Β±0.35 / 35.94 ms β 34.96 / 35.62 Β±0.39 / 36.04 ms β no change β
β QQuery 90 β 16.18 / 16.50 Β±0.24 / 16.88 ms β 16.79 / 17.11 Β±0.23 / 17.41 ms β no change β
β QQuery 91 β 43.76 / 46.77 Β±3.97 / 54.57 ms β 44.25 / 44.53 Β±0.21 / 44.75 ms β no change β
β QQuery 92 β 28.77 / 29.52 Β±0.55 / 30.38 ms β 29.71 / 31.72 Β±3.13 / 37.94 ms β 1.07x slower β
β QQuery 93 β 47.89 / 49.43 Β±1.07 / 50.70 ms β 49.99 / 50.43 Β±0.40 / 51.01 ms β no change β
β QQuery 94 β 37.50 / 38.62 Β±0.98 / 39.86 ms β 38.32 / 39.05 Β±0.79 / 40.60 ms β no change β
β QQuery 95 β 77.87 / 79.80 Β±1.01 / 80.80 ms β 75.43 / 77.35 Β±1.54 / 79.49 ms β no change β
β QQuery 96 β 23.07 / 23.58 Β±0.46 / 24.15 ms β 23.88 / 23.96 Β±0.09 / 24.09 ms β no change β
β QQuery 97 β 50.51 / 52.32 Β±1.87 / 55.45 ms β 51.10 / 52.11 Β±0.76 / 53.16 ms β no change β
β QQuery 98 β 42.53 / 43.90 Β±1.09 / 45.19 ms β 43.84 / 45.06 Β±1.06 / 46.92 ms β no change β
β QQuery 99 β 65.00 / 67.39 Β±4.31 / 76.00 ms β 65.79 / 66.11 Β±0.23 / 66.41 ms β no change β
βββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 9123.30ms β
β Total Time (rich-T-kid_coacler-benchmark) β 9311.99ms β
β Average Time (HEAD) β 92.15ms β
β Average Time (rich-T-kid_coacler-benchmark) β 94.06ms β
β Queries Faster β 5 β
β Queries Slower β 14 β
β Queries with No Change β 80 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpcds β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 50.0s |
| Peak memory | 2.0 GiB |
| Avg memory | 1.3 GiB |
| CPU user | 196.9s |
| CPU sys | 5.7s |
| Peak spill | 0 B |
**tpcds β branch**
| Metric | Value |
|--------|-------|
| Wall time | 50.0s |
| Peak memory | 1.9 GiB |
| Avg memory | 1.3 GiB |
| CPU user | 201.8s |
| CPU sys | 6.1s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739449736
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739391357)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 5.47 ms β 5.47 ms β no change β
β QQuery 2 β 79.50 ms β 79.73 ms β no change β
β QQuery 3 β 28.48 ms β 28.16 ms β no change β
β QQuery 4 β 430.29 ms β 419.27 ms β no change β
β QQuery 5 β 49.43 ms β 49.50 ms β no change β
β QQuery 6 β 34.75 ms β 35.14 ms β no change β
β QQuery 7 β 72.84 ms β 73.50 ms β no change β
β QQuery 8 β 35.17 ms β 35.47 ms β no change β
β QQuery 9 β 52.05 ms β 52.94 ms β no change β
β QQuery 10 β 60.76 ms β 61.09 ms β no change β
β QQuery 11 β 260.00 ms β 257.76 ms β no change β
β QQuery 12 β 28.13 ms β 28.07 ms β no change β
β QQuery 13 β 115.03 ms β 115.14 ms β no change β
β QQuery 14 β 389.43 ms β 385.46 ms β no change β
β QQuery 15 β 51.80 ms β 52.56 ms β no change β
β QQuery 16 β 6.30 ms β 6.22 ms β no change β
β QQuery 17 β 76.21 ms β 76.88 ms β no change β
β QQuery 18 β 102.51 ms β 102.15 ms β no change β
β QQuery 19 β 40.52 ms β 40.61 ms β no change β
β QQuery 20 β 34.59 ms β 34.19 ms β no change β
β QQuery 21 β 16.51 ms β 16.43 ms β no change β
β QQuery 22 β 62.16 ms β 61.40 ms β no change β
β QQuery 23 β 300.65 ms β 306.47 ms β no change β
β QQuery 24 β 187.98 ms β 185.88 ms β no change β
β QQuery 25 β 105.01 ms β 106.52 ms β no change β
β QQuery 26 β 47.41 ms β 47.26 ms β no change β
β QQuery 27 β 5.96 ms β 5.84 ms β no change β
β QQuery 28 β 60.00 ms β 59.80 ms β no change β
β QQuery 29 β 92.40 ms β 92.66 ms β no change β
β QQuery 30 β 32.61 ms β 32.15 ms β no change β
β QQuery 31 β 107.21 ms β 105.79 ms β no change β
β QQuery 32 β 19.68 ms β 19.48 ms β no change β
β QQuery 33 β 36.48 ms β 36.43 ms β no change β
β QQuery 34 β 9.74 ms β 9.87 ms β no change β
β QQuery 35 β 72.41 ms β 70.55 ms β no change β
β QQuery 36 β 5.50 ms β 5.47 ms β no change β
β QQuery 37 β 6.65 ms β 6.74 ms β no change β
β QQuery 38 β 60.58 ms β 59.71 ms β no change β
β QQuery 39 β 72.29 ms β 71.82 ms β no change β
β QQuery 40 β 23.62 ms β 22.42 ms β +1.05x faster β
β QQuery 41 β 10.92 ms β 10.79 ms β no change β
β QQuery 42 β 23.55 ms β 23.08 ms β no change β
β QQuery 43 β 5.01 ms β 4.95 ms β no change β
β QQuery 44 β 8.92 ms β 8.90 ms β no change β
β QQuery 45 β 37.46 ms β 36.16 ms β no change β
β QQuery 46 β 11.78 ms β 11.21 ms β no change β
β QQuery 47 β 220.66 ms β 213.69 ms β no change β
β QQuery 48 β 93.36 ms β 93.17 ms β no change β
β QQuery 49 β 69.23 ms β 68.58 ms β no change β
β QQuery 50 β 56.85 ms β 57.35 ms β no change β
β QQuery 51 β 90.83 ms β 91.57 ms β no change β
β QQuery 52 β 23.64 ms β 23.17 ms β no change β
β QQuery 53 β 28.74 ms β 28.01 ms β no change β
β QQuery 54 β 52.76 ms β 52.68 ms β no change β
β QQuery 55 β 23.18 ms β 22.83 ms β no change β
β QQuery 56 β 37.49 ms β 37.27 ms β no change β
β QQuery 57 β 166.68 ms β 164.11 ms β no change β
β QQuery 58 β 107.24 ms β 105.92 ms β no change β
β QQuery 59 β 115.38 ms β 114.92 ms β no change β
β QQuery 60 β 38.35 ms β 37.93 ms β no change β
β QQuery 61 β 11.14 ms β 11.16 ms β no change β
β QQuery 62 β 43.53 ms β 43.01 ms β no change β
β QQuery 63 β 28.76 ms β 28.30 ms β no change β
β QQuery 64 β 358.45 ms β 353.63 ms β no change β
β QQuery 65 β 128.40 ms β 130.70 ms β no change β
β QQuery 66 β 77.01 ms β 75.20 ms β no change β
β QQuery 67 β 248.80 ms β 237.97 ms β no change β
β QQuery 68 β 11.93 ms β 11.40 ms β no change β
β QQuery 69 β 55.61 ms β 54.89 ms β no change β
β QQuery 70 β 104.06 ms β 101.65 ms β no change β
β QQuery 71 β 35.55 ms β 33.89 ms β no change β
β QQuery 72 β 1739.67 ms β 1768.72 ms β no change β
β QQuery 73 β 9.46 ms β 9.40 ms β no change β
β QQuery 74 β 151.11 ms β 150.05 ms β no change β
β QQuery 75 β 138.59 ms β 139.81 ms β no change β
β QQuery 76 β 34.08 ms β 33.75 ms β no change β
β QQuery 77 β 59.22 ms β 58.80 ms β no change β
β QQuery 78 β 162.48 ms β 158.23 ms β no change β
β QQuery 79 β 65.35 ms β 64.95 ms β no change β
β QQuery 80 β 94.15 ms β 95.34 ms β no change β
β QQuery 81 β 25.69 ms β 25.38 ms β no change β
β QQuery 82 β 15.96 ms β 15.58 ms β no change β
β QQuery 83 β 32.74 ms β 32.87 ms β no change β
β QQuery 84 β 29.11 ms β 29.14 ms β no change β
β QQuery 85 β 101.52 ms β 100.38 ms β no change β
β QQuery 86 β 24.45 ms β 24.11 ms β no change β
β QQuery 87 β 59.99 ms β 59.18 ms β no change β
β QQuery 88 β 59.93 ms β 59.43 ms β no change β
β QQuery 89 β 34.62 ms β 34.43 ms β no change β
β QQuery 90 β 16.30 ms β 16.01 ms β no change β
β QQuery 91 β 43.78 ms β 43.47 ms β no change β
β QQuery 92 β 28.58 ms β 27.60 ms β no change β
β QQuery 93 β 47.42 ms β 50.23 ms β 1.06x slower β
β QQuery 94 β 37.12 ms β 36.62 ms β no change β
β QQuery 95 β 78.51 ms β 77.03 ms β no change β
β QQuery 96 β 23.18 ms β 23.17 ms β no change β
β QQuery 97 β 50.87 ms β 50.69 ms β no change β
β QQuery 98 β 42.08 ms β 41.50 ms β no change β
β QQuery 99 β 65.19 ms β 64.66 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 8874.45ms β
β Total Time (rich-T-kid_coacler-benchmark) β 8840.63ms β
β Average Time (HEAD) β 89.64ms β
β Average Time (rich-T-kid_coacler-benchmark) β 89.30ms β
β Queries Faster β 1 β
β Queries Slower β 1 β
β Queries with No Change β 97 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 5.47 / 6.06 Β±1.00 / 8.07 ms β 5.47 / 6.05 Β±1.00 / 8.06 ms β no change β
β QQuery 2 β 79.50 / 79.97 Β±0.30 / 80.35 ms β 79.73 / 80.19 Β±0.29 / 80.50 ms β no change β
β QQuery 3 β 28.48 / 28.69 Β±0.20 / 29.03 ms β 28.16 / 28.40 Β±0.20 / 28.69 ms β no change β
β QQuery 4 β 430.29 / 438.24 Β±6.44 / 448.29 ms β 419.27 / 428.39 Β±5.92 / 437.57 ms β no change β
β QQuery 5 β 49.43 / 49.81 Β±0.32 / 50.41 ms β 49.50 / 49.92 Β±0.64 / 51.20 ms β no change β
β QQuery 6 β 34.75 / 35.61 Β±0.56 / 36.43 ms β 35.14 / 36.97 Β±2.27 / 41.35 ms β no change β
β QQuery 7 β 72.84 / 73.47 Β±0.61 / 74.62 ms β 73.50 / 74.02 Β±0.59 / 75.05 ms β no change β
β QQuery 8 β 35.17 / 35.55 Β±0.31 / 36.03 ms β 35.47 / 35.90 Β±0.40 / 36.52 ms β no change β
β QQuery 9 β 52.05 / 55.06 Β±4.06 / 63.03 ms β 52.94 / 53.49 Β±0.53 / 54.47 ms β no change β
β QQuery 10 β 60.76 / 61.87 Β±0.68 / 62.46 ms β 61.09 / 62.19 Β±1.34 / 64.78 ms β no change β
β QQuery 11 β 260.00 / 264.69 Β±4.53 / 271.34 ms β 257.76 / 264.12 Β±5.03 / 271.51 ms β no change β
β QQuery 12 β 28.13 / 28.58 Β±0.38 / 29.22 ms β 28.07 / 28.38 Β±0.20 / 28.70 ms β no change β
β QQuery 13 β 115.03 / 116.90 Β±1.81 / 120.20 ms β 115.14 / 117.19 Β±3.04 / 123.21 ms β no change β
β QQuery 14 β 389.43 / 394.61 Β±3.42 / 398.62 ms β 385.46 / 389.67 Β±3.16 / 394.86 ms β no change β
β QQuery 15 β 51.80 / 53.51 Β±1.29 / 55.69 ms β 52.56 / 53.05 Β±0.69 / 54.41 ms β no change β
β QQuery 16 β 6.30 / 6.43 Β±0.21 / 6.85 ms β 6.22 / 6.43 Β±0.19 / 6.77 ms β no change β
β QQuery 17 β 76.21 / 77.06 Β±0.63 / 78.08 ms β 76.88 / 77.35 Β±0.29 / 77.70 ms β no change β
β QQuery 18 β 102.51 / 103.10 Β±0.45 / 103.70 ms β 102.15 / 103.60 Β±1.23 / 105.51 ms β no change β
β QQuery 19 β 40.52 / 40.90 Β±0.22 / 41.08 ms β 40.61 / 40.94 Β±0.29 / 41.36 ms β no change β
β QQuery 20 β 34.59 / 35.14 Β±0.39 / 35.65 ms β 34.19 / 34.59 Β±0.36 / 35.26 ms β no change β
β QQuery 21 β 16.51 / 16.83 Β±0.26 / 17.15 ms β 16.43 / 16.51 Β±0.08 / 16.64 ms β no change β
β QQuery 22 β 62.16 / 65.62 Β±3.71 / 72.74 ms β 61.40 / 62.42 Β±0.64 / 63.39 ms β no change β
β QQuery 23 β 300.65 / 308.25 Β±4.00 / 312.51 ms β 306.47 / 311.15 Β±3.21 / 315.81 ms β no change β
β QQuery 24 β 187.98 / 194.09 Β±6.36 / 205.97 ms β 185.88 / 191.60 Β±4.46 / 197.08 ms β no change β
β QQuery 25 β 105.01 / 106.87 Β±1.61 / 108.85 ms β 106.52 / 109.11 Β±1.78 / 111.93 ms β no change β
β QQuery 26 β 47.41 / 48.41 Β±1.25 / 50.88 ms β 47.26 / 47.46 Β±0.13 / 47.62 ms β no change β
β QQuery 27 β 5.96 / 6.07 Β±0.08 / 6.18 ms β 5.84 / 6.00 Β±0.18 / 6.32 ms β no change β
β QQuery 28 β 60.00 / 60.40 Β±0.25 / 60.71 ms β 59.80 / 60.35 Β±0.31 / 60.60 ms β no change β
β QQuery 29 β 92.40 / 94.80 Β±2.38 / 98.24 ms β 92.66 / 94.96 Β±3.78 / 102.49 ms β no change β
β QQuery 30 β 32.61 / 34.55 Β±2.38 / 39.20 ms β 32.15 / 32.74 Β±0.53 / 33.50 ms β +1.06x faster β
β QQuery 31 β 107.21 / 108.29 Β±1.07 / 110.08 ms β 105.79 / 106.28 Β±0.28 / 106.60 ms β no change β
β QQuery 32 β 19.68 / 20.21 Β±0.35 / 20.69 ms β 19.48 / 19.84 Β±0.33 / 20.45 ms β no change β
β QQuery 33 β 36.48 / 37.17 Β±0.57 / 37.89 ms β 36.43 / 38.51 Β±3.28 / 45.02 ms β no change β
β QQuery 34 β 9.74 / 11.63 Β±2.29 / 15.86 ms β 9.87 / 10.63 Β±0.74 / 11.96 ms β +1.09x faster β
β QQuery 35 β 72.41 / 73.15 Β±0.77 / 74.59 ms β 70.55 / 71.09 Β±0.61 / 72.24 ms β no change β
β QQuery 36 β 5.50 / 5.71 Β±0.22 / 6.12 ms β 5.47 / 5.60 Β±0.24 / 6.07 ms β no change β
β QQuery 37 β 6.65 / 6.77 Β±0.10 / 6.94 ms β 6.74 / 6.86 Β±0.12 / 7.07 ms β no change β
β QQuery 38 β 60.58 / 61.50 Β±0.55 / 62.06 ms β 59.71 / 60.29 Β±0.34 / 60.57 ms β no change β
β QQuery 39 β 72.29 / 74.34 Β±2.67 / 79.30 ms β 71.82 / 74.16 Β±2.87 / 79.80 ms β no change β
β QQuery 40 β 23.62 / 23.98 Β±0.43 / 24.70 ms β 22.42 / 23.27 Β±0.60 / 24.28 ms β no change β
β QQuery 41 β 10.92 / 11.18 Β±0.15 / 11.36 ms β 10.79 / 10.93 Β±0.10 / 11.05 ms β no change β
β QQuery 42 β 23.55 / 23.99 Β±0.58 / 25.03 ms β 23.08 / 23.24 Β±0.11 / 23.36 ms β no change β
β QQuery 43 β 5.01 / 5.14 Β±0.19 / 5.50 ms β 4.95 / 5.07 Β±0.15 / 5.37 ms β no change β
β QQuery 44 β 8.92 / 9.04 Β±0.09 / 9.17 ms β 8.90 / 9.02 Β±0.07 / 9.07 ms β no change β
β QQuery 45 β 37.46 / 38.76 Β±1.04 / 40.53 ms β 36.16 / 36.99 Β±0.64 / 38.12 ms β no change β
β QQuery 46 β 11.78 / 12.10 Β±0.35 / 12.76 ms β 11.21 / 11.89 Β±0.54 / 12.84 ms β no change β
β QQuery 47 β 220.66 / 224.13 Β±3.21 / 229.77 ms β 213.69 / 217.34 Β±4.69 / 226.32 ms β no change β
β QQuery 48 β 93.36 / 94.00 Β±0.90 / 95.71 ms β 93.17 / 93.98 Β±0.82 / 95.27 ms β no change β
β QQuery 49 β 69.23 / 69.61 Β±0.22 / 69.88 ms β 68.58 / 69.36 Β±0.44 / 69.75 ms β no change β
β QQuery 50 β 56.85 / 57.20 Β±0.24 / 57.56 ms β 57.35 / 57.80 Β±0.49 / 58.75 ms β no change β
β QQuery 51 β 90.83 / 95.37 Β±3.54 / 101.65 ms β 91.57 / 93.99 Β±1.28 / 95.41 ms β no change β
β QQuery 52 β 23.64 / 23.85 Β±0.16 / 24.03 ms β 23.17 / 23.36 Β±0.24 / 23.83 ms β no change β
β QQuery 53 β 28.74 / 29.54 Β±1.54 / 32.62 ms β 28.01 / 28.19 Β±0.09 / 28.27 ms β no change β
β QQuery 54 β 52.76 / 53.43 Β±0.59 / 54.39 ms β 52.68 / 53.15 Β±0.43 / 53.76 ms β no change β
β QQuery 55 β 23.18 / 25.06 Β±3.48 / 32.01 ms β 22.83 / 24.67 Β±3.25 / 31.15 ms β no change β
β QQuery 56 β 37.49 / 38.43 Β±0.83 / 39.82 ms β 37.27 / 37.94 Β±0.44 / 38.53 ms β no change β
β QQuery 57 β 166.68 / 169.19 Β±1.51 / 170.91 ms β 164.11 / 166.72 Β±1.73 / 168.94 ms β no change β
β QQuery 58 β 107.24 / 108.86 Β±2.03 / 112.80 ms β 105.92 / 107.41 Β±1.08 / 108.70 ms β no change β
β QQuery 59 β 115.38 / 115.60 Β±0.23 / 116.03 ms β 114.92 / 116.31 Β±1.42 / 119.04 ms β no change β
β QQuery 60 β 38.35 / 39.28 Β±0.91 / 40.91 ms β 37.93 / 38.69 Β±0.65 / 39.91 ms β no change β
β QQuery 61 β 11.14 / 11.40 Β±0.21 / 11.78 ms β 11.16 / 11.42 Β±0.25 / 11.89 ms β no change β
β QQuery 62 β 43.53 / 44.82 Β±1.72 / 48.20 ms β 43.01 / 43.33 Β±0.28 / 43.84 ms β no change β
β QQuery 63 β 28.76 / 29.25 Β±0.47 / 29.91 ms β 28.30 / 28.69 Β±0.51 / 29.69 ms β no change β
β QQuery 64 β 358.45 / 361.74 Β±2.54 / 365.31 ms β 353.63 / 357.47 Β±5.37 / 368.07 ms β no change β
β QQuery 65 β 128.40 / 131.68 Β±2.07 / 134.07 ms β 130.70 / 134.06 Β±4.01 / 141.62 ms β no change β
β QQuery 66 β 77.01 / 78.13 Β±1.85 / 81.80 ms β 75.20 / 76.13 Β±0.61 / 76.70 ms β no change β
β QQuery 67 β 248.80 / 254.86 Β±6.36 / 264.45 ms β 237.97 / 243.43 Β±5.58 / 250.81 ms β no change β
β QQuery 68 β 11.93 / 15.24 Β±5.65 / 26.52 ms β 11.40 / 11.59 Β±0.23 / 12.04 ms β +1.32x faster β
β QQuery 69 β 55.61 / 56.32 Β±0.46 / 56.93 ms β 54.89 / 58.69 Β±6.33 / 71.32 ms β no change β
β QQuery 70 β 104.06 / 105.03 Β±1.41 / 107.80 ms β 101.65 / 103.93 Β±1.73 / 106.91 ms β no change β
β QQuery 71 β 35.55 / 38.49 Β±5.53 / 49.54 ms β 33.89 / 34.45 Β±0.36 / 35.03 ms β +1.12x faster β
β QQuery 72 β 1739.67 / 1787.66 Β±44.42 / 1868.51 ms β 1768.72 / 1798.00 Β±20.54 / 1829.36 ms β no change β
β QQuery 73 β 9.46 / 11.54 Β±2.95 / 17.30 ms β 9.40 / 9.77 Β±0.38 / 10.51 ms β +1.18x faster β
β QQuery 74 β 151.11 / 152.96 Β±2.23 / 157.10 ms β 150.05 / 153.04 Β±2.73 / 157.58 ms β no change β
β QQuery 75 β 138.59 / 139.89 Β±1.33 / 141.65 ms β 139.81 / 142.98 Β±4.42 / 151.58 ms β no change β
β QQuery 76 β 34.08 / 34.43 Β±0.28 / 34.94 ms β 33.75 / 34.16 Β±0.23 / 34.38 ms β no change β
β QQuery 77 β 59.22 / 59.50 Β±0.20 / 59.83 ms β 58.80 / 59.31 Β±0.49 / 60.21 ms β no change β
β QQuery 78 β 162.48 / 164.54 Β±2.96 / 170.33 ms β 158.23 / 165.69 Β±7.96 / 180.86 ms β no change β
β QQuery 79 β 65.35 / 67.98 Β±4.21 / 76.35 ms β 64.95 / 65.56 Β±0.52 / 66.38 ms β no change β
β QQuery 80 β 94.15 / 95.34 Β±0.90 / 96.82 ms β 95.34 / 97.92 Β±2.53 / 102.56 ms β no change β
β QQuery 81 β 25.69 / 25.99 Β±0.17 / 26.19 ms β 25.38 / 25.63 Β±0.15 / 25.83 ms β no change β
β QQuery 82 β 15.96 / 16.26 Β±0.19 / 16.51 ms β 15.58 / 15.89 Β±0.16 / 16.04 ms β no change β
β QQuery 83 β 32.74 / 33.04 Β±0.21 / 33.37 ms β 32.87 / 33.88 Β±1.70 / 37.27 ms β no change β
β QQuery 84 β 29.11 / 31.05 Β±3.22 / 37.46 ms β 29.14 / 29.52 Β±0.26 / 29.82 ms β no change β
β QQuery 85 β 101.52 / 102.78 Β±1.48 / 105.66 ms β 100.38 / 104.36 Β±6.28 / 116.86 ms β no change β
β QQuery 86 β 24.45 / 24.88 Β±0.24 / 25.11 ms β 24.11 / 24.37 Β±0.40 / 25.15 ms β no change β
β QQuery 87 β 59.99 / 62.61 Β±3.38 / 69.25 ms β 59.18 / 60.03 Β±0.60 / 60.99 ms β no change β
β QQuery 88 β 59.93 / 60.23 Β±0.34 / 60.87 ms β 59.43 / 63.06 Β±5.13 / 73.21 ms β no change β
β QQuery 89 β 34.62 / 34.77 Β±0.18 / 35.12 ms β 34.43 / 35.16 Β±0.51 / 35.80 ms β no change β
β QQuery 90 β 16.30 / 17.04 Β±1.12 / 19.28 ms β 16.01 / 16.21 Β±0.19 / 16.51 ms β no change β
β QQuery 91 β 43.78 / 44.19 Β±0.44 / 44.97 ms β 43.47 / 44.39 Β±1.55 / 47.47 ms β no change β
β QQuery 92 β 28.58 / 28.75 Β±0.15 / 29.02 ms β 27.60 / 28.12 Β±0.68 / 29.44 ms β no change β
β QQuery 93 β 47.42 / 50.44 Β±4.06 / 58.41 ms β 50.23 / 52.21 Β±2.58 / 57.30 ms β no change β
β QQuery 94 β 37.12 / 37.50 Β±0.37 / 37.96 ms β 36.62 / 37.45 Β±0.45 / 37.92 ms β no change β
β QQuery 95 β 78.51 / 79.30 Β±0.92 / 81.07 ms β 77.03 / 77.96 Β±1.01 / 79.92 ms β no change β
β QQuery 96 β 23.18 / 23.41 Β±0.21 / 23.79 ms β 23.17 / 23.34 Β±0.16 / 23.63 ms β no change β
β QQuery 97 β 50.87 / 52.69 Β±1.44 / 54.97 ms β 50.69 / 53.29 Β±4.48 / 62.24 ms β no change β
β QQuery 98 β 42.08 / 42.71 Β±0.56 / 43.68 ms β 41.50 / 42.45 Β±0.49 / 42.85 ms β no change β
β QQuery 99 β 65.19 / 65.80 Β±0.90 / 67.57 ms β 64.66 / 65.01 Β±0.29 / 65.34 ms β no change β
βββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 9061.95ms β
β Total Time (rich-T-kid_coacler-benchmark) β 9007.66ms β
β Average Time (HEAD) β 91.53ms β
β Average Time (rich-T-kid_coacler-benchmark) β 90.99ms β
β Queries Faster β 5 β
β Queries Slower β 0 β
β Queries with No Change β 94 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpcds β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 50.0s |
| Peak memory | 1.9 GiB |
| Avg memory | 1.3 GiB |
| CPU user | 197.2s |
| CPU sys | 5.3s |
| Peak spill | 0 B |
**tpcds β branch**
| Metric | Value |
|--------|-------|
| Wall time | 50.0s |
| Peak memory | 2.0 GiB |
| Avg memory | 1.3 GiB |
| CPU user | 196.1s |
| CPU sys | 5.0s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739397449
run benchmarks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5743240679
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5743214143)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5743214143-2484-5xjz2 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5743232569
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5743214143)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5743214143-2485-9ht75 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746617215
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5746603297)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5746603297-2520-9plgs 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (ef7543e040ffbfe7da6bd2c2b70bd2db2721cac7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ef7543e040ffbfe7da6bd2c2b70bd2db2721cac7)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746651651
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5746607186)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (ef7543e040ffbfe7da6bd2c2b70bd2db2721cac7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ef7543e040ffbfe7da6bd2c2b70bd2db2721cac7)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch_mem10
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_mem_sf10.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 219.27 ms β 216.83 ms β no change β
β QQuery 2 β 49.58 ms β 47.73 ms β no change β
β QQuery 3 β 86.33 ms β 98.57 ms β 1.14x slower β
β QQuery 4 β 63.51 ms β 73.15 ms β 1.15x slower β
β QQuery 5 β 175.87 ms β 188.35 ms β 1.07x slower β
β QQuery 6 β 57.06 ms β 57.15 ms β no change β
β QQuery 7 β 340.26 ms β 359.32 ms β 1.06x slower β
β QQuery 8 β 120.04 ms β 123.22 ms β no change β
β QQuery 9 β 285.31 ms β 276.03 ms β no change β
β QQuery 10 β 136.57 ms β 138.51 ms β no change β
β QQuery 11 β 29.66 ms β 24.90 ms β +1.19x faster β
β QQuery 12 β 107.28 ms β 112.23 ms β no change β
β QQuery 13 β 166.52 ms β 175.39 ms β 1.05x slower β
β QQuery 14 β 30.77 ms β 31.17 ms β no change β
β QQuery 15 β 67.72 ms β 69.19 ms β no change β
β QQuery 16 β 44.53 ms β 44.18 ms β no change β
β QQuery 17 β 351.51 ms β 374.25 ms β 1.06x slower β
β QQuery 18 β 763.81 ms β 775.72 ms β no change β
β QQuery 19 β 90.66 ms β 91.45 ms β no change β
β QQuery 20 β 105.78 ms β 107.41 ms β no change β
β QQuery 21 β 1215.41 ms β 1138.76 ms β +1.07x faster β
β QQuery 22 β 24.67 ms β 27.68 ms β 1.12x slower β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 4532.12ms β
β Total Time (rich-T-kid_coacler-benchmark) β 4551.19ms β
β Average Time (HEAD) β 206.01ms β
β Average Time (rich-T-kid_coacler-benchmark) β 206.87ms β
β Queries Faster β 2 β
β Queries Slower β 7 β
β Queries with No Change β 13 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_mem_sf10.json
--------------------
βββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 219.27 / 221.57 Β±1.48 / 223.36 ms β 216.83 / 218.57 Β±1.73 / 221.90 ms β no change β
β QQuery 2 β 49.58 / 51.25 Β±2.12 / 55.32 ms β 47.73 / 50.10 Β±1.65 / 52.74 ms β no change β
β QQuery 3 β 86.33 / 88.71 Β±1.75 / 91.45 ms β 98.57 / 99.48 Β±1.13 / 101.42 ms β 1.12x slower β
β QQuery 4 β 63.51 / 66.07 Β±1.93 / 68.58 ms β 73.15 / 74.30 Β±1.45 / 77.10 ms β 1.12x slower β
β QQuery 5 β 175.87 / 176.92 Β±0.68 / 177.75 ms β 188.35 / 190.84 Β±2.42 / 195.44 ms β 1.08x slower β
β QQuery 6 β 57.06 / 58.76 Β±2.48 / 63.60 ms β 57.15 / 57.33 Β±0.16 / 57.53 ms β no change β
β QQuery 7 β 340.26 / 355.43 Β±12.69 / 369.80 ms β 359.32 / 364.29 Β±4.29 / 372.03 ms β no change β
β QQuery 8 β 120.04 / 122.71 Β±1.90 / 125.92 ms β 123.22 / 126.10 Β±1.92 / 127.82 ms β no change β
β QQuery 9 β 285.31 / 291.14 Β±4.66 / 297.62 ms β 276.03 / 292.12 Β±17.64 / 323.62 ms β no change β
β QQuery 10 β 136.57 / 139.55 Β±2.59 / 144.31 ms β 138.51 / 141.36 Β±2.84 / 145.77 ms β no change β
β QQuery 11 β 29.66 / 30.21 Β±0.77 / 31.69 ms β 24.90 / 27.90 Β±2.45 / 30.59 ms β +1.08x faster β
β QQuery 12 β 107.28 / 112.68 Β±5.25 / 120.65 ms β 112.23 / 116.11 Β±2.56 / 118.94 ms β no change β
β QQuery 13 β 166.52 / 173.00 Β±6.91 / 185.58 ms β 175.39 / 178.25 Β±2.00 / 181.34 ms β no change β
β QQuery 14 β 30.77 / 31.47 Β±0.91 / 33.26 ms β 31.17 / 32.82 Β±1.44 / 35.16 ms β no change β
β QQuery 15 β 67.72 / 68.30 Β±0.54 / 69.19 ms β 69.19 / 70.72 Β±1.46 / 73.33 ms β no change β
β QQuery 16 β 44.53 / 46.61 Β±2.51 / 51.53 ms β 44.18 / 45.46 Β±2.02 / 49.46 ms β no change β
β QQuery 17 β 351.51 / 354.16 Β±2.57 / 358.41 ms β 374.25 / 376.61 Β±1.80 / 379.07 ms β 1.06x slower β
β QQuery 18 β 763.81 / 808.15 Β±33.06 / 860.94 ms β 775.72 / 812.50 Β±19.86 / 833.26 ms β no change β
β QQuery 19 β 90.66 / 103.80 Β±15.44 / 133.45 ms β 91.45 / 110.60 Β±22.72 / 146.64 ms β 1.07x slower β
β QQuery 20 β 105.78 / 108.72 Β±3.01 / 113.90 ms β 107.41 / 113.66 Β±9.66 / 132.72 ms β no change β
β QQuery 21 β 1215.41 / 1235.66 Β±26.04 / 1286.60 ms β 1138.76 / 1214.44 Β±53.54 / 1306.42 ms β no change β
β QQuery 22 β 24.67 / 24.88 Β±0.21 / 25.25 ms β 27.68 / 28.05 Β±0.23 / 28.29 ms β 1.13x slower β
βββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 4669.74ms β
β Total Time (rich-T-kid_coacler-benchmark) β 4741.60ms β
β Average Time (HEAD) β 212.26ms β
β Average Time (rich-T-kid_coacler-benchmark) β 215.53ms β
β Queries Faster β 1 β
β Queries Slower β 6 β
β Queries with No Change β 15 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpch_mem10 β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 35.0s |
| Peak memory | 41.2 GiB |
| Avg memory | 24.6 GiB |
| CPU user | 192.7s |
| CPU sys | 6.0s |
| Peak spill | 0 B |
**tpch_mem10 β branch**
| Metric | Value |
|--------|-------|
| Wall time | 35.0s |
| Peak memory | 42.3 GiB |
| Avg memory | 24.9 GiB |
| CPU user | 203.4s |
| CPU sys | 5.5s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5743302022
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5743214675)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.22 ms β 1.24 ms β no change β
β QQuery 1 β 11.50 ms β 11.66 ms β no change β
β QQuery 2 β 36.68 ms β 36.96 ms β no change β
β QQuery 3 β 31.06 ms β 31.13 ms β no change β
β QQuery 4 β 235.72 ms β 240.00 ms β no change β
β QQuery 5 β 275.23 ms β 274.57 ms β no change β
β QQuery 6 β 1.31 ms β 1.25 ms β no change β
β QQuery 7 β 12.92 ms β 12.88 ms β no change β
β QQuery 8 β 327.45 ms β 336.29 ms β no change β
β QQuery 9 β 468.33 ms β 464.09 ms β no change β
β QQuery 10 β 63.89 ms β 66.56 ms β no change β
β QQuery 11 β 74.18 ms β 77.02 ms β no change β
β QQuery 12 β 263.45 ms β 265.50 ms β no change β
β QQuery 13 β 356.65 ms β 378.50 ms β 1.06x slower β
β QQuery 14 β 277.24 ms β 283.72 ms β no change β
β QQuery 15 β 283.77 ms β 287.17 ms β no change β
β QQuery 16 β 630.65 ms β 624.96 ms β no change β
β QQuery 17 β 667.72 ms β 637.65 ms β no change β
β QQuery 18 β 1352.24 ms β 1259.47 ms β +1.07x faster β
β QQuery 19 β 29.57 ms β 29.67 ms β no change β
β QQuery 20 β 520.58 ms β 522.80 ms β no change β
β QQuery 21 β 517.44 ms β 511.12 ms β no change β
β QQuery 22 β 981.34 ms β 1014.20 ms β no change β
β QQuery 23 β 3017.75 ms β 3081.37 ms β no change β
β QQuery 24 β 39.90 ms β 39.52 ms β no change β
β QQuery 25 β 104.09 ms β 104.72 ms β no change β
β QQuery 26 β 40.36 ms β 40.27 ms β no change β
β QQuery 27 β 507.52 ms β 512.62 ms β no change β
β QQuery 28 β 2901.91 ms β 2884.03 ms β no change β
β QQuery 29 β 41.56 ms β 41.64 ms β no change β
β QQuery 30 β 305.09 ms β 307.01 ms β no change β
β QQuery 31 β 284.92 ms β 287.33 ms β no change β
β QQuery 32 β 1015.91 ms β 998.91 ms β no change β
β QQuery 33 β 1542.43 ms β 1445.78 ms β +1.07x faster β
β QQuery 34 β 1494.82 ms β 1563.13 ms β no change β
β QQuery 35 β 293.99 ms β 320.73 ms β 1.09x slower β
β QQuery 36 β 66.55 ms β 65.28 ms β no change β
β QQuery 37 β 35.27 ms β 35.14 ms β no change β
β QQuery 38 β 39.71 ms β 45.77 ms β 1.15x slower β
β QQuery 39 β 141.41 ms β 132.95 ms β +1.06x faster β
β QQuery 40 β 13.90 ms β 15.85 ms β 1.14x slower β
β QQuery 41 β 13.39 ms β 15.24 ms β 1.14x slower β
β QQuery 42 β 13.08 ms β 15.17 ms β 1.16x slower β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 19333.73ms β
β Total Time (rich-T-kid_coacler-benchmark) β 19320.85ms β
β Average Time (HEAD) β 449.62ms β
β Average Time (rich-T-kid_coacler-benchmark) β 449.32ms β
β Queries Faster β 3 β
β Queries Slower β 6 β
β Queries with No Change β 34 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.22 / 3.93 Β±5.34 / 14.61 ms β 1.24 / 4.13 Β±5.61 / 15.35 ms β 1.05x slower β
β QQuery 1 β 11.50 / 11.71 Β±0.13 / 11.88 ms β 11.66 / 12.01 Β±0.20 / 12.24 ms β no change β
β QQuery 2 β 36.68 / 36.91 Β±0.18 / 37.23 ms β 36.96 / 37.38 Β±0.33 / 37.92 ms β no change β
β QQuery 3 β 31.06 / 31.90 Β±0.92 / 33.30 ms β 31.13 / 31.36 Β±0.18 / 31.61 ms β no change β
β QQuery 4 β 235.72 / 238.14 Β±2.84 / 243.22 ms β 240.00 / 246.16 Β±5.05 / 254.22 ms β no change β
β QQuery 5 β 275.23 / 280.46 Β±4.62 / 289.10 ms β 274.57 / 281.30 Β±6.37 / 292.27 ms β no change β
β QQuery 6 β 1.31 / 1.50 Β±0.26 / 2.00 ms β 1.25 / 1.43 Β±0.26 / 1.94 ms β no change β
β QQuery 7 β 12.92 / 13.89 Β±1.59 / 17.06 ms β 12.88 / 13.02 Β±0.16 / 13.24 ms β +1.07x faster β
β QQuery 8 β 327.45 / 339.07 Β±7.74 / 348.52 ms β 336.29 / 349.93 Β±13.01 / 369.39 ms β no change β
β QQuery 9 β 468.33 / 477.46 Β±4.64 / 480.67 ms β 464.09 / 482.32 Β±13.86 / 499.59 ms β no change β
β QQuery 10 β 63.89 / 68.15 Β±7.87 / 83.87 ms β 66.56 / 67.64 Β±1.22 / 69.51 ms β no change β
β QQuery 11 β 74.18 / 75.78 Β±1.39 / 78.32 ms β 77.02 / 78.42 Β±1.47 / 81.21 ms β no change β
β QQuery 12 β 263.45 / 272.53 Β±7.14 / 280.08 ms β 265.50 / 279.63 Β±13.20 / 295.68 ms β no change β
β QQuery 13 β 356.65 / 381.57 Β±20.05 / 407.98 ms β 378.50 / 389.92 Β±13.84 / 416.26 ms β no change β
β QQuery 14 β 277.24 / 283.68 Β±6.11 / 294.02 ms β 283.72 / 293.76 Β±7.88 / 303.91 ms β no change β
β QQuery 15 β 283.77 / 315.11 Β±16.81 / 327.87 ms β 287.17 / 305.08 Β±13.65 / 321.97 ms β no change β
β QQuery 16 β 630.65 / 674.23 Β±25.56 / 700.18 ms β 624.96 / 634.73 Β±9.59 / 651.65 ms β +1.06x faster β
β QQuery 17 β 667.72 / 685.40 Β±14.33 / 703.45 ms β 637.65 / 650.68 Β±7.64 / 660.87 ms β +1.05x faster β
β QQuery 18 β 1352.24 / 1380.86 Β±29.59 / 1433.75 ms β 1259.47 / 1292.85 Β±22.97 / 1319.98 ms β +1.07x faster β
β QQuery 19 β 29.57 / 30.05 Β±0.54 / 31.08 ms β 29.67 / 30.35 Β±0.42 / 30.97 ms β no change β
β QQuery 20 β 520.58 / 537.89 Β±20.68 / 572.85 ms β 522.80 / 538.29 Β±10.51 / 549.58 ms β no change β
β QQuery 21 β 517.44 / 522.15 Β±5.15 / 529.25 ms β 511.12 / 521.82 Β±7.23 / 531.23 ms β no change β
β QQuery 22 β 981.34 / 992.37 Β±15.59 / 1023.23 ms β 1014.20 / 1026.92 Β±9.53 / 1038.80 ms β no change β
β QQuery 23 β 3017.75 / 3126.23 Β±65.02 / 3198.62 ms β 3081.37 / 3141.87 Β±56.16 / 3231.80 ms β no change β
β QQuery 24 β 39.90 / 41.22 Β±1.38 / 43.62 ms β 39.52 / 42.12 Β±2.12 / 45.18 ms β no change β
β QQuery 25 β 104.09 / 106.46 Β±2.23 / 110.22 ms β 104.72 / 107.13 Β±2.89 / 112.33 ms β no change β
β QQuery 26 β 40.36 / 43.36 Β±3.81 / 49.82 ms β 40.27 / 40.41 Β±0.12 / 40.59 ms β +1.07x faster β
β QQuery 27 β 507.52 / 515.43 Β±5.82 / 525.15 ms β 512.62 / 522.35 Β±8.30 / 531.92 ms β no change β
β QQuery 28 β 2901.91 / 2926.62 Β±26.55 / 2973.84 ms β 2884.03 / 2915.42 Β±28.42 / 2968.26 ms β no change β
β QQuery 29 β 41.56 / 42.33 Β±0.63 / 43.19 ms β 41.64 / 46.78 Β±7.08 / 59.79 ms β 1.11x slower β
β QQuery 30 β 305.09 / 325.60 Β±14.68 / 338.83 ms β 307.01 / 325.19 Β±14.47 / 339.84 ms β no change β
β QQuery 31 β 284.92 / 307.23 Β±25.48 / 354.41 ms β 287.33 / 294.21 Β±5.20 / 301.43 ms β no change β
β QQuery 32 β 1015.91 / 1042.82 Β±16.79 / 1063.84 ms β 998.91 / 1005.15 Β±4.27 / 1010.24 ms β no change β
β QQuery 33 β 1542.43 / 1608.30 Β±46.86 / 1669.19 ms β 1445.78 / 1459.48 Β±8.90 / 1469.71 ms β +1.10x faster β
β QQuery 34 β 1494.82 / 1546.80 Β±36.33 / 1593.52 ms β 1563.13 / 1611.03 Β±47.71 / 1680.80 ms β no change β
β QQuery 35 β 293.99 / 329.14 Β±33.70 / 385.95 ms β 320.73 / 359.46 Β±24.66 / 387.50 ms β 1.09x slower β
β QQuery 36 β 66.55 / 77.05 Β±6.33 / 82.55 ms β 65.28 / 73.33 Β±6.38 / 80.70 ms β no change β
β QQuery 37 β 35.27 / 39.52 Β±5.41 / 48.89 ms β 35.14 / 39.45 Β±5.22 / 49.07 ms β no change β
β QQuery 38 β 39.71 / 43.39 Β±2.15 / 46.07 ms β 45.77 / 48.37 Β±2.74 / 53.29 ms β 1.11x slower β
β QQuery 39 β 141.41 / 151.10 Β±10.54 / 165.89 ms β 132.95 / 149.54 Β±10.89 / 161.35 ms β no change β
β QQuery 40 β 13.90 / 18.40 Β±5.88 / 29.96 ms β 15.85 / 18.20 Β±3.44 / 25.00 ms β no change β
β QQuery 41 β 13.39 / 16.08 Β±4.55 / 25.16 ms β 15.24 / 16.64 Β±2.18 / 20.97 ms β no change β
β QQuery 42 β 13.08 / 13.24 Β±0.16 / 13.52 ms β 15.17 / 16.38 Β±2.16 / 20.69 ms β 1.24x slower β
βββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 19975.04ms β
β Total Time (rich-T-kid_coacler-benchmark) β 19801.62ms β
β Average Time (HEAD) β 464.54ms β
β Average Time (rich-T-kid_coacler-benchmark) β 460.50ms β
β Queries Faster β 6 β
β Queries Slower β 5 β
β Queries with No Change β 32 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**clickbench_partitioned β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 105.0s |
| Peak memory | 11.8 GiB |
| Avg memory | 4.6 GiB |
| CPU user | 1024.1s |
| CPU sys | 70.5s |
| Peak spill | 0 B |
**clickbench_partitioned β branch**
| Metric | Value |
|--------|-------|
| Wall time | 100.0s |
| Peak memory | 11.6 GiB |
| Avg memory | 4.8 GiB |
| CPU user | 1028.8s |
| CPU sys | 73.1s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745524696
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745457778)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 68.24 ms β 69.13 ms β no change β
β QQuery 2 β 343.07 ms β 323.47 ms β +1.06x faster β
β QQuery 3 β 80.27 ms β 79.21 ms β no change β
β QQuery 4 β 865.01 ms β 824.36 ms β no change β
β QQuery 5 β 377.38 ms β 416.75 ms β 1.10x slower β
β QQuery 6 β 175.45 ms β 182.91 ms β no change β
β QQuery 7 β 128.06 ms β 126.95 ms β no change β
β QQuery 8 β 164.78 ms β 161.21 ms β no change β
β QQuery 9 β 229.44 ms β 249.92 ms β 1.09x slower β
β QQuery 10 β 148.48 ms β 152.29 ms β no change β
β QQuery 11 β 571.81 ms β 547.91 ms β no change β
β QQuery 12 β 121.57 ms β 113.58 ms β +1.07x faster β
β QQuery 13 β 292.54 ms β 280.56 ms β no change β
β QQuery 14 β 5680.05 ms β 1366.53 ms β +4.16x faster β
β QQuery 15 β 123.07 ms β 126.30 ms β no change β
β QQuery 16 β 68.62 ms β 68.07 ms β no change β
β QQuery 17 β 601.67 ms β 582.40 ms β no change β
β QQuery 18 β 559.18 ms β 571.77 ms β no change β
β QQuery 19 β 111.63 ms β 109.69 ms β no change β
β QQuery 20 β 126.13 ms β 125.44 ms β no change β
β QQuery 21 β 73.83 ms β 76.82 ms β no change β
β QQuery 22 β 143.32 ms β 142.70 ms β no change β
β QQuery 23 β 1000.36 ms β 1020.95 ms β no change β
β QQuery 24 β 610.84 ms β 573.58 ms β +1.06x faster β
β QQuery 25 β 638.50 ms β 614.10 ms β no change β
β QQuery 26 β 100.81 ms β 93.91 ms β +1.07x faster β
β QQuery 27 β 68.75 ms β 63.39 ms β +1.08x faster β
β QQuery 28 β 125.40 ms β 126.88 ms β no change β
β QQuery 29 β 637.57 ms β 615.37 ms β no change β
β QQuery 30 β 197.00 ms β 190.86 ms β no change β
β QQuery 31 β 490.26 ms β 500.71 ms β no change β
β QQuery 32 β 86.97 ms β 80.55 ms β +1.08x faster β
β QQuery 33 β 168.72 ms β 163.33 ms β no change β
β QQuery 34 β 68.46 ms β 68.88 ms β no change β
β QQuery 35 β 175.78 ms β 175.24 ms β no change β
β QQuery 36 β 100.20 ms β 94.78 ms β +1.06x faster β
β QQuery 37 β 53.32 ms β 49.81 ms β +1.07x faster β
β QQuery 38 β 227.34 ms β 211.17 ms β +1.08x faster β
β QQuery 39 β 311.93 ms β 289.61 ms β +1.08x faster β
β QQuery 40 β 84.93 ms β 79.27 ms β +1.07x faster β
β QQuery 41 β 100.27 ms β 94.44 ms β +1.06x faster β
β QQuery 42 β 73.63 ms β 71.40 ms β no change β
β QQuery 43 β 61.02 ms β 57.22 ms β +1.07x faster β
β QQuery 44 β 152.35 ms β 161.55 ms β 1.06x slower β
β QQuery 45 β 119.23 ms β 121.39 ms β no change β
β QQuery 46 β 75.84 ms β 76.12 ms β no change β
β QQuery 47 β 589.22 ms β 575.34 ms β no change β
β QQuery 48 β 274.17 ms β 257.69 ms β +1.06x faster β
β QQuery 49 β 294.59 ms β 293.04 ms β no change β
β QQuery 50 β 343.98 ms β 335.64 ms β no change β
β QQuery 51 β 334.78 ms β 334.70 ms β no change β
β QQuery 52 β 76.32 ms β 73.17 ms β no change β
β QQuery 53 β 123.34 ms β 114.54 ms β +1.08x faster β
β QQuery 54 β 299.91 ms β 281.65 ms β +1.06x faster β
β QQuery 55 β 76.93 ms β 72.32 ms β +1.06x faster β
β QQuery 56 β 128.12 ms β 127.74 ms β no change β
β QQuery 57 β 452.42 ms β 465.33 ms β no change β
β QQuery 58 β 269.87 ms β 269.09 ms β no change β
β QQuery 59 β 235.72 ms β 229.94 ms β no change β
β QQuery 60 β 133.55 ms β 129.58 ms β no change β
β QQuery 61 β 38.08 ms β 37.62 ms β no change β
β QQuery 62 β 112.75 ms β 110.52 ms β no change β
β QQuery 63 β 121.67 ms β 118.14 ms β no change β
β QQuery 64 β 2618.25 ms β 2706.46 ms β no change β
β QQuery 65 β 578.74 ms β 608.13 ms β 1.05x slower β
β QQuery 66 β 232.98 ms β 233.24 ms β no change β
β QQuery 67 β 418.95 ms β 424.38 ms β no change β
β QQuery 68 β 75.29 ms β 75.09 ms β no change β
β QQuery 69 β 147.67 ms β 149.53 ms β no change β
β QQuery 70 β 309.12 ms β 279.54 ms β +1.11x faster β
β QQuery 71 β 107.53 ms β 101.74 ms β +1.06x faster β
β QQuery 72 β 6287.74 ms β 6326.80 ms β no change β
β QQuery 73 β 68.22 ms β 64.90 ms β no change β
β QQuery 74 β 428.43 ms β 389.53 ms β +1.10x faster β
β QQuery 75 β 1005.19 ms β 919.18 ms β +1.09x faster β
β QQuery 76 β 182.72 ms β 165.80 ms β +1.10x faster β
β QQuery 77 β 387.10 ms β 358.16 ms β +1.08x faster β
β QQuery 78 β 395.00 ms β 366.94 ms β +1.08x faster β
β QQuery 79 β 144.75 ms β 129.78 ms β +1.12x faster β
β QQuery 80 β 572.65 ms β 561.99 ms β no change β
β QQuery 81 β 190.05 ms β 179.83 ms β +1.06x faster β
β QQuery 82 β 77.10 ms β 74.41 ms β no change β
β QQuery 83 β 200.76 ms β 181.08 ms β +1.11x faster β
β QQuery 84 β 78.33 ms β 77.14 ms β no change β
β QQuery 85 β 493.47 ms β 446.34 ms β +1.11x faster β
β QQuery 86 β 117.66 ms β 115.49 ms β no change β
β QQuery 87 β 221.24 ms β 222.05 ms β no change β
β QQuery 88 β 174.71 ms β 168.48 ms β no change β
β QQuery 89 β 138.86 ms β 127.66 ms β +1.09x faster β
β QQuery 90 β 53.15 ms β 53.27 ms β no change β
β QQuery 91 β 118.80 ms β 108.69 ms β +1.09x faster β
β QQuery 92 β 90.45 ms β 85.00 ms β +1.06x faster β
β QQuery 93 β 249.58 ms β 234.40 ms β +1.06x faster β
β QQuery 94 β 132.34 ms β 126.40 ms β no change β
β QQuery 95 β 500.04 ms β 534.90 ms β 1.07x slower β
β QQuery 96 β 41.82 ms β 42.38 ms β no change β
β QQuery 97 β 170.08 ms β 176.29 ms β no change β
β QQuery 98 β 134.04 ms β 127.08 ms β +1.05x faster β
β QQuery 99 β 133.44 ms β 130.30 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 37964.79ms β
β Total Time (rich-T-kid_coacler-benchmark) β 33190.86ms β
β Average Time (HEAD) β 383.48ms β
β Average Time (rich-T-kid_coacler-benchmark) β 335.26ms β
β Queries Faster β 34 β
β Queries Slower β 5 β
β Queries with No Change β 60 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³βββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 68.24 / 70.25 Β±1.45 / 72.59 ms β 69.13 / 70.26 Β±0.90 / 71.78 ms β no change β
β QQuery 2 β 343.07 / 352.97 Β±10.09 / 369.82 ms β 323.47 / 351.78 Β±21.33 / 388.07 ms β no change β
β QQuery 3 β 80.27 / 85.35 Β±4.39 / 93.00 ms β 79.21 / 81.19 Β±1.57 / 83.51 ms β no change β
β QQuery 4 β 865.01 / 913.53 Β±40.24 / 978.00 ms β 824.36 / 874.81 Β±44.61 / 936.60 ms β no change β
β QQuery 5 β 377.38 / 413.19 Β±52.86 / 518.32 ms β 416.75 / 429.86 Β±18.98 / 467.40 ms β no change β
β QQuery 6 β 175.45 / 197.34 Β±33.99 / 264.94 ms β 182.91 / 197.37 Β±14.93 / 224.87 ms β no change β
β QQuery 7 β 128.06 / 141.01 Β±22.47 / 185.86 ms β 126.95 / 136.74 Β±11.18 / 158.43 ms β no change β
β QQuery 8 β 164.78 / 177.77 Β±7.94 / 186.59 ms β 161.21 / 186.76 Β±22.36 / 228.50 ms β 1.05x slower β
β QQuery 9 β 229.44 / 246.78 Β±13.06 / 268.56 ms β 249.92 / 267.49 Β±22.33 / 311.21 ms β 1.08x slower β
β QQuery 10 β 148.48 / 156.61 Β±6.34 / 167.79 ms β 152.29 / 157.03 Β±3.77 / 162.74 ms β no change β
β QQuery 11 β 571.81 / 610.16 Β±29.20 / 659.72 ms β 547.91 / 581.71 Β±25.41 / 617.43 ms β no change β
β QQuery 12 β 121.57 / 135.26 Β±24.53 / 184.30 ms β 113.58 / 130.26 Β±14.53 / 152.81 ms β no change β
β QQuery 13 β 292.54 / 310.05 Β±25.63 / 360.07 ms β 280.56 / 292.10 Β±11.68 / 314.02 ms β +1.06x faster β
β QQuery 14 β 5680.05 / 6046.39 Β±211.51 / 6261.41 ms β 1366.53 / 1418.26 Β±31.62 / 1452.84 ms β +4.26x faster β
β QQuery 15 β 123.07 / 127.86 Β±4.62 / 135.14 ms β 126.30 / 151.06 Β±29.89 / 202.49 ms β 1.18x slower β
β QQuery 16 β 68.62 / 85.78 Β±15.27 / 106.29 ms β 68.07 / 71.60 Β±1.82 / 73.01 ms β +1.20x faster β
β QQuery 17 β 601.67 / 613.58 Β±8.67 / 625.46 ms β 582.40 / 600.03 Β±16.22 / 627.65 ms β no change β
β QQuery 18 β 559.18 / 569.70 Β±7.51 / 579.10 ms β 571.77 / 585.43 Β±12.93 / 607.66 ms β no change β
β QQuery 19 β 111.63 / 118.45 Β±4.29 / 123.69 ms β 109.69 / 126.61 Β±15.42 / 154.52 ms β 1.07x slower β
β QQuery 20 β 126.13 / 132.67 Β±4.29 / 137.21 ms β 125.44 / 129.35 Β±3.44 / 135.20 ms β no change β
β QQuery 21 β 73.83 / 76.92 Β±3.76 / 84.32 ms β 76.82 / 81.22 Β±3.93 / 86.00 ms β 1.06x slower β
β QQuery 22 β 143.32 / 145.92 Β±2.01 / 149.14 ms β 142.70 / 147.27 Β±4.82 / 154.82 ms β no change β
β QQuery 23 β 1000.36 / 1015.57 Β±14.42 / 1034.71 ms β 1020.95 / 1045.59 Β±13.42 / 1057.79 ms β no change β
β QQuery 24 β 610.84 / 648.62 Β±30.55 / 697.68 ms β 573.58 / 583.53 Β±10.48 / 602.54 ms β +1.11x faster β
β QQuery 25 β 638.50 / 663.07 Β±18.28 / 680.54 ms β 614.10 / 628.48 Β±11.56 / 647.76 ms β +1.06x faster β
β QQuery 26 β 100.81 / 111.76 Β±12.53 / 135.23 ms β 93.91 / 101.01 Β±5.56 / 110.23 ms β +1.11x faster β
β QQuery 27 β 68.75 / 71.09 Β±3.50 / 78.06 ms β 63.39 / 69.79 Β±7.62 / 84.67 ms β no change β
β QQuery 28 β 125.40 / 138.77 Β±15.27 / 167.68 ms β 126.88 / 132.04 Β±3.90 / 138.24 ms β no change β
β QQuery 29 β 637.57 / 651.00 Β±9.18 / 665.24 ms β 615.37 / 645.35 Β±21.64 / 679.53 ms β no change β
β QQuery 30 β 197.00 / 205.04 Β±6.60 / 214.66 ms β 190.86 / 202.05 Β±9.37 / 215.00 ms β no change β
β QQuery 31 β 490.26 / 533.35 Β±26.71 / 566.93 ms β 500.71 / 508.82 Β±5.85 / 517.89 ms β no change β
β QQuery 32 β 86.97 / 97.10 Β±12.58 / 120.91 ms β 80.55 / 81.90 Β±1.39 / 84.28 ms β +1.19x faster β
β QQuery 33 β 168.72 / 187.87 Β±13.70 / 206.01 ms β 163.33 / 198.33 Β±29.10 / 240.60 ms β 1.06x slower β
β QQuery 34 β 68.46 / 72.66 Β±4.63 / 81.42 ms β 68.88 / 73.84 Β±4.95 / 82.94 ms β no change β
β QQuery 35 β 175.78 / 187.04 Β±16.00 / 218.19 ms β 175.24 / 190.84 Β±12.68 / 212.75 ms β no change β
β QQuery 36 β 100.20 / 103.02 Β±2.87 / 107.54 ms β 94.78 / 100.63 Β±9.61 / 119.76 ms β no change β
β QQuery 37 β 53.32 / 54.73 Β±1.24 / 57.05 ms β 49.81 / 51.79 Β±1.62 / 53.87 ms β +1.06x faster β
β QQuery 38 β 227.34 / 238.32 Β±10.50 / 257.84 ms β 211.17 / 220.74 Β±7.98 / 229.81 ms β +1.08x faster β
β QQuery 39 β 311.93 / 330.62 Β±11.51 / 344.18 ms β 289.61 / 316.33 Β±19.15 / 338.45 ms β no change β
β QQuery 40 β 84.93 / 85.82 Β±0.79 / 87.27 ms β 79.27 / 86.16 Β±6.76 / 98.98 ms β no change β
β QQuery 41 β 100.27 / 107.08 Β±5.42 / 113.52 ms β 94.44 / 99.15 Β±5.79 / 110.54 ms β +1.08x faster β
β QQuery 42 β 73.63 / 81.14 Β±4.10 / 85.31 ms β 71.40 / 82.57 Β±14.48 / 111.18 ms β no change β
β QQuery 43 β 61.02 / 67.77 Β±8.73 / 84.29 ms β 57.22 / 59.57 Β±3.35 / 65.93 ms β +1.14x faster β
β QQuery 44 β 152.35 / 172.76 Β±10.55 / 180.93 ms β 161.55 / 171.27 Β±7.44 / 180.57 ms β no change β
β QQuery 45 β 119.23 / 129.61 Β±12.72 / 154.32 ms β 121.39 / 128.39 Β±7.28 / 139.74 ms β no change β
β QQuery 46 β 75.84 / 79.60 Β±4.60 / 88.18 ms β 76.12 / 79.76 Β±2.48 / 82.68 ms β no change β
β QQuery 47 β 589.22 / 610.78 Β±19.42 / 637.66 ms β 575.34 / 587.91 Β±11.87 / 608.66 ms β no change β
β QQuery 48 β 274.17 / 288.85 Β±13.76 / 311.12 ms β 257.69 / 270.92 Β±19.35 / 308.88 ms β +1.07x faster β
β QQuery 49 β 294.59 / 318.74 Β±15.00 / 339.11 ms β 293.04 / 312.27 Β±21.27 / 344.53 ms β no change β
β QQuery 50 β 343.98 / 363.67 Β±14.99 / 387.13 ms β 335.64 / 357.62 Β±18.89 / 387.28 ms β no change β
β QQuery 51 β 334.78 / 352.19 Β±10.80 / 363.95 ms β 334.70 / 350.11 Β±13.05 / 369.64 ms β no change β
β QQuery 52 β 76.32 / 78.99 Β±2.48 / 83.60 ms β 73.17 / 78.31 Β±3.83 / 82.99 ms β no change β
β QQuery 53 β 123.34 / 129.73 Β±5.66 / 138.21 ms β 114.54 / 124.18 Β±9.23 / 138.65 ms β no change β
β QQuery 54 β 299.91 / 305.36 Β±6.01 / 314.29 ms β 281.65 / 291.02 Β±10.88 / 307.80 ms β no change β
β QQuery 55 β 76.93 / 83.71 Β±7.01 / 97.00 ms β 72.32 / 80.95 Β±8.71 / 93.75 ms β no change β
β QQuery 56 β 128.12 / 138.89 Β±9.12 / 154.26 ms β 127.74 / 137.38 Β±12.34 / 161.57 ms β no change β
β QQuery 57 β 452.42 / 484.15 Β±25.92 / 527.62 ms β 465.33 / 476.13 Β±9.97 / 493.26 ms β no change β
β QQuery 58 β 269.87 / 284.38 Β±13.64 / 305.78 ms β 269.09 / 281.54 Β±10.99 / 299.16 ms β no change β
β QQuery 59 β 235.72 / 249.35 Β±9.58 / 264.25 ms β 229.94 / 234.08 Β±4.56 / 242.74 ms β +1.07x faster β
β QQuery 60 β 133.55 / 139.27 Β±6.80 / 151.35 ms β 129.58 / 135.74 Β±5.03 / 143.30 ms β no change β
β QQuery 61 β 38.08 / 41.61 Β±4.66 / 50.69 ms β 37.62 / 49.23 Β±17.59 / 84.22 ms β 1.18x slower β
β QQuery 62 β 112.75 / 121.59 Β±7.44 / 130.44 ms β 110.52 / 119.87 Β±8.20 / 132.27 ms β no change β
β QQuery 63 β 121.67 / 129.03 Β±9.60 / 146.43 ms β 118.14 / 122.41 Β±4.01 / 129.94 ms β +1.05x faster β
β QQuery 64 β 2618.25 / 2649.53 Β±26.25 / 2688.21 ms β 2706.46 / 2774.57 Β±35.63 / 2804.12 ms β no change β
β QQuery 65 β 578.74 / 615.37 Β±21.74 / 640.82 ms β 608.13 / 620.00 Β±8.10 / 633.42 ms β no change β
β QQuery 66 β 232.98 / 249.08 Β±13.00 / 265.78 ms β 233.24 / 254.66 Β±16.11 / 282.24 ms β no change β
β QQuery 67 β 418.95 / 441.07 Β±20.69 / 475.29 ms β 424.38 / 445.53 Β±14.06 / 463.14 ms β no change β
β QQuery 68 β 75.29 / 77.07 Β±2.27 / 81.40 ms β 75.09 / 77.13 Β±2.56 / 81.69 ms β no change β
β QQuery 69 β 147.67 / 163.62 Β±12.32 / 177.19 ms β 149.53 / 163.13 Β±9.06 / 173.62 ms β no change β
β QQuery 70 β 309.12 / 314.69 Β±6.43 / 326.25 ms β 279.54 / 296.13 Β±14.77 / 317.20 ms β +1.06x faster β
β QQuery 71 β 107.53 / 117.11 Β±10.93 / 135.40 ms β 101.74 / 103.74 Β±1.73 / 105.92 ms β +1.13x faster β
β QQuery 72 β 6287.74 / 6421.43 Β±107.07 / 6554.80 ms β 6326.80 / 6425.68 Β±109.03 / 6590.26 ms β no change β
β QQuery 73 β 68.22 / 69.18 Β±0.81 / 70.31 ms β 64.90 / 77.66 Β±18.53 / 114.25 ms β 1.12x slower β
β QQuery 74 β 428.43 / 457.74 Β±27.35 / 505.00 ms β 389.53 / 437.46 Β±32.29 / 475.09 ms β no change β
β QQuery 75 β 1005.19 / 1032.07 Β±31.95 / 1093.76 ms β 919.18 / 956.09 Β±21.02 / 981.64 ms β +1.08x faster β
β QQuery 76 β 182.72 / 198.76 Β±10.98 / 210.94 ms β 165.80 / 191.74 Β±23.12 / 222.26 ms β no change β
β QQuery 77 β 387.10 / 418.03 Β±34.98 / 482.49 ms β 358.16 / 393.61 Β±35.39 / 451.46 ms β +1.06x faster β
β QQuery 78 β 395.00 / 421.23 Β±18.79 / 445.20 ms β 366.94 / 387.64 Β±14.42 / 408.23 ms β +1.09x faster β
β QQuery 79 β 144.75 / 150.59 Β±3.45 / 155.10 ms β 129.78 / 139.60 Β±13.76 / 166.84 ms β +1.08x faster β
β QQuery 80 β 572.65 / 610.07 Β±43.69 / 693.73 ms β 561.99 / 603.90 Β±31.70 / 645.10 ms β no change β
β QQuery 81 β 190.05 / 216.77 Β±24.60 / 254.21 ms β 179.83 / 198.91 Β±22.55 / 233.26 ms β +1.09x faster β
β QQuery 82 β 77.10 / 87.47 Β±12.64 / 110.44 ms β 74.41 / 80.78 Β±7.43 / 94.63 ms β +1.08x faster β
β QQuery 83 β 200.76 / 218.46 Β±12.88 / 240.67 ms β 181.08 / 190.14 Β±9.87 / 207.81 ms β +1.15x faster β
β QQuery 84 β 78.33 / 80.00 Β±1.26 / 81.45 ms β 77.14 / 84.65 Β±10.04 / 104.22 ms β 1.06x slower β
β QQuery 85 β 493.47 / 568.58 Β±67.04 / 661.89 ms β 446.34 / 462.68 Β±12.34 / 475.77 ms β +1.23x faster β
β QQuery 86 β 117.66 / 129.10 Β±11.90 / 149.79 ms β 115.49 / 131.70 Β±11.25 / 144.33 ms β no change β
β QQuery 87 β 221.24 / 244.26 Β±14.67 / 264.94 ms β 222.05 / 236.16 Β±14.85 / 263.16 ms β no change β
β QQuery 88 β 174.71 / 180.76 Β±4.28 / 187.26 ms β 168.48 / 184.70 Β±10.96 / 196.10 ms β no change β
β QQuery 89 β 138.86 / 147.53 Β±7.33 / 160.02 ms β 127.66 / 135.25 Β±7.96 / 148.77 ms β +1.09x faster β
β QQuery 90 β 53.15 / 56.05 Β±1.87 / 58.27 ms β 53.27 / 56.11 Β±4.43 / 64.93 ms β no change β
β QQuery 91 β 118.80 / 123.31 Β±3.85 / 129.10 ms β 108.69 / 113.71 Β±3.01 / 116.84 ms β +1.08x faster β
β QQuery 92 β 90.45 / 100.10 Β±5.21 / 106.08 ms β 85.00 / 92.30 Β±4.02 / 96.81 ms β +1.08x faster β
β QQuery 93 β 249.58 / 262.25 Β±7.78 / 271.87 ms β 234.40 / 250.00 Β±12.72 / 273.12 ms β no change β
β QQuery 94 β 132.34 / 142.84 Β±11.00 / 161.73 ms β 126.40 / 139.70 Β±12.45 / 161.34 ms β no change β
β QQuery 95 β 500.04 / 504.71 Β±3.44 / 509.95 ms β 534.90 / 548.23 Β±9.76 / 563.41 ms β 1.09x slower β
β QQuery 96 β 41.82 / 46.47 Β±3.99 / 53.88 ms β 42.38 / 44.69 Β±1.44 / 46.80 ms β no change β
β QQuery 97 β 170.08 / 176.16 Β±4.83 / 182.73 ms β 176.29 / 186.27 Β±7.14 / 193.93 ms β 1.06x slower β
β QQuery 98 β 134.04 / 145.15 Β±13.74 / 172.17 ms β 127.08 / 136.44 Β±9.44 / 153.67 ms β +1.06x faster β
β QQuery 99 β 133.44 / 143.56 Β±10.90 / 163.24 ms β 130.30 / 135.67 Β±6.24 / 147.62 ms β +1.06x faster β
βββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 39861.40ms β
β Total Time (rich-T-kid_coacler-benchmark) β 34692.18ms β
β Average Time (HEAD) β 402.64ms β
β Average Time (rich-T-kid_coacler-benchmark) β 350.43ms β
β Queries Faster β 29 β
β Queries Slower β 11 β
β Queries with No Change β 59 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpcds β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 200.0s |
| Peak memory | 7.6 GiB |
| Avg memory | 1.7 GiB |
| CPU user | 1029.5s |
| CPU sys | 66.1s |
| Peak spill | 0 B |
**tpcds β branch**
| Metric | Value |
|--------|-------|
| Wall time | 175.0s |
| Peak memory | 2.8 GiB |
| Avg memory | 1.4 GiB |
| CPU user | 1031.1s |
| CPU sys | 64.2s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745474601
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745457778)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5745457778-2503-pw9p8 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745474620
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745457304)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5745457304-2501-qrxlt 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (ed2b46cbc8b5768e702be5190db067a2275e4023) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..ed2b46cbc8b5768e702be5190db067a2275e4023)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745544693
new run
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5745706922
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5745657661)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (50b4aadf9bd59b1681e8c222be535966e84155d7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..50b4aadf9bd59b1681e8c222be535966e84155d7)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³ββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 84.84 ms β 86.06 ms β no change β
β QQuery 2 β 90.43 ms β 91.83 ms β no change β
β QQuery 3 β 87.19 ms β 82.60 ms β +1.06x faster β
β QQuery 4 β 64.16 ms β 64.13 ms β no change β
β QQuery 5 β 91.57 ms β 83.40 ms β +1.10x faster β
β QQuery 6 β 25.95 ms β 27.30 ms β 1.05x slower β
β QQuery 7 β 244.87 ms β 254.02 ms β no change β
β QQuery 8 β 243.98 ms β 244.30 ms β no change β
β QQuery 9 β 373.49 ms β 383.73 ms β no change β
β QQuery 10 β 95.39 ms β 94.99 ms β no change β
β QQuery 11 β 82.99 ms β 87.73 ms β 1.06x slower β
β QQuery 12 β 360.93 ms β 200.01 ms β +1.80x faster β
β QQuery 13 β 121.43 ms β 121.05 ms β no change β
β QQuery 14 β 46.03 ms β 48.14 ms β no change β
β QQuery 15 β 129.68 ms β 132.40 ms β no change β
β QQuery 16 β 103.98 ms β 105.04 ms β no change β
β QQuery 17 β 214.33 ms β 192.75 ms β +1.11x faster β
β QQuery 18 β 338.47 ms β 333.65 ms β no change β
β QQuery 19 β 52.52 ms β 52.59 ms β no change β
β QQuery 20 β 99.54 ms β 100.79 ms β no change β
β QQuery 21 β 118.91 ms β 119.95 ms β no change β
β QQuery 22 β 82.83 ms β 78.64 ms β +1.05x faster β
βββββββββββββ΄ββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 3153.51ms β
β Total Time (rich-T-kid_coacler-benchmark) β 2985.10ms β
β Average Time (HEAD) β 143.34ms β
β Average Time (rich-T-kid_coacler-benchmark) β 135.69ms β
β Queries Faster β 5 β
β Queries Slower β 2 β
β Queries with No Change β 15 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpch_sf1.json
--------------------
βββββββββββββ³βββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 84.84 / 86.74 Β±1.34 / 88.11 ms β 86.06 / 88.24 Β±1.76 / 91.27 ms β no change β
β QQuery 2 β 90.43 / 93.41 Β±2.31 / 96.89 ms β 91.83 / 95.05 Β±2.30 / 98.55 ms β no change β
β QQuery 3 β 87.19 / 90.14 Β±1.99 / 92.16 ms β 82.60 / 88.11 Β±3.17 / 91.13 ms β no change β
β QQuery 4 β 64.16 / 66.34 Β±2.30 / 70.69 ms β 64.13 / 67.28 Β±3.00 / 72.32 ms β no change β
β QQuery 5 β 91.57 / 93.82 Β±2.27 / 96.66 ms β 83.40 / 92.58 Β±6.33 / 103.19 ms β no change β
β QQuery 6 β 25.95 / 28.81 Β±1.97 / 30.91 ms β 27.30 / 28.93 Β±1.35 / 30.82 ms β no change β
β QQuery 7 β 244.87 / 254.55 Β±10.08 / 270.03 ms β 254.02 / 258.32 Β±3.69 / 264.87 ms β no change β
β QQuery 8 β 243.98 / 251.06 Β±4.13 / 256.43 ms β 244.30 / 255.95 Β±7.03 / 262.73 ms β no change β
β QQuery 9 β 373.49 / 381.18 Β±7.48 / 391.23 ms β 383.73 / 393.20 Β±7.34 / 404.88 ms β no change β
β QQuery 10 β 95.39 / 101.85 Β±9.54 / 120.43 ms β 94.99 / 105.34 Β±10.38 / 125.03 ms β no change β
β QQuery 11 β 82.99 / 88.13 Β±4.29 / 95.88 ms β 87.73 / 89.95 Β±1.85 / 93.36 ms β no change β
β QQuery 12 β 360.93 / 368.47 Β±8.40 / 383.06 ms β 200.01 / 210.67 Β±8.30 / 225.11 ms β +1.75x faster β
β QQuery 13 β 121.43 / 124.81 Β±3.58 / 131.23 ms β 121.05 / 126.04 Β±3.10 / 130.45 ms β no change β
β QQuery 14 β 46.03 / 47.70 Β±1.16 / 48.87 ms β 48.14 / 50.13 Β±2.77 / 55.52 ms β 1.05x slower β
β QQuery 15 β 129.68 / 137.03 Β±5.93 / 147.47 ms β 132.40 / 141.01 Β±9.03 / 158.36 ms β no change β
β QQuery 16 β 103.98 / 109.49 Β±4.15 / 114.82 ms β 105.04 / 107.49 Β±1.36 / 109.08 ms β no change β
β QQuery 17 β 214.33 / 218.22 Β±5.20 / 228.49 ms β 192.75 / 195.82 Β±2.58 / 198.54 ms β +1.11x faster β
β QQuery 18 β 338.47 / 346.33 Β±13.71 / 373.72 ms β 333.65 / 336.89 Β±2.68 / 341.83 ms β no change β
β QQuery 19 β 52.52 / 55.21 Β±3.28 / 61.53 ms β 52.59 / 52.99 Β±0.44 / 53.63 ms β no change β
β QQuery 20 β 99.54 / 105.93 Β±7.96 / 121.20 ms β 100.79 / 102.08 Β±1.68 / 105.31 ms β no change β
β QQuery 21 β 118.91 / 125.43 Β±4.32 / 132.29 ms β 119.95 / 124.91 Β±3.71 / 131.37 ms β no change β
β QQuery 22 β 82.83 / 89.11 Β±9.41 / 107.74 ms β 78.64 / 91.43 Β±13.94 / 118.36 ms β no change β
βββββββββββββ΄βββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 3263.76ms β
β Total Time (rich-T-kid_coacler-benchmark) β 3102.42ms β
β Average Time (HEAD) β 148.35ms β
β Average Time (rich-T-kid_coacler-benchmark) β 141.02ms β
β Queries Faster β 2 β
β Queries Slower β 1 β
β Queries with No Change β 19 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpch β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 20.0s |
| Peak memory | 2.3 GiB |
| Avg memory | 1.0 GiB |
| CPU user | 101.6s |
| CPU sys | 8.7s |
| Peak spill | 0 B |
**tpch β branch**
| Metric | Value |
|--------|-------|
| Wall time | 20.0s |
| Peak memory | 2.5 GiB |
| Avg memory | 1.1 GiB |
| CPU user | 93.3s |
| CPU sys | 8.4s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5746466139
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5746451749)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5746451749-2515-77stv 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (50b4aadf9bd59b1681e8c222be535966e84155d7) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..50b4aadf9bd59b1681e8c222be535966e84155d7)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
env:
DATAFUSION_EXECUTION_TARGET_PARTITIONS: "256"
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739450004
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739390843)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³βββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 5.94 ms β 5.89 ms β no change β
β QQuery 2 β 80.35 ms β 80.64 ms β no change β
β QQuery 3 β 28.98 ms β 28.98 ms β no change β
β QQuery 4 β 477.78 ms β 476.61 ms β no change β
β QQuery 5 β 51.47 ms β 50.59 ms β no change β
β QQuery 6 β 36.53 ms β 36.49 ms β no change β
β QQuery 7 β 75.06 ms β 74.57 ms β no change β
β QQuery 8 β 37.33 ms β 36.60 ms β no change β
β QQuery 9 β 54.17 ms β 52.16 ms β no change β
β QQuery 10 β 63.43 ms β 62.20 ms β no change β
β QQuery 11 β 305.71 ms β 300.32 ms β no change β
β QQuery 12 β 29.83 ms β 29.72 ms β no change β
β QQuery 13 β 119.10 ms β 118.10 ms β no change β
β QQuery 14 β 402.40 ms β 399.54 ms β no change β
β QQuery 15 β 58.71 ms β 58.84 ms β no change β
β QQuery 16 β 7.03 ms β 7.00 ms β no change β
β QQuery 17 β 81.19 ms β 80.88 ms β no change β
β QQuery 18 β 108.06 ms β 107.84 ms β no change β
β QQuery 19 β 42.45 ms β 41.64 ms β no change β
β QQuery 20 β 37.15 ms β 36.33 ms β no change β
β QQuery 21 β 17.42 ms β 17.25 ms β no change β
β QQuery 22 β 67.78 ms β 66.56 ms β no change β
β QQuery 23 β 329.78 ms β 329.98 ms β no change β
β QQuery 24 β 208.35 ms β 203.03 ms β no change β
β QQuery 25 β 108.28 ms β 110.84 ms β no change β
β QQuery 26 β 48.75 ms β 48.67 ms β no change β
β QQuery 27 β 6.50 ms β 6.27 ms β no change β
β QQuery 28 β 57.27 ms β 61.09 ms β 1.07x slower β
β QQuery 29 β 96.10 ms β 97.34 ms β no change β
β QQuery 30 β 33.80 ms β 33.42 ms β no change β
β QQuery 31 β 110.36 ms β 110.49 ms β no change β
β QQuery 32 β 21.38 ms β 21.24 ms β no change β
β QQuery 33 β 37.67 ms β 37.47 ms β no change β
β QQuery 34 β 10.56 ms β 10.48 ms β no change β
β QQuery 35 β 75.81 ms β 75.80 ms β no change β
β QQuery 36 β 6.33 ms β 6.16 ms β no change β
β QQuery 37 β 7.41 ms β 7.33 ms β no change β
β QQuery 38 β 64.01 ms β 64.20 ms β no change β
β QQuery 39 β 76.14 ms β 76.45 ms β no change β
β QQuery 40 β 25.14 ms β 24.75 ms β no change β
β QQuery 41 β 11.82 ms β 11.62 ms β no change β
β QQuery 42 β 24.41 ms β 24.06 ms β no change β
β QQuery 43 β 5.58 ms β 5.43 ms β no change β
β QQuery 44 β 9.65 ms β 9.64 ms β no change β
β QQuery 45 β 42.31 ms β 41.91 ms β no change β
β QQuery 46 β 12.53 ms β 12.40 ms β no change β
β QQuery 47 β 242.58 ms β 242.61 ms β no change β
β QQuery 48 β 96.05 ms β 95.74 ms β no change β
β QQuery 49 β 71.69 ms β 71.66 ms β no change β
β QQuery 50 β 59.20 ms β 59.79 ms β no change β
β QQuery 51 β 94.21 ms β 93.79 ms β no change β
β QQuery 52 β 24.57 ms β 24.43 ms β no change β
β QQuery 53 β 29.23 ms β 29.25 ms β no change β
β QQuery 54 β 54.82 ms β 54.54 ms β no change β
β QQuery 55 β 23.78 ms β 24.27 ms β no change β
β QQuery 56 β 38.87 ms β 39.18 ms β no change β
β QQuery 57 β 171.38 ms β 172.03 ms β no change β
β QQuery 58 β 109.68 ms β 109.23 ms β no change β
β QQuery 59 β 116.55 ms β 117.18 ms β no change β
β QQuery 60 β 39.36 ms β 39.43 ms β no change β
β QQuery 61 β 12.17 ms β 11.99 ms β no change β
β QQuery 62 β 44.83 ms β 44.29 ms β no change β
β QQuery 63 β 29.52 ms β 29.51 ms β no change β
β QQuery 64 β 368.97 ms β 369.57 ms β no change β
β QQuery 65 β 132.14 ms β 134.09 ms β no change β
β QQuery 66 β 79.30 ms β 78.61 ms β no change β
β QQuery 67 β 262.54 ms β 266.37 ms β no change β
β QQuery 68 β 12.53 ms β 12.37 ms β no change β
β QQuery 69 β 57.29 ms β 56.73 ms β no change β
β QQuery 70 β 104.05 ms β 104.03 ms β no change β
β QQuery 71 β 35.64 ms β 35.56 ms β no change β
β QQuery 72 β 1775.99 ms β 1785.07 ms β no change β
β QQuery 73 β 10.08 ms β 10.13 ms β no change β
β QQuery 74 β 175.75 ms β 174.28 ms β no change β
β QQuery 75 β 143.86 ms β 144.10 ms β no change β
β QQuery 76 β 34.87 ms β 35.00 ms β no change β
β QQuery 77 β 61.40 ms β 61.65 ms β no change β
β QQuery 78 β 168.50 ms β 165.19 ms β no change β
β QQuery 79 β 67.69 ms β 67.04 ms β no change β
β QQuery 80 β 97.67 ms β 100.73 ms β no change β
β QQuery 81 β 26.73 ms β 27.19 ms β no change β
β QQuery 82 β 16.97 ms β 17.09 ms β no change β
β QQuery 83 β 34.62 ms β 34.42 ms β no change β
β QQuery 84 β 30.18 ms β 30.25 ms β no change β
β QQuery 85 β 104.86 ms β 104.96 ms β no change β
β QQuery 86 β 25.93 ms β 25.70 ms β no change β
β QQuery 87 β 63.60 ms β 64.21 ms β no change β
β QQuery 88 β 61.87 ms β 61.87 ms β no change β
β QQuery 89 β 35.19 ms β 36.15 ms β no change β
β QQuery 90 β 17.15 ms β 17.40 ms β no change β
β QQuery 91 β 45.42 ms β 45.30 ms β no change β
β QQuery 92 β 30.64 ms β 29.75 ms β no change β
β QQuery 93 β 48.71 ms β 52.73 ms β 1.08x slower β
β QQuery 94 β 39.01 ms β 38.80 ms β no change β
β QQuery 95 β 81.29 ms β 81.03 ms β no change β
β QQuery 96 β 24.33 ms β 24.14 ms β no change β
β QQuery 97 β 51.92 ms β 52.11 ms β no change β
β QQuery 98 β 43.55 ms β 43.38 ms β no change β
β QQuery 99 β 65.82 ms β 66.21 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄βββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 9312.35ms β
β Total Time (rich-T-kid_coacler-benchmark) β 9310.91ms β
β Average Time (HEAD) β 94.06ms β
β Average Time (rich-T-kid_coacler-benchmark) β 94.05ms β
β Queries Faster β 0 β
β Queries Slower β 2 β
β Queries with No Change β 97 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 5.94 / 6.41 Β±0.88 / 8.16 ms β 5.89 / 6.47 Β±0.91 / 8.28 ms β no change β
β QQuery 2 β 80.35 / 81.04 Β±0.41 / 81.56 ms β 80.64 / 81.05 Β±0.41 / 81.82 ms β no change β
β QQuery 3 β 28.98 / 29.26 Β±0.24 / 29.70 ms β 28.98 / 29.16 Β±0.12 / 29.29 ms β no change β
β QQuery 4 β 477.78 / 480.94 Β±2.82 / 485.81 ms β 476.61 / 479.95 Β±1.83 / 481.81 ms β no change β
β QQuery 5 β 51.47 / 51.82 Β±0.28 / 52.22 ms β 50.59 / 51.46 Β±0.81 / 52.67 ms β no change β
β QQuery 6 β 36.53 / 36.93 Β±0.24 / 37.18 ms β 36.49 / 37.20 Β±0.38 / 37.60 ms β no change β
β QQuery 7 β 75.06 / 75.43 Β±0.34 / 75.91 ms β 74.57 / 75.25 Β±0.56 / 76.05 ms β no change β
β QQuery 8 β 37.33 / 37.50 Β±0.17 / 37.81 ms β 36.60 / 36.80 Β±0.16 / 37.01 ms β no change β
β QQuery 9 β 54.17 / 56.86 Β±3.85 / 64.42 ms β 52.16 / 54.03 Β±1.05 / 54.95 ms β no change β
β QQuery 10 β 63.43 / 63.90 Β±0.36 / 64.26 ms β 62.20 / 62.54 Β±0.22 / 62.86 ms β no change β
β QQuery 11 β 305.71 / 307.95 Β±1.72 / 310.56 ms β 300.32 / 303.06 Β±2.15 / 305.66 ms β no change β
β QQuery 12 β 29.83 / 30.12 Β±0.24 / 30.55 ms β 29.72 / 30.30 Β±0.42 / 30.77 ms β no change β
β QQuery 13 β 119.10 / 120.37 Β±0.78 / 121.23 ms β 118.10 / 118.97 Β±0.65 / 119.99 ms β no change β
β QQuery 14 β 402.40 / 404.87 Β±2.48 / 409.50 ms β 399.54 / 404.56 Β±3.95 / 409.59 ms β no change β
β QQuery 15 β 58.71 / 61.92 Β±2.28 / 65.73 ms β 58.84 / 60.46 Β±2.28 / 64.90 ms β no change β
β QQuery 16 β 7.03 / 7.17 Β±0.12 / 7.34 ms β 7.00 / 7.18 Β±0.13 / 7.40 ms β no change β
β QQuery 17 β 81.19 / 82.20 Β±1.20 / 84.56 ms β 80.88 / 82.09 Β±1.51 / 85.02 ms β no change β
β QQuery 18 β 108.06 / 109.03 Β±0.79 / 110.25 ms β 107.84 / 110.01 Β±1.84 / 112.77 ms β no change β
β QQuery 19 β 42.45 / 43.11 Β±0.77 / 44.44 ms β 41.64 / 42.05 Β±0.28 / 42.49 ms β no change β
β QQuery 20 β 37.15 / 38.16 Β±1.06 / 40.17 ms β 36.33 / 37.20 Β±0.68 / 38.00 ms β no change β
β QQuery 21 β 17.42 / 17.68 Β±0.26 / 18.01 ms β 17.25 / 17.56 Β±0.24 / 17.98 ms β no change β
β QQuery 22 β 67.78 / 68.10 Β±0.29 / 68.59 ms β 66.56 / 66.92 Β±0.31 / 67.47 ms β no change β
β QQuery 23 β 329.78 / 335.10 Β±4.12 / 341.22 ms β 329.98 / 335.38 Β±5.44 / 344.50 ms β no change β
β QQuery 24 β 208.35 / 210.77 Β±3.63 / 217.87 ms β 203.03 / 207.89 Β±6.11 / 219.78 ms β no change β
β QQuery 25 β 108.28 / 110.44 Β±1.95 / 114.02 ms β 110.84 / 115.29 Β±5.40 / 125.72 ms β no change β
β QQuery 26 β 48.75 / 50.74 Β±3.04 / 56.81 ms β 48.67 / 48.88 Β±0.28 / 49.39 ms β no change β
β QQuery 27 β 6.50 / 6.57 Β±0.08 / 6.72 ms β 6.27 / 6.41 Β±0.16 / 6.72 ms β no change β
β QQuery 28 β 57.27 / 60.10 Β±2.19 / 62.38 ms β 61.09 / 63.65 Β±4.07 / 71.71 ms β 1.06x slower β
β QQuery 29 β 96.10 / 97.71 Β±1.54 / 100.24 ms β 97.34 / 99.83 Β±2.24 / 103.12 ms β no change β
β QQuery 30 β 33.80 / 35.78 Β±2.68 / 40.72 ms β 33.42 / 33.84 Β±0.26 / 34.15 ms β +1.06x faster β
β QQuery 31 β 110.36 / 111.37 Β±0.57 / 111.93 ms β 110.49 / 112.05 Β±2.34 / 116.70 ms β no change β
β QQuery 32 β 21.38 / 21.61 Β±0.30 / 22.17 ms β 21.24 / 21.57 Β±0.18 / 21.78 ms β no change β
β QQuery 33 β 37.67 / 38.09 Β±0.23 / 38.32 ms β 37.47 / 38.09 Β±0.37 / 38.47 ms β no change β
β QQuery 34 β 10.56 / 10.74 Β±0.13 / 10.91 ms β 10.48 / 10.69 Β±0.19 / 11.04 ms β no change β
β QQuery 35 β 75.81 / 78.47 Β±2.36 / 82.78 ms β 75.80 / 78.21 Β±3.04 / 83.91 ms β no change β
β QQuery 36 β 6.33 / 6.39 Β±0.04 / 6.45 ms β 6.16 / 6.24 Β±0.11 / 6.46 ms β no change β
β QQuery 37 β 7.41 / 7.46 Β±0.05 / 7.52 ms β 7.33 / 7.59 Β±0.19 / 7.85 ms β no change β
β QQuery 38 β 64.01 / 64.63 Β±0.38 / 65.11 ms β 64.20 / 65.45 Β±1.12 / 67.23 ms β no change β
β QQuery 39 β 76.14 / 78.78 Β±3.92 / 86.55 ms β 76.45 / 76.88 Β±0.38 / 77.50 ms β no change β
β QQuery 40 β 25.14 / 25.71 Β±0.36 / 26.25 ms β 24.75 / 26.40 Β±2.82 / 32.01 ms β no change β
β QQuery 41 β 11.82 / 12.02 Β±0.20 / 12.39 ms β 11.62 / 11.87 Β±0.15 / 12.06 ms β no change β
β QQuery 42 β 24.41 / 24.66 Β±0.30 / 25.22 ms β 24.06 / 24.46 Β±0.40 / 25.01 ms β no change β
β QQuery 43 β 5.58 / 5.62 Β±0.05 / 5.72 ms β 5.43 / 5.48 Β±0.06 / 5.59 ms β no change β
β QQuery 44 β 9.65 / 10.34 Β±1.09 / 12.50 ms β 9.64 / 9.75 Β±0.08 / 9.85 ms β +1.06x faster β
β QQuery 45 β 42.31 / 43.07 Β±0.57 / 43.85 ms β 41.91 / 43.86 Β±1.04 / 45.07 ms β no change β
β QQuery 46 β 12.53 / 12.73 Β±0.12 / 12.88 ms β 12.40 / 12.73 Β±0.39 / 13.29 ms β no change β
β QQuery 47 β 242.58 / 245.49 Β±2.95 / 250.47 ms β 242.61 / 246.91 Β±3.08 / 250.56 ms β no change β
β QQuery 48 β 96.05 / 96.90 Β±0.81 / 98.40 ms β 95.74 / 98.35 Β±4.19 / 106.69 ms β no change β
β QQuery 49 β 71.69 / 72.77 Β±1.40 / 75.52 ms β 71.66 / 72.76 Β±1.85 / 76.42 ms β no change β
β QQuery 50 β 59.20 / 61.68 Β±3.22 / 67.94 ms β 59.79 / 60.38 Β±0.39 / 60.77 ms β no change β
β QQuery 51 β 94.21 / 95.92 Β±1.19 / 97.93 ms β 93.79 / 96.57 Β±2.45 / 100.68 ms β no change β
β QQuery 52 β 24.57 / 24.80 Β±0.19 / 25.11 ms β 24.43 / 24.63 Β±0.17 / 24.90 ms β no change β
β QQuery 53 β 29.23 / 29.48 Β±0.14 / 29.66 ms β 29.25 / 29.56 Β±0.17 / 29.75 ms β no change β
β QQuery 54 β 54.82 / 56.30 Β±2.61 / 61.51 ms β 54.54 / 54.75 Β±0.22 / 55.10 ms β no change β
β QQuery 55 β 23.78 / 24.25 Β±0.40 / 24.75 ms β 24.27 / 26.29 Β±2.92 / 32.05 ms β 1.08x slower β
β QQuery 56 β 38.87 / 39.62 Β±0.54 / 40.33 ms β 39.18 / 39.88 Β±0.79 / 41.40 ms β no change β
β QQuery 57 β 171.38 / 173.29 Β±2.02 / 176.20 ms β 172.03 / 175.20 Β±3.60 / 182.17 ms β no change β
β QQuery 58 β 109.68 / 110.70 Β±0.84 / 111.95 ms β 109.23 / 109.97 Β±0.63 / 110.95 ms β no change β
β QQuery 59 β 116.55 / 117.38 Β±0.81 / 118.93 ms β 117.18 / 119.28 Β±2.43 / 124.02 ms β no change β
β QQuery 60 β 39.36 / 39.81 Β±0.47 / 40.55 ms β 39.43 / 39.67 Β±0.16 / 39.84 ms β no change β
β QQuery 61 β 12.17 / 12.23 Β±0.07 / 12.36 ms β 11.99 / 12.10 Β±0.12 / 12.32 ms β no change β
β QQuery 62 β 44.83 / 44.89 Β±0.06 / 45.00 ms β 44.29 / 44.86 Β±0.35 / 45.26 ms β no change β
β QQuery 63 β 29.52 / 31.39 Β±3.14 / 37.66 ms β 29.51 / 29.64 Β±0.13 / 29.86 ms β +1.06x faster β
β QQuery 64 β 368.97 / 371.76 Β±2.55 / 376.47 ms β 369.57 / 371.99 Β±1.78 / 374.37 ms β no change β
β QQuery 65 β 132.14 / 136.02 Β±2.09 / 138.08 ms β 134.09 / 135.23 Β±1.29 / 137.28 ms β no change β
β QQuery 66 β 79.30 / 81.35 Β±3.82 / 89.00 ms β 78.61 / 79.18 Β±0.33 / 79.58 ms β no change β
β QQuery 67 β 262.54 / 268.00 Β±3.54 / 272.33 ms β 266.37 / 269.23 Β±2.87 / 273.13 ms β no change β
β QQuery 68 β 12.53 / 12.67 Β±0.13 / 12.86 ms β 12.37 / 12.57 Β±0.18 / 12.81 ms β no change β
β QQuery 69 β 57.29 / 57.75 Β±0.56 / 58.85 ms β 56.73 / 57.20 Β±0.45 / 58.06 ms β no change β
β QQuery 70 β 104.05 / 108.68 Β±4.54 / 116.58 ms β 104.03 / 107.22 Β±5.38 / 117.95 ms β no change β
β QQuery 71 β 35.64 / 36.22 Β±0.63 / 37.41 ms β 35.56 / 36.22 Β±0.68 / 37.39 ms β no change β
β QQuery 72 β 1775.99 / 1830.33 Β±43.50 / 1901.18 ms β 1785.07 / 1845.64 Β±35.54 / 1894.62 ms β no change β
β QQuery 73 β 10.08 / 10.40 Β±0.36 / 11.02 ms β 10.13 / 10.39 Β±0.19 / 10.58 ms β no change β
β QQuery 74 β 175.75 / 176.47 Β±0.68 / 177.56 ms β 174.28 / 176.91 Β±2.22 / 180.50 ms β no change β
β QQuery 75 β 143.86 / 147.56 Β±4.59 / 156.45 ms β 144.10 / 148.54 Β±7.24 / 162.94 ms β no change β
β QQuery 76 β 34.87 / 35.44 Β±0.31 / 35.80 ms β 35.00 / 35.58 Β±0.60 / 36.72 ms β no change β
β QQuery 77 β 61.40 / 62.90 Β±1.25 / 65.12 ms β 61.65 / 62.64 Β±0.99 / 64.51 ms β no change β
β QQuery 78 β 168.50 / 172.66 Β±3.20 / 176.30 ms β 165.19 / 170.33 Β±5.22 / 179.17 ms β no change β
β QQuery 79 β 67.69 / 67.97 Β±0.30 / 68.49 ms β 67.04 / 67.38 Β±0.23 / 67.68 ms β no change β
β QQuery 80 β 97.67 / 100.59 Β±3.59 / 107.22 ms β 100.73 / 104.38 Β±4.46 / 112.96 ms β no change β
β QQuery 81 β 26.73 / 27.31 Β±0.57 / 28.28 ms β 27.19 / 28.37 Β±1.51 / 31.36 ms β no change β
β QQuery 82 β 16.97 / 17.18 Β±0.14 / 17.40 ms β 17.09 / 17.76 Β±0.89 / 19.50 ms β no change β
β QQuery 83 β 34.62 / 34.87 Β±0.26 / 35.25 ms β 34.42 / 34.64 Β±0.16 / 34.84 ms β no change β
β QQuery 84 β 30.18 / 30.31 Β±0.13 / 30.51 ms β 30.25 / 30.65 Β±0.38 / 31.33 ms β no change β
β QQuery 85 β 104.86 / 107.09 Β±3.74 / 114.53 ms β 104.96 / 109.39 Β±4.74 / 118.41 ms β no change β
β QQuery 86 β 25.93 / 26.25 Β±0.23 / 26.54 ms β 25.70 / 25.95 Β±0.25 / 26.29 ms β no change β
β QQuery 87 β 63.60 / 64.38 Β±0.43 / 64.87 ms β 64.21 / 64.48 Β±0.21 / 64.84 ms β no change β
β QQuery 88 β 61.87 / 65.35 Β±5.93 / 77.18 ms β 61.87 / 62.96 Β±1.51 / 65.95 ms β no change β
β QQuery 89 β 35.19 / 36.28 Β±0.87 / 37.75 ms β 36.15 / 37.16 Β±0.83 / 38.65 ms β no change β
β QQuery 90 β 17.15 / 17.33 Β±0.13 / 17.54 ms β 17.40 / 17.51 Β±0.10 / 17.68 ms β no change β
β QQuery 91 β 45.42 / 45.82 Β±0.34 / 46.27 ms β 45.30 / 45.79 Β±0.30 / 46.24 ms β no change β
β QQuery 92 β 30.64 / 30.94 Β±0.42 / 31.75 ms β 29.75 / 30.52 Β±0.69 / 31.72 ms β no change β
β QQuery 93 β 48.71 / 51.15 Β±2.31 / 55.36 ms β 52.73 / 53.74 Β±0.70 / 54.51 ms β 1.05x slower β
β QQuery 94 β 39.01 / 39.30 Β±0.30 / 39.85 ms β 38.80 / 39.36 Β±0.34 / 39.82 ms β no change β
β QQuery 95 β 81.29 / 81.95 Β±0.49 / 82.65 ms β 81.03 / 82.12 Β±1.17 / 84.31 ms β no change β
β QQuery 96 β 24.33 / 24.50 Β±0.10 / 24.63 ms β 24.14 / 24.35 Β±0.13 / 24.54 ms β no change β
β QQuery 97 β 51.92 / 54.01 Β±1.39 / 56.25 ms β 52.11 / 55.58 Β±4.15 / 63.65 ms β no change β
β QQuery 98 β 43.55 / 44.09 Β±0.48 / 44.84 ms β 43.38 / 44.07 Β±0.38 / 44.55 ms β no change β
β QQuery 99 β 65.82 / 66.72 Β±0.58 / 67.35 ms β 66.21 / 66.78 Β±0.49 / 67.68 ms β no change β
βββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 9488.13ms β
β Total Time (rich-T-kid_coacler-benchmark) β 9499.42ms β
β Average Time (HEAD) β 95.84ms β
β Average Time (rich-T-kid_coacler-benchmark) β 95.95ms β
β Queries Faster β 3 β
β Queries Slower β 3 β
β Queries with No Change β 93 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpcds β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 50.0s |
| Peak memory | 2.1 GiB |
| Avg memory | 1.4 GiB |
| CPU user | 204.6s |
| CPU sys | 5.5s |
| Peak spill | 0 B |
**tpcds β branch**
| Metric | Value |
|--------|-------|
| Wall time | 50.0s |
| Peak memory | 2.2 GiB |
| Avg memory | 1.5 GiB |
| CPU user | 206.4s |
| CPU sys | 5.6s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739485739
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739397449)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.24 ms β 1.24 ms β no change β
β QQuery 1 β 11.44 ms β 11.47 ms β no change β
β QQuery 2 β 36.78 ms β 36.68 ms β no change β
β QQuery 3 β 31.05 ms β 31.09 ms β no change β
β QQuery 4 β 234.50 ms β 228.98 ms β no change β
β QQuery 5 β 273.10 ms β 271.43 ms β no change β
β QQuery 6 β 1.29 ms β 1.28 ms β no change β
β QQuery 7 β 13.03 ms β 13.75 ms β 1.06x slower β
β QQuery 8 β 328.19 ms β 331.33 ms β no change β
β QQuery 9 β 464.13 ms β 480.22 ms β no change β
β QQuery 10 β 66.45 ms β 63.45 ms β no change β
β QQuery 11 β 75.75 ms β 74.69 ms β no change β
β QQuery 12 β 270.35 ms β 261.28 ms β no change β
β QQuery 13 β 359.47 ms β 379.42 ms β 1.06x slower β
β QQuery 14 β 276.80 ms β 284.96 ms β no change β
β QQuery 15 β 281.90 ms β 311.01 ms β 1.10x slower β
β QQuery 16 β 605.55 ms β 680.91 ms β 1.12x slower β
β QQuery 17 β 627.67 ms β 627.62 ms β no change β
β QQuery 18 β 1276.47 ms β 1307.83 ms β no change β
β QQuery 19 β 27.64 ms β 27.96 ms β no change β
β QQuery 20 β 517.33 ms β 517.69 ms β no change β
β QQuery 21 β 507.26 ms β 507.00 ms β no change β
β QQuery 22 β 983.75 ms β 976.54 ms β no change β
β QQuery 23 β 3073.13 ms β 3047.50 ms β no change β
β QQuery 24 β 41.90 ms β 40.33 ms β no change β
β QQuery 25 β 107.70 ms β 105.09 ms β no change β
β QQuery 26 β 42.82 ms β 40.57 ms β +1.06x faster β
β QQuery 27 β 524.17 ms β 512.22 ms β no change β
β QQuery 28 β 2936.99 ms β 2901.69 ms β no change β
β QQuery 29 β 41.59 ms β 43.43 ms β no change β
β QQuery 30 β 305.64 ms β 322.68 ms β 1.06x slower β
β QQuery 31 β 279.34 ms β 281.12 ms β no change β
β QQuery 32 β 942.46 ms β 1026.19 ms β 1.09x slower β
β QQuery 33 β 1483.11 ms β 1477.58 ms β no change β
β QQuery 34 β 1483.59 ms β 1512.98 ms β no change β
β QQuery 35 β 290.55 ms β 293.71 ms β no change β
β QQuery 36 β 68.38 ms β 66.40 ms β no change β
β QQuery 37 β 36.77 ms β 35.82 ms β no change β
β QQuery 38 β 41.16 ms β 42.21 ms β no change β
β QQuery 39 β 141.92 ms β 160.19 ms β 1.13x slower β
β QQuery 40 β 14.22 ms β 14.11 ms β no change β
β QQuery 41 β 13.91 ms β 13.43 ms β no change β
β QQuery 42 β 13.10 ms β 13.05 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 19153.59ms β
β Total Time (rich-T-kid_coacler-benchmark) β 19378.11ms β
β Average Time (HEAD) β 445.43ms β
β Average Time (rich-T-kid_coacler-benchmark) β 450.65ms β
β Queries Faster β 1 β
β Queries Slower β 7 β
β Queries with No Change β 35 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark clickbench_partitioned.json
--------------------
βββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 0 β 1.24 / 4.19 Β±5.74 / 15.66 ms β 1.24 / 3.99 Β±5.41 / 14.80 ms β no change β
β QQuery 1 β 11.44 / 11.83 Β±0.21 / 12.05 ms β 11.47 / 12.04 Β±0.34 / 12.45 ms β no change β
β QQuery 2 β 36.78 / 37.29 Β±0.37 / 37.64 ms β 36.68 / 37.62 Β±0.73 / 38.32 ms β no change β
β QQuery 3 β 31.05 / 32.12 Β±0.90 / 33.55 ms β 31.09 / 31.42 Β±0.31 / 31.88 ms β no change β
β QQuery 4 β 234.50 / 252.23 Β±14.73 / 276.92 ms β 228.98 / 241.43 Β±9.72 / 256.59 ms β no change β
β QQuery 5 β 273.10 / 289.99 Β±13.32 / 307.19 ms β 271.43 / 277.59 Β±3.65 / 281.00 ms β no change β
β QQuery 6 β 1.29 / 1.44 Β±0.23 / 1.89 ms β 1.28 / 1.43 Β±0.24 / 1.90 ms β no change β
β QQuery 7 β 13.03 / 13.16 Β±0.13 / 13.36 ms β 13.75 / 13.92 Β±0.12 / 14.08 ms β 1.06x slower β
β QQuery 8 β 328.19 / 337.70 Β±9.06 / 351.15 ms β 331.33 / 341.12 Β±14.02 / 368.89 ms β no change β
β QQuery 9 β 464.13 / 483.63 Β±16.93 / 513.12 ms β 480.22 / 486.96 Β±4.94 / 493.32 ms β no change β
β QQuery 10 β 66.45 / 68.82 Β±3.41 / 75.57 ms β 63.45 / 67.87 Β±6.54 / 80.87 ms β no change β
β QQuery 11 β 75.75 / 76.61 Β±0.74 / 77.89 ms β 74.69 / 75.44 Β±0.71 / 76.64 ms β no change β
β QQuery 12 β 270.35 / 277.09 Β±7.00 / 289.14 ms β 261.28 / 272.75 Β±7.49 / 281.02 ms β no change β
β QQuery 13 β 359.47 / 373.69 Β±9.57 / 388.20 ms β 379.42 / 406.71 Β±17.25 / 424.92 ms β 1.09x slower β
β QQuery 14 β 276.80 / 286.48 Β±10.03 / 299.76 ms β 284.96 / 303.83 Β±16.54 / 333.59 ms β 1.06x slower β
β QQuery 15 β 281.90 / 294.97 Β±12.77 / 318.52 ms β 311.01 / 349.79 Β±23.85 / 383.85 ms β 1.19x slower β
β QQuery 16 β 605.55 / 623.52 Β±9.46 / 633.08 ms β 680.91 / 702.44 Β±14.09 / 724.34 ms β 1.13x slower β
β QQuery 17 β 627.67 / 635.01 Β±7.77 / 645.03 ms β 627.62 / 670.30 Β±21.81 / 687.63 ms β 1.06x slower β
β QQuery 18 β 1276.47 / 1314.56 Β±29.85 / 1355.60 ms β 1307.83 / 1329.82 Β±20.36 / 1368.33 ms β no change β
β QQuery 19 β 27.64 / 31.74 Β±6.43 / 44.51 ms β 27.96 / 42.56 Β±28.79 / 100.13 ms β 1.34x slower β
β QQuery 20 β 517.33 / 536.24 Β±15.50 / 562.73 ms β 517.69 / 524.28 Β±4.08 / 529.26 ms β no change β
β QQuery 21 β 507.26 / 514.78 Β±4.17 / 519.64 ms β 507.00 / 516.40 Β±5.49 / 523.39 ms β no change β
β QQuery 22 β 983.75 / 990.68 Β±6.66 / 1002.15 ms β 976.54 / 987.09 Β±6.17 / 993.08 ms β no change β
β QQuery 23 β 3073.13 / 3112.36 Β±39.21 / 3168.71 ms β 3047.50 / 3111.00 Β±37.19 / 3155.44 ms β no change β
β QQuery 24 β 41.90 / 43.39 Β±1.49 / 45.93 ms β 40.33 / 41.20 Β±0.86 / 42.78 ms β +1.05x faster β
β QQuery 25 β 107.70 / 111.00 Β±4.43 / 119.73 ms β 105.09 / 112.20 Β±7.51 / 125.06 ms β no change β
β QQuery 26 β 42.82 / 44.07 Β±2.27 / 48.60 ms β 40.57 / 42.49 Β±2.45 / 47.07 ms β no change β
β QQuery 27 β 524.17 / 539.10 Β±12.01 / 560.38 ms β 512.22 / 517.20 Β±4.63 / 523.85 ms β no change β
β QQuery 28 β 2936.99 / 2959.15 Β±17.28 / 2984.78 ms β 2901.69 / 2943.21 Β±32.70 / 2996.85 ms β no change β
β QQuery 29 β 41.59 / 42.07 Β±0.41 / 42.58 ms β 43.43 / 54.05 Β±10.25 / 69.69 ms β 1.28x slower β
β QQuery 30 β 305.64 / 314.23 Β±6.51 / 325.35 ms β 322.68 / 339.83 Β±8.60 / 345.15 ms β 1.08x slower β
β QQuery 31 β 279.34 / 289.23 Β±12.10 / 312.00 ms β 281.12 / 309.34 Β±15.66 / 328.75 ms β 1.07x slower β
β QQuery 32 β 942.46 / 954.57 Β±11.65 / 970.02 ms β 1026.19 / 1093.98 Β±58.50 / 1173.99 ms β 1.15x slower β
β QQuery 33 β 1483.11 / 1520.57 Β±39.40 / 1592.53 ms β 1477.58 / 1524.38 Β±28.78 / 1563.52 ms β no change β
β QQuery 34 β 1483.59 / 1583.10 Β±95.48 / 1746.04 ms β 1512.98 / 1540.75 Β±22.71 / 1567.95 ms β no change β
β QQuery 35 β 290.55 / 314.65 Β±25.66 / 353.95 ms β 293.71 / 313.10 Β±13.43 / 331.71 ms β no change β
β QQuery 36 β 68.38 / 72.29 Β±3.02 / 77.20 ms β 66.40 / 77.81 Β±11.06 / 95.56 ms β 1.08x slower β
β QQuery 37 β 36.77 / 42.79 Β±4.89 / 49.76 ms β 35.82 / 39.06 Β±2.78 / 42.49 ms β +1.10x faster β
β QQuery 38 β 41.16 / 48.66 Β±10.33 / 69.18 ms β 42.21 / 45.66 Β±3.32 / 50.32 ms β +1.07x faster β
β QQuery 39 β 141.92 / 154.32 Β±11.09 / 174.76 ms β 160.19 / 165.60 Β±3.50 / 171.17 ms β 1.07x slower β
β QQuery 40 β 14.22 / 14.68 Β±0.35 / 15.27 ms β 14.11 / 14.74 Β±0.52 / 15.39 ms β no change β
β QQuery 41 β 13.91 / 14.71 Β±0.45 / 15.29 ms β 13.43 / 14.67 Β±1.77 / 18.19 ms β no change β
β QQuery 42 β 13.10 / 14.56 Β±2.34 / 19.22 ms β 13.05 / 13.32 Β±0.23 / 13.67 ms β +1.09x faster β
βββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ
β Benchmark Summary β β
β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 19677.28ms β
β Total Time (rich-T-kid_coacler-benchmark) β 20010.39ms β
β Average Time (HEAD) β 457.61ms β
β Average Time (rich-T-kid_coacler-benchmark) β 465.36ms β
β Queries Faster β 4 β
β Queries Slower β 13 β
β Queries with No Change β 26 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**clickbench_partitioned β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 100.0s |
| Peak memory | 12.3 GiB |
| Avg memory | 4.5 GiB |
| CPU user | 1005.6s |
| CPU sys | 70.2s |
| Peak spill | 0 B |
**clickbench_partitioned β branch**
| Metric | Value |
|--------|-------|
| Wall time | 105.0s |
| Peak memory | 12.4 GiB |
| Avg memory | 4.6 GiB |
| CPU user | 1016.0s |
| CPU sys | 75.7s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739407211
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739390843)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5739390843-2464-8bkhj 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739410030
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739391357)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5739391357-2467-4zrw6 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (2aaf537ee8bf2c8b32aec817095456aa8eae82cd) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..2aaf537ee8bf2c8b32aec817095456aa8eae82cd)
<details><summary>Run configuration</summary>
```yaml
run benchmark clickbench_partitioned
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739779443
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739768986)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5739768986-2481-xjjk7 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (dbfc4e87e81f5ae40f150fa37700863a165cd991) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..dbfc4e87e81f5ae40f150fa37700863a165cd991)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739768986
run benchmarks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "Rich-T-kid (via GitHub)" <gi...@apache.org>.
Rich-T-kid commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739768539
run benchmarks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5736791822
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5736766800)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5736766800-2462-pzvcz 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (76e1f1c24138317d60fc604b72283008fad49b6a) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..76e1f1c24138317d60fc604b72283008fad49b6a)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5736785644
π€ Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5736766135)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c5736766135-2460-nglwf 6.12.94+ #1 SMP Tue Aug 4 08:44:15 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing rich-T-kid/coacler-benchmark (76e1f1c24138317d60fc604b72283008fad49b6a) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..76e1f1c24138317d60fc604b72283008fad49b6a)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpch
```
</details>
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [PR] playground [datafusion]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #25487:
URL: https://github.com/apache/datafusion/pull/25487#issuecomment-5739812901
π€ Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/25487#issuecomment-5739768539)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
Comparing rich-T-kid/coacler-benchmark (dbfc4e87e81f5ae40f150fa37700863a165cd991) to 6e4d9ba (merge-base) [diff](https://github.com/apache/datafusion/compare/6e4d9bae3c63585cfd920d6364c0c438028acac1..dbfc4e87e81f5ae40f150fa37700863a165cd991)
<details><summary>Run configuration</summary>
```yaml
run benchmark tpcds
```
</details>
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 5.92 ms β 5.85 ms β no change β
β QQuery 2 β 81.56 ms β 80.55 ms β no change β
β QQuery 3 β 29.30 ms β 29.13 ms β no change β
β QQuery 4 β 494.69 ms β 474.73 ms β no change β
β QQuery 5 β 52.01 ms β 52.09 ms β no change β
β QQuery 6 β 36.91 ms β 37.06 ms β no change β
β QQuery 7 β 75.06 ms β 74.22 ms β no change β
β QQuery 8 β 37.51 ms β 36.55 ms β no change β
β QQuery 9 β 53.70 ms β 51.87 ms β no change β
β QQuery 10 β 62.90 ms β 62.27 ms β no change β
β QQuery 11 β 322.20 ms β 305.00 ms β +1.06x faster β
β QQuery 12 β 29.93 ms β 29.73 ms β no change β
β QQuery 13 β 119.69 ms β 118.52 ms β no change β
β QQuery 14 β 406.98 ms β 398.55 ms β no change β
β QQuery 15 β 66.07 ms β 61.37 ms β +1.08x faster β
β QQuery 16 β 7.35 ms β 6.94 ms β +1.06x faster β
β QQuery 17 β 82.49 ms β 80.26 ms β no change β
β QQuery 18 β 116.32 ms β 106.86 ms β +1.09x faster β
β QQuery 19 β 43.60 ms β 41.99 ms β no change β
β QQuery 20 β 38.90 ms β 35.66 ms β +1.09x faster β
β QQuery 21 β 18.08 ms β 17.20 ms β no change β
β QQuery 22 β 71.23 ms β 65.79 ms β +1.08x faster β
β QQuery 23 β 329.39 ms β 315.14 ms β no change β
β QQuery 24 β 203.02 ms β 197.82 ms β no change β
β QQuery 25 β 108.22 ms β 110.21 ms β no change β
β QQuery 26 β 49.63 ms β 49.18 ms β no change β
β QQuery 27 β 6.51 ms β 6.60 ms β no change β
β QQuery 28 β 57.48 ms β 61.49 ms β 1.07x slower β
β QQuery 29 β 97.84 ms β 95.47 ms β no change β
β QQuery 30 β 35.62 ms β 33.25 ms β +1.07x faster β
β QQuery 31 β 111.47 ms β 109.63 ms β no change β
β QQuery 32 β 21.16 ms β 20.89 ms β no change β
β QQuery 33 β 38.42 ms β 37.48 ms β no change β
β QQuery 34 β 10.68 ms β 10.92 ms β no change β
β QQuery 35 β 78.75 ms β 76.07 ms β no change β
β QQuery 36 β 6.47 ms β 6.51 ms β no change β
β QQuery 37 β 7.47 ms β 7.52 ms β no change β
β QQuery 38 β 65.48 ms β 63.54 ms β no change β
β QQuery 39 β 77.19 ms β 75.05 ms β no change β
β QQuery 40 β 25.57 ms β 24.84 ms β no change β
β QQuery 41 β 12.05 ms β 11.55 ms β no change β
β QQuery 42 β 24.66 ms β 24.02 ms β no change β
β QQuery 43 β 5.77 ms β 5.41 ms β +1.07x faster β
β QQuery 44 β 9.93 ms β 9.63 ms β no change β
β QQuery 45 β 45.62 ms β 44.91 ms β no change β
β QQuery 46 β 12.69 ms β 12.43 ms β no change β
β QQuery 47 β 273.75 ms β 240.23 ms β +1.14x faster β
β QQuery 48 β 97.84 ms β 94.85 ms β no change β
β QQuery 49 β 72.72 ms β 70.74 ms β no change β
β QQuery 50 β 59.04 ms β 58.27 ms β no change β
β QQuery 51 β 94.67 ms β 95.16 ms β no change β
β QQuery 52 β 24.76 ms β 24.76 ms β no change β
β QQuery 53 β 29.61 ms β 29.50 ms β no change β
β QQuery 54 β 54.46 ms β 55.25 ms β no change β
β QQuery 55 β 23.84 ms β 23.75 ms β no change β
β QQuery 56 β 39.68 ms β 38.78 ms β no change β
β QQuery 57 β 174.11 ms β 169.35 ms β no change β
β QQuery 58 β 111.08 ms β 112.19 ms β no change β
β QQuery 59 β 117.59 ms β 118.79 ms β no change β
β QQuery 60 β 39.66 ms β 40.18 ms β no change β
β QQuery 61 β 12.11 ms β 12.31 ms β no change β
β QQuery 62 β 44.93 ms β 45.52 ms β no change β
β QQuery 63 β 29.65 ms β 29.59 ms β no change β
β QQuery 64 β 369.41 ms β 371.88 ms β no change β
β QQuery 65 β 128.22 ms β 136.14 ms β 1.06x slower β
β QQuery 66 β 77.41 ms β 81.19 ms β no change β
β QQuery 67 β 259.62 ms β 274.68 ms β 1.06x slower β
β QQuery 68 β 12.22 ms β 12.55 ms β no change β
β QQuery 69 β 56.84 ms β 57.37 ms β no change β
β QQuery 70 β 104.60 ms β 104.59 ms β no change β
β QQuery 71 β 35.10 ms β 36.26 ms β no change β
β QQuery 72 β 1699.52 ms β 1772.26 ms β no change β
β QQuery 73 β 10.25 ms β 9.99 ms β no change β
β QQuery 74 β 173.21 ms β 172.99 ms β no change β
β QQuery 75 β 145.11 ms β 143.27 ms β no change β
β QQuery 76 β 34.97 ms β 34.39 ms β no change β
β QQuery 77 β 61.36 ms β 59.82 ms β no change β
β QQuery 78 β 167.48 ms β 166.95 ms β no change β
β QQuery 79 β 68.49 ms β 66.51 ms β no change β
β QQuery 80 β 98.68 ms β 95.21 ms β no change β
β QQuery 81 β 26.78 ms β 26.44 ms β no change β
β QQuery 82 β 16.84 ms β 16.28 ms β no change β
β QQuery 83 β 34.74 ms β 33.66 ms β no change β
β QQuery 84 β 30.13 ms β 29.91 ms β no change β
β QQuery 85 β 104.10 ms β 103.12 ms β no change β
β QQuery 86 β 26.77 ms β 25.71 ms β no change β
β QQuery 87 β 64.40 ms β 63.44 ms β no change β
β QQuery 88 β 62.00 ms β 61.26 ms β no change β
β QQuery 89 β 35.54 ms β 35.44 ms β no change β
β QQuery 90 β 17.08 ms β 17.12 ms β no change β
β QQuery 91 β 44.75 ms β 44.82 ms β no change β
β QQuery 92 β 31.26 ms β 29.73 ms β no change β
β QQuery 93 β 52.93 ms β 49.69 ms β +1.07x faster β
β QQuery 94 β 39.98 ms β 38.47 ms β no change β
β QQuery 95 β 82.41 ms β 80.04 ms β no change β
β QQuery 96 β 23.89 ms β 24.33 ms β no change β
β QQuery 97 β 51.37 ms β 52.01 ms β no change β
β QQuery 98 β 43.39 ms β 43.12 ms β no change β
β QQuery 99 β 65.57 ms β 65.65 ms β no change β
βββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 9349.43ms β
β Total Time (rich-T-kid_coacler-benchmark) β 9277.26ms β
β Average Time (HEAD) β 94.44ms β
β Average Time (rich-T-kid_coacler-benchmark) β 93.71ms β
β Queries Faster β 10 β
β Queries Slower β 3 β
β Queries with No Change β 86 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
Distribution per query (min / mean Β±stddev / max):
Comparing HEAD and rich-T-kid_coacler-benchmark
--------------------
Benchmark tpcds_sf1.json
--------------------
βββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββββββββββββββββββββββββββ³ββββββββββββββββ
β Query β HEAD β rich-T-kid_coacler-benchmark β Change β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β QQuery 1 β 5.92 / 6.44 Β±0.92 / 8.29 ms β 5.85 / 6.37 Β±0.92 / 8.20 ms β no change β
β QQuery 2 β 81.56 / 81.82 Β±0.23 / 82.20 ms β 80.55 / 81.08 Β±0.42 / 81.68 ms β no change β
β QQuery 3 β 29.30 / 29.56 Β±0.29 / 30.08 ms β 29.13 / 29.39 Β±0.24 / 29.83 ms β no change β
β QQuery 4 β 494.69 / 507.83 Β±11.37 / 528.03 ms β 474.73 / 490.34 Β±8.69 / 497.98 ms β no change β
β QQuery 5 β 52.01 / 52.37 Β±0.29 / 52.74 ms β 52.09 / 52.50 Β±0.46 / 53.29 ms β no change β
β QQuery 6 β 36.91 / 37.42 Β±0.41 / 38.06 ms β 37.06 / 37.69 Β±0.59 / 38.80 ms β no change β
β QQuery 7 β 75.06 / 75.59 Β±0.51 / 76.34 ms β 74.22 / 75.09 Β±0.86 / 76.24 ms β no change β
β QQuery 8 β 37.51 / 38.35 Β±0.78 / 39.73 ms β 36.55 / 37.65 Β±1.53 / 40.61 ms β no change β
β QQuery 9 β 53.70 / 55.01 Β±1.24 / 57.13 ms β 51.87 / 54.63 Β±1.94 / 57.84 ms β no change β
β QQuery 10 β 62.90 / 63.15 Β±0.17 / 63.42 ms β 62.27 / 62.96 Β±0.43 / 63.51 ms β no change β
β QQuery 11 β 322.20 / 325.38 Β±2.08 / 327.90 ms β 305.00 / 314.38 Β±9.48 / 332.16 ms β no change β
β QQuery 12 β 29.93 / 30.09 Β±0.13 / 30.30 ms β 29.73 / 29.96 Β±0.17 / 30.20 ms β no change β
β QQuery 13 β 119.69 / 122.00 Β±3.43 / 128.77 ms β 118.52 / 119.50 Β±0.62 / 120.44 ms β no change β
β QQuery 14 β 406.98 / 412.56 Β±7.62 / 427.62 ms β 398.55 / 400.81 Β±1.89 / 404.02 ms β no change β
β QQuery 15 β 66.07 / 67.85 Β±1.57 / 70.40 ms β 61.37 / 62.13 Β±1.11 / 64.30 ms β +1.09x faster β
β QQuery 16 β 7.35 / 7.55 Β±0.17 / 7.83 ms β 6.94 / 7.10 Β±0.10 / 7.25 ms β +1.06x faster β
β QQuery 17 β 82.49 / 84.19 Β±1.90 / 87.88 ms β 80.26 / 81.58 Β±1.13 / 83.48 ms β no change β
β QQuery 18 β 116.32 / 118.03 Β±1.78 / 121.37 ms β 106.86 / 110.47 Β±2.96 / 115.42 ms β +1.07x faster β
β QQuery 19 β 43.60 / 44.19 Β±0.44 / 44.83 ms β 41.99 / 42.47 Β±0.36 / 43.04 ms β no change β
β QQuery 20 β 38.90 / 39.92 Β±1.99 / 43.90 ms β 35.66 / 36.09 Β±0.34 / 36.70 ms β +1.11x faster β
β QQuery 21 β 18.08 / 18.50 Β±0.50 / 19.44 ms β 17.20 / 17.71 Β±0.44 / 18.52 ms β no change β
β QQuery 22 β 71.23 / 72.86 Β±0.99 / 74.12 ms β 65.79 / 67.61 Β±1.94 / 71.14 ms β +1.08x faster β
β QQuery 23 β 329.39 / 342.42 Β±13.07 / 364.20 ms β 315.14 / 323.78 Β±5.72 / 331.81 ms β +1.06x faster β
β QQuery 24 β 203.02 / 205.65 Β±1.98 / 208.45 ms β 197.82 / 202.63 Β±6.04 / 214.19 ms β no change β
β QQuery 25 β 108.22 / 109.58 Β±0.99 / 110.79 ms β 110.21 / 112.57 Β±2.27 / 116.88 ms β no change β
β QQuery 26 β 49.63 / 51.31 Β±2.78 / 56.84 ms β 49.18 / 49.70 Β±0.32 / 50.12 ms β no change β
β QQuery 27 β 6.51 / 6.69 Β±0.14 / 6.85 ms β 6.60 / 6.80 Β±0.11 / 6.94 ms β no change β
β QQuery 28 β 57.48 / 61.55 Β±2.06 / 63.15 ms β 61.49 / 62.77 Β±1.48 / 65.65 ms β no change β
β QQuery 29 β 97.84 / 98.86 Β±1.13 / 100.97 ms β 95.47 / 97.20 Β±1.12 / 98.85 ms β no change β
β QQuery 30 β 35.62 / 38.81 Β±4.13 / 46.97 ms β 33.25 / 33.62 Β±0.25 / 33.94 ms β +1.15x faster β
β QQuery 31 β 111.47 / 113.05 Β±1.16 / 114.95 ms β 109.63 / 111.48 Β±1.97 / 115.29 ms β no change β
β QQuery 32 β 21.16 / 21.46 Β±0.17 / 21.64 ms β 20.89 / 21.20 Β±0.19 / 21.47 ms β no change β
β QQuery 33 β 38.42 / 40.74 Β±3.03 / 46.68 ms β 37.48 / 38.19 Β±0.47 / 38.90 ms β +1.07x faster β
β QQuery 34 β 10.68 / 10.90 Β±0.32 / 11.53 ms β 10.92 / 11.22 Β±0.43 / 12.06 ms β no change β
β QQuery 35 β 78.75 / 79.77 Β±1.08 / 81.85 ms β 76.07 / 78.16 Β±1.21 / 79.72 ms β no change β
β QQuery 36 β 6.47 / 6.56 Β±0.09 / 6.73 ms β 6.51 / 6.60 Β±0.06 / 6.67 ms β no change β
β QQuery 37 β 7.47 / 7.69 Β±0.16 / 7.88 ms β 7.52 / 7.70 Β±0.14 / 7.85 ms β no change β
β QQuery 38 β 65.48 / 66.53 Β±0.60 / 67.29 ms β 63.54 / 65.77 Β±1.57 / 67.76 ms β no change β
β QQuery 39 β 77.19 / 80.84 Β±4.91 / 90.54 ms β 75.05 / 75.97 Β±0.88 / 77.42 ms β +1.06x faster β
β QQuery 40 β 25.57 / 26.12 Β±0.40 / 26.83 ms β 24.84 / 25.12 Β±0.18 / 25.31 ms β no change β
β QQuery 41 β 12.05 / 12.30 Β±0.17 / 12.57 ms β 11.55 / 12.58 Β±1.89 / 16.36 ms β no change β
β QQuery 42 β 24.66 / 25.00 Β±0.21 / 25.29 ms β 24.02 / 24.65 Β±0.55 / 25.55 ms β no change β
β QQuery 43 β 5.77 / 5.83 Β±0.04 / 5.90 ms β 5.41 / 5.51 Β±0.09 / 5.67 ms β +1.06x faster β
β QQuery 44 β 9.93 / 10.07 Β±0.09 / 10.17 ms β 9.63 / 9.77 Β±0.11 / 9.92 ms β no change β
β QQuery 45 β 45.62 / 46.69 Β±0.89 / 47.82 ms β 44.91 / 46.15 Β±0.93 / 47.30 ms β no change β
β QQuery 46 β 12.69 / 13.26 Β±0.67 / 14.58 ms β 12.43 / 13.01 Β±0.64 / 14.25 ms β no change β
β QQuery 47 β 273.75 / 278.43 Β±5.64 / 287.95 ms β 240.23 / 254.24 Β±8.79 / 261.43 ms β +1.10x faster β
β QQuery 48 β 97.84 / 98.92 Β±0.83 / 100.19 ms β 94.85 / 96.78 Β±1.30 / 98.95 ms β no change β
β QQuery 49 β 72.72 / 74.81 Β±2.98 / 80.63 ms β 70.74 / 71.10 Β±0.32 / 71.65 ms β no change β
β QQuery 50 β 59.04 / 59.35 Β±0.37 / 59.95 ms β 58.27 / 58.62 Β±0.21 / 58.89 ms β no change β
β QQuery 51 β 94.67 / 97.34 Β±1.55 / 99.42 ms β 95.16 / 96.65 Β±1.18 / 98.13 ms β no change β
β QQuery 52 β 24.76 / 25.20 Β±0.44 / 25.92 ms β 24.76 / 24.95 Β±0.11 / 25.09 ms β no change β
β QQuery 53 β 29.61 / 30.09 Β±0.45 / 30.81 ms β 29.50 / 29.94 Β±0.24 / 30.19 ms β no change β
β QQuery 54 β 54.46 / 54.97 Β±0.46 / 55.69 ms β 55.25 / 56.12 Β±0.49 / 56.59 ms β no change β
β QQuery 55 β 23.84 / 23.96 Β±0.09 / 24.09 ms β 23.75 / 24.81 Β±1.29 / 27.19 ms β no change β
β QQuery 56 β 39.68 / 40.08 Β±0.35 / 40.68 ms β 38.78 / 39.25 Β±0.45 / 40.08 ms β no change β
β QQuery 57 β 174.11 / 179.95 Β±3.87 / 186.25 ms β 169.35 / 172.55 Β±3.90 / 179.97 ms β no change β
β QQuery 58 β 111.08 / 114.17 Β±2.27 / 117.94 ms β 112.19 / 113.16 Β±0.66 / 114.20 ms β no change β
β QQuery 59 β 117.59 / 118.12 Β±0.51 / 119.01 ms β 118.79 / 120.38 Β±1.69 / 123.02 ms β no change β
β QQuery 60 β 39.66 / 40.97 Β±1.45 / 43.57 ms β 40.18 / 41.47 Β±0.89 / 42.34 ms β no change β
β QQuery 61 β 12.11 / 12.41 Β±0.33 / 13.01 ms β 12.31 / 12.41 Β±0.11 / 12.62 ms β no change β
β QQuery 62 β 44.93 / 45.11 Β±0.13 / 45.22 ms β 45.52 / 45.90 Β±0.23 / 46.20 ms β no change β
β QQuery 63 β 29.65 / 29.98 Β±0.24 / 30.37 ms β 29.59 / 30.17 Β±0.37 / 30.72 ms β no change β
β QQuery 64 β 369.41 / 380.40 Β±7.39 / 390.86 ms β 371.88 / 375.30 Β±4.68 / 384.20 ms β no change β
β QQuery 65 β 128.22 / 132.33 Β±3.44 / 138.69 ms β 136.14 / 138.32 Β±2.08 / 141.72 ms β no change β
β QQuery 66 β 77.41 / 78.73 Β±1.49 / 81.30 ms β 81.19 / 82.79 Β±0.85 / 83.60 ms β 1.05x slower β
β QQuery 67 β 259.62 / 265.89 Β±5.24 / 273.02 ms β 274.68 / 279.71 Β±5.99 / 290.06 ms β 1.05x slower β
β QQuery 68 β 12.22 / 12.37 Β±0.16 / 12.63 ms β 12.55 / 12.77 Β±0.22 / 13.16 ms β no change β
β QQuery 69 β 56.84 / 58.73 Β±2.59 / 63.64 ms β 57.37 / 57.83 Β±0.32 / 58.19 ms β no change β
β QQuery 70 β 104.60 / 106.83 Β±2.51 / 111.67 ms β 104.59 / 110.37 Β±8.81 / 127.85 ms β no change β
β QQuery 71 β 35.10 / 35.73 Β±0.86 / 37.43 ms β 36.26 / 37.34 Β±1.15 / 39.54 ms β no change β
β QQuery 72 β 1699.52 / 1798.20 Β±64.80 / 1902.34 ms β 1772.26 / 1896.65 Β±80.21 / 2022.67 ms β 1.05x slower β
β QQuery 73 β 10.25 / 10.62 Β±0.33 / 11.17 ms β 9.99 / 10.42 Β±0.36 / 10.87 ms β no change β
β QQuery 74 β 173.21 / 178.26 Β±5.47 / 186.89 ms β 172.99 / 175.30 Β±1.76 / 177.63 ms β no change β
β QQuery 75 β 145.11 / 147.31 Β±3.92 / 155.13 ms β 143.27 / 145.61 Β±4.10 / 153.78 ms β no change β
β QQuery 76 β 34.97 / 35.41 Β±0.27 / 35.80 ms β 34.39 / 35.16 Β±0.63 / 36.05 ms β no change β
β QQuery 77 β 61.36 / 61.97 Β±0.66 / 63.16 ms β 59.82 / 60.37 Β±0.36 / 60.85 ms β no change β
β QQuery 78 β 167.48 / 173.41 Β±5.08 / 182.28 ms β 166.95 / 171.77 Β±6.00 / 183.28 ms β no change β
β QQuery 79 β 68.49 / 70.14 Β±1.26 / 71.42 ms β 66.51 / 67.69 Β±0.86 / 68.64 ms β no change β
β QQuery 80 β 98.68 / 100.09 Β±1.63 / 103.13 ms β 95.21 / 97.34 Β±1.93 / 100.28 ms β no change β
β QQuery 81 β 26.78 / 27.16 Β±0.31 / 27.71 ms β 26.44 / 26.73 Β±0.20 / 26.96 ms β no change β
β QQuery 82 β 16.84 / 17.30 Β±0.79 / 18.87 ms β 16.28 / 16.65 Β±0.21 / 16.87 ms β no change β
β QQuery 83 β 34.74 / 37.29 Β±4.96 / 47.20 ms β 33.66 / 35.13 Β±2.67 / 40.46 ms β +1.06x faster β
β QQuery 84 β 30.13 / 31.31 Β±1.30 / 33.68 ms β 29.91 / 30.12 Β±0.17 / 30.35 ms β no change β
β QQuery 85 β 104.10 / 104.41 Β±0.33 / 104.96 ms β 103.12 / 104.41 Β±1.42 / 107.16 ms β no change β
β QQuery 86 β 26.77 / 27.05 Β±0.17 / 27.27 ms β 25.71 / 25.90 Β±0.15 / 26.07 ms β no change β
β QQuery 87 β 64.40 / 69.65 Β±4.99 / 79.06 ms β 63.44 / 66.23 Β±3.08 / 71.95 ms β no change β
β QQuery 88 β 62.00 / 62.57 Β±0.43 / 63.30 ms β 61.26 / 61.69 Β±0.43 / 62.49 ms β no change β
β QQuery 89 β 35.54 / 36.02 Β±0.30 / 36.45 ms β 35.44 / 35.96 Β±0.42 / 36.60 ms β no change β
β QQuery 90 β 17.08 / 17.25 Β±0.12 / 17.39 ms β 17.12 / 17.34 Β±0.18 / 17.58 ms β no change β
β QQuery 91 β 44.75 / 47.20 Β±3.25 / 53.60 ms β 44.82 / 45.19 Β±0.21 / 45.42 ms β no change β
β QQuery 92 β 31.26 / 32.45 Β±1.11 / 34.33 ms β 29.73 / 31.75 Β±2.35 / 36.36 ms β no change β
β QQuery 93 β 52.93 / 53.35 Β±0.26 / 53.68 ms β 49.69 / 51.27 Β±1.78 / 54.58 ms β no change β
β QQuery 94 β 39.98 / 40.42 Β±0.37 / 41.11 ms β 38.47 / 39.09 Β±0.33 / 39.41 ms β no change β
β QQuery 95 β 82.41 / 84.29 Β±1.80 / 87.63 ms β 80.04 / 80.48 Β±0.32 / 80.86 ms β no change β
β QQuery 96 β 23.89 / 24.58 Β±0.83 / 26.22 ms β 24.33 / 26.10 Β±3.02 / 32.12 ms β 1.06x slower β
β QQuery 97 β 51.37 / 53.71 Β±1.63 / 56.48 ms β 52.01 / 53.65 Β±1.13 / 55.36 ms β no change β
β QQuery 98 β 43.39 / 44.84 Β±0.78 / 45.61 ms β 43.12 / 43.93 Β±0.60 / 44.72 ms β no change β
β QQuery 99 β 65.57 / 67.96 Β±3.78 / 75.47 ms β 65.65 / 66.37 Β±0.48 / 67.02 ms β no change β
βββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ
βββββββββββββββββββββββββββββββββββββββββββββββ³ββββββββββββ
β Benchmark Summary β β
β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ©
β Total Time (HEAD) β 9621.44ms β
β Total Time (rich-T-kid_coacler-benchmark) β 9560.87ms β
β Average Time (HEAD) β 97.19ms β
β Average Time (rich-T-kid_coacler-benchmark) β 96.57ms β
β Queries Faster β 12 β
β Queries Slower β 4 β
β Queries with No Change β 83 β
β Queries with Failure β 0 β
βββββββββββββββββββββββββββββββββββββββββββββββ΄ββββββββββββ
```
</p>
</details>
<details><summary>Resource Usage</summary>
**tpcds β base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 50.0s |
| Peak memory | 2.0 GiB |
| Avg memory | 1.4 GiB |
| CPU user | 205.6s |
| CPU sys | 5.8s |
| Peak spill | 0 B |
**tpcds β branch**
| Metric | Value |
|--------|-------|
| Wall time | 50.0s |
| Peak memory | 2.0 GiB |
| Avg memory | 1.4 GiB |
| CPU user | 207.7s |
| CPU sys | 5.5s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org