You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "Dandandan (via GitHub)" <gi...@apache.org> on 2026/05/29 09:04:56 UTC

[PR] Add row-number late materialization for TopK [datafusion]

Dandandan opened a new pull request, #22617:
URL: https://github.com/apache/datafusion/pull/22617

   ## Which issue does this PR close?
   
   None yet.
   
   ## Rationale for this change
   
   Large `ORDER BY ... LIMIT` queries can sort only key columns first and materialize non-key columns after the TopK rows are known. This reduces the amount of data read and moved through TopK execution, while preserving result order through row-number based selection.
   
   ## What changes are included in this PR?
   
   - Adds a `LateMaterialization` physical optimizer rule enabled by default via `datafusion.optimizer.enable_row_number_topk_late_materialization`
   - Adds `LateTopKMaterializationExec`, including a generic fallback path and a Parquet/file row-selection pushdown path
   - Adds `FileRowsSelection` support to file scan extensions and Parquet access planning
   - Documents the new optimizer config and updates the optimizer rule reference
   - Adds optimizer and Parquet integration coverage
   
   ## Are these changes tested?
   
   Yes.
   
   - `cargo fmt --all`
   - `cargo clippy --all-targets --all-features -- -D warnings`
   - `cargo check -p datafusion-datasource-parquet -p datafusion-physical-optimizer -p datafusion`
   - `cargo clippy -p datafusion-physical-optimizer -p datafusion-datasource-parquet -- -D warnings`
   - `cargo test -p datafusion --test core_integration late_materialization`
   - `cargo test -p datafusion --test parquet_integration file_rows_selection`
   - `git diff --check`
   
   ## Are there any user-facing changes?
   
   Yes. The new optimizer rule is enabled by default and can be disabled with `datafusion.optimizer.enable_row_number_topk_late_materialization = false`.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [PR] Add row-number late materialization for TopK [datafusion]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #22617:
URL: https://github.com/apache/datafusion/pull/22617#issuecomment-4573218988

   <!-- semver-check-comment -->
   Thank you for opening this pull request!
   
   Reviewer note: [cargo-semver-checks](https://github.com/obi1kenobi/cargo-semver-checks) reported the current version number is not SemVer-compatible with the changes in this pull request (compared against the base branch).
   
   <details>
   <summary>Details</summary>
   
   ```
        Cloning apache/main
       Building datafusion v53.1.0 (current)
          Built [  98.639s] (current)
        Parsing datafusion v53.1.0 (current)
         Parsed [   0.038s] (current)
       Building datafusion v53.1.0 (baseline)
          Built [  99.378s] (baseline)
        Parsing datafusion v53.1.0 (baseline)
         Parsed [   0.038s] (baseline)
       Checking datafusion v53.1.0 -> v53.1.0 (no change; assume patch)
        Checked [   0.860s] 222 checks: 222 pass, 30 skip
        Summary no semver update required
       Finished [ 200.912s] datafusion
       Building datafusion-common v53.1.0 (current)
          Built [  32.729s] (current)
        Parsing datafusion-common v53.1.0 (current)
         Parsed [   0.062s] (current)
       Building datafusion-common v53.1.0 (baseline)
          Built [  32.912s] (baseline)
        Parsing datafusion-common v53.1.0 (baseline)
         Parsed [   0.064s] (baseline)
       Checking datafusion-common v53.1.0 -> v53.1.0 (no change; assume patch)
        Checked [   0.959s] 222 checks: 221 pass, 1 fail, 0 warn, 30 skip
   
   --- failure constructible_struct_adds_field: externally-constructible struct adds field ---
   
   Description:
   A pub struct constructible with a struct literal has a new pub field. Existing struct literals must be updated to include the new field.
           ref: https://doc.rust-lang.org/reference/expressions/struct-expr.html
          impl: https://github.com/obi1kenobi/cargo-semver-checks/tree/v0.47.0/src/lints/constructible_struct_adds_field.ron
   
   Failed in:
     field OptimizerOptions.enable_row_number_topk_late_materialization in /home/runner/work/datafusion/datafusion/datafusion/common/src/config.rs:1085
   
        Summary semver requires new major version: 1 major and 0 minor checks failed
       Finished [  68.290s] datafusion-common
       Building datafusion-datasource v53.1.0 (current)
          Built [  36.900s] (current)
        Parsing datafusion-datasource v53.1.0 (current)
         Parsed [   0.034s] (current)
       Building datafusion-datasource v53.1.0 (baseline)
          Built [  37.476s] (baseline)
        Parsing datafusion-datasource v53.1.0 (baseline)
         Parsed [   0.033s] (baseline)
       Checking datafusion-datasource v53.1.0 -> v53.1.0 (no change; assume patch)
        Checked [   0.331s] 222 checks: 222 pass, 30 skip
        Summary no semver update required
       Finished [  77.453s] datafusion-datasource
       Building datafusion-datasource-parquet v53.1.0 (current)
          Built [  41.938s] (current)
        Parsing datafusion-datasource-parquet v53.1.0 (current)
         Parsed [   0.030s] (current)
       Building datafusion-datasource-parquet v53.1.0 (baseline)
          Built [  42.412s] (baseline)
        Parsing datafusion-datasource-parquet v53.1.0 (baseline)
         Parsed [   0.031s] (baseline)
       Checking datafusion-datasource-parquet v53.1.0 -> v53.1.0 (no change; assume patch)
        Checked [   0.218s] 222 checks: 222 pass, 30 skip
        Summary no semver update required
       Finished [  86.011s] datafusion-datasource-parquet
       Building datafusion-physical-optimizer v53.1.0 (current)
          Built [  36.797s] (current)
        Parsing datafusion-physical-optimizer v53.1.0 (current)
         Parsed [   0.025s] (current)
       Building datafusion-physical-optimizer v53.1.0 (baseline)
          Built [  36.467s] (baseline)
        Parsing datafusion-physical-optimizer v53.1.0 (baseline)
         Parsed [   0.023s] (baseline)
       Checking datafusion-physical-optimizer v53.1.0 -> v53.1.0 (no change; assume patch)
        Checked [   0.156s] 222 checks: 222 pass, 30 skip
        Summary no semver update required
       Finished [  75.596s] datafusion-physical-optimizer
   ```
   
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [PR] Add row-number late materialization for TopK [datafusion]

Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #22617:
URL: https://github.com/apache/datafusion/pull/22617#issuecomment-4572982012

   ๐Ÿค– Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/22617#issuecomment-4572940303)
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c4572940303-360-5lwrn 6.12.68+ #1 SMP Wed Apr  1 02:23:28 UTC 2026 aarch64 GNU/Linux`
   <details><summary>CPU Details (lscpu)</summary>
   
   ```
   Architecture:                            aarch64
   CPU op-mode(s):                          64-bit
   Byte Order:                              Little Endian
   CPU(s):                                  16
   On-line CPU(s) list:                     0-15
   Vendor ID:                               ARM
   Model name:                              Neoverse-V2
   Model:                                   1
   Thread(s) per core:                      1
   Core(s) per cluster:                     16
   Socket(s):                               -
   Cluster(s):                              1
   Stepping:                                r0p1
   BogoMIPS:                                2000.00
   Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
   L1d cache:                               1 MiB (16 instances)
   L1i cache:                               1 MiB (16 instances)
   L2 cache:                                32 MiB (16 instances)
   L3 cache:                                80 MiB (1 instance)
   NUMA node(s):                            1
   NUMA node0 CPU(s):                       0-15
   Vulnerability Gather data sampling:      Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit:             Not affected
   Vulnerability L1tf:                      Not affected
   Vulnerability Mds:                       Not affected
   Vulnerability Meltdown:                  Not affected
   Vulnerability Mmio stale data:           Not affected
   Vulnerability Reg file data sampling:    Not affected
   Vulnerability Retbleed:                  Not affected
   Vulnerability Spec rstack overflow:      Not affected
   Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
   Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
   Vulnerability Spectre v2:                Mitigation; CSV2, BHB
   Vulnerability Srbds:                     Not affected
   Vulnerability Tsa:                       Not affected
   Vulnerability Tsx async abort:           Not affected
   Vulnerability Vmscape:                   Not affected
   ```
   
   </details>
   
   Comparing codex/late-materialization-topk (68e8de629cfbca27527529da5dfed2c5ad8522be) to 0da8961 (merge-base) [diff](https://github.com/apache/datafusion/compare/0da89616e43299546ed8405cfa900d0f97cb2515..68e8de629cfbca27527529da5dfed2c5ad8522be) using: tpcds
   Results will be posted here when complete
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [PR] Add row-number late materialization for TopK [datafusion]

Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #22617:
URL: https://github.com/apache/datafusion/pull/22617#issuecomment-4574520398

   ๐Ÿค– Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/22617#issuecomment-4574493650)
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c4574493650-365-4k8pt 6.12.68+ #1 SMP Wed Apr  1 02:23:28 UTC 2026 aarch64 GNU/Linux`
   <details><summary>CPU Details (lscpu)</summary>
   
   ```
   Architecture:                            aarch64
   CPU op-mode(s):                          64-bit
   Byte Order:                              Little Endian
   CPU(s):                                  16
   On-line CPU(s) list:                     0-15
   Vendor ID:                               ARM
   Model name:                              Neoverse-V2
   Model:                                   1
   Thread(s) per core:                      1
   Core(s) per cluster:                     16
   Socket(s):                               -
   Cluster(s):                              1
   Stepping:                                r0p1
   BogoMIPS:                                2000.00
   Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
   L1d cache:                               1 MiB (16 instances)
   L1i cache:                               1 MiB (16 instances)
   L2 cache:                                32 MiB (16 instances)
   L3 cache:                                80 MiB (1 instance)
   NUMA node(s):                            1
   NUMA node0 CPU(s):                       0-15
   Vulnerability Gather data sampling:      Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit:             Not affected
   Vulnerability L1tf:                      Not affected
   Vulnerability Mds:                       Not affected
   Vulnerability Meltdown:                  Not affected
   Vulnerability Mmio stale data:           Not affected
   Vulnerability Reg file data sampling:    Not affected
   Vulnerability Retbleed:                  Not affected
   Vulnerability Spec rstack overflow:      Not affected
   Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
   Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
   Vulnerability Spectre v2:                Mitigation; CSV2, BHB
   Vulnerability Srbds:                     Not affected
   Vulnerability Tsa:                       Not affected
   Vulnerability Tsx async abort:           Not affected
   Vulnerability Vmscape:                   Not affected
   ```
   
   </details>
   
   Comparing codex/late-materialization-topk (c5da79763b3c6f0ba786e43358bbc49af734370f) to 32a1fe5 (merge-base) [diff](https://github.com/apache/datafusion/compare/32a1fe5498c00e1a5327ff796c9f8335691bdb32..c5da79763b3c6f0ba786e43358bbc49af734370f) using: clickbench_partitioned
   Results will be posted here when complete
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [PR] Add row-number late materialization for TopK [datafusion]

Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #22617:
URL: https://github.com/apache/datafusion/pull/22617#issuecomment-4574529410

   ๐Ÿค– Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/22617#issuecomment-4574493650)
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c4574493650-367-mvvkt 6.12.68+ #1 SMP Wed Apr  1 02:23:28 UTC 2026 aarch64 GNU/Linux`
   <details><summary>CPU Details (lscpu)</summary>
   
   ```
   Architecture:                            aarch64
   CPU op-mode(s):                          64-bit
   Byte Order:                              Little Endian
   CPU(s):                                  16
   On-line CPU(s) list:                     0-15
   Vendor ID:                               ARM
   Model name:                              Neoverse-V2
   Model:                                   1
   Thread(s) per core:                      1
   Core(s) per cluster:                     16
   Socket(s):                               -
   Cluster(s):                              1
   Stepping:                                r0p1
   BogoMIPS:                                2000.00
   Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
   L1d cache:                               1 MiB (16 instances)
   L1i cache:                               1 MiB (16 instances)
   L2 cache:                                32 MiB (16 instances)
   L3 cache:                                80 MiB (1 instance)
   NUMA node(s):                            1
   NUMA node0 CPU(s):                       0-15
   Vulnerability Gather data sampling:      Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit:             Not affected
   Vulnerability L1tf:                      Not affected
   Vulnerability Mds:                       Not affected
   Vulnerability Meltdown:                  Not affected
   Vulnerability Mmio stale data:           Not affected
   Vulnerability Reg file data sampling:    Not affected
   Vulnerability Retbleed:                  Not affected
   Vulnerability Spec rstack overflow:      Not affected
   Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
   Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
   Vulnerability Spectre v2:                Mitigation; CSV2, BHB
   Vulnerability Srbds:                     Not affected
   Vulnerability Tsa:                       Not affected
   Vulnerability Tsx async abort:           Not affected
   Vulnerability Vmscape:                   Not affected
   ```
   
   </details>
   
   Comparing codex/late-materialization-topk (c5da79763b3c6f0ba786e43358bbc49af734370f) to 32a1fe5 (merge-base) [diff](https://github.com/apache/datafusion/compare/32a1fe5498c00e1a5327ff796c9f8335691bdb32..c5da79763b3c6f0ba786e43358bbc49af734370f) using: tpch
   Results will be posted here when complete
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [PR] Add row-number late materialization for TopK [datafusion]

Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #22617:
URL: https://github.com/apache/datafusion/pull/22617#issuecomment-4573200592

   ๐Ÿค– Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/22617#issuecomment-4572940303)
   
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
   
   <details><summary>CPU Details (lscpu)</summary>
   
   ```
   Architecture:                            aarch64
   CPU op-mode(s):                          64-bit
   Byte Order:                              Little Endian
   CPU(s):                                  16
   On-line CPU(s) list:                     0-15
   Vendor ID:                               ARM
   Model name:                              Neoverse-V2
   Model:                                   1
   Thread(s) per core:                      1
   Core(s) per cluster:                     16
   Socket(s):                               -
   Cluster(s):                              1
   Stepping:                                r0p1
   BogoMIPS:                                2000.00
   Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
   L1d cache:                               1 MiB (16 instances)
   L1i cache:                               1 MiB (16 instances)
   L2 cache:                                32 MiB (16 instances)
   L3 cache:                                80 MiB (1 instance)
   NUMA node(s):                            1
   NUMA node0 CPU(s):                       0-15
   Vulnerability Gather data sampling:      Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit:             Not affected
   Vulnerability L1tf:                      Not affected
   Vulnerability Mds:                       Not affected
   Vulnerability Meltdown:                  Not affected
   Vulnerability Mmio stale data:           Not affected
   Vulnerability Reg file data sampling:    Not affected
   Vulnerability Retbleed:                  Not affected
   Vulnerability Spec rstack overflow:      Not affected
   Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
   Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
   Vulnerability Spectre v2:                Mitigation; CSV2, BHB
   Vulnerability Srbds:                     Not affected
   Vulnerability Tsa:                       Not affected
   Vulnerability Tsx async abort:           Not affected
   Vulnerability Vmscape:                   Not affected
   ```
   
   </details>
   
   <details><summary>Details</summary>
   <p>
   
   ```
   Comparing HEAD and codex_late-materialization-topk
   --------------------
   Benchmark tpcds_sf1.json
   --------------------
   โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”“
   โ”ƒ Query     โ”ƒ                                  HEAD โ”ƒ       codex_late-materialization-topk โ”ƒ        Change โ”ƒ
   โ”กโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ฉ
   โ”‚ QQuery 1  โ”‚           5.75 / 6.28 ยฑ0.92 / 8.11 ms โ”‚           5.74 / 6.24 ยฑ0.92 / 8.07 ms โ”‚     no change โ”‚
   โ”‚ QQuery 2  โ”‚        79.43 / 80.16 ยฑ0.57 / 81.05 ms โ”‚        79.94 / 80.20 ยฑ0.17 / 80.43 ms โ”‚     no change โ”‚
   โ”‚ QQuery 3  โ”‚        28.64 / 28.92 ยฑ0.32 / 29.41 ms โ”‚        28.51 / 28.73 ยฑ0.21 / 29.08 ms โ”‚     no change โ”‚
   โ”‚ QQuery 4  โ”‚     498.73 / 506.02 ยฑ6.17 / 513.82 ms โ”‚     502.03 / 506.01 ยฑ4.77 / 514.73 ms โ”‚     no change โ”‚
   โ”‚ QQuery 5  โ”‚        50.34 / 50.55 ยฑ0.16 / 50.82 ms โ”‚        50.67 / 51.37 ยฑ0.58 / 52.10 ms โ”‚     no change โ”‚
   โ”‚ QQuery 6  โ”‚        35.19 / 35.61 ยฑ0.32 / 36.11 ms โ”‚        34.44 / 35.49 ยฑ0.56 / 36.00 ms โ”‚     no change โ”‚
   โ”‚ QQuery 7  โ”‚     107.90 / 110.10 ยฑ2.89 / 115.72 ms โ”‚     107.77 / 109.29 ยฑ2.58 / 114.45 ms โ”‚     no change โ”‚
   โ”‚ QQuery 8  โ”‚        35.96 / 36.49 ยฑ0.45 / 37.15 ms โ”‚        35.88 / 36.41 ยฑ0.45 / 37.15 ms โ”‚     no change โ”‚
   โ”‚ QQuery 9  โ”‚        53.32 / 54.24 ยฑ0.92 / 55.85 ms โ”‚        53.14 / 54.57 ยฑ0.96 / 56.13 ms โ”‚     no change โ”‚
   โ”‚ QQuery 10 โ”‚        79.81 / 80.18 ยฑ0.21 / 80.36 ms โ”‚        79.71 / 80.11 ยฑ0.24 / 80.37 ms โ”‚     no change โ”‚
   โ”‚ QQuery 11 โ”‚     303.65 / 307.69 ยฑ2.74 / 310.81 ms โ”‚     308.59 / 311.46 ยฑ2.23 / 315.10 ms โ”‚     no change โ”‚
   โ”‚ QQuery 12 โ”‚        28.17 / 28.58 ยฑ0.67 / 29.92 ms โ”‚        27.90 / 28.35 ยฑ0.32 / 28.78 ms โ”‚     no change โ”‚
   โ”‚ QQuery 13 โ”‚     125.95 / 126.98 ยฑ0.80 / 128.38 ms โ”‚     125.68 / 126.53 ยฑ0.96 / 128.31 ms โ”‚     no change โ”‚
   โ”‚ QQuery 14 โ”‚     504.47 / 506.32 ยฑ1.41 / 508.21 ms โ”‚     498.75 / 502.32 ยฑ2.23 / 505.27 ms โ”‚     no change โ”‚
   โ”‚ QQuery 15 โ”‚        60.24 / 61.99 ยฑ1.47 / 63.95 ms โ”‚        59.31 / 60.16 ยฑ0.60 / 60.98 ms โ”‚     no change โ”‚
   โ”‚ QQuery 16 โ”‚           6.42 / 6.54 ยฑ0.19 / 6.92 ms โ”‚           6.43 / 6.62 ยฑ0.15 / 6.83 ms โ”‚     no change โ”‚
   โ”‚ QQuery 17 โ”‚        80.44 / 81.55 ยฑ0.66 / 82.51 ms โ”‚        80.84 / 81.34 ยฑ0.44 / 82.16 ms โ”‚     no change โ”‚
   โ”‚ QQuery 18 โ”‚     149.97 / 151.87 ยฑ2.33 / 156.38 ms โ”‚     151.14 / 151.82 ยฑ0.53 / 152.54 ms โ”‚     no change โ”‚
   โ”‚ QQuery 19 โ”‚        40.88 / 41.29 ยฑ0.28 / 41.73 ms โ”‚        40.59 / 40.99 ยฑ0.25 / 41.21 ms โ”‚     no change โ”‚
   โ”‚ QQuery 20 โ”‚        34.98 / 35.55 ยฑ0.35 / 36.06 ms โ”‚        34.58 / 34.98 ยฑ0.42 / 35.78 ms โ”‚     no change โ”‚
   โ”‚ QQuery 21 โ”‚        16.89 / 17.76 ยฑ1.21 / 20.14 ms โ”‚        16.39 / 16.79 ยฑ0.34 / 17.41 ms โ”‚ +1.06x faster โ”‚
   โ”‚ QQuery 22 โ”‚        61.45 / 62.39 ยฑ0.64 / 63.20 ms โ”‚        61.85 / 62.03 ยฑ0.15 / 62.27 ms โ”‚     no change โ”‚
   โ”‚ QQuery 23 โ”‚     476.70 / 484.35 ยฑ4.25 / 489.66 ms โ”‚     475.13 / 482.38 ยฑ5.76 / 491.00 ms โ”‚     no change โ”‚
   โ”‚ QQuery 24 โ”‚     233.43 / 236.68 ยฑ3.62 / 243.75 ms โ”‚     232.97 / 235.31 ยฑ3.07 / 241.26 ms โ”‚     no change โ”‚
   โ”‚ QQuery 25 โ”‚     113.04 / 114.38 ยฑ1.11 / 116.37 ms โ”‚     112.62 / 113.95 ยฑ0.90 / 115.40 ms โ”‚     no change โ”‚
   โ”‚ QQuery 26 โ”‚        69.91 / 70.53 ยฑ0.43 / 71.13 ms โ”‚        69.50 / 70.25 ยฑ0.40 / 70.57 ms โ”‚     no change โ”‚
   โ”‚ QQuery 27 โ”‚           6.66 / 6.79 ยฑ0.12 / 7.02 ms โ”‚           6.52 / 6.63 ยฑ0.11 / 6.83 ms โ”‚     no change โ”‚
   โ”‚ QQuery 28 โ”‚        61.21 / 61.97 ยฑ0.46 / 62.51 ms โ”‚        61.32 / 61.82 ยฑ0.47 / 62.59 ms โ”‚     no change โ”‚
   โ”‚ QQuery 29 โ”‚      98.54 / 100.63 ยฑ1.98 / 104.17 ms โ”‚      97.75 / 100.84 ยฑ2.59 / 105.03 ms โ”‚     no change โ”‚
   โ”‚ QQuery 30 โ”‚        30.18 / 30.60 ยฑ0.29 / 30.94 ms โ”‚        30.00 / 30.63 ยฑ0.63 / 31.67 ms โ”‚     no change โ”‚
   โ”‚ QQuery 31 โ”‚     111.18 / 113.20 ยฑ3.23 / 119.62 ms โ”‚     110.67 / 112.11 ยฑ1.83 / 115.73 ms โ”‚     no change โ”‚
   โ”‚ QQuery 32 โ”‚        19.82 / 20.07 ยฑ0.22 / 20.44 ms โ”‚        19.51 / 20.17 ยฑ0.47 / 20.92 ms โ”‚     no change โ”‚
   โ”‚ QQuery 33 โ”‚        38.11 / 38.48 ยฑ0.21 / 38.68 ms โ”‚        37.77 / 38.05 ยฑ0.16 / 38.29 ms โ”‚     no change โ”‚
   โ”‚ QQuery 34 โ”‚          9.16 / 9.56 ยฑ0.34 / 10.06 ms โ”‚           9.11 / 9.38 ยฑ0.28 / 9.81 ms โ”‚     no change โ”‚
   โ”‚ QQuery 35 โ”‚        79.84 / 80.29 ยฑ0.35 / 80.85 ms โ”‚        80.19 / 80.41 ยฑ0.21 / 80.80 ms โ”‚     no change โ”‚
   โ”‚ QQuery 36 โ”‚           5.91 / 6.05 ยฑ0.15 / 6.34 ms โ”‚           5.81 / 5.92 ยฑ0.15 / 6.21 ms โ”‚     no change โ”‚
   โ”‚ QQuery 37 โ”‚           6.75 / 6.86 ยฑ0.07 / 6.94 ms โ”‚           6.65 / 6.69 ยฑ0.05 / 6.79 ms โ”‚     no change โ”‚
   โ”‚ QQuery 38 โ”‚        68.26 / 68.70 ยฑ0.39 / 69.35 ms โ”‚        67.85 / 69.82 ยฑ1.98 / 72.93 ms โ”‚     no change โ”‚
   โ”‚ QQuery 39 โ”‚        97.17 / 97.99 ยฑ0.50 / 98.52 ms โ”‚        96.16 / 97.06 ยฑ0.76 / 97.86 ms โ”‚     no change โ”‚
   โ”‚ QQuery 40 โ”‚        22.67 / 23.04 ยฑ0.26 / 23.47 ms โ”‚        22.20 / 22.72 ยฑ0.34 / 23.12 ms โ”‚     no change โ”‚
   โ”‚ QQuery 41 โ”‚        11.48 / 11.54 ยฑ0.08 / 11.69 ms โ”‚        11.29 / 11.44 ยฑ0.16 / 11.74 ms โ”‚     no change โ”‚
   โ”‚ QQuery 42 โ”‚        23.65 / 24.89 ยฑ1.62 / 27.99 ms โ”‚        23.70 / 24.43 ยฑ1.12 / 26.66 ms โ”‚     no change โ”‚
   โ”‚ QQuery 43 โ”‚           4.71 / 4.77 ยฑ0.06 / 4.86 ms โ”‚           4.86 / 5.43 ยฑ1.03 / 7.48 ms โ”‚  1.14x slower โ”‚
   โ”‚ QQuery 44 โ”‚        10.59 / 10.82 ยฑ0.19 / 11.12 ms โ”‚        10.52 / 10.71 ยฑ0.13 / 10.88 ms โ”‚     no change โ”‚
   โ”‚ QQuery 45 โ”‚        39.89 / 40.59 ยฑ0.63 / 41.43 ms โ”‚        39.24 / 40.44 ยฑ1.06 / 41.97 ms โ”‚     no change โ”‚
   โ”‚ QQuery 46 โ”‚        12.47 / 12.80 ยฑ0.32 / 13.40 ms โ”‚        12.56 / 12.97 ยฑ0.30 / 13.38 ms โ”‚     no change โ”‚
   โ”‚ QQuery 47 โ”‚     225.41 / 229.42 ยฑ3.29 / 233.51 ms โ”‚     226.11 / 227.92 ยฑ1.58 / 229.86 ms โ”‚     no change โ”‚
   โ”‚ QQuery 48 โ”‚     102.24 / 102.98 ยฑ0.57 / 103.84 ms โ”‚     102.91 / 103.51 ยฑ0.70 / 104.71 ms โ”‚     no change โ”‚
   โ”‚ QQuery 49 โ”‚        78.68 / 80.85 ยฑ2.16 / 84.75 ms โ”‚        78.61 / 79.18 ยฑ0.31 / 79.43 ms โ”‚     no change โ”‚
   โ”‚ QQuery 50 โ”‚        59.79 / 60.05 ยฑ0.23 / 60.43 ms โ”‚        59.62 / 59.89 ยฑ0.24 / 60.28 ms โ”‚     no change โ”‚
   โ”‚ QQuery 51 โ”‚        92.58 / 93.19 ยฑ0.50 / 93.82 ms โ”‚       92.12 / 96.04 ยฑ3.36 / 100.25 ms โ”‚     no change โ”‚
   โ”‚ QQuery 52 โ”‚        23.65 / 24.26 ยฑ0.56 / 25.19 ms โ”‚        23.79 / 24.42 ยฑ0.50 / 25.29 ms โ”‚     no change โ”‚
   โ”‚ QQuery 53 โ”‚        29.49 / 29.65 ยฑ0.18 / 29.95 ms โ”‚        29.05 / 29.37 ยฑ0.17 / 29.53 ms โ”‚     no change โ”‚
   โ”‚ QQuery 54 โ”‚        54.25 / 54.67 ยฑ0.29 / 55.07 ms โ”‚        53.97 / 54.30 ยฑ0.17 / 54.43 ms โ”‚     no change โ”‚
   โ”‚ QQuery 55 โ”‚        23.39 / 23.60 ยฑ0.18 / 23.84 ms โ”‚        23.08 / 23.67 ยฑ0.35 / 24.11 ms โ”‚     no change โ”‚
   โ”‚ QQuery 56 โ”‚        38.06 / 39.76 ยฑ1.59 / 41.79 ms โ”‚        38.64 / 39.39 ยฑ0.84 / 40.90 ms โ”‚     no change โ”‚
   โ”‚ QQuery 57 โ”‚     174.23 / 176.20 ยฑ1.34 / 178.42 ms โ”‚     174.78 / 176.88 ยฑ1.40 / 178.55 ms โ”‚     no change โ”‚
   โ”‚ QQuery 58 โ”‚     115.58 / 117.35 ยฑ1.10 / 119.01 ms โ”‚     115.17 / 117.04 ยฑ1.42 / 119.52 ms โ”‚     no change โ”‚
   โ”‚ QQuery 59 โ”‚     116.91 / 118.06 ยฑ0.69 / 118.99 ms โ”‚     115.69 / 116.80 ยฑ1.42 / 119.53 ms โ”‚     no change โ”‚
   โ”‚ QQuery 60 โ”‚        38.87 / 39.16 ยฑ0.22 / 39.42 ms โ”‚        38.87 / 39.49 ยฑ0.49 / 40.36 ms โ”‚     no change โ”‚
   โ”‚ QQuery 61 โ”‚        12.55 / 12.71 ยฑ0.21 / 13.13 ms โ”‚        12.64 / 12.83 ยฑ0.22 / 13.25 ms โ”‚     no change โ”‚
   โ”‚ QQuery 62 โ”‚        45.95 / 46.07 ยฑ0.08 / 46.18 ms โ”‚        45.67 / 46.06 ยฑ0.39 / 46.70 ms โ”‚     no change โ”‚
   โ”‚ QQuery 63 โ”‚        29.44 / 29.76 ยฑ0.27 / 30.14 ms โ”‚        29.19 / 29.40 ยฑ0.17 / 29.69 ms โ”‚     no change โ”‚
   โ”‚ QQuery 64 โ”‚     456.20 / 463.44 ยฑ5.11 / 471.93 ms โ”‚     458.67 / 464.83 ยฑ7.32 / 478.88 ms โ”‚     no change โ”‚
   โ”‚ QQuery 65 โ”‚     146.31 / 151.46 ยฑ4.35 / 157.80 ms โ”‚     146.57 / 151.31 ยฑ4.39 / 158.75 ms โ”‚     no change โ”‚
   โ”‚ QQuery 66 โ”‚        77.63 / 79.53 ยฑ2.02 / 83.07 ms โ”‚        76.76 / 78.98 ยฑ1.68 / 81.86 ms โ”‚     no change โ”‚
   โ”‚ QQuery 67 โ”‚     240.86 / 246.22 ยฑ4.59 / 252.46 ms โ”‚     243.46 / 245.14 ยฑ0.92 / 246.09 ms โ”‚     no change โ”‚
   โ”‚ QQuery 68 โ”‚        12.96 / 13.08 ยฑ0.21 / 13.50 ms โ”‚        12.88 / 13.03 ยฑ0.20 / 13.44 ms โ”‚     no change โ”‚
   โ”‚ QQuery 69 โ”‚        75.61 / 76.08 ยฑ0.35 / 76.65 ms โ”‚        75.86 / 76.36 ยฑ0.29 / 76.76 ms โ”‚     no change โ”‚
   โ”‚ QQuery 70 โ”‚     106.68 / 109.43 ยฑ2.91 / 113.37 ms โ”‚     105.59 / 112.85 ยฑ7.17 / 123.41 ms โ”‚     no change โ”‚
   โ”‚ QQuery 71 โ”‚        35.69 / 35.96 ยฑ0.16 / 36.17 ms โ”‚        35.55 / 35.87 ยฑ0.22 / 36.20 ms โ”‚     no change โ”‚
   โ”‚ QQuery 72 โ”‚ 2113.10 / 2185.55 ยฑ44.19 / 2238.19 ms โ”‚ 2149.20 / 2201.73 ยฑ41.74 / 2253.00 ms โ”‚     no change โ”‚
   โ”‚ QQuery 73 โ”‚           8.99 / 9.22 ยฑ0.26 / 9.72 ms โ”‚           9.05 / 9.23 ยฑ0.24 / 9.71 ms โ”‚     no change โ”‚
   โ”‚ QQuery 74 โ”‚     175.33 / 178.61 ยฑ3.27 / 184.67 ms โ”‚     175.12 / 176.10 ยฑ0.69 / 177.03 ms โ”‚     no change โ”‚
   โ”‚ QQuery 75 โ”‚     145.75 / 147.68 ยฑ1.52 / 150.26 ms โ”‚     146.10 / 147.01 ยฑ0.74 / 148.14 ms โ”‚     no change โ”‚
   โ”‚ QQuery 76 โ”‚        34.86 / 35.55 ยฑ0.44 / 36.12 ms โ”‚        35.26 / 35.57 ยฑ0.28 / 36.06 ms โ”‚     no change โ”‚
   โ”‚ QQuery 77 โ”‚        59.83 / 60.07 ยฑ0.16 / 60.33 ms โ”‚        59.86 / 60.19 ยฑ0.29 / 60.65 ms โ”‚     no change โ”‚
   โ”‚ QQuery 78 โ”‚     188.68 / 190.23 ยฑ1.54 / 192.42 ms โ”‚     185.73 / 187.47 ยฑ1.51 / 190.21 ms โ”‚     no change โ”‚
   โ”‚ QQuery 79 โ”‚        66.90 / 67.25 ยฑ0.35 / 67.75 ms โ”‚        66.86 / 67.30 ยฑ0.36 / 67.84 ms โ”‚     no change โ”‚
   โ”‚ QQuery 80 โ”‚     100.43 / 101.35 ยฑ1.12 / 103.54 ms โ”‚      98.22 / 102.59 ยฑ3.78 / 108.55 ms โ”‚     no change โ”‚
   โ”‚ QQuery 81 โ”‚        23.67 / 23.92 ยฑ0.17 / 24.13 ms โ”‚        23.89 / 24.13 ยฑ0.17 / 24.41 ms โ”‚     no change โ”‚
   โ”‚ QQuery 82 โ”‚        16.24 / 16.46 ยฑ0.13 / 16.66 ms โ”‚        16.34 / 16.55 ยฑ0.18 / 16.83 ms โ”‚     no change โ”‚
   โ”‚ QQuery 83 โ”‚        36.19 / 36.42 ยฑ0.12 / 36.57 ms โ”‚        35.86 / 36.19 ยฑ0.27 / 36.61 ms โ”‚     no change โ”‚
   โ”‚ QQuery 84 โ”‚        42.97 / 43.58 ยฑ0.88 / 45.31 ms โ”‚        43.18 / 44.90 ยฑ2.43 / 49.71 ms โ”‚     no change โ”‚
   โ”‚ QQuery 85 โ”‚     134.74 / 137.58 ยฑ2.17 / 140.68 ms โ”‚     134.98 / 136.18 ยฑ0.86 / 137.39 ms โ”‚     no change โ”‚
   โ”‚ QQuery 86 โ”‚        24.46 / 24.99 ยฑ0.52 / 25.89 ms โ”‚        24.43 / 24.80 ยฑ0.27 / 25.20 ms โ”‚     no change โ”‚
   โ”‚ QQuery 87 โ”‚        68.92 / 70.05 ยฑ1.19 / 72.10 ms โ”‚        68.63 / 69.93 ยฑ1.73 / 73.28 ms โ”‚     no change โ”‚
   โ”‚ QQuery 88 โ”‚        61.95 / 62.18 ยฑ0.24 / 62.61 ms โ”‚        61.70 / 62.27 ยฑ0.61 / 63.15 ms โ”‚     no change โ”‚
   โ”‚ QQuery 89 โ”‚        35.78 / 36.15 ยฑ0.32 / 36.53 ms โ”‚        35.27 / 35.42 ยฑ0.09 / 35.53 ms โ”‚     no change โ”‚
   โ”‚ QQuery 90 โ”‚        16.95 / 17.12 ยฑ0.16 / 17.39 ms โ”‚        16.57 / 16.74 ยฑ0.15 / 16.94 ms โ”‚     no change โ”‚
   โ”‚ QQuery 91 โ”‚        51.28 / 52.06 ยฑ0.54 / 52.87 ms โ”‚        51.05 / 51.91 ยฑ1.18 / 54.25 ms โ”‚     no change โ”‚
   โ”‚ QQuery 92 โ”‚        29.24 / 30.43 ยฑ1.52 / 33.37 ms โ”‚        29.05 / 29.42 ยฑ0.27 / 29.73 ms โ”‚     no change โ”‚
   โ”‚ QQuery 93 โ”‚        50.19 / 51.17 ยฑ0.58 / 51.98 ms โ”‚        50.29 / 50.78 ยฑ0.30 / 51.16 ms โ”‚     no change โ”‚
   โ”‚ QQuery 94 โ”‚        37.59 / 37.87 ยฑ0.20 / 38.12 ms โ”‚        37.32 / 37.69 ยฑ0.45 / 38.55 ms โ”‚     no change โ”‚
   โ”‚ QQuery 95 โ”‚        84.27 / 85.12 ยฑ0.71 / 86.02 ms โ”‚        83.90 / 85.09 ยฑ1.39 / 87.68 ms โ”‚     no change โ”‚
   โ”‚ QQuery 96 โ”‚        23.91 / 24.16 ยฑ0.23 / 24.59 ms โ”‚        24.09 / 24.36 ยฑ0.23 / 24.67 ms โ”‚     no change โ”‚
   โ”‚ QQuery 97 โ”‚        45.58 / 45.91 ยฑ0.20 / 46.18 ms โ”‚        45.85 / 46.07 ยฑ0.11 / 46.20 ms โ”‚     no change โ”‚
   โ”‚ QQuery 98 โ”‚        42.11 / 42.84 ยฑ0.42 / 43.28 ms โ”‚        42.57 / 42.74 ยฑ0.13 / 42.91 ms โ”‚     no change โ”‚
   โ”‚ QQuery 99 โ”‚        68.84 / 69.42 ยฑ0.50 / 70.13 ms โ”‚        68.56 / 69.16 ยฑ0.32 / 69.42 ms โ”‚     no change โ”‚
   โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
   โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”“
   โ”ƒ Benchmark Summary                              โ”ƒ            โ”ƒ
   โ”กโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ฉ
   โ”‚ Total Time (HEAD)                              โ”‚ 10428.52ms โ”‚
   โ”‚ Total Time (codex_late-materialization-topk)   โ”‚ 10427.47ms โ”‚
   โ”‚ Average Time (HEAD)                            โ”‚   105.34ms โ”‚
   โ”‚ Average Time (codex_late-materialization-topk) โ”‚   105.33ms โ”‚
   โ”‚ Queries Faster                                 โ”‚          1 โ”‚
   โ”‚ Queries Slower                                 โ”‚          1 โ”‚
   โ”‚ Queries with No Change                         โ”‚         97 โ”‚
   โ”‚ Queries with Failure                           โ”‚          0 โ”‚
   โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
   ```
   
   </p>
   </details>
   
   <details><summary>Resource Usage</summary>
   
   **tpcds โ€” base (merge-base)**
   | Metric | Value |
   |--------|-------|
   | Wall time | 55.0s |
   | Peak memory | 7.0 GiB |
   | Avg memory | 6.2 GiB |
   | CPU user | 235.7s |
   | CPU sys | 5.6s |
   | Peak spill | 0 B |
   
   **tpcds โ€” branch**
   | Metric | Value |
   |--------|-------|
   | Wall time | 55.0s |
   | Peak memory | 6.9 GiB |
   | Avg memory | 6.1 GiB |
   | CPU user | 234.9s |
   | CPU sys | 5.6s |
   | Peak spill | 0 B |
   
   </details>
   
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [PR] Add row-number late materialization for TopK [datafusion]

Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #22617:
URL: https://github.com/apache/datafusion/pull/22617#issuecomment-4573184886

   ๐Ÿค– Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/22617#issuecomment-4572940303)
   
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
   
   <details><summary>CPU Details (lscpu)</summary>
   
   ```
   Architecture:                            aarch64
   CPU op-mode(s):                          64-bit
   Byte Order:                              Little Endian
   CPU(s):                                  16
   On-line CPU(s) list:                     0-15
   Vendor ID:                               ARM
   Model name:                              Neoverse-V2
   Model:                                   1
   Thread(s) per core:                      1
   Core(s) per cluster:                     16
   Socket(s):                               -
   Cluster(s):                              1
   Stepping:                                r0p1
   BogoMIPS:                                2000.00
   Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
   L1d cache:                               1 MiB (16 instances)
   L1i cache:                               1 MiB (16 instances)
   L2 cache:                                32 MiB (16 instances)
   L3 cache:                                80 MiB (1 instance)
   NUMA node(s):                            1
   NUMA node0 CPU(s):                       0-15
   Vulnerability Gather data sampling:      Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit:             Not affected
   Vulnerability L1tf:                      Not affected
   Vulnerability Mds:                       Not affected
   Vulnerability Meltdown:                  Not affected
   Vulnerability Mmio stale data:           Not affected
   Vulnerability Reg file data sampling:    Not affected
   Vulnerability Retbleed:                  Not affected
   Vulnerability Spec rstack overflow:      Not affected
   Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
   Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
   Vulnerability Spectre v2:                Mitigation; CSV2, BHB
   Vulnerability Srbds:                     Not affected
   Vulnerability Tsa:                       Not affected
   Vulnerability Tsx async abort:           Not affected
   Vulnerability Vmscape:                   Not affected
   ```
   
   </details>
   
   <details><summary>Details</summary>
   <p>
   
   ```
   Comparing HEAD and codex_late-materialization-topk
   --------------------
   Benchmark tpch_sf1.json
   --------------------
   โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”“
   โ”ƒ Query     โ”ƒ                           HEAD โ”ƒ codex_late-materialization-topk โ”ƒ    Change โ”ƒ
   โ”กโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ฉ
   โ”‚ QQuery 1  โ”‚ 38.11 / 39.02 ยฑ1.00 / 40.89 ms โ”‚  38.28 / 39.41 ยฑ0.98 / 40.86 ms โ”‚ no change โ”‚
   โ”‚ QQuery 2  โ”‚ 19.66 / 19.90 ยฑ0.22 / 20.31 ms โ”‚  19.83 / 19.95 ยฑ0.13 / 20.19 ms โ”‚ no change โ”‚
   โ”‚ QQuery 3  โ”‚ 33.18 / 34.70 ยฑ1.28 / 36.62 ms โ”‚  33.20 / 34.84 ยฑ1.16 / 36.17 ms โ”‚ no change โ”‚
   โ”‚ QQuery 4  โ”‚ 17.33 / 17.59 ยฑ0.20 / 17.87 ms โ”‚  17.23 / 17.54 ยฑ0.33 / 18.13 ms โ”‚ no change โ”‚
   โ”‚ QQuery 5  โ”‚ 41.58 / 42.20 ยฑ0.36 / 42.56 ms โ”‚  41.86 / 42.60 ยฑ0.47 / 43.22 ms โ”‚ no change โ”‚
   โ”‚ QQuery 6  โ”‚ 16.15 / 16.54 ยฑ0.31 / 17.09 ms โ”‚  16.23 / 16.37 ยฑ0.10 / 16.49 ms โ”‚ no change โ”‚
   โ”‚ QQuery 7  โ”‚ 45.40 / 48.39 ยฑ2.13 / 50.78 ms โ”‚  45.39 / 48.18 ยฑ2.33 / 52.23 ms โ”‚ no change โ”‚
   โ”‚ QQuery 8  โ”‚ 44.69 / 45.07 ยฑ0.40 / 45.81 ms โ”‚  45.20 / 45.96 ยฑ0.93 / 47.66 ms โ”‚ no change โ”‚
   โ”‚ QQuery 9  โ”‚ 49.19 / 49.73 ยฑ0.55 / 50.47 ms โ”‚  49.10 / 50.30 ยฑ0.94 / 51.42 ms โ”‚ no change โ”‚
   โ”‚ QQuery 10 โ”‚ 62.76 / 63.10 ยฑ0.26 / 63.46 ms โ”‚  63.53 / 63.97 ยฑ0.61 / 65.12 ms โ”‚ no change โ”‚
   โ”‚ QQuery 11 โ”‚ 13.22 / 13.37 ยฑ0.16 / 13.67 ms โ”‚  13.40 / 13.88 ยฑ0.75 / 15.36 ms โ”‚ no change โ”‚
   โ”‚ QQuery 12 โ”‚ 24.21 / 24.85 ยฑ0.66 / 26.12 ms โ”‚  23.88 / 24.72 ยฑ0.84 / 26.05 ms โ”‚ no change โ”‚
   โ”‚ QQuery 13 โ”‚ 33.69 / 35.46 ยฑ1.43 / 37.58 ms โ”‚  33.40 / 34.08 ยฑ0.64 / 34.99 ms โ”‚ no change โ”‚
   โ”‚ QQuery 14 โ”‚ 25.22 / 25.36 ยฑ0.07 / 25.42 ms โ”‚  25.50 / 25.61 ยฑ0.09 / 25.72 ms โ”‚ no change โ”‚
   โ”‚ QQuery 15 โ”‚ 31.45 / 31.72 ยฑ0.29 / 32.17 ms โ”‚  31.67 / 32.25 ยฑ0.69 / 33.58 ms โ”‚ no change โ”‚
   โ”‚ QQuery 16 โ”‚ 14.43 / 14.67 ยฑ0.13 / 14.77 ms โ”‚  14.46 / 15.06 ยฑ0.66 / 16.31 ms โ”‚ no change โ”‚
   โ”‚ QQuery 17 โ”‚ 73.57 / 74.65 ยฑ0.69 / 75.59 ms โ”‚  73.86 / 74.34 ยฑ0.38 / 75.01 ms โ”‚ no change โ”‚
   โ”‚ QQuery 18 โ”‚ 62.37 / 63.99 ยฑ1.70 / 67.06 ms โ”‚  61.33 / 64.59 ยฑ3.52 / 71.44 ms โ”‚ no change โ”‚
   โ”‚ QQuery 19 โ”‚ 33.94 / 34.29 ยฑ0.44 / 35.09 ms โ”‚  34.02 / 34.65 ยฑ0.45 / 35.23 ms โ”‚ no change โ”‚
   โ”‚ QQuery 20 โ”‚ 37.18 / 37.34 ยฑ0.15 / 37.62 ms โ”‚  37.60 / 37.74 ยฑ0.17 / 38.04 ms โ”‚ no change โ”‚
   โ”‚ QQuery 21 โ”‚ 56.52 / 56.89 ยฑ0.30 / 57.27 ms โ”‚  56.38 / 58.45 ยฑ1.18 / 59.71 ms โ”‚ no change โ”‚
   โ”‚ QQuery 22 โ”‚ 22.96 / 24.17 ยฑ1.36 / 26.81 ms โ”‚  23.31 / 24.62 ยฑ1.62 / 27.81 ms โ”‚ no change โ”‚
   โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
   โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”“
   โ”ƒ Benchmark Summary                              โ”ƒ          โ”ƒ
   โ”กโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ฉ
   โ”‚ Total Time (HEAD)                              โ”‚ 813.00ms โ”‚
   โ”‚ Total Time (codex_late-materialization-topk)   โ”‚ 819.11ms โ”‚
   โ”‚ Average Time (HEAD)                            โ”‚  36.95ms โ”‚
   โ”‚ Average Time (codex_late-materialization-topk) โ”‚  37.23ms โ”‚
   โ”‚ Queries Faster                                 โ”‚        0 โ”‚
   โ”‚ Queries Slower                                 โ”‚        0 โ”‚
   โ”‚ Queries with No Change                         โ”‚       22 โ”‚
   โ”‚ Queries with Failure                           โ”‚        0 โ”‚
   โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
   ```
   
   </p>
   </details>
   
   <details><summary>Resource Usage</summary>
   
   **tpch โ€” base (merge-base)**
   | Metric | Value |
   |--------|-------|
   | Wall time | 5.0s |
   | Peak memory | 5.6 GiB |
   | Avg memory | 5.1 GiB |
   | CPU user | 29.5s |
   | CPU sys | 2.3s |
   | Peak spill | 0 B |
   
   **tpch โ€” branch**
   | Metric | Value |
   |--------|-------|
   | Wall time | 5.0s |
   | Peak memory | 5.5 GiB |
   | Avg memory | 5.0 GiB |
   | CPU user | 29.5s |
   | CPU sys | 2.4s |
   | Peak spill | 0 B |
   
   </details>
   
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [PR] Add row-number late materialization for TopK [datafusion]

Posted by "Dandandan (via GitHub)" <gi...@apache.org>.
Dandandan closed pull request #22617: Add row-number late materialization for TopK
URL: https://github.com/apache/datafusion/pull/22617


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [PR] Add row-number late materialization for TopK [datafusion]

Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #22617:
URL: https://github.com/apache/datafusion/pull/22617#issuecomment-4573048594

   ๐Ÿค– Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/22617#issuecomment-4572940303)
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c4572940303-361-9b7d8 6.12.68+ #1 SMP Wed Apr  1 02:23:28 UTC 2026 aarch64 GNU/Linux`
   <details><summary>CPU Details (lscpu)</summary>
   
   ```
   Architecture:                            aarch64
   CPU op-mode(s):                          64-bit
   Byte Order:                              Little Endian
   CPU(s):                                  16
   On-line CPU(s) list:                     0-15
   Vendor ID:                               ARM
   Model name:                              Neoverse-V2
   Model:                                   1
   Thread(s) per core:                      1
   Core(s) per cluster:                     16
   Socket(s):                               -
   Cluster(s):                              1
   Stepping:                                r0p1
   BogoMIPS:                                2000.00
   Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
   L1d cache:                               1 MiB (16 instances)
   L1i cache:                               1 MiB (16 instances)
   L2 cache:                                32 MiB (16 instances)
   L3 cache:                                80 MiB (1 instance)
   NUMA node(s):                            1
   NUMA node0 CPU(s):                       0-15
   Vulnerability Gather data sampling:      Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit:             Not affected
   Vulnerability L1tf:                      Not affected
   Vulnerability Mds:                       Not affected
   Vulnerability Meltdown:                  Not affected
   Vulnerability Mmio stale data:           Not affected
   Vulnerability Reg file data sampling:    Not affected
   Vulnerability Retbleed:                  Not affected
   Vulnerability Spec rstack overflow:      Not affected
   Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
   Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
   Vulnerability Spectre v2:                Mitigation; CSV2, BHB
   Vulnerability Srbds:                     Not affected
   Vulnerability Tsa:                       Not affected
   Vulnerability Tsx async abort:           Not affected
   Vulnerability Vmscape:                   Not affected
   ```
   
   </details>
   
   Comparing codex/late-materialization-topk (68e8de629cfbca27527529da5dfed2c5ad8522be) to 0da8961 (merge-base) [diff](https://github.com/apache/datafusion/compare/0da89616e43299546ed8405cfa900d0f97cb2515..68e8de629cfbca27527529da5dfed2c5ad8522be) using: tpch
   Results will be posted here when complete
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [PR] Add row-number late materialization for TopK [datafusion]

Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #22617:
URL: https://github.com/apache/datafusion/pull/22617#issuecomment-4574701174

   ๐Ÿค– Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/22617#issuecomment-4574493650)
   
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
   
   <details><summary>CPU Details (lscpu)</summary>
   
   ```
   Architecture:                            aarch64
   CPU op-mode(s):                          64-bit
   Byte Order:                              Little Endian
   CPU(s):                                  16
   On-line CPU(s) list:                     0-15
   Vendor ID:                               ARM
   Model name:                              Neoverse-V2
   Model:                                   1
   Thread(s) per core:                      1
   Core(s) per cluster:                     16
   Socket(s):                               -
   Cluster(s):                              1
   Stepping:                                r0p1
   BogoMIPS:                                2000.00
   Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
   L1d cache:                               1 MiB (16 instances)
   L1i cache:                               1 MiB (16 instances)
   L2 cache:                                32 MiB (16 instances)
   L3 cache:                                80 MiB (1 instance)
   NUMA node(s):                            1
   NUMA node0 CPU(s):                       0-15
   Vulnerability Gather data sampling:      Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit:             Not affected
   Vulnerability L1tf:                      Not affected
   Vulnerability Mds:                       Not affected
   Vulnerability Meltdown:                  Not affected
   Vulnerability Mmio stale data:           Not affected
   Vulnerability Reg file data sampling:    Not affected
   Vulnerability Retbleed:                  Not affected
   Vulnerability Spec rstack overflow:      Not affected
   Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
   Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
   Vulnerability Spectre v2:                Mitigation; CSV2, BHB
   Vulnerability Srbds:                     Not affected
   Vulnerability Tsa:                       Not affected
   Vulnerability Tsx async abort:           Not affected
   Vulnerability Vmscape:                   Not affected
   ```
   
   </details>
   
   <details><summary>Details</summary>
   <p>
   
   ```
   Comparing HEAD and codex_late-materialization-topk
   --------------------
   Benchmark tpcds_sf1.json
   --------------------
   โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”“
   โ”ƒ Query     โ”ƒ                                  HEAD โ”ƒ       codex_late-materialization-topk โ”ƒ        Change โ”ƒ
   โ”กโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ฉ
   โ”‚ QQuery 1  โ”‚           5.81 / 6.27 ยฑ0.85 / 7.97 ms โ”‚           6.06 / 6.53 ยฑ0.84 / 8.21 ms โ”‚     no change โ”‚
   โ”‚ QQuery 2  โ”‚        83.34 / 83.77 ยฑ0.29 / 84.15 ms โ”‚        81.98 / 82.10 ยฑ0.21 / 82.51 ms โ”‚     no change โ”‚
   โ”‚ QQuery 3  โ”‚        29.11 / 29.44 ยฑ0.33 / 30.05 ms โ”‚        29.53 / 29.63 ยฑ0.07 / 29.75 ms โ”‚     no change โ”‚
   โ”‚ QQuery 4  โ”‚     485.26 / 491.12 ยฑ4.68 / 499.37 ms โ”‚     498.28 / 502.55 ยฑ3.86 / 508.80 ms โ”‚     no change โ”‚
   โ”‚ QQuery 5  โ”‚        51.99 / 52.60 ยฑ0.35 / 52.93 ms โ”‚        51.94 / 52.51 ยฑ0.56 / 53.56 ms โ”‚     no change โ”‚
   โ”‚ QQuery 6  โ”‚        36.70 / 37.20 ยฑ0.51 / 38.16 ms โ”‚        35.96 / 36.87 ยฑ0.49 / 37.35 ms โ”‚     no change โ”‚
   โ”‚ QQuery 7  โ”‚        95.15 / 95.75 ยฑ0.52 / 96.62 ms โ”‚       96.51 / 98.52 ยฑ3.04 / 104.57 ms โ”‚     no change โ”‚
   โ”‚ QQuery 8  โ”‚        37.47 / 39.03 ยฑ2.63 / 44.28 ms โ”‚        37.17 / 37.86 ยฑ0.44 / 38.56 ms โ”‚     no change โ”‚
   โ”‚ QQuery 9  โ”‚        53.27 / 54.30 ยฑ1.17 / 55.81 ms โ”‚        55.13 / 56.39 ยฑ1.36 / 58.82 ms โ”‚     no change โ”‚
   โ”‚ QQuery 10 โ”‚        68.47 / 69.04 ยฑ0.33 / 69.45 ms โ”‚        68.80 / 69.17 ยฑ0.20 / 69.36 ms โ”‚     no change โ”‚
   โ”‚ QQuery 11 โ”‚     306.39 / 307.60 ยฑ0.66 / 308.36 ms โ”‚     299.98 / 309.29 ยฑ8.28 / 323.63 ms โ”‚     no change โ”‚
   โ”‚ QQuery 12 โ”‚        28.73 / 29.40 ยฑ0.40 / 29.97 ms โ”‚        29.07 / 29.33 ยฑ0.20 / 29.60 ms โ”‚     no change โ”‚
   โ”‚ QQuery 13 โ”‚     119.66 / 121.13 ยฑ2.11 / 125.33 ms โ”‚     120.61 / 122.29 ยฑ1.58 / 125.10 ms โ”‚     no change โ”‚
   โ”‚ QQuery 14 โ”‚     504.34 / 508.97 ยฑ4.38 / 517.08 ms โ”‚     506.99 / 511.74 ยฑ3.74 / 516.80 ms โ”‚     no change โ”‚
   โ”‚ QQuery 15 โ”‚        60.02 / 61.51 ยฑ1.52 / 64.43 ms โ”‚        60.09 / 60.73 ยฑ0.53 / 61.42 ms โ”‚     no change โ”‚
   โ”‚ QQuery 16 โ”‚           6.90 / 7.07 ยฑ0.26 / 7.58 ms โ”‚          6.90 / 8.31 ยฑ2.33 / 12.94 ms โ”‚  1.18x slower โ”‚
   โ”‚ QQuery 17 โ”‚        81.44 / 82.89 ยฑ1.54 / 85.85 ms โ”‚        82.01 / 83.14 ยฑ1.56 / 86.20 ms โ”‚     no change โ”‚
   โ”‚ QQuery 18 โ”‚     126.31 / 127.13 ยฑ0.49 / 127.85 ms โ”‚     125.98 / 127.37 ยฑ1.14 / 128.93 ms โ”‚     no change โ”‚
   โ”‚ QQuery 19 โ”‚        42.09 / 43.80 ยฑ2.71 / 49.16 ms โ”‚        42.22 / 42.75 ยฑ0.28 / 42.99 ms โ”‚     no change โ”‚
   โ”‚ QQuery 20 โ”‚        35.82 / 36.41 ยฑ0.63 / 37.58 ms โ”‚        36.86 / 37.26 ยฑ0.29 / 37.68 ms โ”‚     no change โ”‚
   โ”‚ QQuery 21 โ”‚        17.19 / 17.48 ยฑ0.24 / 17.80 ms โ”‚        17.43 / 17.73 ยฑ0.22 / 18.05 ms โ”‚     no change โ”‚
   โ”‚ QQuery 22 โ”‚        62.67 / 63.69 ยฑ0.59 / 64.26 ms โ”‚        62.58 / 63.39 ยฑ0.92 / 65.10 ms โ”‚     no change โ”‚
   โ”‚ QQuery 23 โ”‚     482.19 / 488.69 ยฑ9.83 / 508.17 ms โ”‚     484.19 / 489.04 ยฑ4.58 / 497.11 ms โ”‚     no change โ”‚
   โ”‚ QQuery 24 โ”‚     224.88 / 230.35 ยฑ5.69 / 239.43 ms โ”‚     225.40 / 230.93 ยฑ7.62 / 245.90 ms โ”‚     no change โ”‚
   โ”‚ QQuery 25 โ”‚     114.93 / 116.82 ยฑ3.05 / 122.88 ms โ”‚     116.14 / 119.12 ยฑ2.80 / 124.27 ms โ”‚     no change โ”‚
   โ”‚ QQuery 26 โ”‚        58.28 / 60.59 ยฑ3.50 / 67.53 ms โ”‚        58.98 / 59.82 ยฑ0.51 / 60.58 ms โ”‚     no change โ”‚
   โ”‚ QQuery 27 โ”‚           6.77 / 6.90 ยฑ0.10 / 7.07 ms โ”‚           6.66 / 6.81 ยฑ0.14 / 7.08 ms โ”‚     no change โ”‚
   โ”‚ QQuery 28 โ”‚        57.32 / 61.24 ยฑ1.97 / 62.36 ms โ”‚        57.70 / 60.19 ยฑ2.07 / 62.56 ms โ”‚     no change โ”‚
   โ”‚ QQuery 29 โ”‚      98.28 / 102.20 ยฑ4.38 / 108.89 ms โ”‚      98.92 / 103.10 ยฑ3.92 / 109.74 ms โ”‚     no change โ”‚
   โ”‚ QQuery 30 โ”‚        33.21 / 33.77 ยฑ0.49 / 34.67 ms โ”‚        33.05 / 33.40 ยฑ0.49 / 34.36 ms โ”‚     no change โ”‚
   โ”‚ QQuery 31 โ”‚     113.22 / 114.02 ยฑ0.63 / 114.99 ms โ”‚     111.93 / 114.52 ยฑ3.62 / 121.69 ms โ”‚     no change โ”‚
   โ”‚ QQuery 32 โ”‚        21.33 / 23.54 ยฑ3.46 / 30.42 ms โ”‚        20.69 / 22.36 ยฑ2.56 / 27.43 ms โ”‚     no change โ”‚
   โ”‚ QQuery 33 โ”‚        39.59 / 39.87 ยฑ0.22 / 40.23 ms โ”‚        39.42 / 39.85 ยฑ0.30 / 40.16 ms โ”‚     no change โ”‚
   โ”‚ QQuery 34 โ”‚         9.93 / 10.41 ยฑ0.60 / 11.56 ms โ”‚        10.23 / 10.82 ยฑ0.83 / 12.46 ms โ”‚     no change โ”‚
   โ”‚ QQuery 35 โ”‚        77.93 / 78.71 ยฑ0.66 / 79.77 ms โ”‚        78.34 / 79.11 ยฑ0.68 / 80.32 ms โ”‚     no change โ”‚
   โ”‚ QQuery 36 โ”‚           5.93 / 6.07 ยฑ0.12 / 6.30 ms โ”‚           6.16 / 6.27 ยฑ0.13 / 6.53 ms โ”‚     no change โ”‚
   โ”‚ QQuery 37 โ”‚           6.96 / 7.03 ยฑ0.04 / 7.07 ms โ”‚           6.88 / 6.98 ยฑ0.08 / 7.07 ms โ”‚     no change โ”‚
   โ”‚ QQuery 38 โ”‚        64.29 / 66.40 ยฑ2.12 / 70.37 ms โ”‚        64.16 / 67.35 ยฑ3.50 / 72.06 ms โ”‚     no change โ”‚
   โ”‚ QQuery 39 โ”‚      99.26 / 100.93 ยฑ1.27 / 103.01 ms โ”‚     100.23 / 100.94 ยฑ0.59 / 101.63 ms โ”‚     no change โ”‚
   โ”‚ QQuery 40 โ”‚        23.77 / 24.00 ยฑ0.18 / 24.25 ms โ”‚        24.00 / 24.26 ยฑ0.14 / 24.43 ms โ”‚     no change โ”‚
   โ”‚ QQuery 41 โ”‚        11.69 / 11.79 ยฑ0.12 / 12.02 ms โ”‚        11.56 / 11.72 ยฑ0.21 / 12.13 ms โ”‚     no change โ”‚
   โ”‚ QQuery 42 โ”‚        24.42 / 25.09 ยฑ0.38 / 25.46 ms โ”‚        24.29 / 24.72 ยฑ0.47 / 25.46 ms โ”‚     no change โ”‚
   โ”‚ QQuery 43 โ”‚           4.79 / 4.90 ยฑ0.15 / 5.21 ms โ”‚           4.84 / 5.01 ยฑ0.16 / 5.30 ms โ”‚     no change โ”‚
   โ”‚ QQuery 44 โ”‚        10.73 / 11.81 ยฑ2.06 / 15.92 ms โ”‚        11.27 / 13.86 ยฑ2.87 / 17.63 ms โ”‚  1.17x slower โ”‚
   โ”‚ QQuery 45 โ”‚        40.17 / 46.99 ยฑ6.18 / 55.21 ms โ”‚        40.86 / 41.46 ยฑ0.40 / 41.90 ms โ”‚ +1.13x faster โ”‚
   โ”‚ QQuery 46 โ”‚        12.34 / 12.75 ยฑ0.30 / 13.16 ms โ”‚        12.49 / 13.02 ยฑ0.35 / 13.40 ms โ”‚     no change โ”‚
   โ”‚ QQuery 47 โ”‚     237.07 / 242.83 ยฑ3.46 / 247.49 ms โ”‚     242.61 / 245.62 ยฑ2.30 / 249.22 ms โ”‚     no change โ”‚
   โ”‚ QQuery 48 โ”‚       98.21 / 99.77 ยฑ2.23 / 104.18 ms โ”‚        97.98 / 98.65 ยฑ0.61 / 99.67 ms โ”‚     no change โ”‚
   โ”‚ QQuery 49 โ”‚        79.38 / 81.63 ยฑ2.72 / 86.97 ms โ”‚        80.06 / 81.79 ยฑ2.79 / 87.34 ms โ”‚     no change โ”‚
   โ”‚ QQuery 50 โ”‚        59.73 / 60.43 ยฑ0.38 / 60.91 ms โ”‚        59.69 / 60.52 ยฑ0.47 / 61.05 ms โ”‚     no change โ”‚
   โ”‚ QQuery 51 โ”‚       94.23 / 98.18 ยฑ4.33 / 105.18 ms โ”‚      95.56 / 100.07 ยฑ4.40 / 108.08 ms โ”‚     no change โ”‚
   โ”‚ QQuery 52 โ”‚        24.69 / 25.09 ยฑ0.38 / 25.77 ms โ”‚        24.40 / 24.84 ยฑ0.40 / 25.59 ms โ”‚     no change โ”‚
   โ”‚ QQuery 53 โ”‚        29.80 / 30.04 ยฑ0.24 / 30.49 ms โ”‚        30.17 / 30.42 ยฑ0.14 / 30.58 ms โ”‚     no change โ”‚
   โ”‚ QQuery 54 โ”‚        56.11 / 56.38 ยฑ0.24 / 56.68 ms โ”‚        56.01 / 56.49 ยฑ0.35 / 56.94 ms โ”‚     no change โ”‚
   โ”‚ QQuery 55 โ”‚        23.82 / 24.26 ยฑ0.28 / 24.61 ms โ”‚        24.12 / 24.50 ยฑ0.34 / 24.99 ms โ”‚     no change โ”‚
   โ”‚ QQuery 56 โ”‚        39.16 / 39.81 ยฑ0.65 / 41.05 ms โ”‚        39.53 / 40.85 ยฑ1.04 / 42.60 ms โ”‚     no change โ”‚
   โ”‚ QQuery 57 โ”‚     177.33 / 181.34 ยฑ3.97 / 188.79 ms โ”‚     179.47 / 181.57 ยฑ1.84 / 183.91 ms โ”‚     no change โ”‚
   โ”‚ QQuery 58 โ”‚     118.81 / 121.16 ยฑ3.07 / 126.64 ms โ”‚     118.76 / 120.44 ยฑ2.44 / 125.25 ms โ”‚     no change โ”‚
   โ”‚ QQuery 59 โ”‚     121.07 / 124.87 ยฑ3.75 / 129.45 ms โ”‚     118.95 / 121.18 ยฑ4.03 / 129.23 ms โ”‚     no change โ”‚
   โ”‚ QQuery 60 โ”‚        39.91 / 40.57 ยฑ0.37 / 41.03 ms โ”‚        40.22 / 41.08 ยฑ0.63 / 42.13 ms โ”‚     no change โ”‚
   โ”‚ QQuery 61 โ”‚        12.71 / 12.89 ยฑ0.14 / 13.13 ms โ”‚        12.98 / 13.12 ยฑ0.16 / 13.41 ms โ”‚     no change โ”‚
   โ”‚ QQuery 62 โ”‚        46.62 / 47.12 ยฑ0.38 / 47.73 ms โ”‚        46.75 / 47.13 ยฑ0.32 / 47.53 ms โ”‚     no change โ”‚
   โ”‚ QQuery 63 โ”‚        30.01 / 30.15 ยฑ0.11 / 30.33 ms โ”‚        30.20 / 30.46 ยฑ0.20 / 30.82 ms โ”‚     no change โ”‚
   โ”‚ QQuery 64 โ”‚     398.09 / 403.25 ยฑ7.62 / 418.29 ms โ”‚     395.00 / 403.23 ยฑ6.81 / 414.69 ms โ”‚     no change โ”‚
   โ”‚ QQuery 65 โ”‚     147.34 / 153.30 ยฑ4.08 / 157.92 ms โ”‚     150.30 / 156.62 ยฑ7.06 / 169.01 ms โ”‚     no change โ”‚
   โ”‚ QQuery 66 โ”‚        79.84 / 81.43 ยฑ2.35 / 85.98 ms โ”‚        80.92 / 85.12 ยฑ7.32 / 99.74 ms โ”‚     no change โ”‚
   โ”‚ QQuery 67 โ”‚     248.61 / 255.61 ยฑ6.20 / 266.10 ms โ”‚     258.68 / 266.61 ยฑ5.70 / 275.05 ms โ”‚     no change โ”‚
   โ”‚ QQuery 68 โ”‚        11.73 / 11.94 ยฑ0.22 / 12.32 ms โ”‚        12.34 / 12.63 ยฑ0.21 / 12.86 ms โ”‚  1.06x slower โ”‚
   โ”‚ QQuery 69 โ”‚        62.90 / 63.08 ยฑ0.15 / 63.27 ms โ”‚        63.48 / 63.83 ยฑ0.31 / 64.32 ms โ”‚     no change โ”‚
   โ”‚ QQuery 70 โ”‚     105.11 / 114.66 ยฑ8.17 / 124.09 ms โ”‚     108.37 / 115.41 ยฑ7.93 / 130.37 ms โ”‚     no change โ”‚
   โ”‚ QQuery 71 โ”‚        35.92 / 36.29 ยฑ0.20 / 36.50 ms โ”‚        36.21 / 36.59 ยฑ0.34 / 37.03 ms โ”‚     no change โ”‚
   โ”‚ QQuery 72 โ”‚ 2192.50 / 2252.18 ยฑ44.05 / 2307.84 ms โ”‚ 2147.65 / 2216.48 ยฑ58.35 / 2299.64 ms โ”‚     no change โ”‚
   โ”‚ QQuery 73 โ”‚          9.68 / 9.88 ยฑ0.23 / 10.21 ms โ”‚          9.71 / 9.90 ยฑ0.15 / 10.16 ms โ”‚     no change โ”‚
   โ”‚ QQuery 74 โ”‚     178.80 / 184.42 ยฑ4.47 / 191.33 ms โ”‚     179.80 / 185.15 ยฑ5.13 / 192.42 ms โ”‚     no change โ”‚
   โ”‚ QQuery 75 โ”‚     148.44 / 150.15 ยฑ1.26 / 152.36 ms โ”‚     150.51 / 152.36 ยฑ1.48 / 154.02 ms โ”‚     no change โ”‚
   โ”‚ QQuery 76 โ”‚        35.77 / 36.21 ยฑ0.32 / 36.63 ms โ”‚        36.42 / 37.06 ยฑ0.50 / 37.60 ms โ”‚     no change โ”‚
   โ”‚ QQuery 77 โ”‚        60.79 / 61.31 ยฑ0.47 / 61.95 ms โ”‚        61.75 / 62.62 ยฑ0.60 / 63.56 ms โ”‚     no change โ”‚
   โ”‚ QQuery 78 โ”‚     190.42 / 196.58 ยฑ5.57 / 203.72 ms โ”‚     193.94 / 200.50 ยฑ5.18 / 207.39 ms โ”‚     no change โ”‚
   โ”‚ QQuery 79 โ”‚        67.58 / 71.64 ยฑ4.25 / 78.66 ms โ”‚        68.66 / 70.84 ยฑ2.68 / 76.00 ms โ”‚     no change โ”‚
   โ”‚ QQuery 80 โ”‚     101.25 / 103.31 ยฑ2.12 / 107.17 ms โ”‚     102.55 / 104.58 ยฑ1.76 / 107.09 ms โ”‚     no change โ”‚
   โ”‚ QQuery 81 โ”‚        26.26 / 26.44 ยฑ0.16 / 26.74 ms โ”‚        26.34 / 26.54 ยฑ0.24 / 27.00 ms โ”‚     no change โ”‚
   โ”‚ QQuery 82 โ”‚        16.56 / 16.81 ยฑ0.23 / 17.20 ms โ”‚        16.80 / 16.92 ยฑ0.09 / 17.03 ms โ”‚     no change โ”‚
   โ”‚ QQuery 83 โ”‚        41.00 / 44.91 ยฑ4.67 / 52.47 ms โ”‚        41.18 / 46.13 ยฑ4.84 / 52.24 ms โ”‚     no change โ”‚
   โ”‚ QQuery 84 โ”‚        34.97 / 35.67 ยฑ0.48 / 36.35 ms โ”‚        35.75 / 36.06 ยฑ0.26 / 36.47 ms โ”‚     no change โ”‚
   โ”‚ QQuery 85 โ”‚     109.10 / 110.56 ยฑ1.25 / 112.81 ms โ”‚     110.11 / 111.71 ยฑ0.94 / 112.49 ms โ”‚     no change โ”‚
   โ”‚ QQuery 86 โ”‚        25.70 / 27.14 ยฑ2.24 / 31.52 ms โ”‚        25.67 / 27.01 ยฑ2.24 / 31.48 ms โ”‚     no change โ”‚
   โ”‚ QQuery 87 โ”‚        65.57 / 67.37 ยฑ1.31 / 69.26 ms โ”‚        66.24 / 68.10 ยฑ1.59 / 70.12 ms โ”‚     no change โ”‚
   โ”‚ QQuery 88 โ”‚        62.63 / 63.12 ยฑ0.31 / 63.56 ms โ”‚        63.07 / 63.65 ยฑ0.43 / 64.28 ms โ”‚     no change โ”‚
   โ”‚ QQuery 89 โ”‚        36.06 / 36.36 ยฑ0.25 / 36.64 ms โ”‚        36.42 / 36.78 ยฑ0.33 / 37.22 ms โ”‚     no change โ”‚
   โ”‚ QQuery 90 โ”‚        17.04 / 17.27 ยฑ0.17 / 17.55 ms โ”‚        17.35 / 17.57 ยฑ0.12 / 17.71 ms โ”‚     no change โ”‚
   โ”‚ QQuery 91 โ”‚        45.02 / 48.26 ยฑ3.30 / 53.84 ms โ”‚        46.08 / 46.31 ยฑ0.20 / 46.65 ms โ”‚     no change โ”‚
   โ”‚ QQuery 92 โ”‚        30.18 / 31.31 ยฑ0.71 / 32.00 ms โ”‚        31.04 / 31.44 ยฑ0.31 / 31.88 ms โ”‚     no change โ”‚
   โ”‚ QQuery 93 โ”‚        52.05 / 52.68 ยฑ0.66 / 53.95 ms โ”‚        52.01 / 52.72 ยฑ0.79 / 53.73 ms โ”‚     no change โ”‚
   โ”‚ QQuery 94 โ”‚        39.31 / 39.46 ยฑ0.14 / 39.69 ms โ”‚        39.46 / 39.63 ยฑ0.22 / 40.06 ms โ”‚     no change โ”‚
   โ”‚ QQuery 95 โ”‚        84.70 / 87.45 ยฑ2.76 / 92.06 ms โ”‚        85.98 / 88.14 ยฑ3.14 / 94.11 ms โ”‚     no change โ”‚
   โ”‚ QQuery 96 โ”‚        24.15 / 24.46 ยฑ0.22 / 24.71 ms โ”‚        24.82 / 24.95 ยฑ0.18 / 25.31 ms โ”‚     no change โ”‚
   โ”‚ QQuery 97 โ”‚        46.05 / 46.97 ยฑ0.75 / 48.18 ms โ”‚        46.83 / 47.65 ยฑ0.57 / 48.34 ms โ”‚     no change โ”‚
   โ”‚ QQuery 98 โ”‚        42.59 / 43.75 ยฑ0.99 / 45.29 ms โ”‚        43.97 / 44.22 ยฑ0.29 / 44.74 ms โ”‚     no change โ”‚
   โ”‚ QQuery 99 โ”‚        70.71 / 72.86 ยฑ2.45 / 75.90 ms โ”‚        70.31 / 73.58 ยฑ5.68 / 84.94 ms โ”‚     no change โ”‚
   โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
   โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”“
   โ”ƒ Benchmark Summary                              โ”ƒ            โ”ƒ
   โ”กโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ฉ
   โ”‚ Total Time (HEAD)                              โ”‚ 10445.09ms โ”‚
   โ”‚ Total Time (codex_late-materialization-topk)   โ”‚ 10467.56ms โ”‚
   โ”‚ Average Time (HEAD)                            โ”‚   105.51ms โ”‚
   โ”‚ Average Time (codex_late-materialization-topk) โ”‚   105.73ms โ”‚
   โ”‚ Queries Faster                                 โ”‚          1 โ”‚
   โ”‚ Queries Slower                                 โ”‚          3 โ”‚
   โ”‚ Queries with No Change                         โ”‚         95 โ”‚
   โ”‚ Queries with Failure                           โ”‚          0 โ”‚
   โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
   ```
   
   </p>
   </details>
   
   <details><summary>Resource Usage</summary>
   
   **tpcds โ€” base (merge-base)**
   | Metric | Value |
   |--------|-------|
   | Wall time | 55.0s |
   | Peak memory | 6.9 GiB |
   | Avg memory | 6.1 GiB |
   | CPU user | 241.8s |
   | CPU sys | 7.1s |
   | Peak spill | 0 B |
   
   **tpcds โ€” branch**
   | Metric | Value |
   |--------|-------|
   | Wall time | 55.0s |
   | Peak memory | 6.9 GiB |
   | Avg memory | 6.1 GiB |
   | CPU user | 240.0s |
   | CPU sys | 7.0s |
   | Peak spill | 0 B |
   
   </details>
   
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [PR] Add row-number late materialization for TopK [datafusion]

Posted by "AdamGS (via GitHub)" <gi...@apache.org>.
AdamGS commented on PR #22617:
URL: https://github.com/apache/datafusion/pull/22617#issuecomment-4573328342

   Is this [selective late materialization](https://www.vldb.org/pvldb/vol18/p4616-liu.pdf) ๐Ÿ‘€ ?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [PR] Add row-number late materialization for TopK [datafusion]

Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #22617:
URL: https://github.com/apache/datafusion/pull/22617#issuecomment-4574685458

   ๐Ÿค– Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/22617#issuecomment-4574493650)
   
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
   
   <details><summary>CPU Details (lscpu)</summary>
   
   ```
   Architecture:                            aarch64
   CPU op-mode(s):                          64-bit
   Byte Order:                              Little Endian
   CPU(s):                                  16
   On-line CPU(s) list:                     0-15
   Vendor ID:                               ARM
   Model name:                              Neoverse-V2
   Model:                                   1
   Thread(s) per core:                      1
   Core(s) per cluster:                     16
   Socket(s):                               -
   Cluster(s):                              1
   Stepping:                                r0p1
   BogoMIPS:                                2000.00
   Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
   L1d cache:                               1 MiB (16 instances)
   L1i cache:                               1 MiB (16 instances)
   L2 cache:                                32 MiB (16 instances)
   L3 cache:                                80 MiB (1 instance)
   NUMA node(s):                            1
   NUMA node0 CPU(s):                       0-15
   Vulnerability Gather data sampling:      Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit:             Not affected
   Vulnerability L1tf:                      Not affected
   Vulnerability Mds:                       Not affected
   Vulnerability Meltdown:                  Not affected
   Vulnerability Mmio stale data:           Not affected
   Vulnerability Reg file data sampling:    Not affected
   Vulnerability Retbleed:                  Not affected
   Vulnerability Spec rstack overflow:      Not affected
   Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
   Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
   Vulnerability Spectre v2:                Mitigation; CSV2, BHB
   Vulnerability Srbds:                     Not affected
   Vulnerability Tsa:                       Not affected
   Vulnerability Tsx async abort:           Not affected
   Vulnerability Vmscape:                   Not affected
   ```
   
   </details>
   
   <details><summary>Details</summary>
   <p>
   
   ```
   Comparing HEAD and codex_late-materialization-topk
   --------------------
   Benchmark tpch_sf1.json
   --------------------
   โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”“
   โ”ƒ Query     โ”ƒ                           HEAD โ”ƒ codex_late-materialization-topk โ”ƒ    Change โ”ƒ
   โ”กโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ฉ
   โ”‚ QQuery 1  โ”‚ 38.07 / 39.14 ยฑ1.14 / 41.06 ms โ”‚  38.18 / 39.32 ยฑ0.98 / 40.87 ms โ”‚ no change โ”‚
   โ”‚ QQuery 2  โ”‚ 18.34 / 18.80 ยฑ0.37 / 19.48 ms โ”‚  18.24 / 18.44 ยฑ0.16 / 18.64 ms โ”‚ no change โ”‚
   โ”‚ QQuery 3  โ”‚ 31.15 / 33.12 ยฑ0.99 / 33.84 ms โ”‚  30.33 / 32.20 ยฑ2.20 / 35.99 ms โ”‚ no change โ”‚
   โ”‚ QQuery 4  โ”‚ 17.01 / 17.15 ยฑ0.10 / 17.26 ms โ”‚  16.82 / 17.37 ยฑ0.57 / 18.45 ms โ”‚ no change โ”‚
   โ”‚ QQuery 5  โ”‚ 37.84 / 39.76 ยฑ1.91 / 43.33 ms โ”‚  36.79 / 38.59 ยฑ1.40 / 39.94 ms โ”‚ no change โ”‚
   โ”‚ QQuery 6  โ”‚ 15.94 / 16.15 ยฑ0.23 / 16.51 ms โ”‚  15.85 / 16.60 ยฑ1.05 / 18.66 ms โ”‚ no change โ”‚
   โ”‚ QQuery 7  โ”‚ 44.61 / 45.45 ยฑ0.61 / 46.28 ms โ”‚  43.82 / 45.75 ยฑ2.00 / 49.26 ms โ”‚ no change โ”‚
   โ”‚ QQuery 8  โ”‚ 42.48 / 43.21 ยฑ0.76 / 44.48 ms โ”‚  42.43 / 42.66 ยฑ0.24 / 43.03 ms โ”‚ no change โ”‚
   โ”‚ QQuery 9  โ”‚ 48.79 / 49.80 ยฑ0.80 / 51.23 ms โ”‚  49.36 / 50.36 ยฑ0.64 / 50.92 ms โ”‚ no change โ”‚
   โ”‚ QQuery 10 โ”‚ 41.59 / 41.81 ยฑ0.27 / 42.32 ms โ”‚  41.70 / 42.08 ยฑ0.22 / 42.36 ms โ”‚ no change โ”‚
   โ”‚ QQuery 11 โ”‚ 12.61 / 13.26 ยฑ0.71 / 14.58 ms โ”‚  12.81 / 13.01 ยฑ0.16 / 13.30 ms โ”‚ no change โ”‚
   โ”‚ QQuery 12 โ”‚ 23.71 / 24.07 ยฑ0.26 / 24.50 ms โ”‚  23.77 / 24.05 ยฑ0.33 / 24.68 ms โ”‚ no change โ”‚
   โ”‚ QQuery 13 โ”‚ 32.22 / 34.03 ยฑ1.91 / 37.53 ms โ”‚  31.91 / 33.90 ยฑ1.74 / 36.68 ms โ”‚ no change โ”‚
   โ”‚ QQuery 14 โ”‚ 23.25 / 24.19 ยฑ1.13 / 26.23 ms โ”‚  23.31 / 23.67 ยฑ0.22 / 23.99 ms โ”‚ no change โ”‚
   โ”‚ QQuery 15 โ”‚ 30.90 / 31.01 ยฑ0.08 / 31.10 ms โ”‚  30.93 / 31.39 ยฑ0.61 / 32.61 ms โ”‚ no change โ”‚
   โ”‚ QQuery 16 โ”‚ 13.74 / 14.06 ยฑ0.32 / 14.64 ms โ”‚  13.93 / 14.11 ยฑ0.22 / 14.50 ms โ”‚ no change โ”‚
   โ”‚ QQuery 17 โ”‚ 71.87 / 72.53 ยฑ0.51 / 73.36 ms โ”‚  71.89 / 72.82 ยฑ0.86 / 74.44 ms โ”‚ no change โ”‚
   โ”‚ QQuery 18 โ”‚ 58.95 / 60.16 ยฑ0.76 / 60.94 ms โ”‚  58.25 / 60.03 ยฑ1.55 / 62.20 ms โ”‚ no change โ”‚
   โ”‚ QQuery 19 โ”‚ 32.67 / 33.11 ยฑ0.54 / 34.07 ms โ”‚  32.80 / 33.64 ยฑ1.64 / 36.93 ms โ”‚ no change โ”‚
   โ”‚ QQuery 20 โ”‚ 31.62 / 31.85 ยฑ0.20 / 32.13 ms โ”‚  31.93 / 32.24 ยฑ0.26 / 32.69 ms โ”‚ no change โ”‚
   โ”‚ QQuery 21 โ”‚ 54.70 / 55.68 ยฑ0.55 / 56.40 ms โ”‚  55.38 / 56.48 ยฑ0.84 / 57.88 ms โ”‚ no change โ”‚
   โ”‚ QQuery 22 โ”‚ 13.61 / 13.82 ยฑ0.14 / 13.99 ms โ”‚  13.52 / 13.74 ยฑ0.14 / 13.90 ms โ”‚ no change โ”‚
   โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
   โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”“
   โ”ƒ Benchmark Summary                              โ”ƒ          โ”ƒ
   โ”กโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ฉ
   โ”‚ Total Time (HEAD)                              โ”‚ 752.15ms โ”‚
   โ”‚ Total Time (codex_late-materialization-topk)   โ”‚ 752.43ms โ”‚
   โ”‚ Average Time (HEAD)                            โ”‚  34.19ms โ”‚
   โ”‚ Average Time (codex_late-materialization-topk) โ”‚  34.20ms โ”‚
   โ”‚ Queries Faster                                 โ”‚        0 โ”‚
   โ”‚ Queries Slower                                 โ”‚        0 โ”‚
   โ”‚ Queries with No Change                         โ”‚       22 โ”‚
   โ”‚ Queries with Failure                           โ”‚        0 โ”‚
   โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
   ```
   
   </p>
   </details>
   
   <details><summary>Resource Usage</summary>
   
   **tpch โ€” base (merge-base)**
   | Metric | Value |
   |--------|-------|
   | Wall time | 5.0s |
   | Peak memory | 5.6 GiB |
   | Avg memory | 4.9 GiB |
   | CPU user | 29.4s |
   | CPU sys | 2.2s |
   | Peak spill | 0 B |
   
   **tpch โ€” branch**
   | Metric | Value |
   |--------|-------|
   | Wall time | 5.0s |
   | Peak memory | 5.7 GiB |
   | Avg memory | 4.9 GiB |
   | CPU user | 29.4s |
   | CPU sys | 2.2s |
   | Peak spill | 0 B |
   
   </details>
   
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [PR] Add row-number late materialization for TopK [datafusion]

Posted by "Dandandan (via GitHub)" <gi...@apache.org>.
Dandandan commented on PR #22617:
URL: https://github.com/apache/datafusion/pull/22617#issuecomment-4574106660

   > Is this [selective late materialization](https://www.vldb.org/pvldb/vol18/p4616-liu.pdf) ๐Ÿ‘€ ?
   
   That would be the idea!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [PR] Add row-number late materialization for TopK [datafusion]

Posted by "Dandandan (via GitHub)" <gi...@apache.org>.
Dandandan commented on PR #22617:
URL: https://github.com/apache/datafusion/pull/22617#issuecomment-4574493650

   
   run benchmarks
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [PR] Add row-number late materialization for TopK [datafusion]

Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #22617:
URL: https://github.com/apache/datafusion/pull/22617#issuecomment-4572982005

   ๐Ÿค– Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/22617#issuecomment-4572940303)
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c4572940303-359-qhx52 6.12.68+ #1 SMP Wed Apr  1 02:23:28 UTC 2026 aarch64 GNU/Linux`
   <details><summary>CPU Details (lscpu)</summary>
   
   ```
   Architecture:                            aarch64
   CPU op-mode(s):                          64-bit
   Byte Order:                              Little Endian
   CPU(s):                                  16
   On-line CPU(s) list:                     0-15
   Vendor ID:                               ARM
   Model name:                              Neoverse-V2
   Model:                                   1
   Thread(s) per core:                      1
   Core(s) per cluster:                     16
   Socket(s):                               -
   Cluster(s):                              1
   Stepping:                                r0p1
   BogoMIPS:                                2000.00
   Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
   L1d cache:                               1 MiB (16 instances)
   L1i cache:                               1 MiB (16 instances)
   L2 cache:                                32 MiB (16 instances)
   L3 cache:                                80 MiB (1 instance)
   NUMA node(s):                            1
   NUMA node0 CPU(s):                       0-15
   Vulnerability Gather data sampling:      Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit:             Not affected
   Vulnerability L1tf:                      Not affected
   Vulnerability Mds:                       Not affected
   Vulnerability Meltdown:                  Not affected
   Vulnerability Mmio stale data:           Not affected
   Vulnerability Reg file data sampling:    Not affected
   Vulnerability Retbleed:                  Not affected
   Vulnerability Spec rstack overflow:      Not affected
   Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
   Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
   Vulnerability Spectre v2:                Mitigation; CSV2, BHB
   Vulnerability Srbds:                     Not affected
   Vulnerability Tsa:                       Not affected
   Vulnerability Tsx async abort:           Not affected
   Vulnerability Vmscape:                   Not affected
   ```
   
   </details>
   
   Comparing codex/late-materialization-topk (68e8de629cfbca27527529da5dfed2c5ad8522be) to 0da8961 (merge-base) [diff](https://github.com/apache/datafusion/compare/0da89616e43299546ed8405cfa900d0f97cb2515..68e8de629cfbca27527529da5dfed2c5ad8522be) using: clickbench_partitioned
   Results will be posted here when complete
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [PR] Add row-number late materialization for TopK [datafusion]

Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #22617:
URL: https://github.com/apache/datafusion/pull/22617#issuecomment-4573265467

   ๐Ÿค– Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/22617#issuecomment-4572940303)
   
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
   
   <details><summary>CPU Details (lscpu)</summary>
   
   ```
   Architecture:                            aarch64
   CPU op-mode(s):                          64-bit
   Byte Order:                              Little Endian
   CPU(s):                                  16
   On-line CPU(s) list:                     0-15
   Vendor ID:                               ARM
   Model name:                              Neoverse-V2
   Model:                                   1
   Thread(s) per core:                      1
   Core(s) per cluster:                     16
   Socket(s):                               -
   Cluster(s):                              1
   Stepping:                                r0p1
   BogoMIPS:                                2000.00
   Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
   L1d cache:                               1 MiB (16 instances)
   L1i cache:                               1 MiB (16 instances)
   L2 cache:                                32 MiB (16 instances)
   L3 cache:                                80 MiB (1 instance)
   NUMA node(s):                            1
   NUMA node0 CPU(s):                       0-15
   Vulnerability Gather data sampling:      Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit:             Not affected
   Vulnerability L1tf:                      Not affected
   Vulnerability Mds:                       Not affected
   Vulnerability Meltdown:                  Not affected
   Vulnerability Mmio stale data:           Not affected
   Vulnerability Reg file data sampling:    Not affected
   Vulnerability Retbleed:                  Not affected
   Vulnerability Spec rstack overflow:      Not affected
   Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
   Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
   Vulnerability Spectre v2:                Mitigation; CSV2, BHB
   Vulnerability Srbds:                     Not affected
   Vulnerability Tsa:                       Not affected
   Vulnerability Tsx async abort:           Not affected
   Vulnerability Vmscape:                   Not affected
   ```
   
   </details>
   
   <details><summary>Details</summary>
   <p>
   
   ```
   Comparing HEAD and codex_late-materialization-topk
   --------------------
   Benchmark clickbench_partitioned.json
   --------------------
   โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”“
   โ”ƒ Query     โ”ƒ                                   HEAD โ”ƒ          codex_late-materialization-topk โ”ƒ        Change โ”ƒ
   โ”กโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ฉ
   โ”‚ QQuery 0  โ”‚           1.14 / 4.58 ยฑ6.79 / 18.17 ms โ”‚             1.16 / 4.70 ยฑ7.03 / 18.76 ms โ”‚     no change โ”‚
   โ”‚ QQuery 1  โ”‚         12.55 / 12.99 ยฑ0.23 / 13.20 ms โ”‚           13.02 / 13.13 ยฑ0.11 / 13.32 ms โ”‚     no change โ”‚
   โ”‚ QQuery 2  โ”‚         35.61 / 35.90 ยฑ0.27 / 36.37 ms โ”‚           36.31 / 36.56 ยฑ0.27 / 37.06 ms โ”‚     no change โ”‚
   โ”‚ QQuery 3  โ”‚         30.90 / 31.55 ยฑ0.72 / 32.52 ms โ”‚           30.73 / 31.28 ยฑ0.52 / 32.25 ms โ”‚     no change โ”‚
   โ”‚ QQuery 4  โ”‚      219.42 / 223.36 ยฑ2.16 / 225.88 ms โ”‚        218.78 / 222.79 ยฑ2.44 / 225.48 ms โ”‚     no change โ”‚
   โ”‚ QQuery 5  โ”‚      270.08 / 272.82 ยฑ2.03 / 276.01 ms โ”‚        270.27 / 273.06 ยฑ1.96 / 275.44 ms โ”‚     no change โ”‚
   โ”‚ QQuery 6  โ”‚            1.20 / 1.34 ยฑ0.22 / 1.77 ms โ”‚              1.18 / 1.32 ยฑ0.21 / 1.74 ms โ”‚     no change โ”‚
   โ”‚ QQuery 7  โ”‚         13.80 / 13.98 ยฑ0.20 / 14.36 ms โ”‚           13.88 / 13.99 ยฑ0.09 / 14.09 ms โ”‚     no change โ”‚
   โ”‚ QQuery 8  โ”‚      316.60 / 321.00 ยฑ3.18 / 324.51 ms โ”‚        317.98 / 322.99 ยฑ3.45 / 328.83 ms โ”‚     no change โ”‚
   โ”‚ QQuery 9  โ”‚      447.67 / 455.13 ยฑ5.00 / 462.17 ms โ”‚        445.95 / 450.81 ยฑ5.70 / 461.95 ms โ”‚     no change โ”‚
   โ”‚ QQuery 10 โ”‚         68.70 / 69.95 ยฑ0.91 / 71.16 ms โ”‚           69.41 / 71.35 ยฑ2.47 / 76.03 ms โ”‚     no change โ”‚
   โ”‚ QQuery 11 โ”‚         80.34 / 82.37 ยฑ1.61 / 85.00 ms โ”‚           80.07 / 81.51 ยฑ1.27 / 83.73 ms โ”‚     no change โ”‚
   โ”‚ QQuery 12 โ”‚      262.86 / 266.87 ยฑ4.47 / 272.51 ms โ”‚        265.55 / 271.46 ยฑ4.77 / 278.62 ms โ”‚     no change โ”‚
   โ”‚ QQuery 13 โ”‚      368.58 / 379.26 ยฑ5.71 / 385.72 ms โ”‚       371.12 / 381.17 ยฑ12.82 / 403.31 ms โ”‚     no change โ”‚
   โ”‚ QQuery 14 โ”‚      276.79 / 281.74 ยฑ5.03 / 289.86 ms โ”‚        275.92 / 282.45 ยฑ5.26 / 291.74 ms โ”‚     no change โ”‚
   โ”‚ QQuery 15 โ”‚      259.88 / 264.83 ยฑ3.28 / 268.61 ms โ”‚       261.42 / 271.40 ยฑ10.30 / 291.12 ms โ”‚     no change โ”‚
   โ”‚ QQuery 16 โ”‚      606.93 / 613.04 ยฑ7.66 / 627.86 ms โ”‚        604.31 / 613.74 ยฑ7.27 / 622.88 ms โ”‚     no change โ”‚
   โ”‚ QQuery 17 โ”‚     606.61 / 623.85 ยฑ19.88 / 661.92 ms โ”‚        608.18 / 612.55 ยฑ5.43 / 621.91 ms โ”‚     no change โ”‚
   โ”‚ QQuery 18 โ”‚ 1264.23 / 1367.26 ยฑ106.45 / 1496.16 ms โ”‚    1251.29 / 1266.47 ยฑ13.87 / 1291.83 ms โ”‚ +1.08x faster โ”‚
   โ”‚ QQuery 19 โ”‚         27.72 / 32.43 ยฑ9.11 / 50.65 ms โ”‚          27.87 / 33.56 ยฑ10.02 / 53.57 ms โ”‚     no change โ”‚
   โ”‚ QQuery 20 โ”‚      515.02 / 522.70 ยฑ9.61 / 541.35 ms โ”‚       517.23 / 524.39 ยฑ11.86 / 547.90 ms โ”‚     no change โ”‚
   โ”‚ QQuery 21 โ”‚      590.73 / 595.50 ยฑ3.00 / 598.84 ms โ”‚        590.70 / 597.49 ยฑ4.67 / 603.19 ms โ”‚     no change โ”‚
   โ”‚ QQuery 22 โ”‚   1052.95 / 1054.77 ยฑ1.07 / 1055.79 ms โ”‚    1054.57 / 1070.28 ยฑ10.08 / 1083.32 ms โ”‚     no change โ”‚
   โ”‚ QQuery 23 โ”‚  3148.83 / 3164.20 ยฑ11.55 / 3179.17 ms โ”‚ 19838.41 / 19980.50 ยฑ90.02 / 20088.59 ms โ”‚  6.31x slower โ”‚
   โ”‚ QQuery 24 โ”‚         41.70 / 43.06 ยฑ1.69 / 46.38 ms โ”‚       593.67 / 671.28 ยฑ62.71 / 730.38 ms โ”‚ 15.59x slower โ”‚
   โ”‚ QQuery 25 โ”‚      110.34 / 111.02 ยฑ0.54 / 111.82 ms โ”‚        111.73 / 113.85 ยฑ1.78 / 116.68 ms โ”‚     no change โ”‚
   โ”‚ QQuery 26 โ”‚         42.03 / 45.93 ยฑ5.00 / 55.82 ms โ”‚           41.97 / 42.37 ยฑ0.42 / 43.17 ms โ”‚ +1.08x faster โ”‚
   โ”‚ QQuery 27 โ”‚      661.50 / 670.94 ยฑ7.28 / 679.32 ms โ”‚        679.16 / 686.64 ยฑ6.06 / 696.41 ms โ”‚     no change โ”‚
   โ”‚ QQuery 28 โ”‚  3009.02 / 3027.21 ยฑ10.63 / 3040.40 ms โ”‚    3017.58 / 3043.51 ยฑ14.30 / 3057.96 ms โ”‚     no change โ”‚
   โ”‚ QQuery 29 โ”‚         39.59 / 42.97 ยฑ3.91 / 49.58 ms โ”‚           40.06 / 41.40 ยฑ2.00 / 45.35 ms โ”‚     no change โ”‚
   โ”‚ QQuery 30 โ”‚      296.87 / 301.13 ยฑ2.60 / 304.03 ms โ”‚        303.32 / 309.45 ยฑ6.07 / 320.91 ms โ”‚     no change โ”‚
   โ”‚ QQuery 31 โ”‚      279.64 / 286.04 ยฑ4.36 / 291.01 ms โ”‚        288.24 / 293.09 ยฑ4.62 / 301.78 ms โ”‚     no change โ”‚
   โ”‚ QQuery 32 โ”‚      914.38 / 926.09 ยฑ7.18 / 935.42 ms โ”‚       898.90 / 921.52 ยฑ16.93 / 950.74 ms โ”‚     no change โ”‚
   โ”‚ QQuery 33 โ”‚  1413.55 / 1437.88 ยฑ23.85 / 1475.58 ms โ”‚    1423.09 / 1445.46 ยฑ21.96 / 1484.82 ms โ”‚     no change โ”‚
   โ”‚ QQuery 34 โ”‚   1424.79 / 1436.14 ยฑ8.25 / 1450.13 ms โ”‚    1450.88 / 1462.91 ยฑ12.37 / 1479.16 ms โ”‚     no change โ”‚
   โ”‚ QQuery 35 โ”‚     276.89 / 304.00 ยฑ44.52 / 392.69 ms โ”‚       275.08 / 287.35 ยฑ11.85 / 307.71 ms โ”‚ +1.06x faster โ”‚
   โ”‚ QQuery 36 โ”‚         64.79 / 67.35 ยฑ1.55 / 69.36 ms โ”‚           64.31 / 69.29 ยฑ4.21 / 74.97 ms โ”‚     no change โ”‚
   โ”‚ QQuery 37 โ”‚         34.73 / 38.66 ยฑ4.14 / 45.57 ms โ”‚           35.42 / 37.36 ยฑ1.76 / 40.67 ms โ”‚     no change โ”‚
   โ”‚ QQuery 38 โ”‚         40.38 / 41.62 ยฑ0.78 / 42.29 ms โ”‚           40.53 / 45.64 ยฑ5.90 / 56.63 ms โ”‚  1.10x slower โ”‚
   โ”‚ QQuery 39 โ”‚      134.02 / 150.24 ยฑ8.29 / 157.56 ms โ”‚        138.76 / 147.85 ยฑ7.28 / 158.70 ms โ”‚     no change โ”‚
   โ”‚ QQuery 40 โ”‚         13.68 / 14.28 ยฑ0.52 / 14.92 ms โ”‚           13.78 / 14.02 ยฑ0.33 / 14.66 ms โ”‚     no change โ”‚
   โ”‚ QQuery 41 โ”‚         13.29 / 13.62 ยฑ0.26 / 13.97 ms โ”‚           13.33 / 15.39 ยฑ3.51 / 22.40 ms โ”‚  1.13x slower โ”‚
   โ”‚ QQuery 42 โ”‚         12.85 / 14.88 ยฑ3.51 / 21.88 ms โ”‚           12.99 / 13.14 ยฑ0.14 / 13.38 ms โ”‚ +1.13x faster โ”‚
   โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
   โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”“
   โ”ƒ Benchmark Summary                              โ”ƒ            โ”ƒ
   โ”กโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ฉ
   โ”‚ Total Time (HEAD)                              โ”‚ 19664.48ms โ”‚
   โ”‚ Total Time (codex_late-materialization-topk)   โ”‚ 37090.49ms โ”‚
   โ”‚ Average Time (HEAD)                            โ”‚   457.31ms โ”‚
   โ”‚ Average Time (codex_late-materialization-topk) โ”‚   862.57ms โ”‚
   โ”‚ Queries Faster                                 โ”‚          4 โ”‚
   โ”‚ Queries Slower                                 โ”‚          4 โ”‚
   โ”‚ Queries with No Change                         โ”‚         35 โ”‚
   โ”‚ Queries with Failure                           โ”‚          0 โ”‚
   โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
   ```
   
   </p>
   </details>
   
   <details><summary>Resource Usage</summary>
   
   **clickbench_partitioned โ€” base (merge-base)**
   | Metric | Value |
   |--------|-------|
   | Wall time | 100.0s |
   | Peak memory | 31.0 GiB |
   | Avg memory | 23.6 GiB |
   | CPU user | 1023.9s |
   | CPU sys | 62.6s |
   | Peak spill | 0 B |
   
   **clickbench_partitioned โ€” branch**
   | Metric | Value |
   |--------|-------|
   | Wall time | 190.0s |
   | Peak memory | 30.4 GiB |
   | Avg memory | 22.1 GiB |
   | CPU user | 1102.3s |
   | CPU sys | 74.7s |
   | Peak spill | 0 B |
   
   </details>
   
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [PR] Add row-number late materialization for TopK [datafusion]

Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #22617:
URL: https://github.com/apache/datafusion/pull/22617#issuecomment-4574728282

   ๐Ÿค– Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/22617#issuecomment-4574493650)
   
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
   
   <details><summary>CPU Details (lscpu)</summary>
   
   ```
   Architecture:                            aarch64
   CPU op-mode(s):                          64-bit
   Byte Order:                              Little Endian
   CPU(s):                                  16
   On-line CPU(s) list:                     0-15
   Vendor ID:                               ARM
   Model name:                              Neoverse-V2
   Model:                                   1
   Thread(s) per core:                      1
   Core(s) per cluster:                     16
   Socket(s):                               -
   Cluster(s):                              1
   Stepping:                                r0p1
   BogoMIPS:                                2000.00
   Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
   L1d cache:                               1 MiB (16 instances)
   L1i cache:                               1 MiB (16 instances)
   L2 cache:                                32 MiB (16 instances)
   L3 cache:                                80 MiB (1 instance)
   NUMA node(s):                            1
   NUMA node0 CPU(s):                       0-15
   Vulnerability Gather data sampling:      Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit:             Not affected
   Vulnerability L1tf:                      Not affected
   Vulnerability Mds:                       Not affected
   Vulnerability Meltdown:                  Not affected
   Vulnerability Mmio stale data:           Not affected
   Vulnerability Reg file data sampling:    Not affected
   Vulnerability Retbleed:                  Not affected
   Vulnerability Spec rstack overflow:      Not affected
   Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
   Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
   Vulnerability Spectre v2:                Mitigation; CSV2, BHB
   Vulnerability Srbds:                     Not affected
   Vulnerability Tsa:                       Not affected
   Vulnerability Tsx async abort:           Not affected
   Vulnerability Vmscape:                   Not affected
   ```
   
   </details>
   
   <details><summary>Details</summary>
   <p>
   
   ```
   Comparing HEAD and codex_late-materialization-topk
   --------------------
   Benchmark clickbench_partitioned.json
   --------------------
   โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”“
   โ”ƒ Query     โ”ƒ                                  HEAD โ”ƒ       codex_late-materialization-topk โ”ƒ        Change โ”ƒ
   โ”กโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ฉ
   โ”‚ QQuery 0  โ”‚          1.15 / 3.27 ยฑ4.14 / 11.55 ms โ”‚          1.16 / 3.28 ยฑ4.18 / 11.65 ms โ”‚     no change โ”‚
   โ”‚ QQuery 1  โ”‚        12.58 / 12.77 ยฑ0.13 / 12.92 ms โ”‚        12.47 / 12.60 ยฑ0.10 / 12.74 ms โ”‚     no change โ”‚
   โ”‚ QQuery 2  โ”‚        35.44 / 35.83 ยฑ0.35 / 36.39 ms โ”‚        35.39 / 35.61 ยฑ0.17 / 35.89 ms โ”‚     no change โ”‚
   โ”‚ QQuery 3  โ”‚        30.61 / 31.08 ยฑ0.56 / 32.14 ms โ”‚        30.43 / 30.72 ยฑ0.39 / 31.46 ms โ”‚     no change โ”‚
   โ”‚ QQuery 4  โ”‚     218.95 / 223.62 ยฑ3.35 / 227.92 ms โ”‚     215.64 / 222.58 ยฑ4.49 / 228.85 ms โ”‚     no change โ”‚
   โ”‚ QQuery 5  โ”‚     270.05 / 272.44 ยฑ2.61 / 276.59 ms โ”‚     268.02 / 271.05 ยฑ3.81 / 278.44 ms โ”‚     no change โ”‚
   โ”‚ QQuery 6  โ”‚           1.18 / 1.33 ยฑ0.22 / 1.75 ms โ”‚           1.21 / 1.35 ยฑ0.21 / 1.77 ms โ”‚     no change โ”‚
   โ”‚ QQuery 7  โ”‚        13.83 / 13.97 ยฑ0.11 / 14.12 ms โ”‚        13.68 / 13.78 ยฑ0.06 / 13.87 ms โ”‚     no change โ”‚
   โ”‚ QQuery 8  โ”‚     316.75 / 319.78 ยฑ2.39 / 322.61 ms โ”‚     313.51 / 320.45 ยฑ6.42 / 329.77 ms โ”‚     no change โ”‚
   โ”‚ QQuery 9  โ”‚    448.14 / 458.56 ยฑ12.60 / 480.91 ms โ”‚    432.62 / 453.31 ยฑ10.75 / 461.75 ms โ”‚     no change โ”‚
   โ”‚ QQuery 10 โ”‚        69.57 / 70.56 ยฑ0.97 / 72.04 ms โ”‚        70.13 / 71.19 ยฑ0.87 / 72.25 ms โ”‚     no change โ”‚
   โ”‚ QQuery 11 โ”‚        80.48 / 82.15 ยฑ1.15 / 83.89 ms โ”‚        81.52 / 85.05 ยฑ5.71 / 96.34 ms โ”‚     no change โ”‚
   โ”‚ QQuery 12 โ”‚     264.63 / 268.13 ยฑ3.03 / 271.71 ms โ”‚     261.48 / 267.97 ยฑ5.47 / 275.35 ms โ”‚     no change โ”‚
   โ”‚ QQuery 13 โ”‚     361.91 / 376.79 ยฑ9.71 / 389.98 ms โ”‚     357.29 / 368.89 ยฑ6.96 / 376.29 ms โ”‚     no change โ”‚
   โ”‚ QQuery 14 โ”‚     279.13 / 283.80 ยฑ5.51 / 294.14 ms โ”‚     277.12 / 280.12 ยฑ4.09 / 288.20 ms โ”‚     no change โ”‚
   โ”‚ QQuery 15 โ”‚     265.94 / 271.91 ยฑ7.18 / 285.30 ms โ”‚     262.71 / 268.75 ยฑ6.61 / 277.05 ms โ”‚     no change โ”‚
   โ”‚ QQuery 16 โ”‚     606.70 / 613.11 ยฑ6.24 / 624.54 ms โ”‚     605.82 / 618.30 ยฑ9.82 / 632.04 ms โ”‚     no change โ”‚
   โ”‚ QQuery 17 โ”‚    611.31 / 621.56 ยฑ11.81 / 644.36 ms โ”‚     609.77 / 619.09 ยฑ9.50 / 636.08 ms โ”‚     no change โ”‚
   โ”‚ QQuery 18 โ”‚ 1231.25 / 1262.38 ยฑ17.71 / 1286.34 ms โ”‚ 1233.90 / 1272.84 ยฑ28.64 / 1306.02 ms โ”‚     no change โ”‚
   โ”‚ QQuery 19 โ”‚        27.46 / 32.57 ยฑ8.60 / 49.65 ms โ”‚        28.14 / 31.19 ยฑ4.91 / 40.83 ms โ”‚     no change โ”‚
   โ”‚ QQuery 20 โ”‚     518.99 / 523.41 ยฑ5.80 / 534.68 ms โ”‚     523.58 / 525.94 ยฑ2.73 / 531.07 ms โ”‚     no change โ”‚
   โ”‚ QQuery 21 โ”‚     589.87 / 596.48 ยฑ4.91 / 602.49 ms โ”‚     604.18 / 607.04 ยฑ2.93 / 610.67 ms โ”‚     no change โ”‚
   โ”‚ QQuery 22 โ”‚  1049.90 / 1062.75 ยฑ8.97 / 1072.28 ms โ”‚  1061.51 / 1071.48 ยฑ8.02 / 1081.02 ms โ”‚     no change โ”‚
   โ”‚ QQuery 23 โ”‚ 3162.41 / 3199.94 ยฑ29.57 / 3243.60 ms โ”‚ 3160.92 / 3212.25 ยฑ41.85 / 3272.75 ms โ”‚     no change โ”‚
   โ”‚ QQuery 24 โ”‚        41.32 / 46.89 ยฑ5.45 / 55.65 ms โ”‚        41.47 / 46.89 ยฑ5.73 / 54.81 ms โ”‚     no change โ”‚
   โ”‚ QQuery 25 โ”‚     110.45 / 114.22 ยฑ4.89 / 123.86 ms โ”‚     110.55 / 111.23 ยฑ0.96 / 113.11 ms โ”‚     no change โ”‚
   โ”‚ QQuery 26 โ”‚        41.32 / 42.34 ยฑ0.95 / 43.98 ms โ”‚        41.82 / 46.86 ยฑ9.40 / 65.64 ms โ”‚  1.11x slower โ”‚
   โ”‚ QQuery 27 โ”‚     666.37 / 675.01 ยฑ6.56 / 685.31 ms โ”‚    664.74 / 680.49 ยฑ16.44 / 710.63 ms โ”‚     no change โ”‚
   โ”‚ QQuery 28 โ”‚  3024.36 / 3036.04 ยฑ6.67 / 3043.03 ms โ”‚ 3031.41 / 3053.22 ยฑ19.90 / 3087.60 ms โ”‚     no change โ”‚
   โ”‚ QQuery 29 โ”‚      39.92 / 61.50 ยฑ28.90 / 115.38 ms โ”‚        39.68 / 40.00 ยฑ0.29 / 40.40 ms โ”‚ +1.54x faster โ”‚
   โ”‚ QQuery 30 โ”‚     296.52 / 305.35 ยฑ5.79 / 313.35 ms โ”‚     296.13 / 305.62 ยฑ9.03 / 316.65 ms โ”‚     no change โ”‚
   โ”‚ QQuery 31 โ”‚     277.00 / 292.54 ยฑ8.69 / 300.78 ms โ”‚    273.76 / 286.88 ยฑ10.42 / 297.97 ms โ”‚     no change โ”‚
   โ”‚ QQuery 32 โ”‚   916.45 / 976.09 ยฑ36.37 / 1013.33 ms โ”‚    923.90 / 945.62 ยฑ26.89 / 997.58 ms โ”‚     no change โ”‚
   โ”‚ QQuery 33 โ”‚ 1425.27 / 1457.42 ยฑ19.90 / 1483.76 ms โ”‚ 1430.13 / 1465.32 ยฑ22.24 / 1489.24 ms โ”‚     no change โ”‚
   โ”‚ QQuery 34 โ”‚ 1446.35 / 1523.66 ยฑ69.41 / 1612.38 ms โ”‚ 1451.00 / 1475.18 ยฑ18.85 / 1502.26 ms โ”‚     no change โ”‚
   โ”‚ QQuery 35 โ”‚    269.15 / 317.63 ยฑ63.83 / 440.39 ms โ”‚    274.65 / 292.67 ยฑ21.11 / 334.10 ms โ”‚ +1.09x faster โ”‚
   โ”‚ QQuery 36 โ”‚      66.37 / 75.68 ยฑ15.11 / 105.84 ms โ”‚        64.69 / 69.44 ยฑ6.50 / 82.13 ms โ”‚ +1.09x faster โ”‚
   โ”‚ QQuery 37 โ”‚        34.73 / 35.63 ยฑ0.54 / 36.30 ms โ”‚        34.90 / 38.02 ยฑ4.37 / 46.47 ms โ”‚  1.07x slower โ”‚
   โ”‚ QQuery 38 โ”‚        39.10 / 40.38 ยฑ0.88 / 41.52 ms โ”‚        40.61 / 47.14 ยฑ6.58 / 58.83 ms โ”‚  1.17x slower โ”‚
   โ”‚ QQuery 39 โ”‚     147.05 / 153.54 ยฑ5.06 / 161.09 ms โ”‚    139.22 / 149.89 ยฑ10.94 / 170.15 ms โ”‚     no change โ”‚
   โ”‚ QQuery 40 โ”‚        13.50 / 13.98 ยฑ0.70 / 15.36 ms โ”‚        13.49 / 13.67 ยฑ0.30 / 14.27 ms โ”‚     no change โ”‚
   โ”‚ QQuery 41 โ”‚        13.19 / 13.27 ยฑ0.06 / 13.37 ms โ”‚        13.63 / 18.11 ยฑ6.23 / 29.94 ms โ”‚  1.36x slower โ”‚
   โ”‚ QQuery 42 โ”‚        12.75 / 12.85 ยฑ0.09 / 13.01 ms โ”‚        12.53 / 16.05 ยฑ6.69 / 29.41 ms โ”‚  1.25x slower โ”‚
   โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
   โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ณโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”“
   โ”ƒ Benchmark Summary                              โ”ƒ            โ”ƒ
   โ”กโ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ•‡โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”ฉ
   โ”‚ Total Time (HEAD)                              โ”‚ 19832.21ms โ”‚
   โ”‚ Total Time (codex_late-materialization-topk)   โ”‚ 19767.14ms โ”‚
   โ”‚ Average Time (HEAD)                            โ”‚   461.21ms โ”‚
   โ”‚ Average Time (codex_late-materialization-topk) โ”‚   459.70ms โ”‚
   โ”‚ Queries Faster                                 โ”‚          3 โ”‚
   โ”‚ Queries Slower                                 โ”‚          5 โ”‚
   โ”‚ Queries with No Change                         โ”‚         35 โ”‚
   โ”‚ Queries with Failure                           โ”‚          0 โ”‚
   โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
   ```
   
   </p>
   </details>
   
   <details><summary>Resource Usage</summary>
   
   **clickbench_partitioned โ€” base (merge-base)**
   | Metric | Value |
   |--------|-------|
   | Wall time | 100.0s |
   | Peak memory | 30.6 GiB |
   | Avg memory | 23.2 GiB |
   | CPU user | 1016.7s |
   | CPU sys | 73.7s |
   | Peak spill | 0 B |
   
   **clickbench_partitioned โ€” branch**
   | Metric | Value |
   |--------|-------|
   | Wall time | 100.0s |
   | Peak memory | 30.3 GiB |
   | Avg memory | 23.2 GiB |
   | CPU user | 1016.6s |
   | CPU sys | 73.0s |
   | Peak spill | 0 B |
   
   </details>
   
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [PR] Add row-number late materialization for TopK [datafusion]

Posted by "Dandandan (via GitHub)" <gi...@apache.org>.
Dandandan commented on PR #22617:
URL: https://github.com/apache/datafusion/pull/22617#issuecomment-4572940303

   run benchmarks


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org


Re: [PR] Add row-number late materialization for TopK [datafusion]

Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #22617:
URL: https://github.com/apache/datafusion/pull/22617#issuecomment-4574528795

   ๐Ÿค– Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/22617#issuecomment-4574493650)
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c4574493650-366-wbmr9 6.12.68+ #1 SMP Wed Apr  1 02:23:28 UTC 2026 aarch64 GNU/Linux`
   <details><summary>CPU Details (lscpu)</summary>
   
   ```
   Architecture:                            aarch64
   CPU op-mode(s):                          64-bit
   Byte Order:                              Little Endian
   CPU(s):                                  16
   On-line CPU(s) list:                     0-15
   Vendor ID:                               ARM
   Model name:                              Neoverse-V2
   Model:                                   1
   Thread(s) per core:                      1
   Core(s) per cluster:                     16
   Socket(s):                               -
   Cluster(s):                              1
   Stepping:                                r0p1
   BogoMIPS:                                2000.00
   Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
   L1d cache:                               1 MiB (16 instances)
   L1i cache:                               1 MiB (16 instances)
   L2 cache:                                32 MiB (16 instances)
   L3 cache:                                80 MiB (1 instance)
   NUMA node(s):                            1
   NUMA node0 CPU(s):                       0-15
   Vulnerability Gather data sampling:      Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit:             Not affected
   Vulnerability L1tf:                      Not affected
   Vulnerability Mds:                       Not affected
   Vulnerability Meltdown:                  Not affected
   Vulnerability Mmio stale data:           Not affected
   Vulnerability Reg file data sampling:    Not affected
   Vulnerability Retbleed:                  Not affected
   Vulnerability Spec rstack overflow:      Not affected
   Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
   Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
   Vulnerability Spectre v2:                Mitigation; CSV2, BHB
   Vulnerability Srbds:                     Not affected
   Vulnerability Tsa:                       Not affected
   Vulnerability Tsx async abort:           Not affected
   Vulnerability Vmscape:                   Not affected
   ```
   
   </details>
   
   Comparing codex/late-materialization-topk (c5da79763b3c6f0ba786e43358bbc49af734370f) to 32a1fe5 (merge-base) [diff](https://github.com/apache/datafusion/compare/32a1fe5498c00e1a5327ff796c9f8335691bdb32..c5da79763b3c6f0ba786e43358bbc49af734370f) using: tpcds
   Results will be posted here when complete
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org