You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "BoazC-MSFT (via GitHub)" <gi...@apache.org> on 2026/05/18 08:53:23 UTC
[PR] fix: prevent panic in record reader when row group metadata overcounts num_rows [arrow-rs]
BoazC-MSFT opened a new pull request, #9993:
URL: https://github.com/apache/arrow-rs/pull/9993
fix: prevent panic in record reader when row group metadata overcounts num_rows
# Which issue does this PR close?
- Closes #9992.
# Rationale for this change
The record reader (`RowIter` / `get_row_iter`) panics with `index out of bounds` when a Parquet file's row group metadata declares more rows than a column chunk actually contains. This happens in production when reading third-party Parquet files with mismatched metadata. Instead of panicking, the reader should return an error.
# What changes are included in this PR?
Three layers of fix in `parquet/src/record/`:
**triplet.rs - fix the inconsistent internal state:**
- Reset `curr_triplet_index` to 0 in the exhaustion path of `read_next`, so the stale index from the previous batch never persists alongside empty buffers.
- Return 0 from `current_def_level` and `current_rep_level` when `has_next` is false, as defense-in-depth against any caller that skips the `has_next` check.
**reader.rs - return errors instead of panicking:**
- Add `has_next()` guards before consuming column data in all `read_field` variants: `PrimitiveReader`, `OptionReader`, `RepeatedReader`, and `KeyValueReader`. When a column is exhausted mid-iteration, `read_field` now returns `Err("Unexpected end of column data")` which propagates through `ReaderIter::next` as `Some(Err(...))`.
# Are these changes tested?
Yes. Five new tests:
- `test_current_def_level_safe_after_exhaustion` - drives a `TripletIter` to exhaustion on an optional column and asserts `current_def_level()` returns 0 instead of panicking.
- `test_current_rep_level_safe_after_exhaustion` - same for `current_rep_level()` on a repeated column.
- `test_reader_iter_returns_error_when_num_records_exceeds_data` - exercises the full `ReaderIter` stack with an optional field (via `nulls.snappy.parquet`).
- `test_reader_iter_returns_error_for_repeated_field_when_num_records_exceeds_data` - same for a repeated primitive field (via `repeated_primitive_no_list.parquet`).
- `test_reader_iter_returns_error_for_map_field_when_num_records_exceeds_data` - same for a map field projected alone (via `map_no_value.parquet`).
Each integration test inflates `num_records` by 1 beyond actual data, asserts all real rows return `Ok`, and asserts the extra iteration returns `Err` containing "Unexpected end of column data".
# Are there any user-facing changes?
Callers of `get_row_iter` or `RowIter` that previously hit a panic on corrupt/truncated files will now receive an `Err` from the iterator instead. No API signature changes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: prevent panic in record reader when row group metadata overcounts num_rows [arrow-rs]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb merged PR #9993:
URL: https://github.com/apache/arrow-rs/pull/9993
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: prevent panic in record reader when row group metadata overcounts num_rows [arrow-rs]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on PR #9993:
URL: https://github.com/apache/arrow-rs/pull/9993#issuecomment-4501812833
run benchmarks arrow_reader arrow_reader_clickbench
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: prevent panic in record reader when row group metadata overcounts num_rows [arrow-rs]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #9993:
URL: https://github.com/apache/arrow-rs/pull/9993#issuecomment-4501832218
🤖 Arrow criterion benchmark running (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9993#issuecomment-4501812833)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c4501812833-242-2gcgt 6.12.68+ #1 SMP Wed Apr 1 02:23:28 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing fix-parquet-record-triplet-index-out-of-bounds (89ece440ab7a07c092b9402b1f7bceea132b4eea) to fd1c5b3 (merge-base) [diff](https://github.com/apache/arrow-rs/compare/fd1c5b391e169762a0981870c4e94baa3372d7a3..89ece440ab7a07c092b9402b1f7bceea132b4eea)
BENCH_NAME=arrow_reader_clickbench
BENCH_COMMAND=cargo bench --features=arrow,async,test_common,experimental,object_store --bench arrow_reader_clickbench
BENCH_FILTER=
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: prevent panic in record reader when row group metadata overcounts num_rows [arrow-rs]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #9993:
URL: https://github.com/apache/arrow-rs/pull/9993#issuecomment-4501838860
🤖 Arrow criterion benchmark running (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9993#issuecomment-4501812833)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c4501812833-241-bjmmw 6.12.68+ #1 SMP Wed Apr 1 02:23:28 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing fix-parquet-record-triplet-index-out-of-bounds (89ece440ab7a07c092b9402b1f7bceea132b4eea) to fd1c5b3 (merge-base) [diff](https://github.com/apache/arrow-rs/compare/fd1c5b391e169762a0981870c4e94baa3372d7a3..89ece440ab7a07c092b9402b1f7bceea132b4eea)
BENCH_NAME=arrow_reader
BENCH_COMMAND=cargo bench --features=arrow,async,test_common,experimental,object_store --bench arrow_reader
BENCH_FILTER=
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: prevent panic in record reader when row group metadata overcounts num_rows [arrow-rs]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #9993:
URL: https://github.com/apache/arrow-rs/pull/9993#issuecomment-4502587465
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9993#issuecomment-4501812445)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
group fix-parquet-record-triplet-index-out-of-bounds main
----- ---------------------------------------------- ----
arrow_array_reader/BYTE_ARRAY/Decimal128Array/plain encoded, mandatory, no NULLs 1.02 849.7±14.82µs ? ?/sec 1.00 834.5±9.74µs ? ?/sec
arrow_array_reader/BYTE_ARRAY/Decimal128Array/plain encoded, optional, half NULLs 1.01 951.0±6.84µs ? ?/sec 1.00 945.5±4.61µs ? ?/sec
arrow_array_reader/BYTE_ARRAY/Decimal128Array/plain encoded, optional, no NULLs 1.02 852.9±15.05µs ? ?/sec 1.00 839.3±9.65µs ? ?/sec
arrow_array_reader/BinaryArray/dictionary encoded, mandatory, no NULLs 1.00 274.9±0.28µs ? ?/sec 1.00 275.3±0.24µs ? ?/sec
arrow_array_reader/BinaryArray/dictionary encoded, optional, half NULLs 1.00 385.2±0.72µs ? ?/sec 1.00 385.7±0.77µs ? ?/sec
arrow_array_reader/BinaryArray/dictionary encoded, optional, no NULLs 1.00 267.5±0.27µs ? ?/sec 1.04 279.0±0.24µs ? ?/sec
arrow_array_reader/BinaryArray/plain encoded, mandatory, no NULLs 1.00 410.0±6.72µs ? ?/sec 1.00 408.3±3.61µs ? ?/sec
arrow_array_reader/BinaryArray/plain encoded, optional, half NULLs 1.00 455.4±4.30µs ? ?/sec 1.02 466.0±2.57µs ? ?/sec
arrow_array_reader/BinaryArray/plain encoded, optional, no NULLs 1.00 415.8±6.91µs ? ?/sec 1.00 415.5±5.33µs ? ?/sec
arrow_array_reader/BinaryViewArray/dictionary encoded, mandatory, no NULLs 1.00 79.4±0.10µs ? ?/sec 1.00 79.7±0.05µs ? ?/sec
arrow_array_reader/BinaryViewArray/dictionary encoded, optional, half NULLs 1.01 107.8±0.25µs ? ?/sec 1.00 107.3±0.10µs ? ?/sec
arrow_array_reader/BinaryViewArray/dictionary encoded, optional, no NULLs 1.00 83.2±0.18µs ? ?/sec 1.00 83.4±0.05µs ? ?/sec
arrow_array_reader/BinaryViewArray/plain encoded, mandatory, no NULLs 1.00 145.2±0.12µs ? ?/sec 1.00 145.5±0.73µs ? ?/sec
arrow_array_reader/BinaryViewArray/plain encoded, mandatory, no NULLs, short string 1.00 141.0±0.57µs ? ?/sec 1.00 141.5±0.66µs ? ?/sec
arrow_array_reader/BinaryViewArray/plain encoded, optional, half NULLs 1.00 143.9±0.57µs ? ?/sec 1.00 144.3±0.43µs ? ?/sec
arrow_array_reader/BinaryViewArray/plain encoded, optional, no NULLs 1.01 151.8±0.29µs ? ?/sec 1.00 150.7±0.23µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Decimal128Array/byte_stream_split encoded, mandatory, no NULLs 1.00 964.9±2.34µs ? ?/sec 1.00 965.9±0.41µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Decimal128Array/byte_stream_split encoded, optional, half NULLs 1.00 669.7±0.90µs ? ?/sec 1.01 673.3±0.37µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Decimal128Array/byte_stream_split encoded, optional, no NULLs 1.00 970.5±2.61µs ? ?/sec 1.00 970.2±0.49µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Decimal128Array/plain encoded, mandatory, no NULLs 1.00 189.1±0.21µs ? ?/sec 1.00 189.0±0.29µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Decimal128Array/plain encoded, optional, half NULLs 1.00 292.6±0.19µs ? ?/sec 1.01 295.0±0.26µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Decimal128Array/plain encoded, optional, no NULLs 1.00 194.3±0.35µs ? ?/sec 1.00 194.1±0.23µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Float16Array/byte_stream_split encoded, mandatory, no NULLs 1.00 120.5±0.27µs ? ?/sec 1.07 129.0±0.36µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Float16Array/byte_stream_split encoded, optional, half NULLs 1.00 178.1±0.11µs ? ?/sec 1.04 184.3±1.90µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Float16Array/byte_stream_split encoded, optional, no NULLs 1.00 124.6±3.58µs ? ?/sec 1.07 133.6±0.20µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Float16Array/plain encoded, mandatory, no NULLs 1.00 60.7±0.05µs ? ?/sec 1.01 61.0±0.04µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Float16Array/plain encoded, optional, half NULLs 1.01 149.1±2.65µs ? ?/sec 1.00 147.9±0.08µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Float16Array/plain encoded, optional, no NULLs 1.00 63.9±0.06µs ? ?/sec 1.00 63.8±0.05µs ? ?/sec
arrow_array_reader/FixedLenByteArray(16)/byte_stream_split encoded, mandatory, no NULLs 1.00 800.0±0.36µs ? ?/sec 1.00 803.8±11.11µs ? ?/sec
arrow_array_reader/FixedLenByteArray(16)/byte_stream_split encoded, optional, half NULLs 1.00 508.4±0.25µs ? ?/sec 1.01 511.7±0.28µs ? ?/sec
arrow_array_reader/FixedLenByteArray(16)/byte_stream_split encoded, optional, no NULLs 1.00 803.1±0.69µs ? ?/sec 1.00 805.1±0.50µs ? ?/sec
arrow_array_reader/FixedLenByteArray(16)/plain encoded, mandatory, no NULLs 1.00 23.1±0.05µs ? ?/sec 1.00 23.1±0.10µs ? ?/sec
arrow_array_reader/FixedLenByteArray(16)/plain encoded, optional, half NULLs 1.00 129.8±0.17µs ? ?/sec 1.02 132.3±0.15µs ? ?/sec
arrow_array_reader/FixedLenByteArray(16)/plain encoded, optional, no NULLs 1.00 26.6±0.07µs ? ?/sec 1.03 27.4±0.06µs ? ?/sec
arrow_array_reader/FixedLenByteArray(2)/byte_stream_split encoded, mandatory, no NULLs 1.00 65.2±0.25µs ? ?/sec 1.32 86.0±11.21µs ? ?/sec
arrow_array_reader/FixedLenByteArray(2)/byte_stream_split encoded, optional, half NULLs 1.00 123.0±0.11µs ? ?/sec 1.04 128.4±0.19µs ? ?/sec
arrow_array_reader/FixedLenByteArray(2)/byte_stream_split encoded, optional, no NULLs 1.00 67.9±0.22µs ? ?/sec 1.15 78.3±0.19µs ? ?/sec
arrow_array_reader/FixedLenByteArray(2)/plain encoded, mandatory, no NULLs 1.00 5.3±0.01µs ? ?/sec 1.02 5.4±0.05µs ? ?/sec
arrow_array_reader/FixedLenByteArray(2)/plain encoded, optional, half NULLs 1.00 92.6±0.09µs ? ?/sec 1.00 92.6±0.09µs ? ?/sec
arrow_array_reader/FixedLenByteArray(2)/plain encoded, optional, no NULLs 1.00 8.7±0.01µs ? ?/sec 1.01 8.8±0.02µs ? ?/sec
arrow_array_reader/FixedLenByteArray(4)/byte_stream_split encoded, mandatory, no NULLs 1.00 134.7±11.91µs ? ?/sec 1.10 148.7±0.64µs ? ?/sec
arrow_array_reader/FixedLenByteArray(4)/byte_stream_split encoded, optional, half NULLs 1.00 189.3±0.37µs ? ?/sec 1.05 198.7±0.30µs ? ?/sec
arrow_array_reader/FixedLenByteArray(4)/byte_stream_split encoded, optional, no NULLs 1.00 134.5±3.19µs ? ?/sec 1.13 151.4±0.50µs ? ?/sec
arrow_array_reader/FixedLenByteArray(4)/plain encoded, mandatory, no NULLs 1.00 7.6±0.01µs ? ?/sec 1.00 7.6±0.02µs ? ?/sec
arrow_array_reader/FixedLenByteArray(4)/plain encoded, optional, half NULLs 1.00 127.1±0.16µs ? ?/sec 1.01 128.0±0.09µs ? ?/sec
arrow_array_reader/FixedLenByteArray(4)/plain encoded, optional, no NULLs 1.00 11.0±0.01µs ? ?/sec 1.01 11.1±0.02µs ? ?/sec
arrow_array_reader/FixedLenByteArray(8)/byte_stream_split encoded, mandatory, no NULLs 1.00 264.8±1.02µs ? ?/sec 1.14 303.1±1.04µs ? ?/sec
arrow_array_reader/FixedLenByteArray(8)/byte_stream_split encoded, optional, half NULLs 1.00 248.3±0.34µs ? ?/sec 1.08 268.4±0.47µs ? ?/sec
arrow_array_reader/FixedLenByteArray(8)/byte_stream_split encoded, optional, no NULLs 1.00 269.8±0.73µs ? ?/sec 1.14 306.4±0.74µs ? ?/sec
arrow_array_reader/FixedLenByteArray(8)/plain encoded, mandatory, no NULLs 1.06 12.7±0.02µs ? ?/sec 1.00 12.0±0.04µs ? ?/sec
arrow_array_reader/FixedLenByteArray(8)/plain encoded, optional, half NULLs 1.00 122.6±0.13µs ? ?/sec 1.02 124.9±0.20µs ? ?/sec
arrow_array_reader/FixedLenByteArray(8)/plain encoded, optional, no NULLs 1.03 16.2±0.03µs ? ?/sec 1.00 15.8±0.02µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed increasing value 1.00 85.3±0.41µs ? ?/sec 1.00 85.5±0.39µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed single value 1.00 77.3±0.50µs ? ?/sec 1.00 77.5±0.33µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed skip increasing value 1.00 49.6±0.17µs ? ?/sec 1.00 49.7±0.17µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed skip single value 1.00 45.2±0.33µs ? ?/sec 1.00 45.2±0.23µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed skip stepped increasing value 1.00 73.1±0.07µs ? ?/sec 1.00 73.3±0.06µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed skip, mandatory, no NULLs 1.00 87.8±0.17µs ? ?/sec 1.00 87.6±0.22µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed skip, optional, half NULLs 1.00 88.9±0.11µs ? ?/sec 1.00 89.2±0.13µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed skip, optional, no NULLs 1.00 89.8±0.15µs ? ?/sec 1.00 90.2±0.19µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed stepped increasing value 1.00 106.0±0.63µs ? ?/sec 1.00 105.7±0.15µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed, mandatory, no NULLs 1.00 124.3±0.36µs ? ?/sec 1.00 124.1±0.31µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed, optional, half NULLs 1.00 146.5±0.19µs ? ?/sec 1.01 147.3±0.19µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed, optional, no NULLs 1.00 128.1±0.34µs ? ?/sec 1.00 128.6±0.56µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/byte_stream_split encoded, mandatory, no NULLs 1.00 54.0±0.07µs ? ?/sec 1.00 54.2±0.07µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/byte_stream_split encoded, optional, half NULLs 1.00 110.2±0.09µs ? ?/sec 1.01 110.9±0.12µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/byte_stream_split encoded, optional, no NULLs 1.00 57.9±0.08µs ? ?/sec 1.00 57.8±0.06µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/dictionary encoded, mandatory, no NULLs 1.08 91.1±0.08µs ? ?/sec 1.00 84.3±0.07µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/dictionary encoded, optional, half NULLs 1.00 127.2±0.12µs ? ?/sec 1.01 128.8±0.13µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/dictionary encoded, optional, no NULLs 1.00 87.8±0.06µs ? ?/sec 1.00 88.1±0.05µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/plain encoded, mandatory, no NULLs 1.00 48.5±0.06µs ? ?/sec 1.01 48.8±0.06µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/plain encoded, optional, half NULLs 1.00 107.6±0.09µs ? ?/sec 1.00 108.1±0.13µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/plain encoded, optional, no NULLs 1.00 50.9±0.08µs ? ?/sec 1.00 50.9±0.06µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed increasing value 1.00 77.5±0.15µs ? ?/sec 1.01 77.9±0.20µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed single value 1.00 74.1±0.18µs ? ?/sec 1.00 74.4±0.15µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed skip increasing value 1.00 43.2±0.06µs ? ?/sec 1.00 43.2±0.05µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed skip single value 1.00 41.5±0.05µs ? ?/sec 1.00 41.3±0.07µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed skip stepped increasing value 1.00 67.2±0.04µs ? ?/sec 1.00 67.0±0.05µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed skip, mandatory, no NULLs 1.00 79.1±0.05µs ? ?/sec 1.01 79.5±0.05µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed skip, optional, half NULLs 1.00 90.1±0.06µs ? ?/sec 1.00 90.5±0.07µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed skip, optional, no NULLs 1.00 81.3±0.07µs ? ?/sec 1.01 81.7±0.05µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed stepped increasing value 1.00 99.1±0.44µs ? ?/sec 1.00 98.9±0.13µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed, mandatory, no NULLs 1.00 113.9±0.20µs ? ?/sec 1.00 114.3±0.18µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed, optional, half NULLs 1.00 152.1±0.17µs ? ?/sec 1.00 152.2±0.14µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed, optional, no NULLs 1.00 118.0±0.17µs ? ?/sec 1.00 118.0±0.16µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/byte_stream_split encoded, mandatory, no NULLs 1.00 82.8±0.08µs ? ?/sec 1.00 82.9±0.10µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/byte_stream_split encoded, optional, half NULLs 1.00 136.1±0.08µs ? ?/sec 1.00 136.5±0.08µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/byte_stream_split encoded, optional, no NULLs 1.00 87.6±0.08µs ? ?/sec 1.00 87.3±0.09µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/dictionary encoded, mandatory, no NULLs 1.00 86.4±0.07µs ? ?/sec 1.01 86.8±0.08µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/dictionary encoded, optional, half NULLs 1.00 140.0±0.10µs ? ?/sec 1.00 140.0±0.15µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/dictionary encoded, optional, no NULLs 1.00 90.5±0.22µs ? ?/sec 1.00 90.5±0.07µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/plain encoded, mandatory, no NULLs 1.00 54.1±0.18µs ? ?/sec 1.00 54.0±0.05µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/plain encoded, optional, half NULLs 1.00 121.7±0.11µs ? ?/sec 1.00 121.2±0.07µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/plain encoded, optional, no NULLs 1.00 58.5±0.09µs ? ?/sec 1.00 58.2±0.06µs ? ?/sec
arrow_array_reader/Int16Array/binary packed increasing value 1.02 53.2±0.58µs ? ?/sec 1.00 52.1±0.41µs ? ?/sec
arrow_array_reader/Int16Array/binary packed single value 1.02 44.8±0.22µs ? ?/sec 1.00 44.0±0.47µs ? ?/sec
arrow_array_reader/Int16Array/binary packed skip increasing value 1.02 33.1±0.24µs ? ?/sec 1.00 32.6±0.16µs ? ?/sec
arrow_array_reader/Int16Array/binary packed skip single value 1.02 28.6±0.16µs ? ?/sec 1.00 28.1±0.28µs ? ?/sec
arrow_array_reader/Int16Array/binary packed skip stepped increasing value 1.00 56.1±0.06µs ? ?/sec 1.00 56.2±0.06µs ? ?/sec
arrow_array_reader/Int16Array/binary packed skip, mandatory, no NULLs 1.00 71.4±0.06µs ? ?/sec 1.00 71.5±0.08µs ? ?/sec
arrow_array_reader/Int16Array/binary packed skip, optional, half NULLs 1.00 72.6±0.23µs ? ?/sec 1.00 72.4±0.09µs ? ?/sec
arrow_array_reader/Int16Array/binary packed skip, optional, no NULLs 1.00 73.4±0.07µs ? ?/sec 1.00 73.5±0.08µs ? ?/sec
arrow_array_reader/Int16Array/binary packed stepped increasing value 1.00 72.5±0.10µs ? ?/sec 1.00 72.9±0.13µs ? ?/sec
arrow_array_reader/Int16Array/binary packed, mandatory, no NULLs 1.00 91.5±0.11µs ? ?/sec 1.00 91.6±0.17µs ? ?/sec
arrow_array_reader/Int16Array/binary packed, optional, half NULLs 1.00 113.7±0.40µs ? ?/sec 1.00 113.8±0.11µs ? ?/sec
arrow_array_reader/Int16Array/binary packed, optional, no NULLs 1.00 95.3±0.13µs ? ?/sec 1.00 95.2±0.16µs ? ?/sec
arrow_array_reader/Int16Array/byte_stream_split encoded, mandatory, no NULLs 1.00 21.0±0.02µs ? ?/sec 1.00 20.9±0.04µs ? ?/sec
arrow_array_reader/Int16Array/byte_stream_split encoded, optional, half NULLs 1.00 77.1±0.09µs ? ?/sec 1.00 77.3±0.10µs ? ?/sec
arrow_array_reader/Int16Array/byte_stream_split encoded, optional, no NULLs 1.00 24.7±0.03µs ? ?/sec 1.00 24.7±0.03µs ? ?/sec
arrow_array_reader/Int16Array/dictionary encoded, mandatory, no NULLs 1.00 51.0±0.03µs ? ?/sec 1.01 51.4±0.05µs ? ?/sec
arrow_array_reader/Int16Array/dictionary encoded, optional, half NULLs 1.00 94.9±0.10µs ? ?/sec 1.00 95.0±0.13µs ? ?/sec
arrow_array_reader/Int16Array/dictionary encoded, optional, no NULLs 1.00 54.5±0.04µs ? ?/sec 1.01 55.2±0.06µs ? ?/sec
arrow_array_reader/Int16Array/plain encoded, mandatory, no NULLs 1.01 14.0±0.03µs ? ?/sec 1.00 13.9±0.02µs ? ?/sec
arrow_array_reader/Int16Array/plain encoded, optional, half NULLs 1.00 74.7±0.09µs ? ?/sec 1.00 74.8±0.08µs ? ?/sec
arrow_array_reader/Int16Array/plain encoded, optional, no NULLs 1.01 17.9±0.02µs ? ?/sec 1.00 17.6±0.03µs ? ?/sec
arrow_array_reader/Int32Array/binary packed increasing value 1.00 48.5±0.36µs ? ?/sec 1.02 49.6±0.53µs ? ?/sec
arrow_array_reader/Int32Array/binary packed single value 1.00 40.6±0.26µs ? ?/sec 1.02 41.4±0.20µs ? ?/sec
arrow_array_reader/Int32Array/binary packed skip increasing value 1.00 30.8±0.14µs ? ?/sec 1.02 31.4±0.22µs ? ?/sec
arrow_array_reader/Int32Array/binary packed skip single value 1.00 26.4±0.19µs ? ?/sec 1.01 26.8±0.14µs ? ?/sec
arrow_array_reader/Int32Array/binary packed skip stepped increasing value 1.01 54.8±0.05µs ? ?/sec 1.00 54.5±0.05µs ? ?/sec
arrow_array_reader/Int32Array/binary packed skip, mandatory, no NULLs 1.00 68.9±0.23µs ? ?/sec 1.01 69.3±0.11µs ? ?/sec
arrow_array_reader/Int32Array/binary packed skip, optional, half NULLs 1.00 71.1±0.18µs ? ?/sec 1.00 70.9±0.08µs ? ?/sec
arrow_array_reader/Int32Array/binary packed skip, optional, no NULLs 1.00 71.2±0.20µs ? ?/sec 1.01 71.7±0.11µs ? ?/sec
arrow_array_reader/Int32Array/binary packed stepped increasing value 1.01 69.5±0.10µs ? ?/sec 1.00 69.1±0.10µs ? ?/sec
arrow_array_reader/Int32Array/binary packed, mandatory, no NULLs 1.00 87.7±0.49µs ? ?/sec 1.00 87.4±0.20µs ? ?/sec
arrow_array_reader/Int32Array/binary packed, optional, half NULLs 1.00 109.5±0.23µs ? ?/sec 1.01 110.9±0.17µs ? ?/sec
arrow_array_reader/Int32Array/binary packed, optional, no NULLs 1.00 91.5±0.70µs ? ?/sec 1.00 91.5±0.20µs ? ?/sec
arrow_array_reader/Int32Array/byte_stream_split encoded, mandatory, no NULLs 1.00 17.3±0.01µs ? ?/sec 1.00 17.3±0.01µs ? ?/sec
arrow_array_reader/Int32Array/byte_stream_split encoded, optional, half NULLs 1.00 74.5±0.10µs ? ?/sec 1.01 75.0±0.08µs ? ?/sec
arrow_array_reader/Int32Array/byte_stream_split encoded, optional, no NULLs 1.00 21.0±0.01µs ? ?/sec 1.00 21.0±0.03µs ? ?/sec
arrow_array_reader/Int32Array/dictionary encoded, mandatory, no NULLs 1.00 47.2±0.02µs ? ?/sec 1.01 47.6±0.02µs ? ?/sec
arrow_array_reader/Int32Array/dictionary encoded, optional, half NULLs 1.00 91.6±0.12µs ? ?/sec 1.01 92.7±0.09µs ? ?/sec
arrow_array_reader/Int32Array/dictionary encoded, optional, no NULLs 1.00 50.8±0.05µs ? ?/sec 1.01 51.5±0.09µs ? ?/sec
arrow_array_reader/Int32Array/plain encoded, mandatory, no NULLs 1.00 9.9±0.04µs ? ?/sec 1.00 9.9±0.01µs ? ?/sec
arrow_array_reader/Int32Array/plain encoded, optional, half NULLs 1.00 71.5±0.09µs ? ?/sec 1.00 71.8±0.18µs ? ?/sec
arrow_array_reader/Int32Array/plain encoded, optional, no NULLs 1.00 13.8±0.01µs ? ?/sec 1.00 13.7±0.05µs ? ?/sec
arrow_array_reader/Int64Array/binary packed increasing value 1.00 40.6±0.15µs ? ?/sec 1.00 40.6±0.15µs ? ?/sec
arrow_array_reader/Int64Array/binary packed single value 1.01 37.9±0.15µs ? ?/sec 1.00 37.7±0.16µs ? ?/sec
arrow_array_reader/Int64Array/binary packed skip increasing value 1.00 24.2±0.05µs ? ?/sec 1.00 24.3±0.05µs ? ?/sec
arrow_array_reader/Int64Array/binary packed skip single value 1.01 22.9±0.03µs ? ?/sec 1.00 22.6±0.03µs ? ?/sec
arrow_array_reader/Int64Array/binary packed skip stepped increasing value 1.00 48.0±0.04µs ? ?/sec 1.00 48.1±0.04µs ? ?/sec
arrow_array_reader/Int64Array/binary packed skip, mandatory, no NULLs 1.00 60.3±0.14µs ? ?/sec 1.00 60.3±0.04µs ? ?/sec
arrow_array_reader/Int64Array/binary packed skip, optional, half NULLs 1.00 71.3±0.05µs ? ?/sec 1.00 71.6±0.06µs ? ?/sec
arrow_array_reader/Int64Array/binary packed skip, optional, no NULLs 1.00 62.7±0.10µs ? ?/sec 1.00 62.6±0.04µs ? ?/sec
arrow_array_reader/Int64Array/binary packed stepped increasing value 1.00 61.7±0.11µs ? ?/sec 1.00 61.8±0.09µs ? ?/sec
arrow_array_reader/Int64Array/binary packed, mandatory, no NULLs 1.00 77.2±0.15µs ? ?/sec 1.00 76.9±0.12µs ? ?/sec
arrow_array_reader/Int64Array/binary packed, optional, half NULLs 1.00 115.6±0.13µs ? ?/sec 1.00 115.7±0.13µs ? ?/sec
arrow_array_reader/Int64Array/binary packed, optional, no NULLs 1.00 81.2±0.15µs ? ?/sec 1.00 81.2±0.12µs ? ?/sec
arrow_array_reader/Int64Array/byte_stream_split encoded, mandatory, no NULLs 1.00 45.7±0.03µs ? ?/sec 1.00 45.7±0.04µs ? ?/sec
arrow_array_reader/Int64Array/byte_stream_split encoded, optional, half NULLs 1.00 99.5±0.10µs ? ?/sec 1.00 99.8±0.27µs ? ?/sec
arrow_array_reader/Int64Array/byte_stream_split encoded, optional, no NULLs 1.00 49.8±0.04µs ? ?/sec 1.00 49.8±0.04µs ? ?/sec
arrow_array_reader/Int64Array/dictionary encoded, mandatory, no NULLs 1.00 49.6±0.02µs ? ?/sec 1.00 49.7±0.04µs ? ?/sec
arrow_array_reader/Int64Array/dictionary encoded, optional, half NULLs 1.00 103.1±0.09µs ? ?/sec 1.00 103.1±0.05µs ? ?/sec
arrow_array_reader/Int64Array/dictionary encoded, optional, no NULLs 1.00 53.1±0.10µs ? ?/sec 1.01 53.8±0.04µs ? ?/sec
arrow_array_reader/Int64Array/plain encoded, mandatory, no NULLs 1.00 16.2±0.01µs ? ?/sec 1.04 16.9±0.02µs ? ?/sec
arrow_array_reader/Int64Array/plain encoded, optional, half NULLs 1.00 84.7±0.04µs ? ?/sec 1.01 85.3±0.10µs ? ?/sec
arrow_array_reader/Int64Array/plain encoded, optional, no NULLs 1.01 20.2±0.02µs ? ?/sec 1.00 20.0±0.03µs ? ?/sec
arrow_array_reader/Int8Array/binary packed increasing value 1.00 52.8±0.61µs ? ?/sec 1.01 53.5±0.38µs ? ?/sec
arrow_array_reader/Int8Array/binary packed single value 1.00 44.4±0.26µs ? ?/sec 1.01 44.9±0.22µs ? ?/sec
arrow_array_reader/Int8Array/binary packed skip increasing value 1.00 33.1±0.25µs ? ?/sec 1.00 33.2±0.19µs ? ?/sec
arrow_array_reader/Int8Array/binary packed skip single value 1.00 28.4±0.14µs ? ?/sec 1.01 28.5±0.16µs ? ?/sec
arrow_array_reader/Int8Array/binary packed skip stepped increasing value 1.00 56.0±0.05µs ? ?/sec 1.00 56.2±0.07µs ? ?/sec
arrow_array_reader/Int8Array/binary packed skip, mandatory, no NULLs 1.00 71.4±0.04µs ? ?/sec 1.00 71.5±0.06µs ? ?/sec
arrow_array_reader/Int8Array/binary packed skip, optional, half NULLs 1.00 72.3±0.05µs ? ?/sec 1.00 72.4±0.06µs ? ?/sec
arrow_array_reader/Int8Array/binary packed skip, optional, no NULLs 1.00 73.5±0.05µs ? ?/sec 1.01 74.2±0.06µs ? ?/sec
arrow_array_reader/Int8Array/binary packed stepped increasing value 1.00 72.2±0.11µs ? ?/sec 1.00 72.5±0.12µs ? ?/sec
arrow_array_reader/Int8Array/binary packed, mandatory, no NULLs 1.00 91.7±0.09µs ? ?/sec 1.00 91.9±0.08µs ? ?/sec
arrow_array_reader/Int8Array/binary packed, optional, half NULLs 1.00 112.6±0.07µs ? ?/sec 1.01 113.9±0.10µs ? ?/sec
arrow_array_reader/Int8Array/binary packed, optional, no NULLs 1.00 95.3±0.06µs ? ?/sec 1.00 95.7±0.09µs ? ?/sec
arrow_array_reader/Int8Array/byte_stream_split encoded, mandatory, no NULLs 1.00 20.6±0.02µs ? ?/sec 1.01 20.9±0.07µs ? ?/sec
arrow_array_reader/Int8Array/byte_stream_split encoded, optional, half NULLs 1.00 76.6±0.08µs ? ?/sec 1.01 77.6±0.18µs ? ?/sec
arrow_array_reader/Int8Array/byte_stream_split encoded, optional, no NULLs 1.00 24.4±0.02µs ? ?/sec 1.01 24.7±0.04µs ? ?/sec
arrow_array_reader/Int8Array/dictionary encoded, mandatory, no NULLs 1.00 50.3±0.02µs ? ?/sec 1.01 51.0±0.06µs ? ?/sec
arrow_array_reader/Int8Array/dictionary encoded, optional, half NULLs 1.00 95.1±0.10µs ? ?/sec 1.00 95.1±0.13µs ? ?/sec
arrow_array_reader/Int8Array/dictionary encoded, optional, no NULLs 1.00 54.4±0.02µs ? ?/sec 1.01 54.8±0.06µs ? ?/sec
arrow_array_reader/Int8Array/plain encoded, mandatory, no NULLs 1.00 13.7±0.04µs ? ?/sec 1.01 13.8±0.03µs ? ?/sec
arrow_array_reader/Int8Array/plain encoded, optional, half NULLs 1.00 73.7±0.09µs ? ?/sec 1.01 74.7±0.10µs ? ?/sec
arrow_array_reader/Int8Array/plain encoded, optional, no NULLs 1.00 17.2±0.06µs ? ?/sec 1.03 17.7±0.02µs ? ?/sec
arrow_array_reader/ListArray/Fixed32List/90pct NULLs 1.00 999.5±8.45µs ? ?/sec 1.01 1007.0±8.91µs ? ?/sec
arrow_array_reader/ListArray/Fixed32List/99pct NULLs 1.00 458.4±12.58µs ? ?/sec 1.00 459.6±12.76µs ? ?/sec
arrow_array_reader/ListArray/Fixed32List/half NULLs 1.00 2.6±0.01ms ? ?/sec 1.01 2.6±0.01ms ? ?/sec
arrow_array_reader/ListArray/Fixed32List/no NULLs 1.00 4.1±0.04ms ? ?/sec 1.02 4.2±0.02ms ? ?/sec
arrow_array_reader/ListArray/Int32List/90pct NULLs 1.00 917.6±5.09µs ? ?/sec 1.01 931.1±5.60µs ? ?/sec
arrow_array_reader/ListArray/Int32List/99pct NULLs 1.00 410.8±11.96µs ? ?/sec 1.01 416.5±11.47µs ? ?/sec
arrow_array_reader/ListArray/Int32List/half NULLs 1.00 2.1±0.01ms ? ?/sec 1.00 2.1±0.01ms ? ?/sec
arrow_array_reader/ListArray/Int32List/no NULLs 1.00 2.8±0.01ms ? ?/sec 1.02 2.9±0.01ms ? ?/sec
arrow_array_reader/ListArray/StringList/90pct NULLs 1.00 1087.1±6.22µs ? ?/sec 1.00 1091.9±6.41µs ? ?/sec
arrow_array_reader/ListArray/StringList/99pct NULLs 1.00 422.1±13.09µs ? ?/sec 1.02 428.8±12.50µs ? ?/sec
arrow_array_reader/ListArray/StringList/half NULLs 1.00 3.9±0.01ms ? ?/sec 1.00 3.9±0.01ms ? ?/sec
arrow_array_reader/ListArray/StringList/no NULLs 1.00 7.0±0.05ms ? ?/sec 1.00 7.0±0.02ms ? ?/sec
arrow_array_reader/StringArray/const delta byte array encoded, mandatory, no NULLs 1.00 517.1±1.64µs ? ?/sec 1.03 533.6±2.18µs ? ?/sec
arrow_array_reader/StringArray/const delta length byte array encoded, mandatory, no NULLs 1.00 214.0±2.61µs ? ?/sec 1.04 222.0±0.46µs ? ?/sec
arrow_array_reader/StringArray/const prefix delta byte array encoded, mandatory, no NULLs 1.01 766.2±33.01µs ? ?/sec 1.00 761.4±40.97µs ? ?/sec
arrow_array_reader/StringArray/dictionary encoded, mandatory, no NULLs 1.00 275.0±0.12µs ? ?/sec 1.03 282.3±0.19µs ? ?/sec
arrow_array_reader/StringArray/dictionary encoded, optional, half NULLs 1.00 385.0±0.69µs ? ?/sec 1.00 383.8±0.75µs ? ?/sec
arrow_array_reader/StringArray/dictionary encoded, optional, no NULLs 1.00 278.7±0.10µs ? ?/sec 1.01 280.5±0.29µs ? ?/sec
arrow_array_reader/StringArray/plain encoded, mandatory, no NULLs 1.01 452.5±6.22µs ? ?/sec 1.00 446.1±4.78µs ? ?/sec
arrow_array_reader/StringArray/plain encoded, optional, half NULLs 1.00 490.1±4.23µs ? ?/sec 1.00 488.3±2.46µs ? ?/sec
arrow_array_reader/StringArray/plain encoded, optional, no NULLs 1.00 457.1±6.21µs ? ?/sec 1.00 455.0±4.95µs ? ?/sec
arrow_array_reader/StringDictionary/dictionary encoded, mandatory, no NULLs 1.00 246.4±0.72µs ? ?/sec 1.00 247.0±0.70µs ? ?/sec
arrow_array_reader/StringDictionary/dictionary encoded, optional, half NULLs 1.00 271.4±1.14µs ? ?/sec 1.01 274.1±1.24µs ? ?/sec
arrow_array_reader/StringDictionary/dictionary encoded, optional, no NULLs 1.00 250.6±0.73µs ? ?/sec 1.00 251.4±0.67µs ? ?/sec
arrow_array_reader/StringViewArray/dictionary encoded, mandatory, no NULLs 1.00 79.5±0.10µs ? ?/sec 1.00 79.8±0.05µs ? ?/sec
arrow_array_reader/StringViewArray/dictionary encoded, optional, half NULLs 1.00 108.0±0.18µs ? ?/sec 1.00 108.0±0.10µs ? ?/sec
arrow_array_reader/StringViewArray/dictionary encoded, optional, no NULLs 1.00 83.4±0.04µs ? ?/sec 1.00 83.6±0.05µs ? ?/sec
arrow_array_reader/StringViewArray/plain encoded, mandatory, no NULLs 1.00 217.4±0.36µs ? ?/sec 1.01 219.8±0.25µs ? ?/sec
arrow_array_reader/StringViewArray/plain encoded, optional, half NULLs 1.00 181.2±0.36µs ? ?/sec 1.01 183.7±0.19µs ? ?/sec
arrow_array_reader/StringViewArray/plain encoded, optional, no NULLs 1.00 226.6±0.40µs ? ?/sec 1.01 229.0±0.33µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed increasing value 1.03 53.4±0.55µs ? ?/sec 1.00 52.1±0.44µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed single value 1.03 45.0±0.20µs ? ?/sec 1.00 43.9±0.49µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed skip increasing value 1.02 33.2±0.21µs ? ?/sec 1.00 32.6±0.17µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed skip single value 1.02 28.6±0.10µs ? ?/sec 1.00 28.1±0.30µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed skip stepped increasing value 1.00 56.1±0.05µs ? ?/sec 1.00 56.3±0.05µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed skip, mandatory, no NULLs 1.00 76.1±0.15µs ? ?/sec 1.00 75.8±0.06µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed skip, optional, half NULLs 1.00 74.9±0.06µs ? ?/sec 1.00 75.0±0.09µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed skip, optional, no NULLs 1.00 78.1±0.05µs ? ?/sec 1.00 78.0±0.07µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed stepped increasing value 1.00 72.6±0.09µs ? ?/sec 1.00 72.6±0.12µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed, mandatory, no NULLs 1.00 97.2±0.12µs ? ?/sec 1.00 97.4±0.15µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed, optional, half NULLs 1.00 116.7±0.27µs ? ?/sec 1.01 117.4±0.17µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed, optional, no NULLs 1.00 101.0±0.09µs ? ?/sec 1.00 101.2±0.16µs ? ?/sec
arrow_array_reader/UInt16Array/byte_stream_split encoded, mandatory, no NULLs 1.00 21.0±0.09µs ? ?/sec 1.00 20.9±0.05µs ? ?/sec
arrow_array_reader/UInt16Array/byte_stream_split encoded, optional, half NULLs 1.00 77.1±0.09µs ? ?/sec 1.01 77.5±0.11µs ? ?/sec
arrow_array_reader/UInt16Array/byte_stream_split encoded, optional, no NULLs 1.00 24.6±0.03µs ? ?/sec 1.00 24.7±0.02µs ? ?/sec
arrow_array_reader/UInt16Array/dictionary encoded, mandatory, no NULLs 1.00 50.7±0.04µs ? ?/sec 1.01 51.0±0.03µs ? ?/sec
arrow_array_reader/UInt16Array/dictionary encoded, optional, half NULLs 1.00 95.0±0.09µs ? ?/sec 1.00 95.2±0.13µs ? ?/sec
arrow_array_reader/UInt16Array/dictionary encoded, optional, no NULLs 1.00 54.6±0.08µs ? ?/sec 1.01 55.0±0.04µs ? ?/sec
arrow_array_reader/UInt16Array/plain encoded, mandatory, no NULLs 1.00 13.8±0.02µs ? ?/sec 1.00 13.8±0.03µs ? ?/sec
arrow_array_reader/UInt16Array/plain encoded, optional, half NULLs 1.00 74.7±0.09µs ? ?/sec 1.01 75.1±0.13µs ? ?/sec
arrow_array_reader/UInt16Array/plain encoded, optional, no NULLs 1.00 17.6±0.02µs ? ?/sec 1.00 17.6±0.02µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed increasing value 1.02 50.1±0.62µs ? ?/sec 1.00 49.4±0.42µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed single value 1.02 41.9±0.24µs ? ?/sec 1.00 41.2±0.31µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed skip increasing value 1.01 31.6±0.29µs ? ?/sec 1.00 31.2±0.13µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed skip single value 1.03 27.3±0.18µs ? ?/sec 1.00 26.5±0.19µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed skip stepped increasing value 1.00 54.5±0.05µs ? ?/sec 1.00 54.7±0.05µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed skip, mandatory, no NULLs 1.00 69.4±0.10µs ? ?/sec 1.00 69.4±0.18µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed skip, optional, half NULLs 1.00 70.6±0.09µs ? ?/sec 1.00 70.8±0.08µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed skip, optional, no NULLs 1.00 71.5±0.11µs ? ?/sec 1.00 71.2±0.19µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed stepped increasing value 1.00 69.5±0.07µs ? ?/sec 1.00 69.2±0.13µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed, mandatory, no NULLs 1.00 87.5±0.21µs ? ?/sec 1.00 87.4±0.29µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed, optional, half NULLs 1.00 110.6±0.16µs ? ?/sec 1.00 110.5±0.21µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed, optional, no NULLs 1.00 91.5±0.23µs ? ?/sec 1.00 91.4±0.29µs ? ?/sec
arrow_array_reader/UInt32Array/byte_stream_split encoded, mandatory, no NULLs 1.00 17.5±0.02µs ? ?/sec 1.00 17.4±0.02µs ? ?/sec
arrow_array_reader/UInt32Array/byte_stream_split encoded, optional, half NULLs 1.00 74.4±0.09µs ? ?/sec 1.01 75.0±0.08µs ? ?/sec
arrow_array_reader/UInt32Array/byte_stream_split encoded, optional, no NULLs 1.01 21.0±0.03µs ? ?/sec 1.00 20.7±0.03µs ? ?/sec
arrow_array_reader/UInt32Array/dictionary encoded, mandatory, no NULLs 1.00 47.4±0.05µs ? ?/sec 1.01 47.9±0.05µs ? ?/sec
arrow_array_reader/UInt32Array/dictionary encoded, optional, half NULLs 1.00 91.4±0.11µs ? ?/sec 1.00 91.4±0.12µs ? ?/sec
arrow_array_reader/UInt32Array/dictionary encoded, optional, no NULLs 1.00 51.0±0.02µs ? ?/sec 1.01 51.6±0.03µs ? ?/sec
arrow_array_reader/UInt32Array/plain encoded, mandatory, no NULLs 1.02 10.4±0.03µs ? ?/sec 1.00 10.1±0.02µs ? ?/sec
arrow_array_reader/UInt32Array/plain encoded, optional, half NULLs 1.00 72.1±0.07µs ? ?/sec 1.00 71.9±0.11µs ? ?/sec
arrow_array_reader/UInt32Array/plain encoded, optional, no NULLs 1.01 14.0±0.02µs ? ?/sec 1.00 13.9±0.03µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed increasing value 1.00 40.6±0.12µs ? ?/sec 1.01 40.8±0.13µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed single value 1.00 37.8±0.13µs ? ?/sec 1.00 38.0±0.19µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed skip increasing value 1.00 24.3±0.08µs ? ?/sec 1.00 24.3±0.05µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed skip single value 1.00 22.8±0.06µs ? ?/sec 1.00 22.9±0.03µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed skip stepped increasing value 1.00 48.0±0.04µs ? ?/sec 1.00 47.9±0.04µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed skip, mandatory, no NULLs 1.00 60.4±0.05µs ? ?/sec 1.00 60.4±0.04µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed skip, optional, half NULLs 1.00 71.2±0.06µs ? ?/sec 1.00 71.3±0.04µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed skip, optional, no NULLs 1.00 62.2±0.06µs ? ?/sec 1.00 62.4±0.05µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed stepped increasing value 1.00 62.0±0.10µs ? ?/sec 1.00 62.0±0.11µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed, mandatory, no NULLs 1.00 77.4±0.13µs ? ?/sec 1.00 77.4±0.12µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed, optional, half NULLs 1.00 115.5±0.10µs ? ?/sec 1.00 115.4±0.09µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed, optional, no NULLs 1.00 81.5±0.14µs ? ?/sec 1.00 81.6±0.13µs ? ?/sec
arrow_array_reader/UInt64Array/byte_stream_split encoded, mandatory, no NULLs 1.00 45.8±0.04µs ? ?/sec 1.00 45.6±0.03µs ? ?/sec
arrow_array_reader/UInt64Array/byte_stream_split encoded, optional, half NULLs 1.00 99.5±0.06µs ? ?/sec 1.00 99.3±0.10µs ? ?/sec
arrow_array_reader/UInt64Array/byte_stream_split encoded, optional, no NULLs 1.00 49.8±0.05µs ? ?/sec 1.00 49.8±0.03µs ? ?/sec
arrow_array_reader/UInt64Array/dictionary encoded, mandatory, no NULLs 1.00 49.3±0.04µs ? ?/sec 1.01 49.9±0.04µs ? ?/sec
arrow_array_reader/UInt64Array/dictionary encoded, optional, half NULLs 1.00 103.0±0.11µs ? ?/sec 1.00 103.0±0.07µs ? ?/sec
arrow_array_reader/UInt64Array/dictionary encoded, optional, no NULLs 1.00 53.4±0.14µs ? ?/sec 1.00 53.6±0.13µs ? ?/sec
arrow_array_reader/UInt64Array/plain encoded, mandatory, no NULLs 1.00 16.3±0.02µs ? ?/sec 1.04 17.0±0.05µs ? ?/sec
arrow_array_reader/UInt64Array/plain encoded, optional, half NULLs 1.00 85.4±0.05µs ? ?/sec 1.00 85.1±0.09µs ? ?/sec
arrow_array_reader/UInt64Array/plain encoded, optional, no NULLs 1.02 20.4±0.03µs ? ?/sec 1.00 20.0±0.02µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed increasing value 1.00 52.2±0.43µs ? ?/sec 1.01 52.8±0.58µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed single value 1.00 43.8±0.27µs ? ?/sec 1.02 44.8±0.24µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed skip increasing value 1.00 32.7±0.16µs ? ?/sec 1.01 33.1±0.24µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed skip single value 1.00 28.1±0.21µs ? ?/sec 1.02 28.6±0.17µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed skip stepped increasing value 1.01 56.4±0.31µs ? ?/sec 1.00 56.1±0.04µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed skip, mandatory, no NULLs 1.00 74.8±0.05µs ? ?/sec 1.00 75.1±0.07µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed skip, optional, half NULLs 1.00 73.9±0.10µs ? ?/sec 1.01 74.8±0.09µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed skip, optional, no NULLs 1.00 77.1±0.06µs ? ?/sec 1.01 77.5±0.06µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed stepped increasing value 1.00 72.6±0.14µs ? ?/sec 1.00 72.4±0.13µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed, mandatory, no NULLs 1.00 96.0±0.09µs ? ?/sec 1.00 96.4±0.13µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed, optional, half NULLs 1.00 116.2±0.12µs ? ?/sec 1.01 117.5±0.21µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed, optional, no NULLs 1.00 100.0±0.08µs ? ?/sec 1.00 100.2±0.10µs ? ?/sec
arrow_array_reader/UInt8Array/byte_stream_split encoded, mandatory, no NULLs 1.00 20.7±0.03µs ? ?/sec 1.00 20.7±0.03µs ? ?/sec
arrow_array_reader/UInt8Array/byte_stream_split encoded, optional, half NULLs 1.00 76.8±0.13µs ? ?/sec 1.01 77.2±0.10µs ? ?/sec
arrow_array_reader/UInt8Array/byte_stream_split encoded, optional, no NULLs 1.00 24.4±0.03µs ? ?/sec 1.01 24.7±0.02µs ? ?/sec
arrow_array_reader/UInt8Array/dictionary encoded, mandatory, no NULLs 1.00 50.4±0.08µs ? ?/sec 1.01 50.8±0.03µs ? ?/sec
arrow_array_reader/UInt8Array/dictionary encoded, optional, half NULLs 1.00 94.3±0.10µs ? ?/sec 1.01 95.1±0.11µs ? ?/sec
arrow_array_reader/UInt8Array/dictionary encoded, optional, no NULLs 1.00 54.0±0.05µs ? ?/sec 1.02 55.1±0.06µs ? ?/sec
arrow_array_reader/UInt8Array/plain encoded, mandatory, no NULLs 1.00 13.4±0.02µs ? ?/sec 1.01 13.6±0.05µs ? ?/sec
arrow_array_reader/UInt8Array/plain encoded, optional, half NULLs 1.00 74.5±0.06µs ? ?/sec 1.00 74.6±0.20µs ? ?/sec
arrow_array_reader/UInt8Array/plain encoded, optional, no NULLs 1.00 17.4±0.02µs ? ?/sec 1.01 17.6±0.02µs ? ?/sec
arrow_array_reader/struct/Int32Array/plain encoded, mandatory struct, optional data, half NULLs 1.00 71.7±0.07µs ? ?/sec 1.00 71.5±0.10µs ? ?/sec
arrow_array_reader/struct/Int32Array/plain encoded, mandatory struct, optional data, no NULLs 1.02 14.1±0.03µs ? ?/sec 1.00 13.8±0.05µs ? ?/sec
arrow_array_reader/struct/Int32Array/plain encoded, optional struct, optional data, half NULLs 1.00 132.4±0.15µs ? ?/sec 1.02 135.3±0.19µs ? ?/sec
arrow_array_reader/struct/Int32Array/plain encoded, optional struct, optional data, no NULLs 1.00 65.8±0.04µs ? ?/sec 1.04 68.1±0.43µs ? ?/sec
```
</p>
</details>
<details><summary>Resource Usage</summary>
**base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 2920.6s |
| Peak memory | 4.2 GiB |
| Avg memory | 4.2 GiB |
| CPU user | 2916.3s |
| CPU sys | 1.5s |
| Peak spill | 0 B |
**branch**
| Metric | Value |
|--------|-------|
| Wall time | 2920.6s |
| Peak memory | 4.3 GiB |
| Avg memory | 4.2 GiB |
| CPU user | 2919.7s |
| CPU sys | 0.8s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: prevent panic in record reader when row group metadata overcounts num_rows [arrow-rs]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on PR #9993:
URL: https://github.com/apache/arrow-rs/pull/9993#issuecomment-4501812445
run benchmarks arrow_reader arrow_reader_clickbench
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: prevent panic in record reader when row group metadata overcounts num_rows [arrow-rs]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on PR #9993:
URL: https://github.com/apache/arrow-rs/pull/9993#issuecomment-4508428892
benchmarks look good to me. I'll try and give this a look shortly
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: prevent panic in record reader when row group metadata overcounts num_rows [arrow-rs]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #9993:
URL: https://github.com/apache/arrow-rs/pull/9993#issuecomment-4501838668
🤖 Arrow criterion benchmark running (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9993#issuecomment-4501812445)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c4501812445-240-pgk9g 6.12.68+ #1 SMP Wed Apr 1 02:23:28 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing fix-parquet-record-triplet-index-out-of-bounds (89ece440ab7a07c092b9402b1f7bceea132b4eea) to fd1c5b3 (merge-base) [diff](https://github.com/apache/arrow-rs/compare/fd1c5b391e169762a0981870c4e94baa3372d7a3..89ece440ab7a07c092b9402b1f7bceea132b4eea)
BENCH_NAME=arrow_reader_clickbench
BENCH_COMMAND=cargo bench --features=arrow,async,test_common,experimental,object_store --bench arrow_reader_clickbench
BENCH_FILTER=
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: prevent panic in record reader when row group metadata overcounts num_rows [arrow-rs]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on PR #9993:
URL: https://github.com/apache/arrow-rs/pull/9993#issuecomment-4501814358
Thank you @BoazC-MSFT
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: prevent panic in record reader when row group metadata overcounts num_rows [arrow-rs]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #9993:
URL: https://github.com/apache/arrow-rs/pull/9993#issuecomment-4501833682
🤖 Arrow criterion benchmark running (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9993#issuecomment-4501812445)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c4501812445-239-rvbmh 6.12.68+ #1 SMP Wed Apr 1 02:23:28 UTC 2026 aarch64 GNU/Linux`
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
Comparing fix-parquet-record-triplet-index-out-of-bounds (89ece440ab7a07c092b9402b1f7bceea132b4eea) to fd1c5b3 (merge-base) [diff](https://github.com/apache/arrow-rs/compare/fd1c5b391e169762a0981870c4e94baa3372d7a3..89ece440ab7a07c092b9402b1f7bceea132b4eea)
BENCH_NAME=arrow_reader
BENCH_COMMAND=cargo bench --features=arrow,async,test_common,experimental,object_store --bench arrow_reader
BENCH_FILTER=
Results will be posted here when complete
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: prevent panic in record reader when row group metadata overcounts num_rows [arrow-rs]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #9993:
URL: https://github.com/apache/arrow-rs/pull/9993#issuecomment-4502060080
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9993#issuecomment-4501812445)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
group fix-parquet-record-triplet-index-out-of-bounds main
----- ---------------------------------------------- ----
arrow_reader_clickbench/async/Q1 1.00 1087.9±5.17µs ? ?/sec 1.00 1086.4±6.04µs ? ?/sec
arrow_reader_clickbench/async/Q10 1.01 6.5±0.02ms ? ?/sec 1.00 6.4±0.03ms ? ?/sec
arrow_reader_clickbench/async/Q11 1.00 7.4±0.03ms ? ?/sec 1.00 7.4±0.04ms ? ?/sec
arrow_reader_clickbench/async/Q12 1.01 14.0±0.05ms ? ?/sec 1.00 13.8±0.04ms ? ?/sec
arrow_reader_clickbench/async/Q13 1.00 16.5±0.07ms ? ?/sec 1.00 16.4±0.07ms ? ?/sec
arrow_reader_clickbench/async/Q14 1.00 15.4±0.04ms ? ?/sec 1.00 15.3±0.07ms ? ?/sec
arrow_reader_clickbench/async/Q19 1.00 3.0±0.03ms ? ?/sec 1.00 3.0±0.02ms ? ?/sec
arrow_reader_clickbench/async/Q20 1.00 72.6±0.43ms ? ?/sec 1.28 92.6±0.50ms ? ?/sec
arrow_reader_clickbench/async/Q21 1.00 81.1±0.55ms ? ?/sec 1.18 95.3±13.14ms ? ?/sec
arrow_reader_clickbench/async/Q22 1.00 121.2±3.36ms ? ?/sec 1.11 134.4±8.79ms ? ?/sec
arrow_reader_clickbench/async/Q23 1.02 247.5±0.84ms ? ?/sec 1.00 242.9±2.78ms ? ?/sec
arrow_reader_clickbench/async/Q24 1.00 18.6±0.09ms ? ?/sec 1.00 18.6±0.07ms ? ?/sec
arrow_reader_clickbench/async/Q27 1.00 57.7±0.58ms ? ?/sec 1.00 57.9±0.21ms ? ?/sec
arrow_reader_clickbench/async/Q28 1.02 57.8±0.38ms ? ?/sec 1.00 56.5±0.23ms ? ?/sec
arrow_reader_clickbench/async/Q30 1.01 18.0±0.07ms ? ?/sec 1.00 17.9±0.05ms ? ?/sec
arrow_reader_clickbench/async/Q36 1.02 14.9±0.26ms ? ?/sec 1.00 14.6±0.10ms ? ?/sec
arrow_reader_clickbench/async/Q37 1.01 5.3±0.02ms ? ?/sec 1.00 5.3±0.01ms ? ?/sec
arrow_reader_clickbench/async/Q38 1.02 13.2±0.21ms ? ?/sec 1.00 12.9±0.08ms ? ?/sec
arrow_reader_clickbench/async/Q39 1.05 24.4±0.48ms ? ?/sec 1.00 23.3±0.16ms ? ?/sec
arrow_reader_clickbench/async/Q40 1.02 5.4±0.03ms ? ?/sec 1.00 5.3±0.02ms ? ?/sec
arrow_reader_clickbench/async/Q41 1.01 4.8±0.02ms ? ?/sec 1.00 4.7±0.02ms ? ?/sec
arrow_reader_clickbench/async/Q42 1.00 3.4±0.02ms ? ?/sec 1.00 3.4±0.01ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q1 1.01 1071.7±2.54µs ? ?/sec 1.00 1061.9±3.46µs ? ?/sec
arrow_reader_clickbench/async_object_store/Q10 1.00 6.3±0.02ms ? ?/sec 1.00 6.3±0.02ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q11 1.00 7.3±0.03ms ? ?/sec 1.00 7.3±0.03ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q12 1.01 13.8±0.06ms ? ?/sec 1.00 13.7±0.02ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q13 1.01 16.4±0.09ms ? ?/sec 1.00 16.2±0.06ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q14 1.01 15.3±0.04ms ? ?/sec 1.00 15.2±0.03ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q19 1.00 2.9±0.02ms ? ?/sec 1.00 2.9±0.02ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q20 1.00 71.5±0.63ms ? ?/sec 1.00 71.5±0.40ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q21 1.00 80.5±0.59ms ? ?/sec 1.00 80.1±0.36ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q22 1.01 98.4±0.64ms ? ?/sec 1.00 97.2±0.35ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q23 1.00 216.5±2.95ms ? ?/sec 1.05 227.0±9.47ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q24 1.01 18.4±0.07ms ? ?/sec 1.00 18.3±0.05ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q27 1.00 56.8±0.57ms ? ?/sec 1.00 56.6±0.47ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q28 1.01 56.4±0.54ms ? ?/sec 1.00 55.7±0.18ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q30 1.01 17.6±0.06ms ? ?/sec 1.00 17.4±0.05ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q36 1.03 14.2±0.24ms ? ?/sec 1.00 13.8±0.10ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q37 1.00 5.2±0.03ms ? ?/sec 1.00 5.2±0.04ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q38 1.03 12.6±0.21ms ? ?/sec 1.00 12.2±0.09ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q39 1.03 22.8±0.39ms ? ?/sec 1.00 22.2±0.17ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q40 1.02 5.2±0.02ms ? ?/sec 1.00 5.1±0.04ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q41 1.00 4.6±0.02ms ? ?/sec 1.00 4.6±0.02ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q42 1.00 3.3±0.02ms ? ?/sec 1.00 3.3±0.02ms ? ?/sec
arrow_reader_clickbench/sync/Q1 1.01 896.9±4.19µs ? ?/sec 1.00 886.0±1.60µs ? ?/sec
arrow_reader_clickbench/sync/Q10 1.00 5.0±0.01ms ? ?/sec 1.00 5.0±0.01ms ? ?/sec
arrow_reader_clickbench/sync/Q11 1.01 6.0±0.04ms ? ?/sec 1.00 5.9±0.02ms ? ?/sec
arrow_reader_clickbench/sync/Q12 1.00 21.0±0.03ms ? ?/sec 1.00 21.0±0.04ms ? ?/sec
arrow_reader_clickbench/sync/Q13 1.00 23.6±0.05ms ? ?/sec 1.00 23.5±0.05ms ? ?/sec
arrow_reader_clickbench/sync/Q14 1.00 22.3±0.04ms ? ?/sec 1.00 22.3±0.03ms ? ?/sec
arrow_reader_clickbench/sync/Q19 1.00 2.6±0.02ms ? ?/sec 1.00 2.6±0.02ms ? ?/sec
arrow_reader_clickbench/sync/Q20 1.00 122.2±0.37ms ? ?/sec 1.00 122.0±0.35ms ? ?/sec
arrow_reader_clickbench/sync/Q21 1.01 96.8±0.32ms ? ?/sec 1.00 96.0±0.27ms ? ?/sec
arrow_reader_clickbench/sync/Q22 1.00 142.0±0.36ms ? ?/sec 1.01 143.1±0.33ms ? ?/sec
arrow_reader_clickbench/sync/Q23 1.01 292.8±8.79ms ? ?/sec 1.00 291.2±9.87ms ? ?/sec
arrow_reader_clickbench/sync/Q24 1.00 25.8±0.08ms ? ?/sec 1.00 25.9±0.08ms ? ?/sec
arrow_reader_clickbench/sync/Q27 1.00 106.5±0.36ms ? ?/sec 1.00 106.3±0.38ms ? ?/sec
arrow_reader_clickbench/sync/Q28 1.02 103.9±0.42ms ? ?/sec 1.00 101.9±0.28ms ? ?/sec
arrow_reader_clickbench/sync/Q30 1.00 17.8±0.05ms ? ?/sec 1.00 17.8±0.04ms ? ?/sec
arrow_reader_clickbench/sync/Q36 1.00 21.6±0.05ms ? ?/sec 1.00 21.5±0.05ms ? ?/sec
arrow_reader_clickbench/sync/Q37 1.00 6.6±0.01ms ? ?/sec 1.00 6.7±0.01ms ? ?/sec
arrow_reader_clickbench/sync/Q38 1.00 11.1±0.02ms ? ?/sec 1.00 11.1±0.03ms ? ?/sec
arrow_reader_clickbench/sync/Q39 1.01 20.0±0.07ms ? ?/sec 1.00 19.9±0.06ms ? ?/sec
arrow_reader_clickbench/sync/Q40 1.01 4.9±0.01ms ? ?/sec 1.00 4.8±0.01ms ? ?/sec
arrow_reader_clickbench/sync/Q41 1.00 5.4±0.02ms ? ?/sec 1.00 5.4±0.02ms ? ?/sec
arrow_reader_clickbench/sync/Q42 1.01 4.2±0.03ms ? ?/sec 1.00 4.2±0.02ms ? ?/sec
```
</p>
</details>
<details><summary>Resource Usage</summary>
**base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 785.2s |
| Peak memory | 4.6 GiB |
| Avg memory | 4.5 GiB |
| CPU user | 712.5s |
| CPU sys | 71.9s |
| Peak spill | 0 B |
**branch**
| Metric | Value |
|--------|-------|
| Wall time | 775.2s |
| Peak memory | 4.8 GiB |
| Avg memory | 4.7 GiB |
| CPU user | 705.9s |
| CPU sys | 67.3s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: prevent panic in record reader when row group metadata overcounts num_rows [arrow-rs]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #9993:
URL: https://github.com/apache/arrow-rs/pull/9993#issuecomment-4502060983
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9993#issuecomment-4501812833)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
group fix-parquet-record-triplet-index-out-of-bounds main
----- ---------------------------------------------- ----
arrow_reader_clickbench/async/Q1 1.00 1098.1±3.06µs ? ?/sec 1.00 1098.3±12.24µs ? ?/sec
arrow_reader_clickbench/async/Q10 1.01 6.5±0.03ms ? ?/sec 1.00 6.4±0.04ms ? ?/sec
arrow_reader_clickbench/async/Q11 1.01 7.5±0.05ms ? ?/sec 1.00 7.4±0.03ms ? ?/sec
arrow_reader_clickbench/async/Q12 1.01 14.0±0.08ms ? ?/sec 1.00 13.9±0.04ms ? ?/sec
arrow_reader_clickbench/async/Q13 1.02 16.6±0.11ms ? ?/sec 1.00 16.3±0.05ms ? ?/sec
arrow_reader_clickbench/async/Q14 1.01 15.4±0.09ms ? ?/sec 1.00 15.3±0.03ms ? ?/sec
arrow_reader_clickbench/async/Q19 1.02 3.0±0.02ms ? ?/sec 1.00 3.0±0.02ms ? ?/sec
arrow_reader_clickbench/async/Q20 1.17 95.3±0.68ms ? ?/sec 1.00 81.2±0.30ms ? ?/sec
arrow_reader_clickbench/async/Q21 1.00 99.0±13.28ms ? ?/sec 1.04 103.3±0.55ms ? ?/sec
arrow_reader_clickbench/async/Q22 1.00 124.0±1.07ms ? ?/sec 1.09 135.2±6.46ms ? ?/sec
arrow_reader_clickbench/async/Q23 1.03 254.8±1.16ms ? ?/sec 1.00 246.5±4.82ms ? ?/sec
arrow_reader_clickbench/async/Q24 1.02 18.9±0.13ms ? ?/sec 1.00 18.6±0.09ms ? ?/sec
arrow_reader_clickbench/async/Q27 1.04 58.3±0.46ms ? ?/sec 1.00 56.1±0.16ms ? ?/sec
arrow_reader_clickbench/async/Q28 1.02 58.6±0.50ms ? ?/sec 1.00 57.6±0.35ms ? ?/sec
arrow_reader_clickbench/async/Q30 1.01 18.1±0.13ms ? ?/sec 1.00 17.9±0.07ms ? ?/sec
arrow_reader_clickbench/async/Q36 1.04 14.8±0.29ms ? ?/sec 1.00 14.1±0.14ms ? ?/sec
arrow_reader_clickbench/async/Q37 1.00 5.2±0.02ms ? ?/sec 1.01 5.3±0.02ms ? ?/sec
arrow_reader_clickbench/async/Q38 1.04 13.1±0.26ms ? ?/sec 1.00 12.6±0.10ms ? ?/sec
arrow_reader_clickbench/async/Q39 1.04 24.2±0.50ms ? ?/sec 1.00 23.3±0.31ms ? ?/sec
arrow_reader_clickbench/async/Q40 1.02 5.5±0.04ms ? ?/sec 1.00 5.4±0.03ms ? ?/sec
arrow_reader_clickbench/async/Q41 1.00 4.7±0.02ms ? ?/sec 1.00 4.7±0.02ms ? ?/sec
arrow_reader_clickbench/async/Q42 1.00 3.4±0.02ms ? ?/sec 1.01 3.4±0.02ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q1 1.00 1071.2±4.92µs ? ?/sec 1.00 1073.7±4.24µs ? ?/sec
arrow_reader_clickbench/async_object_store/Q10 1.01 6.3±0.05ms ? ?/sec 1.00 6.3±0.03ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q11 1.01 7.3±0.05ms ? ?/sec 1.00 7.2±0.04ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q12 1.01 13.9±0.06ms ? ?/sec 1.00 13.8±0.04ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q13 1.02 16.4±0.13ms ? ?/sec 1.00 16.2±0.06ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q14 1.01 15.3±0.07ms ? ?/sec 1.00 15.2±0.06ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q19 1.01 2.9±0.02ms ? ?/sec 1.00 2.9±0.02ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q20 1.02 71.7±0.65ms ? ?/sec 1.00 70.4±0.23ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q21 1.04 81.6±0.83ms ? ?/sec 1.00 78.8±0.17ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q22 1.04 100.1±0.77ms ? ?/sec 1.00 96.0±1.07ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q23 1.11 235.4±7.84ms ? ?/sec 1.00 211.3±0.54ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q24 1.01 18.6±0.16ms ? ?/sec 1.00 18.4±0.06ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q27 1.03 57.0±0.79ms ? ?/sec 1.00 55.4±0.19ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q28 1.01 57.1±0.63ms ? ?/sec 1.00 56.7±0.42ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q30 1.01 17.6±0.10ms ? ?/sec 1.00 17.5±0.04ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q36 1.04 14.2±0.23ms ? ?/sec 1.00 13.6±0.12ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q37 1.00 5.2±0.01ms ? ?/sec 1.00 5.2±0.01ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q38 1.05 12.6±0.14ms ? ?/sec 1.00 12.0±0.09ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q39 1.04 23.1±0.53ms ? ?/sec 1.00 22.3±0.36ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q40 1.00 5.2±0.05ms ? ?/sec 1.00 5.2±0.03ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q41 1.00 4.6±0.02ms ? ?/sec 1.00 4.6±0.04ms ? ?/sec
arrow_reader_clickbench/async_object_store/Q42 1.00 3.3±0.02ms ? ?/sec 1.00 3.3±0.01ms ? ?/sec
arrow_reader_clickbench/sync/Q1 1.00 893.9±4.40µs ? ?/sec 1.00 891.0±1.62µs ? ?/sec
arrow_reader_clickbench/sync/Q10 1.00 5.0±0.02ms ? ?/sec 1.00 5.0±0.07ms ? ?/sec
arrow_reader_clickbench/sync/Q11 1.00 6.0±0.02ms ? ?/sec 1.00 5.9±0.09ms ? ?/sec
arrow_reader_clickbench/sync/Q12 1.00 21.1±0.04ms ? ?/sec 1.00 21.1±0.07ms ? ?/sec
arrow_reader_clickbench/sync/Q13 1.00 23.7±0.11ms ? ?/sec 1.00 23.6±0.06ms ? ?/sec
arrow_reader_clickbench/sync/Q14 1.00 22.4±0.05ms ? ?/sec 1.00 22.4±0.04ms ? ?/sec
arrow_reader_clickbench/sync/Q19 1.03 2.7±0.03ms ? ?/sec 1.00 2.6±0.02ms ? ?/sec
arrow_reader_clickbench/sync/Q20 1.02 122.6±0.47ms ? ?/sec 1.00 119.6±0.30ms ? ?/sec
arrow_reader_clickbench/sync/Q21 1.03 97.6±0.49ms ? ?/sec 1.00 94.9±0.24ms ? ?/sec
arrow_reader_clickbench/sync/Q22 1.02 143.9±0.52ms ? ?/sec 1.00 140.6±0.41ms ? ?/sec
arrow_reader_clickbench/sync/Q23 1.02 302.1±10.78ms ? ?/sec 1.00 296.9±9.43ms ? ?/sec
arrow_reader_clickbench/sync/Q24 1.00 26.0±0.13ms ? ?/sec 1.00 26.0±0.10ms ? ?/sec
arrow_reader_clickbench/sync/Q27 1.03 108.2±0.70ms ? ?/sec 1.00 105.0±0.46ms ? ?/sec
arrow_reader_clickbench/sync/Q28 1.01 105.6±0.72ms ? ?/sec 1.00 104.4±0.57ms ? ?/sec
arrow_reader_clickbench/sync/Q30 1.00 17.9±0.06ms ? ?/sec 1.00 17.8±0.06ms ? ?/sec
arrow_reader_clickbench/sync/Q36 1.00 21.6±0.05ms ? ?/sec 1.01 21.8±0.05ms ? ?/sec
arrow_reader_clickbench/sync/Q37 1.00 6.7±0.01ms ? ?/sec 1.00 6.7±0.01ms ? ?/sec
arrow_reader_clickbench/sync/Q38 1.00 11.1±0.04ms ? ?/sec 1.00 11.2±0.04ms ? ?/sec
arrow_reader_clickbench/sync/Q39 1.00 20.2±0.13ms ? ?/sec 1.00 20.2±0.10ms ? ?/sec
arrow_reader_clickbench/sync/Q40 1.00 4.9±0.01ms ? ?/sec 1.00 4.9±0.01ms ? ?/sec
arrow_reader_clickbench/sync/Q41 1.00 5.4±0.02ms ? ?/sec 1.00 5.4±0.03ms ? ?/sec
arrow_reader_clickbench/sync/Q42 1.00 4.2±0.02ms ? ?/sec 1.00 4.2±0.02ms ? ?/sec
```
</p>
</details>
<details><summary>Resource Usage</summary>
**base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 785.2s |
| Peak memory | 4.6 GiB |
| Avg memory | 4.5 GiB |
| CPU user | 714.1s |
| CPU sys | 67.2s |
| Peak spill | 0 B |
**branch**
| Metric | Value |
|--------|-------|
| Wall time | 790.2s |
| Peak memory | 4.8 GiB |
| Avg memory | 4.6 GiB |
| CPU user | 705.0s |
| CPU sys | 80.7s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] fix: prevent panic in record reader when row group metadata overcounts num_rows [arrow-rs]
Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #9993:
URL: https://github.com/apache/arrow-rs/pull/9993#issuecomment-4502589994
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9993#issuecomment-4501812833)
**Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
<details><summary>CPU Details (lscpu)</summary>
```
Architecture: aarch64
CPU op-mode(s): 64-bit
Byte Order: Little Endian
CPU(s): 16
On-line CPU(s) list: 0-15
Vendor ID: ARM
Model name: Neoverse-V2
Model: 1
Thread(s) per core: 1
Core(s) per cluster: 16
Socket(s): -
Cluster(s): 1
Stepping: r0p1
BogoMIPS: 2000.00
Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache: 1 MiB (16 instances)
L1i cache: 1 MiB (16 instances)
L2 cache: 32 MiB (16 instances)
L3 cache: 80 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-15
Vulnerability Gather data sampling: Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1: Mitigation; __user pointer sanitization
Vulnerability Spectre v2: Mitigation; CSV2, BHB
Vulnerability Srbds: Not affected
Vulnerability Tsa: Not affected
Vulnerability Tsx async abort: Not affected
Vulnerability Vmscape: Not affected
```
</details>
<details><summary>Details</summary>
<p>
```
group fix-parquet-record-triplet-index-out-of-bounds main
----- ---------------------------------------------- ----
arrow_array_reader/BYTE_ARRAY/Decimal128Array/plain encoded, mandatory, no NULLs 1.00 834.4±10.15µs ? ?/sec 1.02 850.9±15.56µs ? ?/sec
arrow_array_reader/BYTE_ARRAY/Decimal128Array/plain encoded, optional, half NULLs 1.00 946.7±5.52µs ? ?/sec 1.01 952.1±7.80µs ? ?/sec
arrow_array_reader/BYTE_ARRAY/Decimal128Array/plain encoded, optional, no NULLs 1.00 839.5±9.41µs ? ?/sec 1.02 855.4±15.63µs ? ?/sec
arrow_array_reader/BinaryArray/dictionary encoded, mandatory, no NULLs 1.00 275.6±0.18µs ? ?/sec 1.00 275.2±0.13µs ? ?/sec
arrow_array_reader/BinaryArray/dictionary encoded, optional, half NULLs 1.00 386.2±0.58µs ? ?/sec 1.02 393.4±0.58µs ? ?/sec
arrow_array_reader/BinaryArray/dictionary encoded, optional, no NULLs 1.00 279.2±0.14µs ? ?/sec 1.04 290.2±0.44µs ? ?/sec
arrow_array_reader/BinaryArray/plain encoded, mandatory, no NULLs 1.00 409.4±6.62µs ? ?/sec 1.01 415.2±6.45µs ? ?/sec
arrow_array_reader/BinaryArray/plain encoded, optional, half NULLs 1.00 458.5±4.54µs ? ?/sec 1.02 467.7±4.16µs ? ?/sec
arrow_array_reader/BinaryArray/plain encoded, optional, no NULLs 1.00 415.9±6.37µs ? ?/sec 1.01 419.5±6.37µs ? ?/sec
arrow_array_reader/BinaryViewArray/dictionary encoded, mandatory, no NULLs 1.00 79.5±0.06µs ? ?/sec 1.00 79.5±0.08µs ? ?/sec
arrow_array_reader/BinaryViewArray/dictionary encoded, optional, half NULLs 1.00 108.0±0.10µs ? ?/sec 1.00 107.6±0.11µs ? ?/sec
arrow_array_reader/BinaryViewArray/dictionary encoded, optional, no NULLs 1.00 83.2±0.04µs ? ?/sec 1.00 83.3±0.07µs ? ?/sec
arrow_array_reader/BinaryViewArray/plain encoded, mandatory, no NULLs 1.00 146.0±0.47µs ? ?/sec 1.00 146.1±0.60µs ? ?/sec
arrow_array_reader/BinaryViewArray/plain encoded, mandatory, no NULLs, short string 1.00 141.0±0.55µs ? ?/sec 1.02 143.5±0.70µs ? ?/sec
arrow_array_reader/BinaryViewArray/plain encoded, optional, half NULLs 1.00 144.8±0.42µs ? ?/sec 1.00 144.2±0.44µs ? ?/sec
arrow_array_reader/BinaryViewArray/plain encoded, optional, no NULLs 1.00 151.4±0.71µs ? ?/sec 1.01 152.4±0.60µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Decimal128Array/byte_stream_split encoded, mandatory, no NULLs 1.00 964.6±2.81µs ? ?/sec 1.00 965.9±0.65µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Decimal128Array/byte_stream_split encoded, optional, half NULLs 1.00 669.1±0.57µs ? ?/sec 1.01 673.9±0.36µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Decimal128Array/byte_stream_split encoded, optional, no NULLs 1.00 969.1±2.89µs ? ?/sec 1.00 969.7±0.63µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Decimal128Array/plain encoded, mandatory, no NULLs 1.00 188.6±0.22µs ? ?/sec 1.00 188.5±0.21µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Decimal128Array/plain encoded, optional, half NULLs 1.00 291.9±0.30µs ? ?/sec 1.01 296.2±0.24µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Decimal128Array/plain encoded, optional, no NULLs 1.00 193.0±0.27µs ? ?/sec 1.00 193.7±0.19µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Float16Array/byte_stream_split encoded, mandatory, no NULLs 1.00 118.9±0.15µs ? ?/sec 1.07 127.5±0.35µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Float16Array/byte_stream_split encoded, optional, half NULLs 1.00 178.7±2.09µs ? ?/sec 1.04 185.5±2.80µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Float16Array/byte_stream_split encoded, optional, no NULLs 1.00 122.6±0.38µs ? ?/sec 1.09 133.7±0.20µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Float16Array/plain encoded, mandatory, no NULLs 1.00 61.1±1.02µs ? ?/sec 1.00 61.2±0.05µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Float16Array/plain encoded, optional, half NULLs 1.00 147.0±0.08µs ? ?/sec 1.00 147.6±0.11µs ? ?/sec
arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Float16Array/plain encoded, optional, no NULLs 1.00 63.6±0.07µs ? ?/sec 1.00 63.8±0.04µs ? ?/sec
arrow_array_reader/FixedLenByteArray(16)/byte_stream_split encoded, mandatory, no NULLs 1.00 800.5±0.50µs ? ?/sec 1.00 803.2±0.45µs ? ?/sec
arrow_array_reader/FixedLenByteArray(16)/byte_stream_split encoded, optional, half NULLs 1.00 509.6±0.36µs ? ?/sec 1.01 513.4±0.32µs ? ?/sec
arrow_array_reader/FixedLenByteArray(16)/byte_stream_split encoded, optional, no NULLs 1.00 804.2±1.06µs ? ?/sec 1.00 806.2±0.57µs ? ?/sec
arrow_array_reader/FixedLenByteArray(16)/plain encoded, mandatory, no NULLs 1.01 23.4±0.04µs ? ?/sec 1.00 23.1±0.18µs ? ?/sec
arrow_array_reader/FixedLenByteArray(16)/plain encoded, optional, half NULLs 1.00 129.4±0.12µs ? ?/sec 1.03 132.6±0.17µs ? ?/sec
arrow_array_reader/FixedLenByteArray(16)/plain encoded, optional, no NULLs 1.00 26.4±0.05µs ? ?/sec 1.04 27.3±0.04µs ? ?/sec
arrow_array_reader/FixedLenByteArray(2)/byte_stream_split encoded, mandatory, no NULLs 1.00 73.7±0.82µs ? ?/sec 1.02 75.5±0.23µs ? ?/sec
arrow_array_reader/FixedLenByteArray(2)/byte_stream_split encoded, optional, half NULLs 1.00 123.4±0.13µs ? ?/sec 1.05 129.0±0.23µs ? ?/sec
arrow_array_reader/FixedLenByteArray(2)/byte_stream_split encoded, optional, no NULLs 1.00 69.9±0.14µs ? ?/sec 1.12 78.6±0.23µs ? ?/sec
arrow_array_reader/FixedLenByteArray(2)/plain encoded, mandatory, no NULLs 1.00 5.3±0.01µs ? ?/sec 1.00 5.3±0.01µs ? ?/sec
arrow_array_reader/FixedLenByteArray(2)/plain encoded, optional, half NULLs 1.00 92.8±0.06µs ? ?/sec 1.00 93.0±0.13µs ? ?/sec
arrow_array_reader/FixedLenByteArray(2)/plain encoded, optional, no NULLs 1.00 8.8±0.02µs ? ?/sec 1.00 8.8±0.01µs ? ?/sec
arrow_array_reader/FixedLenByteArray(4)/byte_stream_split encoded, mandatory, no NULLs 1.00 130.5±0.45µs ? ?/sec 1.13 148.0±0.39µs ? ?/sec
arrow_array_reader/FixedLenByteArray(4)/byte_stream_split encoded, optional, half NULLs 1.00 188.9±0.44µs ? ?/sec 1.06 199.3±0.24µs ? ?/sec
arrow_array_reader/FixedLenByteArray(4)/byte_stream_split encoded, optional, no NULLs 1.00 135.4±0.32µs ? ?/sec 1.12 151.2±0.63µs ? ?/sec
arrow_array_reader/FixedLenByteArray(4)/plain encoded, mandatory, no NULLs 1.03 7.6±0.02µs ? ?/sec 1.00 7.3±0.02µs ? ?/sec
arrow_array_reader/FixedLenByteArray(4)/plain encoded, optional, half NULLs 1.00 127.2±0.09µs ? ?/sec 1.01 128.3±0.11µs ? ?/sec
arrow_array_reader/FixedLenByteArray(4)/plain encoded, optional, no NULLs 1.02 11.1±0.02µs ? ?/sec 1.00 10.9±0.01µs ? ?/sec
arrow_array_reader/FixedLenByteArray(8)/byte_stream_split encoded, mandatory, no NULLs 1.00 265.0±0.88µs ? ?/sec 1.15 304.2±1.19µs ? ?/sec
arrow_array_reader/FixedLenByteArray(8)/byte_stream_split encoded, optional, half NULLs 1.00 248.2±0.31µs ? ?/sec 1.08 268.8±0.44µs ? ?/sec
arrow_array_reader/FixedLenByteArray(8)/byte_stream_split encoded, optional, no NULLs 1.00 269.0±0.64µs ? ?/sec 1.14 306.9±0.80µs ? ?/sec
arrow_array_reader/FixedLenByteArray(8)/plain encoded, mandatory, no NULLs 1.00 12.1±0.03µs ? ?/sec 1.01 12.3±0.03µs ? ?/sec
arrow_array_reader/FixedLenByteArray(8)/plain encoded, optional, half NULLs 1.00 122.4±0.11µs ? ?/sec 1.02 125.0±0.14µs ? ?/sec
arrow_array_reader/FixedLenByteArray(8)/plain encoded, optional, no NULLs 1.00 16.1±0.06µs ? ?/sec 1.01 16.2±0.03µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed increasing value 1.00 85.6±0.37µs ? ?/sec 1.02 87.3±0.29µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed single value 1.00 77.4±0.54µs ? ?/sec 1.02 78.7±0.13µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed skip increasing value 1.00 49.7±0.18µs ? ?/sec 1.01 50.4±0.11µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed skip single value 1.00 45.3±0.28µs ? ?/sec 1.01 45.9±0.10µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed skip stepped increasing value 1.00 73.7±0.06µs ? ?/sec 1.00 73.4±0.06µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed skip, mandatory, no NULLs 1.00 88.0±0.16µs ? ?/sec 1.00 88.0±0.11µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed skip, optional, half NULLs 1.00 89.1±0.10µs ? ?/sec 1.00 89.2±0.11µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed skip, optional, no NULLs 1.00 90.0±0.15µs ? ?/sec 1.00 90.0±0.10µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed stepped increasing value 1.02 107.7±0.84µs ? ?/sec 1.00 106.0±0.11µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed, mandatory, no NULLs 1.00 124.1±0.19µs ? ?/sec 1.00 124.4±0.21µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed, optional, half NULLs 1.00 146.9±0.22µs ? ?/sec 1.01 147.7±0.23µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/binary packed, optional, no NULLs 1.00 128.1±0.34µs ? ?/sec 1.00 128.3±0.22µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/byte_stream_split encoded, mandatory, no NULLs 1.00 54.0±0.12µs ? ?/sec 1.00 54.1±0.04µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/byte_stream_split encoded, optional, half NULLs 1.00 110.1±0.11µs ? ?/sec 1.01 110.9±0.13µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/byte_stream_split encoded, optional, no NULLs 1.00 57.9±0.07µs ? ?/sec 1.00 57.6±0.04µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/dictionary encoded, mandatory, no NULLs 1.00 84.4±0.05µs ? ?/sec 1.00 84.2±0.07µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/dictionary encoded, optional, half NULLs 1.00 127.4±0.14µs ? ?/sec 1.01 128.2±0.12µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/dictionary encoded, optional, no NULLs 1.00 87.7±0.11µs ? ?/sec 1.00 88.0±0.05µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/plain encoded, mandatory, no NULLs 1.02 48.5±0.03µs ? ?/sec 1.00 47.5±0.09µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/plain encoded, optional, half NULLs 1.00 107.8±0.16µs ? ?/sec 1.00 108.1±0.35µs ? ?/sec
arrow_array_reader/INT32/Decimal128Array/plain encoded, optional, no NULLs 1.00 50.6±0.07µs ? ?/sec 1.00 50.8±0.05µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed increasing value 1.00 77.5±0.12µs ? ?/sec 1.00 77.7±0.14µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed single value 1.00 74.2±0.12µs ? ?/sec 1.00 74.3±0.10µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed skip increasing value 1.00 43.4±0.05µs ? ?/sec 1.00 43.2±0.07µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed skip single value 1.00 41.6±0.05µs ? ?/sec 1.00 41.6±0.05µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed skip stepped increasing value 1.00 67.0±0.07µs ? ?/sec 1.00 66.9±0.07µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed skip, mandatory, no NULLs 1.00 79.2±0.05µs ? ?/sec 1.00 79.2±0.06µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed skip, optional, half NULLs 1.00 90.2±0.10µs ? ?/sec 1.00 90.1±0.06µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed skip, optional, no NULLs 1.00 81.4±0.06µs ? ?/sec 1.00 81.3±0.05µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed stepped increasing value 1.00 99.2±0.19µs ? ?/sec 1.00 99.2±0.47µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed, mandatory, no NULLs 1.00 114.0±0.12µs ? ?/sec 1.00 114.2±0.13µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed, optional, half NULLs 1.00 152.6±0.10µs ? ?/sec 1.00 152.2±0.17µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/binary packed, optional, no NULLs 1.00 118.1±0.39µs ? ?/sec 1.00 117.9±0.13µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/byte_stream_split encoded, mandatory, no NULLs 1.00 83.1±0.08µs ? ?/sec 1.00 82.8±0.08µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/byte_stream_split encoded, optional, half NULLs 1.00 136.3±0.13µs ? ?/sec 1.00 136.8±0.11µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/byte_stream_split encoded, optional, no NULLs 1.00 87.8±0.09µs ? ?/sec 1.00 87.6±0.11µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/dictionary encoded, mandatory, no NULLs 1.00 86.4±0.09µs ? ?/sec 1.00 86.8±0.06µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/dictionary encoded, optional, half NULLs 1.00 139.7±0.14µs ? ?/sec 1.00 139.8±0.19µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/dictionary encoded, optional, no NULLs 1.00 90.3±0.06µs ? ?/sec 1.00 90.5±0.09µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/plain encoded, mandatory, no NULLs 1.00 54.5±0.06µs ? ?/sec 1.01 55.1±0.04µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/plain encoded, optional, half NULLs 1.01 122.1±0.11µs ? ?/sec 1.00 121.3±0.11µs ? ?/sec
arrow_array_reader/INT64/Decimal128Array/plain encoded, optional, no NULLs 1.00 58.1±0.06µs ? ?/sec 1.00 58.1±0.30µs ? ?/sec
arrow_array_reader/Int16Array/binary packed increasing value 1.00 53.2±0.58µs ? ?/sec 1.00 53.3±0.57µs ? ?/sec
arrow_array_reader/Int16Array/binary packed single value 1.00 44.9±0.24µs ? ?/sec 1.00 45.1±0.24µs ? ?/sec
arrow_array_reader/Int16Array/binary packed skip increasing value 1.00 33.3±0.17µs ? ?/sec 1.00 33.3±0.18µs ? ?/sec
arrow_array_reader/Int16Array/binary packed skip single value 1.00 28.7±0.14µs ? ?/sec 1.00 28.7±0.14µs ? ?/sec
arrow_array_reader/Int16Array/binary packed skip stepped increasing value 1.00 56.3±0.04µs ? ?/sec 1.00 56.2±0.08µs ? ?/sec
arrow_array_reader/Int16Array/binary packed skip, mandatory, no NULLs 1.00 71.5±0.07µs ? ?/sec 1.00 71.6±0.07µs ? ?/sec
arrow_array_reader/Int16Array/binary packed skip, optional, half NULLs 1.00 72.6±0.07µs ? ?/sec 1.00 72.5±0.09µs ? ?/sec
arrow_array_reader/Int16Array/binary packed skip, optional, no NULLs 1.00 73.5±0.08µs ? ?/sec 1.00 73.7±0.08µs ? ?/sec
arrow_array_reader/Int16Array/binary packed stepped increasing value 1.00 72.7±0.11µs ? ?/sec 1.00 72.8±0.12µs ? ?/sec
arrow_array_reader/Int16Array/binary packed, mandatory, no NULLs 1.00 91.6±0.10µs ? ?/sec 1.00 91.7±0.12µs ? ?/sec
arrow_array_reader/Int16Array/binary packed, optional, half NULLs 1.00 113.6±0.13µs ? ?/sec 1.00 114.0±0.10µs ? ?/sec
arrow_array_reader/Int16Array/binary packed, optional, no NULLs 1.00 95.4±0.17µs ? ?/sec 1.00 95.6±0.16µs ? ?/sec
arrow_array_reader/Int16Array/byte_stream_split encoded, mandatory, no NULLs 1.00 20.9±0.02µs ? ?/sec 1.01 21.0±0.04µs ? ?/sec
arrow_array_reader/Int16Array/byte_stream_split encoded, optional, half NULLs 1.00 76.8±0.08µs ? ?/sec 1.00 77.2±0.08µs ? ?/sec
arrow_array_reader/Int16Array/byte_stream_split encoded, optional, no NULLs 1.00 24.7±0.03µs ? ?/sec 1.00 24.7±0.03µs ? ?/sec
arrow_array_reader/Int16Array/dictionary encoded, mandatory, no NULLs 1.00 51.0±0.03µs ? ?/sec 1.00 51.0±0.03µs ? ?/sec
arrow_array_reader/Int16Array/dictionary encoded, optional, half NULLs 1.00 95.2±0.17µs ? ?/sec 1.01 96.0±0.16µs ? ?/sec
arrow_array_reader/Int16Array/dictionary encoded, optional, no NULLs 1.00 54.5±0.13µs ? ?/sec 1.02 55.4±0.04µs ? ?/sec
arrow_array_reader/Int16Array/plain encoded, mandatory, no NULLs 1.00 13.8±0.03µs ? ?/sec 1.01 14.0±0.04µs ? ?/sec
arrow_array_reader/Int16Array/plain encoded, optional, half NULLs 1.00 74.8±0.08µs ? ?/sec 1.00 75.0±0.09µs ? ?/sec
arrow_array_reader/Int16Array/plain encoded, optional, no NULLs 1.02 17.9±0.02µs ? ?/sec 1.00 17.6±0.03µs ? ?/sec
arrow_array_reader/Int32Array/binary packed increasing value 1.00 48.6±0.34µs ? ?/sec 1.02 49.7±0.54µs ? ?/sec
arrow_array_reader/Int32Array/binary packed single value 1.00 40.7±0.30µs ? ?/sec 1.02 41.5±0.22µs ? ?/sec
arrow_array_reader/Int32Array/binary packed skip increasing value 1.00 30.8±0.15µs ? ?/sec 1.02 31.4±0.15µs ? ?/sec
arrow_array_reader/Int32Array/binary packed skip single value 1.00 26.5±0.18µs ? ?/sec 1.01 26.8±0.17µs ? ?/sec
arrow_array_reader/Int32Array/binary packed skip stepped increasing value 1.00 54.4±0.06µs ? ?/sec 1.00 54.5±0.05µs ? ?/sec
arrow_array_reader/Int32Array/binary packed skip, mandatory, no NULLs 1.00 68.9±0.21µs ? ?/sec 1.01 69.3±0.12µs ? ?/sec
arrow_array_reader/Int32Array/binary packed skip, optional, half NULLs 1.00 71.1±0.11µs ? ?/sec 1.00 71.0±0.09µs ? ?/sec
arrow_array_reader/Int32Array/binary packed skip, optional, no NULLs 1.00 71.2±0.21µs ? ?/sec 1.01 71.8±0.12µs ? ?/sec
arrow_array_reader/Int32Array/binary packed stepped increasing value 1.00 69.1±0.09µs ? ?/sec 1.00 69.1±0.09µs ? ?/sec
arrow_array_reader/Int32Array/binary packed, mandatory, no NULLs 1.00 87.4±0.42µs ? ?/sec 1.00 87.5±0.18µs ? ?/sec
arrow_array_reader/Int32Array/binary packed, optional, half NULLs 1.00 109.5±0.17µs ? ?/sec 1.01 111.0±0.14µs ? ?/sec
arrow_array_reader/Int32Array/binary packed, optional, no NULLs 1.00 91.6±0.49µs ? ?/sec 1.00 91.7±0.21µs ? ?/sec
arrow_array_reader/Int32Array/byte_stream_split encoded, mandatory, no NULLs 1.00 17.4±0.01µs ? ?/sec 1.00 17.4±0.01µs ? ?/sec
arrow_array_reader/Int32Array/byte_stream_split encoded, optional, half NULLs 1.00 74.6±0.09µs ? ?/sec 1.01 75.1±0.09µs ? ?/sec
arrow_array_reader/Int32Array/byte_stream_split encoded, optional, no NULLs 1.00 21.0±0.01µs ? ?/sec 1.00 21.0±0.03µs ? ?/sec
arrow_array_reader/Int32Array/dictionary encoded, mandatory, no NULLs 1.00 47.3±0.03µs ? ?/sec 1.01 47.7±0.02µs ? ?/sec
arrow_array_reader/Int32Array/dictionary encoded, optional, half NULLs 1.00 91.7±0.12µs ? ?/sec 1.00 91.9±0.08µs ? ?/sec
arrow_array_reader/Int32Array/dictionary encoded, optional, no NULLs 1.00 50.8±0.04µs ? ?/sec 1.01 51.5±0.03µs ? ?/sec
arrow_array_reader/Int32Array/plain encoded, mandatory, no NULLs 1.00 9.8±0.02µs ? ?/sec 1.01 9.9±0.09µs ? ?/sec
arrow_array_reader/Int32Array/plain encoded, optional, half NULLs 1.00 71.6±0.09µs ? ?/sec 1.01 72.0±0.14µs ? ?/sec
arrow_array_reader/Int32Array/plain encoded, optional, no NULLs 1.01 13.8±0.03µs ? ?/sec 1.00 13.7±0.06µs ? ?/sec
arrow_array_reader/Int64Array/binary packed increasing value 1.00 40.5±0.10µs ? ?/sec 1.01 40.7±0.11µs ? ?/sec
arrow_array_reader/Int64Array/binary packed single value 1.00 37.8±0.12µs ? ?/sec 1.00 37.8±0.11µs ? ?/sec
arrow_array_reader/Int64Array/binary packed skip increasing value 1.00 24.2±0.04µs ? ?/sec 1.00 24.3±0.06µs ? ?/sec
arrow_array_reader/Int64Array/binary packed skip single value 1.00 22.7±0.04µs ? ?/sec 1.01 22.8±0.03µs ? ?/sec
arrow_array_reader/Int64Array/binary packed skip stepped increasing value 1.00 48.0±0.03µs ? ?/sec 1.00 48.0±0.14µs ? ?/sec
arrow_array_reader/Int64Array/binary packed skip, mandatory, no NULLs 1.01 60.8±0.05µs ? ?/sec 1.00 60.4±0.05µs ? ?/sec
arrow_array_reader/Int64Array/binary packed skip, optional, half NULLs 1.00 71.5±0.05µs ? ?/sec 1.00 71.5±0.05µs ? ?/sec
arrow_array_reader/Int64Array/binary packed skip, optional, no NULLs 1.00 62.4±0.06µs ? ?/sec 1.00 62.4±0.04µs ? ?/sec
arrow_array_reader/Int64Array/binary packed stepped increasing value 1.00 61.8±0.10µs ? ?/sec 1.00 61.9±0.12µs ? ?/sec
arrow_array_reader/Int64Array/binary packed, mandatory, no NULLs 1.00 77.2±0.24µs ? ?/sec 1.00 77.4±0.26µs ? ?/sec
arrow_array_reader/Int64Array/binary packed, optional, half NULLs 1.00 115.4±0.13µs ? ?/sec 1.00 115.9±0.13µs ? ?/sec
arrow_array_reader/Int64Array/binary packed, optional, no NULLs 1.00 81.2±0.14µs ? ?/sec 1.01 81.8±0.13µs ? ?/sec
arrow_array_reader/Int64Array/byte_stream_split encoded, mandatory, no NULLs 1.00 45.6±0.03µs ? ?/sec 1.00 45.7±0.03µs ? ?/sec
arrow_array_reader/Int64Array/byte_stream_split encoded, optional, half NULLs 1.00 99.4±0.13µs ? ?/sec 1.00 99.3±0.20µs ? ?/sec
arrow_array_reader/Int64Array/byte_stream_split encoded, optional, no NULLs 1.00 49.6±0.03µs ? ?/sec 1.01 50.0±0.04µs ? ?/sec
arrow_array_reader/Int64Array/dictionary encoded, mandatory, no NULLs 1.00 49.6±0.03µs ? ?/sec 1.01 50.0±0.04µs ? ?/sec
arrow_array_reader/Int64Array/dictionary encoded, optional, half NULLs 1.00 102.1±0.07µs ? ?/sec 1.00 102.3±0.17µs ? ?/sec
arrow_array_reader/Int64Array/dictionary encoded, optional, no NULLs 1.00 53.0±0.12µs ? ?/sec 1.01 53.6±0.10µs ? ?/sec
arrow_array_reader/Int64Array/plain encoded, mandatory, no NULLs 1.01 16.4±0.02µs ? ?/sec 1.00 16.3±0.02µs ? ?/sec
arrow_array_reader/Int64Array/plain encoded, optional, half NULLs 1.00 85.2±0.08µs ? ?/sec 1.00 85.3±0.04µs ? ?/sec
arrow_array_reader/Int64Array/plain encoded, optional, no NULLs 1.02 21.0±0.03µs ? ?/sec 1.00 20.6±0.03µs ? ?/sec
arrow_array_reader/Int8Array/binary packed increasing value 1.00 53.0±0.64µs ? ?/sec 1.00 53.0±0.41µs ? ?/sec
arrow_array_reader/Int8Array/binary packed single value 1.00 44.5±0.30µs ? ?/sec 1.01 44.8±0.13µs ? ?/sec
arrow_array_reader/Int8Array/binary packed skip increasing value 1.00 33.2±0.24µs ? ?/sec 1.00 33.2±0.13µs ? ?/sec
arrow_array_reader/Int8Array/binary packed skip single value 1.00 28.4±0.16µs ? ?/sec 1.00 28.4±0.12µs ? ?/sec
arrow_array_reader/Int8Array/binary packed skip stepped increasing value 1.00 56.1±0.06µs ? ?/sec 1.00 56.1±0.08µs ? ?/sec
arrow_array_reader/Int8Array/binary packed skip, mandatory, no NULLs 1.00 71.5±0.05µs ? ?/sec 1.00 71.7±0.08µs ? ?/sec
arrow_array_reader/Int8Array/binary packed skip, optional, half NULLs 1.00 72.4±0.06µs ? ?/sec 1.01 73.3±0.08µs ? ?/sec
arrow_array_reader/Int8Array/binary packed skip, optional, no NULLs 1.00 73.6±0.05µs ? ?/sec 1.01 74.0±0.05µs ? ?/sec
arrow_array_reader/Int8Array/binary packed stepped increasing value 1.00 72.4±0.11µs ? ?/sec 1.00 72.4±0.12µs ? ?/sec
arrow_array_reader/Int8Array/binary packed, mandatory, no NULLs 1.00 91.7±0.08µs ? ?/sec 1.00 92.0±0.11µs ? ?/sec
arrow_array_reader/Int8Array/binary packed, optional, half NULLs 1.00 112.8±0.10µs ? ?/sec 1.01 113.8±0.12µs ? ?/sec
arrow_array_reader/Int8Array/binary packed, optional, no NULLs 1.00 95.4±0.05µs ? ?/sec 1.00 95.8±0.08µs ? ?/sec
arrow_array_reader/Int8Array/byte_stream_split encoded, mandatory, no NULLs 1.00 20.9±0.03µs ? ?/sec 1.00 20.8±0.06µs ? ?/sec
arrow_array_reader/Int8Array/byte_stream_split encoded, optional, half NULLs 1.00 76.7±0.09µs ? ?/sec 1.01 77.8±0.11µs ? ?/sec
arrow_array_reader/Int8Array/byte_stream_split encoded, optional, no NULLs 1.00 24.5±0.03µs ? ?/sec 1.00 24.5±0.08µs ? ?/sec
arrow_array_reader/Int8Array/dictionary encoded, mandatory, no NULLs 1.00 50.5±0.03µs ? ?/sec 1.01 51.1±0.06µs ? ?/sec
arrow_array_reader/Int8Array/dictionary encoded, optional, half NULLs 1.00 95.2±0.12µs ? ?/sec 1.01 96.6±0.14µs ? ?/sec
arrow_array_reader/Int8Array/dictionary encoded, optional, no NULLs 1.00 54.4±0.05µs ? ?/sec 1.01 54.9±0.06µs ? ?/sec
arrow_array_reader/Int8Array/plain encoded, mandatory, no NULLs 1.00 13.7±0.02µs ? ?/sec 1.00 13.6±0.05µs ? ?/sec
arrow_array_reader/Int8Array/plain encoded, optional, half NULLs 1.00 73.7±0.08µs ? ?/sec 1.01 74.5±0.10µs ? ?/sec
arrow_array_reader/Int8Array/plain encoded, optional, no NULLs 1.00 17.2±0.04µs ? ?/sec 1.03 17.7±0.03µs ? ?/sec
arrow_array_reader/ListArray/Fixed32List/90pct NULLs 1.00 1003.3±8.16µs ? ?/sec 1.01 1017.8±8.74µs ? ?/sec
arrow_array_reader/ListArray/Fixed32List/99pct NULLs 1.00 456.1±12.36µs ? ?/sec 1.01 462.0±12.72µs ? ?/sec
arrow_array_reader/ListArray/Fixed32List/half NULLs 1.00 2.6±0.01ms ? ?/sec 1.01 2.7±0.02ms ? ?/sec
arrow_array_reader/ListArray/Fixed32List/no NULLs 1.00 4.2±0.03ms ? ?/sec 1.03 4.3±0.04ms ? ?/sec
arrow_array_reader/ListArray/Int32List/90pct NULLs 1.00 917.4±5.50µs ? ?/sec 1.02 931.9±5.58µs ? ?/sec
arrow_array_reader/ListArray/Int32List/99pct NULLs 1.00 408.7±11.72µs ? ?/sec 1.02 415.7±11.64µs ? ?/sec
arrow_array_reader/ListArray/Int32List/half NULLs 1.00 2.1±0.01ms ? ?/sec 1.01 2.1±0.01ms ? ?/sec
arrow_array_reader/ListArray/Int32List/no NULLs 1.00 2.9±0.01ms ? ?/sec 1.01 2.9±0.02ms ? ?/sec
arrow_array_reader/ListArray/StringList/90pct NULLs 1.00 1088.0±6.06µs ? ?/sec 1.01 1096.7±6.51µs ? ?/sec
arrow_array_reader/ListArray/StringList/99pct NULLs 1.00 424.8±12.61µs ? ?/sec 1.01 429.4±12.75µs ? ?/sec
arrow_array_reader/ListArray/StringList/half NULLs 1.00 3.9±0.01ms ? ?/sec 1.00 3.9±0.01ms ? ?/sec
arrow_array_reader/ListArray/StringList/no NULLs 1.00 7.1±0.04ms ? ?/sec 1.01 7.1±0.05ms ? ?/sec
arrow_array_reader/StringArray/const delta byte array encoded, mandatory, no NULLs 1.00 521.7±2.13µs ? ?/sec 1.02 530.6±3.39µs ? ?/sec
arrow_array_reader/StringArray/const delta length byte array encoded, mandatory, no NULLs 1.00 208.7±0.53µs ? ?/sec 1.04 216.9±2.62µs ? ?/sec
arrow_array_reader/StringArray/const prefix delta byte array encoded, mandatory, no NULLs 1.00 761.0±34.14µs ? ?/sec 1.01 768.4±35.98µs ? ?/sec
arrow_array_reader/StringArray/dictionary encoded, mandatory, no NULLs 1.00 275.5±0.20µs ? ?/sec 1.00 275.6±0.13µs ? ?/sec
arrow_array_reader/StringArray/dictionary encoded, optional, half NULLs 1.00 384.9±0.75µs ? ?/sec 1.00 385.4±0.59µs ? ?/sec
arrow_array_reader/StringArray/dictionary encoded, optional, no NULLs 1.00 279.4±0.28µs ? ?/sec 1.00 279.4±0.15µs ? ?/sec
arrow_array_reader/StringArray/plain encoded, mandatory, no NULLs 1.01 458.2±5.91µs ? ?/sec 1.00 455.4±5.90µs ? ?/sec
arrow_array_reader/StringArray/plain encoded, optional, half NULLs 1.01 492.0±4.56µs ? ?/sec 1.00 487.5±4.17µs ? ?/sec
arrow_array_reader/StringArray/plain encoded, optional, no NULLs 1.01 463.3±6.73µs ? ?/sec 1.00 460.5±5.49µs ? ?/sec
arrow_array_reader/StringDictionary/dictionary encoded, mandatory, no NULLs 1.00 246.2±0.73µs ? ?/sec 1.01 247.5±0.59µs ? ?/sec
arrow_array_reader/StringDictionary/dictionary encoded, optional, half NULLs 1.00 272.8±1.43µs ? ?/sec 1.01 275.2±1.22µs ? ?/sec
arrow_array_reader/StringDictionary/dictionary encoded, optional, no NULLs 1.00 250.8±1.07µs ? ?/sec 1.00 251.2±0.63µs ? ?/sec
arrow_array_reader/StringViewArray/dictionary encoded, mandatory, no NULLs 1.00 79.4±0.06µs ? ?/sec 1.01 79.8±0.05µs ? ?/sec
arrow_array_reader/StringViewArray/dictionary encoded, optional, half NULLs 1.01 108.3±0.11µs ? ?/sec 1.00 107.6±0.06µs ? ?/sec
arrow_array_reader/StringViewArray/dictionary encoded, optional, no NULLs 1.00 83.5±0.05µs ? ?/sec 1.00 83.7±0.17µs ? ?/sec
arrow_array_reader/StringViewArray/plain encoded, mandatory, no NULLs 1.00 219.2±0.39µs ? ?/sec 1.01 220.8±0.41µs ? ?/sec
arrow_array_reader/StringViewArray/plain encoded, optional, half NULLs 1.00 181.7±0.37µs ? ?/sec 1.02 185.1±1.64µs ? ?/sec
arrow_array_reader/StringViewArray/plain encoded, optional, no NULLs 1.00 225.8±0.36µs ? ?/sec 1.01 228.9±0.82µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed increasing value 1.02 53.3±0.54µs ? ?/sec 1.00 52.1±0.34µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed single value 1.03 45.1±0.24µs ? ?/sec 1.00 44.0±0.46µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed skip increasing value 1.02 33.2±0.16µs ? ?/sec 1.00 32.6±0.17µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed skip single value 1.02 28.6±0.11µs ? ?/sec 1.00 28.1±0.36µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed skip stepped increasing value 1.00 56.2±0.05µs ? ?/sec 1.00 56.3±0.08µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed skip, mandatory, no NULLs 1.00 76.2±0.22µs ? ?/sec 1.00 76.2±0.07µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed skip, optional, half NULLs 1.00 75.0±0.08µs ? ?/sec 1.00 75.0±0.11µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed skip, optional, no NULLs 1.00 78.1±0.06µs ? ?/sec 1.00 78.1±0.07µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed stepped increasing value 1.00 72.7±0.11µs ? ?/sec 1.00 72.5±0.10µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed, mandatory, no NULLs 1.00 97.2±0.11µs ? ?/sec 1.00 97.5±0.15µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed, optional, half NULLs 1.00 116.9±0.36µs ? ?/sec 1.01 117.7±0.18µs ? ?/sec
arrow_array_reader/UInt16Array/binary packed, optional, no NULLs 1.00 101.2±0.11µs ? ?/sec 1.00 101.4±0.11µs ? ?/sec
arrow_array_reader/UInt16Array/byte_stream_split encoded, mandatory, no NULLs 1.00 20.9±0.02µs ? ?/sec 1.00 20.9±0.03µs ? ?/sec
arrow_array_reader/UInt16Array/byte_stream_split encoded, optional, half NULLs 1.00 77.2±0.11µs ? ?/sec 1.01 77.9±0.19µs ? ?/sec
arrow_array_reader/UInt16Array/byte_stream_split encoded, optional, no NULLs 1.00 24.7±0.02µs ? ?/sec 1.00 24.7±0.06µs ? ?/sec
arrow_array_reader/UInt16Array/dictionary encoded, mandatory, no NULLs 1.00 50.8±0.03µs ? ?/sec 1.00 51.0±0.04µs ? ?/sec
arrow_array_reader/UInt16Array/dictionary encoded, optional, half NULLs 1.00 95.1±0.11µs ? ?/sec 1.04 98.9±0.13µs ? ?/sec
arrow_array_reader/UInt16Array/dictionary encoded, optional, no NULLs 1.00 54.8±0.04µs ? ?/sec 1.07 58.7±0.07µs ? ?/sec
arrow_array_reader/UInt16Array/plain encoded, mandatory, no NULLs 1.00 13.8±0.02µs ? ?/sec 1.00 13.8±0.04µs ? ?/sec
arrow_array_reader/UInt16Array/plain encoded, optional, half NULLs 1.00 74.6±0.07µs ? ?/sec 1.00 74.3±0.09µs ? ?/sec
arrow_array_reader/UInt16Array/plain encoded, optional, no NULLs 1.00 17.6±0.02µs ? ?/sec 1.00 17.7±0.03µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed increasing value 1.02 50.1±0.67µs ? ?/sec 1.00 49.1±0.41µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed single value 1.03 42.1±0.34µs ? ?/sec 1.00 41.0±0.47µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed skip increasing value 1.02 31.8±0.27µs ? ?/sec 1.00 31.0±0.17µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed skip single value 1.03 27.3±0.21µs ? ?/sec 1.00 26.6±0.34µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed skip stepped increasing value 1.00 54.6±0.04µs ? ?/sec 1.00 54.5±0.04µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed skip, mandatory, no NULLs 1.00 69.5±0.12µs ? ?/sec 1.00 69.3±0.15µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed skip, optional, half NULLs 1.00 70.7±0.10µs ? ?/sec 1.00 70.5±0.16µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed skip, optional, no NULLs 1.00 71.6±0.12µs ? ?/sec 1.00 71.3±0.21µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed stepped increasing value 1.00 69.2±0.10µs ? ?/sec 1.00 69.2±0.11µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed, mandatory, no NULLs 1.00 87.7±0.17µs ? ?/sec 1.00 87.6±0.29µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed, optional, half NULLs 1.00 111.0±0.18µs ? ?/sec 1.00 110.9±0.17µs ? ?/sec
arrow_array_reader/UInt32Array/binary packed, optional, no NULLs 1.00 91.6±0.18µs ? ?/sec 1.00 91.6±0.29µs ? ?/sec
arrow_array_reader/UInt32Array/byte_stream_split encoded, mandatory, no NULLs 1.00 17.5±0.04µs ? ?/sec 1.00 17.5±0.04µs ? ?/sec
arrow_array_reader/UInt32Array/byte_stream_split encoded, optional, half NULLs 1.00 74.7±0.10µs ? ?/sec 1.00 75.0±0.36µs ? ?/sec
arrow_array_reader/UInt32Array/byte_stream_split encoded, optional, no NULLs 1.00 21.1±0.02µs ? ?/sec 1.01 21.2±0.07µs ? ?/sec
arrow_array_reader/UInt32Array/dictionary encoded, mandatory, no NULLs 1.00 47.5±0.02µs ? ?/sec 1.01 47.8±0.06µs ? ?/sec
arrow_array_reader/UInt32Array/dictionary encoded, optional, half NULLs 1.00 90.9±0.11µs ? ?/sec 1.02 92.3±0.27µs ? ?/sec
arrow_array_reader/UInt32Array/dictionary encoded, optional, no NULLs 1.00 51.1±0.04µs ? ?/sec 1.02 51.9±0.05µs ? ?/sec
arrow_array_reader/UInt32Array/plain encoded, mandatory, no NULLs 1.00 10.1±0.02µs ? ?/sec 1.00 10.2±0.04µs ? ?/sec
arrow_array_reader/UInt32Array/plain encoded, optional, half NULLs 1.00 72.0±0.16µs ? ?/sec 1.00 72.2±0.07µs ? ?/sec
arrow_array_reader/UInt32Array/plain encoded, optional, no NULLs 1.01 14.1±0.03µs ? ?/sec 1.00 13.9±0.02µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed increasing value 1.00 41.0±0.13µs ? ?/sec 1.00 41.0±0.15µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed single value 1.00 38.1±0.11µs ? ?/sec 1.00 38.0±0.11µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed skip increasing value 1.00 24.4±0.06µs ? ?/sec 1.01 24.5±0.06µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed skip single value 1.00 23.0±0.05µs ? ?/sec 1.00 23.0±0.05µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed skip stepped increasing value 1.00 48.1±0.04µs ? ?/sec 1.00 48.2±0.04µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed skip, mandatory, no NULLs 1.00 60.4±0.04µs ? ?/sec 1.00 60.3±0.04µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed skip, optional, half NULLs 1.00 71.5±0.05µs ? ?/sec 1.00 71.8±0.05µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed skip, optional, no NULLs 1.00 62.4±0.03µs ? ?/sec 1.00 62.7±0.04µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed stepped increasing value 1.00 62.0±0.10µs ? ?/sec 1.00 62.2±0.08µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed, mandatory, no NULLs 1.00 77.4±0.13µs ? ?/sec 1.00 77.5±0.12µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed, optional, half NULLs 1.00 115.3±0.12µs ? ?/sec 1.01 116.2±0.15µs ? ?/sec
arrow_array_reader/UInt64Array/binary packed, optional, no NULLs 1.00 81.3±0.13µs ? ?/sec 1.01 81.8±0.12µs ? ?/sec
arrow_array_reader/UInt64Array/byte_stream_split encoded, mandatory, no NULLs 1.00 46.1±0.05µs ? ?/sec 1.00 45.9±0.03µs ? ?/sec
arrow_array_reader/UInt64Array/byte_stream_split encoded, optional, half NULLs 1.00 99.5±0.06µs ? ?/sec 1.00 99.6±0.10µs ? ?/sec
arrow_array_reader/UInt64Array/byte_stream_split encoded, optional, no NULLs 1.00 49.8±0.04µs ? ?/sec 1.00 49.6±0.03µs ? ?/sec
arrow_array_reader/UInt64Array/dictionary encoded, mandatory, no NULLs 1.00 49.6±0.04µs ? ?/sec 1.01 49.9±0.02µs ? ?/sec
arrow_array_reader/UInt64Array/dictionary encoded, optional, half NULLs 1.00 103.2±0.25µs ? ?/sec 1.00 102.9±0.07µs ? ?/sec
arrow_array_reader/UInt64Array/dictionary encoded, optional, no NULLs 1.00 53.1±0.11µs ? ?/sec 1.01 53.7±0.04µs ? ?/sec
arrow_array_reader/UInt64Array/plain encoded, mandatory, no NULLs 1.00 16.5±0.02µs ? ?/sec 1.00 16.4±0.02µs ? ?/sec
arrow_array_reader/UInt64Array/plain encoded, optional, half NULLs 1.00 85.5±0.07µs ? ?/sec 1.00 85.7±0.07µs ? ?/sec
arrow_array_reader/UInt64Array/plain encoded, optional, no NULLs 1.01 20.8±0.02µs ? ?/sec 1.00 20.5±0.03µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed increasing value 1.00 52.4±0.42µs ? ?/sec 1.01 53.1±0.62µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed single value 1.00 44.0±0.31µs ? ?/sec 1.02 44.9±0.26µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed skip increasing value 1.00 32.8±0.20µs ? ?/sec 1.01 33.2±0.19µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed skip single value 1.00 28.2±0.19µs ? ?/sec 1.02 28.7±0.17µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed skip stepped increasing value 1.00 56.2±0.16µs ? ?/sec 1.00 56.3±0.05µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed skip, mandatory, no NULLs 1.00 75.0±0.07µs ? ?/sec 1.00 75.1±0.06µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed skip, optional, half NULLs 1.00 73.9±0.07µs ? ?/sec 1.01 74.7±0.10µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed skip, optional, no NULLs 1.00 77.2±0.06µs ? ?/sec 1.00 77.6±0.06µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed stepped increasing value 1.00 72.3±0.11µs ? ?/sec 1.01 72.7±0.15µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed, mandatory, no NULLs 1.00 96.1±0.12µs ? ?/sec 1.00 96.4±0.11µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed, optional, half NULLs 1.00 116.5±0.12µs ? ?/sec 1.01 117.4±0.20µs ? ?/sec
arrow_array_reader/UInt8Array/binary packed, optional, no NULLs 1.00 100.0±0.08µs ? ?/sec 1.00 100.3±0.11µs ? ?/sec
arrow_array_reader/UInt8Array/byte_stream_split encoded, mandatory, no NULLs 1.01 20.8±0.05µs ? ?/sec 1.00 20.6±0.04µs ? ?/sec
arrow_array_reader/UInt8Array/byte_stream_split encoded, optional, half NULLs 1.00 76.6±0.11µs ? ?/sec 1.01 77.5±0.14µs ? ?/sec
arrow_array_reader/UInt8Array/byte_stream_split encoded, optional, no NULLs 1.00 24.4±0.02µs ? ?/sec 1.01 24.6±0.03µs ? ?/sec
arrow_array_reader/UInt8Array/dictionary encoded, mandatory, no NULLs 1.00 50.6±0.08µs ? ?/sec 1.01 51.0±0.03µs ? ?/sec
arrow_array_reader/UInt8Array/dictionary encoded, optional, half NULLs 1.00 94.4±0.11µs ? ?/sec 1.01 95.1±0.11µs ? ?/sec
arrow_array_reader/UInt8Array/dictionary encoded, optional, no NULLs 1.00 54.1±0.06µs ? ?/sec 1.02 55.1±0.05µs ? ?/sec
arrow_array_reader/UInt8Array/plain encoded, mandatory, no NULLs 1.00 13.5±0.04µs ? ?/sec 1.01 13.6±0.04µs ? ?/sec
arrow_array_reader/UInt8Array/plain encoded, optional, half NULLs 1.00 74.8±0.09µs ? ?/sec 1.00 74.6±0.09µs ? ?/sec
arrow_array_reader/UInt8Array/plain encoded, optional, no NULLs 1.00 17.5±0.03µs ? ?/sec 1.00 17.6±0.03µs ? ?/sec
arrow_array_reader/struct/Int32Array/plain encoded, mandatory struct, optional data, half NULLs 1.00 71.8±0.10µs ? ?/sec 1.00 72.0±0.13µs ? ?/sec
arrow_array_reader/struct/Int32Array/plain encoded, mandatory struct, optional data, no NULLs 1.00 13.7±0.03µs ? ?/sec 1.03 14.1±0.02µs ? ?/sec
arrow_array_reader/struct/Int32Array/plain encoded, optional struct, optional data, half NULLs 1.00 132.6±0.16µs ? ?/sec 1.02 135.5±0.18µs ? ?/sec
arrow_array_reader/struct/Int32Array/plain encoded, optional struct, optional data, no NULLs 1.00 65.8±0.04µs ? ?/sec 1.03 67.6±0.56µs ? ?/sec
```
</p>
</details>
<details><summary>Resource Usage</summary>
**base (merge-base)**
| Metric | Value |
|--------|-------|
| Wall time | 2930.6s |
| Peak memory | 4.2 GiB |
| Avg memory | 4.2 GiB |
| CPU user | 2927.0s |
| CPU sys | 1.3s |
| Peak spill | 0 B |
**branch**
| Metric | Value |
|--------|-------|
| Wall time | 2925.7s |
| Peak memory | 4.3 GiB |
| Avg memory | 4.2 GiB |
| CPU user | 2924.1s |
| CPU sys | 0.7s |
| Peak spill | 0 B |
</details>
---
[File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org