You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "etseidl (via GitHub)" <gi...@apache.org> on 2026/05/15 19:41:52 UTC

[PR] [Not for merge] Make `ConvertedType` optional in the Parquet schema [arrow-rs]

etseidl opened a new pull request, #9980:
URL: https://github.com/apache/arrow-rs/pull/9980

   # Which issue does this PR close?
   
   <!--
   We generally require a GitHub issue to be filed for all bug fixes and enhancements and this helps us generate change logs for our releases. You can link an issue to this PR using the GitHub syntax.
   -->
   
   - Closes #NNN.
   
   # Rationale for this change
   
   Test of making converted type an optional field (as it is in the Parquet spec).
   
   # What changes are included in this PR?
   Convert `converted_type` in the `BasicTypeInfo` to an `Option<ConvertedType>`, remove the `ConvertedType::NONE` variant (which is not in the spec).
   
   # Are these changes tested?
   
   <!--
   We typically require tests for all PRs in order to:
   1. Prevent the code from being accidentally broken by subsequent changes
   2. Serve as another way to document the expected behavior of the code
   
   If tests are not included in your PR, please explain why (for example, are they covered by existing tests)?
   
   If this PR claims a performance improvement, please include evidence such as benchmark results.
   -->
   
   # Are there any user-facing changes?
   
   <!--
   If there are user-facing changes then we may require documentation to be updated before approving the PR.
   
   If there are any breaking changes to public APIs, please call them out.
   -->
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [Not for merge] Make `ConvertedType` optional in the Parquet schema [arrow-rs]

Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #9980:
URL: https://github.com/apache/arrow-rs/pull/9980#issuecomment-4464429354

   🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9980#issuecomment-4463797817)
   
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
   
   <details><summary>CPU Details (lscpu)</summary>
   
   ```
   Architecture:                            aarch64
   CPU op-mode(s):                          64-bit
   Byte Order:                              Little Endian
   CPU(s):                                  16
   On-line CPU(s) list:                     0-15
   Vendor ID:                               ARM
   Model name:                              Neoverse-V2
   Model:                                   1
   Thread(s) per core:                      1
   Core(s) per cluster:                     16
   Socket(s):                               -
   Cluster(s):                              1
   Stepping:                                r0p1
   BogoMIPS:                                2000.00
   Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
   L1d cache:                               1 MiB (16 instances)
   L1i cache:                               1 MiB (16 instances)
   L2 cache:                                32 MiB (16 instances)
   L3 cache:                                80 MiB (1 instance)
   NUMA node(s):                            1
   NUMA node0 CPU(s):                       0-15
   Vulnerability Gather data sampling:      Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit:             Not affected
   Vulnerability L1tf:                      Not affected
   Vulnerability Mds:                       Not affected
   Vulnerability Meltdown:                  Not affected
   Vulnerability Mmio stale data:           Not affected
   Vulnerability Reg file data sampling:    Not affected
   Vulnerability Retbleed:                  Not affected
   Vulnerability Spec rstack overflow:      Not affected
   Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
   Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
   Vulnerability Spectre v2:                Mitigation; CSV2, BHB
   Vulnerability Srbds:                     Not affected
   Vulnerability Tsa:                       Not affected
   Vulnerability Tsx async abort:           Not affected
   Vulnerability Vmscape:                   Not affected
   ```
   
   </details>
   
   <details><summary>Details</summary>
   <p>
   
   ```
   group                                                                                                      main                                   optional_conv_type
   -----                                                                                                      ----                                   ------------------
   arrow_array_reader/BYTE_ARRAY/Decimal128Array/plain encoded, mandatory, no NULLs                           1.00    834.2±9.88µs        ? ?/sec    1.00    834.0±7.87µs        ? ?/sec
   arrow_array_reader/BYTE_ARRAY/Decimal128Array/plain encoded, optional, half NULLs                          1.00    945.6±5.16µs        ? ?/sec    1.00    947.3±4.41µs        ? ?/sec
   arrow_array_reader/BYTE_ARRAY/Decimal128Array/plain encoded, optional, no NULLs                            1.00   838.5±10.01µs        ? ?/sec    1.00    836.5±9.22µs        ? ?/sec
   arrow_array_reader/BinaryArray/dictionary encoded, mandatory, no NULLs                                     1.00    274.8±0.18µs        ? ?/sec    1.02    279.0±0.17µs        ? ?/sec
   arrow_array_reader/BinaryArray/dictionary encoded, optional, half NULLs                                    1.00    384.8±0.62µs        ? ?/sec    1.00    386.4±0.51µs        ? ?/sec
   arrow_array_reader/BinaryArray/dictionary encoded, optional, no NULLs                                      1.03    278.5±0.20µs        ? ?/sec    1.00    271.1±0.19µs        ? ?/sec
   arrow_array_reader/BinaryArray/plain encoded, mandatory, no NULLs                                          1.00    407.2±4.84µs        ? ?/sec    1.00    406.9±6.44µs        ? ?/sec
   arrow_array_reader/BinaryArray/plain encoded, optional, half NULLs                                         1.00    462.1±3.40µs        ? ?/sec    1.01    465.2±4.31µs        ? ?/sec
   arrow_array_reader/BinaryArray/plain encoded, optional, no NULLs                                           1.00    410.6±4.65µs        ? ?/sec    1.00    411.1±6.49µs        ? ?/sec
   arrow_array_reader/BinaryViewArray/dictionary encoded, mandatory, no NULLs                                 1.00     79.4±0.05µs        ? ?/sec    1.00     79.6±0.05µs        ? ?/sec
   arrow_array_reader/BinaryViewArray/dictionary encoded, optional, half NULLs                                1.00    107.6±0.09µs        ? ?/sec    1.00    107.7±0.12µs        ? ?/sec
   arrow_array_reader/BinaryViewArray/dictionary encoded, optional, no NULLs                                  1.00     83.2±0.04µs        ? ?/sec    1.00     83.6±0.05µs        ? ?/sec
   arrow_array_reader/BinaryViewArray/plain encoded, mandatory, no NULLs                                      1.00    146.0±0.65µs        ? ?/sec    1.00    145.5±0.52µs        ? ?/sec
   arrow_array_reader/BinaryViewArray/plain encoded, mandatory, no NULLs, short string                        1.00    141.0±0.42µs        ? ?/sec    1.01    142.0±0.36µs        ? ?/sec
   arrow_array_reader/BinaryViewArray/plain encoded, optional, half NULLs                                     1.01    145.5±1.81µs        ? ?/sec    1.00    144.6±0.23µs        ? ?/sec
   arrow_array_reader/BinaryViewArray/plain encoded, optional, no NULLs                                       1.01    151.0±0.33µs        ? ?/sec    1.00    149.9±0.22µs        ? ?/sec
   arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Decimal128Array/byte_stream_split encoded, mandatory, no NULLs     1.00    965.4±0.55µs        ? ?/sec    1.00    965.1±0.84µs        ? ?/sec
   arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Decimal128Array/byte_stream_split encoded, optional, half NULLs    1.00    669.8±0.43µs        ? ?/sec    1.01    673.7±0.45µs        ? ?/sec
   arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Decimal128Array/byte_stream_split encoded, optional, no NULLs      1.00    969.5±0.61µs        ? ?/sec    1.00    969.9±0.70µs        ? ?/sec
   arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Decimal128Array/plain encoded, mandatory, no NULLs                 1.00    189.1±0.25µs        ? ?/sec    1.00    188.9±0.16µs        ? ?/sec
   arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Decimal128Array/plain encoded, optional, half NULLs                1.00    292.3±0.39µs        ? ?/sec    1.00    292.2±0.20µs        ? ?/sec
   arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Decimal128Array/plain encoded, optional, no NULLs                  1.00    194.5±0.25µs        ? ?/sec    1.00    193.9±0.33µs        ? ?/sec
   arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Float16Array/byte_stream_split encoded, mandatory, no NULLs        1.00    127.2±0.28µs        ? ?/sec    1.01    128.9±0.29µs        ? ?/sec
   arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Float16Array/byte_stream_split encoded, optional, half NULLs       1.01    183.8±1.50µs        ? ?/sec    1.00    182.2±0.21µs        ? ?/sec
   arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Float16Array/byte_stream_split encoded, optional, no NULLs         1.00    132.1±0.26µs        ? ?/sec    1.01    132.9±0.24µs        ? ?/sec
   arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Float16Array/plain encoded, mandatory, no NULLs                    1.01     60.3±0.07µs        ? ?/sec    1.00     59.9±0.05µs        ? ?/sec
   arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Float16Array/plain encoded, optional, half NULLs                   1.01    147.0±0.08µs        ? ?/sec    1.00    146.3±0.13µs        ? ?/sec
   arrow_array_reader/FIXED_LEN_BYTE_ARRAY/Float16Array/plain encoded, optional, no NULLs                     1.02     64.0±0.06µs        ? ?/sec    1.00     62.8±0.05µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(16)/byte_stream_split encoded, mandatory, no NULLs                    1.00    801.6±0.46µs        ? ?/sec    1.07   855.6±26.21µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(16)/byte_stream_split encoded, optional, half NULLs                   1.00    507.4±0.41µs        ? ?/sec    1.00    509.1±0.37µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(16)/byte_stream_split encoded, optional, no NULLs                     1.02   820.6±13.02µs        ? ?/sec    1.00    805.4±0.45µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(16)/plain encoded, mandatory, no NULLs                                1.00     22.2±0.05µs        ? ?/sec    1.07     23.7±0.05µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(16)/plain encoded, optional, half NULLs                               1.00    128.7±0.19µs        ? ?/sec    1.01    129.6±0.13µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(16)/plain encoded, optional, no NULLs                                 1.02     27.6±0.06µs        ? ?/sec    1.00     27.1±0.07µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(2)/byte_stream_split encoded, mandatory, no NULLs                     1.00     74.7±0.20µs        ? ?/sec    1.02     76.0±0.57µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(2)/byte_stream_split encoded, optional, half NULLs                    1.00    128.0±0.16µs        ? ?/sec    1.00    127.5±0.15µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(2)/byte_stream_split encoded, optional, no NULLs                      1.02     80.2±0.68µs        ? ?/sec    1.00     78.7±0.30µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(2)/plain encoded, mandatory, no NULLs                                 1.01      5.3±0.02µs        ? ?/sec    1.00      5.2±0.02µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(2)/plain encoded, optional, half NULLs                                1.00     92.1±0.07µs        ? ?/sec    1.00     92.3±0.08µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(2)/plain encoded, optional, no NULLs                                  1.01      8.8±0.02µs        ? ?/sec    1.00      8.7±0.01µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(4)/byte_stream_split encoded, mandatory, no NULLs                     1.00    147.5±0.38µs        ? ?/sec    1.01    148.8±0.90µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(4)/byte_stream_split encoded, optional, half NULLs                    1.01    198.9±0.27µs        ? ?/sec    1.00    197.7±0.42µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(4)/byte_stream_split encoded, optional, no NULLs                      1.00    149.8±0.36µs        ? ?/sec    1.02    152.1±0.49µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(4)/plain encoded, mandatory, no NULLs                                 1.00      7.5±0.01µs        ? ?/sec    1.00      7.5±0.02µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(4)/plain encoded, optional, half NULLs                                1.01    127.6±0.10µs        ? ?/sec    1.00    126.7±0.09µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(4)/plain encoded, optional, no NULLs                                  1.00     11.1±0.02µs        ? ?/sec    1.00     11.1±0.01µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(8)/byte_stream_split encoded, mandatory, no NULLs                     1.00    298.6±2.36µs        ? ?/sec    1.05   312.3±29.18µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(8)/byte_stream_split encoded, optional, half NULLs                    1.00    264.5±0.53µs        ? ?/sec    1.01    265.9±0.42µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(8)/byte_stream_split encoded, optional, no NULLs                      1.03   319.1±24.20µs        ? ?/sec    1.00    308.8±3.71µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(8)/plain encoded, mandatory, no NULLs                                 1.00     12.4±0.05µs        ? ?/sec    1.03     12.8±0.03µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(8)/plain encoded, optional, half NULLs                                1.00    122.1±0.09µs        ? ?/sec    1.01    123.3±0.10µs        ? ?/sec
   arrow_array_reader/FixedLenByteArray(8)/plain encoded, optional, no NULLs                                  1.00     15.7±0.02µs        ? ?/sec    1.01     15.9±0.02µs        ? ?/sec
   arrow_array_reader/INT32/Decimal128Array/binary packed increasing value                                    1.00     85.5±0.45µs        ? ?/sec    1.02     87.3±0.35µs        ? ?/sec
   arrow_array_reader/INT32/Decimal128Array/binary packed single value                                        1.00     77.8±0.44µs        ? ?/sec    1.00     78.2±0.26µs        ? ?/sec
   arrow_array_reader/INT32/Decimal128Array/binary packed skip increasing value                               1.00     50.0±0.21µs        ? ?/sec    1.01     50.7±0.12µs        ? ?/sec
   arrow_array_reader/INT32/Decimal128Array/binary packed skip single value                                   1.00     45.3±0.18µs        ? ?/sec    1.01     45.6±0.15µs        ? ?/sec
   arrow_array_reader/INT32/Decimal128Array/binary packed skip stepped increasing value                       1.00     73.3±0.09µs        ? ?/sec    1.00     73.6±0.05µs        ? ?/sec
   arrow_array_reader/INT32/Decimal128Array/binary packed skip, mandatory, no NULLs                           1.00     88.1±0.20µs        ? ?/sec    1.01     88.6±0.10µs        ? ?/sec
   arrow_array_reader/INT32/Decimal128Array/binary packed skip, optional, half NULLs                          1.00     89.4±0.26µs        ? ?/sec    1.00     89.6±0.12µs        ? ?/sec
   arrow_array_reader/INT32/Decimal128Array/binary packed skip, optional, no NULLs                            1.00     90.3±0.17µs        ? ?/sec    1.00     90.6±0.12µs        ? ?/sec
   arrow_array_reader/INT32/Decimal128Array/binary packed stepped increasing value                            1.00    105.7±0.18µs        ? ?/sec    1.01    106.4±0.14µs        ? ?/sec
   arrow_array_reader/INT32/Decimal128Array/binary packed, mandatory, no NULLs                                1.00    124.7±0.62µs        ? ?/sec    1.00    125.3±0.92µs        ? ?/sec
   arrow_array_reader/INT32/Decimal128Array/binary packed, optional, half NULLs                               1.00    147.2±0.20µs        ? ?/sec    1.00    147.3±0.22µs        ? ?/sec
   arrow_array_reader/INT32/Decimal128Array/binary packed, optional, no NULLs                                 1.00    127.9±0.41µs        ? ?/sec    1.01    128.9±0.13µs        ? ?/sec
   arrow_array_reader/INT32/Decimal128Array/byte_stream_split encoded, mandatory, no NULLs                    1.00     54.0±0.04µs        ? ?/sec    1.01     54.7±0.55µs        ? ?/sec
   arrow_array_reader/INT32/Decimal128Array/byte_stream_split encoded, optional, half NULLs                   1.00    110.7±0.12µs        ? ?/sec    1.00    111.2±0.12µs        ? ?/sec
   arrow_array_reader/INT32/Decimal128Array/byte_stream_split encoded, optional, no NULLs                     1.01     57.5±0.04µs        ? ?/sec    1.00     57.2±0.05µs        ? ?/sec
   arrow_array_reader/INT32/Decimal128Array/dictionary encoded, mandatory, no NULLs                           1.01     84.3±0.07µs        ? ?/sec    1.00     83.7±0.05µs        ? ?/sec
   arrow_array_reader/INT32/Decimal128Array/dictionary encoded, optional, half NULLs                          1.01    128.6±0.15µs        ? ?/sec    1.00    127.9±0.16µs        ? ?/sec
   arrow_array_reader/INT32/Decimal128Array/dictionary encoded, optional, no NULLs                            1.00     87.8±0.04µs        ? ?/sec    1.00     87.5±0.08µs        ? ?/sec
   arrow_array_reader/INT32/Decimal128Array/plain encoded, mandatory, no NULLs                                1.02     48.8±0.51µs        ? ?/sec    1.00     47.7±0.04µs        ? ?/sec
   arrow_array_reader/INT32/Decimal128Array/plain encoded, optional, half NULLs                               1.00    108.0±0.45µs        ? ?/sec    1.00    108.2±0.13µs        ? ?/sec
   arrow_array_reader/INT32/Decimal128Array/plain encoded, optional, no NULLs                                 1.00     50.6±0.05µs        ? ?/sec    1.00     50.7±0.04µs        ? ?/sec
   arrow_array_reader/INT64/Decimal128Array/binary packed increasing value                                    1.01     78.2±0.21µs        ? ?/sec    1.00     77.6±0.22µs        ? ?/sec
   arrow_array_reader/INT64/Decimal128Array/binary packed single value                                        1.00     74.4±0.17µs        ? ?/sec    1.00     74.2±0.18µs        ? ?/sec
   arrow_array_reader/INT64/Decimal128Array/binary packed skip increasing value                               1.01     43.5±0.17µs        ? ?/sec    1.00     43.3±0.15µs        ? ?/sec
   arrow_array_reader/INT64/Decimal128Array/binary packed skip single value                                   1.01     41.8±0.06µs        ? ?/sec    1.00     41.5±0.10µs        ? ?/sec
   arrow_array_reader/INT64/Decimal128Array/binary packed skip stepped increasing value                       1.00     66.9±0.09µs        ? ?/sec    1.00     67.0±0.12µs        ? ?/sec
   arrow_array_reader/INT64/Decimal128Array/binary packed skip, mandatory, no NULLs                           1.00     79.4±0.09µs        ? ?/sec    1.00     79.1±0.06µs        ? ?/sec
   arrow_array_reader/INT64/Decimal128Array/binary packed skip, optional, half NULLs                          1.00     90.2±0.07µs        ? ?/sec    1.00     89.8±0.08µs        ? ?/sec
   arrow_array_reader/INT64/Decimal128Array/binary packed skip, optional, no NULLs                            1.00     81.3±0.07µs        ? ?/sec    1.00     81.3±0.08µs        ? ?/sec
   arrow_array_reader/INT64/Decimal128Array/binary packed stepped increasing value                            1.00     98.8±0.15µs        ? ?/sec    1.00     98.9±0.47µs        ? ?/sec
   arrow_array_reader/INT64/Decimal128Array/binary packed, mandatory, no NULLs                                1.00    114.2±0.18µs        ? ?/sec    1.00    114.0±0.13µs        ? ?/sec
   arrow_array_reader/INT64/Decimal128Array/binary packed, optional, half NULLs                               1.01    152.1±0.16µs        ? ?/sec    1.00    151.3±0.10µs        ? ?/sec
   arrow_array_reader/INT64/Decimal128Array/binary packed, optional, no NULLs                                 1.01    118.5±0.21µs        ? ?/sec    1.00    117.8±0.11µs        ? ?/sec
   arrow_array_reader/INT64/Decimal128Array/byte_stream_split encoded, mandatory, no NULLs                    1.01     83.4±0.08µs        ? ?/sec    1.00     82.9±0.28µs        ? ?/sec
   arrow_array_reader/INT64/Decimal128Array/byte_stream_split encoded, optional, half NULLs                   1.01    136.3±0.23µs        ? ?/sec    1.00    135.4±0.11µs        ? ?/sec
   arrow_array_reader/INT64/Decimal128Array/byte_stream_split encoded, optional, no NULLs                     1.01     88.4±0.13µs        ? ?/sec    1.00     87.5±0.39µs        ? ?/sec
   arrow_array_reader/INT64/Decimal128Array/dictionary encoded, mandatory, no NULLs                           1.01     87.0±0.19µs        ? ?/sec    1.00     86.1±0.08µs        ? ?/sec
   arrow_array_reader/INT64/Decimal128Array/dictionary encoded, optional, half NULLs                          1.02    140.9±0.24µs        ? ?/sec    1.00    138.8±0.23µs        ? ?/sec
   arrow_array_reader/INT64/Decimal128Array/dictionary encoded, optional, no NULLs                            1.00     90.4±0.11µs        ? ?/sec    1.00     90.2±0.24µs        ? ?/sec
   arrow_array_reader/INT64/Decimal128Array/plain encoded, mandatory, no NULLs                                1.00     54.3±0.07µs        ? ?/sec    1.00     54.6±0.05µs        ? ?/sec
   arrow_array_reader/INT64/Decimal128Array/plain encoded, optional, half NULLs                               1.01    121.2±0.11µs        ? ?/sec    1.00    120.2±0.10µs        ? ?/sec
   arrow_array_reader/INT64/Decimal128Array/plain encoded, optional, no NULLs                                 1.00     58.5±0.06µs        ? ?/sec    1.00     58.7±0.07µs        ? ?/sec
   arrow_array_reader/Int16Array/binary packed increasing value                                               1.00     53.3±0.44µs        ? ?/sec    1.01     53.7±0.30µs        ? ?/sec
   arrow_array_reader/Int16Array/binary packed single value                                                   1.00     44.8±0.22µs        ? ?/sec    1.01     45.2±0.18µs        ? ?/sec
   arrow_array_reader/Int16Array/binary packed skip increasing value                                          1.00     33.2±0.25µs        ? ?/sec    1.01     33.6±0.07µs        ? ?/sec
   arrow_array_reader/Int16Array/binary packed skip single value                                              1.00     28.5±0.11µs        ? ?/sec    1.01     28.8±0.14µs        ? ?/sec
   arrow_array_reader/Int16Array/binary packed skip stepped increasing value                                  1.00     56.2±0.08µs        ? ?/sec    1.00     56.3±0.07µs        ? ?/sec
   arrow_array_reader/Int16Array/binary packed skip, mandatory, no NULLs                                      1.00     71.2±0.08µs        ? ?/sec    1.01     71.7±0.06µs        ? ?/sec
   arrow_array_reader/Int16Array/binary packed skip, optional, half NULLs                                     1.00     72.3±0.10µs        ? ?/sec    1.00     72.2±0.09µs        ? ?/sec
   arrow_array_reader/Int16Array/binary packed skip, optional, no NULLs                                       1.00     73.2±0.11µs        ? ?/sec    1.00     73.4±0.07µs        ? ?/sec
   arrow_array_reader/Int16Array/binary packed stepped increasing value                                       1.00     72.7±0.18µs        ? ?/sec    1.00     72.9±0.11µs        ? ?/sec
   arrow_array_reader/Int16Array/binary packed, mandatory, no NULLs                                           1.00     91.2±0.15µs        ? ?/sec    1.01     91.7±0.12µs        ? ?/sec
   arrow_array_reader/Int16Array/binary packed, optional, half NULLs                                          1.00    113.5±0.17µs        ? ?/sec    1.00    113.8±0.20µs        ? ?/sec
   arrow_array_reader/Int16Array/binary packed, optional, no NULLs                                            1.00     94.9±0.20µs        ? ?/sec    1.00     95.3±0.15µs        ? ?/sec
   arrow_array_reader/Int16Array/byte_stream_split encoded, mandatory, no NULLs                               1.00     20.9±0.05µs        ? ?/sec    1.00     20.9±0.06µs        ? ?/sec
   arrow_array_reader/Int16Array/byte_stream_split encoded, optional, half NULLs                              1.00     77.3±0.13µs        ? ?/sec    1.01     78.2±0.09µs        ? ?/sec
   arrow_array_reader/Int16Array/byte_stream_split encoded, optional, no NULLs                                1.00     24.6±0.02µs        ? ?/sec    1.02     25.1±0.03µs        ? ?/sec
   arrow_array_reader/Int16Array/dictionary encoded, mandatory, no NULLs                                      1.01     51.2±0.03µs        ? ?/sec    1.00     50.8±0.06µs        ? ?/sec
   arrow_array_reader/Int16Array/dictionary encoded, optional, half NULLs                                     1.00     95.2±0.12µs        ? ?/sec    1.00     95.1±0.13µs        ? ?/sec
   arrow_array_reader/Int16Array/dictionary encoded, optional, no NULLs                                       1.01     54.9±0.04µs        ? ?/sec    1.00     54.6±0.04µs        ? ?/sec
   arrow_array_reader/Int16Array/plain encoded, mandatory, no NULLs                                           1.00     13.9±0.04µs        ? ?/sec    1.00     13.9±0.03µs        ? ?/sec
   arrow_array_reader/Int16Array/plain encoded, optional, half NULLs                                          1.00     75.2±0.14µs        ? ?/sec    1.00     74.9±0.07µs        ? ?/sec
   arrow_array_reader/Int16Array/plain encoded, optional, no NULLs                                            1.00     17.4±0.02µs        ? ?/sec    1.02     17.8±0.03µs        ? ?/sec
   arrow_array_reader/Int32Array/binary packed increasing value                                               1.00     49.8±0.49µs        ? ?/sec    1.01     50.1±0.44µs        ? ?/sec
   arrow_array_reader/Int32Array/binary packed single value                                                   1.00     41.4±0.24µs        ? ?/sec    1.00     41.6±0.21µs        ? ?/sec
   arrow_array_reader/Int32Array/binary packed skip increasing value                                          1.00     31.4±0.17µs        ? ?/sec    1.00     31.5±0.17µs        ? ?/sec
   arrow_array_reader/Int32Array/binary packed skip single value                                              1.00     26.7±0.13µs        ? ?/sec    1.01     26.9±0.15µs        ? ?/sec
   arrow_array_reader/Int32Array/binary packed skip stepped increasing value                                  1.00     54.3±0.05µs        ? ?/sec    1.00     54.4±0.03µs        ? ?/sec
   arrow_array_reader/Int32Array/binary packed skip, mandatory, no NULLs                                      1.00     69.5±0.11µs        ? ?/sec    1.00     69.6±0.10µs        ? ?/sec
   arrow_array_reader/Int32Array/binary packed skip, optional, half NULLs                                     1.00     71.1±0.11µs        ? ?/sec    1.00     70.9±0.12µs        ? ?/sec
   arrow_array_reader/Int32Array/binary packed skip, optional, no NULLs                                       1.00     72.0±0.12µs        ? ?/sec    1.00     71.9±0.12µs        ? ?/sec
   arrow_array_reader/Int32Array/binary packed stepped increasing value                                       1.00     68.9±0.12µs        ? ?/sec    1.00     69.0±0.10µs        ? ?/sec
   arrow_array_reader/Int32Array/binary packed, mandatory, no NULLs                                           1.00     87.5±0.25µs        ? ?/sec    1.01     88.1±0.17µs        ? ?/sec
   arrow_array_reader/Int32Array/binary packed, optional, half NULLs                                          1.00    111.0±0.20µs        ? ?/sec    1.01    111.7±0.24µs        ? ?/sec
   arrow_array_reader/Int32Array/binary packed, optional, no NULLs                                            1.00     91.6±0.24µs        ? ?/sec    1.01     92.2±0.18µs        ? ?/sec
   arrow_array_reader/Int32Array/byte_stream_split encoded, mandatory, no NULLs                               1.00     17.4±0.03µs        ? ?/sec    1.00     17.4±0.02µs        ? ?/sec
   arrow_array_reader/Int32Array/byte_stream_split encoded, optional, half NULLs                              1.00     74.7±0.09µs        ? ?/sec    1.00     75.0±0.07µs        ? ?/sec
   arrow_array_reader/Int32Array/byte_stream_split encoded, optional, no NULLs                                1.01     21.2±0.03µs        ? ?/sec    1.00     20.9±0.02µs        ? ?/sec
   arrow_array_reader/Int32Array/dictionary encoded, mandatory, no NULLs                                      1.01     47.7±0.05µs        ? ?/sec    1.00     47.2±0.04µs        ? ?/sec
   arrow_array_reader/Int32Array/dictionary encoded, optional, half NULLs                                     1.00     91.8±0.12µs        ? ?/sec    1.00     92.0±0.16µs        ? ?/sec
   arrow_array_reader/Int32Array/dictionary encoded, optional, no NULLs                                       1.00     51.4±0.05µs        ? ?/sec    1.00     51.3±0.03µs        ? ?/sec
   arrow_array_reader/Int32Array/plain encoded, mandatory, no NULLs                                           1.01     10.0±0.05µs        ? ?/sec    1.00      9.9±0.03µs        ? ?/sec
   arrow_array_reader/Int32Array/plain encoded, optional, half NULLs                                          1.00     71.7±0.10µs        ? ?/sec    1.00     71.9±0.06µs        ? ?/sec
   arrow_array_reader/Int32Array/plain encoded, optional, no NULLs                                            1.01     13.7±0.03µs        ? ?/sec    1.00     13.6±0.02µs        ? ?/sec
   arrow_array_reader/Int64Array/binary packed increasing value                                               1.00     40.3±0.13µs        ? ?/sec    1.00     40.2±0.12µs        ? ?/sec
   arrow_array_reader/Int64Array/binary packed single value                                                   1.00     37.6±0.18µs        ? ?/sec    1.00     37.5±0.19µs        ? ?/sec
   arrow_array_reader/Int64Array/binary packed skip increasing value                                          1.00     24.2±0.07µs        ? ?/sec    1.00     24.1±0.07µs        ? ?/sec
   arrow_array_reader/Int64Array/binary packed skip single value                                              1.01     22.6±0.06µs        ? ?/sec    1.00     22.4±0.05µs        ? ?/sec
   arrow_array_reader/Int64Array/binary packed skip stepped increasing value                                  1.00     47.9±0.04µs        ? ?/sec    1.00     48.0±0.05µs        ? ?/sec
   arrow_array_reader/Int64Array/binary packed skip, mandatory, no NULLs                                      1.00     60.2±0.08µs        ? ?/sec    1.00     60.2±0.06µs        ? ?/sec
   arrow_array_reader/Int64Array/binary packed skip, optional, half NULLs                                     1.01     71.7±0.06µs        ? ?/sec    1.00     71.0±0.18µs        ? ?/sec
   arrow_array_reader/Int64Array/binary packed skip, optional, no NULLs                                       1.00     62.2±0.05µs        ? ?/sec    1.00     62.3±0.06µs        ? ?/sec
   arrow_array_reader/Int64Array/binary packed stepped increasing value                                       1.00     61.8±0.10µs        ? ?/sec    1.00     61.6±0.08µs        ? ?/sec
   arrow_array_reader/Int64Array/binary packed, mandatory, no NULLs                                           1.00     77.0±0.10µs        ? ?/sec    1.00     76.9±0.11µs        ? ?/sec
   arrow_array_reader/Int64Array/binary packed, optional, half NULLs                                          1.00    114.9±0.10µs        ? ?/sec    1.00    114.8±0.08µs        ? ?/sec
   arrow_array_reader/Int64Array/binary packed, optional, no NULLs                                            1.00     81.2±0.12µs        ? ?/sec    1.00     81.1±0.10µs        ? ?/sec
   arrow_array_reader/Int64Array/byte_stream_split encoded, mandatory, no NULLs                               1.00     46.1±0.03µs        ? ?/sec    1.00     46.2±0.03µs        ? ?/sec
   arrow_array_reader/Int64Array/byte_stream_split encoded, optional, half NULLs                              1.01     99.2±0.11µs        ? ?/sec    1.00     98.4±0.07µs        ? ?/sec
   arrow_array_reader/Int64Array/byte_stream_split encoded, optional, no NULLs                                1.00     50.4±0.04µs        ? ?/sec    1.01     50.8±0.06µs        ? ?/sec
   arrow_array_reader/Int64Array/dictionary encoded, mandatory, no NULLs                                      1.00     49.4±0.03µs        ? ?/sec    1.00     49.6±0.04µs        ? ?/sec
   arrow_array_reader/Int64Array/dictionary encoded, optional, half NULLs                                     1.01    102.9±0.11µs        ? ?/sec    1.00    101.8±0.14µs        ? ?/sec
   arrow_array_reader/Int64Array/dictionary encoded, optional, no NULLs                                       1.00     53.3±0.04µs        ? ?/sec    1.00     53.3±0.04µs        ? ?/sec
   arrow_array_reader/Int64Array/plain encoded, mandatory, no NULLs                                           1.00     16.2±0.03µs        ? ?/sec    1.00     16.1±0.02µs        ? ?/sec
   arrow_array_reader/Int64Array/plain encoded, optional, half NULLs                                          1.00     85.2±0.15µs        ? ?/sec    1.00     84.8±0.05µs        ? ?/sec
   arrow_array_reader/Int64Array/plain encoded, optional, no NULLs                                            1.02     20.4±0.03µs        ? ?/sec    1.00     20.1±0.02µs        ? ?/sec
   arrow_array_reader/Int8Array/binary packed increasing value                                                1.01     53.2±0.38µs        ? ?/sec    1.00     52.6±0.47µs        ? ?/sec
   arrow_array_reader/Int8Array/binary packed single value                                                    1.02     45.0±0.18µs        ? ?/sec    1.00     44.2±0.52µs        ? ?/sec
   arrow_array_reader/Int8Array/binary packed skip increasing value                                           1.01     33.2±0.08µs        ? ?/sec    1.00     32.9±0.23µs        ? ?/sec
   arrow_array_reader/Int8Array/binary packed skip single value                                               1.01     28.5±0.12µs        ? ?/sec    1.00     28.2±0.26µs        ? ?/sec
   arrow_array_reader/Int8Array/binary packed skip stepped increasing value                                   1.00     56.1±0.08µs        ? ?/sec    1.00     56.2±0.07µs        ? ?/sec
   arrow_array_reader/Int8Array/binary packed skip, mandatory, no NULLs                                       1.00     71.3±0.05µs        ? ?/sec    1.00     71.4±0.09µs        ? ?/sec
   arrow_array_reader/Int8Array/binary packed skip, optional, half NULLs                                      1.00     72.7±0.08µs        ? ?/sec    1.00     72.7±0.09µs        ? ?/sec
   arrow_array_reader/Int8Array/binary packed skip, optional, no NULLs                                        1.00     73.7±0.05µs        ? ?/sec    1.00     73.8±0.11µs        ? ?/sec
   arrow_array_reader/Int8Array/binary packed stepped increasing value                                        1.00     72.4±0.13µs        ? ?/sec    1.00     72.6±0.11µs        ? ?/sec
   arrow_array_reader/Int8Array/binary packed, mandatory, no NULLs                                            1.00     91.7±0.06µs        ? ?/sec    1.00     91.9±0.18µs        ? ?/sec
   arrow_array_reader/Int8Array/binary packed, optional, half NULLs                                           1.00    113.4±0.16µs        ? ?/sec    1.01    114.6±0.15µs        ? ?/sec
   arrow_array_reader/Int8Array/binary packed, optional, no NULLs                                             1.00     95.3±0.06µs        ? ?/sec    1.00     95.5±0.20µs        ? ?/sec
   arrow_array_reader/Int8Array/byte_stream_split encoded, mandatory, no NULLs                                1.00     20.6±0.06µs        ? ?/sec    1.00     20.6±0.04µs        ? ?/sec
   arrow_array_reader/Int8Array/byte_stream_split encoded, optional, half NULLs                               1.01     77.6±0.15µs        ? ?/sec    1.00     77.1±0.10µs        ? ?/sec
   arrow_array_reader/Int8Array/byte_stream_split encoded, optional, no NULLs                                 1.01     24.5±0.03µs        ? ?/sec    1.00     24.3±0.05µs        ? ?/sec
   arrow_array_reader/Int8Array/dictionary encoded, mandatory, no NULLs                                       1.01     51.1±0.02µs        ? ?/sec    1.00     50.5±0.05µs        ? ?/sec
   arrow_array_reader/Int8Array/dictionary encoded, optional, half NULLs                                      1.00     94.4±0.11µs        ? ?/sec    1.00     94.7±0.14µs        ? ?/sec
   arrow_array_reader/Int8Array/dictionary encoded, optional, no NULLs                                        1.00     54.6±0.08µs        ? ?/sec    1.00     54.5±0.43µs        ? ?/sec
   arrow_array_reader/Int8Array/plain encoded, mandatory, no NULLs                                            1.00     13.5±0.03µs        ? ?/sec    1.02     13.7±0.03µs        ? ?/sec
   arrow_array_reader/Int8Array/plain encoded, optional, half NULLs                                           1.00     74.4±0.14µs        ? ?/sec    1.00     74.3±0.11µs        ? ?/sec
   arrow_array_reader/Int8Array/plain encoded, optional, no NULLs                                             1.01     17.6±0.03µs        ? ?/sec    1.00     17.3±0.03µs        ? ?/sec
   arrow_array_reader/ListArray/Fixed32List/90pct NULLs                                                       1.00   1003.3±7.34µs        ? ?/sec    1.01   1010.5±7.39µs        ? ?/sec
   arrow_array_reader/ListArray/Fixed32List/99pct NULLs                                                       1.00   455.1±10.80µs        ? ?/sec    1.00   454.5±10.39µs        ? ?/sec
   arrow_array_reader/ListArray/Fixed32List/half NULLs                                                        1.03      2.6±0.01ms        ? ?/sec    1.00      2.5±0.01ms        ? ?/sec
   arrow_array_reader/ListArray/Fixed32List/no NULLs                                                          1.00      4.3±0.02ms        ? ?/sec    1.00      4.3±0.02ms        ? ?/sec
   arrow_array_reader/ListArray/Int32List/90pct NULLs                                                         1.00    922.6±4.58µs        ? ?/sec    1.00    926.8±4.06µs        ? ?/sec
   arrow_array_reader/ListArray/Int32List/99pct NULLs                                                         1.00   411.7±11.15µs        ? ?/sec    1.00    409.6±8.88µs        ? ?/sec
   arrow_array_reader/ListArray/Int32List/half NULLs                                                          1.00      2.1±0.01ms        ? ?/sec    1.00      2.1±0.01ms        ? ?/sec
   arrow_array_reader/ListArray/Int32List/no NULLs                                                            1.01      2.9±0.01ms        ? ?/sec    1.00      2.8±0.01ms        ? ?/sec
   arrow_array_reader/ListArray/StringList/90pct NULLs                                                        1.00   1095.7±5.27µs        ? ?/sec    1.00   1097.0±4.90µs        ? ?/sec
   arrow_array_reader/ListArray/StringList/99pct NULLs                                                        1.00   423.3±10.77µs        ? ?/sec    1.01    426.5±9.17µs        ? ?/sec
   arrow_array_reader/ListArray/StringList/half NULLs                                                         1.00      3.9±0.01ms        ? ?/sec    1.00      3.9±0.01ms        ? ?/sec
   arrow_array_reader/ListArray/StringList/no NULLs                                                           1.01      7.0±0.03ms        ? ?/sec    1.00      7.0±0.05ms        ? ?/sec
   arrow_array_reader/StringArray/const delta byte array encoded, mandatory, no NULLs                         1.00    518.2±6.05µs        ? ?/sec    1.04    537.9±2.72µs        ? ?/sec
   arrow_array_reader/StringArray/const delta length byte array encoded, mandatory, no NULLs                  1.00    209.0±1.10µs        ? ?/sec    1.02    212.2±0.39µs        ? ?/sec
   arrow_array_reader/StringArray/const prefix delta byte array encoded, mandatory, no NULLs                  1.03   789.9±39.09µs        ? ?/sec    1.00   767.3±34.24µs        ? ?/sec
   arrow_array_reader/StringArray/dictionary encoded, mandatory, no NULLs                                     1.00    275.4±0.28µs        ? ?/sec    1.02    279.6±0.21µs        ? ?/sec
   arrow_array_reader/StringArray/dictionary encoded, optional, half NULLs                                    1.00    386.2±1.20µs        ? ?/sec    1.00    385.8±0.62µs        ? ?/sec
   arrow_array_reader/StringArray/dictionary encoded, optional, no NULLs                                      1.00    277.9±0.48µs        ? ?/sec    1.02    283.6±0.23µs        ? ?/sec
   arrow_array_reader/StringArray/plain encoded, mandatory, no NULLs                                          1.02    459.5±7.35µs        ? ?/sec    1.00    452.4±5.17µs        ? ?/sec
   arrow_array_reader/StringArray/plain encoded, optional, half NULLs                                         1.01    494.2±4.34µs        ? ?/sec    1.00    491.4±3.93µs        ? ?/sec
   arrow_array_reader/StringArray/plain encoded, optional, no NULLs                                           1.01    463.9±7.40µs        ? ?/sec    1.00    457.6±4.63µs        ? ?/sec
   arrow_array_reader/StringDictionary/dictionary encoded, mandatory, no NULLs                                1.00    246.5±0.73µs        ? ?/sec    1.00    247.6±0.46µs        ? ?/sec
   arrow_array_reader/StringDictionary/dictionary encoded, optional, half NULLs                               1.00    271.9±0.93µs        ? ?/sec    1.01    275.3±1.02µs        ? ?/sec
   arrow_array_reader/StringDictionary/dictionary encoded, optional, no NULLs                                 1.00    250.4±0.48µs        ? ?/sec    1.01    252.2±0.45µs        ? ?/sec
   arrow_array_reader/StringViewArray/dictionary encoded, mandatory, no NULLs                                 1.00     79.6±0.04µs        ? ?/sec    1.00     79.9±0.04µs        ? ?/sec
   arrow_array_reader/StringViewArray/dictionary encoded, optional, half NULLs                                1.00    107.7±0.11µs        ? ?/sec    1.00    107.6±0.07µs        ? ?/sec
   arrow_array_reader/StringViewArray/dictionary encoded, optional, no NULLs                                  1.00     83.5±0.09µs        ? ?/sec    1.00     83.6±0.06µs        ? ?/sec
   arrow_array_reader/StringViewArray/plain encoded, mandatory, no NULLs                                      1.00    218.2±0.63µs        ? ?/sec    1.00    217.6±0.22µs        ? ?/sec
   arrow_array_reader/StringViewArray/plain encoded, optional, half NULLs                                     1.00    180.2±0.18µs        ? ?/sec    1.00    180.1±0.88µs        ? ?/sec
   arrow_array_reader/StringViewArray/plain encoded, optional, no NULLs                                       1.00    225.6±0.27µs        ? ?/sec    1.00    226.4±1.12µs        ? ?/sec
   arrow_array_reader/UInt16Array/binary packed increasing value                                              1.00     52.1±0.34µs        ? ?/sec    1.03     53.4±0.49µs        ? ?/sec
   arrow_array_reader/UInt16Array/binary packed single value                                                  1.00     43.7±0.54µs        ? ?/sec    1.03     44.9±0.26µs        ? ?/sec
   arrow_array_reader/UInt16Array/binary packed skip increasing value                                         1.00     32.4±0.19µs        ? ?/sec    1.03     33.4±0.19µs        ? ?/sec
   arrow_array_reader/UInt16Array/binary packed skip single value                                             1.00     27.8±0.30µs        ? ?/sec    1.03     28.8±0.14µs        ? ?/sec
   arrow_array_reader/UInt16Array/binary packed skip stepped increasing value                                 1.00     56.1±0.06µs        ? ?/sec    1.00     56.3±0.05µs        ? ?/sec
   arrow_array_reader/UInt16Array/binary packed skip, mandatory, no NULLs                                     1.00     76.0±0.06µs        ? ?/sec    1.00     76.2±0.09µs        ? ?/sec
   arrow_array_reader/UInt16Array/binary packed skip, optional, half NULLs                                    1.00     74.9±0.12µs        ? ?/sec    1.00     75.1±0.09µs        ? ?/sec
   arrow_array_reader/UInt16Array/binary packed skip, optional, no NULLs                                      1.00     77.9±0.10µs        ? ?/sec    1.01     78.9±0.08µs        ? ?/sec
   arrow_array_reader/UInt16Array/binary packed stepped increasing value                                      1.00     72.3±0.15µs        ? ?/sec    1.01     72.7±0.14µs        ? ?/sec
   arrow_array_reader/UInt16Array/binary packed, mandatory, no NULLs                                          1.00     97.3±0.18µs        ? ?/sec    1.00     97.6±0.16µs        ? ?/sec
   arrow_array_reader/UInt16Array/binary packed, optional, half NULLs                                         1.00    117.3±0.21µs        ? ?/sec    1.00    117.7±0.19µs        ? ?/sec
   arrow_array_reader/UInt16Array/binary packed, optional, no NULLs                                           1.00    101.1±0.18µs        ? ?/sec    1.00    101.2±0.15µs        ? ?/sec
   arrow_array_reader/UInt16Array/byte_stream_split encoded, mandatory, no NULLs                              1.00     20.8±0.02µs        ? ?/sec    1.01     20.9±0.03µs        ? ?/sec
   arrow_array_reader/UInt16Array/byte_stream_split encoded, optional, half NULLs                             1.00     77.2±0.08µs        ? ?/sec    1.00     77.4±0.09µs        ? ?/sec
   arrow_array_reader/UInt16Array/byte_stream_split encoded, optional, no NULLs                               1.00     24.5±0.03µs        ? ?/sec    1.01     24.7±0.04µs        ? ?/sec
   arrow_array_reader/UInt16Array/dictionary encoded, mandatory, no NULLs                                     1.00     50.9±0.05µs        ? ?/sec    1.00     50.9±0.05µs        ? ?/sec
   arrow_array_reader/UInt16Array/dictionary encoded, optional, half NULLs                                    1.00     94.9±0.15µs        ? ?/sec    1.00     94.8±0.13µs        ? ?/sec
   arrow_array_reader/UInt16Array/dictionary encoded, optional, no NULLs                                      1.00     54.7±0.07µs        ? ?/sec    1.00     54.6±0.03µs        ? ?/sec
   arrow_array_reader/UInt16Array/plain encoded, mandatory, no NULLs                                          1.00     13.7±0.02µs        ? ?/sec    1.01     13.8±0.04µs        ? ?/sec
   arrow_array_reader/UInt16Array/plain encoded, optional, half NULLs                                         1.00     74.1±0.12µs        ? ?/sec    1.00     74.3±0.10µs        ? ?/sec
   arrow_array_reader/UInt16Array/plain encoded, optional, no NULLs                                           1.00     17.5±0.02µs        ? ?/sec    1.01     17.6±0.03µs        ? ?/sec
   arrow_array_reader/UInt32Array/binary packed increasing value                                              1.00     49.1±0.36µs        ? ?/sec    1.03     50.4±0.28µs        ? ?/sec
   arrow_array_reader/UInt32Array/binary packed single value                                                  1.00     40.7±0.53µs        ? ?/sec    1.02     41.7±0.19µs        ? ?/sec
   arrow_array_reader/UInt32Array/binary packed skip increasing value                                         1.00     30.8±0.17µs        ? ?/sec    1.03     31.8±0.07µs        ? ?/sec
   arrow_array_reader/UInt32Array/binary packed skip single value                                             1.00     26.2±0.28µs        ? ?/sec    1.03     27.0±0.13µs        ? ?/sec
   arrow_array_reader/UInt32Array/binary packed skip stepped increasing value                                 1.00     54.7±0.06µs        ? ?/sec    1.00     54.8±0.08µs        ? ?/sec
   arrow_array_reader/UInt32Array/binary packed skip, mandatory, no NULLs                                     1.00     69.5±0.16µs        ? ?/sec    1.01     70.0±0.11µs        ? ?/sec
   arrow_array_reader/UInt32Array/binary packed skip, optional, half NULLs                                    1.00     70.7±0.09µs        ? ?/sec    1.00     71.0±0.10µs        ? ?/sec
   arrow_array_reader/UInt32Array/binary packed skip, optional, no NULLs                                      1.00     71.5±0.42µs        ? ?/sec    1.01     72.0±0.11µs        ? ?/sec
   arrow_array_reader/UInt32Array/binary packed stepped increasing value                                      1.00     69.2±0.17µs        ? ?/sec    1.01     69.6±0.11µs        ? ?/sec
   arrow_array_reader/UInt32Array/binary packed, mandatory, no NULLs                                          1.00     87.5±0.32µs        ? ?/sec    1.01     88.2±0.21µs        ? ?/sec
   arrow_array_reader/UInt32Array/binary packed, optional, half NULLs                                         1.00    110.8±0.21µs        ? ?/sec    1.00    110.7±0.25µs        ? ?/sec
   arrow_array_reader/UInt32Array/binary packed, optional, no NULLs                                           1.00     91.7±0.33µs        ? ?/sec    1.00     92.0±0.23µs        ? ?/sec
   arrow_array_reader/UInt32Array/byte_stream_split encoded, mandatory, no NULLs                              1.00     17.5±0.02µs        ? ?/sec    1.00     17.4±0.03µs        ? ?/sec
   arrow_array_reader/UInt32Array/byte_stream_split encoded, optional, half NULLs                             1.00     74.4±0.11µs        ? ?/sec    1.00     74.5±0.09µs        ? ?/sec
   arrow_array_reader/UInt32Array/byte_stream_split encoded, optional, no NULLs                               1.00     21.0±0.03µs        ? ?/sec    1.00     20.9±0.02µs        ? ?/sec
   arrow_array_reader/UInt32Array/dictionary encoded, mandatory, no NULLs                                     1.01     47.9±0.03µs        ? ?/sec    1.00     47.6±0.05µs        ? ?/sec
   arrow_array_reader/UInt32Array/dictionary encoded, optional, half NULLs                                    1.00     91.3±0.12µs        ? ?/sec    1.00     91.5±0.14µs        ? ?/sec
   arrow_array_reader/UInt32Array/dictionary encoded, optional, no NULLs                                      1.00     51.4±0.04µs        ? ?/sec    1.00     51.2±0.03µs        ? ?/sec
   arrow_array_reader/UInt32Array/plain encoded, mandatory, no NULLs                                          1.01     10.2±0.02µs        ? ?/sec    1.00     10.1±0.03µs        ? ?/sec
   arrow_array_reader/UInt32Array/plain encoded, optional, half NULLs                                         1.00     72.3±0.10µs        ? ?/sec    1.00     72.2±0.08µs        ? ?/sec
   arrow_array_reader/UInt32Array/plain encoded, optional, no NULLs                                           1.00     13.6±0.02µs        ? ?/sec    1.02     13.9±0.01µs        ? ?/sec
   arrow_array_reader/UInt64Array/binary packed increasing value                                              1.00     40.7±0.11µs        ? ?/sec    1.00     40.6±0.14µs        ? ?/sec
   arrow_array_reader/UInt64Array/binary packed single value                                                  1.00     37.6±0.13µs        ? ?/sec    1.00     37.5±0.20µs        ? ?/sec
   arrow_array_reader/UInt64Array/binary packed skip increasing value                                         1.00     24.5±0.06µs        ? ?/sec    1.00     24.4±0.06µs        ? ?/sec
   arrow_array_reader/UInt64Array/binary packed skip single value                                             1.00     22.9±0.06µs        ? ?/sec    1.00     22.8±0.05µs        ? ?/sec
   arrow_array_reader/UInt64Array/binary packed skip stepped increasing value                                 1.00     47.9±0.05µs        ? ?/sec    1.00     48.1±0.04µs        ? ?/sec
   arrow_array_reader/UInt64Array/binary packed skip, mandatory, no NULLs                                     1.00     60.1±0.04µs        ? ?/sec    1.00     60.2±0.04µs        ? ?/sec
   arrow_array_reader/UInt64Array/binary packed skip, optional, half NULLs                                    1.01     71.5±0.04µs        ? ?/sec    1.00     70.7±0.07µs        ? ?/sec
   arrow_array_reader/UInt64Array/binary packed skip, optional, no NULLs                                      1.00     62.3±0.05µs        ? ?/sec    1.00     62.3±0.04µs        ? ?/sec
   arrow_array_reader/UInt64Array/binary packed stepped increasing value                                      1.00     62.1±0.10µs        ? ?/sec    1.00     62.0±0.08µs        ? ?/sec
   arrow_array_reader/UInt64Array/binary packed, mandatory, no NULLs                                          1.00     77.2±0.11µs        ? ?/sec    1.00     77.2±0.11µs        ? ?/sec
   arrow_array_reader/UInt64Array/binary packed, optional, half NULLs                                         1.01    115.6±0.11µs        ? ?/sec    1.00    114.9±0.12µs        ? ?/sec
   arrow_array_reader/UInt64Array/binary packed, optional, no NULLs                                           1.00     81.2±0.11µs        ? ?/sec    1.00     81.2±0.13µs        ? ?/sec
   arrow_array_reader/UInt64Array/byte_stream_split encoded, mandatory, no NULLs                              1.00     45.5±0.05µs        ? ?/sec    1.01     46.0±0.05µs        ? ?/sec
   arrow_array_reader/UInt64Array/byte_stream_split encoded, optional, half NULLs                             1.01    100.0±0.10µs        ? ?/sec    1.00     99.0±0.31µs        ? ?/sec
   arrow_array_reader/UInt64Array/byte_stream_split encoded, optional, no NULLs                               1.00     49.7±0.04µs        ? ?/sec    1.03     51.0±0.04µs        ? ?/sec
   arrow_array_reader/UInt64Array/dictionary encoded, mandatory, no NULLs                                     1.00     49.5±0.11µs        ? ?/sec    1.00     49.6±0.04µs        ? ?/sec
   arrow_array_reader/UInt64Array/dictionary encoded, optional, half NULLs                                    1.01    102.8±0.11µs        ? ?/sec    1.00    101.9±0.07µs        ? ?/sec
   arrow_array_reader/UInt64Array/dictionary encoded, optional, no NULLs                                      1.00     53.0±0.14µs        ? ?/sec    1.01     53.2±0.07µs        ? ?/sec
   arrow_array_reader/UInt64Array/plain encoded, mandatory, no NULLs                                          1.00     16.4±0.05µs        ? ?/sec    1.02     16.6±0.04µs        ? ?/sec
   arrow_array_reader/UInt64Array/plain encoded, optional, half NULLs                                         1.01     85.1±0.09µs        ? ?/sec    1.00     84.1±0.06µs        ? ?/sec
   arrow_array_reader/UInt64Array/plain encoded, optional, no NULLs                                           1.04     21.0±0.04µs        ? ?/sec    1.00     20.2±0.05µs        ? ?/sec
   arrow_array_reader/UInt8Array/binary packed increasing value                                               1.00     53.0±0.49µs        ? ?/sec    1.00     53.2±0.46µs        ? ?/sec
   arrow_array_reader/UInt8Array/binary packed single value                                                   1.00     44.7±0.25µs        ? ?/sec    1.00     44.5±0.23µs        ? ?/sec
   arrow_array_reader/UInt8Array/binary packed skip increasing value                                          1.00     32.9±0.23µs        ? ?/sec    1.00     33.1±0.22µs        ? ?/sec
   arrow_array_reader/UInt8Array/binary packed skip single value                                              1.00     28.4±0.14µs        ? ?/sec    1.00     28.4±0.14µs        ? ?/sec
   arrow_array_reader/UInt8Array/binary packed skip stepped increasing value                                  1.00     55.9±0.06µs        ? ?/sec    1.00     56.1±0.06µs        ? ?/sec
   arrow_array_reader/UInt8Array/binary packed skip, mandatory, no NULLs                                      1.00     75.2±0.07µs        ? ?/sec    1.00     75.2±0.07µs        ? ?/sec
   arrow_array_reader/UInt8Array/binary packed skip, optional, half NULLs                                     1.00     74.6±0.09µs        ? ?/sec    1.00     74.8±0.10µs        ? ?/sec
   arrow_array_reader/UInt8Array/binary packed skip, optional, no NULLs                                       1.00     77.4±0.06µs        ? ?/sec    1.00     77.5±0.05µs        ? ?/sec
   arrow_array_reader/UInt8Array/binary packed stepped increasing value                                       1.00     72.2±0.15µs        ? ?/sec    1.00     72.3±0.19µs        ? ?/sec
   arrow_array_reader/UInt8Array/binary packed, mandatory, no NULLs                                           1.00     96.4±0.14µs        ? ?/sec    1.00     96.5±0.11µs        ? ?/sec
   arrow_array_reader/UInt8Array/binary packed, optional, half NULLs                                          1.01    117.3±0.21µs        ? ?/sec    1.00    116.3±0.16µs        ? ?/sec
   arrow_array_reader/UInt8Array/binary packed, optional, no NULLs                                            1.00    100.1±0.12µs        ? ?/sec    1.00    100.2±0.13µs        ? ?/sec
   arrow_array_reader/UInt8Array/byte_stream_split encoded, mandatory, no NULLs                               1.00     20.6±0.05µs        ? ?/sec    1.00     20.7±0.03µs        ? ?/sec
   arrow_array_reader/UInt8Array/byte_stream_split encoded, optional, half NULLs                              1.00     77.3±0.10µs        ? ?/sec    1.00     76.9±0.13µs        ? ?/sec
   arrow_array_reader/UInt8Array/byte_stream_split encoded, optional, no NULLs                                1.01     24.5±0.04µs        ? ?/sec    1.00     24.3±0.04µs        ? ?/sec
   arrow_array_reader/UInt8Array/dictionary encoded, mandatory, no NULLs                                      1.01     51.1±0.04µs        ? ?/sec    1.00     50.4±0.06µs        ? ?/sec
   arrow_array_reader/UInt8Array/dictionary encoded, optional, half NULLs                                     1.00     95.1±0.13µs        ? ?/sec    1.00     95.6±0.22µs        ? ?/sec
   arrow_array_reader/UInt8Array/dictionary encoded, optional, no NULLs                                       1.00     54.9±0.06µs        ? ?/sec    1.00     54.7±0.18µs        ? ?/sec
   arrow_array_reader/UInt8Array/plain encoded, mandatory, no NULLs                                           1.01     13.7±0.03µs        ? ?/sec    1.00     13.6±0.03µs        ? ?/sec
   arrow_array_reader/UInt8Array/plain encoded, optional, half NULLs                                          1.01     74.3±0.12µs        ? ?/sec    1.00     73.5±0.16µs        ? ?/sec
   arrow_array_reader/UInt8Array/plain encoded, optional, no NULLs                                            1.02     17.5±0.03µs        ? ?/sec    1.00     17.1±0.03µs        ? ?/sec
   arrow_array_reader/struct/Int32Array/plain encoded, mandatory struct, optional data, half NULLs            1.00     71.9±0.13µs        ? ?/sec    1.00     72.1±0.09µs        ? ?/sec
   arrow_array_reader/struct/Int32Array/plain encoded, mandatory struct, optional data, no NULLs              1.00     13.9±0.03µs        ? ?/sec    1.00     13.9±0.04µs        ? ?/sec
   arrow_array_reader/struct/Int32Array/plain encoded, optional struct, optional data, half NULLs             1.01    134.0±0.20µs        ? ?/sec    1.00    132.1±0.16µs        ? ?/sec
   arrow_array_reader/struct/Int32Array/plain encoded, optional struct, optional data, no NULLs               1.04     67.9±0.54µs        ? ?/sec    1.00     65.1±0.03µs        ? ?/sec
   ```
   
   </p>
   </details>
   
   <details><summary>Resource Usage</summary>
   
   **base (merge-base)**
   | Metric | Value |
   |--------|-------|
   | Wall time | 2925.7s |
   | Peak memory | 3.9 GiB |
   | Avg memory | 3.8 GiB |
   | CPU user | 2923.0s |
   | CPU sys | 1.3s |
   | Peak spill | 0 B |
   
   **branch**
   | Metric | Value |
   |--------|-------|
   | Wall time | 2915.7s |
   | Peak memory | 3.9 GiB |
   | Avg memory | 3.9 GiB |
   | CPU user | 2912.2s |
   | CPU sys | 0.7s |
   | Peak spill | 0 B |
   </details>
   
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [Not for merge] Make `ConvertedType` optional in the Parquet schema [arrow-rs]

Posted by "etseidl (via GitHub)" <gi...@apache.org>.
etseidl commented on PR #9980:
URL: https://github.com/apache/arrow-rs/pull/9980#issuecomment-4462998181

   run benchmarks metadata parquet_round_trip


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [Not for merge] Make `ConvertedType` optional in the Parquet schema [arrow-rs]

Posted by "etseidl (via GitHub)" <gi...@apache.org>.
etseidl commented on PR #9980:
URL: https://github.com/apache/arrow-rs/pull/9980#issuecomment-4463760843

   run benchmark parquet_round_trip
   
   ```yaml
   env:
     BENCH_FILTER: write StringView
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [Not for merge] Make `ConvertedType` optional in the Parquet schema [arrow-rs]

Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #9980:
URL: https://github.com/apache/arrow-rs/pull/9980#issuecomment-4463218946

   🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9980#issuecomment-4462998181)
   
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
   
   <details><summary>CPU Details (lscpu)</summary>
   
   ```
   Architecture:                            aarch64
   CPU op-mode(s):                          64-bit
   Byte Order:                              Little Endian
   CPU(s):                                  16
   On-line CPU(s) list:                     0-15
   Vendor ID:                               ARM
   Model name:                              Neoverse-V2
   Model:                                   1
   Thread(s) per core:                      1
   Core(s) per cluster:                     16
   Socket(s):                               -
   Cluster(s):                              1
   Stepping:                                r0p1
   BogoMIPS:                                2000.00
   Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
   L1d cache:                               1 MiB (16 instances)
   L1i cache:                               1 MiB (16 instances)
   L2 cache:                                32 MiB (16 instances)
   L3 cache:                                80 MiB (1 instance)
   NUMA node(s):                            1
   NUMA node0 CPU(s):                       0-15
   Vulnerability Gather data sampling:      Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit:             Not affected
   Vulnerability L1tf:                      Not affected
   Vulnerability Mds:                       Not affected
   Vulnerability Meltdown:                  Not affected
   Vulnerability Mmio stale data:           Not affected
   Vulnerability Reg file data sampling:    Not affected
   Vulnerability Retbleed:                  Not affected
   Vulnerability Spec rstack overflow:      Not affected
   Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
   Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
   Vulnerability Spectre v2:                Mitigation; CSV2, BHB
   Vulnerability Srbds:                     Not affected
   Vulnerability Tsa:                       Not affected
   Vulnerability Tsx async abort:           Not affected
   Vulnerability Vmscape:                   Not affected
   ```
   
   </details>
   
   <details><summary>Details</summary>
   <p>
   
   ```
   group                                               main                                   optional_conv_type
   -----                                               ----                                   ------------------
   decode metadata (wide) with schema                  1.00     27.9±0.35ms        ? ?/sec    1.01     28.2±0.37ms        ? ?/sec
   decode metadata (wide) with skip PES                1.00     28.5±0.38ms        ? ?/sec    1.01     28.7±0.35ms        ? ?/sec
   decode metadata (wide) with skip all stats          1.00     32.4±0.20ms        ? ?/sec    1.01     32.9±0.20ms        ? ?/sec
   decode metadata (wide) with skip column stats       1.00     29.5±0.29ms        ? ?/sec    1.01     29.8±0.31ms        ? ?/sec
   decode metadata (wide) with skip size stats         1.00     32.8±0.30ms        ? ?/sec    1.00     33.0±0.28ms        ? ?/sec
   decode metadata (wide) with stats mask              1.00     27.4±0.36ms        ? ?/sec    1.01     27.6±0.41ms        ? ?/sec
   decode metadata with schema                         1.01      4.2±0.01µs        ? ?/sec    1.00      4.1±0.01µs        ? ?/sec
   decode metadata with skip PES                       1.00      7.0±0.05µs        ? ?/sec    1.00      7.0±0.01µs        ? ?/sec
   decode metadata with skip column stats              1.02      6.8±0.06µs        ? ?/sec    1.00      6.7±0.09µs        ? ?/sec
   decode metadata with stats mask                     1.01      6.8±0.01µs        ? ?/sec    1.00      6.8±0.05µs        ? ?/sec
   decode parquet metadata                             1.01      7.2±0.01µs        ? ?/sec    1.00      7.1±0.03µs        ? ?/sec
   decode parquet metadata (wide)                      1.00     30.0±0.37ms        ? ?/sec    1.00     30.1±0.39ms        ? ?/sec
   decode parquet metadata no path_in_schema (wide)    1.00     29.4±0.36ms        ? ?/sec    1.00     29.5±0.42ms        ? ?/sec
   decode parquet metadata w/ size stats (wide)        1.00     36.2±0.40ms        ? ?/sec    1.00     36.3±0.41ms        ? ?/sec
   open(default)                                       1.00      7.8±0.01µs        ? ?/sec    1.00      7.7±0.05µs        ? ?/sec
   open(page index)                                    1.01    132.9±0.18µs        ? ?/sec    1.00    132.1±0.09µs        ? ?/sec
   ```
   
   </p>
   </details>
   
   <details><summary>Resource Usage</summary>
   
   **base (merge-base)**
   | Metric | Value |
   |--------|-------|
   | Wall time | 160.0s |
   | Peak memory | 4.2 GiB |
   | Avg memory | 4.2 GiB |
   | CPU user | 156.2s |
   | CPU sys | 0.8s |
   | Peak spill | 0 B |
   
   **branch**
   | Metric | Value |
   |--------|-------|
   | Wall time | 160.0s |
   | Peak memory | 4.2 GiB |
   | Avg memory | 4.2 GiB |
   | CPU user | 156.1s |
   | CPU sys | 0.2s |
   | Peak spill | 0 B |
   </details>
   
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [Not for merge] Make `ConvertedType` optional in the Parquet schema [arrow-rs]

Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #9980:
URL: https://github.com/apache/arrow-rs/pull/9980#issuecomment-4463803739

   🤖 Arrow criterion benchmark running (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9980#issuecomment-4463797817)
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c4463797817-162-skqpk 6.12.68+ #1 SMP Wed Apr  1 02:23:28 UTC 2026 aarch64 GNU/Linux`
   <details><summary>CPU Details (lscpu)</summary>
   
   ```
   Architecture:                            aarch64
   CPU op-mode(s):                          64-bit
   Byte Order:                              Little Endian
   CPU(s):                                  16
   On-line CPU(s) list:                     0-15
   Vendor ID:                               ARM
   Model name:                              Neoverse-V2
   Model:                                   1
   Thread(s) per core:                      1
   Core(s) per cluster:                     16
   Socket(s):                               -
   Cluster(s):                              1
   Stepping:                                r0p1
   BogoMIPS:                                2000.00
   Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
   L1d cache:                               1 MiB (16 instances)
   L1i cache:                               1 MiB (16 instances)
   L2 cache:                                32 MiB (16 instances)
   L3 cache:                                80 MiB (1 instance)
   NUMA node(s):                            1
   NUMA node0 CPU(s):                       0-15
   Vulnerability Gather data sampling:      Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit:             Not affected
   Vulnerability L1tf:                      Not affected
   Vulnerability Mds:                       Not affected
   Vulnerability Meltdown:                  Not affected
   Vulnerability Mmio stale data:           Not affected
   Vulnerability Reg file data sampling:    Not affected
   Vulnerability Retbleed:                  Not affected
   Vulnerability Spec rstack overflow:      Not affected
   Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
   Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
   Vulnerability Spectre v2:                Mitigation; CSV2, BHB
   Vulnerability Srbds:                     Not affected
   Vulnerability Tsa:                       Not affected
   Vulnerability Tsx async abort:           Not affected
   Vulnerability Vmscape:                   Not affected
   ```
   
   </details>
   
   Comparing optional_conv_type (70752e5a95559aa73374551e746fcf8e468a912c) to fd1c5b3 (merge-base) [diff](https://github.com/apache/arrow-rs/compare/fd1c5b391e169762a0981870c4e94baa3372d7a3..70752e5a95559aa73374551e746fcf8e468a912c)
   BENCH_NAME=arrow_reader
   BENCH_COMMAND=cargo bench --features=arrow,async,test_common,experimental,object_store --bench arrow_reader
   BENCH_FILTER=
   Results will be posted here when complete
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [Not for merge] Make `ConvertedType` optional in the Parquet schema [arrow-rs]

Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #9980:
URL: https://github.com/apache/arrow-rs/pull/9980#issuecomment-4463158595

   🤖 Arrow criterion benchmark running (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9980#issuecomment-4462998181)
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c4462998181-154-8tghq 6.12.68+ #1 SMP Wed Apr  1 02:23:28 UTC 2026 aarch64 GNU/Linux`
   <details><summary>CPU Details (lscpu)</summary>
   
   ```
   Architecture:                            aarch64
   CPU op-mode(s):                          64-bit
   Byte Order:                              Little Endian
   CPU(s):                                  16
   On-line CPU(s) list:                     0-15
   Vendor ID:                               ARM
   Model name:                              Neoverse-V2
   Model:                                   1
   Thread(s) per core:                      1
   Core(s) per cluster:                     16
   Socket(s):                               -
   Cluster(s):                              1
   Stepping:                                r0p1
   BogoMIPS:                                2000.00
   Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
   L1d cache:                               1 MiB (16 instances)
   L1i cache:                               1 MiB (16 instances)
   L2 cache:                                32 MiB (16 instances)
   L3 cache:                                80 MiB (1 instance)
   NUMA node(s):                            1
   NUMA node0 CPU(s):                       0-15
   Vulnerability Gather data sampling:      Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit:             Not affected
   Vulnerability L1tf:                      Not affected
   Vulnerability Mds:                       Not affected
   Vulnerability Meltdown:                  Not affected
   Vulnerability Mmio stale data:           Not affected
   Vulnerability Reg file data sampling:    Not affected
   Vulnerability Retbleed:                  Not affected
   Vulnerability Spec rstack overflow:      Not affected
   Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
   Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
   Vulnerability Spectre v2:                Mitigation; CSV2, BHB
   Vulnerability Srbds:                     Not affected
   Vulnerability Tsa:                       Not affected
   Vulnerability Tsx async abort:           Not affected
   Vulnerability Vmscape:                   Not affected
   ```
   
   </details>
   
   Comparing optional_conv_type (efb7f604e67d08e61cff4739afe5210af44478fc) to fd1c5b3 (merge-base) [diff](https://github.com/apache/arrow-rs/compare/fd1c5b391e169762a0981870c4e94baa3372d7a3..efb7f604e67d08e61cff4739afe5210af44478fc)
   BENCH_NAME=parquet_round_trip
   BENCH_COMMAND=cargo bench --features=arrow,async,test_common,experimental,object_store --bench parquet_round_trip
   BENCH_FILTER=
   Results will be posted here when complete
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [Not for merge] Make `ConvertedType` optional in the Parquet schema [arrow-rs]

Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #9980:
URL: https://github.com/apache/arrow-rs/pull/9980#issuecomment-4464295823

   🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9980#issuecomment-4463797817)
   
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
   
   <details><summary>CPU Details (lscpu)</summary>
   
   ```
   Architecture:                            aarch64
   CPU op-mode(s):                          64-bit
   Byte Order:                              Little Endian
   CPU(s):                                  16
   On-line CPU(s) list:                     0-15
   Vendor ID:                               ARM
   Model name:                              Neoverse-V2
   Model:                                   1
   Thread(s) per core:                      1
   Core(s) per cluster:                     16
   Socket(s):                               -
   Cluster(s):                              1
   Stepping:                                r0p1
   BogoMIPS:                                2000.00
   Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
   L1d cache:                               1 MiB (16 instances)
   L1i cache:                               1 MiB (16 instances)
   L2 cache:                                32 MiB (16 instances)
   L3 cache:                                80 MiB (1 instance)
   NUMA node(s):                            1
   NUMA node0 CPU(s):                       0-15
   Vulnerability Gather data sampling:      Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit:             Not affected
   Vulnerability L1tf:                      Not affected
   Vulnerability Mds:                       Not affected
   Vulnerability Meltdown:                  Not affected
   Vulnerability Mmio stale data:           Not affected
   Vulnerability Reg file data sampling:    Not affected
   Vulnerability Retbleed:                  Not affected
   Vulnerability Spec rstack overflow:      Not affected
   Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
   Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
   Vulnerability Spectre v2:                Mitigation; CSV2, BHB
   Vulnerability Srbds:                     Not affected
   Vulnerability Tsa:                       Not affected
   Vulnerability Tsx async abort:           Not affected
   Vulnerability Vmscape:                   Not affected
   ```
   
   </details>
   
   <details><summary>Details</summary>
   <p>
   
   ```
   group                                              main                                   optional_conv_type
   -----                                              ----                                   ------------------
   bool/bloom_filter                                  1.00     13.0±0.07ms    19.2 MB/sec    1.00     13.1±0.07ms    19.1 MB/sec
   bool/cdc                                           1.00     15.8±0.08ms    15.8 MB/sec    1.01     16.0±0.05ms    15.7 MB/sec
   bool/default                                       1.00     11.0±0.07ms    22.8 MB/sec    1.00     10.9±0.04ms    22.9 MB/sec
   bool/parquet_2                                     1.00     14.7±0.08ms    17.0 MB/sec    1.00     14.8±0.06ms    16.9 MB/sec
   bool/zstd                                          1.00     11.5±0.06ms    21.8 MB/sec    1.00     11.5±0.05ms    21.8 MB/sec
   bool/zstd_parquet_2                                1.00     15.1±0.09ms    16.5 MB/sec    1.00     15.2±0.07ms    16.5 MB/sec
   bool_non_null/bloom_filter                         1.00      7.1±0.03ms    17.6 MB/sec    1.01      7.2±0.02ms    17.5 MB/sec
   bool_non_null/cdc                                  1.00      6.9±0.03ms    18.2 MB/sec    1.00      6.9±0.03ms    18.2 MB/sec
   bool_non_null/default                              1.00      4.4±0.02ms    28.7 MB/sec    1.00      4.4±0.02ms    28.7 MB/sec
   bool_non_null/parquet_2                            1.00      9.1±0.04ms    13.7 MB/sec    1.01      9.2±0.03ms    13.7 MB/sec
   bool_non_null/zstd                                 1.00      4.7±0.02ms    26.6 MB/sec    1.00      4.7±0.02ms    26.6 MB/sec
   bool_non_null/zstd_parquet_2                       1.00      9.5±0.03ms    13.1 MB/sec    1.01      9.6±0.03ms    13.0 MB/sec
   float_with_nans/bloom_filter                       1.00     94.0±0.35ms   148.9 MB/sec    1.01     94.9±0.42ms   147.5 MB/sec
   float_with_nans/cdc                                1.01     82.7±1.75ms   169.2 MB/sec    1.00     82.0±0.21ms   170.8 MB/sec
   float_with_nans/default                            1.00     74.4±0.26ms   188.2 MB/sec    1.00     74.5±0.25ms   187.9 MB/sec
   float_with_nans/parquet_2                          1.00     95.0±0.43ms   147.3 MB/sec    1.00     95.4±0.39ms   146.8 MB/sec
   float_with_nans/zstd                               1.00    112.2±0.26ms   124.8 MB/sec    1.00    112.3±0.27ms   124.7 MB/sec
   float_with_nans/zstd_parquet_2                     1.00    132.4±0.40ms   105.7 MB/sec    1.00    132.6±0.39ms   105.6 MB/sec
   list_primitive/bloom_filter                        1.03    343.5±7.50ms  1587.5 MB/sec    1.00    334.3±1.71ms  1631.5 MB/sec
   list_primitive/cdc                                 1.00    365.1±2.39ms  1493.7 MB/sec    1.00    366.1±6.62ms  1489.8 MB/sec
   list_primitive/default                             1.04    262.1±7.87ms     2.0 GB/sec    1.00    252.7±2.26ms     2.1 GB/sec
   list_primitive/parquet_2                           1.03    282.6±7.96ms  1930.1 MB/sec    1.00    274.6±0.72ms  1985.8 MB/sec
   list_primitive/zstd                                1.02    512.7±7.72ms  1063.7 MB/sec    1.00    501.6±2.55ms  1087.3 MB/sec
   list_primitive/zstd_parquet_2                      1.02    506.3±8.14ms  1077.2 MB/sec    1.00    498.0±0.62ms  1095.2 MB/sec
   list_primitive_non_null/bloom_filter               1.00    423.5±5.73ms  1285.2 MB/sec    1.09   462.2±11.95ms  1177.4 MB/sec
   list_primitive_non_null/cdc                        1.01    442.3±8.81ms  1230.5 MB/sec    1.00    439.4±8.89ms  1238.5 MB/sec
   list_primitive_non_null/default                    1.00    284.4±4.35ms  1913.5 MB/sec    1.07   304.8±17.32ms  1785.4 MB/sec
   list_primitive_non_null/parquet_2                  1.00    303.6±8.08ms  1792.6 MB/sec    1.10   333.1±25.66ms  1633.9 MB/sec
   list_primitive_non_null/zstd                       1.00    706.0±6.16ms   770.8 MB/sec    1.01    714.5±9.00ms   761.7 MB/sec
   list_primitive_non_null/zstd_parquet_2             1.00    678.2±3.59ms   802.5 MB/sec    1.01    683.7±2.82ms   796.0 MB/sec
   list_primitive_sparse_99pct_null/bloom_filter      1.01     11.4±0.12ms     3.2 GB/sec    1.00     11.2±0.06ms     3.3 GB/sec
   list_primitive_sparse_99pct_null/cdc               1.01     22.6±0.12ms  1651.8 MB/sec    1.00     22.5±0.10ms  1663.6 MB/sec
   list_primitive_sparse_99pct_null/default           1.01     11.0±0.12ms     3.3 GB/sec    1.00     10.9±0.04ms     3.4 GB/sec
   list_primitive_sparse_99pct_null/parquet_2         1.01     11.0±0.13ms     3.3 GB/sec    1.00     10.9±0.04ms     3.4 GB/sec
   list_primitive_sparse_99pct_null/zstd              1.01     12.9±0.12ms     2.8 GB/sec    1.00     12.7±0.05ms     2.9 GB/sec
   list_primitive_sparse_99pct_null/zstd_parquet_2    1.01     11.1±0.13ms     3.3 GB/sec    1.00     11.0±0.04ms     3.3 GB/sec
   primitive/bloom_filter                             1.00    151.6±0.65ms   296.0 MB/sec    1.00    151.5±0.73ms   296.2 MB/sec
   primitive/cdc                                      1.00    158.9±0.61ms   282.4 MB/sec    1.00    158.7±0.62ms   282.8 MB/sec
   primitive/default                                  1.00    118.5±0.52ms   378.8 MB/sec    1.00    118.3±0.53ms   379.4 MB/sec
   primitive/parquet_2                                1.00    134.0±0.60ms   334.9 MB/sec    1.00    133.3±0.41ms   336.5 MB/sec
   primitive/zstd                                     1.00    148.1±0.51ms   302.9 MB/sec    1.00    148.0±0.50ms   303.2 MB/sec
   primitive/zstd_parquet_2                           1.00    166.6±0.49ms   269.4 MB/sec    1.00    166.9±0.53ms   268.9 MB/sec
   primitive_all_null/bloom_filter                    1.00    909.5±3.51µs    48.2 GB/sec    1.00    912.7±3.47µs    48.0 GB/sec
   primitive_all_null/cdc                             1.00     18.8±0.25ms     2.3 GB/sec    1.00     18.8±0.25ms     2.3 GB/sec
   primitive_all_null/default                         1.00    277.1±0.76µs   158.1 GB/sec    1.00    277.9±1.23µs   157.7 GB/sec
   primitive_all_null/parquet_2                       1.00    278.0±0.97µs   157.6 GB/sec    1.00    277.9±1.96µs   157.7 GB/sec
   primitive_all_null/zstd                            1.00    390.7±0.79µs   112.2 GB/sec    1.00    389.8±1.45µs   112.4 GB/sec
   primitive_all_null/zstd_parquet_2                  1.01    355.8±1.05µs   123.2 GB/sec    1.00    352.3±1.50µs   124.4 GB/sec
   primitive_non_null/bloom_filter                    1.00    109.5±0.46ms   401.7 MB/sec    1.00    109.7±0.34ms   401.0 MB/sec
   primitive_non_null/cdc                             1.00     90.3±0.36ms   487.4 MB/sec    1.00     90.6±0.29ms   485.5 MB/sec
   primitive_non_null/default                         1.00     67.8±0.25ms   648.8 MB/sec    1.00     67.6±0.29ms   650.8 MB/sec
   primitive_non_null/parquet_2                       1.00     89.5±0.28ms   491.6 MB/sec    1.00     89.4±0.26ms   492.3 MB/sec
   primitive_non_null/zstd                            1.00    105.0±1.02ms   418.9 MB/sec    1.00    104.6±0.28ms   420.8 MB/sec
   primitive_non_null/zstd_parquet_2                  1.04    129.1±2.57ms   340.9 MB/sec    1.00    123.5±1.10ms   356.2 MB/sec
   primitive_sparse_99pct_null/bloom_filter           1.00     18.2±0.14ms     2.4 GB/sec    1.01     18.3±0.19ms     2.4 GB/sec
   primitive_sparse_99pct_null/cdc                    1.00     35.5±0.35ms  1264.9 MB/sec    1.00     35.4±0.32ms  1267.5 MB/sec
   primitive_sparse_99pct_null/default                1.00     16.8±0.07ms     2.6 GB/sec    1.00     16.8±0.06ms     2.6 GB/sec
   primitive_sparse_99pct_null/parquet_2              1.00     16.8±0.06ms     2.6 GB/sec    1.00     16.8±0.06ms     2.6 GB/sec
   primitive_sparse_99pct_null/zstd                   1.00     20.1±0.08ms     2.2 GB/sec    1.00     20.1±0.07ms     2.2 GB/sec
   primitive_sparse_99pct_null/zstd_parquet_2         1.00     18.7±0.07ms     2.3 GB/sec    1.00     18.7±0.10ms     2.3 GB/sec
   string/bloom_filter                                1.06   220.9±20.10ms     2.3 GB/sec    1.00    209.1±1.39ms     2.4 GB/sec
   string/cdc                                         1.00    221.4±4.59ms     2.3 GB/sec    1.00    222.1±5.95ms     2.3 GB/sec
   string/default                                     1.00   125.5±19.41ms     4.1 GB/sec    1.04   129.9±19.83ms     3.9 GB/sec
   string/parquet_2                                   1.00    112.2±6.65ms     4.6 GB/sec    1.13    126.2±0.99ms     4.1 GB/sec
   string/zstd                                        1.00    416.9±1.90ms  1257.6 MB/sec    1.07   444.8±17.59ms  1178.7 MB/sec
   string/zstd_parquet_2                              1.00    402.8±6.79ms  1301.6 MB/sec    1.05    424.5±7.60ms  1234.9 MB/sec
   string_and_binary_view/bloom_filter                1.01     65.4±0.39ms   493.0 MB/sec    1.00     65.1±0.32ms   495.7 MB/sec
   string_and_binary_view/cdc                         1.00     58.6±0.26ms   550.2 MB/sec    1.00     58.7±0.22ms   549.3 MB/sec
   string_and_binary_view/default                     1.00     48.3±0.19ms   667.9 MB/sec    1.00     48.2±0.24ms   668.7 MB/sec
   string_and_binary_view/parquet_2                   1.00     59.2±0.20ms   544.6 MB/sec    1.00     59.4±0.20ms   543.4 MB/sec
   string_and_binary_view/zstd                        1.00     85.0±0.23ms   379.5 MB/sec    1.00     85.1±0.17ms   379.2 MB/sec
   string_and_binary_view/zstd_parquet_2              1.00     73.1±0.23ms   441.1 MB/sec    1.00     73.3±0.21ms   439.7 MB/sec
   string_dictionary/bloom_filter                     1.00     92.9±1.02ms     2.8 GB/sec    1.01     94.2±0.77ms     2.7 GB/sec
   string_dictionary/cdc                              1.06     54.3±0.61ms     4.8 GB/sec    1.00     51.2±0.42ms     5.0 GB/sec
   string_dictionary/default                          1.00     47.6±0.77ms     5.4 GB/sec    1.04     49.3±0.42ms     5.2 GB/sec
   string_dictionary/parquet_2                        1.01     55.0±0.28ms     4.7 GB/sec    1.00     54.3±0.37ms     4.8 GB/sec
   string_dictionary/zstd                             1.00    210.2±1.36ms  1256.6 MB/sec    1.00    209.9±0.79ms  1258.1 MB/sec
   string_dictionary/zstd_parquet_2                   1.00    200.0±0.23ms  1320.8 MB/sec    1.00    199.1±0.19ms  1326.5 MB/sec
   string_non_null/bloom_filter                       1.02   263.4±12.95ms  1989.3 MB/sec    1.00   258.3±12.12ms  2028.7 MB/sec
   string_non_null/cdc                                1.00    276.4±8.16ms  1896.0 MB/sec    1.00   275.3±10.25ms  1903.5 MB/sec
   string_non_null/default                            1.04   141.6±11.51ms     3.6 GB/sec    1.00   135.8±12.11ms     3.8 GB/sec
   string_non_null/parquet_2                          1.04    142.2±6.52ms     3.6 GB/sec    1.00    136.5±7.22ms     3.7 GB/sec
   string_non_null/zstd                               1.00    535.6±1.96ms   978.3 MB/sec    1.00    535.6±2.21ms   978.3 MB/sec
   string_non_null/zstd_parquet_2                     1.00    506.4±1.15ms  1034.7 MB/sec    1.00    505.6±0.60ms  1036.3 MB/sec
   struct_all_null/bloom_filter                       1.01    384.2±1.96µs    41.0 GB/sec    1.00    382.1±2.15µs    41.2 GB/sec
   struct_all_null/cdc                                1.00      7.7±0.15ms     2.0 GB/sec    1.00      7.7±0.06ms     2.0 GB/sec
   struct_all_null/default                            1.00    120.2±0.20µs   131.0 GB/sec    1.00    119.9±0.43µs   131.3 GB/sec
   struct_all_null/parquet_2                          1.01    120.2±0.45µs   131.0 GB/sec    1.00    119.4±0.64µs   131.9 GB/sec
   struct_all_null/zstd                               1.00    167.2±0.32µs    94.2 GB/sec    1.00    166.9±0.42µs    94.3 GB/sec
   struct_all_null/zstd_parquet_2                     1.02    154.7±0.48µs   101.8 GB/sec    1.00    152.4±0.67µs   103.3 GB/sec
   struct_non_null/bloom_filter                       1.00     47.5±0.18ms   337.0 MB/sec    1.00     47.5±0.19ms   336.9 MB/sec
   struct_non_null/cdc                                1.00     45.8±0.15ms   349.1 MB/sec    1.00     45.7±0.20ms   349.7 MB/sec
   struct_non_null/default                            1.00     32.3±0.13ms   494.8 MB/sec    1.00     32.3±0.13ms   495.9 MB/sec
   struct_non_null/parquet_2                          1.06     43.4±1.86ms   368.3 MB/sec    1.00     41.1±0.16ms   389.5 MB/sec
   struct_non_null/zstd                               1.00     41.1±0.12ms   389.1 MB/sec    1.00     41.0±0.12ms   390.7 MB/sec
   struct_non_null/zstd_parquet_2                     1.02     56.0±1.87ms   285.6 MB/sec    1.00     55.1±0.16ms   290.1 MB/sec
   struct_sparse_99pct_null/bloom_filter              1.00      6.4±0.03ms     2.4 GB/sec    1.00      6.5±0.04ms     2.4 GB/sec
   struct_sparse_99pct_null/cdc                       1.00     13.3±0.08ms  1215.4 MB/sec    1.00     13.3±0.08ms  1215.5 MB/sec
   struct_sparse_99pct_null/default                   1.00      5.9±0.02ms     2.7 GB/sec    1.00      5.9±0.02ms     2.7 GB/sec
   struct_sparse_99pct_null/parquet_2                 1.00      5.9±0.02ms     2.7 GB/sec    1.01      6.0±0.02ms     2.6 GB/sec
   struct_sparse_99pct_null/zstd                      1.00      7.3±0.03ms     2.2 GB/sec    1.00      7.3±0.03ms     2.2 GB/sec
   struct_sparse_99pct_null/zstd_parquet_2            1.00      6.7±0.02ms     2.3 GB/sec    1.00      6.7±0.02ms     2.4 GB/sec
   ```
   
   </p>
   </details>
   
   <details><summary>Resource Usage</summary>
   
   **base (merge-base)**
   | Metric | Value |
   |--------|-------|
   | Wall time | 1935.4s |
   | Peak memory | 6.6 GiB |
   | Avg memory | 6.4 GiB |
   | CPU user | 1891.7s |
   | CPU sys | 43.0s |
   | Peak spill | 0 B |
   
   **branch**
   | Metric | Value |
   |--------|-------|
   | Wall time | 1940.4s |
   | Peak memory | 6.6 GiB |
   | Avg memory | 6.3 GiB |
   | CPU user | 1876.1s |
   | CPU sys | 59.7s |
   | Peak spill | 0 B |
   </details>
   
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [Not for merge] Make `ConvertedType` optional in the Parquet schema [arrow-rs]

Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #9980:
URL: https://github.com/apache/arrow-rs/pull/9980#issuecomment-4463158843

   🤖 Arrow criterion benchmark running (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9980#issuecomment-4462998181)
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c4462998181-153-l9d4l 6.12.68+ #1 SMP Wed Apr  1 02:23:28 UTC 2026 aarch64 GNU/Linux`
   <details><summary>CPU Details (lscpu)</summary>
   
   ```
   Architecture:                            aarch64
   CPU op-mode(s):                          64-bit
   Byte Order:                              Little Endian
   CPU(s):                                  16
   On-line CPU(s) list:                     0-15
   Vendor ID:                               ARM
   Model name:                              Neoverse-V2
   Model:                                   1
   Thread(s) per core:                      1
   Core(s) per cluster:                     16
   Socket(s):                               -
   Cluster(s):                              1
   Stepping:                                r0p1
   BogoMIPS:                                2000.00
   Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
   L1d cache:                               1 MiB (16 instances)
   L1i cache:                               1 MiB (16 instances)
   L2 cache:                                32 MiB (16 instances)
   L3 cache:                                80 MiB (1 instance)
   NUMA node(s):                            1
   NUMA node0 CPU(s):                       0-15
   Vulnerability Gather data sampling:      Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit:             Not affected
   Vulnerability L1tf:                      Not affected
   Vulnerability Mds:                       Not affected
   Vulnerability Meltdown:                  Not affected
   Vulnerability Mmio stale data:           Not affected
   Vulnerability Reg file data sampling:    Not affected
   Vulnerability Retbleed:                  Not affected
   Vulnerability Spec rstack overflow:      Not affected
   Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
   Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
   Vulnerability Spectre v2:                Mitigation; CSV2, BHB
   Vulnerability Srbds:                     Not affected
   Vulnerability Tsa:                       Not affected
   Vulnerability Tsx async abort:           Not affected
   Vulnerability Vmscape:                   Not affected
   ```
   
   </details>
   
   Comparing optional_conv_type (efb7f604e67d08e61cff4739afe5210af44478fc) to fd1c5b3 (merge-base) [diff](https://github.com/apache/arrow-rs/compare/fd1c5b391e169762a0981870c4e94baa3372d7a3..efb7f604e67d08e61cff4739afe5210af44478fc)
   BENCH_NAME=metadata
   BENCH_COMMAND=cargo bench --features=arrow,async,test_common,experimental,object_store --bench metadata
   BENCH_FILTER=
   Results will be posted here when complete
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [Not for merge] Make `ConvertedType` optional in the Parquet schema [arrow-rs]

Posted by "etseidl (via GitHub)" <gi...@apache.org>.
etseidl commented on PR #9980:
URL: https://github.com/apache/arrow-rs/pull/9980#issuecomment-4464525537

   Curiosity satisfied. There doesn't appear to be any performance impact, but there's also no compelling correctness nor ergonomic argument to be made for this breaking change.  


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [Not for merge] Make `ConvertedType` optional in the Parquet schema [arrow-rs]

Posted by "etseidl (via GitHub)" <gi...@apache.org>.
etseidl commented on PR #9980:
URL: https://github.com/apache/arrow-rs/pull/9980#issuecomment-4463797817

   run benchmarks arrow_reader arrow_writer


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [Not for merge] Make `ConvertedType` optional in the Parquet schema [arrow-rs]

Posted by "etseidl (via GitHub)" <gi...@apache.org>.
etseidl commented on PR #9980:
URL: https://github.com/apache/arrow-rs/pull/9980#issuecomment-4462994154

   run benchmark metadata, parquet_round_trip


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [Not for merge] Make `ConvertedType` optional in the Parquet schema [arrow-rs]

Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #9980:
URL: https://github.com/apache/arrow-rs/pull/9980#issuecomment-4463813809

   🤖 Arrow criterion benchmark running (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9980#issuecomment-4463797817)
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c4463797817-163-sgc9j 6.12.68+ #1 SMP Wed Apr  1 02:23:28 UTC 2026 aarch64 GNU/Linux`
   <details><summary>CPU Details (lscpu)</summary>
   
   ```
   Architecture:                            aarch64
   CPU op-mode(s):                          64-bit
   Byte Order:                              Little Endian
   CPU(s):                                  16
   On-line CPU(s) list:                     0-15
   Vendor ID:                               ARM
   Model name:                              Neoverse-V2
   Model:                                   1
   Thread(s) per core:                      1
   Core(s) per cluster:                     16
   Socket(s):                               -
   Cluster(s):                              1
   Stepping:                                r0p1
   BogoMIPS:                                2000.00
   Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
   L1d cache:                               1 MiB (16 instances)
   L1i cache:                               1 MiB (16 instances)
   L2 cache:                                32 MiB (16 instances)
   L3 cache:                                80 MiB (1 instance)
   NUMA node(s):                            1
   NUMA node0 CPU(s):                       0-15
   Vulnerability Gather data sampling:      Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit:             Not affected
   Vulnerability L1tf:                      Not affected
   Vulnerability Mds:                       Not affected
   Vulnerability Meltdown:                  Not affected
   Vulnerability Mmio stale data:           Not affected
   Vulnerability Reg file data sampling:    Not affected
   Vulnerability Retbleed:                  Not affected
   Vulnerability Spec rstack overflow:      Not affected
   Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
   Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
   Vulnerability Spectre v2:                Mitigation; CSV2, BHB
   Vulnerability Srbds:                     Not affected
   Vulnerability Tsa:                       Not affected
   Vulnerability Tsx async abort:           Not affected
   Vulnerability Vmscape:                   Not affected
   ```
   
   </details>
   
   Comparing optional_conv_type (70752e5a95559aa73374551e746fcf8e468a912c) to fd1c5b3 (merge-base) [diff](https://github.com/apache/arrow-rs/compare/fd1c5b391e169762a0981870c4e94baa3372d7a3..70752e5a95559aa73374551e746fcf8e468a912c)
   BENCH_NAME=arrow_writer
   BENCH_COMMAND=cargo bench --features=arrow,async,test_common,experimental,object_store --bench arrow_writer
   BENCH_FILTER=
   Results will be posted here when complete
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [Not for merge] Make `ConvertedType` optional in the Parquet schema [arrow-rs]

Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #9980:
URL: https://github.com/apache/arrow-rs/pull/9980#issuecomment-4462994442

   Hi @etseidl, thanks for the request (https://github.com/apache/arrow-rs/pull/9980#issuecomment-4462994154).
   
   Supported benchmarks:
   - Standard: (none)
   - Criterion: (any)
   
   Usage:
   ```
   run benchmark <name>           # run specific benchmark(s)
   run benchmarks                 # run default suite
   run benchmarks <name1> <name2> # run specific benchmarks
   ```
   
   Per-side configuration (`run benchmark tpch` followed by):
   ```yaml
   env:
   SHARED_SETTING: enabled
   baseline:
   ref: v45.0.0
   env:
   DATAFUSION_RUNTIME_MEMORY_LIMIT: 1G
   changed:
   ref: v46.0.0
   env:
   DATAFUSION_RUNTIME_MEMORY_LIMIT: 2G
   ```
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [Not for merge] Make `ConvertedType` optional in the Parquet schema [arrow-rs]

Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #9980:
URL: https://github.com/apache/arrow-rs/pull/9980#issuecomment-4463454525

   🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9980#issuecomment-4462998181)
   
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
   
   <details><summary>CPU Details (lscpu)</summary>
   
   ```
   Architecture:                            aarch64
   CPU op-mode(s):                          64-bit
   Byte Order:                              Little Endian
   CPU(s):                                  16
   On-line CPU(s) list:                     0-15
   Vendor ID:                               ARM
   Model name:                              Neoverse-V2
   Model:                                   1
   Thread(s) per core:                      1
   Core(s) per cluster:                     16
   Socket(s):                               -
   Cluster(s):                              1
   Stepping:                                r0p1
   BogoMIPS:                                2000.00
   Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
   L1d cache:                               1 MiB (16 instances)
   L1i cache:                               1 MiB (16 instances)
   L2 cache:                                32 MiB (16 instances)
   L3 cache:                                80 MiB (1 instance)
   NUMA node(s):                            1
   NUMA node0 CPU(s):                       0-15
   Vulnerability Gather data sampling:      Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit:             Not affected
   Vulnerability L1tf:                      Not affected
   Vulnerability Mds:                       Not affected
   Vulnerability Meltdown:                  Not affected
   Vulnerability Mmio stale data:           Not affected
   Vulnerability Reg file data sampling:    Not affected
   Vulnerability Retbleed:                  Not affected
   Vulnerability Spec rstack overflow:      Not affected
   Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
   Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
   Vulnerability Spectre v2:                Mitigation; CSV2, BHB
   Vulnerability Srbds:                     Not affected
   Vulnerability Tsa:                       Not affected
   Vulnerability Tsx async abort:           Not affected
   Vulnerability Vmscape:                   Not affected
   ```
   
   </details>
   
   <details><summary>Details</summary>
   <p>
   
   ```
   group                                     main                                   optional_conv_type
   -----                                     ----                                   ------------------
   read Binary(100) delta_byte_array         1.01      9.0±0.20ms        ? ?/sec    1.00      8.9±0.23ms        ? ?/sec
   read Binary(100) delta_length             1.00      3.5±0.09ms        ? ?/sec    1.01      3.6±0.07ms        ? ?/sec
   read Binary(100) dict                     1.00      4.0±0.04ms        ? ?/sec    1.00      4.0±0.04ms        ? ?/sec
   read Binary(100) plain                    1.00      4.5±0.25ms        ? ?/sec    1.00      4.5±0.26ms        ? ?/sec
   read Binary(20) delta_byte_array          1.00      4.9±0.04ms        ? ?/sec    1.00      4.9±0.02ms        ? ?/sec
   read Binary(20) delta_length              1.00  1922.5±77.22µs        ? ?/sec    1.00  1913.8±78.19µs        ? ?/sec
   read Binary(20) dict                      1.00      2.6±0.01ms        ? ?/sec    1.00      2.6±0.01ms        ? ?/sec
   read Binary(20) plain                     1.01      2.9±0.09ms        ? ?/sec    1.00      2.9±0.09ms        ? ?/sec
   read Fixed(16) byte_stream_split          1.00      5.5±0.02ms        ? ?/sec    1.00      5.5±0.04ms        ? ?/sec
   read Fixed(16) delta_byte_array           1.00      3.4±0.08ms        ? ?/sec    1.03      3.5±0.10ms        ? ?/sec
   read Fixed(16) dict                       1.00   651.0±22.94µs        ? ?/sec    1.00   648.0±11.83µs        ? ?/sec
   read Fixed(16) plain                      1.00   638.1±19.77µs        ? ?/sec    1.02   649.2±22.47µs        ? ?/sec
   read Fixed(2) byte_stream_split           1.00    936.5±2.99µs        ? ?/sec    1.00    933.7±3.13µs        ? ?/sec
   read Fixed(2) delta_byte_array            1.00      3.2±0.01ms        ? ?/sec    1.00      3.2±0.02ms        ? ?/sec
   read Fixed(2) dict                        1.00    436.5±2.63µs        ? ?/sec    1.01    440.4±2.96µs        ? ?/sec
   read Fixed(2) plain                       1.00    444.0±2.39µs        ? ?/sec    1.00    443.4±1.70µs        ? ?/sec
   read String(100) delta_byte_array         1.00      9.8±0.20ms        ? ?/sec    1.00      9.8±0.23ms        ? ?/sec
   read String(100) delta_length             1.00      4.6±0.08ms        ? ?/sec    1.03      4.7±0.10ms        ? ?/sec
   read String(100) dict                     1.01      4.0±0.04ms        ? ?/sec    1.00      4.0±0.04ms        ? ?/sec
   read String(100) plain                    1.00      5.3±0.34ms        ? ?/sec    1.01      5.4±0.30ms        ? ?/sec
   read String(20) delta_byte_array          1.00      5.3±0.05ms        ? ?/sec    1.00      5.3±0.04ms        ? ?/sec
   read String(20) delta_length              1.00      2.1±0.09ms        ? ?/sec    1.06      2.2±0.12ms        ? ?/sec
   read String(20) dict                      1.01      2.6±0.01ms        ? ?/sec    1.00      2.6±0.02ms        ? ?/sec
   read String(20) plain                     1.00      3.0±0.08ms        ? ?/sec    1.02      3.1±0.07ms        ? ?/sec
   read StringView(100) delta_byte_array     1.00      9.1±0.23ms        ? ?/sec    1.00      9.1±0.21ms        ? ?/sec
   read StringView(100) delta_length         1.00      4.9±0.26ms        ? ?/sec    1.00      4.9±0.35ms        ? ?/sec
   read StringView(100) dict                 1.00    998.7±5.03µs        ? ?/sec    1.00    999.6±3.66µs        ? ?/sec
   read StringView(100) plain                1.01      5.5±0.11ms        ? ?/sec    1.00      5.4±0.24ms        ? ?/sec
   read StringView(20) delta_byte_array      1.00      5.3±0.05ms        ? ?/sec    1.01      5.3±0.04ms        ? ?/sec
   read StringView(20) delta_length          1.04      2.7±0.14ms        ? ?/sec    1.00      2.6±0.12ms        ? ?/sec
   read StringView(20) dict                  1.00    985.1±3.91µs        ? ?/sec    1.00    990.0±4.24µs        ? ?/sec
   read StringView(20) plain                 1.03  1809.1±73.18µs        ? ?/sec    1.00  1759.1±113.35µs        ? ?/sec
   read f32 byte_stream_split                1.00   1033.5±9.85µs        ? ?/sec    1.01  1045.8±11.62µs        ? ?/sec
   read f32 dict                             1.00   1456.6±6.56µs        ? ?/sec    1.00   1451.9±6.61µs        ? ?/sec
   read f32 plain                            1.00   970.5±16.85µs        ? ?/sec    1.00   966.0±14.42µs        ? ?/sec
   read f64 byte_stream_split                1.03  1661.0±94.87µs        ? ?/sec    1.00  1615.3±89.03µs        ? ?/sec
   read f64 dict                             1.00   1487.1±7.82µs        ? ?/sec    1.00   1490.3±7.51µs        ? ?/sec
   read f64 plain                            1.01  1134.3±27.76µs        ? ?/sec    1.00  1119.4±14.47µs        ? ?/sec
   read int32 byte_stream_split              1.00  1080.1±12.87µs        ? ?/sec    1.00  1082.0±13.90µs        ? ?/sec
   read int32 delta_binary                   1.01      2.2±0.05ms        ? ?/sec    1.00      2.2±0.05ms        ? ?/sec
   read int32 dict                           1.00   1517.9±8.83µs        ? ?/sec    1.00   1514.5±6.70µs        ? ?/sec
   read int32 plain                          1.01   1028.4±9.46µs        ? ?/sec    1.00   1023.0±7.88µs        ? ?/sec
   read int64 byte_stream_split              1.01  1662.3±47.66µs        ? ?/sec    1.00  1645.5±34.88µs        ? ?/sec
   read int64 delta_binary                   1.00      2.5±0.09ms        ? ?/sec    1.01      2.5±0.09ms        ? ?/sec
   read int64 dict                           1.01   1554.6±6.58µs        ? ?/sec    1.00   1546.6±3.50µs        ? ?/sec
   read int64 plain                          1.00  1178.5±40.12µs        ? ?/sec    1.00  1183.8±47.77µs        ? ?/sec
   write Binary(100) delta_byte_array        1.00     18.7±1.47ms        ? ?/sec    1.45     27.1±0.35ms        ? ?/sec
   write Binary(100) delta_length            1.00     14.5±0.91ms        ? ?/sec    1.08     15.7±1.81ms        ? ?/sec
   write Binary(100) dict                    1.01     17.7±0.05ms        ? ?/sec    1.00     17.5±0.04ms        ? ?/sec
   write Binary(100) plain                   1.00     12.8±0.40ms        ? ?/sec    1.00     12.9±0.40ms        ? ?/sec
   write Binary(20) delta_byte_array         1.00     12.7±0.04ms        ? ?/sec    1.00     12.7±0.07ms        ? ?/sec
   write Binary(20) delta_length             1.00      9.1±0.05ms        ? ?/sec    1.03      9.4±0.06ms        ? ?/sec
   write Binary(20) dict                     1.01     13.3±0.03ms        ? ?/sec    1.00     13.1±0.04ms        ? ?/sec
   write Binary(20) plain                    1.01      8.2±0.04ms        ? ?/sec    1.00      8.2±0.02ms        ? ?/sec
   write Fixed(16) byte_stream_split         1.01     27.6±0.16ms        ? ?/sec    1.00     27.3±0.15ms        ? ?/sec
   write Fixed(16) delta_byte_array          1.00     64.4±0.35ms        ? ?/sec    1.01     65.1±0.22ms        ? ?/sec
   write Fixed(16) dict                      1.01     22.8±0.16ms        ? ?/sec    1.00     22.5±0.12ms        ? ?/sec
   write Fixed(16) plain                     1.01     22.7±0.16ms        ? ?/sec    1.00     22.5±0.17ms        ? ?/sec
   write Fixed(2) byte_stream_split          1.01     21.8±0.07ms        ? ?/sec    1.00     21.5±0.05ms        ? ?/sec
   write Fixed(2) delta_byte_array           1.00     63.3±0.21ms        ? ?/sec    1.01     63.8±0.29ms        ? ?/sec
   write Fixed(2) dict                       1.01     22.6±0.11ms        ? ?/sec    1.00     22.4±0.08ms        ? ?/sec
   write Fixed(2) plain                      1.01     22.6±0.07ms        ? ?/sec    1.00     22.4±0.11ms        ? ?/sec
   write String(100) delta_byte_array        1.01     28.2±0.92ms        ? ?/sec    1.00     27.9±0.38ms        ? ?/sec
   write String(100) delta_length            1.01     23.7±0.79ms        ? ?/sec    1.00     23.5±0.97ms        ? ?/sec
   write String(100) dict                    1.01     17.7±0.04ms        ? ?/sec    1.00     17.5±0.03ms        ? ?/sec
   write String(100) plain                   1.00     12.7±0.40ms        ? ?/sec    1.00     12.7±0.37ms        ? ?/sec
   write String(20) delta_byte_array         1.00     12.9±0.07ms        ? ?/sec    1.00     12.9±0.08ms        ? ?/sec
   write String(20) delta_length             1.00      9.4±0.06ms        ? ?/sec    1.00      9.5±0.03ms        ? ?/sec
   write String(20) dict                     1.01     13.2±0.03ms        ? ?/sec    1.00     13.1±0.03ms        ? ?/sec
   write String(20) plain                    1.00      8.1±0.04ms        ? ?/sec    1.00      8.2±0.05ms        ? ?/sec
   write StringView(100) delta_byte_array    1.00     17.9±0.36ms        ? ?/sec    1.58     28.2±1.04ms        ? ?/sec
   write StringView(100) delta_length        1.00     14.3±0.24ms        ? ?/sec    1.71     24.4±0.38ms        ? ?/sec
   write StringView(100) dict                1.00     18.6±0.06ms        ? ?/sec    1.00     18.5±0.05ms        ? ?/sec
   write StringView(100) plain               1.02     13.2±0.24ms        ? ?/sec    1.00     12.9±0.38ms        ? ?/sec
   write StringView(20) delta_byte_array     1.00     12.8±0.05ms        ? ?/sec    1.00     12.9±0.08ms        ? ?/sec
   write StringView(20) delta_length         1.00      9.5±0.05ms        ? ?/sec    1.00      9.5±0.06ms        ? ?/sec
   write StringView(20) dict                 1.01     13.5±0.04ms        ? ?/sec    1.00     13.4±0.04ms        ? ?/sec
   write StringView(20) plain                1.00      8.1±0.03ms        ? ?/sec    1.00      8.1±0.03ms        ? ?/sec
   write f32 byte_stream_split               1.00      5.1±0.04ms        ? ?/sec    1.00      5.1±0.03ms        ? ?/sec
   write f32 dict                            1.01     16.2±0.05ms        ? ?/sec    1.00     16.1±0.06ms        ? ?/sec
   write f32 plain                           1.01      5.2±0.04ms        ? ?/sec    1.00      5.1±0.04ms        ? ?/sec
   write f64 byte_stream_split               1.01      6.8±0.03ms        ? ?/sec    1.00      6.8±0.03ms        ? ?/sec
   write f64 dict                            1.01     16.2±0.06ms        ? ?/sec    1.00     16.1±0.05ms        ? ?/sec
   write f64 plain                           1.01      5.9±0.05ms        ? ?/sec    1.00      5.9±0.05ms        ? ?/sec
   write int32 byte_stream_split             1.00      5.4±0.04ms        ? ?/sec    1.00      5.4±0.03ms        ? ?/sec
   write int32 delta_binary                  1.00     10.8±0.05ms        ? ?/sec    1.00     10.8±0.09ms        ? ?/sec
   write int32 dict                          1.00     16.9±0.09ms        ? ?/sec    1.00     16.9±0.08ms        ? ?/sec
   write int32 plain                         1.00      5.5±0.03ms        ? ?/sec    1.00      5.5±0.03ms        ? ?/sec
   write int64 byte_stream_split             1.01      6.9±0.04ms        ? ?/sec    1.00      6.9±0.04ms        ? ?/sec
   write int64 delta_binary                  1.00     12.0±0.13ms        ? ?/sec    1.01     12.1±0.18ms        ? ?/sec
   write int64 dict                          1.00     16.6±0.07ms        ? ?/sec    1.00     16.5±0.06ms        ? ?/sec
   write int64 plain                         1.00      6.2±0.04ms        ? ?/sec    1.00      6.2±0.04ms        ? ?/sec
   ```
   
   </p>
   </details>
   
   <details><summary>Resource Usage</summary>
   
   **base (merge-base)**
   | Metric | Value |
   |--------|-------|
   | Wall time | 965.2s |
   | Peak memory | 8.9 GiB |
   | Avg memory | 5.5 GiB |
   | CPU user | 930.0s |
   | CPU sys | 33.1s |
   | Peak spill | 0 B |
   
   **branch**
   | Metric | Value |
   |--------|-------|
   | Wall time | 950.2s |
   | Peak memory | 8.9 GiB |
   | Avg memory | 5.3 GiB |
   | CPU user | 906.7s |
   | CPU sys | 39.4s |
   | Peak spill | 0 B |
   </details>
   
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [Not for merge] Make `ConvertedType` optional in the Parquet schema [arrow-rs]

Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #9980:
URL: https://github.com/apache/arrow-rs/pull/9980#issuecomment-4463794276

   🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9980#issuecomment-4463760843)
   
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB)
   
   <details><summary>CPU Details (lscpu)</summary>
   
   ```
   Architecture:                            aarch64
   CPU op-mode(s):                          64-bit
   Byte Order:                              Little Endian
   CPU(s):                                  16
   On-line CPU(s) list:                     0-15
   Vendor ID:                               ARM
   Model name:                              Neoverse-V2
   Model:                                   1
   Thread(s) per core:                      1
   Core(s) per cluster:                     16
   Socket(s):                               -
   Cluster(s):                              1
   Stepping:                                r0p1
   BogoMIPS:                                2000.00
   Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
   L1d cache:                               1 MiB (16 instances)
   L1i cache:                               1 MiB (16 instances)
   L2 cache:                                32 MiB (16 instances)
   L3 cache:                                80 MiB (1 instance)
   NUMA node(s):                            1
   NUMA node0 CPU(s):                       0-15
   Vulnerability Gather data sampling:      Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit:             Not affected
   Vulnerability L1tf:                      Not affected
   Vulnerability Mds:                       Not affected
   Vulnerability Meltdown:                  Not affected
   Vulnerability Mmio stale data:           Not affected
   Vulnerability Reg file data sampling:    Not affected
   Vulnerability Retbleed:                  Not affected
   Vulnerability Spec rstack overflow:      Not affected
   Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
   Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
   Vulnerability Spectre v2:                Mitigation; CSV2, BHB
   Vulnerability Srbds:                     Not affected
   Vulnerability Tsa:                       Not affected
   Vulnerability Tsx async abort:           Not affected
   Vulnerability Vmscape:                   Not affected
   ```
   
   </details>
   
   <details><summary>Details</summary>
   <p>
   
   ```
   group                                     main                                   optional_conv_type
   -----                                     ----                                   ------------------
   write StringView(100) delta_byte_array    1.01     17.5±0.03ms        ? ?/sec    1.00     17.3±0.05ms        ? ?/sec
   write StringView(100) delta_length        1.01     13.7±0.03ms        ? ?/sec    1.00     13.6±0.05ms        ? ?/sec
   write StringView(100) dict                1.00     18.5±0.04ms        ? ?/sec    1.00     18.5±0.08ms        ? ?/sec
   write StringView(100) plain               1.00     12.6±0.02ms        ? ?/sec    1.00     12.6±0.06ms        ? ?/sec
   write StringView(20) delta_byte_array     1.00     12.4±0.02ms        ? ?/sec    1.00     12.4±0.06ms        ? ?/sec
   write StringView(20) delta_length         1.00      9.2±0.02ms        ? ?/sec    1.00      9.2±0.04ms        ? ?/sec
   write StringView(20) dict                 1.00     13.5±0.03ms        ? ?/sec    1.00     13.4±0.04ms        ? ?/sec
   write StringView(20) plain                1.00      8.0±0.01ms        ? ?/sec    1.00      8.1±0.04ms        ? ?/sec
   ```
   
   </p>
   </details>
   
   <details><summary>Resource Usage</summary>
   
   **base (merge-base)**
   | Metric | Value |
   |--------|-------|
   | Wall time | 85.0s |
   | Peak memory | 8.9 GiB |
   | Avg memory | 5.8 GiB |
   | CPU user | 74.9s |
   | CPU sys | 5.9s |
   | Peak spill | 0 B |
   
   **branch**
   | Metric | Value |
   |--------|-------|
   | Wall time | 80.0s |
   | Peak memory | 8.9 GiB |
   | Avg memory | 5.9 GiB |
   | CPU user | 74.3s |
   | CPU sys | 5.4s |
   | Peak spill | 0 B |
   </details>
   
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [Not for merge] Make `ConvertedType` optional in the Parquet schema [arrow-rs]

Posted by "adriangbot (via GitHub)" <gi...@apache.org>.
adriangbot commented on PR #9980:
URL: https://github.com/apache/arrow-rs/pull/9980#issuecomment-4463778490

   🤖 Arrow criterion benchmark running (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9980#issuecomment-4463760843)
   **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) | `Linux bench-c4463760843-161-mb5s5 6.12.68+ #1 SMP Wed Apr  1 02:23:28 UTC 2026 aarch64 GNU/Linux`
   <details><summary>CPU Details (lscpu)</summary>
   
   ```
   Architecture:                            aarch64
   CPU op-mode(s):                          64-bit
   Byte Order:                              Little Endian
   CPU(s):                                  16
   On-line CPU(s) list:                     0-15
   Vendor ID:                               ARM
   Model name:                              Neoverse-V2
   Model:                                   1
   Thread(s) per core:                      1
   Core(s) per cluster:                     16
   Socket(s):                               -
   Cluster(s):                              1
   Stepping:                                r0p1
   BogoMIPS:                                2000.00
   Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
   L1d cache:                               1 MiB (16 instances)
   L1i cache:                               1 MiB (16 instances)
   L2 cache:                                32 MiB (16 instances)
   L3 cache:                                80 MiB (1 instance)
   NUMA node(s):                            1
   NUMA node0 CPU(s):                       0-15
   Vulnerability Gather data sampling:      Not affected
   Vulnerability Indirect target selection: Not affected
   Vulnerability Itlb multihit:             Not affected
   Vulnerability L1tf:                      Not affected
   Vulnerability Mds:                       Not affected
   Vulnerability Meltdown:                  Not affected
   Vulnerability Mmio stale data:           Not affected
   Vulnerability Reg file data sampling:    Not affected
   Vulnerability Retbleed:                  Not affected
   Vulnerability Spec rstack overflow:      Not affected
   Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
   Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
   Vulnerability Spectre v2:                Mitigation; CSV2, BHB
   Vulnerability Srbds:                     Not affected
   Vulnerability Tsa:                       Not affected
   Vulnerability Tsx async abort:           Not affected
   Vulnerability Vmscape:                   Not affected
   ```
   
   </details>
   
   Comparing optional_conv_type (1517231ae51445d4d90d26c5142e2e78a2fc9c5d) to fd1c5b3 (merge-base) [diff](https://github.com/apache/arrow-rs/compare/fd1c5b391e169762a0981870c4e94baa3372d7a3..1517231ae51445d4d90d26c5142e2e78a2fc9c5d)
   BENCH_NAME=parquet_round_trip
   BENCH_COMMAND=cargo bench --features=arrow,async,test_common,experimental,object_store --bench parquet_round_trip
   BENCH_FILTER=write StringView
   Results will be posted here when complete
   
   ---
   [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [Not for merge] Make `ConvertedType` optional in the Parquet schema [arrow-rs]

Posted by "etseidl (via GitHub)" <gi...@apache.org>.
etseidl closed pull request #9980: [Not for merge] Make `ConvertedType` optional in the Parquet schema
URL: https://github.com/apache/arrow-rs/pull/9980


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org