You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "fallintoplace (via GitHub)" <gi...@apache.org> on 2026/08/27 19:11:07 UTC

[PR] perf(table): avoid heap scratch in canonical partition keys [iceberg-go]

fallintoplace opened a new pull request, #1921:
URL: https://github.com/apache/iceberg-go/pull/1921

   ## What changed
   
   - Reuse small stack buffers in `canonicalPartitionKey`.
   - Keep the existing heap fallback for wider partitions and longer keys.
   - Keep sorting, value normalization, and key encoding unchanged.
   - Add a focused benchmark and a test for the wide-partition fallback.
   
   ## Benchmark
   
   Ran on an Apple M1 Pro (`darwin/arm64`) with Go `go1.26.3`.
   
   ```text
   go test ./table -run '^$' -bench '^BenchmarkCanonicalPartitionKey$' -benchmem -count=5 -benchtime=1s
   ```
   
   Median of 5 runs:
   
   | Case | ns/op before | ns/op after | B/op before -> after | allocs/op before -> after |
   | --- | ---: | ---: | ---: | ---: |
   | fields=1/int32 | 84.39 | 73.89 | 16 -> 8 | 2 -> 1 |
   | fields=2/int32 | 179.8 | 94.01 | 40 -> 16 | 3 -> 1 |
   | fields=4/int32 | 244.6 | 140.5 | 88 -> 32 | 4 -> 1 |
   | fields=8/mixed | 435.8 | 247.0 | 392 -> 80 | 7 -> 1 |
   | fields=4/binary-string | 254.8 | 157.2 | 184 -> 64 | 5 -> 1 |
   | fields=16/mixed | 782.1 | 602.8 | 792 -> 288 | 8 -> 2 |
   
   The common cases now use one allocation for the returned string. The wide case still exercises the heap fallback.
   
   ## Checks
   
   - `go test ./...`
   - `go vet ./...`
   - `go test -race ./table`
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [PR] perf(table): avoid heap scratch in canonical partition keys [iceberg-go]

Posted by "zeroshade (via GitHub)" <gi...@apache.org>.
zeroshade merged PR #1921:
URL: https://github.com/apache/iceberg-go/pull/1921


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org