You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "fallintoplace (via GitHub)" <gi...@apache.org> on 2026/10/20 09:22:42 UTC

[PR] perf(table): read partition manifests concurrently [iceberg-go]

fallintoplace opened a new pull request, #2228:
URL: https://github.com/apache/iceberg-go/pull/2228

   ## What
   - Read partition manifests concurrently in `Inspect().Partitions()`.
   
   ## Why
   - Serial manifest reads add up when metadata is remote.
   
   ## Implementation
   - Process up to 8 manifests at a time.
   - Merge results in manifest order to keep timestamp tie-breaking stable.
   
   ## Benchmark
   - Go 1.26.3, Apple M1 Pro, 10 ms simulated delay per manifest open; median of 5 runs.
   - 8 manifests: 90.6 ms → 13.6 ms (6.7x); 32: 371.6 ms → 51.4 ms (7.2x).
   - 1 manifest: 11.1 ms → 11.6 ms (~4% slower). Allocation counts rise less than 0.5%.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org


Re: [PR] perf(table): read partition manifests concurrently [iceberg-go]

Posted by "zeroshade (via GitHub)" <gi...@apache.org>.
zeroshade merged PR #2228:
URL: https://github.com/apache/iceberg-go/pull/2228


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org