You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iggy.apache.org by "hubcio (via GitHub)" <gi...@apache.org> on 2025/11/20 20:22:43 UTC
[I] Make iggy-server aware of NUMA [iggy]
hubcio opened a new issue, #2387:
URL: https://github.com/apache/iggy/issues/2387
Use crate https://github.com/HadrienG2/hwlocality to improve CPU affinity so that shards are aware of NUMA boundaries (avoid hyperthreading contention).
Current State
- Basic CPU affinity in `core/server/src/configs/sharding.rs` via `CpuAllocation` enum
- Simple ranges/counts without NUMA topology awareness
- Uses `compio::runtime::RuntimeBuilder::thread_affinity()` in `bootstrap.rs:148`
Implementation
1. Detect NUMA topology - identify nodes, physical/logical cores, memory localities
2. Extend `CpuAllocation`:
```rust
NumaAware {
nodes: Vec<usize>, // Which NUMA nodes to use
cores_per_node: usize, // Cores per node
avoid_hyperthreads: bool, // Skip SMT siblings
}
```
3. Shard distribution - map shards to NUMA nodes, pin threads to domains
4. Memory locality - allocate shard buffers on local NUMA node
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Make iggy-server aware of NUMA [iggy]
Posted by "hubcio (via GitHub)" <gi...@apache.org>.
hubcio commented on issue #2387:
URL: https://github.com/apache/iggy/issues/2387#issuecomment-3654843899
Closing because #2412 was merged.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Make iggy-server aware of NUMA [iggy]
Posted by "tungtose (via GitHub)" <gi...@apache.org>.
tungtose commented on issue #2387:
URL: https://github.com/apache/iggy/issues/2387#issuecomment-3561612696
@hubcio Could you please assign this to me?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Make iggy-server aware of NUMA [iggy]
Posted by "hubcio (via GitHub)" <gi...@apache.org>.
hubcio closed issue #2387: Make iggy-server aware of NUMA
URL: https://github.com/apache/iggy/issues/2387
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org