You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iggy.apache.org by "hubcio (via GitHub)" <gi...@apache.org> on 2025/11/20 20:22:43 UTC

[I] Make iggy-server aware of NUMA [iggy]

hubcio opened a new issue, #2387:
URL: https://github.com/apache/iggy/issues/2387

   Use crate https://github.com/HadrienG2/hwlocality to improve CPU affinity so that shards are aware of NUMA boundaries (avoid hyperthreading contention).
   
   Current State
   - Basic CPU affinity in `core/server/src/configs/sharding.rs` via `CpuAllocation` enum
   - Simple ranges/counts without NUMA topology awareness
   - Uses `compio::runtime::RuntimeBuilder::thread_affinity()` in `bootstrap.rs:148`
   
   Implementation
   1. Detect NUMA topology - identify nodes, physical/logical cores, memory localities
   2. Extend `CpuAllocation`:
   ```rust
   NumaAware {
       nodes: Vec<usize>,         // Which NUMA nodes to use
       cores_per_node: usize,     // Cores per node
       avoid_hyperthreads: bool,  // Skip SMT siblings
   }
   ```
   3. Shard distribution - map shards to NUMA nodes, pin threads to domains
   4. Memory locality  - allocate shard buffers on local NUMA node
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Make iggy-server aware of NUMA [iggy]

Posted by "hubcio (via GitHub)" <gi...@apache.org>.
hubcio commented on issue #2387:
URL: https://github.com/apache/iggy/issues/2387#issuecomment-3654843899

   Closing because #2412 was merged.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Make iggy-server aware of NUMA [iggy]

Posted by "tungtose (via GitHub)" <gi...@apache.org>.
tungtose commented on issue #2387:
URL: https://github.com/apache/iggy/issues/2387#issuecomment-3561612696

   @hubcio Could you please assign this to me?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Make iggy-server aware of NUMA [iggy]

Posted by "hubcio (via GitHub)" <gi...@apache.org>.
hubcio closed issue #2387: Make iggy-server aware of NUMA
URL: https://github.com/apache/iggy/issues/2387


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@iggy.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org