You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@iggy.apache.org by "grainier (via GitHub)" <gi...@apache.org> on 2026/03/13 15:20:59 UTC
segment_rotation_scenario test fails with "Too many open files" on macOS
GitHub user grainier created a discussion: segment_rotation_scenario test fails with "Too many open files" on macOS
`server::specific::segment_rotation_scenario` fails with os error 24, even when run in isolation: `cargo test -p integration segment_rotation_scenario`
Failed to open index file: .../00000000000000004555.index. Too many open files (os error 24)
```
2026-03-13T13:25:37.088335Z ERROR shard-1 err_trail: Failed to open messages file: /Users/grainier/NoBackup/iggy/test_logs/server__specific__segment_rotation_scenario_ebe5acb3/server_0_local_data/streams/0/topics/0/partitions/0/00000000000000004550.log. Too many open files (os error 24)
2026-03-13T13:25:37.088363Z ERROR shard-0 server::websocket::connection_handler: Command failed for session: client ID: 1004445935, user ID: 0, IP address: 127.0.0.1:57411, error: Cannot read file.
2026-03-13T13:25:37.088501Z ERROR shard-1 err_trail: Failed to open index file: /Users/grainier/NoBackup/iggy/test_logs/server__specific__segment_rotation_scenario_ebe5acb3/server_0_local_data/streams/0/topics/0/partitions/0/00000000000000004555.index. Too many open files (os error 24)
2026-03-13T13:25:37.088528Z ERROR shard-0 server::websocket::connection_handler: Command failed for session: client ID: 1838626354, user ID: 0, IP address: 127.0.0.1:57412, error: Cannot read file.
```
I also tried setting `ulimit -n 10240` before running. Same result.
**Environment:**
```
- macOS 26.2, Apple M4, 24 GB RAM
- launchctl limit maxfiles: soft=256, hard=unlimited
- kern.maxfilesperproc: 92160
- Rust 1.94.0
```
Question:
1. Is this known? and Is there a recommended macOS FD limit config for running the test suite?
GitHub link: https://github.com/apache/iggy/discussions/2930
----
This is an automatically sent email for dev@iggy.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@iggy.apache.org
Re: segment_rotation_scenario test fails with "Too many open files" on macOS
Posted by "grainier (via GitHub)" <gi...@apache.org>.
GitHub user grainier added a comment to the discussion: segment_rotation_scenario test fails with "Too many open files" on macOS
Thanks. Setting `const TEST_DURATION_SECS: u64 = 2;` worked.
GitHub link: https://github.com/apache/iggy/discussions/2930#discussioncomment-16141777
----
This is an automatically sent email for dev@iggy.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@iggy.apache.org
Re: segment_rotation_scenario test fails with "Too many open files" on macOS
Posted by "hubcio (via GitHub)" <gi...@apache.org>.
GitHub user hubcio added a comment to the discussion: segment_rotation_scenario test fails with "Too many open files" on macOS
AFAIK on linux on my PC this test uses around 20-30k FDs. we can reduce the time that it runs (right now it's 10s, see top of the file) - this should reduce the total FDs. can you test it with time set to e.g. 2s and check if it helped?
GitHub link: https://github.com/apache/iggy/discussions/2930#discussioncomment-16141042
----
This is an automatically sent email for dev@iggy.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@iggy.apache.org
Re: segment_rotation_scenario test fails with "Too many open files" on macOS
Posted by "grainier (via GitHub)" <gi...@apache.org>.
GitHub user grainier closed a discussion: segment_rotation_scenario test fails with "Too many open files" on macOS
`server::specific::segment_rotation_scenario` fails with os error 24, even when run in isolation: `cargo test -p integration segment_rotation_scenario`
Failed to open index file: .../00000000000000004555.index. Too many open files (os error 24)
```
2026-03-13T13:25:37.088335Z ERROR shard-1 err_trail: Failed to open messages file: /Users/grainier/NoBackup/iggy/test_logs/server__specific__segment_rotation_scenario_ebe5acb3/server_0_local_data/streams/0/topics/0/partitions/0/00000000000000004550.log. Too many open files (os error 24)
2026-03-13T13:25:37.088363Z ERROR shard-0 server::websocket::connection_handler: Command failed for session: client ID: 1004445935, user ID: 0, IP address: 127.0.0.1:57411, error: Cannot read file.
2026-03-13T13:25:37.088501Z ERROR shard-1 err_trail: Failed to open index file: /Users/grainier/NoBackup/iggy/test_logs/server__specific__segment_rotation_scenario_ebe5acb3/server_0_local_data/streams/0/topics/0/partitions/0/00000000000000004555.index. Too many open files (os error 24)
2026-03-13T13:25:37.088528Z ERROR shard-0 server::websocket::connection_handler: Command failed for session: client ID: 1838626354, user ID: 0, IP address: 127.0.0.1:57412, error: Cannot read file.
```
I also tried setting `ulimit -n 10240` before running. Same result.
**Environment:**
```
- macOS 26.2, Apple M4, 24 GB RAM
- launchctl limit maxfiles: soft=256, hard=unlimited
- kern.maxfilesperproc: 92160
- Rust 1.94.0
```
Question:
1. Is this known? and Is there a recommended macOS FD limit config for running the test suite?
GitHub link: https://github.com/apache/iggy/discussions/2930
----
This is an automatically sent email for dev@iggy.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@iggy.apache.org