You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@trafficserver.apache.org by GitBox <gi...@apache.org> on 2020/09/21 16:00:19 UTC
[GitHub] [trafficserver] elsloo commented on issue #7204: Rolled logs are not removed when max_space_mb reached
elsloo commented on issue #7204:
URL: https://github.com/apache/trafficserver/issues/7204#issuecomment-696210488
After further testing, I've narrowed this down to when `logging.yaml` is updated. Once that file is touched, regardless of whether or not a config change is present, and the config is reloaded, log rolling stops working. There is no "Error opening logging directory..." message logged.
To reproduce, I lowered the log rolling thresholds, and directed traffic toward ATS until it started rolling logs. I then updated records.config to enable debug for the `logspace` tag, touched `logging.yaml` and reloaded the config via `traffic_ctl config reload`. I also reproduced the issue by performing the same sequence, but starting with an empty log directory, and reloading the configuration prior to the log directory being deemed full by ATS. The debug output of these steps follow, marked as sequence A and B, respectively.
**Sequence A:**
```
traffic_manager[54905]: traffic_manager NOTE: User has changed config file logging.yaml
traffic_manager[54905]: traffic_manager NOTE: User has changed config file records.config
traffic_manager[54905]: traffic_manager NOTE: updated diags config
traffic_server[54915]: [ET_NET 5] NOTE: updated diags config
traffic_server[54915]: [LOG_FLUSH] NOTE: Cannot clear space because there are no recognized Traffic Server rolled logs for auto deletion.
traffic_manager[54905]: [Sep 21 15:44:10.005] [LOG_FLUSH] DEBUG: <LogConfig.cc:119 (register_rolled_log_auto_delete)> (logspace) Registering rotated log deletion for diags.log with min roll count 0
traffic_manager[54905]: [Sep 21 15:44:10.005] [LOG_FLUSH] DEBUG: <LogConfig.cc:119 (register_rolled_log_auto_delete)> (logspace) Registering rotated log deletion for manager.log with min roll count 0
traffic_manager[54905]: [Sep 21 15:44:10.005] [LOG_FLUSH] DEBUG: <LogConfig.cc:119 (register_rolled_log_auto_delete)> (logspace) Registering rotated log deletion for traffic.out with min roll count 0
traffic_manager[54905]: [Sep 21 15:44:10.006] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 211372870 bytes being used for logs
traffic_manager[54905]: [Sep 21 15:44:10.006] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5111513088 bytes left on partition
traffic_manager[54905]: [Sep 21 15:44:10.006] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 316230470, configured space 314572800, physical space left 5006655488, partition headroom 10485760, space is not available
traffic_manager[54905]: [Sep 21 15:44:10.006] [LOG_FLUSH] DEBUG: <LogConfig.cc:683 (update_space_used)> (logspace) headroom reached, trying to clear space ...
traffic_manager[54905]: [Sep 21 15:44:10.006] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 316230470, configured space 314572800, physical space left 5006655488, partition headroom 10485760, space is not available
traffic_server[54915]: [LOG_FLUSH] NOTE: Logging space exhausted, any logs writing to local disk will be dropped!
traffic_manager[54905]: [Sep 21 15:44:10.009] [LOG_FLUSH] DEBUG: <LogConfig.cc:119 (register_rolled_log_auto_delete)> (logspace) Registering rotated log deletion for public_request.log with min roll count 0
traffic_manager[54905]: [Sep 21 15:44:10.009] [LOG_FLUSH] DEBUG: <LogConfig.cc:119 (register_rolled_log_auto_delete)> (logspace) Registering rotated log deletion for private_request.log with min roll count 0
traffic_server[54915]: [LOG_FLUSH] WARNING: Access logging to local log directory suspended - configured space allocation almost exhausted.
traffic_manager[54905]: [Sep 21 15:44:10.009] [LOG_FLUSH] DEBUG: <LogConfig.cc:119 (register_rolled_log_auto_delete)> (logspace) Registering rotated log deletion for specific_remap.log with min roll count 0
traffic_manager[54905]: [Sep 21 15:44:10.009] [LOG_FLUSH] DEBUG: <LogConfig.cc:119 (register_rolled_log_auto_delete)> (logspace) Registering rotated log deletion for alternate.log with min roll count 0
traffic_manager[54905]: [Sep 21 15:44:10.009] [LOG_FLUSH] DEBUG: <LogConfig.cc:119 (register_rolled_log_auto_delete)> (logspace) Registering rotated log deletion for sequence.log with min roll count 0
traffic_manager[54905]: [Sep 21 15:44:10.009] [LOG_FLUSH] DEBUG: <LogConfig.cc:119 (register_rolled_log_auto_delete)> (logspace) Registering rotated log deletion for error.log with min roll count 0
traffic_server[54915]: [LOG_FLUSH] NOTE: /path/to/etc/trafficserver/logging.yaml loading ...
traffic_server[54915]: [LOG_FLUSH] NOTE: /path/to/etc/trafficserver/logging.yaml finished loading
traffic_server[57183]: Alarm Message: Access logging to local log directory suspended - configured space allocation almost exhausted.
traffic_server[54915]: [LOG_FLUSH] NOTE: Cannot clear space because there are no recognized Traffic Server rolled logs for auto deletion.
traffic_manager[54905]: [Sep 21 15:44:15.741] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 316230470, configured space 314572800, physical space left 5006655488, partition headroom 10485760, space is not available
traffic_manager[54905]: [Sep 21 15:44:15.742] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 211372870 bytes being used for logs
traffic_manager[54905]: [Sep 21 15:44:15.742] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5111508992 bytes left on partition
traffic_manager[54905]: [Sep 21 15:44:15.742] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 316230470, configured space 314572800, physical space left 5006651392, partition headroom 10485760, space is not available
traffic_manager[54905]: [Sep 21 15:44:15.742] [LOG_FLUSH] DEBUG: <LogConfig.cc:683 (update_space_used)> (logspace) headroom reached, trying to clear space ...
traffic_manager[54905]: [Sep 21 15:44:15.742] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 316230470, configured space 314572800, physical space left 5006651392, partition headroom 10485760, space is not available
traffic_manager[54905]: [Sep 21 15:44:20.736] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 316230470, configured space 314572800, physical space left 5006651392, partition headroom 10485760, space is not available
traffic_server[54915]: [LOG_FLUSH] NOTE: Cannot clear space because there are no recognized Traffic Server rolled logs for auto deletion.
traffic_manager[54905]: [Sep 21 15:44:20.736] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 211372870 bytes being used for logs
traffic_manager[54905]: [Sep 21 15:44:20.736] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5111508992 bytes left on partition
traffic_manager[54905]: [Sep 21 15:44:20.736] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 316230470, configured space 314572800, physical space left 5006651392, partition headroom 10485760, space is not available
traffic_manager[54905]: [Sep 21 15:44:20.736] [LOG_FLUSH] DEBUG: <LogConfig.cc:683 (update_space_used)> (logspace) headroom reached, trying to clear space ...
traffic_manager[54905]: [Sep 21 15:44:20.736] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 316230470, configured space 314572800, physical space left 5006651392, partition headroom 10485760, space is not available
traffic_manager[54905]: [Sep 21 15:44:25.731] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 316230470, configured space 314572800, physical space left 5006651392, partition headroom 10485760, space is not available
traffic_server[54915]: [LOG_FLUSH] NOTE: Cannot clear space because there are no recognized Traffic Server rolled logs for auto deletion.
traffic_manager[54905]: [Sep 21 15:44:25.732] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 211372870 bytes being used for logs
traffic_manager[54905]: [Sep 21 15:44:25.732] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5111504896 bytes left on partition
traffic_manager[54905]: [Sep 21 15:44:25.732] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 316230470, configured space 314572800, physical space left 5006647296, partition headroom 10485760, space is not available
traffic_manager[54905]: [Sep 21 15:44:25.732] [LOG_FLUSH] DEBUG: <LogConfig.cc:683 (update_space_used)> (logspace) headroom reached, trying to clear space ...
traffic_manager[54905]: [Sep 21 15:44:25.732] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 316230470, configured space 314572800, physical space left 5006647296, partition headroom 10485760, space is not available
traffic_manager[54905]: [Sep 21 15:44:30.747] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 316230470, configured space 314572800, physical space left 5006647296, partition headroom 10485760, space is not available
traffic_server[54915]: [LOG_FLUSH] NOTE: Cannot clear space because there are no recognized Traffic Server rolled logs for auto deletion.
traffic_manager[54905]: [Sep 21 15:44:30.747] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 211372870 bytes being used for logs
traffic_manager[54905]: [Sep 21 15:44:30.747] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5111504896 bytes left on partition
traffic_manager[54905]: [Sep 21 15:44:30.747] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 316230470, configured space 314572800, physical space left 5006647296, partition headroom 10485760, space is not available
traffic_manager[54905]: [Sep 21 15:44:30.747] [LOG_FLUSH] DEBUG: <LogConfig.cc:683 (update_space_used)> (logspace) headroom reached, trying to clear space ...
traffic_manager[54905]: [Sep 21 15:44:30.747] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 316230470, configured space 314572800, physical space left 5006647296, partition headroom 10485760, space is not available
traffic_manager[54905]: [Sep 21 15:44:35.765] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 316230470, configured space 314572800, physical space left 5006647296, partition headroom 10485760, space is not available
traffic_server[54915]: [LOG_FLUSH] NOTE: Cannot clear space because there are no recognized Traffic Server rolled logs for auto deletion.
traffic_manager[54905]: [Sep 21 15:44:35.765] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 211372870 bytes being used for logs
traffic_manager[54905]: [Sep 21 15:44:35.765] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5111500800 bytes left on partition
traffic_manager[54905]: [Sep 21 15:44:35.765] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 316230470, configured space 314572800, physical space left 5006643200, partition headroom 10485760, space is not available
traffic_manager[54905]: [Sep 21 15:44:35.765] [LOG_FLUSH] DEBUG: <LogConfig.cc:683 (update_space_used)> (logspace) headroom reached, trying to clear space ...
traffic_manager[54905]: [Sep 21 15:44:35.765] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 316230470, configured space 314572800, physical space left 5006643200, partition headroom 10485760, space is not available
```
**Sequence B:**
```
traffic_manager[57788]: traffic_manager NOTE: User has changed config file logging.yaml
traffic_manager[57788]: traffic_manager NOTE: User has changed config file records.config
traffic_manager[57788]: traffic_manager NOTE: updated diags config
traffic_server[57797]: [ET_NET 5] NOTE: updated diags config
traffic_manager[57788]: [Sep 21 15:47:24.036] [LOG_FLUSH] DEBUG: <LogConfig.cc:119 (register_rolled_log_auto_delete)> (logspace) Registering rotated log deletion for diags.log with min roll count 0
traffic_manager[57788]: [Sep 21 15:47:24.036] [LOG_FLUSH] DEBUG: <LogConfig.cc:119 (register_rolled_log_auto_delete)> (logspace) Registering rotated log deletion for manager.log with min roll count 0
traffic_server[57797]: [LOG_FLUSH] NOTE: /path/to/etc/trafficserver/logging.yaml loading ...
traffic_manager[57788]: [Sep 21 15:47:24.036] [LOG_FLUSH] DEBUG: <LogConfig.cc:119 (register_rolled_log_auto_delete)> (logspace) Registering rotated log deletion for traffic.out with min roll count 0
traffic_manager[57788]: [Sep 21 15:47:24.036] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 38342439 bytes being used for logs
traffic_manager[57788]: [Sep 21 15:47:24.036] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5284458496 bytes left on partition
traffic_manager[57788]: [Sep 21 15:47:24.036] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 143200039, configured space 314572800, physical space left 5179600896, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:47:24.036] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 143200039, configured space 314572800, physical space left 5179600896, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:47:24.037] [LOG_FLUSH] DEBUG: <LogConfig.cc:119 (register_rolled_log_auto_delete)> (logspace) Registering rotated log deletion for public_request.log with min roll count 0
traffic_manager[57788]: [Sep 21 15:47:24.038] [LOG_FLUSH] DEBUG: <LogConfig.cc:119 (register_rolled_log_auto_delete)> (logspace) Registering rotated log deletion for private_request.log with min roll count 0
traffic_manager[57788]: [Sep 21 15:47:24.038] [LOG_FLUSH] DEBUG: <LogConfig.cc:119 (register_rolled_log_auto_delete)> (logspace) Registering rotated log deletion for specific_remap.log with min roll count 0
traffic_server[57797]: [LOG_FLUSH] NOTE: /path/to/etc/trafficserver/logging.yaml finished loading
traffic_manager[57788]: [Sep 21 15:47:24.038] [LOG_FLUSH] DEBUG: <LogConfig.cc:119 (register_rolled_log_auto_delete)> (logspace) Registering rotated log deletion for alternate.log with min roll count 0
traffic_manager[57788]: [Sep 21 15:47:24.038] [LOG_FLUSH] DEBUG: <LogConfig.cc:119 (register_rolled_log_auto_delete)> (logspace) Registering rotated log deletion for sequence.log with min roll count 0
traffic_manager[57788]: [Sep 21 15:47:24.038] [LOG_FLUSH] DEBUG: <LogConfig.cc:119 (register_rolled_log_auto_delete)> (logspace) Registering rotated log deletion for error.log with min roll count 0
traffic_manager[57788]: [Sep 21 15:47:29.003] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 143200039, configured space 314572800, physical space left 5179600896, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:47:34.006] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 143200039, configured space 314572800, physical space left 5179600896, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:47:34.006] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 50272588 bytes being used for logs
traffic_manager[57788]: [Sep 21 15:47:34.006] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5272522752 bytes left on partition
traffic_manager[57788]: [Sep 21 15:47:34.006] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 155130188, configured space 314572800, physical space left 5167665152, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:47:34.006] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 155130188, configured space 314572800, physical space left 5167665152, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:47:39.000] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 155130188, configured space 314572800, physical space left 5167665152, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:47:44.010] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 155130188, configured space 314572800, physical space left 5167665152, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:47:44.010] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 62371443 bytes being used for logs
traffic_manager[57788]: [Sep 21 15:47:44.011] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5260419072 bytes left on partition
traffic_manager[57788]: [Sep 21 15:47:44.011] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 167229043, configured space 314572800, physical space left 5155561472, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:47:44.011] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 167229043, configured space 314572800, physical space left 5155561472, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:47:49.001] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 167229043, configured space 314572800, physical space left 5155561472, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:47:54.007] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 167229043, configured space 314572800, physical space left 5155561472, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:47:54.007] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 74008343 bytes being used for logs
traffic_manager[57788]: [Sep 21 15:47:54.007] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5248778240 bytes left on partition
traffic_manager[57788]: [Sep 21 15:47:54.007] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 178865943, configured space 314572800, physical space left 5143920640, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:47:54.007] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 178865943, configured space 314572800, physical space left 5143920640, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:47:59.010] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 178865943, configured space 314572800, physical space left 5143920640, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:04.022] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 178865943, configured space 314572800, physical space left 5143920640, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:04.022] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 85811958 bytes being used for logs
traffic_manager[57788]: [Sep 21 15:48:04.022] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5236969472 bytes left on partition
traffic_manager[57788]: [Sep 21 15:48:04.022] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 190669558, configured space 314572800, physical space left 5132111872, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:04.022] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 190669558, configured space 314572800, physical space left 5132111872, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:09.002] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 190669558, configured space 314572800, physical space left 5132111872, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:14.021] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 190669558, configured space 314572800, physical space left 5132111872, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:14.022] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 97702052 bytes being used for logs
traffic_manager[57788]: [Sep 21 15:48:14.022] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5225082880 bytes left on partition
traffic_manager[57788]: [Sep 21 15:48:14.022] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 202559652, configured space 314572800, physical space left 5120225280, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:14.022] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 202559652, configured space 314572800, physical space left 5120225280, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:19.004] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 202559652, configured space 314572800, physical space left 5120225280, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:24.004] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 202559652, configured space 314572800, physical space left 5120225280, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:24.004] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 109420096 bytes being used for logs
traffic_manager[57788]: [Sep 21 15:48:24.004] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5213364224 bytes left on partition
traffic_manager[57788]: [Sep 21 15:48:24.004] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 214277696, configured space 314572800, physical space left 5108506624, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:24.004] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 214277696, configured space 314572800, physical space left 5108506624, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:29.089] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 214277696, configured space 314572800, physical space left 5108506624, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:34.005] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 214277696, configured space 314572800, physical space left 5108506624, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:34.005] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 121121949 bytes being used for logs
traffic_manager[57788]: [Sep 21 15:48:34.005] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5201653760 bytes left on partition
traffic_manager[57788]: [Sep 21 15:48:34.005] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 225979549, configured space 314572800, physical space left 5096796160, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:34.005] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 225979549, configured space 314572800, physical space left 5096796160, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:39.000] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 225979549, configured space 314572800, physical space left 5096796160, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:44.004] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 225979549, configured space 314572800, physical space left 5096796160, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:44.004] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 133484496 bytes being used for logs
traffic_manager[57788]: [Sep 21 15:48:44.004] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5189292032 bytes left on partition
traffic_manager[57788]: [Sep 21 15:48:44.004] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 238342096, configured space 314572800, physical space left 5084434432, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:44.004] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 238342096, configured space 314572800, physical space left 5084434432, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:49.003] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 238342096, configured space 314572800, physical space left 5084434432, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:54.001] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 238342096, configured space 314572800, physical space left 5084434432, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:54.001] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 145051899 bytes being used for logs
traffic_manager[57788]: [Sep 21 15:48:54.001] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5177720832 bytes left on partition
traffic_manager[57788]: [Sep 21 15:48:54.001] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 249909499, configured space 314572800, physical space left 5072863232, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:54.001] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 249909499, configured space 314572800, physical space left 5072863232, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:48:59.000] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 249909499, configured space 314572800, physical space left 5072863232, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:49:04.006] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 249909499, configured space 314572800, physical space left 5072863232, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:49:04.006] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 156798296 bytes being used for logs
traffic_manager[57788]: [Sep 21 15:49:04.006] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5165969408 bytes left on partition
traffic_manager[57788]: [Sep 21 15:49:04.006] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 261655896, configured space 314572800, physical space left 5061111808, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:49:04.006] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 261655896, configured space 314572800, physical space left 5061111808, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:49:09.001] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 261655896, configured space 314572800, physical space left 5061111808, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:49:14.002] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 261655896, configured space 314572800, physical space left 5061111808, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:49:14.002] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 168429572 bytes being used for logs
traffic_manager[57788]: [Sep 21 15:49:14.002] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5154336768 bytes left on partition
traffic_manager[57788]: [Sep 21 15:49:14.002] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 273287172, configured space 314572800, physical space left 5049479168, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:49:14.002] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 273287172, configured space 314572800, physical space left 5049479168, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:49:19.009] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 273287172, configured space 314572800, physical space left 5049479168, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:49:24.001] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 273287172, configured space 314572800, physical space left 5049479168, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:49:24.001] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 180251828 bytes being used for logs
traffic_manager[57788]: [Sep 21 15:49:24.001] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5142507520 bytes left on partition
traffic_manager[57788]: [Sep 21 15:49:24.001] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 285109428, configured space 314572800, physical space left 5037649920, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:49:24.002] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 285109428, configured space 314572800, physical space left 5037649920, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:49:29.069] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 285109428, configured space 314572800, physical space left 5037649920, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:49:34.005] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 285109428, configured space 314572800, physical space left 5037649920, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:49:34.006] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 192540745 bytes being used for logs
traffic_manager[57788]: [Sep 21 15:49:34.006] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5130215424 bytes left on partition
traffic_manager[57788]: [Sep 21 15:49:34.006] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 297398345, configured space 314572800, physical space left 5025357824, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:49:34.006] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 297398345, configured space 314572800, physical space left 5025357824, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:49:39.019] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 297398345, configured space 314572800, physical space left 5025357824, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:49:44.002] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 297398345, configured space 314572800, physical space left 5025357824, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:49:44.002] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 204275711 bytes being used for logs
traffic_manager[57788]: [Sep 21 15:49:44.002] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5118476288 bytes left on partition
traffic_manager[57788]: [Sep 21 15:49:44.002] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 309133311, configured space 314572800, physical space left 5013618688, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:49:44.002] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 309133311, configured space 314572800, physical space left 5013618688, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:49:49.007] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 309133311, configured space 314572800, physical space left 5013618688, partition headroom 10485760, space is available
traffic_manager[57788]: [Sep 21 15:49:54.004] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 309133311, configured space 314572800, physical space left 5013618688, partition headroom 10485760, space is available
traffic_server[57797]: [LOG_FLUSH] NOTE: Cannot clear space because there are no recognized Traffic Server rolled logs for auto deletion.
traffic_manager[57788]: [Sep 21 15:49:54.005] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 216233067 bytes being used for logs
traffic_manager[57788]: [Sep 21 15:49:54.005] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5106515968 bytes left on partition
traffic_manager[57788]: [Sep 21 15:49:54.005] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 321090667, configured space 314572800, physical space left 5001658368, partition headroom 10485760, space is not available
traffic_manager[57788]: [Sep 21 15:49:54.005] [LOG_FLUSH] DEBUG: <LogConfig.cc:683 (update_space_used)> (logspace) headroom reached, trying to clear space ...
traffic_manager[57788]: [Sep 21 15:49:54.005] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 321090667, configured space 314572800, physical space left 5001658368, partition headroom 10485760, space is not available
traffic_server[57797]: [LOG_FLUSH] NOTE: Logging space exhausted, any logs writing to local disk will be dropped!
traffic_server[57797]: [LOG_FLUSH] WARNING: Access logging to local log directory suspended - configured space allocation almost exhausted.
traffic_server[59578]: Alarm Message: Access logging to local log directory suspended - configured space allocation almost exhausted.
traffic_server[57797]: [LOG_FLUSH] NOTE: Cannot clear space because there are no recognized Traffic Server rolled logs for auto deletion.
traffic_manager[57788]: [Sep 21 15:49:59.465] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 321090667, configured space 314572800, physical space left 5001658368, partition headroom 10485760, space is not available
traffic_manager[57788]: [Sep 21 15:49:59.465] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 216233067 bytes being used for logs
traffic_manager[57788]: [Sep 21 15:49:59.465] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5106511872 bytes left on partition
traffic_manager[57788]: [Sep 21 15:49:59.465] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 321090667, configured space 314572800, physical space left 5001654272, partition headroom 10485760, space is not available
traffic_manager[57788]: [Sep 21 15:49:59.465] [LOG_FLUSH] DEBUG: <LogConfig.cc:683 (update_space_used)> (logspace) headroom reached, trying to clear space ...
traffic_manager[57788]: [Sep 21 15:49:59.465] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 321090667, configured space 314572800, physical space left 5001654272, partition headroom 10485760, space is not available
traffic_manager[57788]: [Sep 21 15:50:04.473] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 321090667, configured space 314572800, physical space left 5001654272, partition headroom 10485760, space is not available
traffic_server[57797]: [LOG_FLUSH] NOTE: Cannot clear space because there are no recognized Traffic Server rolled logs for auto deletion.
traffic_manager[57788]: [Sep 21 15:50:04.473] [LOG_FLUSH] DEBUG: <LogConfig.cc:665 (update_space_used)> (logspace) 216233067 bytes being used for logs
traffic_manager[57788]: [Sep 21 15:50:04.473] [LOG_FLUSH] DEBUG: <LogConfig.cc:666 (update_space_used)> (logspace) 5106511872 bytes left on partition
traffic_manager[57788]: [Sep 21 15:50:04.473] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 321090667, configured space 314572800, physical space left 5001654272, partition headroom 10485760, space is not available
traffic_manager[57788]: [Sep 21 15:50:04.473] [LOG_FLUSH] DEBUG: <LogConfig.cc:683 (update_space_used)> (logspace) headroom reached, trying to clear space ...
traffic_manager[57788]: [Sep 21 15:50:04.473] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 321090667, configured space 314572800, physical space left 5001654272, partition headroom 10485760, space is not available
traffic_manager[57788]: [Sep 21 15:50:09.477] [LOG_FLUSH] DEBUG: <LogConfig.cc:561 (space_to_write)> (logspace) logical space used 321090667, configured space 314572800, physical space left 5001654272, partition headroom 10485760, space is not available
traffic_server[57797]: [LOG_FLUSH] NOTE: Cannot clear space because there are no recognized Traffic Server rolled logs for auto deletion.
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org