You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@trafficserver.apache.org by "Leif Hedstrom (JIRA)" <ji...@apache.org> on 2011/05/04 01:32:03 UTC
[jira] [Created] (TS-758) HostDB fails to insert RR entries
(allocation fails) claiming DB is full
HostDB fails to insert RR entries (allocation fails) claiming DB is full
------------------------------------------------------------------------
Key: TS-758
URL: https://issues.apache.org/jira/browse/TS-758
Project: Traffic Server
Issue Type: Bug
Components: DNS
Affects Versions: 2.1.8
Reporter: Leif Hedstrom
After running in forward proxy for a few days, I got a bunch of these errors:
[May 3 17:13:11.574] Server {140488838387680} WARNING: out of room in hostdb for round-robin DNS data
[May 3 17:13:11.726] Server {140488838387680} WARNING: out of room in hostdb for round-robin DNS data
[May 3 17:13:11.736] Server {140488838387680} WARNING: out of room in hostdb for round-robin DNS data
[May 3 17:13:14.072] Server {140488821982992} WARNING: out of room in hostdb for round-robin DNS data
[May 3 17:13:17.114] Server {140488838387680} WARNING: out of room in hostdb for round-robin DNS data
I'm not sure why it thinks it's out of room, there is no way I've filled my hostdb cache (I'm fairly certain). I'm not able to reproduce the problem (easily).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (TS-758) HostDB fails to insert RR entries
(allocation fails) claiming DB is full
Posted by "Alan M. Carroll (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/TS-758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alan M. Carroll resolved TS-758.
--------------------------------
Resolution: Later
Fix Version/s: (was: 3.1.1)
The behavior is by design. It is usable as is. However, in the long term we need to improve HostDB in general due to a number of issues, this being only one. We may in fact want to redo the entire DNS / host resolution system.
> HostDB fails to insert RR entries (allocation fails) claiming DB is full
> ------------------------------------------------------------------------
>
> Key: TS-758
> URL: https://issues.apache.org/jira/browse/TS-758
> Project: Traffic Server
> Issue Type: Bug
> Components: DNS
> Affects Versions: 2.1.8
> Reporter: Leif Hedstrom
>
> After running in forward proxy for a few days, I got a bunch of these errors:
> [May 3 17:13:11.574] Server {140488838387680} WARNING: out of room in hostdb for round-robin DNS data
> [May 3 17:13:11.726] Server {140488838387680} WARNING: out of room in hostdb for round-robin DNS data
> [May 3 17:13:11.736] Server {140488838387680} WARNING: out of room in hostdb for round-robin DNS data
> [May 3 17:13:14.072] Server {140488821982992} WARNING: out of room in hostdb for round-robin DNS data
> [May 3 17:13:17.114] Server {140488838387680} WARNING: out of room in hostdb for round-robin DNS data
> I'm not sure why it thinks it's out of room, there is no way I've filled my hostdb cache (I'm fairly certain). I'm not able to reproduce the problem (easily).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (TS-758) HostDB fails to insert RR entries
(allocation fails) claiming DB is full
Posted by "Leif Hedstrom (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/TS-758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Leif Hedstrom updated TS-758:
-----------------------------
Fix Version/s: 3.1.0
> HostDB fails to insert RR entries (allocation fails) claiming DB is full
> ------------------------------------------------------------------------
>
> Key: TS-758
> URL: https://issues.apache.org/jira/browse/TS-758
> Project: Traffic Server
> Issue Type: Bug
> Components: DNS
> Affects Versions: 2.1.8
> Reporter: Leif Hedstrom
> Fix For: 3.1.0
>
>
> After running in forward proxy for a few days, I got a bunch of these errors:
> [May 3 17:13:11.574] Server {140488838387680} WARNING: out of room in hostdb for round-robin DNS data
> [May 3 17:13:11.726] Server {140488838387680} WARNING: out of room in hostdb for round-robin DNS data
> [May 3 17:13:11.736] Server {140488838387680} WARNING: out of room in hostdb for round-robin DNS data
> [May 3 17:13:14.072] Server {140488821982992} WARNING: out of room in hostdb for round-robin DNS data
> [May 3 17:13:17.114] Server {140488838387680} WARNING: out of room in hostdb for round-robin DNS data
> I'm not sure why it thinks it's out of room, there is no way I've filled my hostdb cache (I'm fairly certain). I'm not able to reproduce the problem (easily).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (TS-758) HostDB fails to insert RR entries
(allocation fails) claiming DB is full
Posted by "Alan M. Carroll (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/TS-758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13082728#comment-13082728 ]
Alan M. Carroll commented on TS-758:
------------------------------------
This appears to be a result of HostDB running out of space in the host storage, rather than exceeding the number of hosts. Because HostDB uses hash tables internally it must commit to a fixed number of hosts when the DB is initialized (that's set by hostdb.size). The memory footprint, however, is determined by how many entries are returned by DNS servers for the hosts in the table. This can vary quite a bit so one can run out of memory without exceeding the maximum host count. For those who remember "the inode problem" this is basically the same thing.
Currently I have classify this as "not a bug". The behavior is as intended. The best response is to increase the value in proxy.config.hostdb.storage_size. Presumably this was original done to provide tuning opportunities while minimizing resource usage. With modern system I recommend just bumping the value up by 50% or so if you see this in the log.
Longer term, the HostDB storage should be rewritten to be more dynamic but that is definitely a long term prospect.
> HostDB fails to insert RR entries (allocation fails) claiming DB is full
> ------------------------------------------------------------------------
>
> Key: TS-758
> URL: https://issues.apache.org/jira/browse/TS-758
> Project: Traffic Server
> Issue Type: Bug
> Components: DNS
> Affects Versions: 2.1.8
> Reporter: Leif Hedstrom
> Fix For: 3.1.1
>
>
> After running in forward proxy for a few days, I got a bunch of these errors:
> [May 3 17:13:11.574] Server {140488838387680} WARNING: out of room in hostdb for round-robin DNS data
> [May 3 17:13:11.726] Server {140488838387680} WARNING: out of room in hostdb for round-robin DNS data
> [May 3 17:13:11.736] Server {140488838387680} WARNING: out of room in hostdb for round-robin DNS data
> [May 3 17:13:14.072] Server {140488821982992} WARNING: out of room in hostdb for round-robin DNS data
> [May 3 17:13:17.114] Server {140488838387680} WARNING: out of room in hostdb for round-robin DNS data
> I'm not sure why it thinks it's out of room, there is no way I've filled my hostdb cache (I'm fairly certain). I'm not able to reproduce the problem (easily).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira