You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kudu.apache.org by "Grant Henke (Jira)" <ji...@apache.org> on 2020/06/02 17:45:00 UTC
[jira] [Resolved] (KUDU-1950) TS runs out of FDs for WALs when
running many tablets
[ https://issues.apache.org/jira/browse/KUDU-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Grant Henke resolved KUDU-1950.
-------------------------------
Fix Version/s: 1.12.0
Resolution: Fixed
> TS runs out of FDs for WALs when running many tablets
> -----------------------------------------------------
>
> Key: KUDU-1950
> URL: https://issues.apache.org/jira/browse/KUDU-1950
> Project: Kudu
> Issue Type: Improvement
> Components: consensus, fs, tserver
> Affects Versions: 1.2.0
> Reporter: David Alves
> Priority: Major
> Labels: dense-storage, scalability
> Fix For: 1.12.0
>
>
> A user was recently complaining that his TS ran out of FDs when he had many tablets and that most were being used by WALs.
> While this was a bit of a non-usual setup - a lot of un-replicated tablets on a single TS - we're likely to hit this problem as we increase density and try and have many more tablets per tablet server.
> The report was that each tablet would use 3 fd's for the WAL. Ultimately we'll likely need some solution akin to the what we've done for the FBM/LBM regarding having an LRU cache of fds for the WAL too.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)