[jira] [Commented] (KUDU-1950) TS runs out of FDs for WALs when running many tablets

["Grant Henke (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KUDU-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17124132#comment-17124132 ] 

Grant Henke commented on KUDU-1950:
-----------------------------------

This should be resolved via https://github.com/apache/kudu/commit/fc4ab691a502067bc4d5bdff30507cac7feb7cfe

> TS runs out of FDs for WALs when running many tablets
> -----------------------------------------------------
>
>                 Key: KUDU-1950
>                 URL: https://issues.apache.org/jira/browse/KUDU-1950
>             Project: Kudu
>          Issue Type: Improvement
>          Components: consensus, fs, tserver
>    Affects Versions: 1.2.0
>            Reporter: David Alves
>            Priority: Major
>              Labels: dense-storage, scalability
>
> A user was recently complaining that his TS ran out of FDs when he had many tablets and that most were being used by WALs.
> While this was a bit of a non-usual setup - a lot of un-replicated tablets on a single TS - we're likely to hit this problem as we increase density and try and have many more tablets per tablet server.
> The report was that each tablet would use 3 fd's for the WAL. Ultimately we'll likely need some solution akin to the what we've done for the FBM/LBM regarding having an LRU cache of fds for the WAL too.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)