[jira] [Assigned] (KUDU-1399) LBM fd usage sometimes doesn't scale right

["Adar Dembo (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KUDU-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Adar Dembo reassigned KUDU-1399:
--------------------------------

    Assignee: Adar Dembo  (was: Todd Lipcon)

I've been working on this.

> LBM fd usage sometimes doesn't scale right
> ------------------------------------------
>
>                 Key: KUDU-1399
>                 URL: https://issues.apache.org/jira/browse/KUDU-1399
>             Project: Kudu
>          Issue Type: Bug
>          Components: fs
>            Reporter: Jean-Daniel Cryans
>            Assignee: Adar Dembo
>
> Noticed on a cluster that runs YCSB non-stop in a loop, using a new table each time and deleting an old one, while ensuring that it keeps at least 10 tables to simulate a "loaded" cluster.
> After a few weeks of running, the cluster's file descriptor usage started triggering alerts in the monitoring system. The total data consumption never really changes since we keep at most 10 tables. Todd found that we have thousands of really small log block manager containers.
> The workaround at the moment is to simply increase the ulimit for open file descriptors.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)