You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kudu.apache.org by "Binglin Chang (Code Review)" <ge...@cloudera.org> on 2016/03/23 06:55:54 UTC

[kudu-CR] Proper handling of 'Too many open files' errors

Binglin Chang has uploaded a new change for review.

  http://gerrit.cloudera.org:8080/2606

Change subject: Proper handling of 'Too many open files' errors
......................................................................

Proper handling of 'Too many open files' errors

When using file block manager, it is possible to get 'Too many open
files' error. When this error caused FlushMRS op to fail, new MRS
is already created and old MRS is put into tablet components rowset
tree, the old MRS will stay there forever (until maybe
rowset compaction). Those MRS consume lots of memory, which causes write
request to be throttled. Also not sure whether records in those MRS are
properly persisted or log is not GCed when TS is restarted.

Currently it is better to just FATAL on FlushMRS failure.

Also we see ton of logs about accept failed, this patch also throttle
those logs.

Change-Id: I17135a68d34e5b0c56c628546f3ab2d7faa863ae
---
M src/kudu/rpc/acceptor_pool.cc
M src/kudu/tablet/tablet_peer_mm_ops.cc
2 files changed, 7 insertions(+), 4 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/06/2606/1
-- 
To view, visit http://gerrit.cloudera.org:8080/2606
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: newchange
Gerrit-Change-Id: I17135a68d34e5b0c56c628546f3ab2d7faa863ae
Gerrit-PatchSet: 1
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-Owner: Binglin Chang <de...@gmail.com>