You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-dev@hadoop.apache.org by "Liang Xie (JIRA)" <ji...@apache.org> on 2013/11/05 07:58:18 UTC

[jira] [Created] (HDFS-5461) fallback to non-ssr(local short circuit reads) while oom detected

Liang Xie created HDFS-5461:
-------------------------------

             Summary: fallback to non-ssr(local short circuit reads) while oom detected
                 Key: HDFS-5461
                 URL: https://issues.apache.org/jira/browse/HDFS-5461
             Project: Hadoop HDFS
          Issue Type: Improvement
    Affects Versions: 2.2.0, 3.0.0
            Reporter: Liang Xie


Currently, the DirectBufferPool used by ssr feature seems doesn't have a upper-bound limit except DirectMemory VM option. So there's a risk to encounter direct memory oom. see HBASE-8143 for example.
IMHO, maybe we could improve it a bit:
1) detect OOM or reach a setting up-limit from caller, then fallback to non-ssr
2) add a new metric about current raw consumed direct memory size.



--
This message was sent by Atlassian JIRA
(v6.1#6144)