You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hbase.apache.org by "Jonathan Hsieh (JIRA)" <ji...@apache.org> on 2016/06/26 23:51:52 UTC

[jira] [Created] (HBASE-16117) Fix Connection leak in mapred.TableOutputFormat when spark uses it.

Jonathan Hsieh created HBASE-16117:
--------------------------------------

             Summary: Fix Connection leak in mapred.TableOutputFormat when spark uses it. 
                 Key: HBASE-16117
                 URL: https://issues.apache.org/jira/browse/HBASE-16117
             Project: HBase
          Issue Type: Bug
          Components: mapreduce
    Affects Versions: 2.0.0, 1.3.0, 1.2.2, 1.1.6
            Reporter: Jonathan Hsieh
            Assignee: Jonathan Hsieh
             Fix For: 2.0.0, 1.3.0, 1.2.2, 1.1.6


Spark seems to instantiate multiple instances of output formats within a single process.  When mapred.TableOutputFormat (not mapreduce.TableOutputFormat) is used, this may cause connection leaks that slowly exhaust the cluster's zk connections.  

This patch fixes that.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)