You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Eugene Koontz (JIRA)" <ji...@apache.org> on 2011/05/06 01:03:03 UTC
[jira] [Created] (HBASE-3861) MiniZooKeeperCluster.startup() should
refer to hbase.zookeeper.property.maxClientCnxns
MiniZooKeeperCluster.startup() should refer to hbase.zookeeper.property.maxClientCnxns
--------------------------------------------------------------------------------------
Key: HBASE-3861
URL: https://issues.apache.org/jira/browse/HBASE-3861
Project: HBase
Issue Type: Improvement
Reporter: Eugene Koontz
Currently the number of the client connections is hard-wired to 1000:
{{{
standaloneServerFactory = new NIOServerCnxnFactory();
standaloneServerFactory.configure(new InetSocketAddress(clientPort),1000);
} catch (BindException e) {
}}}
This should be set according to the test environment's hbase configuration. The property in
question is : hbase.zookeeper.property.maxClientCnxns.
Currently some tests such as org.apache.hadoop.hbase.client.TestHCM fail because the number of connections used by the HBase client exceeds 1000.
Recently MAX_CACHED_HBASE_INSTANCES increased from 31 to 2000 on 0.90 branch:
http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&r1=1096818&r2=1096817&view=diff&pathrev=1096818
and correspondingly the hbase config on the Zookeeper server-side also increased in hbase-default.xml:
http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/resources/hbase-default.xml?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&r1=1091594&r2=1091593&view=diff&pathrev=1091594
So if MiniZKCluster looks at this setting, the test won't have this failure.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-3861) MiniZooKeeperCluster.startup()
should refer to hbase.zookeeper.property.maxClientCnxns
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13029727#comment-13029727 ]
stack commented on HBASE-3861:
------------------------------
Do you think the old constructor should call your new one Eugene? Else some data members will not be set up right? Otherwise the patch looks good to me.
> MiniZooKeeperCluster.startup() should refer to hbase.zookeeper.property.maxClientCnxns
> --------------------------------------------------------------------------------------
>
> Key: HBASE-3861
> URL: https://issues.apache.org/jira/browse/HBASE-3861
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.3
> Reporter: Eugene Koontz
> Assignee: Eugene Koontz
> Fix For: 0.90.3
>
> Attachments: HBASE-3861.patch, HBASE-3861.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Currently the number of the client connections is hard-wired to 1000:
> {{{
> standaloneServerFactory = new NIOServerCnxnFactory();
> standaloneServerFactory.configure(new InetSocketAddress(clientPort),1000);
> } catch (BindException e) {
>
> }}}
> This should be set according to the test environment's hbase configuration. The property in
> question is : hbase.zookeeper.property.maxClientCnxns.
> Currently some tests such as org.apache.hadoop.hbase.client.TestHCM fail because the number of connections used by the HBase client exceeds 1000.
> Recently MAX_CACHED_HBASE_INSTANCES increased from 31 to 2000 on 0.90 branch:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&r1=1096818&r2=1096817&view=diff&pathrev=1096818
> and correspondingly the hbase config on the Zookeeper server-side also increased in hbase-default.xml:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/resources/hbase-default.xml?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&r1=1091594&r2=1091593&view=diff&pathrev=1091594
> So if MiniZKCluster looks at this setting, the test won't have this failure.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3861) MiniZooKeeperCluster.startup() should
refer to hbase.zookeeper.property.maxClientCnxns
Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Purtell updated HBASE-3861:
----------------------------------
Resolution: Fixed
Fix Version/s: 0.92.0
Release Note: (was: added new patch with numClientCnxns set to 5000 (enough for TestHCM to pass).)
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
Committed to trunk and 0.90 branch. Tests pass locally.
> MiniZooKeeperCluster.startup() should refer to hbase.zookeeper.property.maxClientCnxns
> --------------------------------------------------------------------------------------
>
> Key: HBASE-3861
> URL: https://issues.apache.org/jira/browse/HBASE-3861
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.3
> Reporter: Eugene Koontz
> Assignee: Eugene Koontz
> Fix For: 0.90.3, 0.92.0
>
> Attachments: HBASE-3861.patch, HBASE-3861.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Currently the number of the client connections is hard-wired to 1000:
> {{{
> standaloneServerFactory = new NIOServerCnxnFactory();
> standaloneServerFactory.configure(new InetSocketAddress(clientPort),1000);
> } catch (BindException e) {
>
> }}}
> This should be set according to the test environment's hbase configuration. The property in
> question is : hbase.zookeeper.property.maxClientCnxns.
> Currently some tests such as org.apache.hadoop.hbase.client.TestHCM fail because the number of connections used by the HBase client exceeds 1000.
> Recently MAX_CACHED_HBASE_INSTANCES increased from 31 to 2000 on 0.90 branch:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&r1=1096818&r2=1096817&view=diff&pathrev=1096818
> and correspondingly the hbase config on the Zookeeper server-side also increased in hbase-default.xml:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/resources/hbase-default.xml?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&r1=1091594&r2=1091593&view=diff&pathrev=1091594
> So if MiniZKCluster looks at this setting, the test won't have this failure.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-3861) MiniZooKeeperCluster.startup()
should refer to hbase.zookeeper.property.maxClientCnxns
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13030154#comment-13030154 ]
stack commented on HBASE-3861:
------------------------------
I just backed this out of TRUNK because its OOME'ing TestHCM up on hudson and locally on two different platforms (I can't see why it would do it though... must be some interaction w/ hbase-3777). It runs fine for me on branch.
> MiniZooKeeperCluster.startup() should refer to hbase.zookeeper.property.maxClientCnxns
> --------------------------------------------------------------------------------------
>
> Key: HBASE-3861
> URL: https://issues.apache.org/jira/browse/HBASE-3861
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.3
> Reporter: Eugene Koontz
> Assignee: Eugene Koontz
> Fix For: 0.90.3, 0.92.0
>
> Attachments: HBASE-3861.patch, HBASE-3861.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Currently the number of the client connections is hard-wired to 1000:
> {{{
> standaloneServerFactory = new NIOServerCnxnFactory();
> standaloneServerFactory.configure(new InetSocketAddress(clientPort),1000);
> } catch (BindException e) {
>
> }}}
> This should be set according to the test environment's hbase configuration. The property in
> question is : hbase.zookeeper.property.maxClientCnxns.
> Currently some tests such as org.apache.hadoop.hbase.client.TestHCM fail because the number of connections used by the HBase client exceeds 1000.
> Recently MAX_CACHED_HBASE_INSTANCES increased from 31 to 2000 on 0.90 branch:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&r1=1096818&r2=1096817&view=diff&pathrev=1096818
> and correspondingly the hbase config on the Zookeeper server-side also increased in hbase-default.xml:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/resources/hbase-default.xml?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&r1=1091594&r2=1091593&view=diff&pathrev=1091594
> So if MiniZKCluster looks at this setting, the test won't have this failure.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-3861) MiniZooKeeperCluster.startup()
should refer to hbase.zookeeper.property.maxClientCnxns
Posted by "Eugene Koontz (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13030040#comment-13030040 ]
Eugene Koontz commented on HBASE-3861:
--------------------------------------
Thank you for looking at this, stack!! You are right about the constructor-calling. Thank you Andrew for fixing it.
One thing which I can't explain is that TestHCM passes currently *without* this patch. It seems like it should fail because the maxNumCnxns is set too low at only 1000.
So I think my patch is right but it doesn't fix a test that's not passing without it.
> MiniZooKeeperCluster.startup() should refer to hbase.zookeeper.property.maxClientCnxns
> --------------------------------------------------------------------------------------
>
> Key: HBASE-3861
> URL: https://issues.apache.org/jira/browse/HBASE-3861
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.3
> Reporter: Eugene Koontz
> Assignee: Eugene Koontz
> Fix For: 0.90.3
>
> Attachments: HBASE-3861.patch, HBASE-3861.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Currently the number of the client connections is hard-wired to 1000:
> {{{
> standaloneServerFactory = new NIOServerCnxnFactory();
> standaloneServerFactory.configure(new InetSocketAddress(clientPort),1000);
> } catch (BindException e) {
>
> }}}
> This should be set according to the test environment's hbase configuration. The property in
> question is : hbase.zookeeper.property.maxClientCnxns.
> Currently some tests such as org.apache.hadoop.hbase.client.TestHCM fail because the number of connections used by the HBase client exceeds 1000.
> Recently MAX_CACHED_HBASE_INSTANCES increased from 31 to 2000 on 0.90 branch:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&r1=1096818&r2=1096817&view=diff&pathrev=1096818
> and correspondingly the hbase config on the Zookeeper server-side also increased in hbase-default.xml:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/resources/hbase-default.xml?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&r1=1091594&r2=1091593&view=diff&pathrev=1091594
> So if MiniZKCluster looks at this setting, the test won't have this failure.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-3861) MiniZooKeeperCluster.startup()
should refer to hbase.zookeeper.property.maxClientCnxns
Posted by "Lars Hofhansl (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lars Hofhansl resolved HBASE-3861.
----------------------------------
Resolution: Fixed
> MiniZooKeeperCluster.startup() should refer to hbase.zookeeper.property.maxClientCnxns
> --------------------------------------------------------------------------------------
>
> Key: HBASE-3861
> URL: https://issues.apache.org/jira/browse/HBASE-3861
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.3
> Reporter: Eugene Koontz
> Assignee: Eugene Koontz
> Attachments: HBASE-3861.patch, HBASE-3861.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Currently the number of the client connections is hard-wired to 1000:
> {noformat}
> standaloneServerFactory = new NIOServerCnxnFactory();
> standaloneServerFactory.configure(new InetSocketAddress(clientPort),1000);
> } catch (BindException e) {
>
> {noformat}
> This should be set according to the test environment's hbase configuration. The property in
> question is : hbase.zookeeper.property.maxClientCnxns.
> Currently some tests such as org.apache.hadoop.hbase.client.TestHCM fail because the number of connections used by the HBase client exceeds 1000.
> Recently MAX_CACHED_HBASE_INSTANCES increased from 31 to 2000 on 0.90 branch:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&r1=1096818&r2=1096817&view=diff&pathrev=1096818
> and correspondingly the hbase config on the Zookeeper server-side also increased in hbase-default.xml:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/resources/hbase-default.xml?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&r1=1091594&r2=1091593&view=diff&pathrev=1091594
> So if MiniZKCluster looks at this setting, the test won't have this failure.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3861) MiniZooKeeperCluster.startup() should
refer to hbase.zookeeper.property.maxClientCnxns
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-3861:
-------------------------
Fix Version/s: (was: 0.90.4)
Moving this to 0.92.0. It was committed for 0.90.3.
> MiniZooKeeperCluster.startup() should refer to hbase.zookeeper.property.maxClientCnxns
> --------------------------------------------------------------------------------------
>
> Key: HBASE-3861
> URL: https://issues.apache.org/jira/browse/HBASE-3861
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.3
> Reporter: Eugene Koontz
> Assignee: Eugene Koontz
> Fix For: 0.92.0
>
> Attachments: HBASE-3861.patch, HBASE-3861.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Currently the number of the client connections is hard-wired to 1000:
> {{{
> standaloneServerFactory = new NIOServerCnxnFactory();
> standaloneServerFactory.configure(new InetSocketAddress(clientPort),1000);
> } catch (BindException e) {
>
> }}}
> This should be set according to the test environment's hbase configuration. The property in
> question is : hbase.zookeeper.property.maxClientCnxns.
> Currently some tests such as org.apache.hadoop.hbase.client.TestHCM fail because the number of connections used by the HBase client exceeds 1000.
> Recently MAX_CACHED_HBASE_INSTANCES increased from 31 to 2000 on 0.90 branch:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&r1=1096818&r2=1096817&view=diff&pathrev=1096818
> and correspondingly the hbase config on the Zookeeper server-side also increased in hbase-default.xml:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/resources/hbase-default.xml?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&r1=1091594&r2=1091593&view=diff&pathrev=1091594
> So if MiniZKCluster looks at this setting, the test won't have this failure.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3861) MiniZooKeeperCluster.startup() should
refer to hbase.zookeeper.property.maxClientCnxns
Posted by "Eugene Koontz (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eugene Koontz updated HBASE-3861:
---------------------------------
Status: Open (was: Patch Available)
creating new patch with maxNumCnxns set sufficiently high for TestHCM to pass.
> MiniZooKeeperCluster.startup() should refer to hbase.zookeeper.property.maxClientCnxns
> --------------------------------------------------------------------------------------
>
> Key: HBASE-3861
> URL: https://issues.apache.org/jira/browse/HBASE-3861
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.3
> Reporter: Eugene Koontz
> Assignee: Eugene Koontz
> Fix For: 0.90.3
>
> Attachments: HBASE-3861.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Currently the number of the client connections is hard-wired to 1000:
> {{{
> standaloneServerFactory = new NIOServerCnxnFactory();
> standaloneServerFactory.configure(new InetSocketAddress(clientPort),1000);
> } catch (BindException e) {
>
> }}}
> This should be set according to the test environment's hbase configuration. The property in
> question is : hbase.zookeeper.property.maxClientCnxns.
> Currently some tests such as org.apache.hadoop.hbase.client.TestHCM fail because the number of connections used by the HBase client exceeds 1000.
> Recently MAX_CACHED_HBASE_INSTANCES increased from 31 to 2000 on 0.90 branch:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&r1=1096818&r2=1096817&view=diff&pathrev=1096818
> and correspondingly the hbase config on the Zookeeper server-side also increased in hbase-default.xml:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/resources/hbase-default.xml?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&r1=1091594&r2=1091593&view=diff&pathrev=1091594
> So if MiniZKCluster looks at this setting, the test won't have this failure.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3861) MiniZooKeeperCluster.startup() should
refer to hbase.zookeeper.property.maxClientCnxns
Posted by "Eugene Koontz (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eugene Koontz updated HBASE-3861:
---------------------------------
Fix Version/s: 0.90.3
Assignee: Eugene Koontz
Affects Version/s: 0.90.3
Status: Patch Available (was: Open)
attaching HBASE-3861.patch
> MiniZooKeeperCluster.startup() should refer to hbase.zookeeper.property.maxClientCnxns
> --------------------------------------------------------------------------------------
>
> Key: HBASE-3861
> URL: https://issues.apache.org/jira/browse/HBASE-3861
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.3
> Reporter: Eugene Koontz
> Assignee: Eugene Koontz
> Fix For: 0.90.3
>
> Attachments: HBASE-3861.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Currently the number of the client connections is hard-wired to 1000:
> {{{
> standaloneServerFactory = new NIOServerCnxnFactory();
> standaloneServerFactory.configure(new InetSocketAddress(clientPort),1000);
> } catch (BindException e) {
>
> }}}
> This should be set according to the test environment's hbase configuration. The property in
> question is : hbase.zookeeper.property.maxClientCnxns.
> Currently some tests such as org.apache.hadoop.hbase.client.TestHCM fail because the number of connections used by the HBase client exceeds 1000.
> Recently MAX_CACHED_HBASE_INSTANCES increased from 31 to 2000 on 0.90 branch:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&r1=1096818&r2=1096817&view=diff&pathrev=1096818
> and correspondingly the hbase config on the Zookeeper server-side also increased in hbase-default.xml:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/resources/hbase-default.xml?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&r1=1091594&r2=1091593&view=diff&pathrev=1091594
> So if MiniZKCluster looks at this setting, the test won't have this failure.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-3861) MiniZooKeeperCluster.startup()
should refer to hbase.zookeeper.property.maxClientCnxns
Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13030029#comment-13030029 ]
Andrew Purtell commented on HBASE-3861:
---------------------------------------
+1, I'll commit with Stack's comment addressed also.
> MiniZooKeeperCluster.startup() should refer to hbase.zookeeper.property.maxClientCnxns
> --------------------------------------------------------------------------------------
>
> Key: HBASE-3861
> URL: https://issues.apache.org/jira/browse/HBASE-3861
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.3
> Reporter: Eugene Koontz
> Assignee: Eugene Koontz
> Fix For: 0.90.3
>
> Attachments: HBASE-3861.patch, HBASE-3861.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Currently the number of the client connections is hard-wired to 1000:
> {{{
> standaloneServerFactory = new NIOServerCnxnFactory();
> standaloneServerFactory.configure(new InetSocketAddress(clientPort),1000);
> } catch (BindException e) {
>
> }}}
> This should be set according to the test environment's hbase configuration. The property in
> question is : hbase.zookeeper.property.maxClientCnxns.
> Currently some tests such as org.apache.hadoop.hbase.client.TestHCM fail because the number of connections used by the HBase client exceeds 1000.
> Recently MAX_CACHED_HBASE_INSTANCES increased from 31 to 2000 on 0.90 branch:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&r1=1096818&r2=1096817&view=diff&pathrev=1096818
> and correspondingly the hbase config on the Zookeeper server-side also increased in hbase-default.xml:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/resources/hbase-default.xml?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&r1=1091594&r2=1091593&view=diff&pathrev=1091594
> So if MiniZKCluster looks at this setting, the test won't have this failure.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-3861) MiniZooKeeperCluster.startup()
should refer to hbase.zookeeper.property.maxClientCnxns
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13030212#comment-13030212 ]
Hudson commented on HBASE-3861:
-------------------------------
Integrated in HBase-TRUNK #1909 (See [https://builds.apache.org/hudson/job/HBase-TRUNK/1909/])
HBASE-3861 MiniZooKeeperCluster.startup() should refer to hbase.zookeeper.property.maxClientCnxns; backing it out till figure the TestHCM OOME issue
> MiniZooKeeperCluster.startup() should refer to hbase.zookeeper.property.maxClientCnxns
> --------------------------------------------------------------------------------------
>
> Key: HBASE-3861
> URL: https://issues.apache.org/jira/browse/HBASE-3861
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.3
> Reporter: Eugene Koontz
> Assignee: Eugene Koontz
> Fix For: 0.90.3, 0.92.0
>
> Attachments: HBASE-3861.patch, HBASE-3861.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Currently the number of the client connections is hard-wired to 1000:
> {{{
> standaloneServerFactory = new NIOServerCnxnFactory();
> standaloneServerFactory.configure(new InetSocketAddress(clientPort),1000);
> } catch (BindException e) {
>
> }}}
> This should be set according to the test environment's hbase configuration. The property in
> question is : hbase.zookeeper.property.maxClientCnxns.
> Currently some tests such as org.apache.hadoop.hbase.client.TestHCM fail because the number of connections used by the HBase client exceeds 1000.
> Recently MAX_CACHED_HBASE_INSTANCES increased from 31 to 2000 on 0.90 branch:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&r1=1096818&r2=1096817&view=diff&pathrev=1096818
> and correspondingly the hbase config on the Zookeeper server-side also increased in hbase-default.xml:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/resources/hbase-default.xml?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&r1=1091594&r2=1091593&view=diff&pathrev=1091594
> So if MiniZKCluster looks at this setting, the test won't have this failure.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3861) MiniZooKeeperCluster.startup() should
refer to hbase.zookeeper.property.maxClientCnxns
Posted by "Eugene Koontz (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eugene Koontz updated HBASE-3861:
---------------------------------
Attachment: HBASE-3861.patch
> MiniZooKeeperCluster.startup() should refer to hbase.zookeeper.property.maxClientCnxns
> --------------------------------------------------------------------------------------
>
> Key: HBASE-3861
> URL: https://issues.apache.org/jira/browse/HBASE-3861
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.3
> Reporter: Eugene Koontz
> Assignee: Eugene Koontz
> Fix For: 0.90.3
>
> Attachments: HBASE-3861.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Currently the number of the client connections is hard-wired to 1000:
> {{{
> standaloneServerFactory = new NIOServerCnxnFactory();
> standaloneServerFactory.configure(new InetSocketAddress(clientPort),1000);
> } catch (BindException e) {
>
> }}}
> This should be set according to the test environment's hbase configuration. The property in
> question is : hbase.zookeeper.property.maxClientCnxns.
> Currently some tests such as org.apache.hadoop.hbase.client.TestHCM fail because the number of connections used by the HBase client exceeds 1000.
> Recently MAX_CACHED_HBASE_INSTANCES increased from 31 to 2000 on 0.90 branch:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&r1=1096818&r2=1096817&view=diff&pathrev=1096818
> and correspondingly the hbase config on the Zookeeper server-side also increased in hbase-default.xml:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/resources/hbase-default.xml?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&r1=1091594&r2=1091593&view=diff&pathrev=1091594
> So if MiniZKCluster looks at this setting, the test won't have this failure.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Reopened] (HBASE-3861) MiniZooKeeperCluster.startup()
should refer to hbase.zookeeper.property.maxClientCnxns
Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Purtell reopened HBASE-3861:
-----------------------------------
Caused TestHCM to OOME on trunk up on Jenkins. Backed out for now. Reopening to investigate / fix.
> MiniZooKeeperCluster.startup() should refer to hbase.zookeeper.property.maxClientCnxns
> --------------------------------------------------------------------------------------
>
> Key: HBASE-3861
> URL: https://issues.apache.org/jira/browse/HBASE-3861
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.3
> Reporter: Eugene Koontz
> Assignee: Eugene Koontz
> Fix For: 0.90.3, 0.92.0
>
> Attachments: HBASE-3861.patch, HBASE-3861.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Currently the number of the client connections is hard-wired to 1000:
> {{{
> standaloneServerFactory = new NIOServerCnxnFactory();
> standaloneServerFactory.configure(new InetSocketAddress(clientPort),1000);
> } catch (BindException e) {
>
> }}}
> This should be set according to the test environment's hbase configuration. The property in
> question is : hbase.zookeeper.property.maxClientCnxns.
> Currently some tests such as org.apache.hadoop.hbase.client.TestHCM fail because the number of connections used by the HBase client exceeds 1000.
> Recently MAX_CACHED_HBASE_INSTANCES increased from 31 to 2000 on 0.90 branch:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&r1=1096818&r2=1096817&view=diff&pathrev=1096818
> and correspondingly the hbase config on the Zookeeper server-side also increased in hbase-default.xml:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/resources/hbase-default.xml?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&r1=1091594&r2=1091593&view=diff&pathrev=1091594
> So if MiniZKCluster looks at this setting, the test won't have this failure.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3861) MiniZooKeeperCluster.startup() should
refer to hbase.zookeeper.property.maxClientCnxns
Posted by "Eugene Koontz (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eugene Koontz updated HBASE-3861:
---------------------------------
Description:
Currently the number of the client connections is hard-wired to 1000:
{noformat}
standaloneServerFactory = new NIOServerCnxnFactory();
standaloneServerFactory.configure(new InetSocketAddress(clientPort),1000);
} catch (BindException e) {
{noformat}
This should be set according to the test environment's hbase configuration. The property in
question is : hbase.zookeeper.property.maxClientCnxns.
Currently some tests such as org.apache.hadoop.hbase.client.TestHCM fail because the number of connections used by the HBase client exceeds 1000.
Recently MAX_CACHED_HBASE_INSTANCES increased from 31 to 2000 on 0.90 branch:
http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&r1=1096818&r2=1096817&view=diff&pathrev=1096818
and correspondingly the hbase config on the Zookeeper server-side also increased in hbase-default.xml:
http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/resources/hbase-default.xml?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&r1=1091594&r2=1091593&view=diff&pathrev=1091594
So if MiniZKCluster looks at this setting, the test won't have this failure.
was:
Currently the number of the client connections is hard-wired to 1000:
{{{
standaloneServerFactory = new NIOServerCnxnFactory();
standaloneServerFactory.configure(new InetSocketAddress(clientPort),1000);
} catch (BindException e) {
}}}
This should be set according to the test environment's hbase configuration. The property in
question is : hbase.zookeeper.property.maxClientCnxns.
Currently some tests such as org.apache.hadoop.hbase.client.TestHCM fail because the number of connections used by the HBase client exceeds 1000.
Recently MAX_CACHED_HBASE_INSTANCES increased from 31 to 2000 on 0.90 branch:
http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&r1=1096818&r2=1096817&view=diff&pathrev=1096818
and correspondingly the hbase config on the Zookeeper server-side also increased in hbase-default.xml:
http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/resources/hbase-default.xml?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&r1=1091594&r2=1091593&view=diff&pathrev=1091594
So if MiniZKCluster looks at this setting, the test won't have this failure.
> MiniZooKeeperCluster.startup() should refer to hbase.zookeeper.property.maxClientCnxns
> --------------------------------------------------------------------------------------
>
> Key: HBASE-3861
> URL: https://issues.apache.org/jira/browse/HBASE-3861
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.3
> Reporter: Eugene Koontz
> Assignee: Eugene Koontz
> Attachments: HBASE-3861.patch, HBASE-3861.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Currently the number of the client connections is hard-wired to 1000:
> {noformat}
> standaloneServerFactory = new NIOServerCnxnFactory();
> standaloneServerFactory.configure(new InetSocketAddress(clientPort),1000);
> } catch (BindException e) {
>
> {noformat}
> This should be set according to the test environment's hbase configuration. The property in
> question is : hbase.zookeeper.property.maxClientCnxns.
> Currently some tests such as org.apache.hadoop.hbase.client.TestHCM fail because the number of connections used by the HBase client exceeds 1000.
> Recently MAX_CACHED_HBASE_INSTANCES increased from 31 to 2000 on 0.90 branch:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&r1=1096818&r2=1096817&view=diff&pathrev=1096818
> and correspondingly the hbase config on the Zookeeper server-side also increased in hbase-default.xml:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/resources/hbase-default.xml?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&r1=1091594&r2=1091593&view=diff&pathrev=1091594
> So if MiniZKCluster looks at this setting, the test won't have this failure.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3861) MiniZooKeeperCluster.startup() should
refer to hbase.zookeeper.property.maxClientCnxns
Posted by "Eugene Koontz (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eugene Koontz updated HBASE-3861:
---------------------------------
Attachment: (was: HBASE-3861.patch)
> MiniZooKeeperCluster.startup() should refer to hbase.zookeeper.property.maxClientCnxns
> --------------------------------------------------------------------------------------
>
> Key: HBASE-3861
> URL: https://issues.apache.org/jira/browse/HBASE-3861
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.3
> Reporter: Eugene Koontz
> Assignee: Eugene Koontz
> Fix For: 0.90.3
>
> Attachments: HBASE-3861.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Currently the number of the client connections is hard-wired to 1000:
> {{{
> standaloneServerFactory = new NIOServerCnxnFactory();
> standaloneServerFactory.configure(new InetSocketAddress(clientPort),1000);
> } catch (BindException e) {
>
> }}}
> This should be set according to the test environment's hbase configuration. The property in
> question is : hbase.zookeeper.property.maxClientCnxns.
> Currently some tests such as org.apache.hadoop.hbase.client.TestHCM fail because the number of connections used by the HBase client exceeds 1000.
> Recently MAX_CACHED_HBASE_INSTANCES increased from 31 to 2000 on 0.90 branch:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&r1=1096818&r2=1096817&view=diff&pathrev=1096818
> and correspondingly the hbase config on the Zookeeper server-side also increased in hbase-default.xml:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/resources/hbase-default.xml?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&r1=1091594&r2=1091593&view=diff&pathrev=1091594
> So if MiniZKCluster looks at this setting, the test won't have this failure.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3861) MiniZooKeeperCluster.startup() should
refer to hbase.zookeeper.property.maxClientCnxns
Posted by "Eugene Koontz (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eugene Koontz updated HBASE-3861:
---------------------------------
Release Note: added new patch with numClientCnxns set to 5000 (enough for TestHCM to pass).
Status: Patch Available (was: Open)
> MiniZooKeeperCluster.startup() should refer to hbase.zookeeper.property.maxClientCnxns
> --------------------------------------------------------------------------------------
>
> Key: HBASE-3861
> URL: https://issues.apache.org/jira/browse/HBASE-3861
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.3
> Reporter: Eugene Koontz
> Assignee: Eugene Koontz
> Fix For: 0.90.3
>
> Attachments: HBASE-3861.patch, HBASE-3861.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Currently the number of the client connections is hard-wired to 1000:
> {{{
> standaloneServerFactory = new NIOServerCnxnFactory();
> standaloneServerFactory.configure(new InetSocketAddress(clientPort),1000);
> } catch (BindException e) {
>
> }}}
> This should be set according to the test environment's hbase configuration. The property in
> question is : hbase.zookeeper.property.maxClientCnxns.
> Currently some tests such as org.apache.hadoop.hbase.client.TestHCM fail because the number of connections used by the HBase client exceeds 1000.
> Recently MAX_CACHED_HBASE_INSTANCES increased from 31 to 2000 on 0.90 branch:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&r1=1096818&r2=1096817&view=diff&pathrev=1096818
> and correspondingly the hbase config on the Zookeeper server-side also increased in hbase-default.xml:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/resources/hbase-default.xml?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&r1=1091594&r2=1091593&view=diff&pathrev=1091594
> So if MiniZKCluster looks at this setting, the test won't have this failure.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3861) MiniZooKeeperCluster.startup() should
refer to hbase.zookeeper.property.maxClientCnxns
Posted by "Eugene Koontz (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eugene Koontz updated HBASE-3861:
---------------------------------
Attachment: HBASE-3861.patch
> MiniZooKeeperCluster.startup() should refer to hbase.zookeeper.property.maxClientCnxns
> --------------------------------------------------------------------------------------
>
> Key: HBASE-3861
> URL: https://issues.apache.org/jira/browse/HBASE-3861
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.3
> Reporter: Eugene Koontz
> Assignee: Eugene Koontz
> Fix For: 0.90.3
>
> Attachments: HBASE-3861.patch, HBASE-3861.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Currently the number of the client connections is hard-wired to 1000:
> {{{
> standaloneServerFactory = new NIOServerCnxnFactory();
> standaloneServerFactory.configure(new InetSocketAddress(clientPort),1000);
> } catch (BindException e) {
>
> }}}
> This should be set according to the test environment's hbase configuration. The property in
> question is : hbase.zookeeper.property.maxClientCnxns.
> Currently some tests such as org.apache.hadoop.hbase.client.TestHCM fail because the number of connections used by the HBase client exceeds 1000.
> Recently MAX_CACHED_HBASE_INSTANCES increased from 31 to 2000 on 0.90 branch:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&r1=1096818&r2=1096817&view=diff&pathrev=1096818
> and correspondingly the hbase config on the Zookeeper server-side also increased in hbase-default.xml:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/resources/hbase-default.xml?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&r1=1091594&r2=1091593&view=diff&pathrev=1091594
> So if MiniZKCluster looks at this setting, the test won't have this failure.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-3861) MiniZooKeeperCluster.startup()
should refer to hbase.zookeeper.property.maxClientCnxns
Posted by "Hbase Build Acct (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13030036#comment-13030036 ]
Hbase Build Acct commented on HBASE-3861:
-----------------------------------------
Sounds good
> MiniZooKeeperCluster.startup() should refer to hbase.zookeeper.property.maxClientCnxns
> --------------------------------------------------------------------------------------
>
> Key: HBASE-3861
> URL: https://issues.apache.org/jira/browse/HBASE-3861
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.3
> Reporter: Eugene Koontz
> Assignee: Eugene Koontz
> Fix For: 0.90.3
>
> Attachments: HBASE-3861.patch, HBASE-3861.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Currently the number of the client connections is hard-wired to 1000:
> {{{
> standaloneServerFactory = new NIOServerCnxnFactory();
> standaloneServerFactory.configure(new InetSocketAddress(clientPort),1000);
> } catch (BindException e) {
>
> }}}
> This should be set according to the test environment's hbase configuration. The property in
> question is : hbase.zookeeper.property.maxClientCnxns.
> Currently some tests such as org.apache.hadoop.hbase.client.TestHCM fail because the number of connections used by the HBase client exceeds 1000.
> Recently MAX_CACHED_HBASE_INSTANCES increased from 31 to 2000 on 0.90 branch:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&r1=1096818&r2=1096817&view=diff&pathrev=1096818
> and correspondingly the hbase config on the Zookeeper server-side also increased in hbase-default.xml:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/resources/hbase-default.xml?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&r1=1091594&r2=1091593&view=diff&pathrev=1091594
> So if MiniZKCluster looks at this setting, the test won't have this failure.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3861) MiniZooKeeperCluster.startup() should
refer to hbase.zookeeper.property.maxClientCnxns
Posted by "Lars Hofhansl (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lars Hofhansl updated HBASE-3861:
---------------------------------
Looking at MiniZooKeeperCluster in trunk, this is already done:
{code}
NIOServerCnxnFactory standaloneServerFactory;
while (true) {
try {
standaloneServerFactory = new NIOServerCnxnFactory();
standaloneServerFactory.configure(
new InetSocketAddress(tentativePort),
configuration.getInt(HConstants.ZOOKEEPER_MAX_CLIENT_CNXNS,
1000));
} catch (BindException e) {
{code}
Closing.
> MiniZooKeeperCluster.startup() should refer to hbase.zookeeper.property.maxClientCnxns
> --------------------------------------------------------------------------------------
>
> Key: HBASE-3861
> URL: https://issues.apache.org/jira/browse/HBASE-3861
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.3
> Reporter: Eugene Koontz
> Assignee: Eugene Koontz
> Attachments: HBASE-3861.patch, HBASE-3861.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Currently the number of the client connections is hard-wired to 1000:
> {noformat}
> standaloneServerFactory = new NIOServerCnxnFactory();
> standaloneServerFactory.configure(new InetSocketAddress(clientPort),1000);
> } catch (BindException e) {
>
> {noformat}
> This should be set according to the test environment's hbase configuration. The property in
> question is : hbase.zookeeper.property.maxClientCnxns.
> Currently some tests such as org.apache.hadoop.hbase.client.TestHCM fail because the number of connections used by the HBase client exceeds 1000.
> Recently MAX_CACHED_HBASE_INSTANCES increased from 31 to 2000 on 0.90 branch:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&r1=1096818&r2=1096817&view=diff&pathrev=1096818
> and correspondingly the hbase config on the Zookeeper server-side also increased in hbase-default.xml:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/resources/hbase-default.xml?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&r1=1091594&r2=1091593&view=diff&pathrev=1091594
> So if MiniZKCluster looks at this setting, the test won't have this failure.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-3861) MiniZooKeeperCluster.startup() should
refer to hbase.zookeeper.property.maxClientCnxns
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-3861:
-------------------------
Fix Version/s: (was: 0.90.3)
0.90.4
> MiniZooKeeperCluster.startup() should refer to hbase.zookeeper.property.maxClientCnxns
> --------------------------------------------------------------------------------------
>
> Key: HBASE-3861
> URL: https://issues.apache.org/jira/browse/HBASE-3861
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.3
> Reporter: Eugene Koontz
> Assignee: Eugene Koontz
> Fix For: 0.90.4, 0.92.0
>
> Attachments: HBASE-3861.patch, HBASE-3861.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Currently the number of the client connections is hard-wired to 1000:
> {{{
> standaloneServerFactory = new NIOServerCnxnFactory();
> standaloneServerFactory.configure(new InetSocketAddress(clientPort),1000);
> } catch (BindException e) {
>
> }}}
> This should be set according to the test environment's hbase configuration. The property in
> question is : hbase.zookeeper.property.maxClientCnxns.
> Currently some tests such as org.apache.hadoop.hbase.client.TestHCM fail because the number of connections used by the HBase client exceeds 1000.
> Recently MAX_CACHED_HBASE_INSTANCES increased from 31 to 2000 on 0.90 branch:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhadoop%2Fhbase%2Fclient%2FHConnectionManager.java&r1=1096818&r2=1096817&view=diff&pathrev=1096818
> and correspondingly the hbase config on the Zookeeper server-side also increased in hbase-default.xml:
> http://svn.apache.org/viewvc/hbase/branches/0.90/src/main/resources/hbase-default.xml?p2=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&p1=%2Fhbase%2Fbranches%2F0.90%2Fsrc%2Fmain%2Fresources%2Fhbase-default.xml&r1=1091594&r2=1091593&view=diff&pathrev=1091594
> So if MiniZKCluster looks at this setting, the test won't have this failure.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira