You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hbase.apache.org by st...@apache.org on 2013/04/02 20:06:21 UTC
svn commit: r1463652 [16/21] - in /hbase/hbase.apache.org/trunk: ./ book/
case_studies/ community/ configuration/ css/ developer/ external_apis/
getting_started/ hbase-assembly/ hbase-assembly/book/ hbase-assembly/xref/
images/ ops_mgt/ performance/ pr...
Modified: hbase/hbase.apache.org/trunk/mail-lists.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/mail-lists.html?rev=1463652&r1=1463651&r2=1463652&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/mail-lists.html (original)
+++ hbase/hbase.apache.org/trunk/mail-lists.html Tue Apr 2 18:06:19 2013
@@ -1,164 +1,204 @@
-<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
-<!-- Generated by Apache Maven Doxia Site Renderer 1.3 at Apr 2, 2013 -->
-<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
- <head>
- <meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />
- <title>HBase - Project Mailing Lists</title>
- <style type="text/css" media="all">
- @import url("./css/maven-base.css");
- @import url("./css/maven-theme.css");
- @import url("./css/site.css");
- </style>
- <link rel="stylesheet" href="./css/print.css" type="text/css" media="print" />
- <meta name="Date-Revision-yyyymmdd" content="20130402" />
- <meta http-equiv="Content-Language" content="en" />
-
- </head>
- <body class="composite">
- <div id="banner">
- <div id="bannerLeft">
- HBase
- </div>
- <div class="clear">
- <hr/>
- </div>
- </div>
- <div id="breadcrumbs">
-
-
- <div class="xleft">
- <span id="publishDate">Last Published: 2013-04-02</span>
- | <span id="projectVersion">Version: 0.97.0-SNAPSHOT</span>
- </div>
- <div class="xright"> <a href="./" title="HBase">HBase</a>
-
-
- </div>
- <div class="clear">
- <hr/>
- </div>
- </div>
- <div id="leftColumn">
- <div id="navcolumn">
-
-
- <h5>Modules</h5>
- <ul>
- <li class="none">
- <a href="hbase-server/index.html" title="HBase - Server">HBase - Server</a>
- </li>
- <li class="none">
- <a href="hbase-protocol/index.html" title="HBase - Protocol">HBase - Protocol</a>
- </li>
- <li class="none">
- <a href="hbase-client/index.html" title="HBase - Client">HBase - Client</a>
- </li>
- <li class="none">
- <a href="hbase-hadoop-compat/index.html" title="HBase - Hadoop Compatibility">HBase - Hadoop Compatibility</a>
- </li>
- <li class="none">
- <a href="hbase-common/index.html" title="HBase - Common">HBase - Common</a>
- </li>
- <li class="none">
- <a href="hbase-it/index.html" title="HBase - Integration Tests">HBase - Integration Tests</a>
- </li>
- <li class="none">
- <a href="hbase-examples/index.html" title="HBase - Examples">HBase - Examples</a>
- </li>
- <li class="none">
- <a href="hbase-prefix-tree/index.html" title="HBase - Prefix Tree">HBase - Prefix Tree</a>
- </li>
- <li class="none">
- <a href="hbase-assembly/index.html" title="HBase - Assembly">HBase - Assembly</a>
- </li>
- <li class="none">
- <a href="hbase-hadoop1-compat/index.html" title="HBase - Hadoop One Compatibility">HBase - Hadoop One Compatibility</a>
- </li>
- </ul>
- <h5>Project Documentation</h5>
- <ul>
- <li class="expanded">
- <a href="project-info.html" title="Project Information">Project Information</a>
- <ul>
- <li class="none">
- <a href="team-list.html" title="Project Team">Project Team</a>
- </li>
- <li class="none">
- <strong>Mailing Lists</strong>
- </li>
- <li class="none">
- <a href="integration.html" title="Continuous Integration">Continuous Integration</a>
- </li>
- <li class="none">
- <a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a>
- </li>
- <li class="none">
- <a href="license.html" title="Project License">Project License</a>
- </li>
- <li class="none">
- <a href="source-repository.html" title="Source Repository">Source Repository</a>
- </li>
- <li class="none">
- <a href="index.html" title="About">About</a>
- </li>
- <li class="none">
- <a href="project-summary.html" title="Project Summary">Project Summary</a>
- </li>
- <li class="none">
- <a href="dependency-info.html" title="Dependency Information">Dependency Information</a>
- </li>
- <li class="none">
- <a href="modules.html" title="Project Modules">Project Modules</a>
- </li>
- <li class="none">
- <a href="dependency-management.html" title="Dependency Management">Dependency Management</a>
- </li>
- <li class="none">
- <a href="dependencies.html" title="Dependencies">Dependencies</a>
- </li>
- <li class="none">
- <a href="dependency-convergence.html" title="Dependency Convergence">Dependency Convergence</a>
- </li>
- <li class="none">
- <a href="plugin-management.html" title="Plugin Management">Plugin Management</a>
- </li>
- <li class="none">
- <a href="plugins.html" title="Project Plugins">Project Plugins</a>
- </li>
- <li class="none">
- <a href="distribution-management.html" title="Distribution Management">Distribution Management</a>
- </li>
- </ul>
- </li>
- <li class="collapsed">
- <a href="project-reports.html" title="Project Reports">Project Reports</a>
- </li>
- </ul>
- <a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy">
- <img class="poweredBy" alt="Built by Maven" src="./images/logos/maven-feather.png" />
- </a>
-
-
- </div>
- </div>
- <div id="bodyColumn">
- <div id="contentBox">
- <div class="section"><h2>Project Mailing Lists<a name="Project_Mailing_Lists"></a></h2><a name="Project_Mailing_Lists"></a><p>These are the mailing lists that have been established for this project. For each list, there is a subscribe, unsubscribe, and an archive link.</p><table border="0" class="bodyTable"><tr class="a"><th>Name</th><th>Subscribe</th><th>Unsubscribe</th><th>Post</th><th>Archive</th><th>Other Archives</th></tr><tr class="b"><td>User List</td><td><a class="externalLink" href="mailto:user-subscribe@hbase.apache.org">Subscribe</a></td><td><a class="externalLink" href="mailto:user-unsubscribe@hbase.apache.org">Unsubscribe</a></td><td><a class="externalLink" href="mailto:user@hbase.apache.org">Post</a></td><td><a class="externalLink" href="http://mail-archives.apache.org/mod_mbox/hbase-user/">mail-archives.apache.org</a></td><td><a class="externalLink" href="http://hbase.apache.org/mail/user/">hbase.apache.org</a></td></tr><tr class="a"><td>-</td><td>-</t
d><td>-</td><td>-</td><td>-</td><td><a class="externalLink" href="http://dir.gmane.org/gmane.comp.java.hadoop.hbase.user">dir.gmane.org</a></td></tr><tr class="b"><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td><a class="externalLink" href="http://search-hadoop.com/?q=&fc_project=HBase">search-hadoop.com</a></td></tr><tr class="a"><td>Developer List</td><td><a class="externalLink" href="mailto:dev-subscribe@hbase.apache.org">Subscribe</a></td><td><a class="externalLink" href="mailto:dev-unsubscribe@hbase.apache.org">Unsubscribe</a></td><td><a class="externalLink" href="mailto:dev@hbase.apache.org">Post</a></td><td><a class="externalLink" href="http://mail-archives.apache.org/mod_mbox/hbase-dev/">mail-archives.apache.org</a></td><td><a class="externalLink" href="http://hbase.apache.org/mail/dev/">hbase.apache.org</a></td></tr><tr class="b"><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td><a class="externalLink" href="http://dir.gmane.org/gmane.comp.java.hadoop.
hbase.devel">dir.gmane.org</a></td></tr><tr class="a"><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td><a class="externalLink" href="http://search-hadoop.com/?q=&fc_project=HBase">search-hadoop.com</a></td></tr><tr class="b"><td>Commits List</td><td><a class="externalLink" href="mailto:commits-subscribe@hbase.apache.org">Subscribe</a></td><td><a class="externalLink" href="mailto:commits-unsubscribe@hbase.apache.org">Unsubscribe</a></td><td>-</td><td><a class="externalLink" href="http://mail-archives.apache.org/mod_mbox/hbase-commits/">mail-archives.apache.org</a></td><td><a class="externalLink" href="http://hbase.apache.org/mail/commits/">hbase.apache.org</a></td></tr><tr class="a"><td>Issues List</td><td><a class="externalLink" href="mailto:issues-subscribe@hbase.apache.org">Subscribe</a></td><td><a class="externalLink" href="mailto:issues-unsubscribe@hbase.apache.org">Unsubscribe</a></td><td>-</td><td><a class="externalLink" href="http://mail-archives.apache.org/m
od_mbox/hbase-issues/">mail-archives.apache.org</a></td><td><a class="externalLink" href="http://hbase.apache.org/mail/issues/">hbase.apache.org</a></td></tr></table></div>
- </div>
- </div>
- <div class="clear">
- <hr/>
- </div>
- <div id="footer">
- <div class="xright">
- Copyright © 2013
- <a href="http://www.apache.org/">The Apache Software Foundation</a>.
- All Rights Reserved.
-
- </div>
- <div class="clear">
- <hr/>
- </div>
- </div>
- </body>
-</html>
+<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
+
+<!-- Generated by Apache Maven Doxia at Apr 2, 2013 -->
+<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
+ <head>
+ <meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />
+ <title>HBase - Assembly - Project Mailing Lists</title>
+ <style type="text/css" media="all">
+ @import url("./css/maven-base.css");
+ @import url("./css/maven-theme.css");
+ @import url("./css/site.css");
+ </style>
+ <link rel="stylesheet" href="./css/print.css" type="text/css" media="print" />
+ <link rel="shortcut icon" href="/images/favicon.ico" />
+ <meta name="Date-Revision-yyyymmdd" content="20130402" />
+ <meta http-equiv="Content-Language" content="en" />
+ <!--Google Analytics-->
+<script type="text/javascript">
+
+ var _gaq = _gaq || [];
+ _gaq.push(['_setAccount', 'UA-30210968-1']);
+ _gaq.push(['_trackPageview']);
+
+ (function() {
+ var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true;
+ ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js';
+ var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s);
+ })();
+
+</script>
+ </head>
+ <body class="composite">
+ <div id="banner">
+ <a href="../" id="bannerLeft">
+ <img src="images/hbase_logo.png" alt="Apache HBase" />
+ </a>
+ <!-- Commented out since we do not use it. St.Ack 20110906
+ -->
+ <div class="clear">
+ <hr/>
+ </div>
+ </div>
+ <div id="breadcrumbs">
+ <div class="xright" style="padding-left: 8px; margin-top: -4px;">
+ <form method="GET" action="http://search-hadoop.com/">
+ <input type="text" style="width: 192px; height: 15px; font-size: inherit; border: 1px solid darkgray" name="q" value="Search wiki, mailing lists & more" onfocus="this.value=''"/>
+ <input type="hidden" name="fc_project" value="HBase"/>
+ <button style="height: 20px; width: 60px;">Search</button>
+ </form>
+ </div>
+ <div class="clear">
+ <hr/>
+ </div>
+ </div>
+ <div id="leftColumn">
+ <div id="navcolumn">
+
+
+ <h5>Apache HBase Project</h5>
+ <ul>
+ <li class="none">
+ <a href="index.html" title="Overview">Overview</a>
+ </li>
+ <li class="none">
+ <a href="license.html" title="License">License</a>
+ </li>
+ <li class="none">
+ <a href="http://www.apache.org/dyn/closer.cgi/hbase/" class="externalLink" title="Downloads">Downloads</a>
+ </li>
+ <li class="none">
+ <a href="https://issues.apache.org/jira/browse/HBASE?report=com.atlassian.jira.plugin.system.project:changelog-panel#selectedTab=com.atlassian.jira.plugin.system.project%3Achangelog-panel" class="externalLink" title="Release Notes">Release Notes</a>
+ </li>
+ <li class="none">
+ <a href="issue-tracking.html" title="Issue Tracking">Issue Tracking</a>
+ </li>
+ <li class="none">
+ <strong>Mailing Lists</strong>
+ </li>
+ <li class="none">
+ <a href="source-repository.html" title="Source Repository">Source Repository</a>
+ </li>
+ <li class="none">
+ <a href="https://reviews.apache.org" class="externalLink" title="ReviewBoard">ReviewBoard</a>
+ </li>
+ <li class="none">
+ <a href="builds.apache.org" title="Apache Build Box">Apache Build Box</a>
+ </li>
+ <li class="none">
+ <a href="http://54.241.6.143/" class="externalLink" title="EC2 Build Box">EC2 Build Box</a>
+ </li>
+ <li class="none">
+ <a href="team-list.html" title="Team">Team</a>
+ </li>
+ <li class="none">
+ <a href="sponsors.html" title="Thanks">Thanks</a>
+ </li>
+ <li class="none">
+ <a href="http://blogs.apache.org/hbase/" class="externalLink" title="Blog">Blog</a>
+ </li>
+ <li class="none">
+ <a href="resources.html" title="Other resources">Other resources</a>
+ </li>
+ </ul>
+ <h5>Documentation</h5>
+ <ul>
+ <li class="none">
+ <a href="book/quickstart.html" title="Getting Started">Getting Started</a>
+ </li>
+ <li class="none">
+ <a href="apidocs/index.html" title="API">API</a>
+ </li>
+ <li class="none">
+ <a href="xref/index.html" title="X-Ref">X-Ref</a>
+ </li>
+ <li class="none">
+ <a href="book/book.html" title="Ref Guide (multi-page)">Ref Guide (multi-page)</a>
+ </li>
+ <li class="none">
+ <a href="book.html" title="Ref Guide (single-page)">Ref Guide (single-page)</a>
+ </li>
+ <li class="none">
+ <a href="http://abloz.com/hbase/book.html" class="externalLink" title="ä¸æåèæå(å页)">ä¸æåèæå(å页)</a>
+ </li>
+ <li class="none">
+ <a href="book/faq.html" title="FAQ">FAQ</a>
+ </li>
+ <li class="none">
+ <a href="book.html#other.info" title="Videos/Presentations">Videos/Presentations</a>
+ </li>
+ <li class="none">
+ <a href="http://wiki.apache.org/hadoop/Hbase" class="externalLink" title="Wiki">Wiki</a>
+ </li>
+ <li class="none">
+ <a href="acid-semantics.html" title="ACID Semantics">ACID Semantics</a>
+ </li>
+ <li class="none">
+ <a href="book.html#arch.bulk.load" title="Bulk Loads">Bulk Loads</a>
+ </li>
+ <li class="none">
+ <a href="metrics.html" title="Metrics">Metrics</a>
+ </li>
+ <li class="none">
+ <a href="cygwin.html" title="HBase on Windows">HBase on Windows</a>
+ </li>
+ <li class="none">
+ <a href="replication.html" title="Cluster replication">Cluster replication</a>
+ </li>
+ </ul>
+ <h5>0.94 Documentation</h5>
+ <ul>
+ <li class="none">
+ <a href="0.94/apidocs/index.html" title="API">API</a>
+ </li>
+ <li class="none">
+ <a href="0.94/xref/index.html" title="X-Ref">X-Ref</a>
+ </li>
+ <li class="none">
+ <a href="0.94/book.html" title="Ref Guide (single-page)">Ref Guide (single-page)</a>
+ </li>
+ </ul>
+ <h5>ASF</h5>
+ <ul>
+ <li class="none">
+ <a href="http://www.apache.org/foundation/" class="externalLink" title="Apache Software Foundation">Apache Software Foundation</a>
+ </li>
+ <li class="none">
+ <a href="http://www.apache.org/foundation/how-it-works.html" class="externalLink" title="How Apache Works">How Apache Works</a>
+ </li>
+ <li class="none">
+ <a href="http://www.apache.org/foundation/sponsorship.html" class="externalLink" title="Sponsoring Apache">Sponsoring Apache</a>
+ </li>
+ </ul>
+ <a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy">
+ <img class="poweredBy" alt="Built by Maven" src="./images/logos/maven-feather.png" />
+ </a>
+
+
+ </div>
+ </div>
+ <div id="bodyColumn">
+ <div id="contentBox">
+ <div class="section"><h2>Project Mailing Lists<a name="Project_Mailing_Lists"></a></h2><a name="Project_Mailing_Lists"></a><p>These are the mailing lists that have been established for this project. For each list, there is a subscribe, unsubscribe, and an archive link.</p><table border="0" class="bodyTable"><tr class="a"><th>Name</th><th>Subscribe</th><th>Unsubscribe</th><th>Post</th><th>Archive</th><th>Other Archives</th></tr><tr class="b"><td>User List</td><td><a class="externalLink" href="mailto:user-subscribe@hbase.apache.org">Subscribe</a></td><td><a class="externalLink" href="mailto:user-unsubscribe@hbase.apache.org">Unsubscribe</a></td><td><a class="externalLink" href="mailto:user@hbase.apache.org">Post</a></td><td><a class="externalLink" href="http://mail-archives.apache.org/mod_mbox/hbase-user/">mail-archives.apache.org</a></td><td><a class="externalLink" href="http://hbase.apache.org/mail/user/">hbase.apache.org</a></td></tr><tr class="a"><td>-</td><td>-</t
d><td>-</td><td>-</td><td>-</td><td><a class="externalLink" href="http://dir.gmane.org/gmane.comp.java.hadoop.hbase.user">dir.gmane.org</a></td></tr><tr class="b"><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td><a class="externalLink" href="http://search-hadoop.com/?q=&fc_project=HBase">search-hadoop.com</a></td></tr><tr class="a"><td>Developer List</td><td><a class="externalLink" href="mailto:dev-subscribe@hbase.apache.org">Subscribe</a></td><td><a class="externalLink" href="mailto:dev-unsubscribe@hbase.apache.org">Unsubscribe</a></td><td><a class="externalLink" href="mailto:dev@hbase.apache.org">Post</a></td><td><a class="externalLink" href="http://mail-archives.apache.org/mod_mbox/hbase-dev/">mail-archives.apache.org</a></td><td><a class="externalLink" href="http://hbase.apache.org/mail/dev/">hbase.apache.org</a></td></tr><tr class="b"><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td><a class="externalLink" href="http://dir.gmane.org/gmane.comp.java.hadoop.
hbase.devel">dir.gmane.org</a></td></tr><tr class="a"><td>-</td><td>-</td><td>-</td><td>-</td><td>-</td><td><a class="externalLink" href="http://search-hadoop.com/?q=&fc_project=HBase">search-hadoop.com</a></td></tr><tr class="b"><td>Commits List</td><td><a class="externalLink" href="mailto:commits-subscribe@hbase.apache.org">Subscribe</a></td><td><a class="externalLink" href="mailto:commits-unsubscribe@hbase.apache.org">Unsubscribe</a></td><td>-</td><td><a class="externalLink" href="http://mail-archives.apache.org/mod_mbox/hbase-commits/">mail-archives.apache.org</a></td><td><a class="externalLink" href="http://hbase.apache.org/mail/commits/">hbase.apache.org</a></td></tr><tr class="a"><td>Issues List</td><td><a class="externalLink" href="mailto:issues-subscribe@hbase.apache.org">Subscribe</a></td><td><a class="externalLink" href="mailto:issues-unsubscribe@hbase.apache.org">Unsubscribe</a></td><td>-</td><td><a class="externalLink" href="http://mail-archives.apache.org/m
od_mbox/hbase-issues/">mail-archives.apache.org</a></td><td><a class="externalLink" href="http://hbase.apache.org/mail/issues/">hbase.apache.org</a></td></tr></table></div>
+ </div>
+ </div>
+ <div class="clear">
+ <hr/>
+ </div>
+ <div id="footer">
+ <div class="xright">
+
+ <span id="publishDate">Last Published: 2013-04-02</span>
+ | <span id="projectVersion">Version: 0.97.0-SNAPSHOT</span>
+
+ </div>
+ <div class="xright">Copyright ©<a href="http://www.apache.org"> 2013
+ <a href="http://www.apache.org/">The Apache Software Foundation</a>.
+ </a>All Rights Reserved. Apache Hadoop, Hadoop, HDFS, HBase and the HBase project logo are trademarks of the Apache Software Foundation.
+ </div>
+ <div class="clear">
+ <hr/>
+ </div>
+ </div>
+ </body>
+</html>
Modified: hbase/hbase.apache.org/trunk/metrics.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/metrics.html?rev=1463652&r1=1463651&r2=1463652&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/metrics.html (original)
+++ hbase/hbase.apache.org/trunk/metrics.html Tue Apr 2 18:06:19 2013
@@ -1,10 +1,10 @@
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
-<!-- Generated by Apache Maven Doxia at Mar 29, 2013 -->
+<!-- Generated by Apache Maven Doxia at Apr 2, 2013 -->
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />
- <title>HBase -
+ <title>HBase - Assembly -
Apache HBase (TM) Metrics
</title>
@@ -15,7 +15,7 @@
</style>
<link rel="stylesheet" href="./css/print.css" type="text/css" media="print" />
<link rel="shortcut icon" href="/images/favicon.ico" />
- <meta name="Date-Revision-yyyymmdd" content="20130329" />
+ <meta name="Date-Revision-yyyymmdd" content="20130402" />
<meta http-equiv="Content-Language" content="en" />
<!--Google Analytics-->
<script type="text/javascript">
@@ -34,7 +34,7 @@
</head>
<body class="composite">
<div id="banner">
- <a href="./" id="bannerLeft">
+ <a href="../" id="bannerLeft">
<img src="images/hbase_logo.png" alt="Apache HBase" />
</a>
<!-- Commented out since we do not use it. St.Ack 20110906
@@ -86,6 +86,12 @@
<a href="https://reviews.apache.org" class="externalLink" title="ReviewBoard">ReviewBoard</a>
</li>
<li class="none">
+ <a href="builds.apache.org" title="Apache Build Box">Apache Build Box</a>
+ </li>
+ <li class="none">
+ <a href="http://54.241.6.143/" class="externalLink" title="EC2 Build Box">EC2 Build Box</a>
+ </li>
+ <li class="none">
<a href="team-list.html" title="Team">Team</a>
</li>
<li class="none">
@@ -317,8 +323,8 @@ export HBASE_REGIONSERVER_OPTS="$HB
<div id="footer">
<div class="xright">
- <span id="publishDate">Last Published: 2013-03-29</span>
- | <span id="projectVersion">Version: 0.97-SNAPSHOT</span>
+ <span id="publishDate">Last Published: 2013-04-02</span>
+ | <span id="projectVersion">Version: 0.97.0-SNAPSHOT</span>
</div>
<div class="xright">Copyright ©<a href="http://www.apache.org"> 2013
Modified: hbase/hbase.apache.org/trunk/old_news.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/old_news.html?rev=1463652&r1=1463651&r2=1463652&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/old_news.html (original)
+++ hbase/hbase.apache.org/trunk/old_news.html Tue Apr 2 18:06:19 2013
@@ -1,10 +1,10 @@
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
-<!-- Generated by Apache Maven Doxia at Mar 29, 2013 -->
+<!-- Generated by Apache Maven Doxia at Apr 2, 2013 -->
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />
- <title>HBase -
+ <title>HBase - Assembly -
Old Apache HBase (TM) News
</title>
@@ -15,7 +15,7 @@
</style>
<link rel="stylesheet" href="./css/print.css" type="text/css" media="print" />
<link rel="shortcut icon" href="/images/favicon.ico" />
- <meta name="Date-Revision-yyyymmdd" content="20130329" />
+ <meta name="Date-Revision-yyyymmdd" content="20130402" />
<meta http-equiv="Content-Language" content="en" />
<!--Google Analytics-->
<script type="text/javascript">
@@ -34,7 +34,7 @@
</head>
<body class="composite">
<div id="banner">
- <a href="./" id="bannerLeft">
+ <a href="../" id="bannerLeft">
<img src="images/hbase_logo.png" alt="Apache HBase" />
</a>
<!-- Commented out since we do not use it. St.Ack 20110906
@@ -86,6 +86,12 @@
<a href="https://reviews.apache.org" class="externalLink" title="ReviewBoard">ReviewBoard</a>
</li>
<li class="none">
+ <a href="builds.apache.org" title="Apache Build Box">Apache Build Box</a>
+ </li>
+ <li class="none">
+ <a href="http://54.241.6.143/" class="externalLink" title="EC2 Build Box">EC2 Build Box</a>
+ </li>
+ <li class="none">
<a href="team-list.html" title="Team">Team</a>
</li>
<li class="none">
@@ -189,6 +195,10 @@
limitations under the License. -->
<div class="section"><h2>Old News<a name="Old_News"></a></h2>
+ <p>December 4th, 2012 <a class="externalLink" href="http://www.meetup.com/hackathon/events/90536432/">0.96 Bug Squashing and Testing Hackathon</a> at Cloudera, SF.</p>
+ <p>October 29th, 2012 <a class="externalLink" href="http://www.meetup.com/hbaseusergroup/events/82791572/">HBase User Group Meetup</a> at Wize Commerce in San Mateo.</p>
+ <p>October 25th, 2012 <a class="externalLink" href="http://www.meetup.com/HBase-NYC/events/81728932/">Strata/Hadoop World HBase Meetup.</a> in NYC</p>
+ <p>September 11th, 2012 <a class="externalLink" href="http://www.meetup.com/hbaseusergroup/events/80621872/">Contributor's Pow-Wow at HortonWorks HQ.</a></p>
<p>August 8th, 2012 <a class="externalLink" href="http://www.apache.org/dyn/closer.cgi/hbase/">Apache HBase 0.94.1 is available for download</a></p>
<p>June 15th, 2012 <a class="externalLink" href="http://www.meetup.com/hbaseusergroup/events/59829652/">Birds-of-a-feather</a> in San Jose, day after <a class="externalLink" href="http://hadoopsummit.org">Hadoop Summit</a></p>
<p>May 23rd, 2012 <a class="externalLink" href="http://www.meetup.com/hackathon/events/58953522/">HackConAthon</a> in Palo Alto</p>
@@ -237,8 +247,8 @@
<div id="footer">
<div class="xright">
- <span id="publishDate">Last Published: 2013-03-29</span>
- | <span id="projectVersion">Version: 0.97-SNAPSHOT</span>
+ <span id="publishDate">Last Published: 2013-04-02</span>
+ | <span id="projectVersion">Version: 0.97.0-SNAPSHOT</span>
</div>
<div class="xright">Copyright ©<a href="http://www.apache.org"> 2013
Modified: hbase/hbase.apache.org/trunk/ops_mgt.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/ops_mgt.html?rev=1463652&r1=1463651&r2=1463652&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/ops_mgt.html (original)
+++ hbase/hbase.apache.org/trunk/ops_mgt.html Tue Apr 2 18:06:19 2013
@@ -1,6 +1,6 @@
<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
- <title>Chapter 1. Apache HBase (TM) Operational Management</title><link rel="stylesheet" type="text/css" href="css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="chapter" title="Chapter 1. Apache HBase (TM) Operational Management"><div class="titlepage"><div><div><h2 class="title"><a name="ops_mgt"></a>Chapter 1. Apache HBase (TM) Operational Management</h2></div></div></div><div class="toc"><p><b>Table of Contents</b></p><dl><dt><span class="section"><a href="#tools">1.1. HBase Tools and Utilities</a></span></dt><dd><dl><dt><span class="section"><a href="#driver">1.1.1. Driver</a></span></dt><dt><span class="section"><a href="#hbck">1.1.2. HBase <span class="application">hbck</span></a></span></dt><dt><span class="section"><a href="#hfile_tool2">1.1.3. HFile Tool</a></span></dt><dt><span class="sectio
n"><a href="#wal_tools">1.1.4. WAL Tools</a></span></dt><dt><span class="section"><a href="#compression.tool">1.1.5. Compression Tool</a></span></dt><dt><span class="section"><a href="#copytable">1.1.6. CopyTable</a></span></dt><dt><span class="section"><a href="#export">1.1.7. Export</a></span></dt><dt><span class="section"><a href="#import">1.1.8. Import</a></span></dt><dt><span class="section"><a href="#importtsv">1.1.9. ImportTsv</a></span></dt><dt><span class="section"><a href="#completebulkload">1.1.10. CompleteBulkLoad</a></span></dt><dt><span class="section"><a href="#walplayer">1.1.11. WALPlayer</a></span></dt><dt><span class="section"><a href="#rowcounter">1.1.12. RowCounter and CellCounter</a></span></dt></dl></dd><dt><span class="section"><a href="#ops.regionmgt">1.2. Region Management</a></span></dt><dd><dl><dt><span class="section"><a href="#ops.regionmgt.majorcompact">1.2.1. Major Compaction</a></span></dt><dt><span class="section"><a href="#ops.regionmgt.merg
e">1.2.2. Merge</a></span></dt></dl></dd><dt><span class="section"><a href="#node.management">1.3. Node Management</a></span></dt><dd><dl><dt><span class="section"><a href="#decommission">1.3.1. Node Decommission</a></span></dt><dt><span class="section"><a href="#rolling">1.3.2. Rolling Restart</a></span></dt></dl></dd><dt><span class="section"><a href="#hbase_metrics">1.4. HBase Metrics</a></span></dt><dd><dl><dt><span class="section"><a href="#metric_setup">1.4.1. Metric Setup</a></span></dt><dt><span class="section"><a href="#rs_metrics">1.4.2. RegionServer Metrics</a></span></dt></dl></dd><dt><span class="section"><a href="#ops.monitoring">1.5. HBase Monitoring</a></span></dt><dd><dl><dt><span class="section"><a href="#ops.monitoring.overview">1.5.1. Overview</a></span></dt><dt><span class="section"><a href="#ops.slow.query">1.5.2. Slow Query Log</a></span></dt></dl></dd><dt><span class="section"><a href="#cluster_replication">1.6. Cluster Replication</a></span></dt><dt>
<span class="section"><a href="#ops.backup">1.7. HBase Backup</a></span></dt><dd><dl><dt><span class="section"><a href="#ops.backup.fullshutdown">1.7.1. Full Shutdown Backup</a></span></dt><dt><span class="section"><a href="#ops.backup.live.replication">1.7.2. Live Cluster Backup - Replication</a></span></dt><dt><span class="section"><a href="#ops.backup.live.copytable">1.7.3. Live Cluster Backup - CopyTable</a></span></dt><dt><span class="section"><a href="#ops.backup.live.export">1.7.4. Live Cluster Backup - Export</a></span></dt></dl></dd><dt><span class="section"><a href="#ops.capacity">1.8. Capacity Planning</a></span></dt><dd><dl><dt><span class="section"><a href="#ops.capacity.storage">1.8.1. Storage</a></span></dt><dt><span class="section"><a href="#ops.capacity.regions">1.8.2. Regions</a></span></dt></dl></dd></dl></div>
+ <title>Chapter 1. Apache HBase (TM) Operational Management</title><link rel="stylesheet" type="text/css" href="css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="chapter" title="Chapter 1. Apache HBase (TM) Operational Management"><div class="titlepage"><div><div><h2 class="title"><a name="ops_mgt"></a>Chapter 1. Apache HBase (TM) Operational Management</h2></div></div></div><div class="toc"><p><b>Table of Contents</b></p><dl><dt><span class="section"><a href="#tools">1.1. HBase Tools and Utilities</a></span></dt><dd><dl><dt><span class="section"><a href="#driver">1.1.1. Driver</a></span></dt><dt><span class="section"><a href="#hbck">1.1.2. HBase <span class="application">hbck</span></a></span></dt><dt><span class="section"><a href="#hfile_tool2">1.1.3. HFile Tool</a></span></dt><dt><span class="sectio
n"><a href="#wal_tools">1.1.4. WAL Tools</a></span></dt><dt><span class="section"><a href="#compression.tool">1.1.5. Compression Tool</a></span></dt><dt><span class="section"><a href="#copytable">1.1.6. CopyTable</a></span></dt><dt><span class="section"><a href="#export">1.1.7. Export</a></span></dt><dt><span class="section"><a href="#import">1.1.8. Import</a></span></dt><dt><span class="section"><a href="#importtsv">1.1.9. ImportTsv</a></span></dt><dt><span class="section"><a href="#completebulkload">1.1.10. CompleteBulkLoad</a></span></dt><dt><span class="section"><a href="#walplayer">1.1.11. WALPlayer</a></span></dt><dt><span class="section"><a href="#rowcounter">1.1.12. RowCounter and CellCounter</a></span></dt><dt><span class="section"><a href="#mlockall">1.1.13. mlockall</a></span></dt></dl></dd><dt><span class="section"><a href="#ops.regionmgt">1.2. Region Management</a></span></dt><dd><dl><dt><span class="section"><a href="#ops.regionmgt.majorcompact">1.2.1. Major Co
mpaction</a></span></dt><dt><span class="section"><a href="#ops.regionmgt.merge">1.2.2. Merge</a></span></dt></dl></dd><dt><span class="section"><a href="#node.management">1.3. Node Management</a></span></dt><dd><dl><dt><span class="section"><a href="#decommission">1.3.1. Node Decommission</a></span></dt><dt><span class="section"><a href="#rolling">1.3.2. Rolling Restart</a></span></dt></dl></dd><dt><span class="section"><a href="#hbase_metrics">1.4. HBase Metrics</a></span></dt><dd><dl><dt><span class="section"><a href="#metric_setup">1.4.1. Metric Setup</a></span></dt><dt><span class="section"><a href="#rs_metrics">1.4.2. RegionServer Metrics</a></span></dt></dl></dd><dt><span class="section"><a href="#ops.monitoring">1.5. HBase Monitoring</a></span></dt><dd><dl><dt><span class="section"><a href="#ops.monitoring.overview">1.5.1. Overview</a></span></dt><dt><span class="section"><a href="#ops.slow.query">1.5.2. Slow Query Log</a></span></dt></dl></dd><dt><span class="sectio
n"><a href="#cluster_replication">1.6. Cluster Replication</a></span></dt><dt><span class="section"><a href="#ops.backup">1.7. HBase Backup</a></span></dt><dd><dl><dt><span class="section"><a href="#ops.backup.fullshutdown">1.7.1. Full Shutdown Backup</a></span></dt><dt><span class="section"><a href="#ops.backup.live.replication">1.7.2. Live Cluster Backup - Replication</a></span></dt><dt><span class="section"><a href="#ops.backup.live.copytable">1.7.3. Live Cluster Backup - CopyTable</a></span></dt><dt><span class="section"><a href="#ops.backup.live.export">1.7.4. Live Cluster Backup - Export</a></span></dt></dl></dd><dt><span class="section"><a href="#ops.capacity">1.8. Capacity Planning</a></span></dt><dd><dl><dt><span class="section"><a href="#ops.capacity.storage">1.8.1. Storage</a></span></dt><dt><span class="section"><a href="#ops.capacity.regions">1.8.2. Regions</a></span></dt></dl></dd></dl></div>
This chapter will cover operational tools and practices required of a running Apache HBase cluster.
The subject of operations is related to the topics of <a class="xref" href="#">???</a>, <a class="xref" href="#">???</a>,
and <a class="xref" href="#">???</a> but is a distinct topic in itself.
@@ -160,7 +160,12 @@ row10 c1 c2
<code class="code">hbase.mapreduce.scan.column.family</code> to specify scanning a single column family.
</p><pre class="programlisting">$ bin/hbase org.apache.hadoop.hbase.mapreduce.CellCounter <tablename> <outputDir> [regex or prefix]</pre><p>
</p><p>Note: just like RowCounter, caching for the input Scan is configured via <code class="code">hbase.client.scanner.caching</code> in the
- job configuration. </p></div></div><div class="section" title="1.2. Region Management"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="ops.regionmgt"></a>1.2. Region Management</h2></div></div></div><div class="section" title="1.2.1. Major Compaction"><div class="titlepage"><div><div><h3 class="title"><a name="ops.regionmgt.majorcompact"></a>1.2.1. Major Compaction</h3></div></div></div><p>Major compactions can be requested via the HBase shell or <a class="link" href="http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/client/HBaseAdmin.html#majorCompact%28java.lang.String%29" target="_top">HBaseAdmin.majorCompact</a>.
+ job configuration. </p></div><div class="section" title="1.1.13. mlockall"><div class="titlepage"><div><div><h3 class="title"><a name="mlockall"></a>1.1.13. mlockall</h3></div></div></div><p>It is possible to optionally pin your servers in physical memory making them less likely
+ to be swapped out in oversubscribed environments by having the servers call
+ <a class="link" href="http://linux.die.net/man/2/mlockall" target="_top">mlockall</a> on startup.
+ See <a class="link" href="https://issues.apache.org/jira/browse/HBASE-4391" target="_top">HBASE-4391 Add ability to start RS as root and call mlockall</a>
+ for how to build the optional library and have it run on startup.
+ </p></div></div><div class="section" title="1.2. Region Management"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="ops.regionmgt"></a>1.2. Region Management</h2></div></div></div><div class="section" title="1.2.1. Major Compaction"><div class="titlepage"><div><div><h3 class="title"><a name="ops.regionmgt.majorcompact"></a>1.2.1. Major Compaction</h3></div></div></div><p>Major compactions can be requested via the HBase shell or <a class="link" href="http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/client/HBaseAdmin.html#majorCompact%28java.lang.String%29" target="_top">HBaseAdmin.majorCompact</a>.
</p><p>Note: major compactions do NOT do region merges. See <a class="xref" href="#">???</a> for more information about compactions.
</p></div><div class="section" title="1.2.2. Merge"><div class="titlepage"><div><div><h3 class="title"><a name="ops.regionmgt.merge"></a>1.2.2. Merge</h3></div></div></div><p>Merge is a utility that can merge adjoining regions in the same table (see org.apache.hadoop.hbase.util.Merge).</p><pre class="programlisting">$ bin/hbase org.apache.hadoop.hbase.util.Merge <tablename> <region1> <region2>
@@ -295,13 +300,13 @@ false
</p><p>
For more information on HBase metrics, see <a class="xref" href="#hbase_metrics" title="1.4. HBase Metrics">Section 1.4, “HBase Metrics”</a>.
</p></div><div class="section" title="1.5.2. Slow Query Log"><div class="titlepage"><div><div><h3 class="title"><a name="ops.slow.query"></a>1.5.2. Slow Query Log</h3></div></div></div><p>The HBase slow query log consists of parseable JSON structures describing the properties of those client operations (Gets, Puts, Deletes, etc.) that either took too long to run, or produced too much output. The thresholds for "too long to run" and "too much output" are configurable, as described below. The output is produced inline in the main region server logs so that it is easy to discover further details from context with other logged events. It is also prepended with identifying tags <code class="constant">(responseTooSlow)</code>, <code class="constant">(responseTooLarge)</code>, <code class="constant">(operationTooSlow)</code>, and <code class="constant">(operationTooLarge)</code> in order to enable easy filtering with grep, in case the user desires to see only slow q
ueries.
-</p><div class="section" title="1.5.2.1. Configuration"><div class="titlepage"><div><div><h4 class="title"><a name="d889e744"></a>1.5.2.1. Configuration</h4></div></div></div><p>There are two configuration knobs that can be used to adjust the thresholds for when queries are logged.
+</p><div class="section" title="1.5.2.1. Configuration"><div class="titlepage"><div><div><h4 class="title"><a name="d1084e755"></a>1.5.2.1. Configuration</h4></div></div></div><p>There are two configuration knobs that can be used to adjust the thresholds for when queries are logged.
</p><div class="itemizedlist"><ul class="itemizedlist" type="disc"><li class="listitem"><code class="varname">hbase.ipc.warn.response.time</code> Maximum number of milliseconds that a query can be run without being logged. Defaults to 10000, or 10 seconds. Can be set to -1 to disable logging by time.
</li><li class="listitem"><code class="varname">hbase.ipc.warn.response.size</code> Maximum byte size of response that a query can return without being logged. Defaults to 100 megabytes. Can be set to -1 to disable logging by size.
-</li></ul></div></div><div class="section" title="1.5.2.2. Metrics"><div class="titlepage"><div><div><h4 class="title"><a name="d889e758"></a>1.5.2.2. Metrics</h4></div></div></div><p>The slow query log exposes to metrics to JMX.
+</li></ul></div></div><div class="section" title="1.5.2.2. Metrics"><div class="titlepage"><div><div><h4 class="title"><a name="d1084e769"></a>1.5.2.2. Metrics</h4></div></div></div><p>The slow query log exposes to metrics to JMX.
</p><div class="itemizedlist"><ul class="itemizedlist" type="disc"><li class="listitem"><code class="varname">hadoop.regionserver_rpc_slowResponse</code> a global metric reflecting the durations of all responses that triggered logging.</li><li class="listitem"><code class="varname">hadoop.regionserver_rpc_methodName.aboveOneSec</code> A metric reflecting the durations of all responses that lasted for more than one second.</li></ul></div><p>
-</p></div><div class="section" title="1.5.2.3. Output"><div class="titlepage"><div><div><h4 class="title"><a name="d889e773"></a>1.5.2.3. Output</h4></div></div></div><p>The output is tagged with operation e.g. <code class="constant">(operationTooSlow)</code> if the call was a client operation, such as a Put, Get, or Delete, which we expose detailed fingerprint information for. If not, it is tagged <code class="constant">(responseTooSlow)</code> and still produces parseable JSON output, but with less verbose information solely regarding its duration and size in the RPC itself. <code class="constant">TooLarge</code> is substituted for <code class="constant">TooSlow</code> if the response size triggered the logging, with <code class="constant">TooLarge</code> appearing even in the case that both size and duration triggered logging.
-</p></div><div class="section" title="1.5.2.4. Example"><div class="titlepage"><div><div><h4 class="title"><a name="d889e793"></a>1.5.2.4. Example</h4></div></div></div><p>
+</p></div><div class="section" title="1.5.2.3. Output"><div class="titlepage"><div><div><h4 class="title"><a name="d1084e784"></a>1.5.2.3. Output</h4></div></div></div><p>The output is tagged with operation e.g. <code class="constant">(operationTooSlow)</code> if the call was a client operation, such as a Put, Get, or Delete, which we expose detailed fingerprint information for. If not, it is tagged <code class="constant">(responseTooSlow)</code> and still produces parseable JSON output, but with less verbose information solely regarding its duration and size in the RPC itself. <code class="constant">TooLarge</code> is substituted for <code class="constant">TooSlow</code> if the response size triggered the logging, with <code class="constant">TooLarge</code> appearing even in the case that both size and duration triggered logging.
+</p></div><div class="section" title="1.5.2.4. Example"><div class="titlepage"><div><div><h4 class="title"><a name="d1084e804"></a>1.5.2.4. Example</h4></div></div></div><p>
</p><pre class="programlisting">2011-09-08 10:01:25,824 WARN org.apache.hadoop.ipc.HBaseServer: (operationTooSlow): {"tables":{"riley2":{"puts":[{"totalColumns":11,"families":{"actions":[{"timestamp":1315501284459,"qualifier":"0","vlen":9667580},{"timestamp":1315501284459,"qualifier":"1","vlen":10122412},{"timestamp":1315501284459,"qualifier":"2","vlen":11104617},{"timestamp":1315501284459,"qualifier":"3","vlen":13430635}]},"row":"cfcd208495d565ef66e7dff9f98764da:0"}],"families":["actions"]}},"processingtimems":956,"client":"10.47.34.63:33623","starttimems":1315501284456,"queuetimems":0,"totalPuts":1,"class":"HRegionServer","responsesize":0,"method":"multiPut"}</pre><p>
</p><p>Note that everything inside the "tables" structure is output produced by MultiPut's fingerprint, while the rest of the information is RPC-specific, such as processing time and client IP/port. Other client operations follow the same pattern and the same general structure, with necessary differences due to the nature of the individual operations. In the case that the call is not a client operation, that detailed fingerprint information will be completely absent.
</p><p>This particular example, for example, would indicate that the likely cause of slowness is simply a very large (on the order of 100MB) multiput, as we can tell by the "vlen," or value length, fields of each put in the multiPut.
Modified: hbase/hbase.apache.org/trunk/ops_mgt/ops.monitoring.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/ops_mgt/ops.monitoring.html?rev=1463652&r1=1463651&r2=1463652&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/ops_mgt/ops.monitoring.html (original)
+++ hbase/hbase.apache.org/trunk/ops_mgt/ops.monitoring.html Tue Apr 2 18:06:19 2013
@@ -14,13 +14,13 @@
</p><p>
For more information on HBase metrics, see <a class="xref" href="hbase_metrics.html" title="1.4. HBase Metrics">Section 1.4, “HBase Metrics”</a>.
</p></div><div class="section" title="1.5.2. Slow Query Log"><div class="titlepage"><div><div><h3 class="title"><a name="ops.slow.query"></a>1.5.2. Slow Query Log</h3></div></div></div><p>The HBase slow query log consists of parseable JSON structures describing the properties of those client operations (Gets, Puts, Deletes, etc.) that either took too long to run, or produced too much output. The thresholds for "too long to run" and "too much output" are configurable, as described below. The output is produced inline in the main region server logs so that it is easy to discover further details from context with other logged events. It is also prepended with identifying tags <code class="constant">(responseTooSlow)</code>, <code class="constant">(responseTooLarge)</code>, <code class="constant">(operationTooSlow)</code>, and <code class="constant">(operationTooLarge)</code> in order to enable easy filtering with grep, in case the user desires to see only slow q
ueries.
-</p><div class="section" title="1.5.2.1. Configuration"><div class="titlepage"><div><div><h4 class="title"><a name="d889e744"></a>1.5.2.1. Configuration</h4></div></div></div><p>There are two configuration knobs that can be used to adjust the thresholds for when queries are logged.
+</p><div class="section" title="1.5.2.1. Configuration"><div class="titlepage"><div><div><h4 class="title"><a name="d1084e755"></a>1.5.2.1. Configuration</h4></div></div></div><p>There are two configuration knobs that can be used to adjust the thresholds for when queries are logged.
</p><div class="itemizedlist"><ul class="itemizedlist" type="disc"><li class="listitem"><code class="varname">hbase.ipc.warn.response.time</code> Maximum number of milliseconds that a query can be run without being logged. Defaults to 10000, or 10 seconds. Can be set to -1 to disable logging by time.
</li><li class="listitem"><code class="varname">hbase.ipc.warn.response.size</code> Maximum byte size of response that a query can return without being logged. Defaults to 100 megabytes. Can be set to -1 to disable logging by size.
-</li></ul></div></div><div class="section" title="1.5.2.2. Metrics"><div class="titlepage"><div><div><h4 class="title"><a name="d889e758"></a>1.5.2.2. Metrics</h4></div></div></div><p>The slow query log exposes to metrics to JMX.
+</li></ul></div></div><div class="section" title="1.5.2.2. Metrics"><div class="titlepage"><div><div><h4 class="title"><a name="d1084e769"></a>1.5.2.2. Metrics</h4></div></div></div><p>The slow query log exposes to metrics to JMX.
</p><div class="itemizedlist"><ul class="itemizedlist" type="disc"><li class="listitem"><code class="varname">hadoop.regionserver_rpc_slowResponse</code> a global metric reflecting the durations of all responses that triggered logging.</li><li class="listitem"><code class="varname">hadoop.regionserver_rpc_methodName.aboveOneSec</code> A metric reflecting the durations of all responses that lasted for more than one second.</li></ul></div><p>
-</p></div><div class="section" title="1.5.2.3. Output"><div class="titlepage"><div><div><h4 class="title"><a name="d889e773"></a>1.5.2.3. Output</h4></div></div></div><p>The output is tagged with operation e.g. <code class="constant">(operationTooSlow)</code> if the call was a client operation, such as a Put, Get, or Delete, which we expose detailed fingerprint information for. If not, it is tagged <code class="constant">(responseTooSlow)</code> and still produces parseable JSON output, but with less verbose information solely regarding its duration and size in the RPC itself. <code class="constant">TooLarge</code> is substituted for <code class="constant">TooSlow</code> if the response size triggered the logging, with <code class="constant">TooLarge</code> appearing even in the case that both size and duration triggered logging.
-</p></div><div class="section" title="1.5.2.4. Example"><div class="titlepage"><div><div><h4 class="title"><a name="d889e793"></a>1.5.2.4. Example</h4></div></div></div><p>
+</p></div><div class="section" title="1.5.2.3. Output"><div class="titlepage"><div><div><h4 class="title"><a name="d1084e784"></a>1.5.2.3. Output</h4></div></div></div><p>The output is tagged with operation e.g. <code class="constant">(operationTooSlow)</code> if the call was a client operation, such as a Put, Get, or Delete, which we expose detailed fingerprint information for. If not, it is tagged <code class="constant">(responseTooSlow)</code> and still produces parseable JSON output, but with less verbose information solely regarding its duration and size in the RPC itself. <code class="constant">TooLarge</code> is substituted for <code class="constant">TooSlow</code> if the response size triggered the logging, with <code class="constant">TooLarge</code> appearing even in the case that both size and duration triggered logging.
+</p></div><div class="section" title="1.5.2.4. Example"><div class="titlepage"><div><div><h4 class="title"><a name="d1084e804"></a>1.5.2.4. Example</h4></div></div></div><p>
</p><pre class="programlisting">2011-09-08 10:01:25,824 WARN org.apache.hadoop.ipc.HBaseServer: (operationTooSlow): {"tables":{"riley2":{"puts":[{"totalColumns":11,"families":{"actions":[{"timestamp":1315501284459,"qualifier":"0","vlen":9667580},{"timestamp":1315501284459,"qualifier":"1","vlen":10122412},{"timestamp":1315501284459,"qualifier":"2","vlen":11104617},{"timestamp":1315501284459,"qualifier":"3","vlen":13430635}]},"row":"cfcd208495d565ef66e7dff9f98764da:0"}],"families":["actions"]}},"processingtimems":956,"client":"10.47.34.63:33623","starttimems":1315501284456,"queuetimems":0,"totalPuts":1,"class":"HRegionServer","responsesize":0,"method":"multiPut"}</pre><p>
</p><p>Note that everything inside the "tables" structure is output produced by MultiPut's fingerprint, while the rest of the information is RPC-specific, such as processing time and client IP/port. Other client operations follow the same pattern and the same general structure, with necessary differences due to the nature of the individual operations. In the case that the call is not a client operation, that detailed fingerprint information will be completely absent.
</p><p>This particular example, for example, would indicate that the likely cause of slowness is simply a very large (on the order of 100MB) multiput, as we can tell by the "vlen," or value length, fields of each put in the multiPut.
Modified: hbase/hbase.apache.org/trunk/ops_mgt/ops_mgt.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/ops_mgt/ops_mgt.html?rev=1463652&r1=1463651&r2=1463652&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/ops_mgt/ops_mgt.html (original)
+++ hbase/hbase.apache.org/trunk/ops_mgt/ops_mgt.html Tue Apr 2 18:06:19 2013
@@ -1,6 +1,6 @@
<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
- <title>Chapter 1. Apache HBase (TM) Operational Management</title><link rel="stylesheet" type="text/css" href="../css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"><link rel="home" href="ops_mgt.html" title="Chapter 1. Apache HBase (TM) Operational Management"><link rel="next" href="ops.regionmgt.html" title="1.2. Region Management"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="navheader"><table width="100%" summary="Navigation header"><tr><th colspan="3" align="center">Chapter 1. Apache HBase (TM) Operational Management</th></tr><tr><td width="20%" align="left"> </td><th width="60%" align="center"> </th><td width="20%" align="right"> <a accesskey="n" href="ops.regionmgt.html">Next</a></td></tr></table><hr></div><div class="chapter" title="Chapter 1. Apache HBase (TM) Operational Management"><div class="titlepage"><d
iv><div><h2 class="title"><a name="ops_mgt"></a>Chapter 1. Apache HBase (TM) Operational Management</h2></div></div></div><div class="toc"><p><b>Table of Contents</b></p><dl><dt><span class="section"><a href="ops_mgt.html#tools">1.1. HBase Tools and Utilities</a></span></dt><dd><dl><dt><span class="section"><a href="ops_mgt.html#driver">1.1.1. Driver</a></span></dt><dt><span class="section"><a href="ops_mgt.html#hbck">1.1.2. HBase <span class="application">hbck</span></a></span></dt><dt><span class="section"><a href="ops_mgt.html#hfile_tool2">1.1.3. HFile Tool</a></span></dt><dt><span class="section"><a href="ops_mgt.html#wal_tools">1.1.4. WAL Tools</a></span></dt><dt><span class="section"><a href="ops_mgt.html#compression.tool">1.1.5. Compression Tool</a></span></dt><dt><span class="section"><a href="ops_mgt.html#copytable">1.1.6. CopyTable</a></span></dt><dt><span class="section"><a href="ops_mgt.html#export">1.1.7. Export</a></span></dt><dt><span class="section"
><a href="ops_mgt.html#import">1.1.8. Import</a></span></dt><dt><span class="section"><a href="ops_mgt.html#importtsv">1.1.9. ImportTsv</a></span></dt><dt><span class="section"><a href="ops_mgt.html#completebulkload">1.1.10. CompleteBulkLoad</a></span></dt><dt><span class="section"><a href="ops_mgt.html#walplayer">1.1.11. WALPlayer</a></span></dt><dt><span class="section"><a href="ops_mgt.html#rowcounter">1.1.12. RowCounter and CellCounter</a></span></dt></dl></dd><dt><span class="section"><a href="ops.regionmgt.html">1.2. Region Management</a></span></dt><dd><dl><dt><span class="section"><a href="ops.regionmgt.html#ops.regionmgt.majorcompact">1.2.1. Major Compaction</a></span></dt><dt><span class="section"><a href="ops.regionmgt.html#ops.regionmgt.merge">1.2.2. Merge</a></span></dt></dl></dd><dt><span class="section"><a href="node.management.html">1.3. Node Management</a></span></dt><dd><dl><dt><span class="section"><a href="node.management.html#decommission">1.3.1. Node De
commission</a></span></dt><dt><span class="section"><a href="node.management.html#rolling">1.3.2. Rolling Restart</a></span></dt></dl></dd><dt><span class="section"><a href="hbase_metrics.html">1.4. HBase Metrics</a></span></dt><dd><dl><dt><span class="section"><a href="hbase_metrics.html#metric_setup">1.4.1. Metric Setup</a></span></dt><dt><span class="section"><a href="hbase_metrics.html#rs_metrics">1.4.2. RegionServer Metrics</a></span></dt></dl></dd><dt><span class="section"><a href="ops.monitoring.html">1.5. HBase Monitoring</a></span></dt><dd><dl><dt><span class="section"><a href="ops.monitoring.html#ops.monitoring.overview">1.5.1. Overview</a></span></dt><dt><span class="section"><a href="ops.monitoring.html#ops.slow.query">1.5.2. Slow Query Log</a></span></dt></dl></dd><dt><span class="section"><a href="cluster_replication.html">1.6. Cluster Replication</a></span></dt><dt><span class="section"><a href="ops.backup.html">1.7. HBase Backup</a></span></dt><dd><dl><dt><sp
an class="section"><a href="ops.backup.html#ops.backup.fullshutdown">1.7.1. Full Shutdown Backup</a></span></dt><dt><span class="section"><a href="ops.backup.html#ops.backup.live.replication">1.7.2. Live Cluster Backup - Replication</a></span></dt><dt><span class="section"><a href="ops.backup.html#ops.backup.live.copytable">1.7.3. Live Cluster Backup - CopyTable</a></span></dt><dt><span class="section"><a href="ops.backup.html#ops.backup.live.export">1.7.4. Live Cluster Backup - Export</a></span></dt></dl></dd><dt><span class="section"><a href="ops.capacity.html">1.8. Capacity Planning</a></span></dt><dd><dl><dt><span class="section"><a href="ops.capacity.html#ops.capacity.storage">1.8.1. Storage</a></span></dt><dt><span class="section"><a href="ops.capacity.html#ops.capacity.regions">1.8.2. Regions</a></span></dt></dl></dd></dl></div>
+ <title>Chapter 1. Apache HBase (TM) Operational Management</title><link rel="stylesheet" type="text/css" href="../css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"><link rel="home" href="ops_mgt.html" title="Chapter 1. Apache HBase (TM) Operational Management"><link rel="next" href="ops.regionmgt.html" title="1.2. Region Management"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="navheader"><table width="100%" summary="Navigation header"><tr><th colspan="3" align="center">Chapter 1. Apache HBase (TM) Operational Management</th></tr><tr><td width="20%" align="left"> </td><th width="60%" align="center"> </th><td width="20%" align="right"> <a accesskey="n" href="ops.regionmgt.html">Next</a></td></tr></table><hr></div><div class="chapter" title="Chapter 1. Apache HBase (TM) Operational Management"><div class="titlepage"><d
iv><div><h2 class="title"><a name="ops_mgt"></a>Chapter 1. Apache HBase (TM) Operational Management</h2></div></div></div><div class="toc"><p><b>Table of Contents</b></p><dl><dt><span class="section"><a href="ops_mgt.html#tools">1.1. HBase Tools and Utilities</a></span></dt><dd><dl><dt><span class="section"><a href="ops_mgt.html#driver">1.1.1. Driver</a></span></dt><dt><span class="section"><a href="ops_mgt.html#hbck">1.1.2. HBase <span class="application">hbck</span></a></span></dt><dt><span class="section"><a href="ops_mgt.html#hfile_tool2">1.1.3. HFile Tool</a></span></dt><dt><span class="section"><a href="ops_mgt.html#wal_tools">1.1.4. WAL Tools</a></span></dt><dt><span class="section"><a href="ops_mgt.html#compression.tool">1.1.5. Compression Tool</a></span></dt><dt><span class="section"><a href="ops_mgt.html#copytable">1.1.6. CopyTable</a></span></dt><dt><span class="section"><a href="ops_mgt.html#export">1.1.7. Export</a></span></dt><dt><span class="section"
><a href="ops_mgt.html#import">1.1.8. Import</a></span></dt><dt><span class="section"><a href="ops_mgt.html#importtsv">1.1.9. ImportTsv</a></span></dt><dt><span class="section"><a href="ops_mgt.html#completebulkload">1.1.10. CompleteBulkLoad</a></span></dt><dt><span class="section"><a href="ops_mgt.html#walplayer">1.1.11. WALPlayer</a></span></dt><dt><span class="section"><a href="ops_mgt.html#rowcounter">1.1.12. RowCounter and CellCounter</a></span></dt><dt><span class="section"><a href="ops_mgt.html#mlockall">1.1.13. mlockall</a></span></dt></dl></dd><dt><span class="section"><a href="ops.regionmgt.html">1.2. Region Management</a></span></dt><dd><dl><dt><span class="section"><a href="ops.regionmgt.html#ops.regionmgt.majorcompact">1.2.1. Major Compaction</a></span></dt><dt><span class="section"><a href="ops.regionmgt.html#ops.regionmgt.merge">1.2.2. Merge</a></span></dt></dl></dd><dt><span class="section"><a href="node.management.html">1.3. Node Management</a></span></dt><d
d><dl><dt><span class="section"><a href="node.management.html#decommission">1.3.1. Node Decommission</a></span></dt><dt><span class="section"><a href="node.management.html#rolling">1.3.2. Rolling Restart</a></span></dt></dl></dd><dt><span class="section"><a href="hbase_metrics.html">1.4. HBase Metrics</a></span></dt><dd><dl><dt><span class="section"><a href="hbase_metrics.html#metric_setup">1.4.1. Metric Setup</a></span></dt><dt><span class="section"><a href="hbase_metrics.html#rs_metrics">1.4.2. RegionServer Metrics</a></span></dt></dl></dd><dt><span class="section"><a href="ops.monitoring.html">1.5. HBase Monitoring</a></span></dt><dd><dl><dt><span class="section"><a href="ops.monitoring.html#ops.monitoring.overview">1.5.1. Overview</a></span></dt><dt><span class="section"><a href="ops.monitoring.html#ops.slow.query">1.5.2. Slow Query Log</a></span></dt></dl></dd><dt><span class="section"><a href="cluster_replication.html">1.6. Cluster Replication</a></span></dt><dt><span
class="section"><a href="ops.backup.html">1.7. HBase Backup</a></span></dt><dd><dl><dt><span class="section"><a href="ops.backup.html#ops.backup.fullshutdown">1.7.1. Full Shutdown Backup</a></span></dt><dt><span class="section"><a href="ops.backup.html#ops.backup.live.replication">1.7.2. Live Cluster Backup - Replication</a></span></dt><dt><span class="section"><a href="ops.backup.html#ops.backup.live.copytable">1.7.3. Live Cluster Backup - CopyTable</a></span></dt><dt><span class="section"><a href="ops.backup.html#ops.backup.live.export">1.7.4. Live Cluster Backup - Export</a></span></dt></dl></dd><dt><span class="section"><a href="ops.capacity.html">1.8. Capacity Planning</a></span></dt><dd><dl><dt><span class="section"><a href="ops.capacity.html#ops.capacity.storage">1.8.1. Storage</a></span></dt><dt><span class="section"><a href="ops.capacity.html#ops.capacity.regions">1.8.2. Regions</a></span></dt></dl></dd></dl></div>
This chapter will cover operational tools and practices required of a running Apache HBase cluster.
The subject of operations is related to the topics of <a class="xref" href="">???</a>, <a class="xref" href="">???</a>,
and <a class="xref" href="">???</a> but is a distinct topic in itself.
@@ -160,7 +160,12 @@ row10 c1 c2
<code class="code">hbase.mapreduce.scan.column.family</code> to specify scanning a single column family.
</p><pre class="programlisting">$ bin/hbase org.apache.hadoop.hbase.mapreduce.CellCounter <tablename> <outputDir> [regex or prefix]</pre><p>
</p><p>Note: just like RowCounter, caching for the input Scan is configured via <code class="code">hbase.client.scanner.caching</code> in the
- job configuration. </p></div></div></div><div id="disqus_thread"></div><script type="text/javascript">
+ job configuration. </p></div><div class="section" title="1.1.13. mlockall"><div class="titlepage"><div><div><h3 class="title"><a name="mlockall"></a>1.1.13. mlockall</h3></div></div></div><p>It is possible to optionally pin your servers in physical memory making them less likely
+ to be swapped out in oversubscribed environments by having the servers call
+ <a class="link" href="http://linux.die.net/man/2/mlockall" target="_top">mlockall</a> on startup.
+ See <a class="link" href="https://issues.apache.org/jira/browse/HBASE-4391" target="_top">HBASE-4391 Add ability to start RS as root and call mlockall</a>
+ for how to build the optional library and have it run on startup.
+ </p></div></div></div><div id="disqus_thread"></div><script type="text/javascript">
var disqus_shortname = 'hbase'; // required: replace example with your forum shortname
var disqus_url = 'http://hbase.apache.org/book';
var disqus_identifier = 'ops_mgt';
Modified: hbase/hbase.apache.org/trunk/performance.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/performance.html?rev=1463652&r1=1463651&r2=1463652&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/performance.html (original)
+++ hbase/hbase.apache.org/trunk/performance.html Tue Apr 2 18:06:19 2013
@@ -37,11 +37,11 @@
from defaults. Start at 60 or 70 percent (The lower you bring down the
threshold, the more GCing is done, the more CPU used). To address the
second fragmentation issue, Todd added an experimental facility,
- <a class="indexterm" name="d656e96"></a>, that
+ <a class="indexterm" name="d851e96"></a>, that
must be explicitly enabled in Apache HBase 0.90.x (Its defaulted to be on in
Apache 0.92.x HBase). See <code class="code">hbase.hregion.memstore.mslab.enabled</code>
to true in your <code class="classname">Configuration</code>. See the cited
- slides for background and detail<sup>[<a name="d656e106" href="#ftn.d656e106" class="footnote">1</a>]</sup>.
+ slides for background and detail<sup>[<a name="d851e106" href="#ftn.d851e106" class="footnote">1</a>]</sup>.
Be aware that when enabled, each MemStore instance will occupy at least
an MSLAB instance of memory. If you have thousands of regions or lots
of regions each with many column families, this allocation of MSLAB
@@ -229,25 +229,25 @@ htable.close();</pre></div><div class="s
Table Creation: Pre-Creating Regions
”</a>, as well as <a class="xref" href="#perf.configurations" title="1.4. HBase Configurations">Section 1.4, “HBase Configurations”</a> </p></div><div class="section" title="1.9.8. Bloom Filters"><div class="titlepage"><div><div><h3 class="title"><a name="blooms"></a>1.9.8. Bloom Filters</h3></div></div></div><p>Enabling Bloom Filters can save your having to go to disk and
can help improve read latencys.</p><p><a class="link" href="http://en.wikipedia.org/wiki/Bloom_filter" target="_top">Bloom filters</a> were developed over in <a class="link" href="https://issues.apache.org/jira/browse/HBASE-1200" target="_top">HBase-1200
- Add bloomfilters</a>.<sup>[<a name="d656e587" href="#ftn.d656e587" class="footnote">2</a>]</sup><sup>[<a name="d656e599" href="#ftn.d656e599" class="footnote">3</a>]</sup></p><p>See also <a class="xref" href="#schema.bloom" title="1.6.4. Bloom Filters">Section 1.6.4, “Bloom Filters”</a>.
+ Add bloomfilters</a>.<sup>[<a name="d851e587" href="#ftn.d851e587" class="footnote">2</a>]</sup><sup>[<a name="d851e599" href="#ftn.d851e599" class="footnote">3</a>]</sup></p><p>See also <a class="xref" href="#schema.bloom" title="1.6.4. Bloom Filters">Section 1.6.4, “Bloom Filters”</a>.
</p><div class="section" title="1.9.8.1. Bloom StoreFile footprint"><div class="titlepage"><div><div><h4 class="title"><a name="bloom_footprint"></a>1.9.8.1. Bloom StoreFile footprint</h4></div></div></div><p>Bloom filters add an entry to the <code class="classname">StoreFile</code>
general <code class="classname">FileInfo</code> data structure and then two
extra entries to the <code class="classname">StoreFile</code> metadata
- section.</p><div class="section" title="1.9.8.1.1. BloomFilter in the StoreFile FileInfo data structure"><div class="titlepage"><div><div><h5 class="title"><a name="d656e623"></a>1.9.8.1.1. BloomFilter in the <code class="classname">StoreFile</code>
+ section.</p><div class="section" title="1.9.8.1.1. BloomFilter in the StoreFile FileInfo data structure"><div class="titlepage"><div><div><h5 class="title"><a name="d851e623"></a>1.9.8.1.1. BloomFilter in the <code class="classname">StoreFile</code>
<code class="classname">FileInfo</code> data structure</h5></div></div></div><p><code class="classname">FileInfo</code> has a
<code class="varname">BLOOM_FILTER_TYPE</code> entry which is set to
<code class="varname">NONE</code>, <code class="varname">ROW</code> or
- <code class="varname">ROWCOL.</code></p></div><div class="section" title="1.9.8.1.2. BloomFilter entries in StoreFile metadata"><div class="titlepage"><div><div><h5 class="title"><a name="d656e647"></a>1.9.8.1.2. BloomFilter entries in <code class="classname">StoreFile</code>
+ <code class="varname">ROWCOL.</code></p></div><div class="section" title="1.9.8.1.2. BloomFilter entries in StoreFile metadata"><div class="titlepage"><div><div><h5 class="title"><a name="d851e647"></a>1.9.8.1.2. BloomFilter entries in <code class="classname">StoreFile</code>
metadata</h5></div></div></div><p><code class="varname">BLOOM_FILTER_META</code> holds Bloom Size, Hash
Function used, etc. Its small in size and is cached on
<code class="classname">StoreFile.Reader</code> load</p><p><code class="varname">BLOOM_FILTER_DATA</code> is the actual bloomfilter
data. Obtained on-demand. Stored in the LRU cache, if it is enabled
- (Its enabled by default).</p></div></div><div class="section" title="1.9.8.2. Bloom Filter Configuration"><div class="titlepage"><div><div><h4 class="title"><a name="config.bloom"></a>1.9.8.2. Bloom Filter Configuration</h4></div></div></div><div class="section" title="1.9.8.2.1. io.hfile.bloom.enabled global kill switch"><div class="titlepage"><div><div><h5 class="title"><a name="d656e667"></a>1.9.8.2.1. <code class="varname">io.hfile.bloom.enabled</code> global kill
+ (Its enabled by default).</p></div></div><div class="section" title="1.9.8.2. Bloom Filter Configuration"><div class="titlepage"><div><div><h4 class="title"><a name="config.bloom"></a>1.9.8.2. Bloom Filter Configuration</h4></div></div></div><div class="section" title="1.9.8.2.1. io.hfile.bloom.enabled global kill switch"><div class="titlepage"><div><div><h5 class="title"><a name="d851e667"></a>1.9.8.2.1. <code class="varname">io.hfile.bloom.enabled</code> global kill
switch</h5></div></div></div><p><code class="code">io.hfile.bloom.enabled</code> in
<code class="classname">Configuration</code> serves as the kill switch in case
- something goes wrong. Default = <code class="varname">true</code>.</p></div><div class="section" title="1.9.8.2.2. io.hfile.bloom.error.rate"><div class="titlepage"><div><div><h5 class="title"><a name="d656e682"></a>1.9.8.2.2. <code class="varname">io.hfile.bloom.error.rate</code></h5></div></div></div><p><code class="varname">io.hfile.bloom.error.rate</code> = average false
+ something goes wrong. Default = <code class="varname">true</code>.</p></div><div class="section" title="1.9.8.2.2. io.hfile.bloom.error.rate"><div class="titlepage"><div><div><h5 class="title"><a name="d851e682"></a>1.9.8.2.2. <code class="varname">io.hfile.bloom.error.rate</code></h5></div></div></div><p><code class="varname">io.hfile.bloom.error.rate</code> = average false
positive rate. Default = 1%. Decrease rate by ½ (e.g. to .5%) == +1
- bit per bloom entry.</p></div><div class="section" title="1.9.8.2.3. io.hfile.bloom.max.fold"><div class="titlepage"><div><div><h5 class="title"><a name="d656e690"></a>1.9.8.2.3. <code class="varname">io.hfile.bloom.max.fold</code></h5></div></div></div><p><code class="varname">io.hfile.bloom.max.fold</code> = guaranteed minimum
+ bit per bloom entry.</p></div><div class="section" title="1.9.8.2.3. io.hfile.bloom.max.fold"><div class="titlepage"><div><div><h5 class="title"><a name="d851e690"></a>1.9.8.2.3. <code class="varname">io.hfile.bloom.max.fold</code></h5></div></div></div><p><code class="varname">io.hfile.bloom.max.fold</code> = guaranteed minimum
fold rate. Most people should leave this alone. Default = 7, or can
collapse to at least 1/128th of original size. See the
<span class="emphasis"><em>Development Process</em></span> section of the document <a class="link" href="https://issues.apache.org/jira/secure/attachment/12444007/Bloom_Filters_in_HBase.pdf" target="_top">BloomFilters
@@ -271,7 +271,7 @@ read directly from disk instead of going
data is local. What this means for HBase is that the RegionServers can
read directly off their machine's disks instead of having to open a
socket to talk to the DataNode, the former being generally much
-faster<sup>[<a name="d656e762" href="#ftn.d656e762" class="footnote">4</a>]</sup>.
+faster<sup>[<a name="d851e762" href="#ftn.d851e762" class="footnote">4</a>]</sup>.
Also see <a class="link" href="http://search-hadoop.com/m/zV6dKrLCVh1" target="_top">HBase, mail # dev - read short circuit</a> thread for
more discussion around short circuit reads.
</p><p>To enable "short circuit" reads, you must set two configurations.
@@ -301,22 +301,22 @@ the data will still be read.
</p><p>If you are running on EC2 and post performance questions on the dist-list, please state this fact up-front that
because EC2 issues are practically a separate class of performance issues.
</p></div><div class="section" title="1.13. Case Studies"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="perf.casestudy"></a>1.13. Case Studies</h2></div></div></div><p>For Performance and Troubleshooting Case Studies, see <a class="xref" href="#">???</a>.
- </p></div><div class="footnotes"><br><hr width="100" align="left"><div class="footnote"><p><sup>[<a id="ftn.d656e106" href="#d656e106" class="para">1</a>] </sup>The latest jvms do better
+ </p></div><div class="footnotes"><br><hr width="100" align="left"><div class="footnote"><p><sup>[<a id="ftn.d851e106" href="#d851e106" class="para">1</a>] </sup>The latest jvms do better
regards fragmentation so make sure you are running a recent release.
Read down in the message,
- <a class="link" href="http://osdir.com/ml/hotspot-gc-use/2011-11/msg00002.html" target="_top">Identifying concurrent mode failures caused by fragmentation</a>.</p></div><div class="footnote"><p><sup>[<a id="ftn.d656e587" href="#d656e587" class="para">2</a>] </sup>For description of the development process -- why static blooms
+ <a class="link" href="http://osdir.com/ml/hotspot-gc-use/2011-11/msg00002.html" target="_top">Identifying concurrent mode failures caused by fragmentation</a>.</p></div><div class="footnote"><p><sup>[<a id="ftn.d851e587" href="#d851e587" class="para">2</a>] </sup>For description of the development process -- why static blooms
rather than dynamic -- and for an overview of the unique properties
that pertain to blooms in HBase, as well as possible future
directions, see the <span class="emphasis"><em>Development Process</em></span> section
of the document <a class="link" href="https://issues.apache.org/jira/secure/attachment/12444007/Bloom_Filters_in_HBase.pdf" target="_top">BloomFilters
- in HBase</a> attached to <a class="link" href="https://issues.apache.org/jira/browse/HBASE-1200" target="_top">HBase-1200</a>.</p></div><div class="footnote"><p><sup>[<a id="ftn.d656e599" href="#d656e599" class="para">3</a>] </sup>The bloom filters described here are actually version two of
+ in HBase</a> attached to <a class="link" href="https://issues.apache.org/jira/browse/HBASE-1200" target="_top">HBase-1200</a>.</p></div><div class="footnote"><p><sup>[<a id="ftn.d851e599" href="#d851e599" class="para">3</a>] </sup>The bloom filters described here are actually version two of
blooms in HBase. In versions up to 0.19.x, HBase had a dynamic bloom
option based on work done by the <a class="link" href="http://www.one-lab.org" target="_top">European Commission One-Lab
Project 034819</a>. The core of the HBase bloom work was later
pulled up into Hadoop to implement org.apache.hadoop.io.BloomMapFile.
Version 1 of HBase blooms never worked that well. Version 2 is a
rewrite from scratch though again it starts with the one-lab
- work.</p></div><div class="footnote"><p><sup>[<a id="ftn.d656e762" href="#d656e762" class="para">4</a>] </sup>See JD's <a class="link" href="http://files.meetup.com/1350427/hug_ebay_jdcryans.pdf" target="_top">Performance Talk</a></p></div></div></div><div id="disqus_thread"></div><script type="text/javascript">
+ work.</p></div><div class="footnote"><p><sup>[<a id="ftn.d851e762" href="#d851e762" class="para">4</a>] </sup>See JD's <a class="link" href="http://files.meetup.com/1350427/hug_ebay_jdcryans.pdf" target="_top">Performance Talk</a></p></div></div></div><div id="disqus_thread"></div><script type="text/javascript">
var disqus_shortname = 'hbase'; // required: replace example with your forum shortname
var disqus_url = 'http://hbase.apache.org/book';
var disqus_identifier = 'performance';
Modified: hbase/hbase.apache.org/trunk/performance/jvm.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/performance/jvm.html?rev=1463652&r1=1463651&r2=1463652&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/performance/jvm.html (original)
+++ hbase/hbase.apache.org/trunk/performance/jvm.html Tue Apr 2 18:06:19 2013
@@ -10,11 +10,11 @@
from defaults. Start at 60 or 70 percent (The lower you bring down the
threshold, the more GCing is done, the more CPU used). To address the
second fragmentation issue, Todd added an experimental facility,
- <a class="indexterm" name="d656e96"></a>, that
+ <a class="indexterm" name="d851e96"></a>, that
must be explicitly enabled in Apache HBase 0.90.x (Its defaulted to be on in
Apache 0.92.x HBase). See <code class="code">hbase.hregion.memstore.mslab.enabled</code>
to true in your <code class="classname">Configuration</code>. See the cited
- slides for background and detail<sup>[<a name="d656e106" href="#ftn.d656e106" class="footnote">1</a>]</sup>.
+ slides for background and detail<sup>[<a name="d851e106" href="#ftn.d851e106" class="footnote">1</a>]</sup>.
Be aware that when enabled, each MemStore instance will occupy at least
an MSLAB instance of memory. If you have thousands of regions or lots
of regions each with many column families, this allocation of MSLAB
@@ -22,7 +22,7 @@
an extreme case cause you to OOME. Disable MSLAB in this case, or
lower the amount of memory it uses or float less regions per server.
</p><p>For more information about GC logs, see <a class="xref" href="">???</a>.
- </p></div></div><div class="footnotes"><br><hr width="100" align="left"><div class="footnote"><p><sup>[<a id="ftn.d656e106" href="#d656e106" class="para">1</a>] </sup>The latest jvms do better
+ </p></div></div><div class="footnotes"><br><hr width="100" align="left"><div class="footnote"><p><sup>[<a id="ftn.d851e106" href="#d851e106" class="para">1</a>] </sup>The latest jvms do better
regards fragmentation so make sure you are running a recent release.
Read down in the message,
<a class="link" href="http://osdir.com/ml/hotspot-gc-use/2011-11/msg00002.html" target="_top">Identifying concurrent mode failures caused by fragmentation</a>.</p></div></div></div><div id="disqus_thread"></div><script type="text/javascript">
Modified: hbase/hbase.apache.org/trunk/performance/perf.hdfs.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/performance/perf.hdfs.html?rev=1463652&r1=1463651&r2=1463652&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/performance/perf.hdfs.html (original)
+++ hbase/hbase.apache.org/trunk/performance/perf.hdfs.html Tue Apr 2 18:06:19 2013
@@ -13,7 +13,7 @@ read directly from disk instead of going
data is local. What this means for HBase is that the RegionServers can
read directly off their machine's disks instead of having to open a
socket to talk to the DataNode, the former being generally much
-faster<sup>[<a name="d656e762" href="#ftn.d656e762" class="footnote">4</a>]</sup>.
+faster<sup>[<a name="d851e762" href="#ftn.d851e762" class="footnote">4</a>]</sup>.
Also see <a class="link" href="http://search-hadoop.com/m/zV6dKrLCVh1" target="_top">HBase, mail # dev - read short circuit</a> thread for
more discussion around short circuit reads.
</p><p>To enable "short circuit" reads, you must set two configurations.
@@ -37,7 +37,7 @@ the data will still be read.
returning the most current row or specified timestamps, etc.), and as such HBase is 4-5 times slower than HDFS in this
processing context. Not that there isn't room for improvement (and this gap will, over time, be reduced), but HDFS
will always be faster in this use-case.
- </p></div><div class="footnotes"><br><hr width="100" align="left"><div class="footnote"><p><sup>[<a id="ftn.d656e762" href="#d656e762" class="para">4</a>] </sup>See JD's <a class="link" href="http://files.meetup.com/1350427/hug_ebay_jdcryans.pdf" target="_top">Performance Talk</a></p></div></div></div><div id="disqus_thread"></div><script type="text/javascript">
+ </p></div><div class="footnotes"><br><hr width="100" align="left"><div class="footnote"><p><sup>[<a id="ftn.d851e762" href="#d851e762" class="para">4</a>] </sup>See JD's <a class="link" href="http://files.meetup.com/1350427/hug_ebay_jdcryans.pdf" target="_top">Performance Talk</a></p></div></div></div><div id="disqus_thread"></div><script type="text/javascript">
var disqus_shortname = 'hbase'; // required: replace example with your forum shortname
var disqus_url = 'http://hbase.apache.org/book';
var disqus_identifier = 'perf.hdfs';