You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hbase.apache.org by en...@apache.org on 2013/03/30 01:19:57 UTC
svn commit: r1462679 [11/14] - in /hbase/hbase.apache.org/trunk: ./ book/
case_studies/ community/ configuration/ developer/ getting_started/
ops_mgt/ performance/ rpc/
Modified: hbase/hbase.apache.org/trunk/developer/developing.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/developer/developing.html?rev=1462679&r1=1462678&r2=1462679&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/developer/developing.html (original)
+++ hbase/hbase.apache.org/trunk/developer/developing.html Sat Mar 30 00:19:55 2013
@@ -32,13 +32,13 @@
</p><p>This convention comes from our parent project Hadoop.</p></div><div class="section" title="1.10.4. Invariants"><div class="titlepage"><div><div><h3 class="title"><a name="design.invariants"></a>1.10.4. Invariants</h3></div></div></div><p>We don't have many but what we have we list below. All are subject to challenge of
course but until then, please hold to the rules of the road.
</p><div class="section" title="1.10.4.1. No permanent state in ZooKeeper"><div class="titlepage"><div><div><h4 class="title"><a name="design.invariants.zk.data"></a>1.10.4.1. No permanent state in ZooKeeper</h4></div></div></div><p>ZooKeeper state should transient (treat it like memory). If deleted, hbase
- should be able to recover and essentially be in the same state<sup>[<a name="d1377e1044" href="#ftn.d1377e1044" class="footnote">1</a>]</sup>.
+ should be able to recover and essentially be in the same state<sup>[<a name="d1382e1044" href="#ftn.d1382e1044" class="footnote">1</a>]</sup>.
</p></div></div><div class="section" title="1.10.5. Running In-Situ"><div class="titlepage"><div><div><h3 class="title"><a name="run.insitu"></a>1.10.5. Running In-Situ</h3></div></div></div><p>If you are developing Apache HBase, frequently it is useful to test your changes against a more-real cluster than what you find in unit tests. In this case, HBase can be run directly from the source in local-mode.
All you need to do is run:
</p><pre class="programlisting">${HBASE_HOME}/bin/start-hbase.sh</pre><p>
This will spin up a full local-cluster, just as if you had packaged up HBase and installed it on your machine.
</p><p>Keep in mind that you will need to have installed HBase into your local maven repository for the in-situ cluster to work properly. That is, you will need to run:</p><pre class="programlisting">mvn clean install -DskipTests</pre><p>to ensure that maven can find the correct classpath and dependencies. Generally, the above command
- is just a good thing to try running first, if maven is acting oddly.</p></div><div class="footnotes"><br><hr width="100" align="left"><div class="footnote"><p><sup>[<a id="ftn.d1377e1044" href="#d1377e1044" class="para">1</a>] </sup>There are currently
+ is just a good thing to try running first, if maven is acting oddly.</p></div><div class="footnotes"><br><hr width="100" align="left"><div class="footnote"><p><sup>[<a id="ftn.d1382e1044" href="#d1382e1044" class="para">1</a>] </sup>There are currently
a few exceptions that we need to fix around whether a table is enabled or disabled</p></div></div></div><div id="disqus_thread"></div><script type="text/javascript">
var disqus_shortname = 'hbase'; // required: replace example with your forum shortname
var disqus_url = 'http://hbase.apache.org/book';
Modified: hbase/hbase.apache.org/trunk/developer/hbase.org.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/developer/hbase.org.html?rev=1462679&r1=1462678&r2=1462679&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/developer/hbase.org.html (original)
+++ hbase/hbase.apache.org/trunk/developer/hbase.org.html Sat Mar 30 00:19:55 2013
@@ -12,7 +12,7 @@
# Getting the javadoc into site is a little tricky. You have to build it independent, then
# 'aggregate' it at top-level so the pre-site site lifecycle step can find it; that is
# what the javadoc:javadoc and javadoc:aggregate is about.
- $ MAVEN_OPTS=" -Xmx3g" mvn clean -DskipTests javadoc:javadoc javadoc:aggregate site site:stage -DstagingDirectory=/Users/stack/checkouts/hbase.apache.org/trunk
+ $ MAVEN_OPTS=" -Xmx3g" mvn clean -DskipTests javadoc:aggregate site site:stage -DstagingDirectory=/Users/stack/checkouts/hbase.apache.org/trunk
# Check the deployed site by viewing in a brower.
# If all is good, commit it and it will show up at http://hbase.apache.org
#
Modified: hbase/hbase.apache.org/trunk/developer/hbase.tests.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/developer/hbase.tests.html?rev=1462679&r1=1462678&r2=1462679&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/developer/hbase.tests.html (original)
+++ hbase/hbase.apache.org/trunk/developer/hbase.tests.html Sat Mar 30 00:19:55 2013
@@ -46,18 +46,18 @@ Apache HBase uses a patched maven surefi
its unit test characterizations.
</p><p>Read the below to figure which annotation of the set small, medium, and large to
put on your new HBase unit test.
-</p><div class="section" title="1.7.2.1. Small Tests"><div class="titlepage"><div><div><h4 class="title"><a name="hbase.unittests.small"></a>1.7.2.1. Small Tests<a class="indexterm" name="d1377e445"></a></h4></div></div></div><p>
+</p><div class="section" title="1.7.2.1. Small Tests"><div class="titlepage"><div><div><h4 class="title"><a name="hbase.unittests.small"></a>1.7.2.1. Small Tests<a class="indexterm" name="d1382e445"></a></h4></div></div></div><p>
<span class="emphasis"><em>Small</em></span> tests are executed in a shared JVM. We put in this category all the tests that can
be executed quickly in a shared JVM. The maximum execution time for a small test is 15 seconds,
-and small tests should not use a (mini)cluster.</p></div><div class="section" title="1.7.2.2. Medium Tests"><div class="titlepage"><div><div><h4 class="title"><a name="hbase.unittests.medium"></a>1.7.2.2. Medium Tests<a class="indexterm" name="d1377e456"></a></h4></div></div></div><p><span class="emphasis"><em>Medium</em></span> tests represent tests that must be executed
+and small tests should not use a (mini)cluster.</p></div><div class="section" title="1.7.2.2. Medium Tests"><div class="titlepage"><div><div><h4 class="title"><a name="hbase.unittests.medium"></a>1.7.2.2. Medium Tests<a class="indexterm" name="d1382e456"></a></h4></div></div></div><p><span class="emphasis"><em>Medium</em></span> tests represent tests that must be executed
before proposing a patch. They are designed to run in less than 30 minutes altogether,
and are quite stable in their results. They are designed to last less than 50 seconds
individually. They can use a cluster, and each of them is executed in a separate JVM.
-</p></div><div class="section" title="1.7.2.3. Large Tests"><div class="titlepage"><div><div><h4 class="title"><a name="hbase.unittests.large"></a>1.7.2.3. Large Tests<a class="indexterm" name="d1377e466"></a></h4></div></div></div><p><span class="emphasis"><em>Large</em></span> tests are everything else. They are typically large-scale
+</p></div><div class="section" title="1.7.2.3. Large Tests"><div class="titlepage"><div><div><h4 class="title"><a name="hbase.unittests.large"></a>1.7.2.3. Large Tests<a class="indexterm" name="d1382e466"></a></h4></div></div></div><p><span class="emphasis"><em>Large</em></span> tests are everything else. They are typically large-scale
tests, regression tests for specific bugs, timeout tests, performance tests.
They are executed before a commit on the pre-integration machines. They can be run on
the developer machine as well.
-</p></div><div class="section" title="1.7.2.4. Integration Tests"><div class="titlepage"><div><div><h4 class="title"><a name="hbase.unittests.integration"></a>1.7.2.4. Integration Tests<a class="indexterm" name="d1377e476"></a></h4></div></div></div><p><span class="emphasis"><em>Integration</em></span> tests are system level tests. See
+</p></div><div class="section" title="1.7.2.4. Integration Tests"><div class="titlepage"><div><div><h4 class="title"><a name="hbase.unittests.integration"></a>1.7.2.4. Integration Tests<a class="indexterm" name="d1382e476"></a></h4></div></div></div><p><span class="emphasis"><em>Integration</em></span> tests are system level tests. See
<a class="xref" href="hbase.tests.html#integration.tests" title="1.7.5. Integration Tests">Section 1.7.5, “Integration Tests”</a> for more info.
</p></div></div><div class="section" title="1.7.3. Running tests"><div class="titlepage"><div><div><h3 class="title"><a name="hbase.unittests.cmds"></a>1.7.3. Running tests</h3></div></div></div><p>Below we describe how to run the Apache HBase junit categories.</p><div class="section" title="1.7.3.1. Default: small and medium category tests"><div class="titlepage"><div><div><h4 class="title"><a name="hbase.unittests.cmds.test"></a>1.7.3.1. Default: small and medium category tests
</h4></div></div></div><p>Running </p><pre class="programlisting">mvn test</pre><p> will execute all small tests in a single JVM
@@ -112,7 +112,7 @@ It must be executed from the directory w
Running </p><pre class="programlisting">./dev-support/hbasetests.sh runAllTests</pre><p> will execute all tests.
Running </p><pre class="programlisting">./dev-support/hbasetests.sh replayFailed</pre><p> will rerun the failed tests a
second time, in a separate jvm and without parallelisation.
-</p></div><div class="section" title="1.7.3.7. Test Resource Checker"><div class="titlepage"><div><div><h4 class="title"><a name="hbase.unittests.resource.checker"></a>1.7.3.7. Test Resource Checker<a class="indexterm" name="d1377e604"></a></h4></div></div></div><p>
+</p></div><div class="section" title="1.7.3.7. Test Resource Checker"><div class="titlepage"><div><div><h4 class="title"><a name="hbase.unittests.resource.checker"></a>1.7.3.7. Test Resource Checker<a class="indexterm" name="d1382e604"></a></h4></div></div></div><p>
A custom Maven SureFire plugin listener checks a number of resources before
and after each HBase unit test runs and logs its findings at the end of the test
output files which can be found in <code class="filename">target/surefire-reports</code>
Modified: hbase/hbase.apache.org/trunk/getting_started.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/getting_started.html?rev=1462679&r1=1462678&r2=1462679&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/getting_started.html (original)
+++ hbase/hbase.apache.org/trunk/getting_started.html Sat Mar 30 00:19:55 2013
@@ -1,6 +1,6 @@
<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
- <title>Chapter 1. Getting Started</title><link rel="stylesheet" type="text/css" href="css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="chapter" title="Chapter 1. Getting Started"><div class="titlepage"><div><div><h2 class="title"><a name="getting_started"></a>Chapter 1. Getting Started</h2></div></div></div><div class="toc"><p><b>Table of Contents</b></p><dl><dt><span class="section"><a href="#d1152e5">1.1. Introduction</a></span></dt><dt><span class="section"><a href="#quickstart">1.2. Quick Start</a></span></dt><dd><dl><dt><span class="section"><a href="#d1152e33">1.2.1. Download and unpack the latest stable release.</a></span></dt><dt><span class="section"><a href="#start_hbase">1.2.2. Start HBase</a></span></dt><dt><span class="section"><a href="#shell_exercises">1.2.3. Shell Exercises</a></span>
</dt><dt><span class="section"><a href="#stopping">1.2.4. Stopping HBase</a></span></dt><dt><span class="section"><a href="#d1152e193">1.2.5. Where to go next</a></span></dt></dl></dd></dl></div><div class="section" title="1.1. Introduction"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="d1152e5"></a>1.1. Introduction</h2></div></div></div><p><a class="xref" href="#quickstart" title="1.2. Quick Start">Section 1.2, “Quick Start”</a> will get you up and
+ <title>Chapter 1. Getting Started</title><link rel="stylesheet" type="text/css" href="css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="chapter" title="Chapter 1. Getting Started"><div class="titlepage"><div><div><h2 class="title"><a name="getting_started"></a>Chapter 1. Getting Started</h2></div></div></div><div class="toc"><p><b>Table of Contents</b></p><dl><dt><span class="section"><a href="#d1157e5">1.1. Introduction</a></span></dt><dt><span class="section"><a href="#quickstart">1.2. Quick Start</a></span></dt><dd><dl><dt><span class="section"><a href="#d1157e33">1.2.1. Download and unpack the latest stable release.</a></span></dt><dt><span class="section"><a href="#start_hbase">1.2.2. Start HBase</a></span></dt><dt><span class="section"><a href="#shell_exercises">1.2.3. Shell Exercises</a></span>
</dt><dt><span class="section"><a href="#stopping">1.2.4. Stopping HBase</a></span></dt><dt><span class="section"><a href="#d1157e193">1.2.5. Where to go next</a></span></dt></dl></dd></dl></div><div class="section" title="1.1. Introduction"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="d1157e5"></a>1.1. Introduction</h2></div></div></div><p><a class="xref" href="#quickstart" title="1.2. Quick Start">Section 1.2, “Quick Start”</a> will get you up and
running on a single-node instance of HBase using the local filesystem.
</p></div><div class="section" title="1.2. Quick Start"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="quickstart"></a>1.2. Quick Start</h2></div></div></div><p>This guide describes setup of a standalone HBase instance that uses
the local filesystem. It leads you through creating a table, inserting
@@ -13,7 +13,7 @@
127.0.0.1 localhost
127.0.0.1 ubuntu.ubuntu-domain ubuntu
</pre><p>
- </p></div><div class="section" title="1.2.1. Download and unpack the latest stable release."><div class="titlepage"><div><div><h3 class="title"><a name="d1152e33"></a>1.2.1. Download and unpack the latest stable release.</h3></div></div></div><p>Choose a download site from this list of <a class="link" href="http://www.apache.org/dyn/closer.cgi/hbase/" target="_top">Apache Download
+ </p></div><div class="section" title="1.2.1. Download and unpack the latest stable release."><div class="titlepage"><div><div><h3 class="title"><a name="d1157e33"></a>1.2.1. Download and unpack the latest stable release.</h3></div></div></div><p>Choose a download site from this list of <a class="link" href="http://www.apache.org/dyn/closer.cgi/hbase/" target="_top">Apache Download
Mirrors</a>. Click on the suggested top link. This will take you to a
mirror of <span class="emphasis"><em>HBase Releases</em></span>. Click on the folder named
<code class="filename">stable</code> and then download the file that ends in
@@ -95,7 +95,7 @@ cf:a timestamp=1288380727188, val
0 row(s) in 1.0930 seconds
hbase(main):013:0> drop 'test'
0 row(s) in 0.0770 seconds </pre><p>Exit the shell by typing exit.</p><pre class="programlisting">hbase(main):014:0> exit</pre></div><div class="section" title="1.2.4. Stopping HBase"><div class="titlepage"><div><div><h3 class="title"><a name="stopping"></a>1.2.4. Stopping HBase</h3></div></div></div><p>Stop your hbase instance by running the stop script.</p><pre class="programlisting">$ ./bin/stop-hbase.sh
-stopping hbase...............</pre></div><div class="section" title="1.2.5. Where to go next"><div class="titlepage"><div><div><h3 class="title"><a name="d1152e193"></a>1.2.5. Where to go next</h3></div></div></div><p>The above described standalone setup is good for testing and
+stopping hbase...............</pre></div><div class="section" title="1.2.5. Where to go next"><div class="titlepage"><div><div><h3 class="title"><a name="d1157e193"></a>1.2.5. Where to go next</h3></div></div></div><p>The above described standalone setup is good for testing and
experiments only. In the next chapter, <a class="xref" href="#">???</a>,
we'll go into depth on the different HBase run modes, system requirements
running HBase, and critical configurations setting up a distributed HBase deploy.</p></div></div></div><div id="disqus_thread"></div><script type="text/javascript">
Modified: hbase/hbase.apache.org/trunk/getting_started/getting_started.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/getting_started/getting_started.html?rev=1462679&r1=1462678&r2=1462679&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/getting_started/getting_started.html (original)
+++ hbase/hbase.apache.org/trunk/getting_started/getting_started.html Sat Mar 30 00:19:55 2013
@@ -1,6 +1,6 @@
<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
- <title>Chapter 1. Getting Started</title><link rel="stylesheet" type="text/css" href="../css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"><link rel="home" href="getting_started.html" title="Chapter 1. Getting Started"><link rel="next" href="quickstart.html" title="1.2. Quick Start"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="navheader"><table width="100%" summary="Navigation header"><tr><th colspan="3" align="center">Chapter 1. Getting Started</th></tr><tr><td width="20%" align="left"> </td><th width="60%" align="center"> </th><td width="20%" align="right"> <a accesskey="n" href="quickstart.html">Next</a></td></tr></table><hr></div><div class="chapter" title="Chapter 1. Getting Started"><div class="titlepage"><div><div><h2 class="title"><a name="getting_started"></a>Chapter 1. Getting Started</h2></div><
/div></div><div class="toc"><p><b>Table of Contents</b></p><dl><dt><span class="section"><a href="getting_started.html#d1152e5">1.1. Introduction</a></span></dt><dt><span class="section"><a href="quickstart.html">1.2. Quick Start</a></span></dt><dd><dl><dt><span class="section"><a href="quickstart.html#d1152e33">1.2.1. Download and unpack the latest stable release.</a></span></dt><dt><span class="section"><a href="quickstart.html#start_hbase">1.2.2. Start HBase</a></span></dt><dt><span class="section"><a href="quickstart.html#shell_exercises">1.2.3. Shell Exercises</a></span></dt><dt><span class="section"><a href="quickstart.html#stopping">1.2.4. Stopping HBase</a></span></dt><dt><span class="section"><a href="quickstart.html#d1152e193">1.2.5. Where to go next</a></span></dt></dl></dd></dl></div><div class="section" title="1.1. Introduction"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="d1152e5"></a>1.1. Introduction</h2></div></di
v></div><p><a class="xref" href="quickstart.html" title="1.2. Quick Start">Section 1.2, “Quick Start”</a> will get you up and
+ <title>Chapter 1. Getting Started</title><link rel="stylesheet" type="text/css" href="../css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"><link rel="home" href="getting_started.html" title="Chapter 1. Getting Started"><link rel="next" href="quickstart.html" title="1.2. Quick Start"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="navheader"><table width="100%" summary="Navigation header"><tr><th colspan="3" align="center">Chapter 1. Getting Started</th></tr><tr><td width="20%" align="left"> </td><th width="60%" align="center"> </th><td width="20%" align="right"> <a accesskey="n" href="quickstart.html">Next</a></td></tr></table><hr></div><div class="chapter" title="Chapter 1. Getting Started"><div class="titlepage"><div><div><h2 class="title"><a name="getting_started"></a>Chapter 1. Getting Started</h2></div><
/div></div><div class="toc"><p><b>Table of Contents</b></p><dl><dt><span class="section"><a href="getting_started.html#d1157e5">1.1. Introduction</a></span></dt><dt><span class="section"><a href="quickstart.html">1.2. Quick Start</a></span></dt><dd><dl><dt><span class="section"><a href="quickstart.html#d1157e33">1.2.1. Download and unpack the latest stable release.</a></span></dt><dt><span class="section"><a href="quickstart.html#start_hbase">1.2.2. Start HBase</a></span></dt><dt><span class="section"><a href="quickstart.html#shell_exercises">1.2.3. Shell Exercises</a></span></dt><dt><span class="section"><a href="quickstart.html#stopping">1.2.4. Stopping HBase</a></span></dt><dt><span class="section"><a href="quickstart.html#d1157e193">1.2.5. Where to go next</a></span></dt></dl></dd></dl></div><div class="section" title="1.1. Introduction"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="d1157e5"></a>1.1. Introduction</h2></div></di
v></div><p><a class="xref" href="quickstart.html" title="1.2. Quick Start">Section 1.2, “Quick Start”</a> will get you up and
running on a single-node instance of HBase using the local filesystem.
</p></div></div><div id="disqus_thread"></div><script type="text/javascript">
var disqus_shortname = 'hbase'; // required: replace example with your forum shortname
Modified: hbase/hbase.apache.org/trunk/getting_started/quickstart.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/getting_started/quickstart.html?rev=1462679&r1=1462678&r2=1462679&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/getting_started/quickstart.html (original)
+++ hbase/hbase.apache.org/trunk/getting_started/quickstart.html Sat Mar 30 00:19:55 2013
@@ -11,7 +11,7 @@
127.0.0.1 localhost
127.0.0.1 ubuntu.ubuntu-domain ubuntu
</pre><p>
- </p></div><div class="section" title="1.2.1. Download and unpack the latest stable release."><div class="titlepage"><div><div><h3 class="title"><a name="d1152e33"></a>1.2.1. Download and unpack the latest stable release.</h3></div></div></div><p>Choose a download site from this list of <a class="link" href="http://www.apache.org/dyn/closer.cgi/hbase/" target="_top">Apache Download
+ </p></div><div class="section" title="1.2.1. Download and unpack the latest stable release."><div class="titlepage"><div><div><h3 class="title"><a name="d1157e33"></a>1.2.1. Download and unpack the latest stable release.</h3></div></div></div><p>Choose a download site from this list of <a class="link" href="http://www.apache.org/dyn/closer.cgi/hbase/" target="_top">Apache Download
Mirrors</a>. Click on the suggested top link. This will take you to a
mirror of <span class="emphasis"><em>HBase Releases</em></span>. Click on the folder named
<code class="filename">stable</code> and then download the file that ends in
@@ -93,7 +93,7 @@ cf:a timestamp=1288380727188, val
0 row(s) in 1.0930 seconds
hbase(main):013:0> drop 'test'
0 row(s) in 0.0770 seconds </pre><p>Exit the shell by typing exit.</p><pre class="programlisting">hbase(main):014:0> exit</pre></div><div class="section" title="1.2.4. Stopping HBase"><div class="titlepage"><div><div><h3 class="title"><a name="stopping"></a>1.2.4. Stopping HBase</h3></div></div></div><p>Stop your hbase instance by running the stop script.</p><pre class="programlisting">$ ./bin/stop-hbase.sh
-stopping hbase...............</pre></div><div class="section" title="1.2.5. Where to go next"><div class="titlepage"><div><div><h3 class="title"><a name="d1152e193"></a>1.2.5. Where to go next</h3></div></div></div><p>The above described standalone setup is good for testing and
+stopping hbase...............</pre></div><div class="section" title="1.2.5. Where to go next"><div class="titlepage"><div><div><h3 class="title"><a name="d1157e193"></a>1.2.5. Where to go next</h3></div></div></div><p>The above described standalone setup is good for testing and
experiments only. In the next chapter, <a class="xref" href="">???</a>,
we'll go into depth on the different HBase run modes, system requirements
running HBase, and critical configurations setting up a distributed HBase deploy.</p></div></div><div id="disqus_thread"></div><script type="text/javascript">
Modified: hbase/hbase.apache.org/trunk/index.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/index.html?rev=1462679&r1=1462678&r2=1462679&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/index.html (original)
+++ hbase/hbase.apache.org/trunk/index.html Sat Mar 30 00:19:55 2013
@@ -1,6 +1,6 @@
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
-<!-- Generated by Apache Maven Doxia at Mar 21, 2013 -->
+<!-- Generated by Apache Maven Doxia at Mar 29, 2013 -->
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />
@@ -13,7 +13,7 @@
</style>
<link rel="stylesheet" href="./css/print.css" type="text/css" media="print" />
<link rel="shortcut icon" href="/images/favicon.ico" />
- <meta name="Date-Revision-yyyymmdd" content="20130321" />
+ <meta name="Date-Revision-yyyymmdd" content="20130329" />
<meta http-equiv="Content-Language" content="en" />
<!--Google Analytics-->
<script type="text/javascript">
@@ -252,7 +252,7 @@ Apache HBase is an open-source, distribu
<div id="footer">
<div class="xright">
- <span id="publishDate">Last Published: 2013-03-21</span>
+ <span id="publishDate">Last Published: 2013-03-29</span>
| <span id="projectVersion">Version: 0.97-SNAPSHOT</span>
</div>
Modified: hbase/hbase.apache.org/trunk/integration.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/integration.html?rev=1462679&r1=1462678&r2=1462679&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/integration.html (original)
+++ hbase/hbase.apache.org/trunk/integration.html Sat Mar 30 00:19:55 2013
@@ -1,6 +1,6 @@
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
-<!-- Generated by Apache Maven Doxia at Mar 21, 2013 -->
+<!-- Generated by Apache Maven Doxia at Mar 29, 2013 -->
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />
@@ -12,7 +12,7 @@
</style>
<link rel="stylesheet" href="./css/print.css" type="text/css" media="print" />
<link rel="shortcut icon" href="/images/favicon.ico" />
- <meta name="Date-Revision-yyyymmdd" content="20130321" />
+ <meta name="Date-Revision-yyyymmdd" content="20130329" />
<meta http-equiv="Content-Language" content="en" />
<!--Google Analytics-->
<script type="text/javascript">
@@ -182,7 +182,7 @@
<div id="footer">
<div class="xright">
- <span id="publishDate">Last Published: 2013-03-21</span>
+ <span id="publishDate">Last Published: 2013-03-29</span>
| <span id="projectVersion">Version: 0.97-SNAPSHOT</span>
</div>
Modified: hbase/hbase.apache.org/trunk/issue-tracking.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/issue-tracking.html?rev=1462679&r1=1462678&r2=1462679&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/issue-tracking.html (original)
+++ hbase/hbase.apache.org/trunk/issue-tracking.html Sat Mar 30 00:19:55 2013
@@ -1,6 +1,6 @@
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
-<!-- Generated by Apache Maven Doxia at Mar 21, 2013 -->
+<!-- Generated by Apache Maven Doxia at Mar 29, 2013 -->
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />
@@ -12,7 +12,7 @@
</style>
<link rel="stylesheet" href="./css/print.css" type="text/css" media="print" />
<link rel="shortcut icon" href="/images/favicon.ico" />
- <meta name="Date-Revision-yyyymmdd" content="20130321" />
+ <meta name="Date-Revision-yyyymmdd" content="20130329" />
<meta http-equiv="Content-Language" content="en" />
<!--Google Analytics-->
<script type="text/javascript">
@@ -182,7 +182,7 @@
<div id="footer">
<div class="xright">
- <span id="publishDate">Last Published: 2013-03-21</span>
+ <span id="publishDate">Last Published: 2013-03-29</span>
| <span id="projectVersion">Version: 0.97-SNAPSHOT</span>
</div>
Modified: hbase/hbase.apache.org/trunk/license.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/license.html?rev=1462679&r1=1462678&r2=1462679&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/license.html (original)
+++ hbase/hbase.apache.org/trunk/license.html Sat Mar 30 00:19:55 2013
@@ -1,6 +1,6 @@
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
-<!-- Generated by Apache Maven Doxia at Mar 21, 2013 -->
+<!-- Generated by Apache Maven Doxia at Mar 29, 2013 -->
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />
@@ -12,7 +12,7 @@
</style>
<link rel="stylesheet" href="./css/print.css" type="text/css" media="print" />
<link rel="shortcut icon" href="/images/favicon.ico" />
- <meta name="Date-Revision-yyyymmdd" content="20130321" />
+ <meta name="Date-Revision-yyyymmdd" content="20130329" />
<meta http-equiv="Content-Language" content="en" />
<!--Google Analytics-->
<script type="text/javascript">
@@ -384,7 +384,7 @@
<div id="footer">
<div class="xright">
- <span id="publishDate">Last Published: 2013-03-21</span>
+ <span id="publishDate">Last Published: 2013-03-29</span>
| <span id="projectVersion">Version: 0.97-SNAPSHOT</span>
</div>
Modified: hbase/hbase.apache.org/trunk/mail-lists.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/mail-lists.html?rev=1462679&r1=1462678&r2=1462679&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/mail-lists.html (original)
+++ hbase/hbase.apache.org/trunk/mail-lists.html Sat Mar 30 00:19:55 2013
@@ -1,6 +1,6 @@
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
-<!-- Generated by Apache Maven Doxia at Mar 21, 2013 -->
+<!-- Generated by Apache Maven Doxia at Mar 29, 2013 -->
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />
@@ -12,7 +12,7 @@
</style>
<link rel="stylesheet" href="./css/print.css" type="text/css" media="print" />
<link rel="shortcut icon" href="/images/favicon.ico" />
- <meta name="Date-Revision-yyyymmdd" content="20130321" />
+ <meta name="Date-Revision-yyyymmdd" content="20130329" />
<meta http-equiv="Content-Language" content="en" />
<!--Google Analytics-->
<script type="text/javascript">
@@ -182,7 +182,7 @@
<div id="footer">
<div class="xright">
- <span id="publishDate">Last Published: 2013-03-21</span>
+ <span id="publishDate">Last Published: 2013-03-29</span>
| <span id="projectVersion">Version: 0.97-SNAPSHOT</span>
</div>
Modified: hbase/hbase.apache.org/trunk/metrics.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/metrics.html?rev=1462679&r1=1462678&r2=1462679&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/metrics.html (original)
+++ hbase/hbase.apache.org/trunk/metrics.html Sat Mar 30 00:19:55 2013
@@ -1,6 +1,6 @@
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
-<!-- Generated by Apache Maven Doxia at Mar 21, 2013 -->
+<!-- Generated by Apache Maven Doxia at Mar 29, 2013 -->
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />
@@ -15,7 +15,7 @@
</style>
<link rel="stylesheet" href="./css/print.css" type="text/css" media="print" />
<link rel="shortcut icon" href="/images/favicon.ico" />
- <meta name="Date-Revision-yyyymmdd" content="20130321" />
+ <meta name="Date-Revision-yyyymmdd" content="20130329" />
<meta http-equiv="Content-Language" content="en" />
<!--Google Analytics-->
<script type="text/javascript">
@@ -317,7 +317,7 @@ export HBASE_REGIONSERVER_OPTS="$HB
<div id="footer">
<div class="xright">
- <span id="publishDate">Last Published: 2013-03-21</span>
+ <span id="publishDate">Last Published: 2013-03-29</span>
| <span id="projectVersion">Version: 0.97-SNAPSHOT</span>
</div>
Modified: hbase/hbase.apache.org/trunk/old_news.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/old_news.html?rev=1462679&r1=1462678&r2=1462679&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/old_news.html (original)
+++ hbase/hbase.apache.org/trunk/old_news.html Sat Mar 30 00:19:55 2013
@@ -1,6 +1,6 @@
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
-<!-- Generated by Apache Maven Doxia at Mar 21, 2013 -->
+<!-- Generated by Apache Maven Doxia at Mar 29, 2013 -->
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />
@@ -15,7 +15,7 @@
</style>
<link rel="stylesheet" href="./css/print.css" type="text/css" media="print" />
<link rel="shortcut icon" href="/images/favicon.ico" />
- <meta name="Date-Revision-yyyymmdd" content="20130321" />
+ <meta name="Date-Revision-yyyymmdd" content="20130329" />
<meta http-equiv="Content-Language" content="en" />
<!--Google Analytics-->
<script type="text/javascript">
@@ -237,7 +237,7 @@
<div id="footer">
<div class="xright">
- <span id="publishDate">Last Published: 2013-03-21</span>
+ <span id="publishDate">Last Published: 2013-03-29</span>
| <span id="projectVersion">Version: 0.97-SNAPSHOT</span>
</div>
Modified: hbase/hbase.apache.org/trunk/ops_mgt.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/ops_mgt.html?rev=1462679&r1=1462678&r2=1462679&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/ops_mgt.html (original)
+++ hbase/hbase.apache.org/trunk/ops_mgt.html Sat Mar 30 00:19:55 2013
@@ -163,7 +163,7 @@ row10 c1 c2
job configuration. </p></div></div><div class="section" title="1.2. Region Management"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="ops.regionmgt"></a>1.2. Region Management</h2></div></div></div><div class="section" title="1.2.1. Major Compaction"><div class="titlepage"><div><div><h3 class="title"><a name="ops.regionmgt.majorcompact"></a>1.2.1. Major Compaction</h3></div></div></div><p>Major compactions can be requested via the HBase shell or <a class="link" href="http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/client/HBaseAdmin.html#majorCompact%28java.lang.String%29" target="_top">HBaseAdmin.majorCompact</a>.
</p><p>Note: major compactions do NOT do region merges. See <a class="xref" href="#">???</a> for more information about compactions.
- </p></div><div class="section" title="1.2.2. Merge"><div class="titlepage"><div><div><h3 class="title"><a name="ops.regionmgt.merge"></a>1.2.2. Merge</h3></div></div></div><p>Merge is a utility that can merge adjoining regions in the same table (see org.apache.hadoop.hbase.util.Merge).</p><pre class="programlisting">$ bin/hbase org.apache.hbase.util.Merge <tablename> <region1> <region2>
+ </p></div><div class="section" title="1.2.2. Merge"><div class="titlepage"><div><div><h3 class="title"><a name="ops.regionmgt.merge"></a>1.2.2. Merge</h3></div></div></div><p>Merge is a utility that can merge adjoining regions in the same table (see org.apache.hadoop.hbase.util.Merge).</p><pre class="programlisting">$ bin/hbase org.apache.hadoop.hbase.util.Merge <tablename> <region1> <region2>
</pre><p>If you feel you have too many regions and want to consolidate them, Merge is the utility you need. Merge must
run be done when the cluster is down.
See the <a class="link" href="http://ofps.oreilly.com/titles/9781449396107/performance.html" target="_top">O'Reilly HBase Book</a> for
@@ -295,13 +295,13 @@ false
</p><p>
For more information on HBase metrics, see <a class="xref" href="#hbase_metrics" title="1.4. HBase Metrics">Section 1.4, “HBase Metrics”</a>.
</p></div><div class="section" title="1.5.2. Slow Query Log"><div class="titlepage"><div><div><h3 class="title"><a name="ops.slow.query"></a>1.5.2. Slow Query Log</h3></div></div></div><p>The HBase slow query log consists of parseable JSON structures describing the properties of those client operations (Gets, Puts, Deletes, etc.) that either took too long to run, or produced too much output. The thresholds for "too long to run" and "too much output" are configurable, as described below. The output is produced inline in the main region server logs so that it is easy to discover further details from context with other logged events. It is also prepended with identifying tags <code class="constant">(responseTooSlow)</code>, <code class="constant">(responseTooLarge)</code>, <code class="constant">(operationTooSlow)</code>, and <code class="constant">(operationTooLarge)</code> in order to enable easy filtering with grep, in case the user desires to see only slow q
ueries.
-</p><div class="section" title="1.5.2.1. Configuration"><div class="titlepage"><div><div><h4 class="title"><a name="d884e744"></a>1.5.2.1. Configuration</h4></div></div></div><p>There are two configuration knobs that can be used to adjust the thresholds for when queries are logged.
+</p><div class="section" title="1.5.2.1. Configuration"><div class="titlepage"><div><div><h4 class="title"><a name="d889e744"></a>1.5.2.1. Configuration</h4></div></div></div><p>There are two configuration knobs that can be used to adjust the thresholds for when queries are logged.
</p><div class="itemizedlist"><ul class="itemizedlist" type="disc"><li class="listitem"><code class="varname">hbase.ipc.warn.response.time</code> Maximum number of milliseconds that a query can be run without being logged. Defaults to 10000, or 10 seconds. Can be set to -1 to disable logging by time.
</li><li class="listitem"><code class="varname">hbase.ipc.warn.response.size</code> Maximum byte size of response that a query can return without being logged. Defaults to 100 megabytes. Can be set to -1 to disable logging by size.
-</li></ul></div></div><div class="section" title="1.5.2.2. Metrics"><div class="titlepage"><div><div><h4 class="title"><a name="d884e758"></a>1.5.2.2. Metrics</h4></div></div></div><p>The slow query log exposes to metrics to JMX.
+</li></ul></div></div><div class="section" title="1.5.2.2. Metrics"><div class="titlepage"><div><div><h4 class="title"><a name="d889e758"></a>1.5.2.2. Metrics</h4></div></div></div><p>The slow query log exposes to metrics to JMX.
</p><div class="itemizedlist"><ul class="itemizedlist" type="disc"><li class="listitem"><code class="varname">hadoop.regionserver_rpc_slowResponse</code> a global metric reflecting the durations of all responses that triggered logging.</li><li class="listitem"><code class="varname">hadoop.regionserver_rpc_methodName.aboveOneSec</code> A metric reflecting the durations of all responses that lasted for more than one second.</li></ul></div><p>
-</p></div><div class="section" title="1.5.2.3. Output"><div class="titlepage"><div><div><h4 class="title"><a name="d884e773"></a>1.5.2.3. Output</h4></div></div></div><p>The output is tagged with operation e.g. <code class="constant">(operationTooSlow)</code> if the call was a client operation, such as a Put, Get, or Delete, which we expose detailed fingerprint information for. If not, it is tagged <code class="constant">(responseTooSlow)</code> and still produces parseable JSON output, but with less verbose information solely regarding its duration and size in the RPC itself. <code class="constant">TooLarge</code> is substituted for <code class="constant">TooSlow</code> if the response size triggered the logging, with <code class="constant">TooLarge</code> appearing even in the case that both size and duration triggered logging.
-</p></div><div class="section" title="1.5.2.4. Example"><div class="titlepage"><div><div><h4 class="title"><a name="d884e793"></a>1.5.2.4. Example</h4></div></div></div><p>
+</p></div><div class="section" title="1.5.2.3. Output"><div class="titlepage"><div><div><h4 class="title"><a name="d889e773"></a>1.5.2.3. Output</h4></div></div></div><p>The output is tagged with operation e.g. <code class="constant">(operationTooSlow)</code> if the call was a client operation, such as a Put, Get, or Delete, which we expose detailed fingerprint information for. If not, it is tagged <code class="constant">(responseTooSlow)</code> and still produces parseable JSON output, but with less verbose information solely regarding its duration and size in the RPC itself. <code class="constant">TooLarge</code> is substituted for <code class="constant">TooSlow</code> if the response size triggered the logging, with <code class="constant">TooLarge</code> appearing even in the case that both size and duration triggered logging.
+</p></div><div class="section" title="1.5.2.4. Example"><div class="titlepage"><div><div><h4 class="title"><a name="d889e793"></a>1.5.2.4. Example</h4></div></div></div><p>
</p><pre class="programlisting">2011-09-08 10:01:25,824 WARN org.apache.hadoop.ipc.HBaseServer: (operationTooSlow): {"tables":{"riley2":{"puts":[{"totalColumns":11,"families":{"actions":[{"timestamp":1315501284459,"qualifier":"0","vlen":9667580},{"timestamp":1315501284459,"qualifier":"1","vlen":10122412},{"timestamp":1315501284459,"qualifier":"2","vlen":11104617},{"timestamp":1315501284459,"qualifier":"3","vlen":13430635}]},"row":"cfcd208495d565ef66e7dff9f98764da:0"}],"families":["actions"]}},"processingtimems":956,"client":"10.47.34.63:33623","starttimems":1315501284456,"queuetimems":0,"totalPuts":1,"class":"HRegionServer","responsesize":0,"method":"multiPut"}</pre><p>
</p><p>Note that everything inside the "tables" structure is output produced by MultiPut's fingerprint, while the rest of the information is RPC-specific, such as processing time and client IP/port. Other client operations follow the same pattern and the same general structure, with necessary differences due to the nature of the individual operations. In the case that the call is not a client operation, that detailed fingerprint information will be completely absent.
</p><p>This particular example, for example, would indicate that the likely cause of slowness is simply a very large (on the order of 100MB) multiput, as we can tell by the "vlen," or value length, fields of each put in the multiPut.
Modified: hbase/hbase.apache.org/trunk/ops_mgt/ops.monitoring.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/ops_mgt/ops.monitoring.html?rev=1462679&r1=1462678&r2=1462679&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/ops_mgt/ops.monitoring.html (original)
+++ hbase/hbase.apache.org/trunk/ops_mgt/ops.monitoring.html Sat Mar 30 00:19:55 2013
@@ -14,13 +14,13 @@
</p><p>
For more information on HBase metrics, see <a class="xref" href="hbase_metrics.html" title="1.4. HBase Metrics">Section 1.4, “HBase Metrics”</a>.
</p></div><div class="section" title="1.5.2. Slow Query Log"><div class="titlepage"><div><div><h3 class="title"><a name="ops.slow.query"></a>1.5.2. Slow Query Log</h3></div></div></div><p>The HBase slow query log consists of parseable JSON structures describing the properties of those client operations (Gets, Puts, Deletes, etc.) that either took too long to run, or produced too much output. The thresholds for "too long to run" and "too much output" are configurable, as described below. The output is produced inline in the main region server logs so that it is easy to discover further details from context with other logged events. It is also prepended with identifying tags <code class="constant">(responseTooSlow)</code>, <code class="constant">(responseTooLarge)</code>, <code class="constant">(operationTooSlow)</code>, and <code class="constant">(operationTooLarge)</code> in order to enable easy filtering with grep, in case the user desires to see only slow q
ueries.
-</p><div class="section" title="1.5.2.1. Configuration"><div class="titlepage"><div><div><h4 class="title"><a name="d884e744"></a>1.5.2.1. Configuration</h4></div></div></div><p>There are two configuration knobs that can be used to adjust the thresholds for when queries are logged.
+</p><div class="section" title="1.5.2.1. Configuration"><div class="titlepage"><div><div><h4 class="title"><a name="d889e744"></a>1.5.2.1. Configuration</h4></div></div></div><p>There are two configuration knobs that can be used to adjust the thresholds for when queries are logged.
</p><div class="itemizedlist"><ul class="itemizedlist" type="disc"><li class="listitem"><code class="varname">hbase.ipc.warn.response.time</code> Maximum number of milliseconds that a query can be run without being logged. Defaults to 10000, or 10 seconds. Can be set to -1 to disable logging by time.
</li><li class="listitem"><code class="varname">hbase.ipc.warn.response.size</code> Maximum byte size of response that a query can return without being logged. Defaults to 100 megabytes. Can be set to -1 to disable logging by size.
-</li></ul></div></div><div class="section" title="1.5.2.2. Metrics"><div class="titlepage"><div><div><h4 class="title"><a name="d884e758"></a>1.5.2.2. Metrics</h4></div></div></div><p>The slow query log exposes to metrics to JMX.
+</li></ul></div></div><div class="section" title="1.5.2.2. Metrics"><div class="titlepage"><div><div><h4 class="title"><a name="d889e758"></a>1.5.2.2. Metrics</h4></div></div></div><p>The slow query log exposes to metrics to JMX.
</p><div class="itemizedlist"><ul class="itemizedlist" type="disc"><li class="listitem"><code class="varname">hadoop.regionserver_rpc_slowResponse</code> a global metric reflecting the durations of all responses that triggered logging.</li><li class="listitem"><code class="varname">hadoop.regionserver_rpc_methodName.aboveOneSec</code> A metric reflecting the durations of all responses that lasted for more than one second.</li></ul></div><p>
-</p></div><div class="section" title="1.5.2.3. Output"><div class="titlepage"><div><div><h4 class="title"><a name="d884e773"></a>1.5.2.3. Output</h4></div></div></div><p>The output is tagged with operation e.g. <code class="constant">(operationTooSlow)</code> if the call was a client operation, such as a Put, Get, or Delete, which we expose detailed fingerprint information for. If not, it is tagged <code class="constant">(responseTooSlow)</code> and still produces parseable JSON output, but with less verbose information solely regarding its duration and size in the RPC itself. <code class="constant">TooLarge</code> is substituted for <code class="constant">TooSlow</code> if the response size triggered the logging, with <code class="constant">TooLarge</code> appearing even in the case that both size and duration triggered logging.
-</p></div><div class="section" title="1.5.2.4. Example"><div class="titlepage"><div><div><h4 class="title"><a name="d884e793"></a>1.5.2.4. Example</h4></div></div></div><p>
+</p></div><div class="section" title="1.5.2.3. Output"><div class="titlepage"><div><div><h4 class="title"><a name="d889e773"></a>1.5.2.3. Output</h4></div></div></div><p>The output is tagged with operation e.g. <code class="constant">(operationTooSlow)</code> if the call was a client operation, such as a Put, Get, or Delete, which we expose detailed fingerprint information for. If not, it is tagged <code class="constant">(responseTooSlow)</code> and still produces parseable JSON output, but with less verbose information solely regarding its duration and size in the RPC itself. <code class="constant">TooLarge</code> is substituted for <code class="constant">TooSlow</code> if the response size triggered the logging, with <code class="constant">TooLarge</code> appearing even in the case that both size and duration triggered logging.
+</p></div><div class="section" title="1.5.2.4. Example"><div class="titlepage"><div><div><h4 class="title"><a name="d889e793"></a>1.5.2.4. Example</h4></div></div></div><p>
</p><pre class="programlisting">2011-09-08 10:01:25,824 WARN org.apache.hadoop.ipc.HBaseServer: (operationTooSlow): {"tables":{"riley2":{"puts":[{"totalColumns":11,"families":{"actions":[{"timestamp":1315501284459,"qualifier":"0","vlen":9667580},{"timestamp":1315501284459,"qualifier":"1","vlen":10122412},{"timestamp":1315501284459,"qualifier":"2","vlen":11104617},{"timestamp":1315501284459,"qualifier":"3","vlen":13430635}]},"row":"cfcd208495d565ef66e7dff9f98764da:0"}],"families":["actions"]}},"processingtimems":956,"client":"10.47.34.63:33623","starttimems":1315501284456,"queuetimems":0,"totalPuts":1,"class":"HRegionServer","responsesize":0,"method":"multiPut"}</pre><p>
</p><p>Note that everything inside the "tables" structure is output produced by MultiPut's fingerprint, while the rest of the information is RPC-specific, such as processing time and client IP/port. Other client operations follow the same pattern and the same general structure, with necessary differences due to the nature of the individual operations. In the case that the call is not a client operation, that detailed fingerprint information will be completely absent.
</p><p>This particular example, for example, would indicate that the likely cause of slowness is simply a very large (on the order of 100MB) multiput, as we can tell by the "vlen," or value length, fields of each put in the multiPut.
Modified: hbase/hbase.apache.org/trunk/ops_mgt/ops.regionmgt.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/ops_mgt/ops.regionmgt.html?rev=1462679&r1=1462678&r2=1462679&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/ops_mgt/ops.regionmgt.html (original)
+++ hbase/hbase.apache.org/trunk/ops_mgt/ops.regionmgt.html Sat Mar 30 00:19:55 2013
@@ -3,7 +3,7 @@
<title>1.2. Region Management</title><link rel="stylesheet" type="text/css" href="../css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"><link rel="home" href="ops_mgt.html" title="Chapter 1. Apache HBase (TM) Operational Management"><link rel="up" href="ops_mgt.html" title="Chapter 1. Apache HBase (TM) Operational Management"><link rel="prev" href="ops_mgt.html" title="Chapter 1. Apache HBase (TM) Operational Management"><link rel="next" href="node.management.html" title="1.3. Node Management"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="navheader"><table width="100%" summary="Navigation header"><tr><th colspan="3" align="center">1.2. Region Management</th></tr><tr><td width="20%" align="left"><a accesskey="p" href="ops_mgt.html">Prev</a> </td><th width="60%" align="center"> </th><td width="20%" align="right"> <a acc
esskey="n" href="node.management.html">Next</a></td></tr></table><hr></div><div class="section" title="1.2. Region Management"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="ops.regionmgt"></a>1.2. Region Management</h2></div></div></div><div class="section" title="1.2.1. Major Compaction"><div class="titlepage"><div><div><h3 class="title"><a name="ops.regionmgt.majorcompact"></a>1.2.1. Major Compaction</h3></div></div></div><p>Major compactions can be requested via the HBase shell or <a class="link" href="http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/client/HBaseAdmin.html#majorCompact%28java.lang.String%29" target="_top">HBaseAdmin.majorCompact</a>.
</p><p>Note: major compactions do NOT do region merges. See <a class="xref" href="">???</a> for more information about compactions.
- </p></div><div class="section" title="1.2.2. Merge"><div class="titlepage"><div><div><h3 class="title"><a name="ops.regionmgt.merge"></a>1.2.2. Merge</h3></div></div></div><p>Merge is a utility that can merge adjoining regions in the same table (see org.apache.hadoop.hbase.util.Merge).</p><pre class="programlisting">$ bin/hbase org.apache.hbase.util.Merge <tablename> <region1> <region2>
+ </p></div><div class="section" title="1.2.2. Merge"><div class="titlepage"><div><div><h3 class="title"><a name="ops.regionmgt.merge"></a>1.2.2. Merge</h3></div></div></div><p>Merge is a utility that can merge adjoining regions in the same table (see org.apache.hadoop.hbase.util.Merge).</p><pre class="programlisting">$ bin/hbase org.apache.hadoop.hbase.util.Merge <tablename> <region1> <region2>
</pre><p>If you feel you have too many regions and want to consolidate them, Merge is the utility you need. Merge must
run be done when the cluster is down.
See the <a class="link" href="http://ofps.oreilly.com/titles/9781449396107/performance.html" target="_top">O'Reilly HBase Book</a> for