You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hbase.apache.org by st...@apache.org on 2013/04/02 20:06:21 UTC
svn commit: r1463652 [8/21] - in /hbase/hbase.apache.org/trunk: ./ book/
case_studies/ community/ configuration/ css/ developer/ external_apis/
getting_started/ hbase-assembly/ hbase-assembly/book/ hbase-assembly/xref/
images/ ops_mgt/ performance/ pre...
Modified: hbase/hbase.apache.org/trunk/book/schema.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/book/schema.html?rev=1463652&r1=1463651&r2=1463652&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/book/schema.html (original)
+++ hbase/hbase.apache.org/trunk/book/schema.html Tue Apr 2 18:06:19 2013
@@ -26,10 +26,11 @@
Summary Tables
</a></span></dt><dt><span class="section"><a href="secondary.indexes.html#secondary.indexes.coproc">6.9.5.
Coprocessor Secondary Index
- </a></span></dt></dl></dd><dt><span class="section"><a href="schema.smackdown.html">6.10. Schema Design Smackdown</a></span></dt><dd><dl><dt><span class="section"><a href="schema.smackdown.html#schema.smackdown.rowsversions">6.10.1. Rows vs. Versions</a></span></dt><dt><span class="section"><a href="schema.smackdown.html#schema.smackdown.rowscols">6.10.2. Rows vs. Columns</a></span></dt><dt><span class="section"><a href="schema.smackdown.html#schema.smackdown.rowsascols">6.10.3. Rows as Columns</a></span></dt></dl></dd><dt><span class="section"><a href="schema.ops.html">6.11. Operational and Performance Configuration Options</a></span></dt><dt><span class="section"><a href="constraints.html">6.12. Constraints</a></span></dt></dl></div><p>A good general introduction on the strength and weaknesses modelling on
+ </a></span></dt></dl></dd><dt><span class="section"><a href="constraints.html">6.10. Constraints</a></span></dt><dt><span class="section"><a href="schema.casestudies.html">6.11. Schema Design Case Studies</a></span></dt><dd><dl><dt><span class="section"><a href="schema.casestudies.html#schema.casestudies.log-timeseries">6.11.1. Log Data and Timeseries Data Case Study</a></span></dt><dt><span class="section"><a href="schema.casestudies.html#schema.casestudies.log-timeseries.log-steroids">6.11.2. Log Data and Timeseries Data on Steroids Case Study</a></span></dt><dt><span class="section"><a href="schema.casestudies.html#schema.casestudies.log-timeseries.custsales">6.11.3. Customer / Sales Case Study</a></span></dt><dt><span class="section"><a href="schema.casestudies.html#schema.smackdown">6.11.4. "Tall/Wide/Middle" Schema Design Smackdown</a></span></dt></dl></dd><dt><span class="section"><a href="schema.ops.html">6.12. Operational and Performance Configuration Options<
/a></span></dt></dl></div><p>A good general introduction on the strength and weaknesses modelling on
the various non-rdbms datastores is Ian Varley's Master thesis,
<a class="link" href="http://ianvarley.com/UT/MR/Varley_MastersReport_Full_2009-08-07.pdf" target="_top">No Relation: The Mixed Blessings of Non-Relational Databases</a>.
- Recommended. Also, read <a class="xref" href="regions.arch.html#keyvalue" title="9.7.5.4. KeyValue">Section 9.7.5.4, “KeyValue”</a> for how HBase stores data internally.
+ Recommended. Also, read <a class="xref" href="regions.arch.html#keyvalue" title="9.7.6.4. KeyValue">Section 9.7.6.4, “KeyValue”</a> for how HBase stores data internally, and the section on
+ <a class="xref" href="schema.casestudies.html" title="6.11. Schema Design Case Studies">Section 6.11, “Schema Design Case Studies”</a>.
</p><div class="section" title="6.1. Schema Creation"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="schema.creation"></a>6.1.
Schema Creation
</h2></div></div></div><p>HBase schemas can be created or updated with <a class="xref" href="shell.html" title="Chapter 4. The Apache HBase Shell">Chapter 4, <i>The Apache HBase Shell</i></a>
@@ -54,7 +55,7 @@ admin.enableTable(table);
to be disabled.
</p><div class="section" title="6.1.1. Schema Updates"><div class="titlepage"><div><div><h3 class="title"><a name="schema.updates"></a>6.1.1. Schema Updates</h3></div></div></div><p>When changes are made to either Tables or ColumnFamilies (e.g., region size, block size), these changes
take effect the next time there is a major compaction and the StoreFiles get re-written.
- </p><p>See <a class="xref" href="regions.arch.html#store" title="9.7.5. Store">Section 9.7.5, “Store”</a> for more information on StoreFiles.
+ </p><p>See <a class="xref" href="regions.arch.html#store" title="9.7.6. Store">Section 9.7.6, “Store”</a> for more information on StoreFiles.
</p></div></div></div><div id="disqus_thread"></div><script type="text/javascript">
var disqus_shortname = 'hbase'; // required: replace example with your forum shortname
var disqus_url = 'http://hbase.apache.org/book';
Modified: hbase/hbase.apache.org/trunk/book/schema.ops.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/book/schema.ops.html?rev=1463652&r1=1463651&r2=1463652&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/book/schema.ops.html (original)
+++ hbase/hbase.apache.org/trunk/book/schema.ops.html Tue Apr 2 18:06:19 2013
@@ -1,6 +1,6 @@
<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
- <title>6.11. Operational and Performance Configuration Options</title><link rel="stylesheet" type="text/css" href="../css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"><link rel="home" href="book.html" title="The Apache HBase™ Reference Guide"><link rel="up" href="schema.html" title="Chapter 6. HBase and Schema Design"><link rel="prev" href="schema.smackdown.html" title="6.10. Schema Design Smackdown"><link rel="next" href="constraints.html" title="6.12. Constraints"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="navheader"><table width="100%" summary="Navigation header"><tr><th colspan="3" align="center">6.11. Operational and Performance Configuration Options</th></tr><tr><td width="20%" align="left"><a accesskey="p" href="schema.smackdown.html">Prev</a> </td><th width="60%" align="center">Chapter 6. HBase and Schema Design</t
h><td width="20%" align="right"> <a accesskey="n" href="constraints.html">Next</a></td></tr></table><hr></div><div class="section" title="6.11. Operational and Performance Configuration Options"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="schema.ops"></a>6.11. Operational and Performance Configuration Options</h2></div></div></div><p>See the Performance section <a class="xref" href="perf.schema.html" title="11.6. Schema Design">Section 11.6, “Schema Design”</a> for more information operational and performance
+ <title>6.12. Operational and Performance Configuration Options</title><link rel="stylesheet" type="text/css" href="../css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"><link rel="home" href="book.html" title="The Apache HBase™ Reference Guide"><link rel="up" href="schema.html" title="Chapter 6. HBase and Schema Design"><link rel="prev" href="schema.casestudies.html" title="6.11. Schema Design Case Studies"><link rel="next" href="mapreduce.html" title="Chapter 7. HBase and MapReduce"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="navheader"><table width="100%" summary="Navigation header"><tr><th colspan="3" align="center">6.12. Operational and Performance Configuration Options</th></tr><tr><td width="20%" align="left"><a accesskey="p" href="schema.casestudies.html">Prev</a> </td><th width="60%" align="center">Chapter 6. HBa
se and Schema Design</th><td width="20%" align="right"> <a accesskey="n" href="mapreduce.html">Next</a></td></tr></table><hr></div><div class="section" title="6.12. Operational and Performance Configuration Options"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="schema.ops"></a>6.12. Operational and Performance Configuration Options</h2></div></div></div><p>See the Performance section <a class="xref" href="perf.schema.html" title="11.6. Schema Design">Section 11.6, “Schema Design”</a> for more information operational and performance
schema design options, such as Bloom Filters, Table-configured regionsizes, compression, and blocksizes.
</p></div><div id="disqus_thread"></div><script type="text/javascript">
var disqus_shortname = 'hbase'; // required: replace example with your forum shortname
@@ -13,4 +13,4 @@
dsq.src = 'http://' + disqus_shortname + '.disqus.com/embed.js';
(document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
})();
-</script><noscript>Please enable JavaScript to view the <a href="http://disqus.com/?ref_noscript">comments powered by Disqus.</a></noscript><a href="http://disqus.com" class="dsq-brlink">comments powered by <span class="logo-disqus">Disqus</span></a><div class="navfooter"><hr><table width="100%" summary="Navigation footer"><tr><td width="40%" align="left"><a accesskey="p" href="schema.smackdown.html">Prev</a> </td><td width="20%" align="center"><a accesskey="u" href="schema.html">Up</a></td><td width="40%" align="right"> <a accesskey="n" href="constraints.html">Next</a></td></tr><tr><td width="40%" align="left" valign="top">6.10. Schema Design Smackdown </td><td width="20%" align="center"><a accesskey="h" href="book.html">Home</a></td><td width="40%" align="right" valign="top"> 6.12. Constraints</td></tr></table></div></body></html>
\ No newline at end of file
+</script><noscript>Please enable JavaScript to view the <a href="http://disqus.com/?ref_noscript">comments powered by Disqus.</a></noscript><a href="http://disqus.com" class="dsq-brlink">comments powered by <span class="logo-disqus">Disqus</span></a><div class="navfooter"><hr><table width="100%" summary="Navigation footer"><tr><td width="40%" align="left"><a accesskey="p" href="schema.casestudies.html">Prev</a> </td><td width="20%" align="center"><a accesskey="u" href="schema.html">Up</a></td><td width="40%" align="right"> <a accesskey="n" href="mapreduce.html">Next</a></td></tr><tr><td width="40%" align="left" valign="top">6.11. Schema Design Case Studies </td><td width="20%" align="center"><a accesskey="h" href="book.html">Home</a></td><td width="40%" align="right" valign="top"> Chapter 7. HBase and MapReduce</td></tr></table></div></body></html>
\ No newline at end of file
Modified: hbase/hbase.apache.org/trunk/book/secondary.indexes.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/book/secondary.indexes.html?rev=1463652&r1=1463651&r2=1463652&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/book/secondary.indexes.html (original)
+++ hbase/hbase.apache.org/trunk/book/secondary.indexes.html Tue Apr 2 18:06:19 2013
@@ -1,8 +1,8 @@
<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
- <title>6.9. Secondary Indexes and Alternate Query Paths</title><link rel="stylesheet" type="text/css" href="../css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"><link rel="home" href="book.html" title="The Apache HBase™ Reference Guide"><link rel="up" href="schema.html" title="Chapter 6. HBase and Schema Design"><link rel="prev" href="cf.keep.deleted.html" title="6.8. Keeping Deleted Cells"><link rel="next" href="schema.smackdown.html" title="6.10. Schema Design Smackdown"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="navheader"><table width="100%" summary="Navigation header"><tr><th colspan="3" align="center">6.9.
+ <title>6.9. Secondary Indexes and Alternate Query Paths</title><link rel="stylesheet" type="text/css" href="../css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"><link rel="home" href="book.html" title="The Apache HBase™ Reference Guide"><link rel="up" href="schema.html" title="Chapter 6. HBase and Schema Design"><link rel="prev" href="cf.keep.deleted.html" title="6.8. Keeping Deleted Cells"><link rel="next" href="constraints.html" title="6.10. Constraints"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="navheader"><table width="100%" summary="Navigation header"><tr><th colspan="3" align="center">6.9.
Secondary Indexes and Alternate Query Paths
- </th></tr><tr><td width="20%" align="left"><a accesskey="p" href="cf.keep.deleted.html">Prev</a> </td><th width="60%" align="center">Chapter 6. HBase and Schema Design</th><td width="20%" align="right"> <a accesskey="n" href="schema.smackdown.html">Next</a></td></tr></table><hr></div><div class="section" title="6.9. Secondary Indexes and Alternate Query Paths"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="secondary.indexes"></a>6.9.
+ </th></tr><tr><td width="20%" align="left"><a accesskey="p" href="cf.keep.deleted.html">Prev</a> </td><th width="60%" align="center">Chapter 6. HBase and Schema Design</th><td width="20%" align="right"> <a accesskey="n" href="constraints.html">Next</a></td></tr></table><hr></div><div class="section" title="6.9. Secondary Indexes and Alternate Query Paths"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="secondary.indexes"></a>6.9.
Secondary Indexes and Alternate Query Paths
</h2></div></div></div><p>This section could also be titled "what if my table rowkey looks like <span class="emphasis"><em>this</em></span> but I also want to query my table like <span class="emphasis"><em>that</em></span>."
A common example on the dist-list is where a row-key is of the format "user-timestamp" but there are reporting requirements on activity across users for certain
@@ -44,6 +44,6 @@
dsq.src = 'http://' + disqus_shortname + '.disqus.com/embed.js';
(document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
})();
-</script><noscript>Please enable JavaScript to view the <a href="http://disqus.com/?ref_noscript">comments powered by Disqus.</a></noscript><a href="http://disqus.com" class="dsq-brlink">comments powered by <span class="logo-disqus">Disqus</span></a><div class="navfooter"><hr><table width="100%" summary="Navigation footer"><tr><td width="40%" align="left"><a accesskey="p" href="cf.keep.deleted.html">Prev</a> </td><td width="20%" align="center"><a accesskey="u" href="schema.html">Up</a></td><td width="40%" align="right"> <a accesskey="n" href="schema.smackdown.html">Next</a></td></tr><tr><td width="40%" align="left" valign="top">6.8.
+</script><noscript>Please enable JavaScript to view the <a href="http://disqus.com/?ref_noscript">comments powered by Disqus.</a></noscript><a href="http://disqus.com" class="dsq-brlink">comments powered by <span class="logo-disqus">Disqus</span></a><div class="navfooter"><hr><table width="100%" summary="Navigation footer"><tr><td width="40%" align="left"><a accesskey="p" href="cf.keep.deleted.html">Prev</a> </td><td width="20%" align="center"><a accesskey="u" href="schema.html">Up</a></td><td width="40%" align="right"> <a accesskey="n" href="constraints.html">Next</a></td></tr><tr><td width="40%" align="left" valign="top">6.8.
Keeping Deleted Cells
- </td><td width="20%" align="center"><a accesskey="h" href="book.html">Home</a></td><td width="40%" align="right" valign="top"> 6.10. Schema Design Smackdown</td></tr></table></div></body></html>
\ No newline at end of file
+ </td><td width="20%" align="center"><a accesskey="h" href="book.html">Home</a></td><td width="40%" align="right" valign="top"> 6.10. Constraints</td></tr></table></div></body></html>
\ No newline at end of file
Modified: hbase/hbase.apache.org/trunk/book/security.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/book/security.html?rev=1463652&r1=1463651&r2=1463652&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/book/security.html (original)
+++ hbase/hbase.apache.org/trunk/book/security.html Tue Apr 2 18:06:19 2013
@@ -1,6 +1,6 @@
<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
- <title>Chapter 8. Secure Apache HBase (TM)</title><link rel="stylesheet" type="text/css" href="../css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"><link rel="home" href="book.html" title="The Apache HBase™ Reference Guide"><link rel="up" href="book.html" title="The Apache HBase™ Reference Guide"><link rel="prev" href="mapreduce.specex.html" title="7.4. Speculative Execution"><link rel="next" href="hbase.accesscontrol.configuration.html" title="8.2. Access Control"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="navheader"><table width="100%" summary="Navigation header"><tr><th colspan="3" align="center">Chapter 8. Secure Apache HBase (TM)</th></tr><tr><td width="20%" align="left"><a accesskey="p" href="mapreduce.specex.html">Prev</a> </td><th width="60%" align="center"> </th><td width="20%" align="right"> <a accesskey="n"
href="hbase.accesscontrol.configuration.html">Next</a></td></tr></table><hr></div><div class="chapter" title="Chapter 8. Secure Apache HBase (TM)"><div class="titlepage"><div><div><h2 class="title"><a name="security"></a>Chapter 8. Secure Apache HBase (TM)</h2></div></div></div><div class="toc"><p><b>Table of Contents</b></p><dl><dt><span class="section"><a href="security.html#hbase.secure.configuration">8.1. Secure Client Access to Apache HBase</a></span></dt><dd><dl><dt><span class="section"><a href="security.html#d2279e4235">8.1.1. Prerequisites</a></span></dt><dt><span class="section"><a href="security.html#d2279e4276">8.1.2. Server-side Configuration for Secure Operation</a></span></dt><dt><span class="section"><a href="security.html#d2279e4288">8.1.3. Client-side Configuration for Secure Operation</a></span></dt><dt><span class="section"><a href="security.html#d2279e4327">8.1.4. Client-side Configuration for Secure Operation - Thrift Gateway</a></sp
an></dt><dt><span class="section"><a href="security.html#d2279e4342">8.1.5. Client-side Configuration for Secure Operation - REST Gateway</a></span></dt></dl></dd><dt><span class="section"><a href="hbase.accesscontrol.configuration.html">8.2. Access Control</a></span></dt><dd><dl><dt><span class="section"><a href="hbase.accesscontrol.configuration.html#d2279e4367">8.2.1. Prerequisites</a></span></dt><dt><span class="section"><a href="hbase.accesscontrol.configuration.html#d2279e4374">8.2.2. Overview</a></span></dt><dt><span class="section"><a href="hbase.accesscontrol.configuration.html#d2279e4531">8.2.3. Server-side Configuration for Access Control</a></span></dt><dt><span class="section"><a href="hbase.accesscontrol.configuration.html#d2279e4543">8.2.4. Shell Enhancements for Access Control</a></span></dt></dl></dd><dt><span class="section"><a href="hbase.secure.bulkload.html">8.3. Secure Bulk Load</a></span></dt></dl></div><div class="section" title="8.1. Secure Clie
nt Access to Apache HBase"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="hbase.secure.configuration"></a>8.1. Secure Client Access to Apache HBase</h2></div></div></div><p>Newer releases of Apache HBase (TM) (>= 0.92) support optional SASL authentication of clients<sup>[<a name="d2279e4226" href="#ftn.d2279e4226" class="footnote">20</a>]</sup>.</p><p>This describes how to set up Apache HBase and clients for connection to secure HBase resources.</p><div class="section" title="8.1.1. Prerequisites"><div class="titlepage"><div><div><h3 class="title"><a name="d2279e4235"></a>8.1.1. Prerequisites</h3></div></div></div><p>
+ <title>Chapter 8. Secure Apache HBase (TM)</title><link rel="stylesheet" type="text/css" href="../css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"><link rel="home" href="book.html" title="The Apache HBase™ Reference Guide"><link rel="up" href="book.html" title="The Apache HBase™ Reference Guide"><link rel="prev" href="mapreduce.specex.html" title="7.4. Speculative Execution"><link rel="next" href="hbase.accesscontrol.configuration.html" title="8.2. Access Control"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="navheader"><table width="100%" summary="Navigation header"><tr><th colspan="3" align="center">Chapter 8. Secure Apache HBase (TM)</th></tr><tr><td width="20%" align="left"><a accesskey="p" href="mapreduce.specex.html">Prev</a> </td><th width="60%" align="center"> </th><td width="20%" align="right"> <a accesskey="n"
href="hbase.accesscontrol.configuration.html">Next</a></td></tr></table><hr></div><div class="chapter" title="Chapter 8. Secure Apache HBase (TM)"><div class="titlepage"><div><div><h2 class="title"><a name="security"></a>Chapter 8. Secure Apache HBase (TM)</h2></div></div></div><div class="toc"><p><b>Table of Contents</b></p><dl><dt><span class="section"><a href="security.html#hbase.secure.configuration">8.1. Secure Client Access to Apache HBase</a></span></dt><dd><dl><dt><span class="section"><a href="security.html#d2475e4468">8.1.1. Prerequisites</a></span></dt><dt><span class="section"><a href="security.html#d2475e4509">8.1.2. Server-side Configuration for Secure Operation</a></span></dt><dt><span class="section"><a href="security.html#d2475e4521">8.1.3. Client-side Configuration for Secure Operation</a></span></dt><dt><span class="section"><a href="security.html#d2475e4560">8.1.4. Client-side Configuration for Secure Operation - Thrift Gateway</a></sp
an></dt><dt><span class="section"><a href="security.html#d2475e4575">8.1.5. Client-side Configuration for Secure Operation - REST Gateway</a></span></dt></dl></dd><dt><span class="section"><a href="hbase.accesscontrol.configuration.html">8.2. Access Control</a></span></dt><dd><dl><dt><span class="section"><a href="hbase.accesscontrol.configuration.html#d2475e4600">8.2.1. Prerequisites</a></span></dt><dt><span class="section"><a href="hbase.accesscontrol.configuration.html#d2475e4607">8.2.2. Overview</a></span></dt><dt><span class="section"><a href="hbase.accesscontrol.configuration.html#d2475e4764">8.2.3. Server-side Configuration for Access Control</a></span></dt><dt><span class="section"><a href="hbase.accesscontrol.configuration.html#d2475e4776">8.2.4. Shell Enhancements for Access Control</a></span></dt></dl></dd><dt><span class="section"><a href="hbase.secure.bulkload.html">8.3. Secure Bulk Load</a></span></dt></dl></div><div class="section" title="8.1. Secure Clie
nt Access to Apache HBase"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="hbase.secure.configuration"></a>8.1. Secure Client Access to Apache HBase</h2></div></div></div><p>Newer releases of Apache HBase (TM) (>= 0.92) support optional SASL authentication of clients<sup>[<a name="d2475e4459" href="#ftn.d2475e4459" class="footnote">20</a>]</sup>.</p><p>This describes how to set up Apache HBase and clients for connection to secure HBase resources.</p><div class="section" title="8.1.1. Prerequisites"><div class="titlepage"><div><div><h3 class="title"><a name="d2475e4468"></a>8.1.1. Prerequisites</h3></div></div></div><p>
You need to have a working Kerberos KDC.
</p><p>
A HBase configured for secure client access is expected to be running
@@ -57,7 +57,7 @@
keytabs for Hadoop. Those steps are omitted here. Copy the resulting
keytab files to where the client daemon will execute and make them
readable only to the user account under which the daemon will run.
- </p></div><div class="section" title="8.1.2. Server-side Configuration for Secure Operation"><div class="titlepage"><div><div><h3 class="title"><a name="d2279e4276"></a>8.1.2. Server-side Configuration for Secure Operation</h3></div></div></div><p>
+ </p></div><div class="section" title="8.1.2. Server-side Configuration for Secure Operation"><div class="titlepage"><div><div><h3 class="title"><a name="d2475e4509"></a>8.1.2. Server-side Configuration for Secure Operation</h3></div></div></div><p>
Add the following to the <code class="code">hbase-site.xml</code> file on every server machine in the cluster:
</p><pre class="programlisting">
<property>
@@ -75,7 +75,7 @@
</pre><p>
A full shutdown and restart of HBase service is required when deploying
these configuration changes.
- </p></div><div class="section" title="8.1.3. Client-side Configuration for Secure Operation"><div class="titlepage"><div><div><h3 class="title"><a name="d2279e4288"></a>8.1.3. Client-side Configuration for Secure Operation</h3></div></div></div><p>
+ </p></div><div class="section" title="8.1.3. Client-side Configuration for Secure Operation"><div class="titlepage"><div><div><h3 class="title"><a name="d2475e4521"></a>8.1.3. Client-side Configuration for Secure Operation</h3></div></div></div><p>
Add the following to the <code class="code">hbase-site.xml</code> file on every client:
</p><pre class="programlisting">
<property>
@@ -109,7 +109,7 @@
HTable table = new HTable(conf, tablename);
</pre><p>
Expect a ~10% performance penalty for encrypted communication.
- </p></div><div class="section" title="8.1.4. Client-side Configuration for Secure Operation - Thrift Gateway"><div class="titlepage"><div><div><h3 class="title"><a name="d2279e4327"></a>8.1.4. Client-side Configuration for Secure Operation - Thrift Gateway</h3></div></div></div><p>
+ </p></div><div class="section" title="8.1.4. Client-side Configuration for Secure Operation - Thrift Gateway"><div class="titlepage"><div><div><h3 class="title"><a name="d2475e4560"></a>8.1.4. Client-side Configuration for Secure Operation - Thrift Gateway</h3></div></div></div><p>
Add the following to the <code class="code">hbase-site.xml</code> file for every Thrift gateway:
</p><pre class="programlisting">
<property>
@@ -129,7 +129,7 @@
credential. No authentication will be performed by the Thrift gateway
itself. All client access via the Thrift gateway will use the Thrift
gateway's credential and have its privilege.
- </p></div><div class="section" title="8.1.5. Client-side Configuration for Secure Operation - REST Gateway"><div class="titlepage"><div><div><h3 class="title"><a name="d2279e4342"></a>8.1.5. Client-side Configuration for Secure Operation - REST Gateway</h3></div></div></div><p>
+ </p></div><div class="section" title="8.1.5. Client-side Configuration for Secure Operation - REST Gateway"><div class="titlepage"><div><div><h3 class="title"><a name="d2475e4575"></a>8.1.5. Client-side Configuration for Secure Operation - REST Gateway</h3></div></div></div><p>
Add the following to the <code class="code">hbase-site.xml</code> file for every REST gateway:
</p><pre class="programlisting">
<property>
@@ -153,7 +153,7 @@
It should be possible for clients to authenticate with the HBase
cluster through the REST gateway in a pass-through manner via SPEGNO
HTTP authentication. This is future work.
- </p></div></div><div class="footnotes"><br><hr width="100" align="left"><div class="footnote"><p><sup>[<a id="ftn.d2279e4226" href="#d2279e4226" class="para">20</a>] </sup>See
+ </p></div></div><div class="footnotes"><br><hr width="100" align="left"><div class="footnote"><p><sup>[<a id="ftn.d2475e4459" href="#d2475e4459" class="para">20</a>] </sup>See
also Matteo Bertozzi's article on <a class="link" href="http://www.cloudera.com/blog/2012/09/understanding-user-authentication-and-authorization-in-apache-hbase/" target="_top">Understanding User Authentication and Authorization in Apache HBase</a>.</p></div></div></div><div id="disqus_thread"></div><script type="text/javascript">
var disqus_shortname = 'hbase'; // required: replace example with your forum shortname
var disqus_url = 'http://hbase.apache.org/book';
Modified: hbase/hbase.apache.org/trunk/book/shell.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/book/shell.html?rev=1463652&r1=1463651&r2=1463652&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/book/shell.html (original)
+++ hbase/hbase.apache.org/trunk/book/shell.html Tue Apr 2 18:06:19 2013
@@ -1,6 +1,6 @@
<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
- <title>Chapter 4. The Apache HBase Shell</title><link rel="stylesheet" type="text/css" href="../css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"><link rel="home" href="book.html" title="The Apache HBase™ Reference Guide"><link rel="up" href="book.html" title="The Apache HBase™ Reference Guide"><link rel="prev" href="upgrade0.90.html" title="3.4. Upgrading to HBase 0.90.x from 0.20.x or 0.89.x"><link rel="next" href="shell_tricks.html" title="4.2. Shell Tricks"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="navheader"><table width="100%" summary="Navigation header"><tr><th colspan="3" align="center">Chapter 4. The Apache HBase Shell</th></tr><tr><td width="20%" align="left"><a accesskey="p" href="upgrade0.90.html">Prev</a> </td><th width="60%" align="center"> </th><td width="20%" align="right"> <a accesskey="n" href="shell
_tricks.html">Next</a></td></tr></table><hr></div><div class="chapter" title="Chapter 4. The Apache HBase Shell"><div class="titlepage"><div><div><h2 class="title"><a name="shell"></a>Chapter 4. The Apache HBase Shell</h2></div></div></div><div class="toc"><p><b>Table of Contents</b></p><dl><dt><span class="section"><a href="shell.html#scripting">4.1. Scripting</a></span></dt><dt><span class="section"><a href="shell_tricks.html">4.2. Shell Tricks</a></span></dt><dd><dl><dt><span class="section"><a href="shell_tricks.html#d2279e2913">4.2.1. <code class="filename">irbrc</code></a></span></dt><dt><span class="section"><a href="shell_tricks.html#d2279e2931">4.2.2. LOG data to timestamp</a></span></dt><dt><span class="section"><a href="shell_tricks.html#d2279e2949">4.2.3. Debug</a></span></dt><dt><span class="section"><a href="shell_tricks.html#d2279e2971">4.2.4. Commands</a></span></dt></dl></dd></dl></div><p>
+ <title>Chapter 4. The Apache HBase Shell</title><link rel="stylesheet" type="text/css" href="../css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"><link rel="home" href="book.html" title="The Apache HBase™ Reference Guide"><link rel="up" href="book.html" title="The Apache HBase™ Reference Guide"><link rel="prev" href="upgrade0.90.html" title="3.5. Upgrading to HBase 0.90.x from 0.20.x or 0.89.x"><link rel="next" href="shell_tricks.html" title="4.2. Shell Tricks"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="navheader"><table width="100%" summary="Navigation header"><tr><th colspan="3" align="center">Chapter 4. The Apache HBase Shell</th></tr><tr><td width="20%" align="left"><a accesskey="p" href="upgrade0.90.html">Prev</a> </td><th width="60%" align="center"> </th><td width="20%" align="right"> <a accesskey="n" href="shell
_tricks.html">Next</a></td></tr></table><hr></div><div class="chapter" title="Chapter 4. The Apache HBase Shell"><div class="titlepage"><div><div><h2 class="title"><a name="shell"></a>Chapter 4. The Apache HBase Shell</h2></div></div></div><div class="toc"><p><b>Table of Contents</b></p><dl><dt><span class="section"><a href="shell.html#scripting">4.1. Scripting</a></span></dt><dt><span class="section"><a href="shell_tricks.html">4.2. Shell Tricks</a></span></dt><dd><dl><dt><span class="section"><a href="shell_tricks.html#d2475e2917">4.2.1. <code class="filename">irbrc</code></a></span></dt><dt><span class="section"><a href="shell_tricks.html#d2475e2935">4.2.2. LOG data to timestamp</a></span></dt><dt><span class="section"><a href="shell_tricks.html#d2475e2953">4.2.3. Debug</a></span></dt><dt><span class="section"><a href="shell_tricks.html#d2475e2975">4.2.4. Commands</a></span></dt></dl></dd></dl></div><p>
The Apache HBase (TM) Shell is <a class="link" href="http://jruby.org" target="_top">(J)Ruby</a>'s
IRB with some HBase particular commands added. Anything you can do in
IRB, you should be able to do in the HBase Shell.</p><p>To run the HBase shell,
@@ -29,4 +29,4 @@
dsq.src = 'http://' + disqus_shortname + '.disqus.com/embed.js';
(document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
})();
-</script><noscript>Please enable JavaScript to view the <a href="http://disqus.com/?ref_noscript">comments powered by Disqus.</a></noscript><a href="http://disqus.com" class="dsq-brlink">comments powered by <span class="logo-disqus">Disqus</span></a><div class="navfooter"><hr><table width="100%" summary="Navigation footer"><tr><td width="40%" align="left"><a accesskey="p" href="upgrade0.90.html">Prev</a> </td><td width="20%" align="center"> </td><td width="40%" align="right"> <a accesskey="n" href="shell_tricks.html">Next</a></td></tr><tr><td width="40%" align="left" valign="top">3.4. Upgrading to HBase 0.90.x from 0.20.x or 0.89.x </td><td width="20%" align="center"><a accesskey="h" href="book.html">Home</a></td><td width="40%" align="right" valign="top"> 4.2. Shell Tricks</td></tr></table></div></body></html>
\ No newline at end of file
+</script><noscript>Please enable JavaScript to view the <a href="http://disqus.com/?ref_noscript">comments powered by Disqus.</a></noscript><a href="http://disqus.com" class="dsq-brlink">comments powered by <span class="logo-disqus">Disqus</span></a><div class="navfooter"><hr><table width="100%" summary="Navigation footer"><tr><td width="40%" align="left"><a accesskey="p" href="upgrade0.90.html">Prev</a> </td><td width="20%" align="center"> </td><td width="40%" align="right"> <a accesskey="n" href="shell_tricks.html">Next</a></td></tr><tr><td width="40%" align="left" valign="top">3.5. Upgrading to HBase 0.90.x from 0.20.x or 0.89.x </td><td width="20%" align="center"><a accesskey="h" href="book.html">Home</a></td><td width="40%" align="right" valign="top"> 4.2. Shell Tricks</td></tr></table></div></body></html>
\ No newline at end of file
Modified: hbase/hbase.apache.org/trunk/book/shell_tricks.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/book/shell_tricks.html?rev=1463652&r1=1463651&r2=1463652&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/book/shell_tricks.html (original)
+++ hbase/hbase.apache.org/trunk/book/shell_tricks.html Tue Apr 2 18:06:19 2013
@@ -1,6 +1,6 @@
<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
- <title>4.2. Shell Tricks</title><link rel="stylesheet" type="text/css" href="../css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"><link rel="home" href="book.html" title="The Apache HBase™ Reference Guide"><link rel="up" href="shell.html" title="Chapter 4. The Apache HBase Shell"><link rel="prev" href="shell.html" title="Chapter 4. The Apache HBase Shell"><link rel="next" href="datamodel.html" title="Chapter 5. Data Model"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="navheader"><table width="100%" summary="Navigation header"><tr><th colspan="3" align="center">4.2. Shell Tricks</th></tr><tr><td width="20%" align="left"><a accesskey="p" href="shell.html">Prev</a> </td><th width="60%" align="center">Chapter 4. The Apache HBase Shell</th><td width="20%" align="right"> <a accesskey="n" href="datamodel.html">Next</a>
</td></tr></table><hr></div><div class="section" title="4.2. Shell Tricks"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="shell_tricks"></a>4.2. Shell Tricks</h2></div></div></div><div class="section" title="4.2.1. irbrc"><div class="titlepage"><div><div><h3 class="title"><a name="d2279e2913"></a>4.2.1. <code class="filename">irbrc</code></h3></div></div></div><p>Create an <code class="filename">.irbrc</code> file for yourself in your
+ <title>4.2. Shell Tricks</title><link rel="stylesheet" type="text/css" href="../css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"><link rel="home" href="book.html" title="The Apache HBase™ Reference Guide"><link rel="up" href="shell.html" title="Chapter 4. The Apache HBase Shell"><link rel="prev" href="shell.html" title="Chapter 4. The Apache HBase Shell"><link rel="next" href="datamodel.html" title="Chapter 5. Data Model"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="navheader"><table width="100%" summary="Navigation header"><tr><th colspan="3" align="center">4.2. Shell Tricks</th></tr><tr><td width="20%" align="left"><a accesskey="p" href="shell.html">Prev</a> </td><th width="60%" align="center">Chapter 4. The Apache HBase Shell</th><td width="20%" align="right"> <a accesskey="n" href="datamodel.html">Next</a>
</td></tr></table><hr></div><div class="section" title="4.2. Shell Tricks"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="shell_tricks"></a>4.2. Shell Tricks</h2></div></div></div><div class="section" title="4.2.1. irbrc"><div class="titlepage"><div><div><h3 class="title"><a name="d2475e2917"></a>4.2.1. <code class="filename">irbrc</code></h3></div></div></div><p>Create an <code class="filename">.irbrc</code> file for yourself in your
home directory. Add customizations. A useful one is
command history so commands are save across Shell invocations:
</p><pre class="programlisting">
@@ -11,7 +11,7 @@
See the <span class="application">ruby</span> documentation of
<code class="filename">.irbrc</code> to learn about other possible
confiurations.
- </p></div><div class="section" title="4.2.2. LOG data to timestamp"><div class="titlepage"><div><div><h3 class="title"><a name="d2279e2931"></a>4.2.2. LOG data to timestamp</h3></div></div></div><p>
+ </p></div><div class="section" title="4.2.2. LOG data to timestamp"><div class="titlepage"><div><div><h3 class="title"><a name="d2475e2935"></a>4.2.2. LOG data to timestamp</h3></div></div></div><p>
To convert the date '08/08/16 20:56:29' from an hbase log into a timestamp, do:
</p><pre class="programlisting">
hbase(main):021:0> import java.text.SimpleDateFormat
@@ -25,14 +25,14 @@
</p><p>
To output in a format that is exactly like that of the HBase log format will take a little messing with
<a class="link" href="http://download.oracle.com/javase/6/docs/api/java/text/SimpleDateFormat.html" target="_top">SimpleDateFormat</a>.
- </p></div><div class="section" title="4.2.3. Debug"><div class="titlepage"><div><div><h3 class="title"><a name="d2279e2949"></a>4.2.3. Debug</h3></div></div></div><div class="section" title="4.2.3.1. Shell debug switch"><div class="titlepage"><div><div><h4 class="title"><a name="d2279e2952"></a>4.2.3.1. Shell debug switch</h4></div></div></div><p>You can set a debug switch in the shell to see more output
+ </p></div><div class="section" title="4.2.3. Debug"><div class="titlepage"><div><div><h3 class="title"><a name="d2475e2953"></a>4.2.3. Debug</h3></div></div></div><div class="section" title="4.2.3.1. Shell debug switch"><div class="titlepage"><div><div><h4 class="title"><a name="d2475e2956"></a>4.2.3.1. Shell debug switch</h4></div></div></div><p>You can set a debug switch in the shell to see more output
-- e.g. more of the stack trace on exception --
when you run a command:
</p><pre class="programlisting">hbase> debug <RETURN></pre><p>
- </p></div><div class="section" title="4.2.3.2. DEBUG log level"><div class="titlepage"><div><div><h4 class="title"><a name="d2279e2960"></a>4.2.3.2. DEBUG log level</h4></div></div></div><p>To enable DEBUG level logging in the shell,
+ </p></div><div class="section" title="4.2.3.2. DEBUG log level"><div class="titlepage"><div><div><h4 class="title"><a name="d2475e2964"></a>4.2.3.2. DEBUG log level</h4></div></div></div><p>To enable DEBUG level logging in the shell,
launch it with the <span class="command"><strong>-d</strong></span> option.
</p><pre class="programlisting">$ ./bin/hbase shell -d</pre><p>
- </p></div></div><div class="section" title="4.2.4. Commands"><div class="titlepage"><div><div><h3 class="title"><a name="d2279e2971"></a>4.2.4. Commands</h3></div></div></div><div class="section" title="4.2.4.1. count"><div class="titlepage"><div><div><h4 class="title"><a name="d2279e2974"></a>4.2.4.1. count</h4></div></div></div><p>Count command returns the number of rows in a table.
+ </p></div></div><div class="section" title="4.2.4. Commands"><div class="titlepage"><div><div><h3 class="title"><a name="d2475e2975"></a>4.2.4. Commands</h3></div></div></div><div class="section" title="4.2.4.1. count"><div class="titlepage"><div><div><h4 class="title"><a name="d2475e2978"></a>4.2.4.1. count</h4></div></div></div><p>Count command returns the number of rows in a table.
It's quite fast when configured with the right CACHE
</p><pre class="programlisting">hbase> count '<tablename>', CACHE => 1000</pre><p>
The above count fetches 1000 rows at a time. Set CACHE lower if your rows are big.
Modified: hbase/hbase.apache.org/trunk/book/snappy.compression.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/book/snappy.compression.html?rev=1463652&r1=1463651&r2=1463652&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/book/snappy.compression.html (original)
+++ hbase/hbase.apache.org/trunk/book/snappy.compression.html Tue Apr 2 18:06:19 2013
@@ -7,7 +7,7 @@
</h2></div></div></div><p>
If snappy is installed, HBase can make use of it (courtesy of
<a class="link" href="http://code.google.com/p/hadoop-snappy/" target="_top">hadoop-snappy</a>
- <sup>[<a name="d2279e11930" href="#ftn.d2279e11930" class="footnote">32</a>]</sup>).
+ <sup>[<a name="d2475e12185" href="#ftn.d2475e12185" class="footnote">32</a>]</sup>).
</p><div class="orderedlist"><ol class="orderedlist" type="1"><li class="listitem"><p>
Build and install <a class="link" href="http://code.google.com/p/snappy/" target="_top">snappy</a> on all nodes
@@ -45,7 +45,7 @@ hbase> describe 't1'</pre><p>
libsnappy.so.1
libsnappy.so.1.1.2
</pre><p>
- </p></div><div class="footnotes"><br><hr width="100" align="left"><div class="footnote"><p><sup>[<a id="ftn.d2279e11930" href="#d2279e11930" class="para">32</a>] </sup>See <a class="link" href="http://search-hadoop.com/m/Ds8d51c263B1/%2522Hadoop-Snappy+in+synch+with+Hadoop+trunk%2522&subj=Hadoop+Snappy+in+synch+with+Hadoop+trunk" target="_top">Alejandro's note</a> up on the list on difference between Snappy in Hadoop
+ </p></div><div class="footnotes"><br><hr width="100" align="left"><div class="footnote"><p><sup>[<a id="ftn.d2475e12185" href="#d2475e12185" class="para">32</a>] </sup>See <a class="link" href="http://search-hadoop.com/m/Ds8d51c263B1/%2522Hadoop-Snappy+in+synch+with+Hadoop+trunk%2522&subj=Hadoop+Snappy+in+synch+with+Hadoop+trunk" target="_top">Alejandro's note</a> up on the list on difference between Snappy in Hadoop
and Snappy in HBase</p></div></div></div><div id="disqus_thread"></div><script type="text/javascript">
var disqus_shortname = 'hbase'; // required: replace example with your forum shortname
var disqus_url = 'http://hbase.apache.org/book';
Modified: hbase/hbase.apache.org/trunk/book/standalone_dist.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/book/standalone_dist.html?rev=1463652&r1=1463651&r2=1463652&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/book/standalone_dist.html (original)
+++ hbase/hbase.apache.org/trunk/book/standalone_dist.html Tue Apr 2 18:06:19 2013
@@ -18,7 +18,7 @@
daemons run on a single node -- a.k.a
<span class="emphasis"><em>pseudo-distributed</em></span>-- and
<span class="emphasis"><em>fully-distributed</em></span> where the daemons are spread
- across all nodes in the cluster <sup>[<a name="d2279e717" href="#ftn.d2279e717" class="footnote">9</a>]</sup>.</p><p>Distributed modes require an instance of the <span class="emphasis"><em>Hadoop
+ across all nodes in the cluster <sup>[<a name="d2475e717" href="#ftn.d2475e717" class="footnote">9</a>]</sup>.</p><p>Distributed modes require an instance of the <span class="emphasis"><em>Hadoop
Distributed File System</em></span> (HDFS). See the Hadoop <a class="link" href="http://hadoop.apache.org/common/docs/r1.1.1/api/overview-summary.html#overview_description" target="_top">
requirements and instructions</a> for how to set up a HDFS. Before
proceeding, ensure you have an appropriate, working HDFS.</p><p>Below we describe the different distributed setups. Starting,
@@ -37,7 +37,7 @@
Note that the <code class="varname">hbase.rootdir</code> property points to the
local HDFS instance.
</p><p>Now skip to <a class="xref" href="standalone_dist.html#confirm" title="2.2.3. Running and Confirming Your Installation">Section 2.2.3, “Running and Confirming Your Installation”</a> for how to start and verify your
- pseudo-distributed install. <sup>[<a name="d2279e765" href="#ftn.d2279e765" class="footnote">10</a>]</sup></p><div class="note" title="Note" style="margin-left: 0.5in; margin-right: 0.5in;"><h3 class="title">Note</h3><p>Let HBase create the <code class="varname">hbase.rootdir</code>
+ pseudo-distributed install. <sup>[<a name="d2475e765" href="#ftn.d2475e765" class="footnote">10</a>]</sup></p><div class="note" title="Note" style="margin-left: 0.5in; margin-right: 0.5in;"><h3 class="title">Note</h3><p>Let HBase create the <code class="varname">hbase.rootdir</code>
directory. If you don't, you'll get warning saying HBase needs a
migration run because the directory is missing files expected by
HBase (it'll create them if you let it).</p></div><div class="section" title="2.2.2.1.1. Pseudo-distributed Configuration File"><div class="titlepage"><div><div><h5 class="title"><a name="pseudo.config"></a>2.2.2.1.1. Pseudo-distributed Configuration File</h5></div></div></div><p>Below is a sample pseudo-distributed file for the node <code class="varname">h-24-30.example.com</code>.
@@ -158,8 +158,8 @@ stopping hbase...............</pre><p> S
complete. It can take longer if your cluster is comprised of many
machines. If you are running a distributed operation, be sure to wait
until HBase has shut down completely before stopping the Hadoop
- daemons.</p></div><div class="footnotes"><br><hr width="100" align="left"><div class="footnote"><p><sup>[<a id="ftn.d2279e717" href="#d2279e717" class="para">9</a>] </sup>The pseudo-distributed vs fully-distributed nomenclature
- comes from Hadoop.</p></div><div class="footnote"><p><sup>[<a id="ftn.d2279e765" href="#d2279e765" class="para">10</a>] </sup>See <a class="xref" href="standalone_dist.html#pseudo.extras" title="2.2.2.1.2. Pseudo-distributed Extras">Section 2.2.2.1.2, “Pseudo-distributed Extras”</a> for notes on how to start extra Masters and
+ daemons.</p></div><div class="footnotes"><br><hr width="100" align="left"><div class="footnote"><p><sup>[<a id="ftn.d2475e717" href="#d2475e717" class="para">9</a>] </sup>The pseudo-distributed vs fully-distributed nomenclature
+ comes from Hadoop.</p></div><div class="footnote"><p><sup>[<a id="ftn.d2475e765" href="#d2475e765" class="para">10</a>] </sup>See <a class="xref" href="standalone_dist.html#pseudo.extras" title="2.2.2.1.2. Pseudo-distributed Extras">Section 2.2.2.1.2, “Pseudo-distributed Extras”</a> for notes on how to start extra Masters and
RegionServers when running pseudo-distributed.</p></div></div></div><div id="disqus_thread"></div><script type="text/javascript">
var disqus_shortname = 'hbase'; // required: replace example with your forum shortname
var disqus_url = 'http://hbase.apache.org/book';
Modified: hbase/hbase.apache.org/trunk/book/thrift.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/book/thrift.html?rev=1463652&r1=1463651&r2=1463652&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/book/thrift.html (original)
+++ hbase/hbase.apache.org/trunk/book/thrift.html Tue Apr 2 18:06:19 2013
@@ -2,7 +2,8 @@
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<title>10.3. Thrift</title><link rel="stylesheet" type="text/css" href="../css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"><link rel="home" href="book.html" title="The Apache HBase™ Reference Guide"><link rel="up" href="external_apis.html" title="Chapter 10. Apache HBase (TM) External APIs"><link rel="prev" href="rest.html" title="10.2. REST"><link rel="next" href="c.html" title="10.4. C/C++ Apache HBase Client"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="navheader"><table width="100%" summary="Navigation header"><tr><th colspan="3" align="center">10.3. Thrift</th></tr><tr><td width="20%" align="left"><a accesskey="p" href="rest.html">Prev</a> </td><th width="60%" align="center">Chapter 10. Apache HBase (TM) External APIs</th><td width="20%" align="right"> <a accesskey="n" href="c.html">Next</a></td></tr></table><hr><
/div><div class="section" title="10.3. Thrift"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="thrift"></a>10.3. Thrift</h2></div></div></div><p>Currently most of the documentation on Thrift exists in the
<a class="link" href="http://wiki.apache.org/hadoop/Hbase/ThriftApi" target="_top">Apache HBase Wiki on Thrift</a>.
- </p><div class="section" title="10.3.1. Filter Language"><div class="titlepage"><div><div><h3 class="title"><a name="thrift.filter-language"></a>10.3.1. Filter Language</h3></div></div></div><div class="section" title="10.3.1.1. Use Case"><div class="titlepage"><div><div><h4 class="title"><a name="use-case"></a>10.3.1.1. Use Case</h4></div></div></div><p>Note: this feature was introduced in Apache HBase 0.92</p><p>This allows the user to perform server-side filtering when accessing HBase over Thrift. The user specifies a filter via a string. The string is parsed on the server to construct the filter</p></div><div class="section" title="10.3.1.2. General Filter String Syntax"><div class="titlepage"><div><div><h4 class="title"><a name="general-syntax"></a>10.3.1.2. General Filter String Syntax</h4></div></div></div><p>A simple filter expression is expressed as: <code class="code">“FilterName (argument, argument, ... , argument)”</
code></p><p>You must specify the name of the filter followed by the argument list in parenthesis. Commas separate the individual arguments</p><p>If the argument represents a string, it should be enclosed in single quotes.</p><p>If it represents a boolean, an integer or a comparison operator like <,
+ </p><div class="section" title="10.3.1. Filter Language"><div class="titlepage"><div><div><h3 class="title"><a name="thrift.filter-language"></a>10.3.1. Filter Language</h3></div></div></div><div class="section" title="10.3.1.1. Use Case"><div class="titlepage"><div><div><h4 class="title"><a name="use-case"></a>10.3.1.1. Use Case</h4></div></div></div><div class="note" title="Note" style="margin-left: 0.5in; margin-right: 0.5in;"><h3 class="title">Note</h3><p>this feature was introduced in Apache HBase 0.92</p></div><p>This allows the user to perform server-side filtering when accessing HBase over Thrift (or in the shell -- see the 'scan' help in the shell).
+ The user specifies a filter via a string. The string is parsed on the server to construct the filter</p></div><div class="section" title="10.3.1.2. General Filter String Syntax"><div class="titlepage"><div><div><h4 class="title"><a name="general-syntax"></a>10.3.1.2. General Filter String Syntax</h4></div></div></div><p>A simple filter expression is expressed as: <code class="code">“FilterName (argument, argument, ... , argument)”</code></p><p>You must specify the name of the filter followed by the argument list in parenthesis. Commas separate the individual arguments</p><p>If the argument represents a string, it should be enclosed in single quotes.</p><p>If it represents a boolean, an integer or a comparison operator like <,
>, != etc. it should not be enclosed in quotes</p><p>The filter name must be one word. All ASCII characters are allowed except for whitespace, single quotes and parenthesis.</p><p>The filter’s arguments can contain any ASCII character. <code class="code">If single quotes are present in the argument, they must be escaped by a
preceding single quote</code></p></div><div class="section" title="10.3.1.3. Compound Filters and Operators"><div class="titlepage"><div><div><h4 class="title"><a name="compound-filters-and-operators"></a>10.3.1.3. Compound Filters and Operators</h4></div></div></div><p>Currently, two binary operators – AND/OR and two unary operators – WHILE/SKIP are supported.</p><p>Note: the operators are all in uppercase</p><p><span class="bold"><strong>AND</strong></span> – as the name suggests, if this
operator is used, the key-value must pass both the filters</p><p><span class="bold"><strong>OR</strong></span> – as the name suggests, if this operator
Modified: hbase/hbase.apache.org/trunk/book/trouble.resources.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/book/trouble.resources.html?rev=1463652&r1=1463651&r2=1463652&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/book/trouble.resources.html (original)
+++ hbase/hbase.apache.org/trunk/book/trouble.resources.html Tue Apr 2 18:06:19 2013
@@ -8,12 +8,12 @@
is generally used for questions on released versions of Apache HBase. Before going to the mailing list, make sure your
question has not already been answered by searching the mailing list archives first. Use
<a class="xref" href="trouble.resources.html#trouble.resources.searchhadoop" title="12.3.1. search-hadoop.com">Section 12.3.1, “search-hadoop.com”</a>.
- Take some time crafting your question<sup>[<a name="d2279e7773" href="#ftn.d2279e7773" class="footnote">28</a>]</sup>; a quality question that includes all context and
+ Take some time crafting your question<sup>[<a name="d2475e8017" href="#ftn.d2475e8017" class="footnote">28</a>]</sup>; a quality question that includes all context and
exhibits evidence the author has tried to find answers in the manual and out on lists
is more likely to get a prompt response.
</p></div><div class="section" title="12.3.3. IRC"><div class="titlepage"><div><div><h3 class="title"><a name="trouble.resources.irc"></a>12.3.3. IRC</h3></div></div></div><p>#hbase on irc.freenode.net</p></div><div class="section" title="12.3.4. JIRA"><div class="titlepage"><div><div><h3 class="title"><a name="trouble.resources.jira"></a>12.3.4. JIRA</h3></div></div></div><p>
<a class="link" href="https://issues.apache.org/jira/browse/HBASE" target="_top">JIRA</a> is also really helpful when looking for Hadoop/HBase-specific issues.
- </p></div><div class="footnotes"><br><hr width="100" align="left"><div class="footnote"><p><sup>[<a id="ftn.d2279e7773" href="#d2279e7773" class="para">28</a>] </sup>See Getting Answers</p></div></div></div><div id="disqus_thread"></div><script type="text/javascript">
+ </p></div><div class="footnotes"><br><hr width="100" align="left"><div class="footnote"><p><sup>[<a id="ftn.d2475e8017" href="#d2475e8017" class="para">28</a>] </sup>See Getting Answers</p></div></div></div><div id="disqus_thread"></div><script type="text/javascript">
var disqus_shortname = 'hbase'; // required: replace example with your forum shortname
var disqus_url = 'http://hbase.apache.org/book';
var disqus_identifier = 'trouble.resources';
Modified: hbase/hbase.apache.org/trunk/book/upgrade0.90.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/book/upgrade0.90.html?rev=1463652&r1=1463651&r2=1463652&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/book/upgrade0.90.html (original)
+++ hbase/hbase.apache.org/trunk/book/upgrade0.90.html Tue Apr 2 18:06:19 2013
@@ -1,6 +1,6 @@
<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
- <title>3.4. Upgrading to HBase 0.90.x from 0.20.x or 0.89.x</title><link rel="stylesheet" type="text/css" href="../css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"><link rel="home" href="book.html" title="The Apache HBase™ Reference Guide"><link rel="up" href="upgrading.html" title="Chapter 3. Upgrading"><link rel="prev" href="upgrade0.92.html" title="3.3. Upgrading from 0.90.x to 0.92.x"><link rel="next" href="shell.html" title="Chapter 4. The Apache HBase Shell"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="navheader"><table width="100%" summary="Navigation header"><tr><th colspan="3" align="center">3.4. Upgrading to HBase 0.90.x from 0.20.x or 0.89.x</th></tr><tr><td width="20%" align="left"><a accesskey="p" href="upgrade0.92.html">Prev</a> </td><th width="60%" align="center">Chapter 3. Upgrading</th><td width="20%" a
lign="right"> <a accesskey="n" href="shell.html">Next</a></td></tr></table><hr></div><div class="section" title="3.4. Upgrading to HBase 0.90.x from 0.20.x or 0.89.x"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="upgrade0.90"></a>3.4. Upgrading to HBase 0.90.x from 0.20.x or 0.89.x</h2></div></div></div><p>This version of 0.90.x HBase can be started on data written by
+ <title>3.5. Upgrading to HBase 0.90.x from 0.20.x or 0.89.x</title><link rel="stylesheet" type="text/css" href="../css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"><link rel="home" href="book.html" title="The Apache HBase™ Reference Guide"><link rel="up" href="upgrading.html" title="Chapter 3. Upgrading"><link rel="prev" href="upgrade0.92.html" title="3.4. Upgrading from 0.90.x to 0.92.x"><link rel="next" href="shell.html" title="Chapter 4. The Apache HBase Shell"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="navheader"><table width="100%" summary="Navigation header"><tr><th colspan="3" align="center">3.5. Upgrading to HBase 0.90.x from 0.20.x or 0.89.x</th></tr><tr><td width="20%" align="left"><a accesskey="p" href="upgrade0.92.html">Prev</a> </td><th width="60%" align="center">Chapter 3. Upgrading</th><td width="20%" a
lign="right"> <a accesskey="n" href="shell.html">Next</a></td></tr></table><hr></div><div class="section" title="3.5. Upgrading to HBase 0.90.x from 0.20.x or 0.89.x"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="upgrade0.90"></a>3.5. Upgrading to HBase 0.90.x from 0.20.x or 0.89.x</h2></div></div></div><p>This version of 0.90.x HBase can be started on data written by
HBase 0.20.x or HBase 0.89.x. There is no need of a migration step.
HBase 0.89.x and 0.90.x does write out the name of region directories
differently -- it names them with a md5 hash of the region name rather
@@ -27,10 +27,10 @@
need to change this (The 'normal'/default value is 64MB (67108864)).
Run the script <code class="filename">bin/set_meta_memstore_size.rb</code>.
This will make the necessary edit to your <code class="varname">.META.</code> schema.
- Failure to run this change will make for a slow cluster <sup>[<a name="d2279e2863" href="#ftn.d2279e2863" class="footnote">12</a>]</sup>
+ Failure to run this change will make for a slow cluster <sup>[<a name="d2475e2867" href="#ftn.d2475e2867" class="footnote">12</a>]</sup>
.
- </p><div class="footnotes"><br><hr width="100" align="left"><div class="footnote"><p><sup>[<a id="ftn.d2279e2863" href="#d2279e2863" class="para">12</a>] </sup>
+ </p><div class="footnotes"><br><hr width="100" align="left"><div class="footnote"><p><sup>[<a id="ftn.d2475e2867" href="#d2475e2867" class="para">12</a>] </sup>
See <a class="link" href="https://issues.apache.org/jira/browse/HBASE-3499" target="_top">HBASE-3499 Users upgrading to 0.90.0 need to have their .META. table updated with the right MEMSTORE_SIZE</a>
</p></div></div></div><div id="disqus_thread"></div><script type="text/javascript">
var disqus_shortname = 'hbase'; // required: replace example with your forum shortname
@@ -43,4 +43,4 @@
dsq.src = 'http://' + disqus_shortname + '.disqus.com/embed.js';
(document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
})();
-</script><noscript>Please enable JavaScript to view the <a href="http://disqus.com/?ref_noscript">comments powered by Disqus.</a></noscript><a href="http://disqus.com" class="dsq-brlink">comments powered by <span class="logo-disqus">Disqus</span></a><div class="navfooter"><hr><table width="100%" summary="Navigation footer"><tr><td width="40%" align="left"><a accesskey="p" href="upgrade0.92.html">Prev</a> </td><td width="20%" align="center"><a accesskey="u" href="upgrading.html">Up</a></td><td width="40%" align="right"> <a accesskey="n" href="shell.html">Next</a></td></tr><tr><td width="40%" align="left" valign="top">3.3. Upgrading from 0.90.x to 0.92.x </td><td width="20%" align="center"><a accesskey="h" href="book.html">Home</a></td><td width="40%" align="right" valign="top"> Chapter 4. The Apache HBase Shell</td></tr></table></div></body></html>
\ No newline at end of file
+</script><noscript>Please enable JavaScript to view the <a href="http://disqus.com/?ref_noscript">comments powered by Disqus.</a></noscript><a href="http://disqus.com" class="dsq-brlink">comments powered by <span class="logo-disqus">Disqus</span></a><div class="navfooter"><hr><table width="100%" summary="Navigation footer"><tr><td width="40%" align="left"><a accesskey="p" href="upgrade0.92.html">Prev</a> </td><td width="20%" align="center"><a accesskey="u" href="upgrading.html">Up</a></td><td width="40%" align="right"> <a accesskey="n" href="shell.html">Next</a></td></tr><tr><td width="40%" align="left" valign="top">3.4. Upgrading from 0.90.x to 0.92.x </td><td width="20%" align="center"><a accesskey="h" href="book.html">Home</a></td><td width="40%" align="right" valign="top"> Chapter 4. The Apache HBase Shell</td></tr></table></div></body></html>
\ No newline at end of file
Modified: hbase/hbase.apache.org/trunk/book/upgrade0.92.html
URL: http://svn.apache.org/viewvc/hbase/hbase.apache.org/trunk/book/upgrade0.92.html?rev=1463652&r1=1463651&r2=1463652&view=diff
==============================================================================
--- hbase/hbase.apache.org/trunk/book/upgrade0.92.html (original)
+++ hbase/hbase.apache.org/trunk/book/upgrade0.92.html Tue Apr 2 18:06:19 2013
@@ -1,6 +1,6 @@
<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
- <title>3.3. Upgrading from 0.90.x to 0.92.x</title><link rel="stylesheet" type="text/css" href="../css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"><link rel="home" href="book.html" title="The Apache HBase™ Reference Guide"><link rel="up" href="upgrading.html" title="Chapter 3. Upgrading"><link rel="prev" href="upgrade0.94.html" title="3.2. Upgrading from 0.92.x to 0.94.x"><link rel="next" href="upgrade0.90.html" title="3.4. Upgrading to HBase 0.90.x from 0.20.x or 0.89.x"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="navheader"><table width="100%" summary="Navigation header"><tr><th colspan="3" align="center">3.3. Upgrading from 0.90.x to 0.92.x</th></tr><tr><td width="20%" align="left"><a accesskey="p" href="upgrade0.94.html">Prev</a> </td><th width="60%" align="center">Chapter 3. Upgrading</th><td width="20%" align="right"
> <a accesskey="n" href="upgrade0.90.html">Next</a></td></tr></table><hr></div><div class="section" title="3.3. Upgrading from 0.90.x to 0.92.x"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="upgrade0.92"></a>3.3. Upgrading from 0.90.x to 0.92.x</h2></div><div><h3 class="subtitle">Upgrade Guide</h3></div></div></div><p>You will find that 0.92.0 runs a little differently to 0.90.x releases. Here are a few things to watch out for upgrading from 0.90.x to 0.92.0.
+ <title>3.4. Upgrading from 0.90.x to 0.92.x</title><link rel="stylesheet" type="text/css" href="../css/freebsd_docbook.css"><meta name="generator" content="DocBook XSL-NS Stylesheets V1.76.1"><link rel="home" href="book.html" title="The Apache HBase™ Reference Guide"><link rel="up" href="upgrading.html" title="Chapter 3. Upgrading"><link rel="prev" href="upgrade0.94.html" title="3.3. Upgrading from 0.92.x to 0.94.x"><link rel="next" href="upgrade0.90.html" title="3.5. Upgrading to HBase 0.90.x from 0.20.x or 0.89.x"></head><body bgcolor="white" text="black" link="#0000FF" vlink="#840084" alink="#0000FF"><div class="navheader"><table width="100%" summary="Navigation header"><tr><th colspan="3" align="center">3.4. Upgrading from 0.90.x to 0.92.x</th></tr><tr><td width="20%" align="left"><a accesskey="p" href="upgrade0.94.html">Prev</a> </td><th width="60%" align="center">Chapter 3. Upgrading</th><td width="20%" align="right"
> <a accesskey="n" href="upgrade0.90.html">Next</a></td></tr></table><hr></div><div class="section" title="3.4. Upgrading from 0.90.x to 0.92.x"><div class="titlepage"><div><div><h2 class="title" style="clear: both"><a name="upgrade0.92"></a>3.4. Upgrading from 0.90.x to 0.92.x</h2></div><div><h3 class="subtitle">Upgrade Guide</h3></div></div></div><p>You will find that 0.92.0 runs a little differently to 0.90.x releases. Here are a few things to watch out for upgrading from 0.90.x to 0.92.0.
</p><div class="note" title="tl;dr" style="margin-left: 0.5in; margin-right: 0.5in;"><h3 class="title">tl;dr</h3><p>
If you've not patience, here are the important things to know upgrading.
</p><div class="orderedlist"><ol class="orderedlist" type="1"><li class="listitem">Once you upgrade, you can’t go back.
@@ -14,46 +14,46 @@ There’s a separate tarball for sec
If -XX:MaxDirectMemorySize is set in your hbase-env.sh, it’s going to enable the experimental off-heap cache (You may not want this).
</li></ol></div><p>
</p></div><p>
-</p><div class="section" title="3.3.1. You can’t go back!"><div class="titlepage"><div><div><h3 class="title"><a name="d2279e2710"></a>3.3.1. You can’t go back!
+</p><div class="section" title="3.4.1. You can’t go back!"><div class="titlepage"><div><div><h3 class="title"><a name="d2475e2714"></a>3.4.1. You can’t go back!
</h3></div></div></div><p>To move to 0.92.0, all you need to do is shutdown your cluster, replace your hbase 0.90.x with hbase 0.92.0 binaries (be sure you clear out all 0.90.x instances) and restart (You cannot do a rolling restart from 0.90.x to 0.92.x -- you must restart).
On startup, the <code class="varname">.META.</code> table content is rewritten removing the table schema from the <code class="varname">info:regioninfo</code> column.
Also, any flushes done post first startup will write out data in the new 0.92.0 file format, <a class="link" href="http://hbase.apache.org/book.html#hfilev2" target="_top">HFile V2</a>.
This means you cannot go back to 0.90.x once you’ve started HBase 0.92.0 over your HBase data directory.
-</p></div><div class="section" title="3.3.2. MSLAB is ON by default"><div class="titlepage"><div><div><h3 class="title"><a name="d2279e2724"></a>3.3.2. MSLAB is ON by default
+</p></div><div class="section" title="3.4.2. MSLAB is ON by default"><div class="titlepage"><div><div><h3 class="title"><a name="d2475e2728"></a>3.4.2. MSLAB is ON by default
</h3></div></div></div><p>In 0.92.0, the <a class="link" href="http://hbase.apache.org/book.html#hbase.hregion.memstore.mslab.enabled" target="_top">hbase.hregion.memstore.mslab.enabled</a> flag is set to true
(See <a class="xref" href="jvm.html#mslab">Section 11.3.1.1, “Long GC pauses”</a>). In 0.90.x it was <code class="constant">false</code>. When it is enabled, memstores will step allocate memory in MSLAB 2MB chunks even if the
memstore has zero or just a few small elements. This is fine usually but if you had lots of regions per regionserver in a 0.90.x cluster (and MSLAB was off),
you may find yourself OOME'ing on upgrade because the <span class="mathphrase">thousands of regions * number of column families * 2MB MSLAB (at a minimum)</span>
puts your heap over the top. Set <code class="varname">hbase.hregion.memstore.mslab.enabled</code> to
<code class="constant">false</code> or set the MSLAB size down from 2MB by setting <code class="varname">hbase.hregion.memstore.mslab.chunksize</code> to something less.
-</p></div><div class="section" title="3.3.3. Distributed splitting is on by default"><div class="titlepage"><div><div><h3 class="title"><a name="d2279e2749"></a>3.3.3. Distributed splitting is on by default
+</p></div><div class="section" title="3.4.3. Distributed splitting is on by default"><div class="titlepage"><div><div><h3 class="title"><a name="d2475e2753"></a>3.4.3. Distributed splitting is on by default
</h3></div></div></div><p>Previous, WAL logs on crash were split by the Master alone. In 0.92.0, log splitting is done by the cluster (See See “HBASE-1364 [performance] Distributed splitting of regionserver commit logs”). This should cut down significantly on the amount of time it takes splitting logs and getting regions back online again.
-</p></div><div class="section" title="3.3.4. Memory accounting is different now"><div class="titlepage"><div><div><h3 class="title"><a name="d2279e2754"></a>3.3.4. Memory accounting is different now
+</p></div><div class="section" title="3.4.4. Memory accounting is different now"><div class="titlepage"><div><div><h3 class="title"><a name="d2475e2758"></a>3.4.4. Memory accounting is different now
</h3></div></div></div><p>In 0.92.0, <a class="xref" href="hfilev2.html" title="Appendix E. HFile format version 2">Appendix E, <i>HFile format version 2</i></a> indices and bloom filters take up residence in the same LRU used caching blocks that come from the filesystem.
In 0.90.x, the HFile v1 indices lived outside of the LRU so they took up space even if the index was on a ‘cold’ file, one that wasn’t being actively used. With the indices now in the LRU, you may find you
have less space for block caching. Adjust your block cache accordingly. See the <a class="xref" href="regionserver.arch.html#block.cache" title="9.6.4. Block Cache">Section 9.6.4, “Block Cache”</a> for more detail.
The block size default size has been changed in 0.92.0 from 0.2 (20 percent of heap) to 0.25.
-</p></div><div class="section" title="3.3.5. On the Hadoop version to use"><div class="titlepage"><div><div><h3 class="title"><a name="d2279e2763"></a>3.3.5. On the Hadoop version to use
+</p></div><div class="section" title="3.4.5. On the Hadoop version to use"><div class="titlepage"><div><div><h3 class="title"><a name="d2475e2767"></a>3.4.5. On the Hadoop version to use
</h3></div></div></div><p>Run 0.92.0 on Hadoop 1.0.x (or CDH3u3 when it ships). The performance benefits are worth making the move. Otherwise, our Hadoop prescription is as it has been; you need an Hadoop that supports a working sync. See <a class="xref" href="configuration.html#hadoop" title="2.1.3. Hadoop">Section 2.1.3, “Hadoop”</a>.
</p><p>If running on Hadoop 1.0.x (or CDH3u3), enable local read. See <a class="link" href="http://files.meetup.com/1350427/hug_ebay_jdcryans.pdf" target="_top">Practical Caching</a> presentation for ruminations on the performance benefits ‘going local’ (and for how to enable local reads).
-</p></div><div class="section" title="3.3.6. HBase 0.92.0 ships with ZooKeeper 3.4.2"><div class="titlepage"><div><div><h3 class="title"><a name="d2279e2775"></a>3.3.6. HBase 0.92.0 ships with ZooKeeper 3.4.2
+</p></div><div class="section" title="3.4.6. HBase 0.92.0 ships with ZooKeeper 3.4.2"><div class="titlepage"><div><div><h3 class="title"><a name="d2475e2779"></a>3.4.6. HBase 0.92.0 ships with ZooKeeper 3.4.2
</h3></div></div></div><p>If you can, upgrade your zookeeper. If you can’t, 3.4.2 clients should work against 3.3.X ensembles (HBase makes use of 3.4.2 API).
-</p></div><div class="section" title="3.3.7. Online alter is off by default"><div class="titlepage"><div><div><h3 class="title"><a name="d2279e2780"></a>3.3.7. Online alter is off by default
+</p></div><div class="section" title="3.4.7. Online alter is off by default"><div class="titlepage"><div><div><h3 class="title"><a name="d2475e2784"></a>3.4.7. Online alter is off by default
</h3></div></div></div><p>In 0.92.0, we’ve added an experimental online schema alter facility (See <a class="xref" href="config.files.html#hbase.online.schema.update.enable" title="hbase.online.schema.update.enable"><code class="varname">hbase.online.schema.update.enable</code></a>). Its off by default. Enable it at your own risk. Online alter and splitting tables do not play well together so be sure your cluster quiescent using this feature (for now).
-</p></div><div class="section" title="3.3.8. WebUI"><div class="titlepage"><div><div><h3 class="title"><a name="d2279e2787"></a>3.3.8. WebUI
+</p></div><div class="section" title="3.4.8. WebUI"><div class="titlepage"><div><div><h3 class="title"><a name="d2475e2791"></a>3.4.8. WebUI
</h3></div></div></div><p>The webui has had a few additions made in 0.92.0. It now shows a list of the regions currently transitioning, recent compactions/flushes, and a process list of running processes (usually empty if all is well and requests are being handled promptly). Other additions including requests by region, a debugging servlet dump, etc.
-</p></div><div class="section" title="3.3.9. Security tarball"><div class="titlepage"><div><div><h3 class="title"><a name="d2279e2792"></a>3.3.9. Security tarball
+</p></div><div class="section" title="3.4.9. Security tarball"><div class="titlepage"><div><div><h3 class="title"><a name="d2475e2796"></a>3.4.9. Security tarball
</h3></div></div></div><p>We now ship with two tarballs; secure and insecure HBase. Documentation on how to setup a secure HBase is on the way.
-</p></div><div class="section" title="3.3.10. Experimental off-heap cache"><div class="titlepage"><div><div><h3 class="title"><a name="d2279e2797"></a>3.3.10. Experimental off-heap cache
+</p></div><div class="section" title="3.4.10. Experimental off-heap cache"><div class="titlepage"><div><div><h3 class="title"><a name="d2475e2801"></a>3.4.10. Experimental off-heap cache
</h3></div></div></div><p>
A new cache was contributed to 0.92.0 to act as a solution between using the “on-heap” cache which is the current LRU cache the region servers have and the operating system cache which is out of our control.
To enable, set “-XX:MaxDirectMemorySize” in hbase-env.sh to the value for maximum direct memory size and specify hbase.offheapcache.percentage in hbase-site.xml with the percentage that you want to dedicate to off-heap cache. This should only be set for servers and not for clients. Use at your own risk.
See this blog post for additional information on this new experimental feature: http://www.cloudera.com/blog/2012/01/caching-in-hbase-slabcache/
-</p></div><div class="section" title="3.3.11. Changes in HBase replication"><div class="titlepage"><div><div><h3 class="title"><a name="d2279e2802"></a>3.3.11. Changes in HBase replication
+</p></div><div class="section" title="3.4.11. Changes in HBase replication"><div class="titlepage"><div><div><h3 class="title"><a name="d2475e2806"></a>3.4.11. Changes in HBase replication
</h3></div></div></div><p>0.92.0 adds two new features: multi-slave and multi-master replication. The way to enable this is the same as adding a new peer, so in order to have multi-master you would just run add_peer for each cluster that acts as a master to the other slave clusters. Collisions are handled at the timestamp level which may or may not be what you want, this needs to be evaluated on a per use case basis. Replication is still experimental in 0.92 and is disabled by default, run it at your own risk.
-</p></div><div class="section" title="3.3.12. RegionServer now aborts if OOME"><div class="titlepage"><div><div><h3 class="title"><a name="d2279e2807"></a>3.3.12. RegionServer now aborts if OOME
+</p></div><div class="section" title="3.4.12. RegionServer now aborts if OOME"><div class="titlepage"><div><div><h3 class="title"><a name="d2475e2811"></a>3.4.12. RegionServer now aborts if OOME
</h3></div></div></div><p>If an OOME, we now have the JVM kill -9 the regionserver process so it goes down fast. Previous, a RegionServer might stick around after incurring an OOME limping along in some wounded state. To disable this facility, and recommend you leave it in place, you’d need to edit the bin/hbase file. Look for the addition of the -XX:OnOutOfMemoryError="kill -9 %p" arguments (See [HBASE-4769] - ‘Abort RegionServer Immediately on OOME’)
-</p></div><div class="section" title="3.3.13. HFile V2 and the “Bigger, Fewer” Tendency"><div class="titlepage"><div><div><h3 class="title"><a name="d2279e2812"></a>3.3.13. HFile V2 and the “Bigger, Fewer” Tendency
+</p></div><div class="section" title="3.4.13. HFile V2 and the “Bigger, Fewer” Tendency"><div class="titlepage"><div><div><h3 class="title"><a name="d2475e2816"></a>3.4.13. HFile V2 and the “Bigger, Fewer” Tendency
</h3></div></div></div><p>0.92.0 stores data in a new format, <a class="xref" href="hfilev2.html" title="Appendix E. HFile format version 2">Appendix E, <i>HFile format version 2</i></a>. As HBase runs, it will move all your data from HFile v1 to HFile v2 format. This auto-migration will run in the background as flushes and compactions run.
HFile V2 allows HBase run with larger regions/files. In fact, we encourage that all HBasers going forward tend toward Facebook axiom #1, run with larger, fewer regions.
If you have lots of regions now -- more than 100s per host -- you should look into setting your region size up after you move to 0.92.0 (In 0.92.0, default size is now 1G, up from 256M), and then running online merge tool (See “HBASE-1621 merge tool should work on online cluster, but disabled table”).
@@ -68,4 +68,4 @@ If you have lots of regions now -- more
dsq.src = 'http://' + disqus_shortname + '.disqus.com/embed.js';
(document.getElementsByTagName('head')[0] || document.getElementsByTagName('body')[0]).appendChild(dsq);
})();
-</script><noscript>Please enable JavaScript to view the <a href="http://disqus.com/?ref_noscript">comments powered by Disqus.</a></noscript><a href="http://disqus.com" class="dsq-brlink">comments powered by <span class="logo-disqus">Disqus</span></a><div class="navfooter"><hr><table width="100%" summary="Navigation footer"><tr><td width="40%" align="left"><a accesskey="p" href="upgrade0.94.html">Prev</a> </td><td width="20%" align="center"><a accesskey="u" href="upgrading.html">Up</a></td><td width="40%" align="right"> <a accesskey="n" href="upgrade0.90.html">Next</a></td></tr><tr><td width="40%" align="left" valign="top">3.2. Upgrading from 0.92.x to 0.94.x </td><td width="20%" align="center"><a accesskey="h" href="book.html">Home</a></td><td width="40%" align="right" valign="top"> 3.4. Upgrading to HBase 0.90.x from 0.20.x or 0.89.x</td></tr></table></div></body></html>
\ No newline at end of file
+</script><noscript>Please enable JavaScript to view the <a href="http://disqus.com/?ref_noscript">comments powered by Disqus.</a></noscript><a href="http://disqus.com" class="dsq-brlink">comments powered by <span class="logo-disqus">Disqus</span></a><div class="navfooter"><hr><table width="100%" summary="Navigation footer"><tr><td width="40%" align="left"><a accesskey="p" href="upgrade0.94.html">Prev</a> </td><td width="20%" align="center"><a accesskey="u" href="upgrading.html">Up</a></td><td width="40%" align="right"> <a accesskey="n" href="upgrade0.90.html">Next</a></td></tr><tr><td width="40%" align="left" valign="top">3.3. Upgrading from 0.92.x to 0.94.x </td><td width="20%" align="center"><a accesskey="h" href="book.html">Home</a></td><td width="40%" align="right" valign="top"> 3.5. Upgrading to HBase 0.90.x from 0.20.x or 0.89.x</td></tr></table></div></body></html>
\ No newline at end of file