You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by Apache Wiki <wi...@apache.org> on 2007/10/15 20:50:44 UTC
[Lucene-hadoop Wiki] Update of "Hbase" by JimKellerman
Dear Wiki user,
You have subscribed to a wiki page or wiki category on "Lucene-hadoop Wiki" for change notification.
The following page has been changed by JimKellerman:
http://wiki.apache.org/lucene-hadoop/Hbase
The comment on the change is:
add table of contents, missing links
------------------------------------------------------------------------------
= Bigtable-like structured storage for Hadoop HDFS =
- '''NEWS:'''
+ == Table Of Contents ==
+
+ * [#news News]
+ * [#background Background]
+ * [#rationale Rationale]
+ * [#goals Goals]
+ * [#nongoals Non-Goals]
+ * [#links Project Links]
+ * [#contributors Initial Contributors]
+ * [#comments Comments]
+
+
+ [[Anchor(news)]]
+ == NEWS: ==
* Cluster behavior has been much improved. The master, rather than the splitting region server host, now rules where the daughter splits are deployed. A simple formula has been added to spread region load evenly. Splits have been made near-instantaneous and compaction has been reworked so neither block updates for extended periods of time. -- ''Added 2007/08/16''
* Support for row and filter columns.
* A simple [wiki:Hbase/HbaseShell shell] for manipulating HBase tables contributed by Edward Yoon. -- ''Added 2007/07/10'''
@@ -24, +37 @@
See the [https://issues.apache.org/jira/secure/IssueNavigator.jspa?mode=hide&requestId=12311855 HBase section of JIRA] for current set of outstanding issues and recent fixes.
+ [[Anchor(background)]]
== Background ==
Google's [http://labs.google.com/papers/bigtable.html Bigtable],
@@ -45, +59 @@
Iterator can be set up to scan through the key-value pairs for that column
given a specific row key.
+ [[Anchor(rationale)]]
== Rationale ==
Both Google's GFS and Hadoop's HDFS provide a mechanism to
@@ -55, +70 @@
Bigtable (and Hbase) provide a means for organizing and efficiently
accessing these large data sets.
+ [[Anchor(goals)]]
== Goals ==
Design (and subsequently implement) a structured storage system as
similar to Google's Bigtable as possible for the Hadoop environment.
+ [[Anchor(nongoals)]]
=== Non-Goals ===
* Gratuitous changes that are essentially "re-inventing the wheel" or are the result of "not invented here".
* Until the first working version is completed, requests for additional features should be posted at [wiki:Self:Hbase/HbaseFeatureRequests Hbase Feature Requests] to prevent "feature creep" or "one plus" requests that are not necessary in an initial release.
* Premature optimization. Once there is a working version, the system will be profiled for hot spots.
+ [[Anchor(links)]]
== Project Links ==
- * [wiki:Hbase/HbaseArchitecture Hbase Architecture - a work in progress]
+ * [wiki:Hbase/HbaseArchitecture Hbase Architecture]
* [http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/javadoc/org/apache/hadoop/hbase/package-summary.html#package_description Getting Started] description hosted inside the HBase javadoc package description.
* [wiki:Hbase/FAQ FAQ]
+ * [wiki:Hbase/HbaseFeatureRequests Requested New Features]
+ * [wiki:Hbase/UsingBloomFilters Using Bloom Filters]
* The [wiki:Hbase/HbaseShell HBase Shell home page] describes current state of a basic HBase shell. Includes links to wiki pages describing future shell developments.
* [http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/javadoc/org/apache/hadoop/hbase/package-summary.html HBase API Docs] built as part of Hadoop nightlies
* [wiki:Hbase/PerformanceEvaluation Tools for evaluating HBase performance and scalability]
* [wiki:Hbase/RDF RDF]: Notes on HBase as an RDF store.
* Hbase IRC channel is #hbase at irc.freenode.net.
+ [[Anchor(contributors)]]
== Initial Contributors ==
* Mike Cafarella (who wrote the initial code base)
* JimKellerman [[MailTo(jim AT SPAMFREE powerset DOT com)]]
* Michael Stack [[MailTo(stack AT SPAMFREE powerset DOT com)]]
+ [[Anchor(comments)]]
== Comments ==
Please add comments related to the project goals and process below.