You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by Apache Wiki <wi...@apache.org> on 2007/10/15 20:50:44 UTC

[Lucene-hadoop Wiki] Update of "Hbase" by JimKellerman

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Lucene-hadoop Wiki" for change notification.

The following page has been changed by JimKellerman:
http://wiki.apache.org/lucene-hadoop/Hbase

The comment on the change is:
add table of contents, missing links

------------------------------------------------------------------------------
  
  = Bigtable-like structured storage for Hadoop HDFS =
  
- '''NEWS:'''
+ == Table Of Contents ==
+ 
+  * [#news News]
+  * [#background Background]
+  * [#rationale Rationale]
+  * [#goals Goals]
+   * [#nongoals Non-Goals]
+  * [#links Project Links]
+  * [#contributors Initial Contributors]
+  * [#comments Comments]
+ 
+ 
+ [[Anchor(news)]]
+ == NEWS: ==
   * Cluster behavior has been much improved. The master, rather than the splitting region server host, now rules where the daughter splits are deployed. A simple formula has been added to spread region load evenly.  Splits have been made near-instantaneous and compaction has been reworked so neither block updates for extended periods of time. -- ''Added 2007/08/16''
   * Support for row and filter columns.
   * A simple [wiki:Hbase/HbaseShell shell] for manipulating HBase tables contributed by Edward Yoon. -- ''Added 2007/07/10'''
@@ -24, +37 @@

  See the [https://issues.apache.org/jira/secure/IssueNavigator.jspa?mode=hide&requestId=12311855 HBase section of JIRA] for current set of outstanding issues and recent fixes.
  
  
+ [[Anchor(background)]]
  == Background ==
  
  Google's [http://labs.google.com/papers/bigtable.html Bigtable],
@@ -45, +59 @@

  Iterator can be set up to scan through the key-value pairs for that column 
  given a specific row key.
  
+ [[Anchor(rationale)]]
  == Rationale ==
  
  Both Google's GFS and Hadoop's HDFS provide a mechanism to
@@ -55, +70 @@

  Bigtable (and Hbase) provide a means for organizing and efficiently
  accessing these large data sets.
  
+ [[Anchor(goals)]]
  == Goals ==
  
  Design (and subsequently implement) a structured storage system as
  similar to Google's Bigtable as possible for the Hadoop environment.
  
+ [[Anchor(nongoals)]]
  === Non-Goals ===
  
   * Gratuitous changes that are essentially "re-inventing the wheel" or are the result of "not invented here".
   * Until the first working version is completed, requests for additional features should be posted at [wiki:Self:Hbase/HbaseFeatureRequests Hbase Feature Requests] to prevent "feature creep" or "one plus" requests that are not necessary in an initial release.
   * Premature optimization. Once there is a working version, the system will be profiled for hot spots.
  
+ [[Anchor(links)]]
  == Project Links ==
  
-  * [wiki:Hbase/HbaseArchitecture  Hbase Architecture - a work in progress]
+  * [wiki:Hbase/HbaseArchitecture  Hbase Architecture]
   * [http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/javadoc/org/apache/hadoop/hbase/package-summary.html#package_description  Getting Started] description hosted inside the HBase javadoc package description.
   * [wiki:Hbase/FAQ FAQ]
+  * [wiki:Hbase/HbaseFeatureRequests Requested New Features]
+  * [wiki:Hbase/UsingBloomFilters Using Bloom Filters]
   * The [wiki:Hbase/HbaseShell HBase Shell home page] describes current state of a basic HBase shell. Includes links to wiki pages describing future shell developments.
   * [http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/javadoc/org/apache/hadoop/hbase/package-summary.html HBase API Docs] built as part of Hadoop nightlies
   * [wiki:Hbase/PerformanceEvaluation Tools for evaluating HBase performance and scalability]
   * [wiki:Hbase/RDF RDF]: Notes on HBase as an RDF store.
   * Hbase IRC channel is #hbase at irc.freenode.net.
  
+ [[Anchor(contributors)]]
  == Initial Contributors ==
  
    * Mike Cafarella (who wrote the initial code base)
    * JimKellerman [[MailTo(jim AT SPAMFREE powerset DOT com)]]
    * Michael Stack [[MailTo(stack AT SPAMFREE powerset DOT com)]]
  
+ [[Anchor(comments)]]
  == Comments ==
  
  Please add comments related to the project goals and process below.