You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@accumulo.apache.org by bi...@apache.org on 2011/11/01 17:23:43 UTC
svn commit: r1196099 [1/2] - in
/incubator/accumulo/site/trunk/content/accumulo: ./
user_manual_1.3-incubating/ user_manual_1.4-incubating/
Author: billie
Date: Tue Nov 1 16:23:42 2011
New Revision: 1196099
URL: http://svn.apache.org/viewvc?rev=1196099&view=rev
Log:
ACCUMULO-70 introduced navigation panels for manuals
Modified:
incubator/accumulo/site/trunk/content/accumulo/notable_features.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Accumulo_Design.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Accumulo_Shell.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Administration.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Analytics.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Contents.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/High_Speed_Ingest.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Introduction.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Security.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Shell_Commands.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Table_Configuration.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Table_Design.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Writing_Accumulo_Clients.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/accumulo_user_manual.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/index.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Accumulo_Design.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Accumulo_Shell.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Administration.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Analytics.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Contents.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/High_Speed_Ingest.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Introduction.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Security.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Shell_Commands.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Table_Configuration.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Table_Design.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Writing_Accumulo_Clients.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/accumulo_user_manual.mdtext
incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/index.mdtext
Modified: incubator/accumulo/site/trunk/content/accumulo/notable_features.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/notable_features.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/notable_features.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/notable_features.mdtext Tue Nov 1 16:23:42 2011
@@ -368,5 +368,5 @@ beginning and end of the range are split
[2]: /accumulo/user_manual_1.3-incubating/Security.html
[4]: /accumulo/user_manual_1.3-incubating/Writing_Accumulo_Clients.html
-[6]: /accumulo/user_manual_1.3-incubating/High_Speed_Ingest.html#SECTION00830000000000000000
+[6]: /accumulo/user_manual_1.3-incubating/High_Speed_Ingest.html#Bulk_Ingest
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Accumulo_Design.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Accumulo_Design.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Accumulo_Design.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Accumulo_Design.mdtext Tue Nov 1 16:23:42 2011
@@ -16,15 +16,17 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Next:** [Accumulo Shell][2] ** Up:** [Accumulo User Manual Version 1.3][4] ** Previous:** [Introduction][6] ** [Contents][8]**
+
<a id=CHILD_LINKS></a>**Subsections**
-* [Data Model][1]
-* [Architecture][2]
-* [Components][3]
-* [Data Management][4]
-* [Tablet Service][5]
-* [Compactions][6]
-* [Fault-Tolerance][7]
+* [Data Model][9]
+* [Architecture][10]
+* [Components][11]
+* [Data Management][12]
+* [Tablet Service][13]
+* [Compactions][14]
+* [Fault-Tolerance][15]
* * *
@@ -34,7 +36,7 @@ Notice: Licensed to the Apache Softwa
Accumulo provides a richer data model than simple key-value stores, but is not a fully relational database. Data is represented as key-value pairs, where the key and value are comprised of the following elements:
-![converted table][8]
+![converted table][16]
All elements of the Key and the Value are represented as byte arrays except for Timestamp, which is a Long. Accumulo sorts keys by element and lexicographically in ascending order. Timestamps are sorted in descending order so that later versions of the same Key appear first in a sequential scan. Tables consist of a set of sorted key-value pairs.
@@ -72,7 +74,7 @@ Accumulo includes a client library that
Accumulo stores data in tables, which are partitioned into tablets. Tablets are partitioned on row boundaries so that all of the columns and values for a particular row are found together within the same tablet. The Master assigns Tablets to one TabletServer at a time. This enables row-level transactions to take place without using distributed locking or some other complicated synchronization mechanism. As clients insert and query data, and as machines are added and removed from the cluster, the Master migrates tablets to ensure they remain available and that the ingest and query load is balanced across the cluster.
-![Image data_distribution][9]
+![Image data_distribution][17]
## <a id=Tablet_Service></a> Tablet Service
@@ -93,21 +95,24 @@ The Master will coordinate the copying o
TabletServer failures are noted on the Master's monitor page, accessible via
http://master-address:50095/monitor.
-![Image failure_handling][10]
-
-
-
+![Image failure_handling][18]
* * *
- [1]: Accumulo_Design.html#Data_Model
- [2]: Accumulo_Design.html#Architecture
- [3]: Accumulo_Design.html#Components
- [4]: Accumulo_Design.html#Data_Management
- [5]: Accumulo_Design.html#Tablet_Service
- [6]: Accumulo_Design.html#Compactions
- [7]: Accumulo_Design.html#Fault-Tolerance
- [8]: img1.png
- [9]: ./data_distribution.png
- [10]: ./failure_handling.png
+** Next:** [Accumulo Shell][2] ** Up:** [Accumulo User Manual Version 1.3][4] ** Previous:** [Introduction][6] ** [Contents][8]**
+
+ [2]: Accumulo_Shell.html
+ [4]: accumulo_user_manual.html
+ [6]: Introduction.html
+ [8]: Contents.html
+ [9]: Accumulo_Design.html#Data_Model
+ [10]: Accumulo_Design.html#Architecture
+ [11]: Accumulo_Design.html#Components
+ [12]: Accumulo_Design.html#Data_Management
+ [13]: Accumulo_Design.html#Tablet_Service
+ [14]: Accumulo_Design.html#Compactions
+ [15]: Accumulo_Design.html#Fault-Tolerance
+ [16]: img1.png
+ [17]: ./data_distribution.png
+ [18]: ./failure_handling.png
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Accumulo_Shell.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Accumulo_Shell.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Accumulo_Shell.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Accumulo_Shell.mdtext Tue Nov 1 16:23:42 2011
@@ -16,11 +16,13 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Next:** [Writing Accumulo Clients][2] ** Up:** [Accumulo User Manual Version 1.3][4] ** Previous:** [Accumulo Design][6] ** [Contents][8]**
+
<a id=CHILD_LINKS></a>**Subsections**
-* [Basic Administration][1]
-* [Table Maintenance][2]
-* [User Administration][3]
+* [Basic Administration][9]
+* [Table Maintenance][10]
+* [User Administration][11]
* * *
@@ -134,12 +136,15 @@ The Shell can be used to add, remove, an
root@myinstance bobstable> revoke System.CREATE_TABLE -s -u bob
-
-
-
* * *
- [1]: Accumulo_Shell.html#Basic_Administration
- [2]: Accumulo_Shell.html#Table_Maintenance
- [3]: Accumulo_Shell.html#User_Administration
+** Next:** [Writing Accumulo Clients][2] ** Up:** [Accumulo User Manual Version 1.3][4] ** Previous:** [Accumulo Design][6] ** [Contents][8]**
+
+ [2]: Writing_Accumulo_Clients.html
+ [4]: accumulo_user_manual.html
+ [6]: Accumulo_Design.html
+ [8]: Contents.html
+ [9]: Accumulo_Shell.html#Basic_Administration
+ [10]: Accumulo_Shell.html#Table_Maintenance
+ [11]: Accumulo_Shell.html#User_Administration
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Administration.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Administration.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Administration.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Administration.mdtext Tue Nov 1 16:23:42 2011
@@ -16,18 +16,20 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Next:** [Shell Commands][2] ** Up:** [Accumulo User Manual Version 1.3][4] ** Previous:** [Security][6] ** [Contents][8]**
+
<a id=CHILD_LINKS></a>**Subsections**
-* [Hardware][1]
-* [Network][2]
-* [Installation][3]
-* [Dependencies][4]
-* [Configuration][5]
-* [Initialization][6]
-* [Running][7]
-* [Monitoring][8]
-* [Logging][9]
-* [Recovery][10]
+* [Hardware][9]
+* [Network][10]
+* [Installation][11]
+* [Dependencies][12]
+* [Configuration][13]
+* [Initialization][14]
+* [Running][15]
+* [Monitoring][16]
+* [Logging][17]
+* [Recovery][18]
* * *
@@ -160,19 +162,22 @@ The Accumulo client library is configure
Note that because Accumulo uses timestamps to order mutations, any mutations that are applied as part of the recovery process should appear to have been applied when they originally arrived at the TabletServer that failed. This makes the ordering of mutations consistent in the presence of failure.
-
-
-
* * *
- [1]: Administration.html#Hardware
- [2]: Administration.html#Network
- [3]: Administration.html#Installation
- [4]: Administration.html#Dependencies
- [5]: Administration.html#Configuration
- [6]: Administration.html#Initialization
- [7]: Administration.html#Running
- [8]: Administration.html#Monitoring
- [9]: Administration.html#Logging
- [10]: Administration.html#Recovery
+** Next:** [Shell Commands][2] ** Up:** [Accumulo User Manual Version 1.3][4] ** Previous:** [Security][6] ** [Contents][8]**
+
+ [2]: Shell_Commands.html
+ [4]: accumulo_user_manual.html
+ [6]: Security.html
+ [8]: Contents.html
+ [9]: Administration.html#Hardware
+ [10]: Administration.html#Network
+ [11]: Administration.html#Installation
+ [12]: Administration.html#Dependencies
+ [13]: Administration.html#Configuration
+ [14]: Administration.html#Initialization
+ [15]: Administration.html#Running
+ [16]: Administration.html#Monitoring
+ [17]: Administration.html#Logging
+ [18]: Administration.html#Recovery
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Analytics.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Analytics.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Analytics.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Analytics.mdtext Tue Nov 1 16:23:42 2011
@@ -16,11 +16,13 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Next:** [Security][2] ** Up:** [Accumulo User Manual Version 1.3][4] ** Previous:** [High-Speed Ingest][6] ** [Contents][8]**
+
<a id=CHILD_LINKS></a>**Subsections**
-* [MapReduce][1]
-* [Aggregating Iterators][2]
-* [Statistical Modeling][3]
+* [MapReduce][9]
+* [Aggregating Iterators][10]
+* [Statistical Modeling][11]
* * *
@@ -148,12 +150,15 @@ Statistical models that need to be updat
Using Accumulo this way enables efficient and fast lookups and updates of small pieces of information in a random access pattern, which is complementary to MapReduce's sequential access model.
-
-
-
* * *
- [1]: Analytics.html#MapReduce
- [2]: Analytics.html#Aggregating_Iterators
- [3]: Analytics.html#Statistical_Modeling
+** Next:** [Security][2] ** Up:** [Accumulo User Manual Version 1.3][4] ** Previous:** [High-Speed Ingest][6] ** [Contents][8]**
+
+ [2]: Security.html
+ [4]: accumulo_user_manual.html
+ [6]: High_Speed_Ingest.html
+ [8]: Contents.html
+ [9]: Analytics.html#MapReduce
+ [10]: Analytics.html#Aggregating_Iterators
+ [11]: Analytics.html#Statistical_Modeling
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Contents.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Contents.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Contents.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Contents.mdtext Tue Nov 1 16:23:42 2011
@@ -16,232 +16,235 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Next:** [Introduction][2] ** Up:** [Accumulo User Manual Version 1.3][4] ** Previous:** [Accumulo User Manual Version 1.3][4]
+
### <a id=Contents></a> Contents
-* [Introduction][1]
-* [Accumulo Design][2]
+* [Introduction][2]
+* [Accumulo Design][6]
- * [Data Model][3]
- * [Architecture][4]
- * [Components][5]
+ * [Data Model][7]
+ * [Architecture][8]
+ * [Components][9]
- * [Tablet Server][6]
- * [Loggers][7]
- * [Garbage Collector][8]
- * [Master][9]
- * [Client][10]
+ * [Tablet Server][10]
+ * [Loggers][11]
+ * [Garbage Collector][12]
+ * [Master][13]
+ * [Client][14]
- * [Data Management][11]
- * [Tablet Service][12]
- * [Compactions][13]
- * [Fault-Tolerance][14]
+ * [Data Management][15]
+ * [Tablet Service][16]
+ * [Compactions][17]
+ * [Fault-Tolerance][18]
-* [Accumulo Shell][15]
+* [Accumulo Shell][19]
- * [Basic Administration][16]
- * [Table Maintenance][17]
- * [User Administration][18]
+ * [Basic Administration][20]
+ * [Table Maintenance][21]
+ * [User Administration][22]
-* [Writing Accumulo Clients][19]
+* [Writing Accumulo Clients][23]
- * [Writing Data][20]
+ * [Writing Data][24]
- * [BatchWriter][21]
+ * [BatchWriter][25]
- * [Reading Data][22]
+ * [Reading Data][26]
- * [Scanner][23]
- * [BatchScanner][24]
+ * [Scanner][27]
+ * [BatchScanner][28]
-* [Table Configuration][25]
+* [Table Configuration][29]
- * [Locality Groups][26]
+ * [Locality Groups][30]
- * [Managing Locality Groups via the Shell][27]
- * [Managing Locality Groups via the Client API][28]
+ * [Managing Locality Groups via the Shell][31]
+ * [Managing Locality Groups via the Client API][32]
- * [Constraints][29]
- * [Bloom Filters][30]
- * [Iterators][31]
+ * [Constraints][33]
+ * [Bloom Filters][34]
+ * [Iterators][35]
- * [Setting Iterators via the Shell][32]
- * [Setting Iterators Programmatically][33]
+ * [Setting Iterators via the Shell][36]
+ * [Setting Iterators Programmatically][37]
- * [Versioning Iterators and Timestamps][34]
+ * [Versioning Iterators and Timestamps][38]
- * [Logical Time][35]
- * [Deletes][36]
+ * [Logical Time][39]
+ * [Deletes][40]
- * [Filtering Iterators][37]
- * [Aggregating Iterators][38]
+ * [Filtering Iterators][41]
+ * [Aggregating Iterators][42]
-* [Table Design][39]
+* [Table Design][43]
- * [Basic Table][40]
- * [RowID Design][41]
- * [Indexing][42]
- * [Entity-Attribute and Graph Tables][43]
- * [Document-Partitioned Indexing][44]
+ * [Basic Table][44]
+ * [RowID Design][45]
+ * [Indexing][46]
+ * [Entity-Attribute and Graph Tables][47]
+ * [Document-Partitioned Indexing][48]
-* [High-Speed Ingest][45]
+* [High-Speed Ingest][49]
- * [Pre-Splitting New Tables][46]
- * [Multiple Ingester Clients][47]
- * [Bulk Ingest][48]
- * [MapReduce Ingest][49]
+ * [Pre-Splitting New Tables][50]
+ * [Multiple Ingester Clients][51]
+ * [Bulk Ingest][52]
+ * [MapReduce Ingest][53]
-* [Analytics][50]
+* [Analytics][54]
- * [MapReduce][51]
+ * [MapReduce][55]
- * [Mapper and Reducer classes][52]
- * [AccumuloInputFormat options][53]
- * [AccumuloOutputFormat options][54]
+ * [Mapper and Reducer classes][56]
+ * [AccumuloInputFormat options][57]
+ * [AccumuloOutputFormat options][58]
- * [Aggregating Iterators][55]
+ * [Aggregating Iterators][59]
- * [Feature Vectors][56]
+ * [Feature Vectors][60]
- * [Statistical Modeling][57]
+ * [Statistical Modeling][61]
-* [Security][58]
+* [Security][62]
- * [Security Label Expressions][59]
- * [Security Label Expression Syntax][60]
- * [Authorization][61]
- * [Secure Authorizations Handling][62]
- * [Query Services Layer][63]
+ * [Security Label Expressions][63]
+ * [Security Label Expression Syntax][64]
+ * [Authorization][65]
+ * [Secure Authorizations Handling][66]
+ * [Query Services Layer][67]
-* [Administration][64]
+* [Administration][68]
- * [Hardware][65]
- * [Network][66]
- * [Installation][67]
- * [Dependencies][68]
- * [Configuration][69]
+ * [Hardware][69]
+ * [Network][70]
+ * [Installation][71]
+ * [Dependencies][72]
+ * [Configuration][73]
- * [Edit conf/accumulo-env.sh][70]
- * [Cluster Specification][71]
- * [Accumulo Settings][72]
- * [Deploy Configuration][73]
+ * [Edit conf/accumulo-env.sh][74]
+ * [Cluster Specification][75]
+ * [Accumulo Settings][76]
+ * [Deploy Configuration][77]
- * [Initialization][74]
- * [Running][75]
+ * [Initialization][78]
+ * [Running][79]
- * [Starting Accumulo][76]
- * [Stopping Accumulo][77]
+ * [Starting Accumulo][80]
+ * [Stopping Accumulo][81]
- * [Monitoring][78]
- * [Logging][79]
- * [Recovery][80]
+ * [Monitoring][82]
+ * [Logging][83]
+ * [Recovery][84]
-* [Shell Commands][81]
+* [Shell Commands][85]
* * *
- [1]: Introduction.html
- [2]: Accumulo_Design.html
- [3]: Accumulo_Design.html#Data_Model
- [4]: Accumulo_Design.html#Architecture
- [5]: Accumulo_Design.html#Components
- [6]: Accumulo_Design.html#Tablet_Server
- [7]: Accumulo_Design.html#Loggers
- [8]: Accumulo_Design.html#Garbage_Collector
- [9]: Accumulo_Design.html#Master
- [10]: Accumulo_Design.html#Client
- [11]: Accumulo_Design.html#Data_Management
- [12]: Accumulo_Design.html#Tablet_Service
- [13]: Accumulo_Design.html#Compactions
- [14]: Accumulo_Design.html#Fault-Tolerance
- [15]: Accumulo_Shell.html
- [16]: Accumulo_Shell.html#Basic_Administration
- [17]: Accumulo_Shell.html#Table_Maintenance
- [18]: Accumulo_Shell.html#User_Administration
- [19]: Writing_Accumulo_Clients.html
- [20]: Writing_Accumulo_Clients.html#Writing_Data
- [21]: Writing_Accumulo_Clients.html#BatchWriter
- [22]: Writing_Accumulo_Clients.html#Reading_Data
- [23]: Writing_Accumulo_Clients.html#Scanner
- [24]: Writing_Accumulo_Clients.html#BatchScanner
- [25]: Table_Configuration.html
- [26]: Table_Configuration.html#Locality_Groups
- [27]: Table_Configuration.html#Managing_Locality_Groups_via_the_Shell
- [28]: Table_Configuration.html#Managing_Locality_Groups_via_the_Client_API
- [29]: Table_Configuration.html#Constraints
- [30]: Table_Configuration.html#Bloom_Filters
- [31]: Table_Configuration.html#Iterators
- [32]: Table_Configuration.html#Setting_Iterators_via_the_Shell
- [33]: Table_Configuration.html#Setting_Iterators_Programmatically
- [34]: Table_Configuration.html#Versioning_Iterators_and_Timestamps
- [35]: Table_Configuration.html#Logical_Time
- [36]: Table_Configuration.html#Deletes
- [37]: Table_Configuration.html#Filtering_Iterators
- [38]: Table_Configuration.html#Aggregating_Iterators
- [39]: Table_Design.html
- [40]: Table_Design.html#Basic_Table
- [41]: Table_Design.html#RowID_Design
- [42]: Table_Design.html#Indexing
- [43]: Table_Design.html#Entity-Attribute_and_Graph_Tables
- [44]: Table_Design.html#Document-Partitioned_Indexing
- [45]: High_Speed_Ingest.html
- [46]: High_Speed_Ingest.html#Pre-Splitting_New_Tables
- [47]: High_Speed_Ingest.html#Multiple_Ingester_Clients
- [48]: High_Speed_Ingest.html#Bulk_Ingest
- [49]: High_Speed_Ingest.html#MapReduce_Ingest
- [50]: Analytics.html
- [51]: Analytics.html#MapReduce
- [52]: Analytics.html#Mapper_and_Reducer_classes
- [53]: Analytics.html#AccumuloInputFormat_options
- [54]: Analytics.html#AccumuloOutputFormat_options
- [55]: Analytics.html#Aggregating_Iterators
- [56]: Analytics.html#Feature_Vectors
- [57]: Analytics.html#Statistical_Modeling
- [58]: Security.html
- [59]: Security.html#Security_Label_Expressions
- [60]: Security.html#Security_Label_Expression_Syntax
- [61]: Security.html#Authorization
- [62]: Security.html#Secure_Authorizations_Handling
- [63]: Security.html#Query_Services_Layer
- [64]: Administration.html
- [65]: Administration.html#Hardware
- [66]: Administration.html#Network
- [67]: Administration.html#Installation
- [68]: Administration.html#Dependencies
- [69]: Administration.html#Configuration
- [70]: Administration.html#Edit_conf/accumulo-env.sh
- [71]: Administration.html#Cluster_Specification
- [72]: Administration.html#Accumulo_Settings
- [73]: Administration.html#Deploy_Configuration
- [74]: Administration.html#Initialization
- [75]: Administration.html#Running
- [76]: Administration.html#Starting_Accumulo
- [77]: Administration.html#Stopping_Accumulo
- [78]: Administration.html#Monitoring
- [79]: Administration.html#Logging
- [80]: Administration.html#Recovery
- [81]: Shell_Commands.html
+ [2]: Introduction.html
+ [4]: accumulo_user_manual.html
+ [6]: Accumulo_Design.html
+ [7]: Accumulo_Design.html#Data_Model
+ [8]: Accumulo_Design.html#Architecture
+ [9]: Accumulo_Design.html#Components
+ [10]: Accumulo_Design.html#Tablet_Server
+ [11]: Accumulo_Design.html#Loggers
+ [12]: Accumulo_Design.html#Garbage_Collector
+ [13]: Accumulo_Design.html#Master
+ [14]: Accumulo_Design.html#Client
+ [15]: Accumulo_Design.html#Data_Management
+ [16]: Accumulo_Design.html#Tablet_Service
+ [17]: Accumulo_Design.html#Compactions
+ [18]: Accumulo_Design.html#Fault-Tolerance
+ [19]: Accumulo_Shell.html
+ [20]: Accumulo_Shell.html#Basic_Administration
+ [21]: Accumulo_Shell.html#Table_Maintenance
+ [22]: Accumulo_Shell.html#User_Administration
+ [23]: Writing_Accumulo_Clients.html
+ [24]: Writing_Accumulo_Clients.html#Writing_Data
+ [25]: Writing_Accumulo_Clients.html#BatchWriter
+ [26]: Writing_Accumulo_Clients.html#Reading_Data
+ [27]: Writing_Accumulo_Clients.html#Scanner
+ [28]: Writing_Accumulo_Clients.html#BatchScanner
+ [29]: Table_Configuration.html
+ [30]: Table_Configuration.html#Locality_Groups
+ [31]: Table_Configuration.html#Managing_Locality_Groups_via_the_Shell
+ [32]: Table_Configuration.html#Managing_Locality_Groups_via_the_Client_API
+ [33]: Table_Configuration.html#Constraints
+ [34]: Table_Configuration.html#Bloom_Filters
+ [35]: Table_Configuration.html#Iterators
+ [36]: Table_Configuration.html#Setting_Iterators_via_the_Shell
+ [37]: Table_Configuration.html#Setting_Iterators_Programmatically
+ [38]: Table_Configuration.html#Versioning_Iterators_and_Timestamps
+ [39]: Table_Configuration.html#Logical_Time
+ [40]: Table_Configuration.html#Deletes
+ [41]: Table_Configuration.html#Filtering_Iterators
+ [42]: Table_Configuration.html#Aggregating_Iterators
+ [43]: Table_Design.html
+ [44]: Table_Design.html#Basic_Table
+ [45]: Table_Design.html#RowID_Design
+ [46]: Table_Design.html#Indexing
+ [47]: Table_Design.html#Entity-Attribute_and_Graph_Tables
+ [48]: Table_Design.html#Document-Partitioned_Indexing
+ [49]: High_Speed_Ingest.html
+ [50]: High_Speed_Ingest.html#Pre-Splitting_New_Tables
+ [51]: High_Speed_Ingest.html#Multiple_Ingester_Clients
+ [52]: High_Speed_Ingest.html#Bulk_Ingest
+ [53]: High_Speed_Ingest.html#MapReduce_Ingest
+ [54]: Analytics.html
+ [55]: Analytics.html#MapReduce
+ [56]: Analytics.html#Mapper_and_Reducer_classes
+ [57]: Analytics.html#AccumuloInputFormat_options
+ [58]: Analytics.html#AccumuloOutputFormat_options
+ [59]: Analytics.html#Aggregating_Iterators
+ [60]: Analytics.html#Feature_Vectors
+ [61]: Analytics.html#Statistical_Modeling
+ [62]: Security.html
+ [63]: Security.html#Security_Label_Expressions
+ [64]: Security.html#Security_Label_Expression_Syntax
+ [65]: Security.html#Authorization
+ [66]: Security.html#Secure_Authorizations_Handling
+ [67]: Security.html#Query_Services_Layer
+ [68]: Administration.html
+ [69]: Administration.html#Hardware
+ [70]: Administration.html#Network
+ [71]: Administration.html#Installation
+ [72]: Administration.html#Dependencies
+ [73]: Administration.html#Configuration
+ [74]: Administration.html#Edit_conf/accumulo-env.sh
+ [75]: Administration.html#Cluster_Specification
+ [76]: Administration.html#Accumulo_Settings
+ [77]: Administration.html#Deploy_Configuration
+ [78]: Administration.html#Initialization
+ [79]: Administration.html#Running
+ [80]: Administration.html#Starting_Accumulo
+ [81]: Administration.html#Stopping_Accumulo
+ [82]: Administration.html#Monitoring
+ [83]: Administration.html#Logging
+ [84]: Administration.html#Recovery
+ [85]: Shell_Commands.html
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/High_Speed_Ingest.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/High_Speed_Ingest.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/High_Speed_Ingest.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/High_Speed_Ingest.mdtext Tue Nov 1 16:23:42 2011
@@ -16,12 +16,14 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Next:** [Analytics][2] ** Up:** [Accumulo User Manual Version 1.3][4] ** Previous:** [Table Design][6] ** [Contents][8]**
+
<a id=CHILD_LINKS></a>**Subsections**
-* [Pre-Splitting New Tables][1]
-* [Multiple Ingester Clients][2]
-* [Bulk Ingest][3]
-* [MapReduce Ingest][4]
+* [Pre-Splitting New Tables][9]
+* [Multiple Ingester Clients][10]
+* [Bulk Ingest][11]
+* [MapReduce Ingest][12]
* * *
@@ -82,13 +84,16 @@ It is possible to efficiently write many
An example of using MapReduce can be found under
accumulo/docs/examples/README.mapred
-
-
-
* * *
- [1]: High_Speed_Ingest.html#Pre-Splitting_New_Tables
- [2]: High_Speed_Ingest.html#Multiple_Ingester_Clients
- [3]: High_Speed_Ingest.html#Bulk_Ingest
- [4]: High_Speed_Ingest.html#MapReduce_Ingest
+** Next:** [Analytics][2] ** Up:** [Accumulo User Manual Version 1.3][4] ** Previous:** [Table Design][6] ** [Contents][8]**
+
+ [2]: Analytics.html
+ [4]: accumulo_user_manual.html
+ [6]: Table_Design.html
+ [8]: Contents.html
+ [9]: High_Speed_Ingest.html#Pre-Splitting_New_Tables
+ [10]: High_Speed_Ingest.html#Multiple_Ingester_Clients
+ [11]: High_Speed_Ingest.html#Bulk_Ingest
+ [12]: High_Speed_Ingest.html#MapReduce_Ingest
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Introduction.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Introduction.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Introduction.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Introduction.mdtext Tue Nov 1 16:23:42 2011
@@ -16,6 +16,10 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Next:** [Accumulo Design][2] ** Up:** [Accumulo User Manual Version 1.3][4] ** Previous:** [Contents][6] ** [Contents][6]**
+
+
+
## <a id=Introduction></a> Introduction
Accumulo is a highly scalable structured store based on Google's BigTable. Accumulo is written in Java and operates over the Hadoop Distributed File System (HDFS), which is part of the popular Apache Hadoop project. Accumulo supports efficient storage and retrieval of structured data, including queries for ranges, and provides support for using Accumulo tables as input and output for MapReduce jobs.
@@ -26,3 +30,8 @@ Accumulo features automatic load-balanci
* * *
+
+ [2]: Accumulo_Design.html
+ [4]: accumulo_user_manual.html
+ [6]: Contents.html
+
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Security.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Security.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Security.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Security.mdtext Tue Nov 1 16:23:42 2011
@@ -16,13 +16,15 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Next:** [Administration][2] ** Up:** [Accumulo User Manual Version 1.3][4] ** Previous:** [Analytics][6] ** [Contents][8]**
+
<a id=CHILD_LINKS></a>**Subsections**
-* [Security Label Expressions][1]
-* [Security Label Expression Syntax][2]
-* [Authorization][3]
-* [Secure Authorizations Handling][4]
-* [Query Services Layer][5]
+* [Security Label Expressions][9]
+* [Security Label Expression Syntax][10]
+* [Authorization][11]
+* [Secure Authorizations Handling][12]
+* [Query Services Layer][13]
* * *
@@ -104,14 +106,17 @@ Several production environments choose t
Typically, the query services layer sits between Accumulo and user workstations.
-
-
-
* * *
- [1]: Security.html#Security_Label_Expressions
- [2]: Security.html#Security_Label_Expression_Syntax
- [3]: Security.html#Authorization
- [4]: Security.html#Secure_Authorizations_Handling
- [5]: Security.html#Query_Services_Layer
+** Next:** [Administration][2] ** Up:** [Accumulo User Manual Version 1.3][4] ** Previous:** [Analytics][6] ** [Contents][8]**
+
+ [2]: Administration.html
+ [4]: accumulo_user_manual.html
+ [6]: Analytics.html
+ [8]: Contents.html
+ [9]: Security.html#Security_Label_Expressions
+ [10]: Security.html#Security_Label_Expression_Syntax
+ [11]: Security.html#Authorization
+ [12]: Security.html#Secure_Authorizations_Handling
+ [13]: Security.html#Query_Services_Layer
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Shell_Commands.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Shell_Commands.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Shell_Commands.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Shell_Commands.mdtext Tue Nov 1 16:23:42 2011
@@ -16,6 +16,10 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Up:** [Accumulo User Manual Version 1.3][3] ** Previous:** [Administration][5] ** [Contents][7]**
+
+
+
## <a id=Shell_Commands></a> Shell Commands
**?**
@@ -534,7 +538,11 @@ Notice: Licensed to the Apache Softwa
-
+* * *
+** Up:** [Accumulo User Manual Version 1.3][3] ** Previous:** [Administration][5] ** [Contents][7]**
+
+ [3]: accumulo_user_manual.html
+ [5]: Administration.html
+ [7]: Contents.html
-* * *
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Table_Configuration.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Table_Configuration.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Table_Configuration.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Table_Configuration.mdtext Tue Nov 1 16:23:42 2011
@@ -16,15 +16,17 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Next:** [Table Design][2] ** Up:** [Accumulo User Manual Version 1.3][4] ** Previous:** [Writing Accumulo Clients][6] ** [Contents][8]**
+
<a id=CHILD_LINKS></a>**Subsections**
-* [Locality Groups][1]
-* [Constraints][2]
-* [Bloom Filters][3]
-* [Iterators][4]
-* [Versioning Iterators and Timestamps][5]
-* [Filtering Iterators][6]
-* [Aggregating Iterators][7]
+* [Locality Groups][9]
+* [Constraints][10]
+* [Bloom Filters][11]
+* [Iterators][12]
+* [Versioning Iterators and Timestamps][13]
+* [Filtering Iterators][14]
+* [Aggregating Iterators][15]
* * *
@@ -306,16 +308,19 @@ Additional Aggregators can be added by c
An example of an aggregator can be found under
accumulo/src/examples/main/java/accumulo/examples/aggregation/SortedSetAggregator.java
-
-
-
* * *
- [1]: Table_Configuration.html#Locality_Groups
- [2]: Table_Configuration.html#Constraints
- [3]: Table_Configuration.html#Bloom_Filters
- [4]: Table_Configuration.html#Iterators
- [5]: Table_Configuration.html#Versioning_Iterators_and_Timestamps
- [6]: Table_Configuration.html#Filtering_Iterators
- [7]: Table_Configuration.html#Aggregating_Iterators
+** Next:** [Table Design][2] ** Up:** [Accumulo User Manual Version 1.3][4] ** Previous:** [Writing Accumulo Clients][6] ** [Contents][8]**
+
+ [2]: Table_Design.html
+ [4]: accumulo_user_manual.html
+ [6]: Writing_Accumulo_Clients.html
+ [8]: Contents.html
+ [9]: Table_Configuration.html#Locality_Groups
+ [10]: Table_Configuration.html#Constraints
+ [11]: Table_Configuration.html#Bloom_Filters
+ [12]: Table_Configuration.html#Iterators
+ [13]: Table_Configuration.html#Versioning_Iterators_and_Timestamps
+ [14]: Table_Configuration.html#Filtering_Iterators
+ [15]: Table_Configuration.html#Aggregating_Iterators
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Table_Design.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Table_Design.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Table_Design.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Table_Design.mdtext Tue Nov 1 16:23:42 2011
@@ -16,13 +16,15 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Next:** [High-Speed Ingest][2] ** Up:** [Accumulo User Manual Version 1.3][4] ** Previous:** [Table Configuration][6] ** [Contents][8]**
+
<a id=CHILD_LINKS></a>**Subsections**
-* [Basic Table][1]
-* [RowID Design][2]
-* [Indexing][3]
-* [Entity-Attribute and Graph Tables][4]
-* [Document-Partitioned Indexing][5]
+* [Basic Table][9]
+* [RowID Design][10]
+* [Indexing][11]
+* [Entity-Attribute and Graph Tables][12]
+* [Document-Partitioned Indexing][13]
* * *
@@ -99,7 +101,7 @@ Appending dates provides the additional
In order to support lookups via more than one attribute of an entity, additional indexes can be built. However, because Accumulo tables can support any number of columns without specifying them beforehand, a single additional index will often suffice for supporting lookups of records in the main table. Here, the index has, as the rowID, the Value or Term from the main table, the column families are the same, and the column qualifier of the index table contains the rowID from the main table.
-![converted table][6]
+![converted table][14]
Note: We store rowIDs in the column qualifier rather than the Value so that we can have more than one rowID associated with a particular term within the index. If we stored this in the Value we would only see one of the rows in which the value appears since Accumulo is configured by default to return the one most recent value associated with a key.
@@ -141,11 +143,11 @@ Rather than storing individual events, E
The physical shema for an entity-attribute or graph table is as follows:
-![converted table][7]
+![converted table][15]
For example, to keep track of employees, managers and products the following entity-attribute table could be used. Note that the weights are not always necessary and are set to 0 when not used.
-![converted table][8]
+![converted table][16]
@@ -161,7 +163,7 @@ For these reasons Accumulo includes supp
This is accomplished via partitioning records into bins that each reside on at most one TabletServer, and then creating an index of terms per record within each bin as follows:
-![converted table][9]
+![converted table][17]
Documents or records are mapped into bins by a user-defined ingest application. By storing the BinID as the RowID we ensure that all the information for a particular bin is contained in a single tablet and hosted on a single TabletServer since Accumulo never splits rows across tablets. Storing the Terms as column families serves to enable fast lookups of all the documents within this bin that contain the given term.
@@ -189,18 +191,21 @@ This code effectively has the BatchScann
Of course, fast servers will return their results to the client which can display them to the user immediately while they wait for the rest of the results to arrive. If the results are unordered this is quite effective as the first results to arrive are as good as any others to the user.
-
-
-
* * *
- [1]: Table_Design.html#Basic_Table
- [2]: Table_Design.html#RowID_Design
- [3]: Table_Design.html#Indexing
- [4]: Table_Design.html#Entity-Attribute_and_Graph_Tables
- [5]: Table_Design.html#Document-Partitioned_Indexing
- [6]: img2.png
- [7]: img3.png
- [8]: img4.png
- [9]: img5.png
+** Next:** [High-Speed Ingest][2] ** Up:** [Accumulo User Manual Version 1.3][4] ** Previous:** [Table Configuration][6] ** [Contents][8]**
+
+ [2]: High_Speed_Ingest.html
+ [4]: accumulo_user_manual.html
+ [6]: Table_Configuration.html
+ [8]: Contents.html
+ [9]: Table_Design.html#Basic_Table
+ [10]: Table_Design.html#RowID_Design
+ [11]: Table_Design.html#Indexing
+ [12]: Table_Design.html#Entity-Attribute_and_Graph_Tables
+ [13]: Table_Design.html#Document-Partitioned_Indexing
+ [14]: img2.png
+ [15]: img3.png
+ [16]: img4.png
+ [17]: img5.png
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Writing_Accumulo_Clients.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Writing_Accumulo_Clients.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Writing_Accumulo_Clients.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/Writing_Accumulo_Clients.mdtext Tue Nov 1 16:23:42 2011
@@ -16,10 +16,12 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Next:** [Table Configuration][2] ** Up:** [Accumulo User Manual Version 1.3][4] ** Previous:** [Accumulo Shell][6] ** [Contents][8]**
+
<a id=CHILD_LINKS></a>**Subsections**
-* [Writing Data][1]
-* [Reading Data][2]
+* [Writing Data][9]
+* [Reading Data][10]
* * *
@@ -123,11 +125,14 @@ The BatchScanner is configured similarly
An example of the BatchScanner can be found at
accumulo/docs/examples/README.batch
-
-
-
* * *
- [1]: Writing_Accumulo_Clients.html#Writing_Data
- [2]: Writing_Accumulo_Clients.html#Reading_Data
+** Next:** [Table Configuration][2] ** Up:** [Accumulo User Manual Version 1.3][4] ** Previous:** [Accumulo Shell][6] ** [Contents][8]**
+
+ [2]: Table_Configuration.html
+ [4]: accumulo_user_manual.html
+ [6]: Accumulo_Shell.html
+ [8]: Contents.html
+ [9]: Writing_Accumulo_Clients.html#Writing_Data
+ [10]: Writing_Accumulo_Clients.html#Reading_Data
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/accumulo_user_manual.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/accumulo_user_manual.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/accumulo_user_manual.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/accumulo_user_manual.mdtext Tue Nov 1 16:23:42 2011
@@ -1,4 +1,4 @@
-Title: Accumulo User Manual: accumulo user manual
+Title: Accumulo User Manual: index
Notice: Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
@@ -16,6 +16,10 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Next:** [Contents][2] ** [Contents][2]**
+
+
+
Version 1.3
@@ -26,34 +30,34 @@ Version 1.3
<a id=CHILD_LINKS></a>
-* [Contents][1]
-* [Introduction][2]
-* [Accumulo Design][3]
-* [Accumulo Shell][4]
-* [Writing Accumulo Clients][5]
-* [Table Configuration][6]
-* [Table Design][7]
-* [High-Speed Ingest][8]
-* [Analytics][9]
-* [Security][10]
-* [Administration][11]
-* [Shell Commands][12]
+* [Contents][2]
+* [Introduction][6]
+* [Accumulo Design][7]
+* [Accumulo Shell][8]
+* [Writing Accumulo Clients][9]
+* [Table Configuration][10]
+* [Table Design][11]
+* [High-Speed Ingest][12]
+* [Analytics][13]
+* [Security][14]
+* [Administration][15]
+* [Shell Commands][16]
* * *
- [1]: Contents.html
- [2]: Introduction.html
- [3]: Accumulo_Design.html
- [4]: Accumulo_Shell.html
- [5]: Writing_Accumulo_Clients.html
- [6]: Table_Configuration.html
- [7]: Table_Design.html
- [8]: High_Speed_Ingest.html
- [9]: Analytics.html
- [10]: Security.html
- [11]: Administration.html
- [12]: Shell_Commands.html
+ [2]: Contents.html
+ [6]: Introduction.html
+ [7]: Accumulo_Design.html
+ [8]: Accumulo_Shell.html
+ [9]: Writing_Accumulo_Clients.html
+ [10]: Table_Configuration.html
+ [11]: Table_Design.html
+ [12]: High_Speed_Ingest.html
+ [13]: Analytics.html
+ [14]: Security.html
+ [15]: Administration.html
+ [16]: Shell_Commands.html
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/index.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/index.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/index.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.3-incubating/index.mdtext Tue Nov 1 16:23:42 2011
@@ -16,6 +16,10 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Next:** [Contents][2] ** [Contents][2]**
+
+
+
Version 1.3
@@ -26,34 +30,34 @@ Version 1.3
<a id=CHILD_LINKS></a>
-* [Contents][1]
-* [Introduction][2]
-* [Accumulo Design][3]
-* [Accumulo Shell][4]
-* [Writing Accumulo Clients][5]
-* [Table Configuration][6]
-* [Table Design][7]
-* [High-Speed Ingest][8]
-* [Analytics][9]
-* [Security][10]
-* [Administration][11]
-* [Shell Commands][12]
+* [Contents][2]
+* [Introduction][6]
+* [Accumulo Design][7]
+* [Accumulo Shell][8]
+* [Writing Accumulo Clients][9]
+* [Table Configuration][10]
+* [Table Design][11]
+* [High-Speed Ingest][12]
+* [Analytics][13]
+* [Security][14]
+* [Administration][15]
+* [Shell Commands][16]
* * *
- [1]: Contents.html
- [2]: Introduction.html
- [3]: Accumulo_Design.html
- [4]: Accumulo_Shell.html
- [5]: Writing_Accumulo_Clients.html
- [6]: Table_Configuration.html
- [7]: Table_Design.html
- [8]: High_Speed_Ingest.html
- [9]: Analytics.html
- [10]: Security.html
- [11]: Administration.html
- [12]: Shell_Commands.html
+ [2]: Contents.html
+ [6]: Introduction.html
+ [7]: Accumulo_Design.html
+ [8]: Accumulo_Shell.html
+ [9]: Writing_Accumulo_Clients.html
+ [10]: Table_Configuration.html
+ [11]: Table_Design.html
+ [12]: High_Speed_Ingest.html
+ [13]: Analytics.html
+ [14]: Security.html
+ [15]: Administration.html
+ [16]: Shell_Commands.html
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Accumulo_Design.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Accumulo_Design.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Accumulo_Design.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Accumulo_Design.mdtext Tue Nov 1 16:23:42 2011
@@ -16,15 +16,17 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Next:** [Accumulo Shell][2] ** Up:** [Accumulo User Manual Version 1.4][4] ** Previous:** [Introduction][6] ** [Contents][8]**
+
<a id=CHILD_LINKS></a>**Subsections**
-* [Data Model][1]
-* [Architecture][2]
-* [Components][3]
-* [Data Management][4]
-* [Tablet Service][5]
-* [Compactions][6]
-* [Fault-Tolerance][7]
+* [Data Model][9]
+* [Architecture][10]
+* [Components][11]
+* [Data Management][12]
+* [Tablet Service][13]
+* [Compactions][14]
+* [Fault-Tolerance][15]
* * *
@@ -34,7 +36,7 @@ Notice: Licensed to the Apache Softwa
Accumulo provides a richer data model than simple key-value stores, but is not a fully relational database. Data is represented as key-value pairs, where the key and value are comprised of the following elements:
-![converted table][8]
+![converted table][16]
All elements of the Key and the Value are represented as byte arrays except for Timestamp, which is a Long. Accumulo sorts keys by element and lexicographically in ascending order. Timestamps are sorted in descending order so that later versions of the same Key appear first in a sequential scan. Tables consist of a set of sorted key-value pairs.
@@ -72,7 +74,7 @@ Accumulo includes a client library that
Accumulo stores data in tables, which are partitioned into tablets. Tablets are partitioned on row boundaries so that all of the columns and values for a particular row are found together within the same tablet. The Master assigns Tablets to one TabletServer at a time. This enables row-level transactions to take place without using distributed locking or some other complicated synchronization mechanism. As clients insert and query data, and as machines are added and removed from the cluster, the Master migrates tablets to ensure they remain available and that the ingest and query load is balanced across the cluster.
-![Image data_distribution][9]
+![Image data_distribution][17]
## <a id=Tablet_Service></a> Tablet Service
@@ -93,21 +95,24 @@ The Master will coordinate the copying o
TabletServer failures are noted on the Master's monitor page, accessible via
http://master-address:50095/monitor.
-![Image failure_handling][10]
-
-
-
+![Image failure_handling][18]
* * *
- [1]: Accumulo_Design.html#Data_Model
- [2]: Accumulo_Design.html#Architecture
- [3]: Accumulo_Design.html#Components
- [4]: Accumulo_Design.html#Data_Management
- [5]: Accumulo_Design.html#Tablet_Service
- [6]: Accumulo_Design.html#Compactions
- [7]: Accumulo_Design.html#Fault-Tolerance
- [8]: img1.png
- [9]: ./data_distribution.png
- [10]: ./failure_handling.png
+** Next:** [Accumulo Shell][2] ** Up:** [Accumulo User Manual Version 1.4][4] ** Previous:** [Introduction][6] ** [Contents][8]**
+
+ [2]: Accumulo_Shell.html
+ [4]: accumulo_user_manual.html
+ [6]: Introduction.html
+ [8]: Contents.html
+ [9]: Accumulo_Design.html#Data_Model
+ [10]: Accumulo_Design.html#Architecture
+ [11]: Accumulo_Design.html#Components
+ [12]: Accumulo_Design.html#Data_Management
+ [13]: Accumulo_Design.html#Tablet_Service
+ [14]: Accumulo_Design.html#Compactions
+ [15]: Accumulo_Design.html#Fault-Tolerance
+ [16]: img1.png
+ [17]: ./data_distribution.png
+ [18]: ./failure_handling.png
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Accumulo_Shell.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Accumulo_Shell.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Accumulo_Shell.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Accumulo_Shell.mdtext Tue Nov 1 16:23:42 2011
@@ -16,11 +16,13 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Next:** [Writing Accumulo Clients][2] ** Up:** [Accumulo User Manual Version 1.4][4] ** Previous:** [Accumulo Design][6] ** [Contents][8]**
+
<a id=CHILD_LINKS></a>**Subsections**
-* [Basic Administration][1]
-* [Table Maintenance][2]
-* [User Administration][3]
+* [Basic Administration][9]
+* [Table Maintenance][10]
+* [User Administration][11]
* * *
@@ -134,12 +136,15 @@ The Shell can be used to add, remove, an
root@myinstance bobstable> revoke System.CREATE_TABLE -s -u bob
-
-
-
* * *
- [1]: Accumulo_Shell.html#Basic_Administration
- [2]: Accumulo_Shell.html#Table_Maintenance
- [3]: Accumulo_Shell.html#User_Administration
+** Next:** [Writing Accumulo Clients][2] ** Up:** [Accumulo User Manual Version 1.4][4] ** Previous:** [Accumulo Design][6] ** [Contents][8]**
+
+ [2]: Writing_Accumulo_Clients.html
+ [4]: accumulo_user_manual.html
+ [6]: Accumulo_Design.html
+ [8]: Contents.html
+ [9]: Accumulo_Shell.html#Basic_Administration
+ [10]: Accumulo_Shell.html#Table_Maintenance
+ [11]: Accumulo_Shell.html#User_Administration
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Administration.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Administration.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Administration.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Administration.mdtext Tue Nov 1 16:23:42 2011
@@ -16,18 +16,20 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Next:** [Shell Commands][2] ** Up:** [Accumulo User Manual Version 1.4][4] ** Previous:** [Security][6] ** [Contents][8]**
+
<a id=CHILD_LINKS></a>**Subsections**
-* [Hardware][1]
-* [Network][2]
-* [Installation][3]
-* [Dependencies][4]
-* [Configuration][5]
-* [Initialization][6]
-* [Running][7]
-* [Monitoring][8]
-* [Logging][9]
-* [Recovery][10]
+* [Hardware][9]
+* [Network][10]
+* [Installation][11]
+* [Dependencies][12]
+* [Configuration][13]
+* [Initialization][14]
+* [Running][15]
+* [Monitoring][16]
+* [Logging][17]
+* [Recovery][18]
* * *
@@ -160,19 +162,22 @@ The Accumulo client library is configure
Note that because Accumulo uses timestamps to order mutations, any mutations that are applied as part of the recovery process should appear to have been applied when they originally arrived at the TabletServer that failed. This makes the ordering of mutations consistent in the presence of failure.
-
-
-
* * *
- [1]: Administration.html#Hardware
- [2]: Administration.html#Network
- [3]: Administration.html#Installation
- [4]: Administration.html#Dependencies
- [5]: Administration.html#Configuration
- [6]: Administration.html#Initialization
- [7]: Administration.html#Running
- [8]: Administration.html#Monitoring
- [9]: Administration.html#Logging
- [10]: Administration.html#Recovery
+** Next:** [Shell Commands][2] ** Up:** [Accumulo User Manual Version 1.4][4] ** Previous:** [Security][6] ** [Contents][8]**
+
+ [2]: Shell_Commands.html
+ [4]: accumulo_user_manual.html
+ [6]: Security.html
+ [8]: Contents.html
+ [9]: Administration.html#Hardware
+ [10]: Administration.html#Network
+ [11]: Administration.html#Installation
+ [12]: Administration.html#Dependencies
+ [13]: Administration.html#Configuration
+ [14]: Administration.html#Initialization
+ [15]: Administration.html#Running
+ [16]: Administration.html#Monitoring
+ [17]: Administration.html#Logging
+ [18]: Administration.html#Recovery
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Analytics.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Analytics.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Analytics.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Analytics.mdtext Tue Nov 1 16:23:42 2011
@@ -16,11 +16,13 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Next:** [Security][2] ** Up:** [Accumulo User Manual Version 1.4][4] ** Previous:** [High-Speed Ingest][6] ** [Contents][8]**
+
<a id=CHILD_LINKS></a>**Subsections**
-* [MapReduce][1]
-* [Aggregating Iterators][2]
-* [Statistical Modeling][3]
+* [MapReduce][9]
+* [Aggregating Iterators][10]
+* [Statistical Modeling][11]
* * *
@@ -148,12 +150,15 @@ Statistical models that need to be updat
Using Accumulo this way enables efficient and fast lookups and updates of small pieces of information in a random access pattern, which is complementary to MapReduce's sequential access model.
-
-
-
* * *
- [1]: Analytics.html#MapReduce
- [2]: Analytics.html#Aggregating_Iterators
- [3]: Analytics.html#Statistical_Modeling
+** Next:** [Security][2] ** Up:** [Accumulo User Manual Version 1.4][4] ** Previous:** [High-Speed Ingest][6] ** [Contents][8]**
+
+ [2]: Security.html
+ [4]: accumulo_user_manual.html
+ [6]: High_Speed_Ingest.html
+ [8]: Contents.html
+ [9]: Analytics.html#MapReduce
+ [10]: Analytics.html#Aggregating_Iterators
+ [11]: Analytics.html#Statistical_Modeling
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Contents.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Contents.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Contents.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Contents.mdtext Tue Nov 1 16:23:42 2011
@@ -16,246 +16,249 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Next:** [Introduction][2] ** Up:** [Accumulo User Manual Version 1.4][4] ** Previous:** [Accumulo User Manual Version 1.4][4]
+
### <a id=Contents></a> Contents
-* [Introduction][1]
-* [Accumulo Design][2]
+* [Introduction][2]
+* [Accumulo Design][6]
- * [Data Model][3]
- * [Architecture][4]
- * [Components][5]
+ * [Data Model][7]
+ * [Architecture][8]
+ * [Components][9]
- * [Tablet Server][6]
- * [Loggers][7]
- * [Garbage Collector][8]
- * [Master][9]
- * [Client][10]
+ * [Tablet Server][10]
+ * [Loggers][11]
+ * [Garbage Collector][12]
+ * [Master][13]
+ * [Client][14]
- * [Data Management][11]
- * [Tablet Service][12]
- * [Compactions][13]
- * [Fault-Tolerance][14]
+ * [Data Management][15]
+ * [Tablet Service][16]
+ * [Compactions][17]
+ * [Fault-Tolerance][18]
-* [Accumulo Shell][15]
+* [Accumulo Shell][19]
- * [Basic Administration][16]
- * [Table Maintenance][17]
- * [User Administration][18]
+ * [Basic Administration][20]
+ * [Table Maintenance][21]
+ * [User Administration][22]
-* [Writing Accumulo Clients][19]
+* [Writing Accumulo Clients][23]
- * [Writing Data][20]
+ * [Writing Data][24]
- * [BatchWriter][21]
+ * [BatchWriter][25]
- * [Reading Data][22]
+ * [Reading Data][26]
- * [Scanner][23]
- * [Isolated Scanner][24]
- * [BatchScanner][25]
+ * [Scanner][27]
+ * [Isolated Scanner][28]
+ * [BatchScanner][29]
-* [Table Configuration][26]
+* [Table Configuration][30]
- * [Locality Groups][27]
+ * [Locality Groups][31]
- * [Managing Locality Groups via the Shell][28]
- * [Managing Locality Groups via the Client API][29]
+ * [Managing Locality Groups via the Shell][32]
+ * [Managing Locality Groups via the Client API][33]
- * [Constraints][30]
- * [Bloom Filters][31]
- * [Iterators][32]
+ * [Constraints][34]
+ * [Bloom Filters][35]
+ * [Iterators][36]
- * [Setting Iterators via the Shell][33]
- * [Setting Iterators Programmatically][34]
+ * [Setting Iterators via the Shell][37]
+ * [Setting Iterators Programmatically][38]
- * [Versioning Iterators and Timestamps][35]
+ * [Versioning Iterators and Timestamps][39]
- * [Logical Time][36]
- * [Deletes][37]
+ * [Logical Time][40]
+ * [Deletes][41]
- * [Filters][38]
- * [Aggregating Iterators][39]
- * [Pre-splitting tables][40]
- * [Merging tablets][41]
- * [Delete Range][42]
- * [Cloning Tables][43]
+ * [Filters][42]
+ * [Aggregating Iterators][43]
+ * [Pre-splitting tables][44]
+ * [Merging tablets][45]
+ * [Delete Range][46]
+ * [Cloning Tables][47]
-* [Table Design][44]
+* [Table Design][48]
- * [Basic Table][45]
- * [RowID Design][46]
- * [Indexing][47]
- * [Entity-Attribute and Graph Tables][48]
- * [Document-Partitioned Indexing][49]
+ * [Basic Table][49]
+ * [RowID Design][50]
+ * [Indexing][51]
+ * [Entity-Attribute and Graph Tables][52]
+ * [Document-Partitioned Indexing][53]
-* [High-Speed Ingest][50]
+* [High-Speed Ingest][54]
- * [Pre-Splitting New Tables][51]
- * [Multiple Ingester Clients][52]
- * [Bulk Ingest][53]
- * [Logical Time for Bulk Ingest][54]
- * [MapReduce Ingest][55]
+ * [Pre-Splitting New Tables][55]
+ * [Multiple Ingester Clients][56]
+ * [Bulk Ingest][57]
+ * [Logical Time for Bulk Ingest][58]
+ * [MapReduce Ingest][59]
-* [Analytics][56]
+* [Analytics][60]
- * [MapReduce][57]
+ * [MapReduce][61]
- * [Mapper and Reducer classes][58]
- * [AccumuloInputFormat options][59]
- * [AccumuloOutputFormat options][60]
+ * [Mapper and Reducer classes][62]
+ * [AccumuloInputFormat options][63]
+ * [AccumuloOutputFormat options][64]
- * [Aggregating Iterators][61]
+ * [Aggregating Iterators][65]
- * [Feature Vectors][62]
+ * [Feature Vectors][66]
- * [Statistical Modeling][63]
+ * [Statistical Modeling][67]
-* [Security][64]
+* [Security][68]
- * [Security Label Expressions][65]
- * [Security Label Expression Syntax][66]
- * [Authorization][67]
- * [User Authorizations][68]
- * [Secure Authorizations Handling][69]
- * [Query Services Layer][70]
+ * [Security Label Expressions][69]
+ * [Security Label Expression Syntax][70]
+ * [Authorization][71]
+ * [User Authorizations][72]
+ * [Secure Authorizations Handling][73]
+ * [Query Services Layer][74]
-* [Administration][71]
+* [Administration][75]
- * [Hardware][72]
- * [Network][73]
- * [Installation][74]
- * [Dependencies][75]
- * [Configuration][76]
+ * [Hardware][76]
+ * [Network][77]
+ * [Installation][78]
+ * [Dependencies][79]
+ * [Configuration][80]
- * [Edit conf/accumulo-env.sh][77]
- * [Cluster Specification][78]
- * [Accumulo Settings][79]
- * [Deploy Configuration][80]
+ * [Edit conf/accumulo-env.sh][81]
+ * [Cluster Specification][82]
+ * [Accumulo Settings][83]
+ * [Deploy Configuration][84]
- * [Initialization][81]
- * [Running][82]
+ * [Initialization][85]
+ * [Running][86]
- * [Starting Accumulo][83]
- * [Stopping Accumulo][84]
+ * [Starting Accumulo][87]
+ * [Stopping Accumulo][88]
- * [Monitoring][85]
- * [Logging][86]
- * [Recovery][87]
+ * [Monitoring][89]
+ * [Logging][90]
+ * [Recovery][91]
-* [Shell Commands][88]
+* [Shell Commands][92]
* * *
- [1]: Introduction.html
- [2]: Accumulo_Design.html
- [3]: Accumulo_Design.html#Data_Model
- [4]: Accumulo_Design.html#Architecture
- [5]: Accumulo_Design.html#Components
- [6]: Accumulo_Design.html#Tablet_Server
- [7]: Accumulo_Design.html#Loggers
- [8]: Accumulo_Design.html#Garbage_Collector
- [9]: Accumulo_Design.html#Master
- [10]: Accumulo_Design.html#Client
- [11]: Accumulo_Design.html#Data_Management
- [12]: Accumulo_Design.html#Tablet_Service
- [13]: Accumulo_Design.html#Compactions
- [14]: Accumulo_Design.html#Fault-Tolerance
- [15]: Accumulo_Shell.html
- [16]: Accumulo_Shell.html#Basic_Administration
- [17]: Accumulo_Shell.html#Table_Maintenance
- [18]: Accumulo_Shell.html#User_Administration
- [19]: Writing_Accumulo_Clients.html
- [20]: Writing_Accumulo_Clients.html#Writing_Data
- [21]: Writing_Accumulo_Clients.html#BatchWriter
- [22]: Writing_Accumulo_Clients.html#Reading_Data
- [23]: Writing_Accumulo_Clients.html#Scanner
- [24]: Writing_Accumulo_Clients.html#Isolated_Scanner
- [25]: Writing_Accumulo_Clients.html#BatchScanner
- [26]: Table_Configuration.html
- [27]: Table_Configuration.html#Locality_Groups
- [28]: Table_Configuration.html#Managing_Locality_Groups_via_the_Shell
- [29]: Table_Configuration.html#Managing_Locality_Groups_via_the_Client_API
- [30]: Table_Configuration.html#Constraints
- [31]: Table_Configuration.html#Bloom_Filters
- [32]: Table_Configuration.html#Iterators
- [33]: Table_Configuration.html#Setting_Iterators_via_the_Shell
- [34]: Table_Configuration.html#Setting_Iterators_Programmatically
- [35]: Table_Configuration.html#Versioning_Iterators_and_Timestamps
- [36]: Table_Configuration.html#Logical_Time
- [37]: Table_Configuration.html#Deletes
- [38]: Table_Configuration.html#Filters
- [39]: Table_Configuration.html#Aggregating_Iterators
- [40]: Table_Configuration.html#Pre-splitting_tables
- [41]: Table_Configuration.html#Merging_tablets
- [42]: Table_Configuration.html#Delete_Range
- [43]: Table_Configuration.html#Cloning_Tables
- [44]: Table_Design.html
- [45]: Table_Design.html#Basic_Table
- [46]: Table_Design.html#RowID_Design
- [47]: Table_Design.html#Indexing
- [48]: Table_Design.html#Entity-Attribute_and_Graph_Tables
- [49]: Table_Design.html#Document-Partitioned_Indexing
- [50]: High_Speed_Ingest.html
- [51]: High_Speed_Ingest.html#Pre-Splitting_New_Tables
- [52]: High_Speed_Ingest.html#Multiple_Ingester_Clients
- [53]: High_Speed_Ingest.html#Bulk_Ingest
- [54]: High_Speed_Ingest.html#Logical_Time_for_Bulk_Ingest
- [55]: High_Speed_Ingest.html#MapReduce_Ingest
- [56]: Analytics.html
- [57]: Analytics.html#MapReduce
- [58]: Analytics.html#Mapper_and_Reducer_classes
- [59]: Analytics.html#AccumuloInputFormat_options
- [60]: Analytics.html#AccumuloOutputFormat_options
- [61]: Analytics.html#Aggregating_Iterators
- [62]: Analytics.html#Feature_Vectors
- [63]: Analytics.html#Statistical_Modeling
- [64]: Security.html
- [65]: Security.html#Security_Label_Expressions
- [66]: Security.html#Security_Label_Expression_Syntax
- [67]: Security.html#Authorization
- [68]: Security.html#User_Authorizations
- [69]: Security.html#Secure_Authorizations_Handling
- [70]: Security.html#Query_Services_Layer
- [71]: Administration.html
- [72]: Administration.html#Hardware
- [73]: Administration.html#Network
- [74]: Administration.html#Installation
- [75]: Administration.html#Dependencies
- [76]: Administration.html#Configuration
- [77]: Administration.html#Edit_conf/accumulo-env.sh
- [78]: Administration.html#Cluster_Specification
- [79]: Administration.html#Accumulo_Settings
- [80]: Administration.html#Deploy_Configuration
- [81]: Administration.html#Initialization
- [82]: Administration.html#Running
- [83]: Administration.html#Starting_Accumulo
- [84]: Administration.html#Stopping_Accumulo
- [85]: Administration.html#Monitoring
- [86]: Administration.html#Logging
- [87]: Administration.html#Recovery
- [88]: Shell_Commands.html
+ [2]: Introduction.html
+ [4]: accumulo_user_manual.html
+ [6]: Accumulo_Design.html
+ [7]: Accumulo_Design.html#Data_Model
+ [8]: Accumulo_Design.html#Architecture
+ [9]: Accumulo_Design.html#Components
+ [10]: Accumulo_Design.html#Tablet_Server
+ [11]: Accumulo_Design.html#Loggers
+ [12]: Accumulo_Design.html#Garbage_Collector
+ [13]: Accumulo_Design.html#Master
+ [14]: Accumulo_Design.html#Client
+ [15]: Accumulo_Design.html#Data_Management
+ [16]: Accumulo_Design.html#Tablet_Service
+ [17]: Accumulo_Design.html#Compactions
+ [18]: Accumulo_Design.html#Fault-Tolerance
+ [19]: Accumulo_Shell.html
+ [20]: Accumulo_Shell.html#Basic_Administration
+ [21]: Accumulo_Shell.html#Table_Maintenance
+ [22]: Accumulo_Shell.html#User_Administration
+ [23]: Writing_Accumulo_Clients.html
+ [24]: Writing_Accumulo_Clients.html#Writing_Data
+ [25]: Writing_Accumulo_Clients.html#BatchWriter
+ [26]: Writing_Accumulo_Clients.html#Reading_Data
+ [27]: Writing_Accumulo_Clients.html#Scanner
+ [28]: Writing_Accumulo_Clients.html#Isolated_Scanner
+ [29]: Writing_Accumulo_Clients.html#BatchScanner
+ [30]: Table_Configuration.html
+ [31]: Table_Configuration.html#Locality_Groups
+ [32]: Table_Configuration.html#Managing_Locality_Groups_via_the_Shell
+ [33]: Table_Configuration.html#Managing_Locality_Groups_via_the_Client_API
+ [34]: Table_Configuration.html#Constraints
+ [35]: Table_Configuration.html#Bloom_Filters
+ [36]: Table_Configuration.html#Iterators
+ [37]: Table_Configuration.html#Setting_Iterators_via_the_Shell
+ [38]: Table_Configuration.html#Setting_Iterators_Programmatically
+ [39]: Table_Configuration.html#Versioning_Iterators_and_Timestamps
+ [40]: Table_Configuration.html#Logical_Time
+ [41]: Table_Configuration.html#Deletes
+ [42]: Table_Configuration.html#Filters
+ [43]: Table_Configuration.html#Aggregating_Iterators
+ [44]: Table_Configuration.html#Pre-splitting_tables
+ [45]: Table_Configuration.html#Merging_tablets
+ [46]: Table_Configuration.html#Delete_Range
+ [47]: Table_Configuration.html#Cloning_Tables
+ [48]: Table_Design.html
+ [49]: Table_Design.html#Basic_Table
+ [50]: Table_Design.html#RowID_Design
+ [51]: Table_Design.html#Indexing
+ [52]: Table_Design.html#Entity-Attribute_and_Graph_Tables
+ [53]: Table_Design.html#Document-Partitioned_Indexing
+ [54]: High_Speed_Ingest.html
+ [55]: High_Speed_Ingest.html#Pre-Splitting_New_Tables
+ [56]: High_Speed_Ingest.html#Multiple_Ingester_Clients
+ [57]: High_Speed_Ingest.html#Bulk_Ingest
+ [58]: High_Speed_Ingest.html#Logical_Time_for_Bulk_Ingest
+ [59]: High_Speed_Ingest.html#MapReduce_Ingest
+ [60]: Analytics.html
+ [61]: Analytics.html#MapReduce
+ [62]: Analytics.html#Mapper_and_Reducer_classes
+ [63]: Analytics.html#AccumuloInputFormat_options
+ [64]: Analytics.html#AccumuloOutputFormat_options
+ [65]: Analytics.html#Aggregating_Iterators
+ [66]: Analytics.html#Feature_Vectors
+ [67]: Analytics.html#Statistical_Modeling
+ [68]: Security.html
+ [69]: Security.html#Security_Label_Expressions
+ [70]: Security.html#Security_Label_Expression_Syntax
+ [71]: Security.html#Authorization
+ [72]: Security.html#User_Authorizations
+ [73]: Security.html#Secure_Authorizations_Handling
+ [74]: Security.html#Query_Services_Layer
+ [75]: Administration.html
+ [76]: Administration.html#Hardware
+ [77]: Administration.html#Network
+ [78]: Administration.html#Installation
+ [79]: Administration.html#Dependencies
+ [80]: Administration.html#Configuration
+ [81]: Administration.html#Edit_conf/accumulo-env.sh
+ [82]: Administration.html#Cluster_Specification
+ [83]: Administration.html#Accumulo_Settings
+ [84]: Administration.html#Deploy_Configuration
+ [85]: Administration.html#Initialization
+ [86]: Administration.html#Running
+ [87]: Administration.html#Starting_Accumulo
+ [88]: Administration.html#Stopping_Accumulo
+ [89]: Administration.html#Monitoring
+ [90]: Administration.html#Logging
+ [91]: Administration.html#Recovery
+ [92]: Shell_Commands.html
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/High_Speed_Ingest.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/High_Speed_Ingest.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/High_Speed_Ingest.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/High_Speed_Ingest.mdtext Tue Nov 1 16:23:42 2011
@@ -16,13 +16,15 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Next:** [Analytics][2] ** Up:** [Accumulo User Manual Version 1.4][4] ** Previous:** [Table Design][6] ** [Contents][8]**
+
<a id=CHILD_LINKS></a>**Subsections**
-* [Pre-Splitting New Tables][1]
-* [Multiple Ingester Clients][2]
-* [Bulk Ingest][3]
-* [Logical Time for Bulk Ingest][4]
-* [MapReduce Ingest][5]
+* [Pre-Splitting New Tables][9]
+* [Multiple Ingester Clients][10]
+* [Bulk Ingest][11]
+* [Logical Time for Bulk Ingest][12]
+* [MapReduce Ingest][13]
* * *
@@ -89,14 +91,17 @@ It is possible to efficiently write many
An example of using MapReduce can be found under
accumulo/docs/examples/README.mapred
-
-
-
* * *
- [1]: High_Speed_Ingest.html#Pre-Splitting_New_Tables
- [2]: High_Speed_Ingest.html#Multiple_Ingester_Clients
- [3]: High_Speed_Ingest.html#Bulk_Ingest
- [4]: High_Speed_Ingest.html#Logical_Time_for_Bulk_Ingest
- [5]: High_Speed_Ingest.html#MapReduce_Ingest
+** Next:** [Analytics][2] ** Up:** [Accumulo User Manual Version 1.4][4] ** Previous:** [Table Design][6] ** [Contents][8]**
+
+ [2]: Analytics.html
+ [4]: accumulo_user_manual.html
+ [6]: Table_Design.html
+ [8]: Contents.html
+ [9]: High_Speed_Ingest.html#Pre-Splitting_New_Tables
+ [10]: High_Speed_Ingest.html#Multiple_Ingester_Clients
+ [11]: High_Speed_Ingest.html#Bulk_Ingest
+ [12]: High_Speed_Ingest.html#Logical_Time_for_Bulk_Ingest
+ [13]: High_Speed_Ingest.html#MapReduce_Ingest
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Introduction.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Introduction.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Introduction.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Introduction.mdtext Tue Nov 1 16:23:42 2011
@@ -16,6 +16,10 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Next:** [Accumulo Design][2] ** Up:** [Accumulo User Manual Version 1.4][4] ** Previous:** [Contents][6] ** [Contents][6]**
+
+
+
## <a id=Introduction></a> Introduction
Accumulo is a highly scalable structured store based on Google's BigTable. Accumulo is written in Java and operates over the Hadoop Distributed File System (HDFS), which is part of the popular Apache Hadoop project. Accumulo supports efficient storage and retrieval of structured data, including queries for ranges, and provides support for using Accumulo tables as input and output for MapReduce jobs.
@@ -26,3 +30,8 @@ Accumulo features automatic load-balanci
* * *
+
+ [2]: Accumulo_Design.html
+ [4]: accumulo_user_manual.html
+ [6]: Contents.html
+
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Security.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Security.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Security.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Security.mdtext Tue Nov 1 16:23:42 2011
@@ -16,14 +16,16 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Next:** [Administration][2] ** Up:** [Accumulo User Manual Version 1.4][4] ** Previous:** [Analytics][6] ** [Contents][8]**
+
<a id=CHILD_LINKS></a>**Subsections**
-* [Security Label Expressions][1]
-* [Security Label Expression Syntax][2]
-* [Authorization][3]
-* [User Authorizations][4]
-* [Secure Authorizations Handling][5]
-* [Query Services Layer][6]
+* [Security Label Expressions][9]
+* [Security Label Expression Syntax][10]
+* [Authorization][11]
+* [User Authorizations][12]
+* [Secure Authorizations Handling][13]
+* [Query Services Layer][14]
* * *
@@ -119,15 +121,18 @@ Several production environments choose t
Typically, the query services layer sits between Accumulo and user workstations.
-
-
-
* * *
- [1]: Security.html#Security_Label_Expressions
- [2]: Security.html#Security_Label_Expression_Syntax
- [3]: Security.html#Authorization
- [4]: Security.html#User_Authorizations
- [5]: Security.html#Secure_Authorizations_Handling
- [6]: Security.html#Query_Services_Layer
+** Next:** [Administration][2] ** Up:** [Accumulo User Manual Version 1.4][4] ** Previous:** [Analytics][6] ** [Contents][8]**
+
+ [2]: Administration.html
+ [4]: accumulo_user_manual.html
+ [6]: Analytics.html
+ [8]: Contents.html
+ [9]: Security.html#Security_Label_Expressions
+ [10]: Security.html#Security_Label_Expression_Syntax
+ [11]: Security.html#Authorization
+ [12]: Security.html#User_Authorizations
+ [13]: Security.html#Secure_Authorizations_Handling
+ [14]: Security.html#Query_Services_Layer
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Shell_Commands.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Shell_Commands.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Shell_Commands.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Shell_Commands.mdtext Tue Nov 1 16:23:42 2011
@@ -16,6 +16,10 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Up:** [Accumulo User Manual Version 1.4][3] ** Previous:** [Administration][5] ** [Contents][7]**
+
+
+
## <a id=Shell_Commands></a> Shell Commands
**?**
@@ -639,7 +643,11 @@ Notice: Licensed to the Apache Softwa
-
+* * *
+** Up:** [Accumulo User Manual Version 1.4][3] ** Previous:** [Administration][5] ** [Contents][7]**
+
+ [3]: accumulo_user_manual.html
+ [5]: Administration.html
+ [7]: Contents.html
-* * *
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Table_Configuration.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Table_Configuration.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Table_Configuration.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Table_Configuration.mdtext Tue Nov 1 16:23:42 2011
@@ -16,19 +16,21 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Next:** [Table Design][2] ** Up:** [Accumulo User Manual Version 1.4][4] ** Previous:** [Writing Accumulo Clients][6] ** [Contents][8]**
+
<a id=CHILD_LINKS></a>**Subsections**
-* [Locality Groups][1]
-* [Constraints][2]
-* [Bloom Filters][3]
-* [Iterators][4]
-* [Versioning Iterators and Timestamps][5]
-* [Filters][6]
-* [Aggregating Iterators][7]
-* [Pre-splitting tables][8]
-* [Merging tablets][9]
-* [Delete Range][10]
-* [Cloning Tables][11]
+* [Locality Groups][9]
+* [Constraints][10]
+* [Bloom Filters][11]
+* [Iterators][12]
+* [Versioning Iterators and Timestamps][13]
+* [Filters][14]
+* [Aggregating Iterators][15]
+* [Pre-splitting tables][16]
+* [Merging tablets][17]
+* [Delete Range][18]
+* [Cloning Tables][19]
* * *
@@ -408,20 +410,23 @@ The du command in the shell shows how mu
root@a14 cic>
-
-
-
* * *
- [1]: Table_Configuration.html#Locality_Groups
- [2]: Table_Configuration.html#Constraints
- [3]: Table_Configuration.html#Bloom_Filters
- [4]: Table_Configuration.html#Iterators
- [5]: Table_Configuration.html#Versioning_Iterators_and_Timestamps
- [6]: Table_Configuration.html#Filters
- [7]: Table_Configuration.html#Aggregating_Iterators
- [8]: Table_Configuration.html#Pre-splitting_tables
- [9]: Table_Configuration.html#Merging_tablets
- [10]: Table_Configuration.html#Delete_Range
- [11]: Table_Configuration.html#Cloning_Tables
+** Next:** [Table Design][2] ** Up:** [Accumulo User Manual Version 1.4][4] ** Previous:** [Writing Accumulo Clients][6] ** [Contents][8]**
+
+ [2]: Table_Design.html
+ [4]: accumulo_user_manual.html
+ [6]: Writing_Accumulo_Clients.html
+ [8]: Contents.html
+ [9]: Table_Configuration.html#Locality_Groups
+ [10]: Table_Configuration.html#Constraints
+ [11]: Table_Configuration.html#Bloom_Filters
+ [12]: Table_Configuration.html#Iterators
+ [13]: Table_Configuration.html#Versioning_Iterators_and_Timestamps
+ [14]: Table_Configuration.html#Filters
+ [15]: Table_Configuration.html#Aggregating_Iterators
+ [16]: Table_Configuration.html#Pre-splitting_tables
+ [17]: Table_Configuration.html#Merging_tablets
+ [18]: Table_Configuration.html#Delete_Range
+ [19]: Table_Configuration.html#Cloning_Tables
Modified: incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Table_Design.mdtext
URL: http://svn.apache.org/viewvc/incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Table_Design.mdtext?rev=1196099&r1=1196098&r2=1196099&view=diff
==============================================================================
--- incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Table_Design.mdtext (original)
+++ incubator/accumulo/site/trunk/content/accumulo/user_manual_1.4-incubating/Table_Design.mdtext Tue Nov 1 16:23:42 2011
@@ -16,13 +16,15 @@ Notice: Licensed to the Apache Softwa
specific language governing permissions and limitations
under the License.
+** Next:** [High-Speed Ingest][2] ** Up:** [Accumulo User Manual Version 1.4][4] ** Previous:** [Table Configuration][6] ** [Contents][8]**
+
<a id=CHILD_LINKS></a>**Subsections**
-* [Basic Table][1]
-* [RowID Design][2]
-* [Indexing][3]
-* [Entity-Attribute and Graph Tables][4]
-* [Document-Partitioned Indexing][5]
+* [Basic Table][9]
+* [RowID Design][10]
+* [Indexing][11]
+* [Entity-Attribute and Graph Tables][12]
+* [Document-Partitioned Indexing][13]
* * *
@@ -99,7 +101,7 @@ Appending dates provides the additional
In order to support lookups via more than one attribute of an entity, additional indexes can be built. However, because Accumulo tables can support any number of columns without specifying them beforehand, a single additional index will often suffice for supporting lookups of records in the main table. Here, the index has, as the rowID, the Value or Term from the main table, the column families are the same, and the column qualifier of the index table contains the rowID from the main table.
-![converted table][6]
+![converted table][14]
Note: We store rowIDs in the column qualifier rather than the Value so that we can have more than one rowID associated with a particular term within the index. If we stored this in the Value we would only see one of the rows in which the value appears since Accumulo is configured by default to return the one most recent value associated with a key.
@@ -141,11 +143,11 @@ Rather than storing individual events, E
The physical schema for an entity-attribute or graph table is as follows:
-![converted table][7]
+![converted table][15]
For example, to keep track of employees, managers and products the following entity-attribute table could be used. Note that the weights are not always necessary and are set to 0 when not used.
-![converted table][8]
+![converted table][16]
@@ -161,7 +163,7 @@ For these reasons Accumulo includes supp
This is accomplished via partitioning records into bins that each reside on at most one TabletServer, and then creating an index of terms per record within each bin as follows:
-![converted table][9]
+![converted table][17]
Documents or records are mapped into bins by a user-defined ingest application. By storing the BinID as the RowID we ensure that all the information for a particular bin is contained in a single tablet and hosted on a single TabletServer since Accumulo never splits rows across tablets. Storing the Terms as column families serves to enable fast lookups of all the documents within this bin that contain the given term.
@@ -185,18 +187,21 @@ This code effectively has the BatchScann
Of course, fast servers will return their results to the client which can display them to the user immediately while they wait for the rest of the results to arrive. If the results are unordered this is quite effective as the first results to arrive are as good as any others to the user.
-
-
-
* * *
- [1]: Table_Design.html#Basic_Table
- [2]: Table_Design.html#RowID_Design
- [3]: Table_Design.html#Indexing
- [4]: Table_Design.html#Entity-Attribute_and_Graph_Tables
- [5]: Table_Design.html#Document-Partitioned_Indexing
- [6]: img2.png
- [7]: img3.png
- [8]: img4.png
- [9]: img5.png
+** Next:** [High-Speed Ingest][2] ** Up:** [Accumulo User Manual Version 1.4][4] ** Previous:** [Table Configuration][6] ** [Contents][8]**
+
+ [2]: High_Speed_Ingest.html
+ [4]: accumulo_user_manual.html
+ [6]: Table_Configuration.html
+ [8]: Contents.html
+ [9]: Table_Design.html#Basic_Table
+ [10]: Table_Design.html#RowID_Design
+ [11]: Table_Design.html#Indexing
+ [12]: Table_Design.html#Entity-Attribute_and_Graph_Tables
+ [13]: Table_Design.html#Document-Partitioned_Indexing
+ [14]: img2.png
+ [15]: img3.png
+ [16]: img4.png
+ [17]: img5.png