You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@accumulo.apache.org by bu...@apache.org on 2011/11/01 18:08:19 UTC
svn commit: r797867 [2/12] - in /websites/staging/accumulo/trunk/content: ./
accumulo/ accumulo/css/ accumulo/governance/ accumulo/images/
accumulo/user_manual_1.3-incubating/
accumulo/user_manual_1.3-incubating/examples/
accumulo/user_manual_1.4-incub...
Added: websites/staging/accumulo/trunk/content/accumulo/source.html
==============================================================================
--- websites/staging/accumulo/trunk/content/accumulo/source.html (added)
+++ websites/staging/accumulo/trunk/content/accumulo/source.html Tue Nov 1 17:08:17 2011
@@ -0,0 +1,151 @@
+<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
+<html>
+<head>
+<!--
+
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE- 2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+ <link href="/accumulo/css/accumulo.css" rel="stylesheet" type="text/css">
+ <title>Accumulo Source Code & Developers Guide</title>
+ <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
+ <script type="text/javascript">
+
+ var _gaq = _gaq || [];
+ _gaq.push(['_setAccount', 'UA-21103458-6']);
+ _gaq.push(['_trackPageview']);
+
+ (function() {
+ var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true;
+ ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js';
+ var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s);
+ })();
+
+ </script>
+</head>
+
+<body>
+ <div id="banner">
+ <img id="logo" alt="Apache accumulo (Incubating)" src="/accumulo/images/accumulo-logo.png"/>
+ <div id="bannertext">
+
+ </div><br />
+ </div>
+
+ <div id="navigation">
+ <h1 id="project">Project</h1>
+<ul>
+<li><a href="/accumulo">Home</a></li>
+<li><a href="http://incubator.apache.org/projects/accumulo.html">Incubator page</a>
+<!-- - Download --></li>
+<li><a href="/accumulo/notable_features.html">Features</a></li>
+<li><a href="http://www.apache.org/licenses/LICENSE-2.0">License</a></li>
+</ul>
+<h1 id="community">Community</h1>
+<ul>
+<li><a href="/accumulo/get_involved.html">Get Involved</a></li>
+<li><a href="/accumulo/mailing_list.html">Mailing Lists</a></li>
+<li><a href="https://issues.apache.org/jira/secure/ConfigureReport.jspa?versionId=-2&selectedProjectId=12312121&reportKey=com.sourcelabs.jira.plugin.report.contributions%3Acontributionreport">People</a></li>
+</ul>
+<h1 id="development">Development</h1>
+<ul>
+<li><a href="/accumulo/source.html">Source Code</a></li>
+<li><a href="https://issues.apache.org/jira/browse/accumulo">Issues</a></li>
+<li><a href="https://builds.apache.org/job/Accumulo-Trunk">Builds</a></li>
+</ul>
+<h1 id="documentation">Documentation</h1>
+<ul>
+<li><a href="/accumulo/user_manual_1.3-incubating">Manual v1.3</a><ul>
+<li><a href="/accumulo/user_manual_1.3-incubating/examples.html">Examples v1.3</a></li>
+</ul>
+</li>
+<li><a href="/accumulo/user_manual_1.4-incubating">Manual v1.4</a>
+<!-- - klzzwxh:0005 -->
+<!-- - Javadoc -->
+<!-- - Examples --></li>
+<li><a href="/accumulo/screenshots.html">Screenshots</a></li>
+</ul>
+<!--
+# Development
+ - Source code
+ - Building
+-->
+
+<h1 id="asf_links">ASF links</h1>
+<ul>
+<li><a href="http://www.apache.org">Apache Software Foundation</a></li>
+<li><a href="http://www.apache.org/foundation/thanks.html">Thanks</a></li>
+<li><a href="http://www.apache.org/foundation/sponsorship.html">Become a Sponsor</a></li>
+</ul>
+ </div>
+
+ <div id="content">
+ <h1 class="title">Accumulo Source Code & Developers Guide</h1>
+ <h2 id="source_code">Source Code</h2>
+<p>Accumulo source code is maintained using <a href="http://subversion.apache.org/">Apache Subversion</a> version control
+(<a href="http://svn.apache.org/viewvc/incubator/accumulo/">browse</a>|<a href="https://svn.apache.org/repos/asf/incubator/accumulo/trunk/">checkout</a>). It builds with <a href="http://maven.apache.org/">Apache Maven</a>.</p>
+<h2 id="developers_guide">Developers Guide</h2>
+<h3 id="building_code">Building code</h3>
+<p>To check out the code:</p>
+<div class="codehilite"><pre><span class="n">svn</span> <span class="n">co</span> <span class="n">https:</span><span class="sr">//s</span><span class="n">vn</span><span class="o">.</span><span class="n">apache</span><span class="o">.</span><span class="n">org</span><span class="sr">/repos/</span><span class="n">asf</span><span class="sr">/incubator/</span><span class="n">accumulo</span><span class="sr">/trunk/</span>
+</pre></div>
+
+
+<p>To build the code:</p>
+<div class="codehilite"><pre><span class="n">mvn</span> <span class="nb">package</span> <span class="o">&&</span> <span class="n">mvn</span> <span class="n">assembly:single</span>
+</pre></div>
+
+
+<p>This will create a file accumulo-*-incubating-SNAPSHOT-dist.tar.gz in the target directory.</p>
+<h3 id="continuous_integration">Continuous Integration</h3>
+<p>Accumulo uses <a href="http://jenkins-ci.org/">Jenkins</a> for automatic builds.</p>
+<p><img src="https://builds.apache.org/job/Accumulo-Trunk/lastBuild/buildStatus" width=18> <a href="https://builds.apache.org/job/Accumulo-Trunk/">Trunk</a></p>
+<p><img src="https://builds.apache.org/job/Accumulo-1.3.x/lastBuild/buildStatus" width=18> <a href="https://builds.apache.org/job/Accumulo-1.3.x/">1.3 Branch</a></p>
+<h3 id="issue_tracking">Issue Tracking</h3>
+<p>Accumulo <a href="https://issues.apache.org/jira/browse/accumulo">tracks issues</a> with <a href="http://www.atlassian.com/software/jira/overview">JIRA</a>.</p>
+<h3 id="coding_practices">Coding Practices</h3>
+<ul>
+<li>License Header: Always add the current ASF license header as described in <a href="http://www.apache.org/legal/src-headers.html">ASF Source Header</a>.</li>
+<li>Trailing Whitespaces: Remove all trailing whitespaces. Eclipse users can use Source->Cleanup option to accomplish this.</li>
+<li>Indentation: Use 2 space indents and never use tabs!</li>
+<li>Line Wrapping: Use 160-column line width for Java code and Javadoc.</li>
+<li>Control Structure New Lines: Use a new line with single statement if/else blocks.</li>
+<li>Author Tags: Do not use Author Tags. The code is developed and owned by the community. </li>
+</ul>
+<h3 id="eclipse_configuration_tips">Eclipse Configuration Tips</h3>
+<ul>
+<li>Download Eclipse <a href="https://svn.apache.org/repos/asf/incubator/accumulo/trunk/contrib/">formatting and style guides for Accumulo</a>.</li>
+<li>Import Formatter: Preferences > Java > Code Style > Formatter and import the Eclipse-Accumulo-Codestyle.xml downloaded in the previous step. </li>
+<li>Import Template: Preferences > Java > Code Style > Code Templates and import the Eclipse-Accumulo-Template.xml. Make sure to check the "Automatically add comments" box. This template adds the ASF header and so on for new code.</li>
+</ul>
+ </div>
+
+ <div id="footer">
+ <div class="copyright">
+ <p>
+ Copyright © 2011 The Apache Software Foundation, Licensed under
+ the <a href="http://www.apache.org/licenses/LICENSE-2.0">Apache License, Version 2.0</a>.
+ <br />
+ Apache and the Apache feather logos are trademarks of The Apache Software Foundation.
+ </p>
+ </div>
+ <a alt="Apache Incubator" href="http://incubator.apache.org">
+ <img id="asf-logo" alt="Apache Incubator" src="/accumulo/images/apache-incubator-logo.png" width="150"/>
+ </a>
+
+ </div>
+
+</body>
+</html>
Added: websites/staging/accumulo/trunk/content/accumulo/user_manual_1.3-incubating/Accumulo_Design.html
==============================================================================
--- websites/staging/accumulo/trunk/content/accumulo/user_manual_1.3-incubating/Accumulo_Design.html (added)
+++ websites/staging/accumulo/trunk/content/accumulo/user_manual_1.3-incubating/Accumulo_Design.html Tue Nov 1 17:08:17 2011
@@ -0,0 +1,163 @@
+<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
+<html>
+<head>
+<!--
+
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE- 2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+ <link href="/accumulo/css/accumulo.css" rel="stylesheet" type="text/css">
+ <title>Accumulo User Manual: Accumulo Design</title>
+ <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
+ <script type="text/javascript">
+
+ var _gaq = _gaq || [];
+ _gaq.push(['_setAccount', 'UA-21103458-6']);
+ _gaq.push(['_trackPageview']);
+
+ (function() {
+ var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true;
+ ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js';
+ var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s);
+ })();
+
+ </script>
+</head>
+
+<body>
+ <div id="banner">
+ <img id="logo" alt="Apache accumulo (Incubating)" src="/accumulo/images/accumulo-logo.png"/>
+ <div id="bannertext">
+
+ </div><br />
+ </div>
+
+ <div id="navigation">
+ <h1 id="project">Project</h1>
+<ul>
+<li><a href="/accumulo">Home</a></li>
+<li><a href="http://incubator.apache.org/projects/accumulo.html">Incubator page</a>
+<!-- - Download --></li>
+<li><a href="/accumulo/notable_features.html">Features</a></li>
+<li><a href="http://www.apache.org/licenses/LICENSE-2.0">License</a></li>
+</ul>
+<h1 id="community">Community</h1>
+<ul>
+<li><a href="/accumulo/get_involved.html">Get Involved</a></li>
+<li><a href="/accumulo/mailing_list.html">Mailing Lists</a></li>
+<li><a href="https://issues.apache.org/jira/secure/ConfigureReport.jspa?versionId=-2&selectedProjectId=12312121&reportKey=com.sourcelabs.jira.plugin.report.contributions%3Acontributionreport">People</a></li>
+</ul>
+<h1 id="development">Development</h1>
+<ul>
+<li><a href="/accumulo/source.html">Source Code</a></li>
+<li><a href="https://issues.apache.org/jira/browse/accumulo">Issues</a></li>
+<li><a href="https://builds.apache.org/job/Accumulo-Trunk">Builds</a></li>
+</ul>
+<h1 id="documentation">Documentation</h1>
+<ul>
+<li><a href="/accumulo/user_manual_1.3-incubating">Manual v1.3</a><ul>
+<li><a href="/accumulo/user_manual_1.3-incubating/examples.html">Examples v1.3</a></li>
+</ul>
+</li>
+<li><a href="/accumulo/user_manual_1.4-incubating">Manual v1.4</a>
+<!-- - klzzwxh:0005 -->
+<!-- - Javadoc -->
+<!-- - Examples --></li>
+<li><a href="/accumulo/screenshots.html">Screenshots</a></li>
+</ul>
+<!--
+# Development
+ - Source code
+ - Building
+-->
+
+<h1 id="asf_links">ASF links</h1>
+<ul>
+<li><a href="http://www.apache.org">Apache Software Foundation</a></li>
+<li><a href="http://www.apache.org/foundation/thanks.html">Thanks</a></li>
+<li><a href="http://www.apache.org/foundation/sponsorship.html">Become a Sponsor</a></li>
+</ul>
+ </div>
+
+ <div id="content">
+ <h1 class="title">Accumulo User Manual: Accumulo Design</h1>
+ <p><strong> Next:</strong> <a href="Accumulo_Shell.html">Accumulo Shell</a> <strong> Up:</strong> <a href="accumulo_user_manual.html">Accumulo User Manual Version 1.3</a> <strong> Previous:</strong> <a href="Introduction.html">Introduction</a> <strong> <a href="Contents.html">Contents</a></strong> <br />
+</p>
+<p><a id=CHILD_LINKS></a><strong>Subsections</strong></p>
+<ul>
+<li><a href="Accumulo_Design.html#Data_Model">Data Model</a></li>
+<li><a href="Accumulo_Design.html#Architecture">Architecture</a></li>
+<li><a href="Accumulo_Design.html#Components">Components</a></li>
+<li><a href="Accumulo_Design.html#Data_Management">Data Management</a></li>
+<li><a href="Accumulo_Design.html#Tablet_Service">Tablet Service</a></li>
+<li><a href="Accumulo_Design.html#Compactions">Compactions</a></li>
+<li><a href="Accumulo_Design.html#Fault-Tolerance">Fault-Tolerance</a></li>
+</ul>
+<hr />
+<h2 id="a_idaccumulo_designa_accumulo_design"><a id=Accumulo_Design></a> Accumulo Design</h2>
+<h2 id="a_iddata_modela_data_model"><a id=Data_Model></a> Data Model</h2>
+<p>Accumulo provides a richer data model than simple key-value stores, but is not a fully relational database. Data is represented as key-value pairs, where the key and value are comprised of the following elements: </p>
+<p><img alt="converted table" src="img1.png" /></p>
+<p>All elements of the Key and the Value are represented as byte arrays except for Timestamp, which is a Long. Accumulo sorts keys by element and lexicographically in ascending order. Timestamps are sorted in descending order so that later versions of the same Key appear first in a sequential scan. Tables consist of a set of sorted key-value pairs. </p>
+<h2 id="a_idarchitecturea_architecture"><a id=Architecture></a> Architecture</h2>
+<p>Accumulo is a distributed data storage and retrieval system and as such consists of several architectural components, some of which run on many individual servers. Much of the work Accumulo does involves maintaining certain properties of the data, such as organization, availability, and integrity, across many commodity-class machines. </p>
+<h2 id="a_idcomponentsa_components"><a id=Components></a> Components</h2>
+<p>An instance of Accumulo includes many TabletServers, write-ahead Logger servers, one Garbage Collector process, one Master server and many Clients. </p>
+<h3 id="a_idtablet_servera_tablet_server"><a id=Tablet_Server></a> Tablet Server</h3>
+<p>The TabletServer manages some subset of all the tablets (partitions of tables). This includes receiving writes from clients, persisting writes to a writeâahead log, sorting new keyâvalue pairs in memory, periodically flushing sorted keyâvalue pairs to new files in HDFS, and responding to reads from clients, forming a mergeâsorted view of all keys and values from all the files it has created and the sorted inâmemory store. </p>
+<p>TabletServers also perform recovery of a tablet that was previously on a server that failed, reapplying any writes found in the write-ahead log to the tablet. </p>
+<h3 id="a_idloggersa_loggers"><a id=Loggers></a> Loggers</h3>
+<p>The Loggers accept updates to Tablet servers and write them to local on-disk storage. Each tablet server will write their updates to multiple loggers to preserve data in case of hardware failure. </p>
+<h3 id="a_idgarbage_collectora_garbage_collector"><a id=Garbage_Collector></a> Garbage Collector</h3>
+<p>Accumulo processes will share files stored in HDFS. Periodically, the Garbage Collector will identify files that are no longer needed by any process, and delete them. </p>
+<h3 id="a_idmastera_master"><a id=Master></a> Master</h3>
+<p>The Accumulo Master is responsible for detecting and responding to TabletServer failure. It tries to balance the load across TabletServer by assigning tablets carefully and instructing TabletServers to migrate tablets when necessary. The Master ensures all tablets are assigned to one TabletServer each, and handles table creation, alteration, and deletion requests from clients. The Master also coordinates startup, graceful shutdown and recovery of changes in write-ahead logs when Tablet servers fail. </p>
+<h3 id="a_idclienta_client"><a id=Client></a> Client</h3>
+<p>Accumulo includes a client library that is linked to every application. The client library contains logic for finding servers managing a particular tablet, and communicating with TabletServers to write and retrieve key-value pairs. </p>
+<h2 id="a_iddata_managementa_data_management"><a id=Data_Management></a> Data Management</h2>
+<p>Accumulo stores data in tables, which are partitioned into tablets. Tablets are partitioned on row boundaries so that all of the columns and values for a particular row are found together within the same tablet. The Master assigns Tablets to one TabletServer at a time. This enables row-level transactions to take place without using distributed locking or some other complicated synchronization mechanism. As clients insert and query data, and as machines are added and removed from the cluster, the Master migrates tablets to ensure they remain available and that the ingest and query load is balanced across the cluster. </p>
+<p><img alt="Image data_distribution" src="./data_distribution.png" /></p>
+<h2 id="a_idtablet_servicea_tablet_service"><a id=Tablet_Service></a> Tablet Service</h2>
+<p>When a write arrives at a TabletServer it is written to a WriteâAhead Log and then inserted into a sorted data structure in memory called a MemTable. When the MemTable reaches a certain size the TabletServer writes out the sorted key-value pairs to a file in HDFS called Indexed Sequential Access Method (ISAM) file. This process is called a minor compaction. A new MemTable is then created and the fact of the compaction is recorded in the WriteâAhead Log. </p>
+<p>When a request to read data arrives at a TabletServer, the TabletServer does a binary search across the MemTable as well as the in-memory indexes associated with each ISAM file to find the relevant values. If clients are performing a scan, several keyâvalue pairs are returned to the client in order from the MemTable and the set of ISAM files by performing a mergeâsort as they are read. </p>
+<h2 id="a_idcompactionsa_compactions"><a id=Compactions></a> Compactions</h2>
+<p>In order to manage the number of files per tablet, periodically the TabletServer performs Major Compactions of files within a tablet, in which some set of ISAM files are combined into one file. The previous files will eventually be removed by the Garbage Collector. This also provides an opportunity to permanently remove deleted keyâvalue pairs by omitting keyâvalue pairs suppressed by a delete entry when the new file is created. </p>
+<h2 id="a_idfault-tolerancea_fault-tolerance"><a id=Fault-Tolerance></a> Fault-Tolerance</h2>
+<p>If a TabletServer fails, the Master detects it and automatically reassigns the tablets assigned from the failed server to other servers. Any key-value pairs that were in memory at the time the TabletServer are automatically reapplied from the Write-Ahead Log to prevent any loss of data. </p>
+<p>The Master will coordinate the copying of write-ahead logs to HDFS so the logs are available to all tablet servers. To make recovery efficient, the updates within a log are grouped by tablet. The sorting process can be performed by Hadoops MapReduce or the Logger server. TabletServers can quickly apply the mutations from the sorted logs that are destined for the tablets they have now been assigned. </p>
+<p>TabletServer failures are noted on the Master's monitor page, accessible via <br />
+http://master-address:50095/monitor. </p>
+<p><img alt="Image failure_handling" src="./failure_handling.png" /></p>
+<hr />
+<p><strong> Next:</strong> <a href="Accumulo_Shell.html">Accumulo Shell</a> <strong> Up:</strong> <a href="accumulo_user_manual.html">Accumulo User Manual Version 1.3</a> <strong> Previous:</strong> <a href="Introduction.html">Introduction</a> <strong> <a href="Contents.html">Contents</a></strong></p>
+ </div>
+
+ <div id="footer">
+ <div class="copyright">
+ <p>
+ Copyright © 2011 The Apache Software Foundation, Licensed under
+ the <a href="http://www.apache.org/licenses/LICENSE-2.0">Apache License, Version 2.0</a>.
+ <br />
+ Apache and the Apache feather logos are trademarks of The Apache Software Foundation.
+ </p>
+ </div>
+ <a alt="Apache Incubator" href="http://incubator.apache.org">
+ <img id="asf-logo" alt="Apache Incubator" src="/accumulo/images/apache-incubator-logo.png" width="150"/>
+ </a>
+
+ </div>
+
+</body>
+</html>
Added: websites/staging/accumulo/trunk/content/accumulo/user_manual_1.3-incubating/Accumulo_Shell.html
==============================================================================
--- websites/staging/accumulo/trunk/content/accumulo/user_manual_1.3-incubating/Accumulo_Shell.html (added)
+++ websites/staging/accumulo/trunk/content/accumulo/user_manual_1.3-incubating/Accumulo_Shell.html Tue Nov 1 17:08:17 2011
@@ -0,0 +1,223 @@
+<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
+<html>
+<head>
+<!--
+
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE- 2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+ <link href="/accumulo/css/accumulo.css" rel="stylesheet" type="text/css">
+ <title>Accumulo User Manual: Accumulo Shell</title>
+ <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
+ <script type="text/javascript">
+
+ var _gaq = _gaq || [];
+ _gaq.push(['_setAccount', 'UA-21103458-6']);
+ _gaq.push(['_trackPageview']);
+
+ (function() {
+ var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true;
+ ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js';
+ var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s);
+ })();
+
+ </script>
+</head>
+
+<body>
+ <div id="banner">
+ <img id="logo" alt="Apache accumulo (Incubating)" src="/accumulo/images/accumulo-logo.png"/>
+ <div id="bannertext">
+
+ </div><br />
+ </div>
+
+ <div id="navigation">
+ <h1 id="project">Project</h1>
+<ul>
+<li><a href="/accumulo">Home</a></li>
+<li><a href="http://incubator.apache.org/projects/accumulo.html">Incubator page</a>
+<!-- - Download --></li>
+<li><a href="/accumulo/notable_features.html">Features</a></li>
+<li><a href="http://www.apache.org/licenses/LICENSE-2.0">License</a></li>
+</ul>
+<h1 id="community">Community</h1>
+<ul>
+<li><a href="/accumulo/get_involved.html">Get Involved</a></li>
+<li><a href="/accumulo/mailing_list.html">Mailing Lists</a></li>
+<li><a href="https://issues.apache.org/jira/secure/ConfigureReport.jspa?versionId=-2&selectedProjectId=12312121&reportKey=com.sourcelabs.jira.plugin.report.contributions%3Acontributionreport">People</a></li>
+</ul>
+<h1 id="development">Development</h1>
+<ul>
+<li><a href="/accumulo/source.html">Source Code</a></li>
+<li><a href="https://issues.apache.org/jira/browse/accumulo">Issues</a></li>
+<li><a href="https://builds.apache.org/job/Accumulo-Trunk">Builds</a></li>
+</ul>
+<h1 id="documentation">Documentation</h1>
+<ul>
+<li><a href="/accumulo/user_manual_1.3-incubating">Manual v1.3</a><ul>
+<li><a href="/accumulo/user_manual_1.3-incubating/examples.html">Examples v1.3</a></li>
+</ul>
+</li>
+<li><a href="/accumulo/user_manual_1.4-incubating">Manual v1.4</a>
+<!-- - klzzwxh:0005 -->
+<!-- - Javadoc -->
+<!-- - Examples --></li>
+<li><a href="/accumulo/screenshots.html">Screenshots</a></li>
+</ul>
+<!--
+# Development
+ - Source code
+ - Building
+-->
+
+<h1 id="asf_links">ASF links</h1>
+<ul>
+<li><a href="http://www.apache.org">Apache Software Foundation</a></li>
+<li><a href="http://www.apache.org/foundation/thanks.html">Thanks</a></li>
+<li><a href="http://www.apache.org/foundation/sponsorship.html">Become a Sponsor</a></li>
+</ul>
+ </div>
+
+ <div id="content">
+ <h1 class="title">Accumulo User Manual: Accumulo Shell</h1>
+ <p><strong> Next:</strong> <a href="Writing_Accumulo_Clients.html">Writing Accumulo Clients</a> <strong> Up:</strong> <a href="accumulo_user_manual.html">Accumulo User Manual Version 1.3</a> <strong> Previous:</strong> <a href="Accumulo_Design.html">Accumulo Design</a> <strong> <a href="Contents.html">Contents</a></strong> <br />
+</p>
+<p><a id=CHILD_LINKS></a><strong>Subsections</strong></p>
+<ul>
+<li><a href="Accumulo_Shell.html#Basic_Administration">Basic Administration</a></li>
+<li><a href="Accumulo_Shell.html#Table_Maintenance">Table Maintenance</a></li>
+<li><a href="Accumulo_Shell.html#User_Administration">User Administration</a></li>
+</ul>
+<hr />
+<h2 id="a_idaccumulo_shella_accumulo_shell"><a id=Accumulo_Shell></a> Accumulo Shell</h2>
+<p>Accumulo provides a simple shell that can be used to examine the contents and configuration settings of tables, apply individual mutations, and change configuration settings. </p>
+<p>The shell can be started by the following command: </p>
+<div class="codehilite"><pre><span class="nv">$ACCUMULO_HOME</span><span class="sr">/bin/</span><span class="n">accumulo</span> <span class="n">shell</span> <span class="o">-</span><span class="n">u</span> <span class="p">[</span><span class="n">username</span><span class="p">]</span>
+</pre></div>
+
+
+<p>The shell will prompt for the corresponding password to the username specified and then display the following prompt: </p>
+<div class="codehilite"><pre><span class="n">Shell</span> <span class="n">Accumulo</span> <span class="n">Interactive</span> <span class="n">Shell</span>
+<span class="o">-</span>
+<span class="o">-</span> <span class="n">version</span> <span class="mf">1.3</span>
+<span class="o">-</span> <span class="n">instance</span> <span class="n">name:</span> <span class="n">myinstance</span>
+<span class="o">-</span> <span class="n">instance</span> <span class="n">id:</span> <span class="mo">00000000</span><span class="o">-</span><span class="mo">0000</span><span class="o">-</span><span class="mo">0000</span><span class="o">-</span><span class="mo">0000</span><span class="o">-</span><span class="mo">000000000000</span>
+<span class="o">-</span>
+<span class="o">-</span> <span class="n">type</span> <span class="s">'help'</span> <span class="k">for</span> <span class="n">a</span> <span class="n">list</span> <span class="n">of</span> <span class="n">available</span> <span class="n">commands</span>
+<span class="o">-</span>
+</pre></div>
+
+
+<h2 id="a_idbasic_administrationa_basic_administration"><a id=Basic_Administration></a> Basic Administration</h2>
+<p>The Accumulo shell can be used to create and delete tables, as well as to configure table and instance specific options. </p>
+<div class="codehilite"><pre><span class="n">root</span><span class="nv">@myinstance</span><span class="o">></span> <span class="n">tables</span>
+<span class="o">!</span><span class="n">METADATA</span>
+
+<span class="n">root</span><span class="nv">@myinstance</span><span class="o">></span> <span class="n">createtable</span> <span class="n">mytable</span>
+
+<span class="n">root</span><span class="nv">@myinstance</span> <span class="n">mytable</span><span class="o">></span>
+
+<span class="n">root</span><span class="nv">@myinstance</span> <span class="n">mytable</span><span class="o">></span> <span class="n">tables</span>
+<span class="o">!</span><span class="n">METADATA</span>
+<span class="n">mytable</span>
+
+<span class="n">root</span><span class="nv">@myinstance</span> <span class="n">mytable</span><span class="o">></span> <span class="n">createtable</span> <span class="n">testtable</span>
+
+<span class="n">root</span><span class="nv">@myinstance</span> <span class="n">testtable</span><span class="o">></span>
+
+<span class="n">root</span><span class="nv">@myinstance</span> <span class="n">junk</span><span class="o">></span> <span class="n">deletetable</span> <span class="n">testtable</span>
+
+<span class="n">root</span><span class="nv">@myinstance</span><span class="o">></span>
+</pre></div>
+
+
+<p>The Shell can also be used to insert updates and scan tables. This is useful for inspecting tables. </p>
+<div class="codehilite"><pre><span class="n">root</span><span class="nv">@myinstance</span> <span class="n">mytable</span><span class="o">></span> <span class="n">scan</span>
+
+<span class="n">root</span><span class="nv">@myinstance</span> <span class="n">mytable</span><span class="o">></span> <span class="n">insert</span> <span class="n">row1</span> <span class="n">colf</span> <span class="n">colq</span> <span class="n">value1</span>
+<span class="n">insert</span> <span class="n">successful</span>
+
+<span class="n">root</span><span class="nv">@myinstance</span> <span class="n">mytable</span><span class="o">></span> <span class="n">scan</span>
+<span class="n">row1</span> <span class="n">colf:colq</span> <span class="o">[]</span> <span class="n">value1</span>
+</pre></div>
+
+
+<h2 id="a_idtable_maintenancea_table_maintenance"><a id=Table_Maintenance></a> Table Maintenance</h2>
+<p>The <strong>compact</strong> command instructs Accumulo to schedule a compaction of the table during which files are consolidated and deleted entries are removed. </p>
+<div class="codehilite"><pre><span class="n">root</span><span class="nv">@myinstance</span> <span class="n">mytable</span><span class="o">></span> <span class="n">compact</span> <span class="o">-</span><span class="n">t</span> <span class="n">mytable</span>
+<span class="mo">07</span> <span class="mi">16</span><span class="p">:</span><span class="mi">13</span><span class="p">:</span><span class="mi">53</span><span class="p">,</span><span class="mi">201</span> <span class="p">[</span><span class="n">shell</span><span class="o">.</span><span class="n">Shell</span><span class="p">]</span> <span class="n">INFO</span> <span class="p">:</span> <span class="n">Compaction</span> <span class="n">of</span> <span class="n">table</span> <span class="n">mytable</span>
+<span class="n">scheduled</span> <span class="k">for</span> <span class="mi">20100707161353</span><span class="n">EDT</span>
+</pre></div>
+
+
+<p>The <strong>flush</strong> command instructs Accumulo to write all entries currently in memory for a given table to disk. </p>
+<div class="codehilite"><pre><span class="n">root</span><span class="nv">@myinstance</span> <span class="n">mytable</span><span class="o">></span> <span class="n">flush</span> <span class="o">-</span><span class="n">t</span> <span class="n">mytable</span>
+<span class="mo">07</span> <span class="mi">16</span><span class="p">:</span><span class="mi">14</span><span class="p">:</span><span class="mi">19</span><span class="p">,</span><span class="mi">351</span> <span class="p">[</span><span class="n">shell</span><span class="o">.</span><span class="n">Shell</span><span class="p">]</span> <span class="n">INFO</span> <span class="p">:</span> <span class="n">Flush</span> <span class="n">of</span> <span class="n">table</span> <span class="n">mytable</span>
+<span class="n">initiated</span><span class="o">...</span>
+</pre></div>
+
+
+<h2 id="a_iduser_administrationa_user_administration"><a id=User_Administration></a> User Administration</h2>
+<p>The Shell can be used to add, remove, and grant privileges to users. </p>
+<div class="codehilite"><pre><span class="n">root</span><span class="nv">@myinstance</span> <span class="n">mytable</span><span class="o">></span> <span class="n">createuser</span> <span class="n">bob</span>
+<span class="n">Enter</span> <span class="k">new</span> <span class="n">password</span> <span class="k">for</span> <span class="s">'bob'</span><span class="p">:</span> <span class="o">*********</span>
+<span class="n">Please</span> <span class="n">confirm</span> <span class="k">new</span> <span class="n">password</span> <span class="k">for</span> <span class="s">'bob'</span><span class="p">:</span> <span class="o">*********</span>
+
+<span class="n">root</span><span class="nv">@myinstance</span> <span class="n">mytable</span><span class="o">></span> <span class="n">authenticate</span> <span class="n">bob</span>
+<span class="n">Enter</span> <span class="n">current</span> <span class="n">password</span> <span class="k">for</span> <span class="s">'bob'</span><span class="p">:</span> <span class="o">*********</span>
+<span class="n">Valid</span>
+
+<span class="n">root</span><span class="nv">@myinstance</span> <span class="n">mytable</span><span class="o">></span> <span class="n">grant</span> <span class="n">System</span><span class="o">.</span><span class="n">CREATE_TABLE</span> <span class="o">-</span><span class="n">s</span> <span class="o">-</span><span class="n">u</span> <span class="n">bob</span>
+
+<span class="n">root</span><span class="nv">@myinstance</span> <span class="n">mytable</span><span class="o">></span> <span class="n">user</span> <span class="n">bob</span>
+<span class="n">Enter</span> <span class="n">current</span> <span class="n">password</span> <span class="k">for</span> <span class="s">'bob'</span><span class="p">:</span> <span class="o">*********</span>
+
+<span class="n">bob</span><span class="nv">@myinstance</span> <span class="n">mytable</span><span class="o">></span> <span class="n">userpermissions</span>
+<span class="n">System</span> <span class="n">permissions:</span> <span class="n">System</span><span class="o">.</span><span class="n">CREATE_TABLE</span>
+<span class="n">Table</span> <span class="n">permissions</span> <span class="p">(</span><span class="o">!</span><span class="n">METADATA</span><span class="p">):</span> <span class="n">Table</span><span class="o">.</span><span class="n">READ</span>
+<span class="n">Table</span> <span class="n">permissions</span> <span class="p">(</span><span class="n">mytable</span><span class="p">):</span> <span class="n">NONE</span>
+
+<span class="n">bob</span><span class="nv">@myinstance</span> <span class="n">mytable</span><span class="o">></span> <span class="n">createtable</span> <span class="n">bobstable</span>
+<span class="n">bob</span><span class="nv">@myinstance</span> <span class="n">bobstable</span><span class="o">></span>
+
+<span class="n">bob</span><span class="nv">@myinstance</span> <span class="n">bobstable</span><span class="o">></span> <span class="n">user</span> <span class="n">root</span>
+<span class="n">Enter</span> <span class="n">current</span> <span class="n">password</span> <span class="k">for</span> <span class="s">'root'</span><span class="p">:</span> <span class="o">*********</span>
+
+<span class="n">root</span><span class="nv">@myinstance</span> <span class="n">bobstable</span><span class="o">></span> <span class="n">revoke</span> <span class="n">System</span><span class="o">.</span><span class="n">CREATE_TABLE</span> <span class="o">-</span><span class="n">s</span> <span class="o">-</span><span class="n">u</span> <span class="n">bob</span>
+</pre></div>
+
+
+<hr />
+<p><strong> Next:</strong> <a href="Writing_Accumulo_Clients.html">Writing Accumulo Clients</a> <strong> Up:</strong> <a href="accumulo_user_manual.html">Accumulo User Manual Version 1.3</a> <strong> Previous:</strong> <a href="Accumulo_Design.html">Accumulo Design</a> <strong> <a href="Contents.html">Contents</a></strong></p>
+ </div>
+
+ <div id="footer">
+ <div class="copyright">
+ <p>
+ Copyright © 2011 The Apache Software Foundation, Licensed under
+ the <a href="http://www.apache.org/licenses/LICENSE-2.0">Apache License, Version 2.0</a>.
+ <br />
+ Apache and the Apache feather logos are trademarks of The Apache Software Foundation.
+ </p>
+ </div>
+ <a alt="Apache Incubator" href="http://incubator.apache.org">
+ <img id="asf-logo" alt="Apache Incubator" src="/accumulo/images/apache-incubator-logo.png" width="150"/>
+ </a>
+
+ </div>
+
+</body>
+</html>
Added: websites/staging/accumulo/trunk/content/accumulo/user_manual_1.3-incubating/Administration.html
==============================================================================
--- websites/staging/accumulo/trunk/content/accumulo/user_manual_1.3-incubating/Administration.html (added)
+++ websites/staging/accumulo/trunk/content/accumulo/user_manual_1.3-incubating/Administration.html Tue Nov 1 17:08:17 2011
@@ -0,0 +1,215 @@
+<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
+<html>
+<head>
+<!--
+
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE- 2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+ <link href="/accumulo/css/accumulo.css" rel="stylesheet" type="text/css">
+ <title>Accumulo User Manual: Administration</title>
+ <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
+ <script type="text/javascript">
+
+ var _gaq = _gaq || [];
+ _gaq.push(['_setAccount', 'UA-21103458-6']);
+ _gaq.push(['_trackPageview']);
+
+ (function() {
+ var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true;
+ ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js';
+ var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s);
+ })();
+
+ </script>
+</head>
+
+<body>
+ <div id="banner">
+ <img id="logo" alt="Apache accumulo (Incubating)" src="/accumulo/images/accumulo-logo.png"/>
+ <div id="bannertext">
+
+ </div><br />
+ </div>
+
+ <div id="navigation">
+ <h1 id="project">Project</h1>
+<ul>
+<li><a href="/accumulo">Home</a></li>
+<li><a href="http://incubator.apache.org/projects/accumulo.html">Incubator page</a>
+<!-- - Download --></li>
+<li><a href="/accumulo/notable_features.html">Features</a></li>
+<li><a href="http://www.apache.org/licenses/LICENSE-2.0">License</a></li>
+</ul>
+<h1 id="community">Community</h1>
+<ul>
+<li><a href="/accumulo/get_involved.html">Get Involved</a></li>
+<li><a href="/accumulo/mailing_list.html">Mailing Lists</a></li>
+<li><a href="https://issues.apache.org/jira/secure/ConfigureReport.jspa?versionId=-2&selectedProjectId=12312121&reportKey=com.sourcelabs.jira.plugin.report.contributions%3Acontributionreport">People</a></li>
+</ul>
+<h1 id="development">Development</h1>
+<ul>
+<li><a href="/accumulo/source.html">Source Code</a></li>
+<li><a href="https://issues.apache.org/jira/browse/accumulo">Issues</a></li>
+<li><a href="https://builds.apache.org/job/Accumulo-Trunk">Builds</a></li>
+</ul>
+<h1 id="documentation">Documentation</h1>
+<ul>
+<li><a href="/accumulo/user_manual_1.3-incubating">Manual v1.3</a><ul>
+<li><a href="/accumulo/user_manual_1.3-incubating/examples.html">Examples v1.3</a></li>
+</ul>
+</li>
+<li><a href="/accumulo/user_manual_1.4-incubating">Manual v1.4</a>
+<!-- - klzzwxh:0005 -->
+<!-- - Javadoc -->
+<!-- - Examples --></li>
+<li><a href="/accumulo/screenshots.html">Screenshots</a></li>
+</ul>
+<!--
+# Development
+ - Source code
+ - Building
+-->
+
+<h1 id="asf_links">ASF links</h1>
+<ul>
+<li><a href="http://www.apache.org">Apache Software Foundation</a></li>
+<li><a href="http://www.apache.org/foundation/thanks.html">Thanks</a></li>
+<li><a href="http://www.apache.org/foundation/sponsorship.html">Become a Sponsor</a></li>
+</ul>
+ </div>
+
+ <div id="content">
+ <h1 class="title">Accumulo User Manual: Administration</h1>
+ <p><strong> Next:</strong> <a href="Shell_Commands.html">Shell Commands</a> <strong> Up:</strong> <a href="accumulo_user_manual.html">Accumulo User Manual Version 1.3</a> <strong> Previous:</strong> <a href="Security.html">Security</a> <strong> <a href="Contents.html">Contents</a></strong> <br />
+</p>
+<p><a id=CHILD_LINKS></a><strong>Subsections</strong></p>
+<ul>
+<li><a href="Administration.html#Hardware">Hardware</a></li>
+<li><a href="Administration.html#Network">Network</a></li>
+<li><a href="Administration.html#Installation">Installation</a></li>
+<li><a href="Administration.html#Dependencies">Dependencies</a></li>
+<li><a href="Administration.html#Configuration">Configuration</a></li>
+<li><a href="Administration.html#Initialization">Initialization</a></li>
+<li><a href="Administration.html#Running">Running</a></li>
+<li><a href="Administration.html#Monitoring">Monitoring</a></li>
+<li><a href="Administration.html#Logging">Logging</a></li>
+<li><a href="Administration.html#Recovery">Recovery</a></li>
+</ul>
+<hr />
+<h2 id="a_idadministrationa_administration"><a id=Administration></a> Administration</h2>
+<h2 id="a_idhardwarea_hardware"><a id=Hardware></a> Hardware</h2>
+<p>Because we are running essentially two or three systems simultaneously layered across the cluster: HDFS, Accumulo and MapReduce, it is typical for hardware to consist of 4 to 8 cores, and 8 to 32 GB RAM. This is so each running process can have at least one core and 2 - 4 GB each. </p>
+<p>One core running HDFS can typically keep 2 to 4 disks busy, so each machine may typically have as little as 2 x 300GB disks and as much as 4 x 1TB or 2TB disks. </p>
+<p>It is possible to do with less than this, such as with 1u servers with 2 cores and 4GB each, but in this case it is recommended to only run up to two processes per machine - i.e. DataNode and TabletServer or DataNode and MapReduce worker but not all three. The constraint here is having enough available heap space for all the processes on a machine. </p>
+<h2 id="a_idnetworka_network"><a id=Network></a> Network</h2>
+<p>Accumulo communicates via remote procedure calls over TCP/IP for both passing data and control messages. In addition, Accumulo uses HDFS clients to communicate with HDFS. To achieve good ingest and query performance, sufficient network bandwidth must be available between any two machines. </p>
+<h2 id="a_idinstallationa_installation"><a id=Installation></a> Installation</h2>
+<p>Choose a directory for the Accumulo installation. This directory will be referenced by the environment variable $ACCUMULO_HOME. Run the following: </p>
+<div class="codehilite"><pre><span class="nv">$</span> <span class="nv">tar</span> <span class="n">xzf</span> <span class="nv">$ACCUMULO_HOME</span><span class="o">/</span><span class="n">accumulo</span><span class="o">.</span><span class="n">tar</span><span class="o">.</span><span class="n">gz</span>
+</pre></div>
+
+
+<p>Repeat this step at each machine within the cluster. Usually all machines have the same $ACCUMULO_HOME. </p>
+<h2 id="a_iddependenciesa_dependencies"><a id=Dependencies></a> Dependencies</h2>
+<p>Accumulo requires HDFS and ZooKeeper to be configured and running before starting. Password-less SSH should be configured between at least the Accumulo master and TabletServer machines. It is also a good idea to run Network Time Protocol (NTP) within the cluster to ensure nodes' clocks don't get too out of sync, which can cause problems with automatically timestamped data. Accumulo will remove from the set of TabletServers those machines whose times differ too much from the master's. </p>
+<h2 id="a_idconfigurationa_configuration"><a id=Configuration></a> Configuration</h2>
+<p>Accumulo is configured by editing several Shell and XML files found in $ACCUMULO_HOME/conf. The structure closely resembles Hadoop's configuration files. </p>
+<h3 id="a_idedit_confaccumulo-envsha_edit_confaccumulo-envsh"><a id=Edit_conf/accumulo-env.sh></a> Edit conf/accumulo-env.sh</h3>
+<p>Accumulo needs to know where to find the software it depends on. Edit accumuloenv. sh and specify the following: </p>
+<ol>
+<li>Enter the location of the installation directory of Accumulo for $ACCUMULO_HOME</li>
+<li>Enter your system's Java home for $JAVA_HOME</li>
+<li>Enter the location of Hadoop for $HADOOP_HOME</li>
+<li>Choose a location for Accumulo logs and enter it for $ACCUMULO_LOG_DIR</li>
+<li>Enter the location of ZooKeeper for $ZOOKEEPER_HOME</li>
+</ol>
+<p>By default Accumulo TabletServers are set to use 1GB of memory. You may change this by altering the value of $ACCUMULO_TSERVER_OPTS. Note the syntax is that of the Java JVM command line options. This value should be less than the physical memory of the machines running TabletServers. </p>
+<p>There are similar options for the master's memory usage and the garbage collector process. Reduce these if they exceed the physical RAM of your hardware and increase them, within the bounds of the physical RAM, if a process fails because of insufficient memory. </p>
+<p>Note that you will be specifying the Java heap space in accumulo-env.sh. You should make sure that the total heap space used for the Accumulo tserver and the Hadoop DataNode and TaskTracker is less than the available memory on each slave node in the cluster. On large clusters, it is recommended that the Accumulo master, Hadoop NameNode, secondary NameNode, and Hadoop JobTracker all be run on separate machines to allow them to use more heap space. If you are running these on the same machine on a small cluster, likewise make sure their heap space settings fit within the available memory. </p>
+<h3 id="a_idcluster_specificationa_cluster_specification"><a id=Cluster_Specification></a> Cluster Specification</h3>
+<p>On the machine that will serve as the Accumulo master: </p>
+<ol>
+<li>Write the IP address or domain name of the Accumulo Master to the <br />
+$ACCUMULO_HOME/conf/masters file. </li>
+<li>Write the IP addresses or domain name of the machines that will be TabletServers in <br />
+$ACCUMULO_HOME/conf/slaves, one per line. </li>
+</ol>
+<p>Note that if using domain names rather than IP addresses, DNS must be configured properly for all machines participating in the cluster. DNS can be a confusing source of errors. </p>
+<h3 id="a_idaccumulo_settingsa_accumulo_settings"><a id=Accumulo_Settings></a> Accumulo Settings</h3>
+<p>Specify appropriate values for the following settings in <br />
+$ACCUMULO_HOME/conf/accumulo-site.xml : </p>
+<div class="codehilite"><pre><span class="nt"><property></span>
+ <span class="nt"><name></span>zookeeper<span class="nt"></name></span>
+ <span class="nt"><value></span>zooserver-one:2181,zooserver-two:2181<span class="nt"></value></span>
+ <span class="nt"><description></span>list of zookeeper servers<span class="nt"></description></span>
+<span class="nt"></property></span>
+<span class="nt"><property></span>
+ <span class="nt"><name></span>walog<span class="nt"></name></span>
+ <span class="nt"><value></span>/var/accumulo/walogs<span class="nt"></value></span>
+ <span class="nt"><description></span>local directory for write ahead logs<span class="nt"></description></span>
+<span class="nt"></property></span>
+</pre></div>
+
+
+<p>This enables Accumulo to find ZooKeeper. Accumulo uses ZooKeeper to coordinate settings between processes and helps finalize TabletServer failure. </p>
+<p>Accumulo records all changes to tables to a write-ahead log before committing them to the table. The `walog' setting specifies the local directory on each machine to which write-ahead logs are written. This directory should exist on all machines acting as TabletServers. </p>
+<p>Some settings can be modified via the Accumulo shell and take effect immediately. However, any settings that should be persisted across system restarts must be recorded in the accumulo-site.xml file. </p>
+<h3 id="a_iddeploy_configurationa_deploy_configuration"><a id=Deploy_Configuration></a> Deploy Configuration</h3>
+<p>Copy the masters, slaves, accumulo-env.sh, and if necessary, accumulo-site.xml from the <br />
+$ACCUMULO_HOME/conf/ directory on the master to all the machines specified in the slaves file. </p>
+<h2 id="a_idinitializationa_initialization"><a id=Initialization></a> Initialization</h2>
+<p>Accumulo must be initialized to create the structures it uses internally to locate data across the cluster. HDFS is required to be configured and running before Accumulo can be initialized. </p>
+<p>Once HDFS is started, initialization can be performed by executing <br />
+$ACCUMULO_HOME/bin/accumulo init . This script will prompt for a name for this instance of Accumulo. The instance name is used to identify a set of tables and instance-specific settings. The script will then write some information into HDFS so Accumulo can start properly. </p>
+<p>The initialization script will prompt you to set a root password. Once Accumulo is initialized it can be started. </p>
+<h2 id="a_idrunninga_running"><a id=Running></a> Running</h2>
+<h3 id="a_idstarting_accumuloa_starting_accumulo"><a id=Starting_Accumulo></a> Starting Accumulo</h3>
+<p>Make sure Hadoop is configured on all of the machines in the cluster, including access to a shared HDFS instance. Make sure HDFS and ZooKeeper are running. Make sure ZooKeeper is configured and running on at least one machine in the cluster. Start Accumulo using the bin/start-all.sh script. </p>
+<p>To verify that Accumulo is running, check the Status page as described under <em>Monitoring</em>. In addition, the Shell can provide some information about the status of tables via reading the !METADATA table. </p>
+<h3 id="a_idstopping_accumuloa_stopping_accumulo"><a id=Stopping_Accumulo></a> Stopping Accumulo</h3>
+<p>To shutdown cleanly, run bin/stop-all.sh and the master will orchestrate the shutdown of all the tablet servers. Shutdown waits for all minor compactions to finish, so it may take some time for particular configurations. </p>
+<h2 id="a_idmonitoringa_monitoring"><a id=Monitoring></a> Monitoring</h2>
+<p>The Accumulo Master provides an interface for monitoring the status and health of Accumulo components. This interface can be accessed by pointing a web browser to <br />
+http://accumulomaster:50095/status</p>
+<h2 id="a_idlogginga_logging"><a id=Logging></a> Logging</h2>
+<p>Accumulo processes each write to a set of log files. By default these are found under <br />
+$ACCUMULO/logs/. </p>
+<h2 id="a_idrecoverya_recovery"><a id=Recovery></a> Recovery</h2>
+<p>In the event of TabletServer failure or error on shutting Accumulo down, some mutations may not have been minor compacted to HDFS properly. In this case, Accumulo will automatically reapply such mutations from the write-ahead log either when the tablets from the failed server are reassigned by the Master, in the case of a single TabletServer failure or the next time Accumulo starts, in the event of failure during shutdown. </p>
+<p>Recovery is performed by asking the loggers to copy their write-ahead logs into HDFS. As the logs are copied, they are also sorted, so that tablets can easily find their missing updates. The copy/sort status of each file is displayed on Accumulo monitor status page. Once the recovery is complete any tablets involved should return to an ``online" state. Until then those tablets will be unavailable to clients. </p>
+<p>The Accumulo client library is configured to retry failed mutations and in many cases clients will be able to continue processing after the recovery process without throwing an exception. </p>
+<p>Note that because Accumulo uses timestamps to order mutations, any mutations that are applied as part of the recovery process should appear to have been applied when they originally arrived at the TabletServer that failed. This makes the ordering of mutations consistent in the presence of failure. </p>
+<hr />
+<p><strong> Next:</strong> <a href="Shell_Commands.html">Shell Commands</a> <strong> Up:</strong> <a href="accumulo_user_manual.html">Accumulo User Manual Version 1.3</a> <strong> Previous:</strong> <a href="Security.html">Security</a> <strong> <a href="Contents.html">Contents</a></strong></p>
+ </div>
+
+ <div id="footer">
+ <div class="copyright">
+ <p>
+ Copyright © 2011 The Apache Software Foundation, Licensed under
+ the <a href="http://www.apache.org/licenses/LICENSE-2.0">Apache License, Version 2.0</a>.
+ <br />
+ Apache and the Apache feather logos are trademarks of The Apache Software Foundation.
+ </p>
+ </div>
+ <a alt="Apache Incubator" href="http://incubator.apache.org">
+ <img id="asf-logo" alt="Apache Incubator" src="/accumulo/images/apache-incubator-logo.png" width="150"/>
+ </a>
+
+ </div>
+
+</body>
+</html>
Added: websites/staging/accumulo/trunk/content/accumulo/user_manual_1.3-incubating/Analytics.html
==============================================================================
--- websites/staging/accumulo/trunk/content/accumulo/user_manual_1.3-incubating/Analytics.html (added)
+++ websites/staging/accumulo/trunk/content/accumulo/user_manual_1.3-incubating/Analytics.html Tue Nov 1 17:08:17 2011
@@ -0,0 +1,225 @@
+<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
+<html>
+<head>
+<!--
+
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE- 2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+ <link href="/accumulo/css/accumulo.css" rel="stylesheet" type="text/css">
+ <title>Accumulo User Manual: Analytics</title>
+ <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
+ <script type="text/javascript">
+
+ var _gaq = _gaq || [];
+ _gaq.push(['_setAccount', 'UA-21103458-6']);
+ _gaq.push(['_trackPageview']);
+
+ (function() {
+ var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true;
+ ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js';
+ var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s);
+ })();
+
+ </script>
+</head>
+
+<body>
+ <div id="banner">
+ <img id="logo" alt="Apache accumulo (Incubating)" src="/accumulo/images/accumulo-logo.png"/>
+ <div id="bannertext">
+
+ </div><br />
+ </div>
+
+ <div id="navigation">
+ <h1 id="project">Project</h1>
+<ul>
+<li><a href="/accumulo">Home</a></li>
+<li><a href="http://incubator.apache.org/projects/accumulo.html">Incubator page</a>
+<!-- - Download --></li>
+<li><a href="/accumulo/notable_features.html">Features</a></li>
+<li><a href="http://www.apache.org/licenses/LICENSE-2.0">License</a></li>
+</ul>
+<h1 id="community">Community</h1>
+<ul>
+<li><a href="/accumulo/get_involved.html">Get Involved</a></li>
+<li><a href="/accumulo/mailing_list.html">Mailing Lists</a></li>
+<li><a href="https://issues.apache.org/jira/secure/ConfigureReport.jspa?versionId=-2&selectedProjectId=12312121&reportKey=com.sourcelabs.jira.plugin.report.contributions%3Acontributionreport">People</a></li>
+</ul>
+<h1 id="development">Development</h1>
+<ul>
+<li><a href="/accumulo/source.html">Source Code</a></li>
+<li><a href="https://issues.apache.org/jira/browse/accumulo">Issues</a></li>
+<li><a href="https://builds.apache.org/job/Accumulo-Trunk">Builds</a></li>
+</ul>
+<h1 id="documentation">Documentation</h1>
+<ul>
+<li><a href="/accumulo/user_manual_1.3-incubating">Manual v1.3</a><ul>
+<li><a href="/accumulo/user_manual_1.3-incubating/examples.html">Examples v1.3</a></li>
+</ul>
+</li>
+<li><a href="/accumulo/user_manual_1.4-incubating">Manual v1.4</a>
+<!-- - klzzwxh:0005 -->
+<!-- - Javadoc -->
+<!-- - Examples --></li>
+<li><a href="/accumulo/screenshots.html">Screenshots</a></li>
+</ul>
+<!--
+# Development
+ - Source code
+ - Building
+-->
+
+<h1 id="asf_links">ASF links</h1>
+<ul>
+<li><a href="http://www.apache.org">Apache Software Foundation</a></li>
+<li><a href="http://www.apache.org/foundation/thanks.html">Thanks</a></li>
+<li><a href="http://www.apache.org/foundation/sponsorship.html">Become a Sponsor</a></li>
+</ul>
+ </div>
+
+ <div id="content">
+ <h1 class="title">Accumulo User Manual: Analytics</h1>
+ <p><strong> Next:</strong> <a href="Security.html">Security</a> <strong> Up:</strong> <a href="accumulo_user_manual.html">Accumulo User Manual Version 1.3</a> <strong> Previous:</strong> <a href="High_Speed_Ingest.html">High-Speed Ingest</a> <strong> <a href="Contents.html">Contents</a></strong> <br />
+</p>
+<p><a id=CHILD_LINKS></a><strong>Subsections</strong></p>
+<ul>
+<li><a href="Analytics.html#MapReduce">MapReduce</a></li>
+<li><a href="Analytics.html#Aggregating_Iterators">Aggregating Iterators</a></li>
+<li><a href="Analytics.html#Statistical_Modeling">Statistical Modeling</a></li>
+</ul>
+<hr />
+<h2 id="a_idanalyticsa_analytics"><a id=Analytics></a> Analytics</h2>
+<p>Accumulo supports more advanced data processing than simply keeping keys sorted and performing efficient lookups. Analytics can be developed by using MapReduce and Iterators in conjunction with Accumulo tables. </p>
+<h2 id="a_idmapreducea_mapreduce"><a id=MapReduce></a> MapReduce</h2>
+<p>Accumulo tables can be used as the source and destination of MapReduce jobs. To use a Accumulo table with a MapReduce job (specifically with the new Hadoop API as of version 0.20), configure the job parameters to use the AccumuloInputFormat and AccumuloOutputFormat. Accumulo specific parameters can be set via these two format classes to do the following: </p>
+<ul>
+<li>Authenticate and provide user credentials for the input </li>
+<li>Restrict the scan to a range of rows </li>
+<li>Restrict the input to a subset of available columns </li>
+</ul>
+<h3 id="a_idmapper_and_reducer_classesa_mapper_and_reducer_classes"><a id=Mapper_and_Reducer_classes></a> Mapper and Reducer classes</h3>
+<p>To read from a Accumulo table create a Mapper with the following class parameterization and be sure to configure the AccumuloInputFormat. </p>
+<div class="codehilite"><pre><span class="n">class</span> <span class="n">MyMapper</span> <span class="n">extends</span> <span class="n">Mapper</span><span class="sr"><Key,Value,WritableComparable,Writable></span> <span class="p">{</span>
+ <span class="n">public</span> <span class="n">void</span> <span class="nb">map</span><span class="p">(</span><span class="n">Key</span> <span class="n">k</span><span class="p">,</span> <span class="n">Value</span> <span class="n">v</span><span class="p">,</span> <span class="n">Context</span> <span class="n">c</span><span class="p">)</span> <span class="p">{</span>
+ <span class="sr">//</span> <span class="n">transform</span> <span class="n">key</span> <span class="ow">and</span> <span class="n">value</span> <span class="n">data</span> <span class="n">here</span>
+ <span class="p">}</span>
+<span class="p">}</span>
+</pre></div>
+
+
+<p>To write to a Accumulo table, create a Reducer with the following class parameterization and be sure to configure the AccumuloOutputFormat. The key emitted from the Reducer identifies the table to which the mutation is sent. This allows a single Reducer to write to more than one table if desired. A default table can be configured using the AccumuloOutputFormat, in which case the output table name does not have to be passed to the Context object within the Reducer. </p>
+<div class="codehilite"><pre><span class="n">class</span> <span class="n">MyReducer</span> <span class="n">extends</span> <span class="n">Reducer</span><span class="o"><</span><span class="n">WritableComparable</span><span class="p">,</span> <span class="n">Writable</span><span class="p">,</span> <span class="n">Text</span><span class="p">,</span> <span class="n">Mutation</span><span class="o">></span> <span class="p">{</span>
+
+ <span class="n">public</span> <span class="n">void</span> <span class="n">reduce</span><span class="p">(</span><span class="n">WritableComparable</span> <span class="n">key</span><span class="p">,</span> <span class="n">Iterator</span><span class="sr"><Text></span> <span class="nb">values</span><span class="p">,</span> <span class="n">Context</span> <span class="n">c</span><span class="p">)</span> <span class="p">{</span>
+
+ <span class="n">Mutation</span> <span class="n">m</span><span class="p">;</span>
+
+ <span class="sr">//</span> <span class="n">create</span> <span class="n">the</span> <span class="n">mutation</span> <span class="n">based</span> <span class="n">on</span> <span class="n">input</span> <span class="n">key</span> <span class="ow">and</span> <span class="n">value</span>
+
+ <span class="n">c</span><span class="o">.</span><span class="nb">write</span><span class="p">(</span><span class="k">new</span> <span class="n">Text</span><span class="p">(</span><span class="s">"output-table"</span><span class="p">),</span> <span class="n">m</span><span class="p">);</span>
+ <span class="p">}</span>
+<span class="p">}</span>
+</pre></div>
+
+
+<p>The Text object passed as the output should contain the name of the table to which this mutation should be applied. The Text can be null in which case the mutation will be applied to the default table name specified in the AccumuloOutputFormat options. </p>
+<h3 id="a_idaccumuloinputformat_optionsa_accumuloinputformat_options"><a id=AccumuloInputFormat_options></a> AccumuloInputFormat options</h3>
+<div class="codehilite"><pre><span class="n">Job</span> <span class="n">job</span> <span class="o">=</span> <span class="k">new</span> <span class="n">Job</span><span class="p">(</span><span class="n">getConf</span><span class="p">());</span>
+<span class="n">AccumuloInputFormat</span><span class="o">.</span><span class="n">setInputInfo</span><span class="p">(</span><span class="n">job</span><span class="p">,</span>
+ <span class="s">"user"</span><span class="p">,</span>
+ <span class="s">"passwd"</span><span class="o">.</span><span class="n">getBytes</span><span class="p">(),</span>
+ <span class="s">"table"</span><span class="p">,</span>
+ <span class="k">new</span> <span class="n">Authorizations</span><span class="p">());</span>
+
+<span class="n">AccumuloInputFormat</span><span class="o">.</span><span class="n">setZooKeeperInstance</span><span class="p">(</span><span class="n">job</span><span class="p">,</span> <span class="s">"myinstance"</span><span class="p">,</span>
+ <span class="s">"zooserver-one,zooserver-two"</span><span class="p">);</span>
+</pre></div>
+
+
+<p><strong>Optional settings:</strong></p>
+<p>To restrict Accumulo to a set of row ranges: </p>
+<div class="codehilite"><pre><span class="n">ArrayList</span><span class="sr"><Range></span> <span class="n">ranges</span> <span class="o">=</span> <span class="k">new</span> <span class="n">ArrayList</span><span class="sr"><Range></span><span class="p">();</span>
+<span class="sr">//</span> <span class="n">populate</span> <span class="n">array</span> <span class="n">list</span> <span class="n">of</span> <span class="n">row</span> <span class="n">ranges</span> <span class="o">...</span>
+<span class="n">AccumuloInputFormat</span><span class="o">.</span><span class="n">setRanges</span><span class="p">(</span><span class="n">job</span><span class="p">,</span> <span class="n">ranges</span><span class="p">);</span>
+</pre></div>
+
+
+<p>To restrict accumulo to a list of columns: </p>
+<div class="codehilite"><pre><span class="n">ArrayList</span><span class="sr"><Pair<Text,Text></span><span class="o">></span> <span class="n">columns</span> <span class="o">=</span> <span class="k">new</span> <span class="n">ArrayList</span><span class="sr"><Pair<Text,Text></span><span class="o">></span><span class="p">();</span>
+<span class="sr">//</span> <span class="n">populate</span> <span class="n">list</span> <span class="n">of</span> <span class="n">columns</span>
+<span class="n">AccumuloInputFormat</span><span class="o">.</span><span class="n">fetchColumns</span><span class="p">(</span><span class="n">job</span><span class="p">,</span> <span class="n">columns</span><span class="p">);</span>
+</pre></div>
+
+
+<p>To use a regular expression to match row IDs: </p>
+<div class="codehilite"><pre><span class="n">AccumuloInputFormat</span><span class="o">.</span><span class="n">setRegex</span><span class="p">(</span><span class="n">job</span><span class="p">,</span> <span class="n">RegexType</span><span class="o">.</span><span class="n">ROW</span><span class="p">,</span> <span class="s">"^.*"</span><span class="p">);</span>
+</pre></div>
+
+
+<h3 id="a_idaccumulooutputformat_optionsa_accumulooutputformat_options"><a id=AccumuloOutputFormat_options></a> AccumuloOutputFormat options</h3>
+<div class="codehilite"><pre><span class="n">boolean</span> <span class="n">createTables</span> <span class="o">=</span> <span class="n">true</span><span class="p">;</span>
+<span class="n">String</span> <span class="n">defaultTable</span> <span class="o">=</span> <span class="s">"mytable"</span><span class="p">;</span>
+
+<span class="n">AccumuloOutputFormat</span><span class="o">.</span><span class="n">setOutputInfo</span><span class="p">(</span><span class="n">job</span><span class="p">,</span>
+ <span class="s">"user"</span><span class="p">,</span>
+ <span class="s">"passwd"</span><span class="o">.</span><span class="n">getBytes</span><span class="p">(),</span>
+ <span class="n">createTables</span><span class="p">,</span>
+ <span class="n">defaultTable</span><span class="p">);</span>
+
+<span class="n">AccumuloOutputFormat</span><span class="o">.</span><span class="n">setZooKeeperInstance</span><span class="p">(</span><span class="n">job</span><span class="p">,</span> <span class="s">"myinstance"</span><span class="p">,</span>
+ <span class="s">"zooserver-one,zooserver-two"</span><span class="p">);</span>
+</pre></div>
+
+
+<p><strong>Optional Settings:</strong></p>
+<div class="codehilite"><pre><span class="n">AccumuloOutputFormat</span><span class="o">.</span><span class="n">setMaxLatency</span><span class="p">(</span><span class="n">job</span><span class="p">,</span> <span class="mi">300</span><span class="p">);</span> <span class="sr">//</span> <span class="n">milliseconds</span>
+<span class="n">AccumuloOutputFormat</span><span class="o">.</span><span class="n">setMaxMutationBufferSize</span><span class="p">(</span><span class="n">job</span><span class="p">,</span> <span class="mi">5000000</span><span class="p">);</span> <span class="sr">//</span> <span class="n">bytes</span>
+</pre></div>
+
+
+<p>An example of using MapReduce with Accumulo can be found at <br />
+accumulo/docs/examples/README.mapred </p>
+<h2 id="a_idaggregating_iteratorsa_aggregating_iterators"><a id=Aggregating_Iterators></a> Aggregating Iterators</h2>
+<p>Many applications can benefit from the ability to aggregate values across common keys. This can be done via aggregating iterators and is similar to the Reduce step in MapReduce. This provides the ability to define online, incrementally updated analytics without the overhead or latency associated with batch-oriented MapReduce jobs. </p>
+<p>All that is needed to aggregate values of a table is to identify the fields over which values will be grouped, insert mutations with those fields as the key, and configure the table with an aggregating iterator that supports the summarization operation desired. </p>
+<p>The only restriction on an aggregating iterator is that the aggregator developer should not assume that all values for a given key have been seen, since new mutations can be inserted at anytime. This precludes using the total number of values in the aggregation such as when calculating an average, for example. </p>
+<h3 id="a_idfeature_vectorsa_feature_vectors"><a id=Feature_Vectors></a> Feature Vectors</h3>
+<p>An interesting use of aggregating iterators within a Accumulo table is to store feature vectors for use in machine learning algorithms. For example, many algorithms such as k-means clustering, support vector machines, anomaly detection, etc. use the concept of a feature vector and the calculation of distance metrics to learn a particular model. The columns in a Accumulo table can be used to efficiently store sparse features and their weights to be incrementally updated via the use of an aggregating iterator. </p>
+<h2 id="a_idstatistical_modelinga_statistical_modeling"><a id=Statistical_Modeling></a> Statistical Modeling</h2>
+<p>Statistical models that need to be updated by many machines in parallel could be similarly stored within a Accumulo table. For example, a MapReduce job that is iteratively updating a global statistical model could have each map or reduce worker reference the parts of the model to be read and updated through an embedded Accumulo client. </p>
+<p>Using Accumulo this way enables efficient and fast lookups and updates of small pieces of information in a random access pattern, which is complementary to MapReduce's sequential access model. </p>
+<hr />
+<p><strong> Next:</strong> <a href="Security.html">Security</a> <strong> Up:</strong> <a href="accumulo_user_manual.html">Accumulo User Manual Version 1.3</a> <strong> Previous:</strong> <a href="High_Speed_Ingest.html">High-Speed Ingest</a> <strong> <a href="Contents.html">Contents</a></strong></p>
+ </div>
+
+ <div id="footer">
+ <div class="copyright">
+ <p>
+ Copyright © 2011 The Apache Software Foundation, Licensed under
+ the <a href="http://www.apache.org/licenses/LICENSE-2.0">Apache License, Version 2.0</a>.
+ <br />
+ Apache and the Apache feather logos are trademarks of The Apache Software Foundation.
+ </p>
+ </div>
+ <a alt="Apache Incubator" href="http://incubator.apache.org">
+ <img id="asf-logo" alt="Apache Incubator" src="/accumulo/images/apache-incubator-logo.png" width="150"/>
+ </a>
+
+ </div>
+
+</body>
+</html>
Added: websites/staging/accumulo/trunk/content/accumulo/user_manual_1.3-incubating/Contents.html
==============================================================================
--- websites/staging/accumulo/trunk/content/accumulo/user_manual_1.3-incubating/Contents.html (added)
+++ websites/staging/accumulo/trunk/content/accumulo/user_manual_1.3-incubating/Contents.html Tue Nov 1 17:08:17 2011
@@ -0,0 +1,291 @@
+<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
+<html>
+<head>
+<!--
+
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE- 2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+ <link href="/accumulo/css/accumulo.css" rel="stylesheet" type="text/css">
+ <title>Accumulo User Manual: Contents</title>
+ <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
+ <script type="text/javascript">
+
+ var _gaq = _gaq || [];
+ _gaq.push(['_setAccount', 'UA-21103458-6']);
+ _gaq.push(['_trackPageview']);
+
+ (function() {
+ var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true;
+ ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js';
+ var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s);
+ })();
+
+ </script>
+</head>
+
+<body>
+ <div id="banner">
+ <img id="logo" alt="Apache accumulo (Incubating)" src="/accumulo/images/accumulo-logo.png"/>
+ <div id="bannertext">
+
+ </div><br />
+ </div>
+
+ <div id="navigation">
+ <h1 id="project">Project</h1>
+<ul>
+<li><a href="/accumulo">Home</a></li>
+<li><a href="http://incubator.apache.org/projects/accumulo.html">Incubator page</a>
+<!-- - Download --></li>
+<li><a href="/accumulo/notable_features.html">Features</a></li>
+<li><a href="http://www.apache.org/licenses/LICENSE-2.0">License</a></li>
+</ul>
+<h1 id="community">Community</h1>
+<ul>
+<li><a href="/accumulo/get_involved.html">Get Involved</a></li>
+<li><a href="/accumulo/mailing_list.html">Mailing Lists</a></li>
+<li><a href="https://issues.apache.org/jira/secure/ConfigureReport.jspa?versionId=-2&selectedProjectId=12312121&reportKey=com.sourcelabs.jira.plugin.report.contributions%3Acontributionreport">People</a></li>
+</ul>
+<h1 id="development">Development</h1>
+<ul>
+<li><a href="/accumulo/source.html">Source Code</a></li>
+<li><a href="https://issues.apache.org/jira/browse/accumulo">Issues</a></li>
+<li><a href="https://builds.apache.org/job/Accumulo-Trunk">Builds</a></li>
+</ul>
+<h1 id="documentation">Documentation</h1>
+<ul>
+<li><a href="/accumulo/user_manual_1.3-incubating">Manual v1.3</a><ul>
+<li><a href="/accumulo/user_manual_1.3-incubating/examples.html">Examples v1.3</a></li>
+</ul>
+</li>
+<li><a href="/accumulo/user_manual_1.4-incubating">Manual v1.4</a>
+<!-- - klzzwxh:0005 -->
+<!-- - Javadoc -->
+<!-- - Examples --></li>
+<li><a href="/accumulo/screenshots.html">Screenshots</a></li>
+</ul>
+<!--
+# Development
+ - Source code
+ - Building
+-->
+
+<h1 id="asf_links">ASF links</h1>
+<ul>
+<li><a href="http://www.apache.org">Apache Software Foundation</a></li>
+<li><a href="http://www.apache.org/foundation/thanks.html">Thanks</a></li>
+<li><a href="http://www.apache.org/foundation/sponsorship.html">Become a Sponsor</a></li>
+</ul>
+ </div>
+
+ <div id="content">
+ <h1 class="title">Accumulo User Manual: Contents</h1>
+ <p><strong> Next:</strong> <a href="Introduction.html">Introduction</a> <strong> Up:</strong> <a href="accumulo_user_manual.html">Accumulo User Manual Version 1.3</a> <strong> Previous:</strong> <a href="accumulo_user_manual.html">Accumulo User Manual Version 1.3</a> <br />
+</p>
+<h3 id="a_idcontentsa_contents"><a id=Contents></a> Contents</h3>
+<ul>
+<li><a href="Introduction.html">Introduction</a></li>
+<li>
+<p><a href="Accumulo_Design.html">Accumulo Design</a></p>
+<ul>
+<li><a href="Accumulo_Design.html#Data_Model">Data Model</a></li>
+<li><a href="Accumulo_Design.html#Architecture">Architecture</a></li>
+<li>
+<p><a href="Accumulo_Design.html#Components">Components</a></p>
+<ul>
+<li><a href="Accumulo_Design.html#Tablet_Server">Tablet Server</a></li>
+<li><a href="Accumulo_Design.html#Loggers">Loggers</a></li>
+<li><a href="Accumulo_Design.html#Garbage_Collector">Garbage Collector</a></li>
+<li><a href="Accumulo_Design.html#Master">Master</a></li>
+<li><a href="Accumulo_Design.html#Client">Client</a></li>
+</ul>
+</li>
+<li>
+<p><a href="Accumulo_Design.html#Data_Management">Data Management</a></p>
+</li>
+<li><a href="Accumulo_Design.html#Tablet_Service">Tablet Service</a></li>
+<li><a href="Accumulo_Design.html#Compactions">Compactions</a></li>
+<li><a href="Accumulo_Design.html#Fault-Tolerance">Fault-Tolerance</a></li>
+</ul>
+</li>
+<li>
+<p><a href="Accumulo_Shell.html">Accumulo Shell</a></p>
+<ul>
+<li><a href="Accumulo_Shell.html#Basic_Administration">Basic Administration</a></li>
+<li><a href="Accumulo_Shell.html#Table_Maintenance">Table Maintenance</a></li>
+<li><a href="Accumulo_Shell.html#User_Administration">User Administration</a></li>
+</ul>
+</li>
+<li>
+<p><a href="Writing_Accumulo_Clients.html">Writing Accumulo Clients</a></p>
+<ul>
+<li>
+<p><a href="Writing_Accumulo_Clients.html#Writing_Data">Writing Data</a></p>
+<ul>
+<li><a href="Writing_Accumulo_Clients.html#BatchWriter">BatchWriter</a></li>
+</ul>
+</li>
+<li>
+<p><a href="Writing_Accumulo_Clients.html#Reading_Data">Reading Data</a></p>
+<ul>
+<li><a href="Writing_Accumulo_Clients.html#Scanner">Scanner</a></li>
+<li><a href="Writing_Accumulo_Clients.html#BatchScanner">BatchScanner</a></li>
+</ul>
+</li>
+</ul>
+</li>
+<li>
+<p><a href="Table_Configuration.html">Table Configuration</a></p>
+<ul>
+<li>
+<p><a href="Table_Configuration.html#Locality_Groups">Locality Groups</a></p>
+<ul>
+<li><a href="Table_Configuration.html#Managing_Locality_Groups_via_the_Shell">Managing Locality Groups via the Shell</a></li>
+<li><a href="Table_Configuration.html#Managing_Locality_Groups_via_the_Client_API">Managing Locality Groups via the Client API</a></li>
+</ul>
+</li>
+<li>
+<p><a href="Table_Configuration.html#Constraints">Constraints</a></p>
+</li>
+<li><a href="Table_Configuration.html#Bloom_Filters">Bloom Filters</a></li>
+<li>
+<p><a href="Table_Configuration.html#Iterators">Iterators</a></p>
+<ul>
+<li><a href="Table_Configuration.html#Setting_Iterators_via_the_Shell">Setting Iterators via the Shell</a></li>
+<li><a href="Table_Configuration.html#Setting_Iterators_Programmatically">Setting Iterators Programmatically</a></li>
+</ul>
+</li>
+<li>
+<p><a href="Table_Configuration.html#Versioning_Iterators_and_Timestamps">Versioning Iterators and Timestamps</a></p>
+<ul>
+<li><a href="Table_Configuration.html#Logical_Time">Logical Time</a></li>
+<li><a href="Table_Configuration.html#Deletes">Deletes</a></li>
+</ul>
+</li>
+<li>
+<p><a href="Table_Configuration.html#Filtering_Iterators">Filtering Iterators</a></p>
+</li>
+<li><a href="Table_Configuration.html#Aggregating_Iterators">Aggregating Iterators</a></li>
+</ul>
+</li>
+<li>
+<p><a href="Table_Design.html">Table Design</a></p>
+<ul>
+<li><a href="Table_Design.html#Basic_Table">Basic Table</a></li>
+<li><a href="Table_Design.html#RowID_Design">RowID Design</a></li>
+<li><a href="Table_Design.html#Indexing">Indexing</a></li>
+<li><a href="Table_Design.html#Entity-Attribute_and_Graph_Tables">Entity-Attribute and Graph Tables</a></li>
+<li><a href="Table_Design.html#Document-Partitioned_Indexing">Document-Partitioned Indexing</a></li>
+</ul>
+</li>
+<li>
+<p><a href="High_Speed_Ingest.html">High-Speed Ingest</a></p>
+<ul>
+<li><a href="High_Speed_Ingest.html#Pre-Splitting_New_Tables">Pre-Splitting New Tables</a></li>
+<li><a href="High_Speed_Ingest.html#Multiple_Ingester_Clients">Multiple Ingester Clients</a></li>
+<li><a href="High_Speed_Ingest.html#Bulk_Ingest">Bulk Ingest</a></li>
+<li><a href="High_Speed_Ingest.html#MapReduce_Ingest">MapReduce Ingest</a></li>
+</ul>
+</li>
+<li>
+<p><a href="Analytics.html">Analytics</a></p>
+<ul>
+<li>
+<p><a href="Analytics.html#MapReduce">MapReduce</a></p>
+<ul>
+<li><a href="Analytics.html#Mapper_and_Reducer_classes">Mapper and Reducer classes</a></li>
+<li><a href="Analytics.html#AccumuloInputFormat_options">AccumuloInputFormat options</a></li>
+<li><a href="Analytics.html#AccumuloOutputFormat_options">AccumuloOutputFormat options</a></li>
+</ul>
+</li>
+<li>
+<p><a href="Analytics.html#Aggregating_Iterators">Aggregating Iterators</a></p>
+<ul>
+<li><a href="Analytics.html#Feature_Vectors">Feature Vectors</a></li>
+</ul>
+</li>
+<li>
+<p><a href="Analytics.html#Statistical_Modeling">Statistical Modeling</a></p>
+</li>
+</ul>
+</li>
+<li>
+<p><a href="Security.html">Security</a></p>
+<ul>
+<li><a href="Security.html#Security_Label_Expressions">Security Label Expressions</a></li>
+<li><a href="Security.html#Security_Label_Expression_Syntax">Security Label Expression Syntax</a></li>
+<li><a href="Security.html#Authorization">Authorization</a></li>
+<li><a href="Security.html#Secure_Authorizations_Handling">Secure Authorizations Handling</a></li>
+<li><a href="Security.html#Query_Services_Layer">Query Services Layer</a></li>
+</ul>
+</li>
+<li>
+<p><a href="Administration.html">Administration</a></p>
+<ul>
+<li><a href="Administration.html#Hardware">Hardware</a></li>
+<li><a href="Administration.html#Network">Network</a></li>
+<li><a href="Administration.html#Installation">Installation</a></li>
+<li><a href="Administration.html#Dependencies">Dependencies</a></li>
+<li>
+<p><a href="Administration.html#Configuration">Configuration</a></p>
+<ul>
+<li><a href="Administration.html#Edit_conf/accumulo-env.sh">Edit conf/accumulo-env.sh</a></li>
+<li><a href="Administration.html#Cluster_Specification">Cluster Specification</a></li>
+<li><a href="Administration.html#Accumulo_Settings">Accumulo Settings</a></li>
+<li><a href="Administration.html#Deploy_Configuration">Deploy Configuration</a></li>
+</ul>
+</li>
+<li>
+<p><a href="Administration.html#Initialization">Initialization</a></p>
+</li>
+<li>
+<p><a href="Administration.html#Running">Running</a></p>
+<ul>
+<li><a href="Administration.html#Starting_Accumulo">Starting Accumulo</a></li>
+<li><a href="Administration.html#Stopping_Accumulo">Stopping Accumulo</a></li>
+</ul>
+</li>
+<li>
+<p><a href="Administration.html#Monitoring">Monitoring</a></p>
+</li>
+<li><a href="Administration.html#Logging">Logging</a></li>
+<li><a href="Administration.html#Recovery">Recovery</a></li>
+</ul>
+</li>
+<li>
+<p><a href="Shell_Commands.html">Shell Commands</a></p>
+</li>
+</ul>
+<hr />
+ </div>
+
+ <div id="footer">
+ <div class="copyright">
+ <p>
+ Copyright © 2011 The Apache Software Foundation, Licensed under
+ the <a href="http://www.apache.org/licenses/LICENSE-2.0">Apache License, Version 2.0</a>.
+ <br />
+ Apache and the Apache feather logos are trademarks of The Apache Software Foundation.
+ </p>
+ </div>
+ <a alt="Apache Incubator" href="http://incubator.apache.org">
+ <img id="asf-logo" alt="Apache Incubator" src="/accumulo/images/apache-incubator-logo.png" width="150"/>
+ </a>
+
+ </div>
+
+</body>
+</html>