svn commit: r929839 - in /websites/staging/jena/trunk/content: ./ documentation/hadoop/index.html

[bu...@apache.org]

Author: buildbot
Date: Thu Nov 20 09:16:54 2014
New Revision: 929839

Log:
Staging update by buildbot for jena

Modified:
    websites/staging/jena/trunk/content/   (props changed)
    websites/staging/jena/trunk/content/documentation/hadoop/index.html

Propchange: websites/staging/jena/trunk/content/
------------------------------------------------------------------------------
--- cms:source-revision (original)
+++ cms:source-revision Thu Nov 20 09:16:54 2014
@@ -1 +1 @@
-1639994
+1640699

Modified: websites/staging/jena/trunk/content/documentation/hadoop/index.html
==============================================================================
--- websites/staging/jena/trunk/content/documentation/hadoop/index.html (original)
+++ websites/staging/jena/trunk/content/documentation/hadoop/index.html Thu Nov 20 09:16:54 2014
@@ -19,7 +19,7 @@
     limitations under the License.
 -->
 
-  <title>Apache Jena - RDF Tools for Hadoop</title>
+  <title>Apache Jena - RDF Tools for Apache Hadoop</title>
   <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
   <meta name="viewport" content="width=device-width, initial-scale=1.0">
 
@@ -145,9 +145,13 @@
 	<div class="row">
 	<div class="col-md-12">
 	<div id="breadcrumbs"></div>
-	<h1 class="title">RDF Tools for Hadoop</h1>
-  <p>RDF Tools for Hadoop is a set of libraries which provide various basic building blocks which enable
+	<h1 class="title">RDF Tools for Apache Hadoop</h1>
+  <p>RDF Tools for Apache Hadoop is a set of libraries which provide various basic building blocks which enable
 you to start writing Hadoop based applications which work with RDF data.</p>
+<p>Historically there has been no serious support for RDF within the Hadoop ecosystem and what support has existed has
+often been limited and task specific.  These libraries aim to be as generic as possible and provide the necessary
+infrastructure that enables developers to create their application specific logic without worrying about the
+underlying plumbing.</p>
 <h2 id="documentation">Documentation</h2>
 <ul>
 <li><a href="#overview">Overview</a></li>
@@ -165,18 +169,22 @@ you to start writing Hadoop based applic
 <li><a href="artifacts.html">Maven Artifacts for Jena JDBC</a></li>
 </ul>
 <h2 id="overview">Overview</h2>
-<p>Jena JDBC aims to be a pure SPARQL over JDBC driver, it assumes that all commands that come in are
-either SPARQL queries or updates and processes them as such.</p>
-<p>As detailed on the <a href="drivers.html">drivers</a> page there are actually three drivers provided currently:</p>
-<ul>
-<li><a href="drivers.html#in-memory">In-Memory</a> - uses an in-memory dataset to provide non-persistent storage</li>
-<li><a href="drivers.html#tdb">TDB</a> - uses a <a href="/documentation/tdb/">TDB</a> dataset to provide persistent and transactional storage</li>
-<li><a href="drivers.html#remote-endpoint">Remote Endpoint</a> - uses HTTP based remote endpoints to access any SPARQL protocol compliant storage</li>
-</ul>
-<p>These are all built on a core library which can be used to build <a href="custom_driver.html">custom drivers</a>
-if desired.  This means that all drivers share common infrastructure and thus exhibit broadly speaking
-the same behavior around handling queries, updates and results.</p>
-<p>Jena JDBC is published as a Maven module via its <a href="artifacts.html">maven artifacts</a>.  The source for Jena JDBC may be <a href="/download/index.cgi">downloaded</a> as part of the source distribution.</p>
+<p>RDF Tools for Apache Hadoop is published as a set of Maven module via its <a href="artifacts.html">maven artifacts</a>.  The source for this libraries
+may be <a href="/download/index.cgi">downloaded</a> as part of the source distribution.  These modules are built against the Hadoop 2.x. APIs and no
+backwards compatibility for 1.x is provided.</p>
+<p>The core aim of these libraries it to provide the basic building blocks that allow users to start writing Hadoop applications that
+work with RDF.  They are mostly fairly low level components but they are designed to be used as building blocks to help users and developers
+focus on actual application logic rather than on the low level plumbing.</p>
+<p>Firstly at the lowest level they provide <code>Writable</code> implementations that allow the basic RDF primitives - nodes, triples and quads -
+to be represented and exchanged within Hadoop applications, this support is provided by the <a href="common.html">Common</a> library.</p>
+<p>Secondly they provide support for all the RDF serialisations which Jena supports as both input and output formats subject to the specific 
+limitations of those serialisations.  This support is provided by the <a href="io.html">IO</a> library in the form of standard <code>InputFormat</code> and
+<code>OutputFormat</code> implementations.</p>
+<p>There are also a set of basic <code>Mapper</code> and <code>Reducer</code> implementations provided by the <a href="mapred.html">Map/Reduce</a> library which contains code
+that enables various common Hadoop tasks such as counting, filtering, splitting and grouping to be carried out on RDF data.  Typically these
+will be used as a starting point to build more complex RDF processing applications.</p>
+<p>Finally there is a <a href="demo.html">RDF Stats Demo</a> which is a runnable Hadoop job JAR file that demonstrates using these libraries to calculate
+a number of basic statistics over arbitrary RDF data.</p>
 <h2 id="getting-started">Getting Started</h2>
 <p>To get started you will need to add the relevant dependencies to your project, the exact dependencies necessary will depend 
 on what you are trying to do.  Typically you will likely need at least the IO library and possibly the Map/Reduce library:</p>