You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@jena.apache.org by gi...@apache.org on 2021/11/14 09:55:45 UTC
[jena-site] branch asf-site updated: Updated site from main (77206b2ce7782b665f1514bc57a947616e0a14fc)
This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/jena-site.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 715206d Updated site from main (77206b2ce7782b665f1514bc57a947616e0a14fc)
715206d is described below
commit 715206df937428f939681a2e1f7a91d7233d6627
Author: jenkins <bu...@apache.org>
AuthorDate: Sun Nov 14 09:55:41 2021 +0000
Updated site from main (77206b2ce7782b665f1514bc57a947616e0a14fc)
---
content/documentation/index.xml | 13 ++
content/documentation/tdb/tdb-xloader.html | 236 +++++++++++++++++++++++++++++
content/index.xml | 13 ++
content/sitemap.xml | 7 +-
4 files changed, 268 insertions(+), 1 deletion(-)
diff --git a/content/documentation/index.xml b/content/documentation/index.xml
index da10f93..bc957ce 100644
--- a/content/documentation/index.xml
+++ b/content/documentation/index.xml
@@ -1788,6 +1788,19 @@ The file access mechanism can be set explicitly, but this is not a good idea for
</item>
<item>
+ <title>TDB xloader</title>
+ <link>https://jena.apache.org/documentation/tdb/tdb-xloader.html</link>
+ <pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate>
+
+ <guid>https://jena.apache.org/documentation/tdb/tdb-xloader.html</guid>
+ <description>TDB xloader (&ldquo;x&rdquo; for external) is a bulkloader for very large datasets. The goal is stability and reliability for long running loading, running on modest and
+xloader is not a replacement for regular TDB1 and TDB2 loaders.
+&ldquo;tdb1.xloader&rdquo; was called &ldquo;tdbloader2&rdquo; and has some improvements.
+It is not as fast as other TDB loaders on dataset where the general loaders work on without encountering progressive slowdown.
+The xloaders for TDB1 and TDB2 are not identical.</description>
+ </item>
+
+ <item>
<title>TDB2</title>
<link>https://jena.apache.org/documentation/tdb2/</link>
<pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate>
diff --git a/content/documentation/tdb/tdb-xloader.html b/content/documentation/tdb/tdb-xloader.html
new file mode 100644
index 0000000..c7ba640
--- /dev/null
+++ b/content/documentation/tdb/tdb-xloader.html
@@ -0,0 +1,236 @@
+<!DOCTYPE html>
+<html lang="en">
+<head>
+
+
+ <title>Apache Jena - TDB xloader</title>
+ <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
+ <meta name="viewport" content="width=device-width, initial-scale=1.0">
+
+ <link href="/css/bootstrap.min.css" rel="stylesheet" media="screen">
+ <link href="/css/bootstrap-extension.css" rel="stylesheet" type="text/css">
+ <link href="/css/jena.css" rel="stylesheet" type="text/css">
+ <link rel="shortcut icon" href="/images/favicon.ico" />
+
+ <script src="https://code.jquery.com/jquery-2.2.4.min.js"
+ integrity="sha256-BbhdlvQf/xTY9gja0Dq3HiwQF8LaCRTXxZKRutelT44="
+ crossorigin="anonymous"></script>
+ <script src="/js/jena-navigation.js" type="text/javascript"></script>
+ <script src="/js/bootstrap.min.js" type="text/javascript"></script>
+
+ <script src="/js/improve.js" type="text/javascript"></script>
+
+
+</head>
+
+<body>
+
+<nav class="navbar navbar-default" role="navigation">
+ <div class="container">
+ <div class="navbar-header">
+ <button type="button" class="navbar-toggle" data-toggle="collapse" data-target=".navbar-ex1-collapse">
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ </button>
+ <a class="navbar-brand" href="/index.html">
+ <img class="logo-menu" src="/images/jena-logo/jena-logo-notext-small.png" alt="jena logo">Apache Jena</a>
+ </div>
+
+ <div class="collapse navbar-collapse navbar-ex1-collapse">
+ <ul class="nav navbar-nav">
+ <li id="homepage"><a href="/index.html"><span class="glyphicon glyphicon-home"></span> Home</a></li>
+ <li id="download"><a href="/download/index.cgi"><span class="glyphicon glyphicon-download-alt"></span> Download</a></li>
+ <li class="dropdown">
+ <a href="#" class="dropdown-toggle" data-toggle="dropdown"><span class="glyphicon glyphicon-book"></span> Learn <b class="caret"></b></a>
+ <ul class="dropdown-menu">
+ <li class="dropdown-header">Tutorials</li>
+ <li><a href="/tutorials/index.html">Overview</a></li>
+ <li><a href="/tutorials/rdf_api.html">RDF core API tutorial</a></li>
+ <li><a href="/tutorials/sparql.html">SPARQL tutorial</a></li>
+ <li><a href="/documentation/query/manipulating_sparql_using_arq.html">Manipulating SPARQL using ARQ</a></li>
+ <li><a href="/tutorials/using_jena_with_eclipse.html">Using Jena with Eclipse</a></li>
+ <li><a href="/documentation/notes/index.html">How-To's</a></li>
+ <li class="divider"></li>
+ <li class="dropdown-header">References</li>
+ <li><a href="/documentation/index.html">Overview</a></li>
+ <li><a href="/documentation/javadoc.html">Javadoc</a></li>
+ <li><a href="/documentation/rdf/index.html">RDF API</a></li>
+ <li><a href="/documentation/io/">RDF I/O</a></li>
+ <li><a href="/documentation/fuseki2/index.html">Fuseki</a></li>
+ <li><a href="/documentation/query/index.html">ARQ (SPARQL)</a></li>
+ <li><a href="/documentation/rdfconnection/">RDF Connection - SPARQL API</a></li>
+ <li><a href="/documentation/rdfs/">Data with RDFS Inferencing</a></li>
+ <li><a href="/documentation/tdb/index.html">TDB</a></li>
+ <li><a href="/documentation/tdb2/index.html">TDB2</a></li>
+ <li><a href="/documentation/query/text-query.html">Text Search</a></li>
+ <li><a href="/documentation/shacl/index.html">SHACL</a></li>
+ <li><a href="/documentation/shex/index.html">ShEx</a></li>
+ <li><a href="/documentation/rdfstar/index.html">RDF-star</a></li>
+ <li><a href="/documentation/tools/index.html">Command-line tools</a></li>
+ <li><a href="/documentation/jdbc/index.html">SPARQL over JDBC</a></li>
+ <li><a href="/documentation/permissions/index.html">Permissions</a></li>
+ <li><a href="/documentation/assembler/index.html">Assembler</a></li>
+ <li><a href="/documentation/ontology/">Ontology API</a></li>
+ <li><a href="/documentation/inference/index.html">Inference API</a></li>
+ <li><a href="/documentation/extras/querybuilder/index.html">Query Builder</a></li>
+ </ul>
+ </li>
+
+ <li class="drop down">
+ <a href="#" class="dropdown-toggle" data-toggle="dropdown"><span class="glyphicon glyphicon-book"></span> Javadoc <b class="caret"></b></a>
+ <ul class="dropdown-menu">
+ <li><a href="/documentation/javadoc/jena/">Jena Core</a></li>
+ <li><a href="/documentation/javadoc/arq/">ARQ</a></li>
+ <li><a href="/documentation/javadoc/tdb/">TDB</a></li>
+ <li><a href="/documentation/javadoc/fuseki2/">Fuseki</a></li>
+ <li><a href="/documentation/javadoc_elephas.html">Elephas</a></li>
+ <li><a href="/documentation/javadoc/text/">Text Search</a></li>
+ <li><a href="/documentation/javadoc/shacl/">SHACL</a></li>
+ <li><a href="/documentation/javadoc/geosparql/">GeoSPARQL</a></li>
+ <li><a href="/documentation/javadoc/permissions/">Permissions</a></li>
+ <li><a href="/documentation/javadoc/jdbc/">JDBC</a></li>
+ <li><a href="/documentation/javadoc/extras/querybuilder/">Query Builder</a></li>
+ <li><a href="/documentation/javadoc.html">All Javadoc</a></li>
+ </ul>
+ </li>
+
+ <li id="ask"><a href="/help_and_support/index.html"><span class="glyphicon glyphicon-question-sign"></span> Ask</a></li>
+
+ <li class="dropdown">
+ <a href="#" class="dropdown-toggle" data-toggle="dropdown"><span class="glyphicon glyphicon-bullhorn"></span> Get involved <b class="caret"></b></a>
+ <ul class="dropdown-menu">
+ <li><a href="/getting_involved/index.html">Contribute</a></li>
+ <li><a href="/help_and_support/bugs_and_suggestions.html">Report a bug</a></li>
+ <li class="divider"></li>
+ <li class="dropdown-header">Project</li>
+ <li><a href="/about_jena/about.html">About Jena</a></li>
+ <li><a href="/about_jena/roadmap.html">Roadmap</a></li>
+ <li><a href="/about_jena/architecture.html">Architecture</a></li>
+ <li><a href="/about_jena/team.html">Project team</a></li>
+ <li><a href="/about_jena/contributions.html">Related projects</a></li>
+ <li class="divider"></li>
+ <li class="dropdown-header">ASF</li>
+ <li><a href="http://www.apache.org/">Apache Software Foundation</a></li>
+ <li><a href="http://www.apache.org/licenses/LICENSE-2.0">License</a></li>
+ <li><a href="http://www.apache.org/foundation/thanks.html">Thanks</a></li>
+ <li><a href="http://www.apache.org/foundation/sponsorship.html">Become a Sponsor</a></li>
+ <li><a href="http://www.apache.org/security/">Security</a></li>
+ </ul>
+ </li>
+
+ <li id="edit"><a href="https://github.com/apache/jena-site/edit/main/source/documentation/tdb/tdb-xloader.md" title="Edit this page on GitHub"><span class="glyphicon glyphicon-pencil"></span> Edit this page</a></li>
+ </ul>
+ </div>
+ </div>
+</nav>
+
+
+<div class="container">
+ <div class="row">
+ <div class="col-md-12">
+ <div id="breadcrumbs">
+
+
+
+
+
+
+
+<ol class="breadcrumb">
+
+
+
+
+
+
+
+
+ <li><a href='/documentation'>DOCUMENTATION</a></li>
+
+
+
+
+
+
+
+ <li><a href='/documentation/tdb'>TDB</a></li>
+
+
+
+
+
+
+
+ <li class="active">TDB XLOADER</li>
+
+
+
+
+</ol>
+
+
+
+
+
+ </div>
+ <h1 class="title">TDB xloader</h1>
+
+ <p>TDB xloader (“x” for external) is a bulkloader for very large datasets. The goal
+is stability and reliability for long running loading, running on modest and</p>
+<p>xloader is not a replacement for regular TDB1 and TDB2 loaders.</p>
+<p>“tdb1.xloader” was called “tdbloader2” and has some improvements.</p>
+<p>It is not as fast as other TDB loaders on dataset where the general loaders work
+on without encountering progressive slowdown.</p>
+<p>The xloaders for TDB1 and TDB2 are not identical. The TDB2 is more capable; it
+is based on the same design approach with further refinements to building the
+node table and to reduce the total amount of temporary file space used.</p>
+<p>The xloader does not run on MS Windows. It uses and external sort program from
+unix - <code>sort(1)</code>.</p>
+<p>The xloader only builds a fresh database from empty.
+It can not be used to load an existing database.</p>
+<h3 id="running-xloader">Running xloader</h3>
+<p><code>tdb2.xloader --loc DIRECTORY</code> FILE…</p>
+<p>or</p>
+<p><code>tdb1.xloader --loc DIRECTORY</code> FILE…</p>
+<p>Additioally, there is an argument <code>--tmpdir</code> to use a different directory for
+temporary files.</p>
+<p><code>FILE</code> is any RDF syntax supported by Jena.</p>
+<h3 id="advice">Advice</h3>
+<p><code>xloader</code> uses a lot of temporary disk space.</p>
+<p>To avoid a load failing due to a syntax or other data error, it is advisable to
+run <code>riot --check</code> on the data first. Parsing is faster than loading.</p>
+<p>If desired, the data can be converted to <a href="../io/rdf-binary.html">RDF Thrift</a> at
+this stage by adding <code>--stream rdf-thrift</code> to the riot checking run.
+Parsing RDF Thrift is faster than parsing N-Triples although the bulk of the loading process is not limited by parser speed.</p>
+<p>Do not capture the bulk loader output in a file on the same disk as the database
+or temporary directory; it slows loading down.</p>
+
+
+ </div>
+ </div>
+
+</div>
+
+<footer class="footer">
+ <div class="container">
+ <p>
+ Copyright © 2011–2021 The Apache Software Foundation, Licensed under the
+ <a href="http://www.apache.org/licenses/LICENSE-2.0">Apache License, Version 2.0</a>.
+ </p>
+ <p>
+ Apache Jena, Jena, the Apache Jena project logo, Apache and the Apache feather logos are trademarks of
+ The Apache Software Foundation.
+ </p>
+ </div>
+</footer>
+
+
+<script type="text/javascript">
+ var link = $('a[href="' + this.location.pathname + '"]');
+ if (link != undefined)
+ link.parents('li,ul').addClass('active');
+</script>
+
+</body>
+</html>
diff --git a/content/index.xml b/content/index.xml
index 09bc99d..82b9568 100644
--- a/content/index.xml
+++ b/content/index.xml
@@ -2061,6 +2061,19 @@ The file access mechanism can be set explicitly, but this is not a good idea for
</item>
<item>
+ <title>TDB xloader</title>
+ <link>https://jena.apache.org/documentation/tdb/tdb-xloader.html</link>
+ <pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate>
+
+ <guid>https://jena.apache.org/documentation/tdb/tdb-xloader.html</guid>
+ <description>TDB xloader (&ldquo;x&rdquo; for external) is a bulkloader for very large datasets. The goal is stability and reliability for long running loading, running on modest and
+xloader is not a replacement for regular TDB1 and TDB2 loaders.
+&ldquo;tdb1.xloader&rdquo; was called &ldquo;tdbloader2&rdquo; and has some improvements.
+It is not as fast as other TDB loaders on dataset where the general loaders work on without encountering progressive slowdown.
+The xloaders for TDB1 and TDB2 are not identical.</description>
+ </item>
+
+ <item>
<title>TDB2</title>
<link>https://jena.apache.org/documentation/tdb2/</link>
<pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate>
diff --git a/content/sitemap.xml b/content/sitemap.xml
index 46815ad..8b85b4d 100644
--- a/content/sitemap.xml
+++ b/content/sitemap.xml
@@ -324,7 +324,7 @@
<url>
<loc>https://jena.apache.org/documentation.html</loc>
- <lastmod>2021-11-03T15:06:49+03:00</lastmod>
+ <lastmod>2021-11-12T12:33:33+00:00</lastmod>
</url>
<url>
@@ -983,6 +983,11 @@
</url>
<url>
+ <loc>https://jena.apache.org/documentation/tdb/tdb-xloader.html</loc>
+ <lastmod>2021-11-12T12:33:33+00:00</lastmod>
+ </url>
+
+ <url>
<loc>https://jena.apache.org/documentation/tdb2/</loc>
<lastmod>2020-05-01T11:11:56+12:00</lastmod>
</url>