You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@jackrabbit.apache.org by th...@apache.org on 2018/08/30 11:48:46 UTC
svn commit: r1839663 [10/22] - in /jackrabbit/site/live/oak/docs: ./
architecture/ coldstandby/ features/ nodestore/ nodestore/document/
nodestore/segment/ oak-mongo-js/ oak_api/ plugins/ query/ security/
security/accesscontrol/ security/authentication...
Modified: jackrabbit/site/live/oak/docs/query/oak-run-indexing.html
URL: http://svn.apache.org/viewvc/jackrabbit/site/live/oak/docs/query/oak-run-indexing.html?rev=1839663&r1=1839662&r2=1839663&view=diff
==============================================================================
--- jackrabbit/site/live/oak/docs/query/oak-run-indexing.html (original)
+++ jackrabbit/site/live/oak/docs/query/oak-run-indexing.html Thu Aug 30 11:48:45 2018
@@ -1,15 +1,15 @@
<!DOCTYPE html>
<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8.1 at 2018-08-29
+ | Generated by Apache Maven Doxia Site Renderer 1.7.4 at 2018-02-21
| Rendered using Apache Maven Fluido Skin 1.6
-->
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<meta charset="UTF-8" />
<meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20180829" />
+ <meta name="Date-Revision-yyyymmdd" content="20180221" />
<meta http-equiv="Content-Language" content="en" />
- <title>Jackrabbit Oak – Oak Run Indexing</title>
+ <title>Jackrabbit Oak – <a name="oak-run-indexing"></a> Oak Run Indexing</title>
<link rel="stylesheet" href="../css/apache-maven-fluido-1.6.min.css" />
<link rel="stylesheet" href="../css/site.css" />
<link rel="stylesheet" href="../css/print.css" media="print" />
@@ -52,7 +52,6 @@
<a href="#" class="dropdown-toggle" data-toggle="dropdown">Main APIs <b class="caret"></b></a>
<ul class="dropdown-menu">
<li><a href="http://www.day.com/specs/jcr/2.0/index.html" title="JCR API">JCR API</a></li>
- <li><a href="https://jackrabbit.apache.org/jcr/jcr-api.html" title="Jackrabbit API">Jackrabbit API</a></li>
<li><a href="../oak_api/overview.html" title="Oak API">Oak API</a></li>
</ul>
</li>
@@ -67,12 +66,7 @@
<li><a href="../nodestore/compositens.html" title="Composite NodeStore">Composite NodeStore</a></li>
</ul>
</li>
- <li class="dropdown-submenu">
-<a href="../plugins/blobstore.html" title="Blob Storage">Blob Storage</a>
- <ul class="dropdown-menu">
- <li><a href="../features/direct-binary-access.html" title="Direct Binary Access">Direct Binary Access</a></li>
- </ul>
- </li>
+ <li><a href="../plugins/blobstore.html" title="Blob Storage">Blob Storage</a></li>
<li class="dropdown-submenu">
<a href="../query/query.html" title="Query">Query</a>
<ul class="dropdown-menu">
@@ -142,7 +136,7 @@
<div id="breadcrumbs">
<ul class="breadcrumb">
- <li id="publishDate">Last Published: 2018-08-29<span class="divider">|</span>
+ <li id="publishDate">Last Published: 2018-02-21<span class="divider">|</span>
</li>
<li id="projectVersion">Version: 1.10-SNAPSHOT</li>
</ul>
@@ -161,14 +155,12 @@
<li><a href="../architecture/nodestate.html" title="The Node State Model"><span class="none"></span>The Node State Model</a> </li>
<li class="nav-header">Main APIs</li>
<li><a href="http://www.day.com/specs/jcr/2.0/index.html" class="externalLink" title="JCR API"><span class="none"></span>JCR API</a> </li>
- <li><a href="https://jackrabbit.apache.org/jcr/jcr-api.html" class="externalLink" title="Jackrabbit API"><span class="none"></span>Jackrabbit API</a> </li>
<li><a href="../oak_api/overview.html" title="Oak API"><span class="none"></span>Oak API</a> </li>
<li class="nav-header">Features and Plugins</li>
<li><a href="../nodestore/overview.html" title="Node Storage"><span class="icon-chevron-down"></span>Node Storage</a>
<ul class="nav nav-list">
<li><a href="../nodestore/documentmk.html" title="Document NodeStore"><span class="icon-chevron-down"></span>Document NodeStore</a>
<ul class="nav nav-list">
- <li><a href="../nodestore/document/mongo-document-store.html" title="MongoDB DocumentStore"><span class="none"></span>MongoDB DocumentStore</a> </li>
<li><a href="../nodestore/document/node-bundling.html" title="Node Bundling"><span class="none"></span>Node Bundling</a> </li>
<li><a href="../nodestore/document/secondary-store.html" title="Secondary Store"><span class="none"></span>Secondary Store</a> </li>
<li><a href="../nodestore/persistent-cache.html" title="Persistent Cache"><span class="none"></span>Persistent Cache</a> </li>
@@ -179,11 +171,7 @@
<li><a href="../nodestore/compositens.html" title="Composite NodeStore"><span class="none"></span>Composite NodeStore</a> </li>
</ul>
</li>
- <li><a href="../plugins/blobstore.html" title="Blob Storage"><span class="icon-chevron-down"></span>Blob Storage</a>
- <ul class="nav nav-list">
- <li><a href="../features/direct-binary-access.html" title="Direct Binary Access"><span class="none"></span>Direct Binary Access</a> </li>
- </ul>
- </li>
+ <li><a href="../plugins/blobstore.html" title="Blob Storage"><span class="none"></span>Blob Storage</a> </li>
<li><a href="../query/query.html" title="Query"><span class="icon-chevron-down"></span>Query</a>
<ul class="nav nav-list">
<li><a href="../query/query-engine.html" title="Query Engine"><span class="none"></span>Query Engine</a> </li>
@@ -251,51 +239,66 @@
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
- -->
-<h1><a name="oak-run-indexing"></a> Oak Run Indexing</h1>
-<ul>
+ --><h1><a name="oak-run-indexing"></a> Oak Run Indexing</h1>
+<ul>
+
<li><a href="#oak-run-indexing">Oak Run Indexing</a>
+
<ul>
-
+
<li><a href="#common-options">Common Options</a></li>
+
<li><a href="#index-info">Generate Index Info</a></li>
+
<li><a href="#dump-index-defn">Dump Index Definitions</a></li>
+
<li><a href="#async-index-data">Dump Index Data</a></li>
+
<li><a href="#check-index">Index Consistency Check</a></li>
+
<li><a href="#reindex">Reindex</a>
+
<ul>
-
+
<li><a href="#out-of-band-indexing">A - out-of-band indexing</a>
+
<ul>
-
+
<li><a href="#out-of-band-pre-extraction">Step 1 - Text PreExtraction</a></li>
+
<li><a href="#out-of-band-create-checkpoint">Step 2 - Create Checkpoint</a></li>
+
<li><a href="#out-of-band-perform-reindex">Step 3 - Perform Reindex</a></li>
+
<li><a href="#out-of-band-import-reindex">Step 4 - Import the index</a>
+
<ul>
-
+
<li><a href="#import-index-oak-run">4.1 - Via oak-run</a></li>
+
<li><a href="#import-index-mbean">4.2 - Via IndexerMBean</a></li>
+
<li><a href="#import-index-script">4.3 - Via script</a></li>
-</ul>
-</li>
-</ul>
-</li>
+ </ul></li>
+ </ul></li>
+
<li><a href="#online-indexing">B - Online indexing</a>
+
<ul>
-
+
<li><a href="#online-indexing-pre-extract">Step 1 - Text PreExtraction</a></li>
+
<li><a href="#online-indexing-perform-reindex">Step 2 - Perform reindexing</a></li>
-</ul>
-</li>
+ </ul></li>
+
<li><a href="#index-definition-updates">Updating or Adding New Index Definitions</a></li>
+
<li><a href="#json-file-format">JSON File Format</a></li>
+
<li><a href="#tika-setup">Tika Setup</a></li>
-</ul>
-</li>
-</ul>
-</li>
+ </ul></li>
+ </ul></li>
</ul>
<p><tt>@since Oak 1.7.0</tt></p>
<p><b>Work in progress. Not to be used on production setups</b></p>
@@ -306,63 +309,60 @@
<div class="section">
<h2><a name="Common_Options"></a><a name="common-options"></a> Common Options</h2>
<p>All the commands support following common options</p>
-<ol style="list-style-type: decimal">
-<li><tt>--index-paths</tt> - Comma separated list of index paths for which the selected operations need to be performed. If not specified then the operation would be performed against all the indexes.</li>
+<ol style="list-style-type: decimal">
+
+<li><tt>--index-paths</tt> - Comma separated list of index paths for which the selected operations need to be performed. If not specified then the operation would be performed against all the indexes.</li>
</ol>
<p>Also refer to help output via <tt>-h</tt> command for some other options</p></div>
<div class="section">
<h2><a name="Generate_Index_Info"></a><a name="index-info"></a> Generate Index Info</h2>
-<div>
-<div>
-<pre class="source">java -jar oak-run*.jar index --fds-path=/path/to/datastore /path/to/segmentstore/ --index-info
+<div class="source">
+<div class="source"><pre class="prettyprint">java -jar oak-run*.jar index --fds-path=/path/to/datastore /path/to/segmentstore/ --index-info
</pre></div></div>
-
<p>Generates a report consisting of various stats related to indexes present in the given repository. The generated report is stored by default in <tt><output dir>/index-info.txt</tt></p>
<p>Supported for all index types</p></div>
<div class="section">
<h2><a name="Dump_Index_Definitions"></a><a name="dump-index-defn"></a> Dump Index Definitions</h2>
-<div>
-<div>
-<pre class="source">java -jar oak-run*.jar index --fds-path=/path/to/datastore /path/to/segmentstore/ --index-definitions
+<div class="source">
+<div class="source"><pre class="prettyprint">java -jar oak-run*.jar index --fds-path=/path/to/datastore /path/to/segmentstore/ --index-definitions
</pre></div></div>
-
<p><tt>--index-definitions</tt> operation dumps the index definition in json format to a file <tt><output dir>/index-definitions.json</tt>. The json file contains index definitions keyed against the index paths</p>
<p>Supported for all index types</p></div>
<div class="section">
<h2><a name="Dump_Index_Data"></a><a name="async-index-data"></a> Dump Index Data</h2>
-<div>
-<div>
-<pre class="source">java -jar oak-run*.jar index --fds-path=/path/to/datastore /path/to/segmentstore/ --index-dump
+<div class="source">
+<div class="source"><pre class="prettyprint">java -jar oak-run*.jar index --fds-path=/path/to/datastore /path/to/segmentstore/ --index-dump
</pre></div></div>
-
<p><tt>--index-dump</tt> operation dumps the index content in output directory. The output directory would contain one folder for each index. Each folder would have a property file <tt>index-details.txt</tt> which contains <tt>indexPath</tt></p>
<p>Supported for only Lucene indexes.</p></div>
<div class="section">
<h2><a name="Index_Consistency_Check"></a><a name="check-index"></a> Index Consistency Check</h2>
-<div>
-<div>
-<pre class="source">java -jar oak-run*.jar index --fds-path=/path/to/datastore /path/to/segmentstore/ --index-consistency-check
+<div class="source">
+<div class="source"><pre class="prettyprint">java -jar oak-run*.jar index --fds-path=/path/to/datastore /path/to/segmentstore/ --index-consistency-check
</pre></div></div>
-
<p><tt>--index-consistency-check</tt> operation performs index consistency check against various indexes. It supports 2 level</p>
-<ul>
-<li>Level 1 - Specified as <tt>--index-consistency-check=1</tt>. Performs a basic check to determine if all blobs referred in index are valid</li>
-<li>Level 2 - Specified as <tt>--index-consistency-check=2</tt>. Performs a more through check to determine if all index files are valid and no corruption has happened. This check is slower</li>
+<ul>
+
+<li>Level 1 - Specified as <tt>--index-consistency-check=1</tt>. Performs a basic check to determine if all blobs referred in index are valid</li>
+
+<li>Level 2 - Specified as <tt>--index-consistency-check=2</tt>. Performs a more through check to determine if all index files are valid and no corruption has happened. This check is slower</li>
</ul>
<p>It would generate a report in <tt><output dir>/index-consistency-check-report.txt</tt></p>
<p>Supported for only Lucene indexes.</p></div>
<div class="section">
<h2><a name="Reindex"></a><a name="reindex"></a> Reindex</h2>
<p>The reindex operation supports 2 modes of index</p>
-<ul>
+<ul>
+
<li>Out-of-band indexing - Here oak-run would connect to repository in read only mode. It would require certain manual steps</li>
+
<li>Online Indexing - Here oak-run would connect to repository in <tt>--read-write</tt> mode</li>
</ul>
<p>Supported for only Lucene indexes.</p>
@@ -370,37 +370,43 @@
<div class="section">
<h3><a name="A_-_out-of-band_indexing"></a><a name="out-of-band-indexing"></a> A - out-of-band indexing</h3>
<p>Out of band indexing has following phases</p>
-<ol style="list-style-type: decimal">
+<ol style="list-style-type: decimal">
+
<li>Get checkpoint issued</li>
+
<li>Perform indexing with read only connection to NodeStore upto checkpoint state</li>
+
<li>Import the generated indexes</li>
+
<li>Complete the increment indexing from checkpoint state to current head</li>
</ol>
<div class="section">
<h4><a name="Step_1_-_Text_PreExtraction"></a><a name="out-of-band-pre-extraction"></a> Step 1 - Text PreExtraction</h4>
-<p>If the index being reindexed involves fulltext index and the repository has binary content then its recommended that first <a href="pre-extract-text.html">text pre-extraction</a> is performed. This ensures that costly operation around text extraction is done prior to actual indexing so that actual indexing does not do text extraction in critical path</p></div>
+<p>If the index being reindexed involves fulltext index and the repository has binary content then its recommended that first <a href="pre-extract-text.html">text pre-extraction</a> is performed. This ensures that costly operation around text extraction is done prior to actual indexing so that actual indexing does not do text extraction in critical path</p></div>
<div class="section">
<h4><a name="Step_2_-_Create_Checkpoint"></a><a name="out-of-band-create-checkpoint"></a>Step 2 - Create Checkpoint</h4>
-<p>Go to <tt>CheckpointMBean</tt> and create a checkpoint with a long enough lifetime like 10 days. For this invoke <tt>CheckpointMBean#createCheckpoint</tt> with 864000000 as argument for lifetime</p></div>
+<p>Go to <tt>CheckpointMBean</tt> and create a checkpoint with a long enough lifetime like 10 days. For this invoke <tt>CheckpointMBean#createCheckpoint</tt> with 864000000 as argument for lifetime</p></div>
<div class="section">
<h4><a name="Step_3_-_Perform_Reindex"></a><a name="out-of-band-perform-reindex"></a> Step 3 - Perform Reindex</h4>
-<p>In this step we perform the actual indexing via oak-run where it connects to repository in read only mode.</p>
+<p>In this step we perform the actual indexing via oak-run where it connects to repository in read only mode. </p>
-<div>
-<div>
-<pre class="source"> java -jar oak-run*.jar index --reindex \
+<div class="source">
+<div class="source"><pre class="prettyprint"> java -jar oak-run*.jar index --reindex \
--index-paths=/oak:index/indexName \
- --checkpoint=0fd2a388-de87-47d3-8f30-e86b1cf0a081 \
+ --checkpoint=0fd2a388-de87-47d3-8f30-e86b1cf0a081 \
--fds-path=/path/to/datastore /path/to/segmentstore/
</pre></div></div>
-
<p>Here following options can be used</p>
-<ul>
+<ul>
+
<li><tt>--pre-extracted-text-dir</tt> - Directory path containing pre extracted text generated via step #1 (optional)</li>
+
<li><tt>--index-paths</tt> - This command requires an explicit set of index paths which need to be indexed (required)</li>
-<li><tt>--checkpoint</tt> - The checkpoint up to which the index is updated, when indexing in read only mode. For testing purpose, it can be set to ‘head’ to indicate that the head state should be used. (required)</li>
+
+<li><tt>--checkpoint</tt> - The checkpoint up to which the index is updated, when indexing in read only mode. For testing purpose, it can be set to ‘head’ to indicate that the head state should be used. (required)</li>
+
<li><tt>--index-definitions-file</tt> - json file file path which contains updated index definitions</li>
</ul>
<p>If the index does not support fulltext indexing then you can omit providing BlobStore details</p></div>
@@ -411,13 +417,11 @@
<h5><a name="a4.1_-_Via_oak-run"></a><a name="import-index-oak-run"></a>4.1 - Via oak-run</h5>
<p>In this mode we import the index using oak-run</p>
-<div>
-<div>
-<pre class="source">java -jar oak-run*.jar index --index-import --read-write \
+<div class="source">
+<div class="source"><pre class="prettyprint">java -jar oak-run*.jar index --index-import --read-write \
--index-import-dir=<index dir> \
--fds-path=/path/to/datastore /path/to/segmentstore
</pre></div></div>
-
<p>Here “index dir” is the directory which contains the index files created in step #3. Check the logs from previous command for the directory path.</p>
<p>This mode should only be used when repository is from Oak version 1.7+ as oak-run connects to the repository in read-write mode.</p></div>
<div class="section">
@@ -428,7 +432,7 @@
<p>TODO - Provide a way to import the data on older setup using some script</p></div></div></div>
<div class="section">
<h3><a name="B_-_Online_indexing"></a><a name="online-indexing"></a>B - Online indexing</h3>
-<p>Online indexing automates some of the manual steps which are required for out-of-band indexing.</p>
+<p>Online indexing automates some of the manual steps which are required for out-of-band indexing. </p>
<p>This mode should only be used when repository is from Oak version 1.7+ as oak-run connects to the repository in read-write mode.</p>
<div class="section">
<h4><a name="Step_1_-_Text_PreExtraction"></a><a name="online-indexing-pre-extract"></a>Step 1 - Text PreExtraction</h4>
@@ -437,28 +441,23 @@
<h4><a name="Step_2_-_Perform_reindexing"></a><a name="online-indexing-perform-reindex"></a>Step 2 - Perform reindexing</h4>
<p>In this step we configure oak-run to connect to repository in read-write mode and let it perform all other steps i.e checkpoint creation, indexing and import</p>
-<div>
-<div>
-<pre class="source">java -jar oak-run*.jar index --reindex --index-paths=/oak:index/lucene --read-write --fds-path=/path/to/datastore /path/to/segmentstore
-</pre></div></div>
-</div></div>
+<div class="source">
+<div class="source"><pre class="prettyprint">java -jar oak-run*.jar index --reindex --index-paths=/oak:index/lucene --read-write --fds-path=/path/to/datastore /path/to/segmentstore
+</pre></div></div></div></div>
<div class="section">
<h3><a name="Updating_or_Adding_New_Index_Definitions"></a><a name="index-definition-updates"></a> Updating or Adding New Index Definitions</h3>
<p><tt>@since Oak 1.7.5</tt></p>
<p>Index tooling support updating and adding new index definitions to existing setups. This can be done by passing in path of a json file which contains index definitions</p>
-<div>
-<div>
-<pre class="source">java -jar oak-run*.jar index --reindex --index-paths=/oak:index/newAssetIndex \
+<div class="source">
+<div class="source"><pre class="prettyprint">java -jar oak-run*.jar index --reindex --index-paths=/oak:index/newAssetIndex \
--index-definitions-file=index-definitions.json \
--fds-path=/path/to/datastore /path/to/segmentstore
</pre></div></div>
-
<p>Where index-definitions.json has following structure</p>
-<div>
-<div>
-<pre class="source">{
+<div class="source">
+<div class="source"><pre class="prettyprint">{
"/oak:index/newAssetIndex": {
"evaluatePathRestrictions": true,
"compatVersion": 2,
@@ -488,18 +487,17 @@
}
}
</pre></div></div>
-
-<p>Some points to note about this json file * Each key of top level object refers to the index path * The value of each such key refers to complete index definition * If the index path is not present in existing repository then it would result in a new index being created * In case of new index it must be ensured that parent path structure must already exist in repository. So if a new index is being created at <tt>/content/en/oak:index/contentIndex</tt> then path upto <tt>/content/en/oak:index</tt> should already exist in repository * If this option is used with online indexing then do ensure that oak-run version matches with the Oak version used by target repository</p>
+<p>Some points to note about this json file * Each key of top level object refers to the index path * The value of each such key refers to complete index definition * If the index path is not present in existing repository then it would result in a new index being created * In case of new index it must be ensured that parent path structure must already exist in repository. So if a new index is being created at <tt>/content/en/oak:index/contentIndex</tt> then path upto <tt>/content/en/oak:index</tt> should already exist in repository * If this option is used with online indexing then do ensure that oak-run version matches with the Oak version used by target repository</p>
<p>You can also use the json file generated from <a class="externalLink" href="http://oakutils.appspot.com/generate/index">Oakutils</a>. It needs to be modified to confirm to above structure i.e. enclose the whole definition under the intended index path key.</p>
<p>In general the index definitions does not need any special encoding of values as Index definitions in Oak use only String, Long and Double types mostly. However if the index refers to binary config like Tika config then the binary data would need to encoded. Refer to next section for more details.</p>
-<p>This option is supported in both online and out-of-band indexing.</p>
+<p>This option is supported in both online and out-of-band indexing. </p>
<p>For more details refer to <a class="externalLink" href="https://issues.apache.org/jira/browse/OAK-6471">OAK-6471</a></p></div>
<div class="section">
<h3><a name="JSON_File_Format"></a><a name="json-file-format"></a> JSON File Format</h3>
<p>Some of the standard types used in Oak are not supported directly by JSON like names, blobs etc. Those would need to be encoded in a specific format.</p>
<p>Below are the encoding rules</p>
-<dl>
+<dl>
<dt>LONG</dt>
<dd>No encoding required</dd>
<dd><i>“compatVersion”: 2</i></dd>
@@ -518,7 +516,7 @@
<dd><i>“created”: “dat:2017-07-20T13:23:21.196+05:30”</i></dd>
<dt>NAME</dt>
<dd>Prefix the value with <tt>nam:</tt>.</dd>
-<dd>For <tt>jcr:primaryType</tt> and <tt>jcr:mixins</tt> no encoding is required. Any property with these names would be converted to NAME type</dd>
+<dd>For <tt>jcr:primaryType</tt> and <tt>jcr:mixins</tt> no encoding is required. Any property with these names would be converted to NAME type</dd>
<dd><i>“nodetype”: “nam:nt:base”</i></dd>
<dt>PATH</dt>
<dd>Prefix the value with <tt>pat:</tt></dd>
@@ -527,7 +525,7 @@
<dd>Prefix the value with <tt>uri:</tt></dd>
<dd><i>“serverURI”: “uri:http://foo.example.com”</i></dd>
<dt>BINARY</dt>
-<dd>By default the binary values are encoded as Base64 string if the binary is less than 1 MB size. The encoded value is prefixed with <tt>:blobId:</tt></dd>
+<dd>By default the binary values are encoded as Base64 string if the binary is less than 1 MB size. The encoded value is prefixed with <tt>:blobId:</tt></dd>
<dd><i>“jcr:data”: “:blobId:axygz”</i></dd>
</dl></div>
<div class="section">
@@ -536,9 +534,8 @@
<p>First download the <a class="externalLink" href="https://tika.apache.org/download.html">tika-app</a> jar from Tika downloads. You should be able to use 1.15 version with Oak 1.7.4 jar.</p>
<p>Then modify the index command like below. The rest of arguments remain same as documented before.</p>
-<div>
-<div>
-<pre class="source">java -cp oak-run.jar:tika-app-1.15.jar org.apache.jackrabbit.oak.run.Main index
+<div class="source">
+<div class="source"><pre class="prettyprint">java -cp oak-run.jar:tika-app-1.15.jar org.apache.jackrabbit.oak.run.Main index
</pre></div></div></div></div>
</div>
</div>
Modified: jackrabbit/site/live/oak/docs/query/ootb-index-change.html
URL: http://svn.apache.org/viewvc/jackrabbit/site/live/oak/docs/query/ootb-index-change.html?rev=1839663&r1=1839662&r2=1839663&view=diff
==============================================================================
--- jackrabbit/site/live/oak/docs/query/ootb-index-change.html (original)
+++ jackrabbit/site/live/oak/docs/query/ootb-index-change.html Thu Aug 30 11:48:45 2018
@@ -1,13 +1,13 @@
<!DOCTYPE html>
<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8.1 at 2018-08-29
+ | Generated by Apache Maven Doxia Site Renderer 1.7.4 at 2018-02-21
| Rendered using Apache Maven Fluido Skin 1.6
-->
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<meta charset="UTF-8" />
<meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20180829" />
+ <meta name="Date-Revision-yyyymmdd" content="20180221" />
<meta http-equiv="Content-Language" content="en" />
<title>Jackrabbit Oak – Changing Out-Of-The-Box Index Definitions</title>
<link rel="stylesheet" href="../css/apache-maven-fluido-1.6.min.css" />
@@ -52,7 +52,6 @@
<a href="#" class="dropdown-toggle" data-toggle="dropdown">Main APIs <b class="caret"></b></a>
<ul class="dropdown-menu">
<li><a href="http://www.day.com/specs/jcr/2.0/index.html" title="JCR API">JCR API</a></li>
- <li><a href="https://jackrabbit.apache.org/jcr/jcr-api.html" title="Jackrabbit API">Jackrabbit API</a></li>
<li><a href="../oak_api/overview.html" title="Oak API">Oak API</a></li>
</ul>
</li>
@@ -67,12 +66,7 @@
<li><a href="../nodestore/compositens.html" title="Composite NodeStore">Composite NodeStore</a></li>
</ul>
</li>
- <li class="dropdown-submenu">
-<a href="../plugins/blobstore.html" title="Blob Storage">Blob Storage</a>
- <ul class="dropdown-menu">
- <li><a href="../features/direct-binary-access.html" title="Direct Binary Access">Direct Binary Access</a></li>
- </ul>
- </li>
+ <li><a href="../plugins/blobstore.html" title="Blob Storage">Blob Storage</a></li>
<li class="dropdown-submenu">
<a href="../query/query.html" title="Query">Query</a>
<ul class="dropdown-menu">
@@ -142,7 +136,7 @@
<div id="breadcrumbs">
<ul class="breadcrumb">
- <li id="publishDate">Last Published: 2018-08-29<span class="divider">|</span>
+ <li id="publishDate">Last Published: 2018-02-21<span class="divider">|</span>
</li>
<li id="projectVersion">Version: 1.10-SNAPSHOT</li>
</ul>
@@ -161,14 +155,12 @@
<li><a href="../architecture/nodestate.html" title="The Node State Model"><span class="none"></span>The Node State Model</a> </li>
<li class="nav-header">Main APIs</li>
<li><a href="http://www.day.com/specs/jcr/2.0/index.html" class="externalLink" title="JCR API"><span class="none"></span>JCR API</a> </li>
- <li><a href="https://jackrabbit.apache.org/jcr/jcr-api.html" class="externalLink" title="Jackrabbit API"><span class="none"></span>Jackrabbit API</a> </li>
<li><a href="../oak_api/overview.html" title="Oak API"><span class="none"></span>Oak API</a> </li>
<li class="nav-header">Features and Plugins</li>
<li><a href="../nodestore/overview.html" title="Node Storage"><span class="icon-chevron-down"></span>Node Storage</a>
<ul class="nav nav-list">
<li><a href="../nodestore/documentmk.html" title="Document NodeStore"><span class="icon-chevron-down"></span>Document NodeStore</a>
<ul class="nav nav-list">
- <li><a href="../nodestore/document/mongo-document-store.html" title="MongoDB DocumentStore"><span class="none"></span>MongoDB DocumentStore</a> </li>
<li><a href="../nodestore/document/node-bundling.html" title="Node Bundling"><span class="none"></span>Node Bundling</a> </li>
<li><a href="../nodestore/document/secondary-store.html" title="Secondary Store"><span class="none"></span>Secondary Store</a> </li>
<li><a href="../nodestore/persistent-cache.html" title="Persistent Cache"><span class="none"></span>Persistent Cache</a> </li>
@@ -179,11 +171,7 @@
<li><a href="../nodestore/compositens.html" title="Composite NodeStore"><span class="none"></span>Composite NodeStore</a> </li>
</ul>
</li>
- <li><a href="../plugins/blobstore.html" title="Blob Storage"><span class="icon-chevron-down"></span>Blob Storage</a>
- <ul class="nav nav-list">
- <li><a href="../features/direct-binary-access.html" title="Direct Binary Access"><span class="none"></span>Direct Binary Access</a> </li>
- </ul>
- </li>
+ <li><a href="../plugins/blobstore.html" title="Blob Storage"><span class="none"></span>Blob Storage</a> </li>
<li><a href="../query/query.html" title="Query"><span class="icon-chevron-down"></span>Query</a>
<ul class="nav nav-list">
<li><a href="../query/query-engine.html" title="Query Engine"><span class="none"></span>Query Engine</a> </li>
@@ -251,16 +239,14 @@
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
- -->
-<div class="section">
+ --><div class="section">
<h2><a name="Changing_Out-Of-The-Box_Index_Definitions"></a>Changing Out-Of-The-Box Index Definitions</h2>
<p>You may have the need to change an out-of-the-box index definition that is shipped either with oak or any other products built on top of it.</p>
<p>To better deal with upgrades and changes in provided index definitions it would be better to follow the following practice.</p>
<p>Let’s say for example that you have the following index definition as <tt>NodeTypeIndex</tt> and you’d like to add your custom node to the list: <tt>cust:unstructured</tt>.</p>
-<div>
-<div>
-<pre class="source">"oak:index/nodetype" : {
+<div class="source">
+<div class="source"><pre class="prettyprint">"oak:index/nodetype" : {
"jcr:primaryType": "oak:QueryIndexDefinition",
"declaringNodeTypes": [
"sling:MessageEntry",
@@ -283,21 +269,24 @@
"reindexCount": 1
}
</pre></div></div>
-
<p>to customise it you would do the following:</p>
-<ol style="list-style-type: decimal">
-<li>Copy the current index definition with a new name. Let’s say <tt>oak:index/custNodeType</tt></li>
+<ol style="list-style-type: decimal">
+
+<li>Copy the current index definition with a new name. Let’s say <tt>oak:index/custNodeType</tt></li>
+
<li>Add the custom nodetype to the <tt>declaringNodeTypes</tt></li>
+
<li>Issue a re-index by setting <tt>reindex=true</tt></li>
+
<li>wait for it to finish</li>
-<li>either <a href="./query-engine.html#Temporarily_Disabling_an_Index">disable</a> the old index definition or delete it.</li>
+
+<li>either <a href="./query-engine.html#Temporarily_Disabling_an_Index">disable</a> the old index definition or delete it.</li>
</ol>
<p>The new index definition in our example, once completed would look like the following:</p>
-<div>
-<div>
-<pre class="source">"oak:index/custNodetype" : {
+<div class="source">
+<div class="source"><pre class="prettyprint">"oak:index/custNodetype" : {
"jcr:primaryType": "oak:QueryIndexDefinition",
"declaringNodeTypes": [
"sling:MessageEntry",
Modified: jackrabbit/site/live/oak/docs/query/ordered-index-migrate.html
URL: http://svn.apache.org/viewvc/jackrabbit/site/live/oak/docs/query/ordered-index-migrate.html?rev=1839663&r1=1839662&r2=1839663&view=diff
==============================================================================
--- jackrabbit/site/live/oak/docs/query/ordered-index-migrate.html (original)
+++ jackrabbit/site/live/oak/docs/query/ordered-index-migrate.html Thu Aug 30 11:48:45 2018
@@ -1,13 +1,13 @@
<!DOCTYPE html>
<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8.1 at 2018-08-29
+ | Generated by Apache Maven Doxia Site Renderer 1.7.4 at 2018-02-21
| Rendered using Apache Maven Fluido Skin 1.6
-->
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<meta charset="UTF-8" />
<meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20180829" />
+ <meta name="Date-Revision-yyyymmdd" content="20180221" />
<meta http-equiv="Content-Language" content="en" />
<title>Jackrabbit Oak – Migrating Ordered Index to Lucene Property</title>
<link rel="stylesheet" href="../css/apache-maven-fluido-1.6.min.css" />
@@ -52,7 +52,6 @@
<a href="#" class="dropdown-toggle" data-toggle="dropdown">Main APIs <b class="caret"></b></a>
<ul class="dropdown-menu">
<li><a href="http://www.day.com/specs/jcr/2.0/index.html" title="JCR API">JCR API</a></li>
- <li><a href="https://jackrabbit.apache.org/jcr/jcr-api.html" title="Jackrabbit API">Jackrabbit API</a></li>
<li><a href="../oak_api/overview.html" title="Oak API">Oak API</a></li>
</ul>
</li>
@@ -67,12 +66,7 @@
<li><a href="../nodestore/compositens.html" title="Composite NodeStore">Composite NodeStore</a></li>
</ul>
</li>
- <li class="dropdown-submenu">
-<a href="../plugins/blobstore.html" title="Blob Storage">Blob Storage</a>
- <ul class="dropdown-menu">
- <li><a href="../features/direct-binary-access.html" title="Direct Binary Access">Direct Binary Access</a></li>
- </ul>
- </li>
+ <li><a href="../plugins/blobstore.html" title="Blob Storage">Blob Storage</a></li>
<li class="dropdown-submenu">
<a href="../query/query.html" title="Query">Query</a>
<ul class="dropdown-menu">
@@ -142,7 +136,7 @@
<div id="breadcrumbs">
<ul class="breadcrumb">
- <li id="publishDate">Last Published: 2018-08-29<span class="divider">|</span>
+ <li id="publishDate">Last Published: 2018-02-21<span class="divider">|</span>
</li>
<li id="projectVersion">Version: 1.10-SNAPSHOT</li>
</ul>
@@ -161,14 +155,12 @@
<li><a href="../architecture/nodestate.html" title="The Node State Model"><span class="none"></span>The Node State Model</a> </li>
<li class="nav-header">Main APIs</li>
<li><a href="http://www.day.com/specs/jcr/2.0/index.html" class="externalLink" title="JCR API"><span class="none"></span>JCR API</a> </li>
- <li><a href="https://jackrabbit.apache.org/jcr/jcr-api.html" class="externalLink" title="Jackrabbit API"><span class="none"></span>Jackrabbit API</a> </li>
<li><a href="../oak_api/overview.html" title="Oak API"><span class="none"></span>Oak API</a> </li>
<li class="nav-header">Features and Plugins</li>
<li><a href="../nodestore/overview.html" title="Node Storage"><span class="icon-chevron-down"></span>Node Storage</a>
<ul class="nav nav-list">
<li><a href="../nodestore/documentmk.html" title="Document NodeStore"><span class="icon-chevron-down"></span>Document NodeStore</a>
<ul class="nav nav-list">
- <li><a href="../nodestore/document/mongo-document-store.html" title="MongoDB DocumentStore"><span class="none"></span>MongoDB DocumentStore</a> </li>
<li><a href="../nodestore/document/node-bundling.html" title="Node Bundling"><span class="none"></span>Node Bundling</a> </li>
<li><a href="../nodestore/document/secondary-store.html" title="Secondary Store"><span class="none"></span>Secondary Store</a> </li>
<li><a href="../nodestore/persistent-cache.html" title="Persistent Cache"><span class="none"></span>Persistent Cache</a> </li>
@@ -179,11 +171,7 @@
<li><a href="../nodestore/compositens.html" title="Composite NodeStore"><span class="none"></span>Composite NodeStore</a> </li>
</ul>
</li>
- <li><a href="../plugins/blobstore.html" title="Blob Storage"><span class="icon-chevron-down"></span>Blob Storage</a>
- <ul class="nav nav-list">
- <li><a href="../features/direct-binary-access.html" title="Direct Binary Access"><span class="none"></span>Direct Binary Access</a> </li>
- </ul>
- </li>
+ <li><a href="../plugins/blobstore.html" title="Blob Storage"><span class="none"></span>Blob Storage</a> </li>
<li><a href="../query/query.html" title="Query"><span class="icon-chevron-down"></span>Query</a>
<ul class="nav nav-list">
<li><a href="../query/query-engine.html" title="Query Engine"><span class="none"></span>Query Engine</a> </li>
@@ -251,14 +239,12 @@
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
- -->
-<h1>Migrating Ordered Index to Lucene Property</h1>
+ --><h1>Migrating Ordered Index to Lucene Property</h1>
<p>A quick step-by-step on how to migrate from the ordered index to lucene.</p>
<p>Assuming you have the following ordered index configuration</p>
-<div>
-<div>
-<pre class="source">{
+<div class="source">
+<div class="source"><pre class="prettyprint">{
...
"declaringNodeTypes" : "nt:unstructured",
"direction" : "ascending",
@@ -267,12 +253,10 @@
...
}
</pre></div></div>
-
<p>the related lucene configuration will be</p>
-<div>
-<div>
-<pre class="source">{
+<div class="source">
+<div class="source"><pre class="prettyprint">{
"jcr:primaryType" : "oak:QueryIndexDefinition",
"compatVersion" : 2,
"type" : "lucene",
@@ -292,7 +276,6 @@
}
}
</pre></div></div>
-
<p>for all the details around the configuration of Lucene index and additional flags, please refer to the <a href="lucene.html">index documetation</a>.</p>
</div>
</div>
Modified: jackrabbit/site/live/oak/docs/query/ordered-index.html
URL: http://svn.apache.org/viewvc/jackrabbit/site/live/oak/docs/query/ordered-index.html?rev=1839663&r1=1839662&r2=1839663&view=diff
==============================================================================
--- jackrabbit/site/live/oak/docs/query/ordered-index.html (original)
+++ jackrabbit/site/live/oak/docs/query/ordered-index.html Thu Aug 30 11:48:45 2018
@@ -1,13 +1,13 @@
<!DOCTYPE html>
<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8.1 at 2018-08-29
+ | Generated by Apache Maven Doxia Site Renderer 1.7.4 at 2018-02-21
| Rendered using Apache Maven Fluido Skin 1.6
-->
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<meta charset="UTF-8" />
<meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20180829" />
+ <meta name="Date-Revision-yyyymmdd" content="20180221" />
<meta http-equiv="Content-Language" content="en" />
<title>Jackrabbit Oak – Ordered Index (deprecated since 1.1.8)</title>
<link rel="stylesheet" href="../css/apache-maven-fluido-1.6.min.css" />
@@ -52,7 +52,6 @@
<a href="#" class="dropdown-toggle" data-toggle="dropdown">Main APIs <b class="caret"></b></a>
<ul class="dropdown-menu">
<li><a href="http://www.day.com/specs/jcr/2.0/index.html" title="JCR API">JCR API</a></li>
- <li><a href="https://jackrabbit.apache.org/jcr/jcr-api.html" title="Jackrabbit API">Jackrabbit API</a></li>
<li><a href="../oak_api/overview.html" title="Oak API">Oak API</a></li>
</ul>
</li>
@@ -67,12 +66,7 @@
<li><a href="../nodestore/compositens.html" title="Composite NodeStore">Composite NodeStore</a></li>
</ul>
</li>
- <li class="dropdown-submenu">
-<a href="../plugins/blobstore.html" title="Blob Storage">Blob Storage</a>
- <ul class="dropdown-menu">
- <li><a href="../features/direct-binary-access.html" title="Direct Binary Access">Direct Binary Access</a></li>
- </ul>
- </li>
+ <li><a href="../plugins/blobstore.html" title="Blob Storage">Blob Storage</a></li>
<li class="dropdown-submenu">
<a href="../query/query.html" title="Query">Query</a>
<ul class="dropdown-menu">
@@ -142,7 +136,7 @@
<div id="breadcrumbs">
<ul class="breadcrumb">
- <li id="publishDate">Last Published: 2018-08-29<span class="divider">|</span>
+ <li id="publishDate">Last Published: 2018-02-21<span class="divider">|</span>
</li>
<li id="projectVersion">Version: 1.10-SNAPSHOT</li>
</ul>
@@ -161,14 +155,12 @@
<li><a href="../architecture/nodestate.html" title="The Node State Model"><span class="none"></span>The Node State Model</a> </li>
<li class="nav-header">Main APIs</li>
<li><a href="http://www.day.com/specs/jcr/2.0/index.html" class="externalLink" title="JCR API"><span class="none"></span>JCR API</a> </li>
- <li><a href="https://jackrabbit.apache.org/jcr/jcr-api.html" class="externalLink" title="Jackrabbit API"><span class="none"></span>Jackrabbit API</a> </li>
<li><a href="../oak_api/overview.html" title="Oak API"><span class="none"></span>Oak API</a> </li>
<li class="nav-header">Features and Plugins</li>
<li><a href="../nodestore/overview.html" title="Node Storage"><span class="icon-chevron-down"></span>Node Storage</a>
<ul class="nav nav-list">
<li><a href="../nodestore/documentmk.html" title="Document NodeStore"><span class="icon-chevron-down"></span>Document NodeStore</a>
<ul class="nav nav-list">
- <li><a href="../nodestore/document/mongo-document-store.html" title="MongoDB DocumentStore"><span class="none"></span>MongoDB DocumentStore</a> </li>
<li><a href="../nodestore/document/node-bundling.html" title="Node Bundling"><span class="none"></span>Node Bundling</a> </li>
<li><a href="../nodestore/document/secondary-store.html" title="Secondary Store"><span class="none"></span>Secondary Store</a> </li>
<li><a href="../nodestore/persistent-cache.html" title="Persistent Cache"><span class="none"></span>Persistent Cache</a> </li>
@@ -179,11 +171,7 @@
<li><a href="../nodestore/compositens.html" title="Composite NodeStore"><span class="none"></span>Composite NodeStore</a> </li>
</ul>
</li>
- <li><a href="../plugins/blobstore.html" title="Blob Storage"><span class="icon-chevron-down"></span>Blob Storage</a>
- <ul class="nav nav-list">
- <li><a href="../features/direct-binary-access.html" title="Direct Binary Access"><span class="none"></span>Direct Binary Access</a> </li>
- </ul>
- </li>
+ <li><a href="../plugins/blobstore.html" title="Blob Storage"><span class="none"></span>Blob Storage</a> </li>
<li><a href="../query/query.html" title="Query"><span class="icon-chevron-down"></span>Query</a>
<ul class="nav nav-list">
<li><a href="../query/query-engine.html" title="Query Engine"><span class="none"></span>Query Engine</a> </li>
@@ -251,14 +239,12 @@
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
- -->
-<h1>Ordered Index (deprecated since 1.1.8)</h1>
+ --><h1>Ordered Index (deprecated since 1.1.8)</h1>
<p>Extension of the Property index will keep the order of the indexed property persisted in the repository.</p>
<p>Used to speed-up queries with <tt>ORDER BY</tt> clause, <i>equality</i> and <i>range</i> ones.</p>
-<div>
-<div>
-<pre class="source">SELECT * FROM [nt:base] ORDER BY jcr:lastModified
+<div class="source">
+<div class="source"><pre class="prettyprint">SELECT * FROM [nt:base] ORDER BY jcr:lastModified
SELECT * FROM [nt:base] WHERE jcr:lastModified > $date
@@ -269,25 +255,31 @@ WHERE jcr:lastModified > $date1 AND j
SELECT * FROM [nt:base] WHERE [jcr:uuid] = $id
</pre></div></div>
-
<p>To define a property index on a subtree you have to add an index definition node that:</p>
-<ul>
+<ul>
+
<li>must be of type <tt>oak:QueryIndexDefinition</tt></li>
+
<li>must have the <tt>type</tt> property set to <b><tt>ordered</tt></b></li>
-<li>contains the <tt>propertyNames</tt> property that indicates what properties will be stored in the index. <tt>propertyNames</tt> has to be a single value list of type <tt>Name[]</tt></li>
+
+<li>contains the <tt>propertyNames</tt> property that indicates what properties will be stored in the index. <tt>propertyNames</tt> has to be a single value list of type <tt>Name[]</tt></li>
</ul>
<p><i>Optionally</i> you can specify</p>
-<ul>
-<li>the <tt>reindex</tt> flag which when set to <tt>true</tt>, triggers a full content re-index.</li>
-<li>The direction of the sorting by specifying a <tt>direction</tt> property of type <tt>String</tt> of value <tt>ascending</tt> or <tt>descending</tt>. If not provided <tt>ascending</tt> is the default.</li>
-<li>The index can be defined as asynchronous by providing the property <tt>async=async</tt></li>
+<ul>
+
+<li>the <tt>reindex</tt> flag which when set to <tt>true</tt>, triggers a full content re-index.</li>
+
+<li>The direction of the sorting by specifying a <tt>direction</tt> property of type <tt>String</tt> of value <tt>ascending</tt> or <tt>descending</tt>. If not provided <tt>ascending</tt> is the default.</li>
+
+<li>The index can be defined as asynchronous by providing the property <tt>async=async</tt></li>
</ul>
<p><i>Caveats</i></p>
-<ul>
-<li>In case deploying on the index on a clustered mongodb you have to define it as asynchronous by providing <tt>async=async</tt> in the index definition. This is to avoid cluster merges.</li>
+<ul>
+
+<li>In case deploying on the index on a clustered mongodb you have to define it as asynchronous by providing <tt>async=async</tt> in the index definition. This is to avoid cluster merges.</li>
</ul>
</div>
</div>
Modified: jackrabbit/site/live/oak/docs/query/pre-extract-text.html
URL: http://svn.apache.org/viewvc/jackrabbit/site/live/oak/docs/query/pre-extract-text.html?rev=1839663&r1=1839662&r2=1839663&view=diff
==============================================================================
--- jackrabbit/site/live/oak/docs/query/pre-extract-text.html (original)
+++ jackrabbit/site/live/oak/docs/query/pre-extract-text.html Thu Aug 30 11:48:45 2018
@@ -1,13 +1,13 @@
<!DOCTYPE html>
<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8.1 at 2018-08-29
+ | Generated by Apache Maven Doxia Site Renderer 1.8.1 at 2018-08-17
| Rendered using Apache Maven Fluido Skin 1.6
-->
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<meta charset="UTF-8" />
<meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20180829" />
+ <meta name="Date-Revision-yyyymmdd" content="20180817" />
<meta http-equiv="Content-Language" content="en" />
<title>Jackrabbit Oak – Pre-Extracting Text from Binaries</title>
<link rel="stylesheet" href="../css/apache-maven-fluido-1.6.min.css" />
@@ -52,7 +52,6 @@
<a href="#" class="dropdown-toggle" data-toggle="dropdown">Main APIs <b class="caret"></b></a>
<ul class="dropdown-menu">
<li><a href="http://www.day.com/specs/jcr/2.0/index.html" title="JCR API">JCR API</a></li>
- <li><a href="https://jackrabbit.apache.org/jcr/jcr-api.html" title="Jackrabbit API">Jackrabbit API</a></li>
<li><a href="../oak_api/overview.html" title="Oak API">Oak API</a></li>
</ul>
</li>
@@ -67,12 +66,7 @@
<li><a href="../nodestore/compositens.html" title="Composite NodeStore">Composite NodeStore</a></li>
</ul>
</li>
- <li class="dropdown-submenu">
-<a href="../plugins/blobstore.html" title="Blob Storage">Blob Storage</a>
- <ul class="dropdown-menu">
- <li><a href="../features/direct-binary-access.html" title="Direct Binary Access">Direct Binary Access</a></li>
- </ul>
- </li>
+ <li><a href="../plugins/blobstore.html" title="Blob Storage">Blob Storage</a></li>
<li class="dropdown-submenu">
<a href="../query/query.html" title="Query">Query</a>
<ul class="dropdown-menu">
@@ -142,7 +136,7 @@
<div id="breadcrumbs">
<ul class="breadcrumb">
- <li id="publishDate">Last Published: 2018-08-29<span class="divider">|</span>
+ <li id="publishDate">Last Published: 2018-08-17<span class="divider">|</span>
</li>
<li id="projectVersion">Version: 1.10-SNAPSHOT</li>
</ul>
@@ -161,7 +155,6 @@
<li><a href="../architecture/nodestate.html" title="The Node State Model"><span class="none"></span>The Node State Model</a> </li>
<li class="nav-header">Main APIs</li>
<li><a href="http://www.day.com/specs/jcr/2.0/index.html" class="externalLink" title="JCR API"><span class="none"></span>JCR API</a> </li>
- <li><a href="https://jackrabbit.apache.org/jcr/jcr-api.html" class="externalLink" title="Jackrabbit API"><span class="none"></span>Jackrabbit API</a> </li>
<li><a href="../oak_api/overview.html" title="Oak API"><span class="none"></span>Oak API</a> </li>
<li class="nav-header">Features and Plugins</li>
<li><a href="../nodestore/overview.html" title="Node Storage"><span class="icon-chevron-down"></span>Node Storage</a>
@@ -179,11 +172,7 @@
<li><a href="../nodestore/compositens.html" title="Composite NodeStore"><span class="none"></span>Composite NodeStore</a> </li>
</ul>
</li>
- <li><a href="../plugins/blobstore.html" title="Blob Storage"><span class="icon-chevron-down"></span>Blob Storage</a>
- <ul class="nav nav-list">
- <li><a href="../features/direct-binary-access.html" title="Direct Binary Access"><span class="none"></span>Direct Binary Access</a> </li>
- </ul>
- </li>
+ <li><a href="../plugins/blobstore.html" title="Blob Storage"><span class="none"></span>Blob Storage</a> </li>
<li><a href="../query/query.html" title="Query"><span class="icon-chevron-down"></span>Query</a>
<ul class="nav nav-list">
<li><a href="../query/query-engine.html" title="Query Engine"><span class="none"></span>Query Engine</a> </li>
Modified: jackrabbit/site/live/oak/docs/query/property-index.html
URL: http://svn.apache.org/viewvc/jackrabbit/site/live/oak/docs/query/property-index.html?rev=1839663&r1=1839662&r2=1839663&view=diff
==============================================================================
--- jackrabbit/site/live/oak/docs/query/property-index.html (original)
+++ jackrabbit/site/live/oak/docs/query/property-index.html Thu Aug 30 11:48:45 2018
@@ -1,13 +1,13 @@
<!DOCTYPE html>
<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8.1 at 2018-08-29
+ | Generated by Apache Maven Doxia Site Renderer 1.7.4 at 2018-02-21
| Rendered using Apache Maven Fluido Skin 1.6
-->
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<meta charset="UTF-8" />
<meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20180829" />
+ <meta name="Date-Revision-yyyymmdd" content="20180221" />
<meta http-equiv="Content-Language" content="en" />
<title>Jackrabbit Oak – The Property Index</title>
<link rel="stylesheet" href="../css/apache-maven-fluido-1.6.min.css" />
@@ -52,7 +52,6 @@
<a href="#" class="dropdown-toggle" data-toggle="dropdown">Main APIs <b class="caret"></b></a>
<ul class="dropdown-menu">
<li><a href="http://www.day.com/specs/jcr/2.0/index.html" title="JCR API">JCR API</a></li>
- <li><a href="https://jackrabbit.apache.org/jcr/jcr-api.html" title="Jackrabbit API">Jackrabbit API</a></li>
<li><a href="../oak_api/overview.html" title="Oak API">Oak API</a></li>
</ul>
</li>
@@ -67,12 +66,7 @@
<li><a href="../nodestore/compositens.html" title="Composite NodeStore">Composite NodeStore</a></li>
</ul>
</li>
- <li class="dropdown-submenu">
-<a href="../plugins/blobstore.html" title="Blob Storage">Blob Storage</a>
- <ul class="dropdown-menu">
- <li><a href="../features/direct-binary-access.html" title="Direct Binary Access">Direct Binary Access</a></li>
- </ul>
- </li>
+ <li><a href="../plugins/blobstore.html" title="Blob Storage">Blob Storage</a></li>
<li class="dropdown-submenu">
<a href="../query/query.html" title="Query">Query</a>
<ul class="dropdown-menu">
@@ -142,7 +136,7 @@
<div id="breadcrumbs">
<ul class="breadcrumb">
- <li id="publishDate">Last Published: 2018-08-29<span class="divider">|</span>
+ <li id="publishDate">Last Published: 2018-02-21<span class="divider">|</span>
</li>
<li id="projectVersion">Version: 1.10-SNAPSHOT</li>
</ul>
@@ -161,14 +155,12 @@
<li><a href="../architecture/nodestate.html" title="The Node State Model"><span class="none"></span>The Node State Model</a> </li>
<li class="nav-header">Main APIs</li>
<li><a href="http://www.day.com/specs/jcr/2.0/index.html" class="externalLink" title="JCR API"><span class="none"></span>JCR API</a> </li>
- <li><a href="https://jackrabbit.apache.org/jcr/jcr-api.html" class="externalLink" title="Jackrabbit API"><span class="none"></span>Jackrabbit API</a> </li>
<li><a href="../oak_api/overview.html" title="Oak API"><span class="none"></span>Oak API</a> </li>
<li class="nav-header">Features and Plugins</li>
<li><a href="../nodestore/overview.html" title="Node Storage"><span class="icon-chevron-down"></span>Node Storage</a>
<ul class="nav nav-list">
<li><a href="../nodestore/documentmk.html" title="Document NodeStore"><span class="icon-chevron-down"></span>Document NodeStore</a>
<ul class="nav nav-list">
- <li><a href="../nodestore/document/mongo-document-store.html" title="MongoDB DocumentStore"><span class="none"></span>MongoDB DocumentStore</a> </li>
<li><a href="../nodestore/document/node-bundling.html" title="Node Bundling"><span class="none"></span>Node Bundling</a> </li>
<li><a href="../nodestore/document/secondary-store.html" title="Secondary Store"><span class="none"></span>Secondary Store</a> </li>
<li><a href="../nodestore/persistent-cache.html" title="Persistent Cache"><span class="none"></span>Persistent Cache</a> </li>
@@ -179,11 +171,7 @@
<li><a href="../nodestore/compositens.html" title="Composite NodeStore"><span class="none"></span>Composite NodeStore</a> </li>
</ul>
</li>
- <li><a href="../plugins/blobstore.html" title="Blob Storage"><span class="icon-chevron-down"></span>Blob Storage</a>
- <ul class="nav nav-list">
- <li><a href="../features/direct-binary-access.html" title="Direct Binary Access"><span class="none"></span>Direct Binary Access</a> </li>
- </ul>
- </li>
+ <li><a href="../plugins/blobstore.html" title="Blob Storage"><span class="none"></span>Blob Storage</a> </li>
<li><a href="../query/query.html" title="Query"><span class="icon-chevron-down"></span>Query</a>
<ul class="nav nav-list">
<li><a href="../query/query-engine.html" title="Query Engine"><span class="none"></span>Query Engine</a> </li>
@@ -252,44 +240,54 @@
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
- -->
-<div class="section">
+ --><div class="section">
<h2><a name="The_Property_Index"></a>The Property Index</h2>
<p>Is useful whenever there is a query with a property constraint that is not full-text:</p>
-<div>
-<div>
-<pre class="source">SELECT * FROM [nt:base] WHERE [jcr:uuid] = $id
+<div class="source">
+<div class="source"><pre class="prettyprint">SELECT * FROM [nt:base] WHERE [jcr:uuid] = $id
</pre></div></div>
-
<p>To define a property index, you have to add an index definition node that:</p>
-<ul>
+<ul>
+
<li>Must be a child node of <tt>/oak:index</tt>.</li>
+
<li>Must be of type <tt>oak:QueryIndexDefinition</tt>.</li>
-<li><tt>type</tt> (String) must have the property set to “property”.</li>
-<li><tt>propertyNames</tt> (Name, multi-valued): the property to be indexed. This is a multi-valued property, and must not be empty. It usually contains only <i>one</i> property name. All nodes that have <i>any</i> of those properties are stored in this index.</li>
+
+<li><tt>type</tt> (String) must have the property set to “property”.</li>
+
+<li><tt>propertyNames</tt> (Name, multi-valued): the property to be indexed. This is a multi-valued property, and must not be empty. It usually contains only <i>one</i> property name. All nodes that have <i>any</i> of those properties are stored in this index.</li>
</ul>
<p>It is recommended to index one property per index. (If multiple properties are indexed within one index, then the index contains all nodes that has either one of the properties, which can make the query less efficient, and can make the query pick the wrong index.)</p>
<p>Optionally you can specify:</p>
-<ul>
+<ul>
+
<li><tt>declaringNodeTypes</tt> (Name, multi-valued): the index only applies to a certain node type.</li>
-<li><tt>unique</tt> (Boolean): if set to <tt>true</tt>, a uniqueness constraint on this property is added. Ensure you set declaringNodeTypes, otherwise all nodes of the repository are affected (which is most likely not what you want), and you are not able to version the node.</li>
+
+<li><tt>unique</tt> (Boolean): if set to <tt>true</tt>, a uniqueness constraint on this property is added. Ensure you set declaringNodeTypes, otherwise all nodes of the repository are affected (which is most likely not what you want), and you are not able to version the node.</li>
+
<li><tt>includedPaths</tt> (String, multi-valued): the paths that are included (‘/’ if not set). Since Oak version 1.4 (OAK-3263). The index is only used if the query has a path restriction that is not excluded, and part of the included paths.</li>
+
<li><tt>excludedPaths</tt> (String, multi-valued): the paths where this index is excluded (none if not set). Since Oak version 1.4 (OAK-3263). The index is only used if the query has a path restriction that is not excluded, and part of the included paths.</li>
+
<li><tt>valuePattern</tt> (String) A regular expression of all indexed values. The index is used for equality conditions where the value matches the pattern, and for “in(…)” queries where all values match the pattern. The index is not used for “like” conditions. Since Oak version 1.7.2 (OAK-4637).</li>
+
<li><tt>valueExcludedPrefixes</tt> The index is used for equality conditions where the value does not start with the given prefix, and the prefix does not start with the value, similarly for “in(…)” conditions, and similarly for “like” conditions. and for “in(…)” queries where all values match the pattern. Since Oak version 1.7.2 (OAK-4637).</li>
+
<li><tt>valueIncludedPrefixes</tt> The index is used for equality conditions where the value starts with the given prefix, similarly for “in(…)” conditions, and similarly for “like” conditions. Since Oak version 1.7.2 (OAK-4637).</li>
-<li><tt>entryCount</tt> (Long): the estimated number of path entries in the index, to override the cost estimation (a high entry count means a high cost).</li>
-<li><tt>keyCount</tt> (Long), the estimated number of keys in the index, to override the cost estimation (a high key count means a lower cost and a low key count means a high cost when searching for specific keys; has no effect when searching for “is not null”).</li>
-<li><tt>reindex</tt> (Boolean): if set to <tt>true</tt>, the full content is re-indexed. This can take a long time, and is run synchronously with storing the index (except with an async index). See “Reindexing” below for details.</li>
+
+<li><tt>entryCount</tt> (Long): the estimated number of path entries in the index, to override the cost estimation (a high entry count means a high cost).</li>
+
+<li><tt>keyCount</tt> (Long), the estimated number of keys in the index, to override the cost estimation (a high key count means a lower cost and a low key count means a high cost when searching for specific keys; has no effect when searching for “is not null”).</li>
+
+<li><tt>reindex</tt> (Boolean): if set to <tt>true</tt>, the full content is re-indexed. This can take a long time, and is run synchronously with storing the index (except with an async index). See “Reindexing” below for details.</li>
</ul>
<p>Example:</p>
-<div>
-<div>
-<pre class="source">{
+<div class="source">
+<div class="source"><pre class="prettyprint">{
NodeBuilder index = root.child("oak:index");
index.child("uuid")
.setProperty("jcr:primaryType", "oak:QueryIndexDefinition", Type.NAME)
@@ -300,17 +298,14 @@
.setProperty("reindex", true);
}
</pre></div></div>
-
<p>or to simplify you can use one of the existing <tt>IndexUtils#createIndexDefinition</tt> helper methods:</p>
-<div>
-<div>
-<pre class="source">{
+<div class="source">
+<div class="source"><pre class="prettyprint">{
NodeBuilder index = IndexUtils.getOrCreateOakIndex(root);
IndexUtils.createIndexDefinition(index, "myProp", true, false, ImmutableList.of("myProp"), null);
}
</pre></div></div>
-
<div class="section">
<div class="section">
<h4><a name="Reindexing"></a><a name="reindexing"></a> Reindexing</h4>
@@ -319,28 +314,32 @@
<p>Asynchronous reindexing of a property index is available as of OAK-1456. The way this works is by pushing the property index updates to a background job and when the indexing process is done, the property definition will be switched back to a synchronous updates mode. To enable this async reindex behaviour you need to first set the <b><tt>reindex-async</tt></b> and <b><tt>reindex</tt></b> flags to <b><tt>true</tt></b> (call #save). You can verify the initial setup worked by refreshing the index definition node and looking for the <b><tt>async</tt></b> = <b><tt>async-reindex</tt></b> property. Next you need to start the dedicated background job via a jmx call to the <b><tt>PropertyIndexAsyncReindex#startPropertyIndexAsyncReindex</tt></b> MBean.</p>
<p>Example:</p>
-<div>
-<div>
-<pre class="source">{
+<div class="source">
+<div class="source"><pre class="prettyprint">{
NodeBuilder index = root.child("oak:index");
index.child("property")
.setProperty("reindex-async", true)
.setProperty("reindex", true);
}
</pre></div></div>
-
<p>When recovering a failed async reindex special care needs to be taken wrt. the created checkpoint and the <b><tt>async</tt></b> property. The checkpoint should be released via the <b><tt>CheckpointManager</tt></b> mbean, and the <b><tt>async</tt></b> property needs to be manually deleted while also setting the <b><tt>reindex</tt></b> flags to <b><tt>true</tt></b> to make sure the index returns to a consistent state, in sync with the head revision.</p></div>
<div class="section">
<h4><a name="Cost_Estimation"></a>Cost Estimation</h4>
<p>When running a query, the property index reports its estimated cost to the query engine, and then the query engine picks the index with the lowest cost (cost-based query optimization). The algorithm to calculate the estimated cost is roughly as follows (a bit simplified):</p>
-<ul>
-<li>The cost is infinity (so the index is never used) if the condition contains a fulltext constraint, no applicable restriction, the wrong nodetype, or if the path filtering (<tt>includedPaths</tt> / <tt>excludedPaths</tt>) does not match the query.</li>
-<li>For the nodetype index, the cost is the sum of the cost for the <tt>jcr:primaryType</tt> lookup (if the primary type is known), plus the cost for the <tt>jcr:mixinTypes</tt> lookup (if that is known).</li>
-<li>Otherwise, the cost is based on the overhead (which is 2), plus the estimated number of entries.</li>
-<li>For an “x is not null” condition, the estimated number of entries is either the configured <tt>entryCount</tt> or, if not set, the approximate number of entries in the index. The approximation is an “order of magnitude” estimation (Morris’ algorithm).</li>
-<li>For a unique index and “x = 1” condition, the estimated number of entries is either 0 or 1 (depending on whether the key is found).</li>
-<li>For a non-unique index and a “x = 1” condition, if the <tt>entryCount</tt> and <tt>keyCount</tt> are set, those setting are used to estimate the number of entries. If not, the approximate number of entries for the key is read (maintained using Morris’ algorithm). In addition to that, the path condition is used to scale down the estimated count depending on the approximate number of nodes in that subtree versus the approximate number of entries in the repository, using approximation available via the <tt>counter</tt> index.</li>
+<ul>
+
+<li>The cost is infinity (so the index is never used) if the condition contains a fulltext constraint, no applicable restriction, the wrong nodetype, or if the path filtering (<tt>includedPaths</tt> / <tt>excludedPaths</tt>) does not match the query.</li>
+
+<li>For the nodetype index, the cost is the sum of the cost for the <tt>jcr:primaryType</tt> lookup (if the primary type is known), plus the cost for the <tt>jcr:mixinTypes</tt> lookup (if that is known).</li>
+
+<li>Otherwise, the cost is based on the overhead (which is 2), plus the estimated number of entries.</li>
+
+<li>For an “x is not null” condition, the estimated number of entries is either the configured <tt>entryCount</tt> or, if not set, the approximate number of entries in the index. The approximation is an “order of magnitude” estimation (Morris’ algorithm).</li>
+
+<li>For a unique index and “x = 1” condition, the estimated number of entries is either 0 or 1 (depending on whether the key is found).</li>
+
+<li>For a non-unique index and a “x = 1” condition, if the <tt>entryCount</tt> and <tt>keyCount</tt> are set, those setting are used to estimate the number of entries. If not, the approximate number of entries for the key is read (maintained using Morris’ algorithm). In addition to that, the path condition is used to scale down the estimated count depending on the approximate number of nodes in that subtree versus the approximate number of entries in the repository, using approximation available via the <tt>counter</tt> index.</li>
</ul>
<p>For example, for a query with path restriction “/content/products/t-shirts” and property restriction “color = ‘red’”, if there is an index for the property “color”, then the entry count approximation is read from the index. Let’s say it is 10’000 for this value. Then the approximate number of nodes in the subtree “/content/products/t-shirts” is read (let’s say it is 20’000), and the approximate number of nodes in the repository (let’s say it is 1 million). Therefore, the estimated number of entries is scaled down (divided by 50) from 10’000 to 200. The estimated cost is therefore 202, due to the overhead of 2.</p></div></div></div>
</div>
Modified: jackrabbit/site/live/oak/docs/query/query-engine.html
URL: http://svn.apache.org/viewvc/jackrabbit/site/live/oak/docs/query/query-engine.html?rev=1839663&r1=1839662&r2=1839663&view=diff
==============================================================================
--- jackrabbit/site/live/oak/docs/query/query-engine.html (original)
+++ jackrabbit/site/live/oak/docs/query/query-engine.html Thu Aug 30 11:48:45 2018
@@ -1,13 +1,13 @@
<!DOCTYPE html>
<!--
- | Generated by Apache Maven Doxia Site Renderer 1.8.1 at 2018-08-29
+ | Generated by Apache Maven Doxia Site Renderer 1.8.1 at 2018-08-30
| Rendered using Apache Maven Fluido Skin 1.6
-->
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<meta charset="UTF-8" />
<meta name="viewport" content="width=device-width, initial-scale=1.0" />
- <meta name="Date-Revision-yyyymmdd" content="20180829" />
+ <meta name="Date-Revision-yyyymmdd" content="20180830" />
<meta http-equiv="Content-Language" content="en" />
<title>Jackrabbit Oak – The Query Engine</title>
<link rel="stylesheet" href="../css/apache-maven-fluido-1.6.min.css" />
@@ -142,7 +142,7 @@
<div id="breadcrumbs">
<ul class="breadcrumb">
- <li id="publishDate">Last Published: 2018-08-29<span class="divider">|</span>
+ <li id="publishDate">Last Published: 2018-08-30<span class="divider">|</span>
</li>
<li id="projectVersion">Version: 1.10-SNAPSHOT</li>
</ul>
@@ -469,7 +469,7 @@ consider creating an index or changing t
<div class="section">
<h3><a name="Full-Text_Queries"></a>Full-Text Queries</h3>
<p>The full-text syntax supported by Jackrabbit Oak is a superset of the JCR specification.</p>
-<p>By default (that is, using a Lucene index with <tt>compatVersion</tt> 2), Jackrabbit Oak uses the <a class="externalLink" href="https://lucene.apache.org/core/4_7_1/queryparser/org/apache/lucene/queryparser/classic/package-summary.html">Apache Lucene grammar for fulltext search</a>. <a class="externalLink" href="https://wiki.apache.org/jackrabbit/EncodingAndEscaping">See also how to escape queries.</a></p>
+<p>By default (that is, using a Lucene index with <tt>compatVersion</tt> 2), Jackrabbit Oak uses the <a class="externalLink" href="https://lucene.apache.org/core/4_7_1/queryparser/org/apache/lucene/queryparser/classic/package-summary.html">Apache Lucene grammar for fulltext search</a>. <a class="externalLink" href="https://wiki.apache.org/jackrabbit/EncodingAndEscaping">See also how to escape queries.</a>. However, the words <tt>AND</tt> and <tt>NOT</tt> are treated as search terms, and only <tt>OR</tt> is supported as a keyword. Instead of <tt>NOT</tt>, use <tt>-</tt>. Instead of <tt>AND</tt>, just write the terms next to each other (instead of <tt>hello AND world</tt>, just write <tt>hello world</tt>).</p>
<p>For older Lucene indexes (<tt>compatVersion</tt> 1), the following syntax is supported within <tt>contains</tt> queries. This is a subset of the Apache Lucene syntax:</p>
<div>