You are viewing a plain text version of this content. The canonical link for it is here.
Posted to oak-commits@jackrabbit.apache.org by ch...@apache.org on 2017/03/20 12:49:35 UTC

svn commit: r1787757 - in /jackrabbit/oak/trunk/oak-doc/src/site/markdown/query: corrupt-index-mbean.png indexing.md

Author: chetanm
Date: Mon Mar 20 12:49:34 2017
New Revision: 1787757

URL: http://svn.apache.org/viewvc?rev=1787757&view=rev
Log:
OAK-4939 -Isolate corrupted index and make async indexer more resilient

Added:
    jackrabbit/oak/trunk/oak-doc/src/site/markdown/query/corrupt-index-mbean.png   (with props)
Modified:
    jackrabbit/oak/trunk/oak-doc/src/site/markdown/query/indexing.md

Added: jackrabbit/oak/trunk/oak-doc/src/site/markdown/query/corrupt-index-mbean.png
URL: http://svn.apache.org/viewvc/jackrabbit/oak/trunk/oak-doc/src/site/markdown/query/corrupt-index-mbean.png?rev=1787757&view=auto
==============================================================================
Binary file - no diff available.

Propchange: jackrabbit/oak/trunk/oak-doc/src/site/markdown/query/corrupt-index-mbean.png
------------------------------------------------------------------------------
    svn:mime-type = image/png

Modified: jackrabbit/oak/trunk/oak-doc/src/site/markdown/query/indexing.md
URL: http://svn.apache.org/viewvc/jackrabbit/oak/trunk/oak-doc/src/site/markdown/query/indexing.md?rev=1787757&r1=1787756&r2=1787757&view=diff
==============================================================================
--- jackrabbit/oak/trunk/oak-doc/src/site/markdown/query/indexing.md (original)
+++ jackrabbit/oak/trunk/oak-doc/src/site/markdown/query/indexing.md Mon Mar 20 12:49:34 2017
@@ -207,6 +207,35 @@ Further it provides operations like
 
 #### <a name="corrupt-index-handling"></a> Isolating Corrupt Indexes
 
+`Since 1.6`
+
+AsyncIndexerService would now mark any index which fails to update for 30 mins (configurable) as `corrupt` and 
+ignore such indexes from further indexing. 
+
+When any index is marked as corrupt following log entry would be made
+
+    2016-11-22 12:52:35,484 INFO  NA [async-index-update-fulltext-async] o.a.j.o.p.i.AsyncIndexUpdate - Marking 
+    [/oak:index/lucene] as corrupt. The index is failing since Tue Nov 22 12:51:25 IST 2016 ,1 indexing cycles, failed 
+    7 times, skipped 0 time 
+
+Post this when any new content gets indexed and any such corrupt index is skipped then following warn entry would be made
+
+    2016-11-22 12:52:35,485 WARN  NA [async-index-update-fulltext-async] o.a.j.o.p.index.IndexUpdate - Ignoring corrupt 
+    index [/oak:index/lucene] which has been marked as corrupt since [2016-11-22T12:51:25.492+05:30]. This index MUST be 
+    reindexed for indexing to work properly 
+    
+This info would also be seen in MBean
+
+![Corrupt Index stats in IndexStatsMBean](corrupt-index-mbean.png)
+    
+Later once the index is reindexed following log entry would be made
+
+    2016-11-22 12:56:25,486 INFO  NA [async-index-update-fulltext-async] o.a.j.o.p.index.IndexUpdate - Removing corrupt 
+    flag from index [/oak:index/lucene] which has been marked as corrupt since [corrupt = 2016-11-22T12:51:25.492+05:30] 
+
+This feature can be disabled by setting `failingIndexTimeoutSeconds` to 0 in AsyncIndexService config. Refer to 
+[OAK-4939][OAK-4939] for more details
+
 ## <a name="nrt-indexing"></a> Near Real Time Indexing
 
 ## Index Types
@@ -216,6 +245,7 @@ Further it provides operations like
 ### Lucene Indexes
 
 [OAK-5159]: https://issues.apache.org/jira/browse/OAK-5159
+[OAK-4939]: https://issues.apache.org/jira/browse/OAK-4939
 
   
   
\ No newline at end of file