You are viewing a plain text version of this content. The canonical link for it is here.
Posted to oak-dev@jackrabbit.apache.org by Christopher Rockwell <cm...@umich.edu> on 2016/03/17 17:56:39 UTC
Re: LuceneIndexEditor message in error.log
Hello. My apologies all. I missed the responses to my group email from Nov 2015. I saw responses and follow-up questions in mail archive… so I’m trying to circle back since this index errors are still occurring.
Amit. I’m not sure whether indexing fails or not. The content json is included below [2] along with a stacktrace
Julian. The type of cq:lastModified is Date. I’m not sure what the index definition looks like. The indexes I’ve set do not use this value or page type. It should be one of the AEM indexes. For what it’s worth, I see the following from /system/console/jmx/org.apache.jackrabbit.oak%3Aid%3D10%2Cname%3D"Lucene+Index+statistics"%2Ctype%3D"LuceneIndex"
Attribute Name Attribute Value
IndexStats
org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexMBeanImpl
indexSize indexSizeStr maxDoc numDeletedDocs numDocs path
8238737 8.2 MB 39943 140 39803 /oak:index/lsaNews
19474513 19.5 MB 36272 240 36032 /oak:index/lsaPeople
125057 125.1 kB 833 2 831 /oak:index/cqTagLucene
329174 329.2 kB 3455 3 3452 /oak:index/workflowDataLucene
106259 106.3 kB 334 0 334 /oak:index/authorizables
2341765 2.3 MB 21031 0 21031 /oak:index/ntBaseLucene
156566 156.6 kB 416 0 416 /oak:index/cqPageLucene
9014717 9.0 MB 4540 1 4539 /oak:index/damLucene
9695674 9.7 MB 4540 1 4539 /oak:index/damAssetLucene
259904911 259.9 MB 448741 10837 437904 /oak:index/lucene
--------
Tue, 24 Nov 2015 12:12:43 GMT
Hi Chris,
Does the lucene indexing process fail after this warning? As you pointed
out this sounds similar to OAK-3020, which was fixed in Oak 1.2.3.
In addition can you also post the json for one of the nodes.
Thanks
Amit
-------
On Tue, Nov 24, 2015 at 3:07 AM, Julian Sedding <js...@gmail.com> wrote:
> Hi Chris
>
> Two questions:
>
> 1. What is the property type of
> /content/michigan-lsa/classics/en/graduate-students/current-students/jcr:content/cq:lastModified?
> 2. Do you have an idea what the index definition looks like that is used for indexing this property
>
> Regards
> Julian
----
[2] Here is another error message example ...
17.03.2016 12:20:03.660 *WARN* [pool-10-thread-1] org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexEditor Failed to index the node [/content/michigan-lsa/mcdb/en/alumni-friends/newsletter]
java.lang.IllegalArgumentException: DocValuesField ":dvjcr:content/cq:lastModified" appears more than once in this document (only one value is allowed per field)
at org.apache.lucene.index.NumericDocValuesWriter.addValue(NumericDocValuesWriter.java:54)
at org.apache.lucene.index.DocValuesProcessor.addNumericField(DocValuesProcessor.java:153)
at org.apache.lucene.index.DocValuesProcessor.addField(DocValuesProcessor.java:66)
at org.apache.lucene.index.TwoStoredFieldsConsumers.addField(TwoStoredFieldsConsumers.java:36)
at org.apache.lucene.index.DocFieldProcessor.processDocument(DocFieldProcessor.java:236)
at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:253)
at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:455)
at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1534)
at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1507)
at org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexEditor.addOrUpdate(LuceneIndexEditor.java:302)
at org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexEditor.leave(LuceneIndexEditor.java:198)
at org.apache.jackrabbit.oak.spi.commit.CompositeEditor.leave(CompositeEditor.java:74)
at org.apache.jackrabbit.oak.spi.commit.VisibleEditor.leave(VisibleEditor.java:63)
at org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:153)
at org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:418)
at org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583)
at org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148)
at org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:418)
at org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583)
at org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148)
at org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:418)
at org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583)
at org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148)
at org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:418)
at org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583)
at org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148)
at org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:418)
at org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583)
at org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148)
at org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:487)
at org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583)
at org.apache.jackrabbit.oak.spi.commit.EditorDiff.process(EditorDiff.java:52)
at org.apache.jackrabbit.oak.plugins.index.AsyncIndexUpdate.updateIndex(AsyncIndexUpdate.java:376)
at org.apache.jackrabbit.oak.plugins.index.AsyncIndexUpdate.run(AsyncIndexUpdate.java:318)
at org.apache.sling.commons.scheduler.impl.QuartzJobExecutor.execute(QuartzJobExecutor.java:105)
at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
And here is an example json content for a page that had the problem…
{
jcr:primaryType: "cq:Page",
jcr:createdBy: "ksumrall",
jcr:created: "Thu Mar 17 2016 12:08:28 GMT-0400",
jcr:content: {
jcr:primaryType: "cq:PageContent",
jcr:createdBy: "ksuddmrall",
jcr:title: "Newsletter",
cq:template: "/apps/michigan-lsa/templates/department_sub",
jcr:created: "Thu Mar 17 2016 12:08:28 GMT-0400",
cq:lastModified: "Thu Mar 17 2016 12:20:25 GMT-0400",
sling:resourceType: "michigan-lsa/components/pages/department_sub",
cq:designPath: "/etc/designs/michigan-lsa",
cq:lastModifiedBy: "ksumrall",
par: {
jcr:primaryType: "nt:unstructured",
sling:resourceType: "wcm/foundation/components/parsys",
button: {
jcr:primaryType: "nt:unstructured",
wrapping: true,
jcr:createdBy: "ksumrall",
jcr:lastModifiedBy: "ksumrall",
jcr:created: "Thu Mar 17 2016 12:09:40 GMT-0400",
link: "/content/dam/mcdb-assets/mcdb-documents/newsletter2012.pdf",
text: "2012 MCDB Newsletter",
width: "normal",
textPosition: "left",
jcr:lastModified: "Thu Mar 17 2016 12:12:31 GMT-0400",
sling:resourceType: "michigan-lsa/components/button"
},
button_1102522790: {
jcr:primaryType: "nt:unstructured",
wrapping: true,
jcr:createdBy: "ksumrall",
jcr:lastModifiedBy: "ksumrall",
jcr:created: "Thu Mar 17 2016 12:12:39 GMT-0400",
link: "/content/dam/mcdb-assets/mcdb-documents/newsletter2011.pdf",
text: "2011 MCDB Newsletter",
width: "normal",
textPosition: "left",
jcr:lastModified: "Thu Mar 17 2016 12:14:57 GMT-0400",
sling:resourceType: "michigan-lsa/components/button"
},
button_475415812: {
jcr:primaryType: "nt:unstructured",
wrapping: true,
jcr:createdBy: "ksumrall",
jcr:lastModifiedBy: "ksumrall",
jcr:created: "Thu Mar 17 2016 12:14:25 GMT-0400",
link: "/content/dam/mcdb-assets/mcdb-documents/newsletter2009.pdf",
text: "2009 MCDB Newsletter",
width: "normal",
textPosition: "left",
jcr:lastModified: "Thu Mar 17 2016 12:15:21 GMT-0400",
sling:resourceType: "michigan-lsa/components/button"
},
button_850480106: {
jcr:primaryType: "nt:unstructured",
wrapping: true,
jcr:createdBy: "ksumrall",
jcr:lastModifiedBy: "ksumrall",
jcr:created: "Thu Mar 17 2016 12:14:26 GMT-0400",
link: "/content/dam/mcdb-assets/mcdb-documents/newsletter2008.pdf",
text: "2008 MCDB Newsletter",
width: "normal",
textPosition: "left",
jcr:lastModified: "Thu Mar 17 2016 12:15:44 GMT-0400",
sling:resourceType: "michigan-lsa/components/button"
},
button_1316341457: {
jcr:primaryType: "nt:unstructured",
wrapping: true,
jcr:createdBy: "ksumrall",
jcr:lastModifiedBy: "ksumrall",
jcr:created: "Thu Mar 17 2016 12:14:34 GMT-0400",
link: "/content/dam/mcdb-assets/mcdb-documents/newsletter2007.pdf",
text: "2007 MCDB Newsletter",
width: "normal",
textPosition: "left",
jcr:lastModified: "Thu Mar 17 2016 12:17:05 GMT-0400",
sling:resourceType: "michigan-lsa/components/button"
},
button_1888841713: {
jcr:primaryType: "nt:unstructured",
wrapping: true,
jcr:createdBy: "ksumrall",
jcr:lastModifiedBy: "ksumrall",
jcr:created: "Thu Mar 17 2016 12:14:35 GMT-0400",
link: "/content/dam/mcdb-assets/mcdb-documents/newsletter2006.pdf",
text: "2006 MCDB Newsletter",
width: "normal",
textPosition: "left",
jcr:lastModified: "Thu Mar 17 2016 12:17:23 GMT-0400",
sling:resourceType: "michigan-lsa/components/button"
},
button_1741156277: {
jcr:primaryType: "nt:unstructured",
wrapping: true,
jcr:createdBy: "ksumrall",
jcr:lastModifiedBy: "ksumrall",
jcr:created: "Thu Mar 17 2016 12:14:35 GMT-0400",
link: "/content/dam/mcdb-assets/mcdb-documents/newsletter2005.pdf",
text: "2005 MCDB Newsletter",
width: "normal",
textPosition: "left",
jcr:lastModified: "Thu Mar 17 2016 12:17:42 GMT-0400",
sling:resourceType: "michigan-lsa/components/button"
},
button_156841819: {
jcr:primaryType: "nt:unstructured",
wrapping: true,
jcr:createdBy: "ksumrall",
jcr:lastModifiedBy: "ksumrall",
jcr:created: "Thu Mar 17 2016 12:14:35 GMT-0400",
link: "/content/dam/mcdb-assets/mcdb-documents/newsletter2004.pdf",
text: "2004 MCDB Newsletter",
width: "normal",
textPosition: "left",
jcr:lastModified: "Thu Mar 17 2016 12:17:59 GMT-0400",
sling:resourceType: "michigan-lsa/components/button"
},
button_842469556: {
jcr:primaryType: "nt:unstructured",
wrapping: true,
jcr:createdBy: "ksumrall",
jcr:lastModifiedBy: "ksumrall",
jcr:created: "Thu Mar 17 2016 12:18:12 GMT-0400",
link: "/content/dam/mcdb-assets/mcdb-documents/newsletter03.pdf",
text: "2003 MCDB Newsletter",
width: "normal",
textPosition: "left",
jcr:lastModified: "Thu Mar 17 2016 12:20:01 GMT-0400",
sling:resourceType: "michigan-lsa/components/button"
},
button_1413621409: {
jcr:primaryType: "nt:unstructured",
wrapping: true,
jcr:createdBy: "ksumrall",
jcr:lastModifiedBy: "ksumrall",
jcr:created: "Thu Mar 17 2016 12:18:12 GMT-0400",
link: "/content/dam/mcdb-assets/mcdb-documents/newsletter01.pdf",
text: "2001 MCDB Newsletter",
width: "normal",
textPosition: "left",
jcr:lastModified: "Thu Mar 17 2016 12:20:25 GMT-0400",
sling:resourceType: "michigan-lsa/components/button"
}
}
}
}
> On Nov 23, 2015, at 1:38 PM, Chris <cm...@umich.edu> wrote:
>
> Hello. We are running Oak v1.2.4 in AEM6.1. After upgrading to AEM6.1 I see the error message below repeated 1000+ times a day in the error log. The logs refer to many different content nodes, not just this example. We have also have already requested Daycare support. The response indicated that this log message might be related to OAK-3020 [1]. So far the system continues to operate, but it seems like a major warning sign if indexing continues to fail at this rate. Can anyone provide suggestions?
>
> 19.11.2015 10:08:37.561 *WARN* [pool-9-thread-4] org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexEditor Failed to index the node [/content/michigan-lsa/classics/en/graduate-students/current-students]
> java.lang.IllegalArgumentException: DocValuesField ":dvjcr:content/cq:lastModified" appears more than once in this document (only one value is allowed per field)
> at org.apache.lucene.index.NumericDocValuesWriter.addValue(NumericDocValuesWriter.java:54)
> at org.apache.lucene.index.DocValuesProcessor.addNumericField(DocValuesProcessor.java:153)
> at org.apache.lucene.index.DocValuesProcessor.addField(DocValuesProcessor.java:66)
> at org.apache.lucene.index.TwoStoredFieldsConsumers.addField(TwoStoredFieldsConsumers.java:36)
> at org.apache.lucene.index.DocFieldProcessor.processDocument(DocFieldProcessor.java:236)
> at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:253)
> at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:455)
> at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1534)
> at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1507)
> at org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexEditor.addOrUpdate(LuceneIndexEditor.java:302)
> at org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexEditor.leave(LuceneIndexEditor.java:198)
> at org.apache.jackrabbit.oak.spi.commit.CompositeEditor.leave(CompositeEditor.java:74)
> at org.apache.jackrabbit.oak.spi.commit.VisibleEditor.leave(VisibleEditor.java:63)
> at org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:153)
> at org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:418)
> at org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583)
> at org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148)
> at org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:418)
> at org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583)
> at org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148)
> at org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:418)
> at org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583)
> at org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148)
> at org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:418)
> at org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583)
> at org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148)
> at org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:418)
> at org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583)
> at org.apache.jackrabbit.oak.spi.commit.EditorDiff.childNodeChanged(EditorDiff.java:148)
> at org.apache.jackrabbit.oak.plugins.segment.MapRecord$2.childNodeChanged(MapRecord.java:403)
> at org.apache.jackrabbit.oak.plugins.segment.MapRecord$3.childNodeChanged(MapRecord.java:444)
> at org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:487)
> at org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:436)
> at org.apache.jackrabbit.oak.plugins.segment.MapRecord.compare(MapRecord.java:394)
> at org.apache.jackrabbit.oak.plugins.segment.SegmentNodeState.compareAgainstBaseState(SegmentNodeState.java:583)
> at org.apache.jackrabbit.oak.spi.commit.EditorDiff.process(EditorDiff.java:52)
> at org.apache.jackrabbit.oak.plugins.index.AsyncIndexUpdate.updateIndex(AsyncIndexUpdate.java:376)
> at org.apache.jackrabbit.oak.plugins.index.AsyncIndexUpdate.run(AsyncIndexUpdate.java:318)
> at org.apache.sling.commons.scheduler.impl.QuartzJobExecutor.execute(QuartzJobExecutor.java:105)
> at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
>
> [1] with https://issues.apache.org/jira/browse/OAK-3020