You are viewing a plain text version of this content. The canonical link for it is here.
Posted to oak-issues@jackrabbit.apache.org by "Chetan Mehrotra (JIRA)" <ji...@apache.org> on 2013/11/28 06:55:43 UTC

[jira] [Comment Edited] (OAK-1204) Analyze behaviour while running Oak cluster on Mongo

    [ https://issues.apache.org/jira/browse/OAK-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13827545#comment-13827545 ] 

Chetan Mehrotra edited comment on OAK-1204 at 11/28/13 5:55 AM:
----------------------------------------------------------------

*Exception - E4* Occurs frequently. Being tracked with OAK-1233

{noformat}
2013-11-20 15:08:53,546 INFO  NA [MongoNodeStore background thread] o.a.j.o.p.m.MongoNodeStore - Split operation on 1:/oak:index. Size before: 102794, after: 73686 
2013-11-20 15:08:57,646 ERROR NA [pool-10-thread-4] o.a.s.c.s.impl.QuartzScheduler - Exception during job execution of org.apache.jackrabbit.oak.plugins.index.AsyncIndexUpdate@5f4519b9 : com.google.common.util.concurrent.UncheckedExecutionException: java.lang.IllegalStateException: First element of next iterator must be greater than previous iterator 
com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.IllegalStateException: First element of next iterator must be greater than previous iterator
	at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2199) ~[na:na]
	at com.google.common.cache.LocalCache.get(LocalCache.java:3932) ~[na:na]
	at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4721) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.MongoMK.diff(MongoMK.java:162) ~[na:na]
	at org.apache.jackrabbit.oak.kernel.KernelNodeState.compareAgainstBaseState(KernelNodeState.java:480) ~[na:na]
	at org.apache.jackrabbit.oak.spi.commit.EditorDiff.process(EditorDiff.java:52) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.index.AsyncIndexUpdate.run(AsyncIndexUpdate.java:103) ~[na:na]
	at org.apache.sling.commons.scheduler.impl.QuartzJobExecutor.execute(QuartzJobExecutor.java:105) ~[org.apache.sling.commons.scheduler:2.4.2]
	at org.quartz.core.JobRunShell.run(JobRunShell.java:207) [org.apache.sling.commons.scheduler:2.4.2]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_40]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_40]
	at java.lang.Thread.run(Thread.java:724) [na:1.7.0_40]
Caused by: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.IllegalStateException: First element of next iterator must be greater than previous iterator
	at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2199) ~[na:na]
	at com.google.common.cache.LocalCache.get(LocalCache.java:3932) ~[na:na]
	at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4721) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.MongoNodeStore.getNode(MongoNodeStore.java:484) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.MongoMK.diffFewChildren(MongoMK.java:308) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.MongoMK.diffImpl(MongoMK.java:224) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.MongoMK$1.call(MongoMK.java:165) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.MongoMK$1.call(MongoMK.java:162) ~[na:na]
	at com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4724) ~[na:na]
	at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3522) ~[na:na]
	at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2315) ~[na:na]
	at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2278) ~[na:na]
	at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2193) ~[na:na]
	... 11 common frames omitted
Caused by: java.lang.IllegalStateException: First element of next iterator must be greater than previous iterator
	at org.apache.jackrabbit.oak.plugins.mongomk.util.MergeSortedIterators.fetchNextIterator(MergeSortedIterators.java:96) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.util.MergeSortedIterators.next(MergeSortedIterators.java:78) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.NodeDocument.getLatestValue(NodeDocument.java:1028) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.NodeDocument.getNodeAtRevision(NodeDocument.java:450) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.MongoNodeStore.readNode(MongoNodeStore.java:630) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.MongoNodeStore.access$000(MongoNodeStore.java:76) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.MongoNodeStore$1.call(MongoNodeStore.java:487) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.MongoNodeStore$1.call(MongoNodeStore.java:484) ~[na:na]
	at com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4724) ~[na:na]
	at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3522) ~[na:na]
	at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2315) ~[na:na]
	at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2278) ~[na:na]
	at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2193) ~[na:na]
	... 23 common frames omitted

{noformat}


was (Author: chetanm):
*Exception - E4* Only once

{noformat}
2013-11-20 15:08:53,546 INFO  NA [MongoNodeStore background thread] o.a.j.o.p.m.MongoNodeStore - Split operation on 1:/oak:index. Size before: 102794, after: 73686 
2013-11-20 15:08:57,646 ERROR NA [pool-10-thread-4] o.a.s.c.s.impl.QuartzScheduler - Exception during job execution of org.apache.jackrabbit.oak.plugins.index.AsyncIndexUpdate@5f4519b9 : com.google.common.util.concurrent.UncheckedExecutionException: java.lang.IllegalStateException: First element of next iterator must be greater than previous iterator 
com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.IllegalStateException: First element of next iterator must be greater than previous iterator
	at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2199) ~[na:na]
	at com.google.common.cache.LocalCache.get(LocalCache.java:3932) ~[na:na]
	at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4721) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.MongoMK.diff(MongoMK.java:162) ~[na:na]
	at org.apache.jackrabbit.oak.kernel.KernelNodeState.compareAgainstBaseState(KernelNodeState.java:480) ~[na:na]
	at org.apache.jackrabbit.oak.spi.commit.EditorDiff.process(EditorDiff.java:52) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.index.AsyncIndexUpdate.run(AsyncIndexUpdate.java:103) ~[na:na]
	at org.apache.sling.commons.scheduler.impl.QuartzJobExecutor.execute(QuartzJobExecutor.java:105) ~[org.apache.sling.commons.scheduler:2.4.2]
	at org.quartz.core.JobRunShell.run(JobRunShell.java:207) [org.apache.sling.commons.scheduler:2.4.2]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_40]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_40]
	at java.lang.Thread.run(Thread.java:724) [na:1.7.0_40]
Caused by: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.IllegalStateException: First element of next iterator must be greater than previous iterator
	at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2199) ~[na:na]
	at com.google.common.cache.LocalCache.get(LocalCache.java:3932) ~[na:na]
	at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4721) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.MongoNodeStore.getNode(MongoNodeStore.java:484) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.MongoMK.diffFewChildren(MongoMK.java:308) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.MongoMK.diffImpl(MongoMK.java:224) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.MongoMK$1.call(MongoMK.java:165) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.MongoMK$1.call(MongoMK.java:162) ~[na:na]
	at com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4724) ~[na:na]
	at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3522) ~[na:na]
	at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2315) ~[na:na]
	at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2278) ~[na:na]
	at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2193) ~[na:na]
	... 11 common frames omitted
Caused by: java.lang.IllegalStateException: First element of next iterator must be greater than previous iterator
	at org.apache.jackrabbit.oak.plugins.mongomk.util.MergeSortedIterators.fetchNextIterator(MergeSortedIterators.java:96) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.util.MergeSortedIterators.next(MergeSortedIterators.java:78) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.NodeDocument.getLatestValue(NodeDocument.java:1028) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.NodeDocument.getNodeAtRevision(NodeDocument.java:450) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.MongoNodeStore.readNode(MongoNodeStore.java:630) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.MongoNodeStore.access$000(MongoNodeStore.java:76) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.MongoNodeStore$1.call(MongoNodeStore.java:487) ~[na:na]
	at org.apache.jackrabbit.oak.plugins.mongomk.MongoNodeStore$1.call(MongoNodeStore.java:484) ~[na:na]
	at com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4724) ~[na:na]
	at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3522) ~[na:na]
	at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2315) ~[na:na]
	at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2278) ~[na:na]
	at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2193) ~[na:na]
	... 23 common frames omitted

{noformat}

> Analyze behaviour while running Oak cluster on Mongo
> ----------------------------------------------------
>
>                 Key: OAK-1204
>                 URL: https://issues.apache.org/jira/browse/OAK-1204
>             Project: Jackrabbit Oak
>          Issue Type: Task
>          Components: mongomk
>            Reporter: Chetan Mehrotra
>            Assignee: Chetan Mehrotra
>         Attachments: mongo-mk-cluster.tar.gz
>
>
> To checkout the cluster support we should run two Sling based systems running on Oak in a cluster using Mongo. Post that analyse if any exception is reported and identify issues related to those



--
This message was sent by Atlassian JIRA
(v6.1#6144)