You are viewing a plain text version of this content. The canonical link for it is here.
Posted to oak-issues@jackrabbit.apache.org by "Dheeraj Khanna (JIRA)" <ji...@apache.org> on 2015/11/22 20:44:11 UTC

[jira] [Commented] (OAK-2549) Persistent Cache: support append-only mode

    [ https://issues.apache.org/jira/browse/OAK-2549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021162#comment-15021162 ] 

Dheeraj Khanna commented on OAK-2549:
-------------------------------------

Hi [~tmueller],

We saw the same *WARN* message again while shutting down the 561->61 upgraded server after the  first restart of AEM61
1. I see this is a warning message only but want to check would it have any impact, other then unable to read particular node. 
2. Shall we be deleting the persistentCache directory whenever this issue comes?

AEM61/MongoDB/OAK122-R1689912

{noformat}
22.11.2015 18:39:14.985 *INFO* [FelixStartLevel] org.apache.sling.commons.threads.impl.DefaultThreadPool Thread pool [ThreadPool-6ebc78e4-3ec4-454b-9c35-d781e66b52c5 (com.apple.haiku.services.bulkoperation.impl.BulkConfigImpl)] is shut down.
22.11.2015 18:39:14.985 *INFO* [FelixStartLevel] org.apache.sling.commons.threads.impl.DefaultThreadPoolManager Stopped Apache Sling Thread Pool Manager
22.11.2015 18:39:14.986 *INFO* [FelixStartLevel] org.apache.sling.commons.threads BundleEvent STOPPED
22.11.2015 18:39:14.986 *INFO* [FelixStartLevel] org.apache.sling.commons.json BundleEvent STOPPING
22.11.2015 18:39:14.987 *INFO* [FelixStartLevel] org.apache.sling.commons.json BundleEvent STOPPED
22.11.2015 18:39:14.987 *INFO* [FelixStartLevel] org.apache.jackrabbit.jackrabbit-jcr-rmi BundleEvent STOPPING
22.11.2015 18:39:14.987 *INFO* [FelixStartLevel] org.apache.jackrabbit.jackrabbit-jcr-rmi BundleEvent STOPPED
22.11.2015 18:39:14.988 *INFO* [FelixStartLevel] org.apache.jackrabbit.jackrabbit-jcr-commons BundleEvent STOPPING
22.11.2015 18:39:14.988 *INFO* [FelixStartLevel] org.apache.jackrabbit.jackrabbit-jcr-commons BundleEvent STOPPED
22.11.2015 18:39:14.988 *INFO* [FelixStartLevel] org.apache.jackrabbit.jackrabbit-api BundleEvent STOPPING
22.11.2015 18:39:14.988 *INFO* [FelixStartLevel] org.apache.jackrabbit.jackrabbit-api BundleEvent STOPPED
22.11.2015 18:39:14.989 *INFO* [FelixStartLevel] com.day.commons.day-commons-text BundleEvent STOPPING
22.11.2015 18:39:14.989 *INFO* [FelixStartLevel] com.day.commons.day-commons-text BundleEvent STOPPED
22.11.2015 18:39:14.990 *INFO* [FelixStartLevel] com.day.crx.crx-api BundleEvent STOPPING
22.11.2015 18:39:14.990 *INFO* [FelixStartLevel] com.day.crx.crx-api BundleEvent STOPPED
22.11.2015 18:39:14.990 *WARN* [pool-5-thread-2] org.apache.jackrabbit.oak.plugins.document.persistentCache.CacheMap Re-opening map NODE
java.lang.IllegalStateException: Chunk 3709 no longer exists [1.4.185/9]
	at org.h2.mvstore.DataUtils.newIllegalStateException(DataUtils.java:773)
	at org.h2.mvstore.MVStore.getChunkIfFound(MVStore.java:888)
	at org.h2.mvstore.MVStore.getChunk(MVStore.java:871)
	at org.h2.mvstore.MVStore.readPage(MVStore.java:1821)
	at org.h2.mvstore.MVMap.readPage(MVMap.java:736)
	at org.h2.mvstore.Page.getChildPage(Page.java:216)
	at org.h2.mvstore.MVMap.binarySearch(MVMap.java:468)
	at org.h2.mvstore.MVMap.get(MVMap.java:450)
	at org.apache.jackrabbit.oak.plugins.document.persistentCache.CacheMap.get(CacheMap.java:87)
	at org.apache.jackrabbit.oak.plugins.document.persistentCache.MultiGenerationMap.get(MultiGenerationMap.java:56)
	at org.apache.jackrabbit.oak.plugins.document.persistentCache.NodeCache.readIfPresent(NodeCache.java:80)
	at org.apache.jackrabbit.oak.plugins.document.persistentCache.NodeCache.getIfPresent(NodeCache.java:101)
	at org.apache.jackrabbit.oak.plugins.document.persistentCache.NodeCache.get(NodeCache.java:112)
	at org.apache.jackrabbit.oak.plugins.document.DocumentNodeStore.getNode(DocumentNodeStore.java:814)
	at org.apache.jackrabbit.oak.plugins.document.DocumentNodeState.getChildNode(DocumentNodeState.java:252)
	at org.apache.jackrabbit.oak.plugins.memory.MemoryNodeBuilder.<init>(MemoryNodeBuilder.java:143)
	at org.apache.jackrabbit.oak.plugins.document.AbstractDocumentNodeBuilder.<init>(AbstractDocumentNodeBuilder.java:42)
	at org.apache.jackrabbit.oak.plugins.document.DocumentNodeBuilder.<init>(DocumentNodeBuilder.java:47)
	at org.apache.jackrabbit.oak.plugins.document.DocumentNodeBuilder.createChildBuilder(DocumentNodeBuilder.java:63)
	at org.apache.jackrabbit.oak.plugins.document.AbstractDocumentNodeBuilder.getChildNode(AbstractDocumentNodeBuilder.java:74)
	at org.apache.jackrabbit.oak.plugins.document.AbstractDocumentNodeBuilder.getChildNode(AbstractDocumentNodeBuilder.java:34)
	at org.apache.jackrabbit.oak.plugins.index.lucene.OakDirectory.openInput(OakDirectory.java:129)
	at org.apache.lucene.codecs.lucene40.BitVector.<init>(BitVector.java:327)
	at org.apache.lucene.codecs.lucene40.Lucene40LiveDocsFormat.readLiveDocs(Lucene40LiveDocsFormat.java:90)
	at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:104)
	at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:141)
	at org.apache.lucene.index.BufferedUpdatesStream.applyDeletesAndUpdates(BufferedUpdatesStream.java:279)
	at org.apache.lucene.index.IndexWriter.applyAllDeletesAndUpdates(IndexWriter.java:3191)
	at org.apache.lucene.index.IndexWriter.maybeApplyDeletes(IndexWriter.java:3182)
	at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3155)
	at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3123)
	at org.apache.lucene.index.IndexWriter.closeInternal(IndexWriter.java:988)
	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:932)
	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:894)
	at org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexEditorContext.closeWriter(LuceneIndexEditorContext.java:190)
	at org.apache.jackrabbit.oak.plugins.index.lucene.LuceneIndexEditor.leave(LuceneIndexEditor.java:207)
	at org.apache.jackrabbit.oak.plugins.index.IndexUpdate.leave(IndexUpdate.java:221)
	at org.apache.jackrabbit.oak.spi.commit.VisibleEditor.leave(VisibleEditor.java:63)
	at org.apache.jackrabbit.oak.spi.commit.EditorDiff.process(EditorDiff.java:56)
	at org.apache.jackrabbit.oak.plugins.index.AsyncIndexUpdate.updateIndex(AsyncIndexUpdate.java:367)
	at org.apache.jackrabbit.oak.plugins.index.AsyncIndexUpdate.run(AsyncIndexUpdate.java:312)
	at org.apache.sling.commons.scheduler.impl.QuartzJobExecutor.execute(QuartzJobExecutor.java:105)
	at org.quartz.core.JobRunShell.run(JobRunShell.java:202)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:722)
22.11.2015 18:39:14.990 *INFO* [FelixStartLevel] com.adobe.granite.jmx BundleEvent STOPPING
22.11.2015 18:39:14.992 *INFO* [FelixStartLevel] com.adobe.granite.jmx Service [com.adobe.granite.jmx.internal.JMXConsolePlugin,171, [javax.servlet.Servlet]] ServiceEvent UNREGISTERING
22.11.2015 18:39:14.993 *INFO* [FelixStartLevel] com.adobe.granite.jmx BundleEvent STOPPED
22.11.2015 18:39:14.993 *INFO* [FelixStartLevel] org.apache.jackrabbit.oak-tarmk-standby BundleEvent STOPPING
22.11.2015 18:39:14.994 *INFO* [FelixStartLevel] org.apache.jackrabbit.oak-tarmk-standby BundleEvent STOPPED
22.11.2015 18:39:14.994 *INFO* [FelixStartLevel] org.apache.jackrabbit.oak-solr-osgi BundleEvent STOPPING
22.11.2015 18:39:14.995 *INFO* [FelixStartLevel] org.apache.jackrabbit.oak-solr-osgi Service [169, [org.apache.jackrabbit.oak.spi.query.QueryIndexProvider]] ServiceEvent UNREGISTERING
22.11.2015 18:39:14.997 *INFO* [FelixStartLevel] org.apache.jackrabbit.oak-solr-osgi Service [org.apache.jackrabbit.oak.plugins.index.solr.osgi.SolrServerProviderService,166, [org.apache.jackrabbit.oak.plugins.index.solr.server.SolrServerProvider]] ServiceEvent UNREGISTERING
22.11.2015 18:39:14.998 *INFO* [FelixStartLevel] org.apache.jackrabbit.oak-solr-osgi Service [org.apache.jackrabbit.oak.plugins.index.solr.osgi.SolrIndexEditorProviderService,170, [org.apache.jackrabbit.oak.plugins.index.IndexEditorProvider]] ServiceEvent UNREGISTERING
22.11.2015 18:39:15.000 *INFO* [FelixStartLevel] org.apache.jackrabbit.oak-solr-osgi Service [org.apache.jackrabbit.oak.plugins.index.solr.osgi.EmbeddedSolrServerConfigurationProvider,165, [org.apache.jackrabbit.oak.plugins.index.solr.configuration.SolrServerConfigurationProvider]] ServiceEvent UNREGISTERING
22.11.2015 18:39:15.003 *INFO* [FelixStartLevel] org.apache.jackrabbit.oak-solr-osgi Service [org.apache.jackrabbit.oak.plugins.index.solr.osgi.RemoteSolrServerConfigurationProvider,167, [org.apache.jackrabbit.oak.plugins.index.solr.configuration.SolrServerConfigurationProvider]] ServiceEvent UNREGISTERING
22.11.2015 18:39:15.005 *INFO* [FelixStartLevel] org.apache.jackrabbit.oak-solr-osgi Service [org.apache.jackrabbit.oak.plugins.index.solr.osgi.OakSolrConfigurationProviderService,168, [org.apache.jackrabbit.oak.plugins.index.solr.configuration.OakSolrConfigurationProvider]] ServiceEvent UNREGISTERING
22.11.2015 18:39:15.006 *INFO* [FelixStartLevel] org.apache.jackrabbit.oak-solr-osgi BundleEvent STOPPED
22.11.2015 18:39:15.007 *INFO* [FelixStartLevel] org.apache.jackrabbit.oak-mk-api BundleEvent STOPPING
22.11.2015 18:39:15.007 *INFO* [FelixStartLevel] org.apache.jackrabbit.oak-mk-api BundleEvent STOPPED
22.11.2015 18:39:15.008 *INFO* [FelixStartLevel] org.apache.jackrabbit.oak-blob BundleEvent STOPPING
22.11.2015 18:39:15.008 *INFO* [FelixStartLevel] org.apache.jackrabbit.oak-blob BundleEvent STOPPED
22.11.2015 18:39:15.009 *INFO* [FelixStartLevel] org.apache.jackrabbit.oak-auth-ldap BundleEvent STOPPING
22.11.2015 18:39:15.010 *INFO* [FelixStartLevel] org.apache.jackrabbit.oak-auth-ldap BundleEvent STOPPED
22.11.2015 18:39:15.010 *INFO* [FelixStartLevel] org.apache.jackrabbit.oak-auth-external BundleEvent STOPPING
22.11.2015 18:39:15.012 *INFO* [FelixStartLevel] org.apache.jackrabbit.oak-auth-external Service [org.apache.jackrabbit.oak.spi.security.authentication.external.impl.SyncManagerImpl,163, [org.apache.jackrabbit.oak.spi.security.authentication.external.SyncManager]] ServiceEvent UNREGISTERING
22.11.2015 18:39:15.014 *INFO* [FelixStartLevel] org.apache.jackrabbit.oak-auth-external Service [org.apache.jackrabbit.oak.spi.security.authentication.external.impl.ExternalIDPManagerImpl,164, [org.apache.jackrabbit.oak.spi.security.authentication.external.ExternalIdentityProviderManager]] ServiceEvent UNREGISTERING
22.11.2015 18:39:15.015 *INFO* [FelixStartLevel] org.apache.jackrabbit.oak-auth-external BundleEvent STOPPED
22.11.2015 18:39:15.015 *INFO* [FelixStartLevel] org.mongodb.mongo-java-driver BundleEvent STOPPING
22.11.2015 18:39:15.016 *INFO* [FelixStartLevel] org.mongodb.mongo-java-driver BundleEvent STOPPED
22.11.2015 18:39:15.016 *INFO* [FelixStartLevel] org.apache.jackrabbit.jackrabbit-data BundleEvent STOPPING
22.11.2015 18:39:15.017 *INFO* [FelixStartLevel] org.apache.jackrabbit.jackrabbit-data BundleEvent STOPPED
22.11.2015 18:39:15.018 *INFO* [FelixStartLevel] org.h2.mvstore BundleEvent STOPPING
22.11.2015 18:39:15.018 *INFO* [FelixStartLevel] org.h2.mvstore BundleEvent STOPPED
22.11.2015 18:39:15.019 *INFO* [FelixStartLevel] com.adobe.granite.osgi.wrapper.guava BundleEvent STOPPING
22.11.2015 18:39:15.019 *INFO* [FelixStartLevel] com.adobe.granite.osgi.wrapper.guava BundleEvent STOPPED
22.11.2015 18:39:15.020 *INFO* [FelixStartLevel] com.adobe.xmp.xmpcore BundleEvent STOPPING
22.11.2015 18:39:15.020 *INFO* [FelixStartLevel] com.adobe.xmp.xmpcore BundleEvent STOPPED
22.11.2015 18:39:15.021 *INFO* [FelixStartLevel] org.apache.tika.parsers BundleEvent STOPPING
22.11.2015 18:39:15.023 *INFO* [FelixStartLevel] org.apache.tika.parsers Service [162, [org.apache.tika.parser.Parser]] ServiceEvent UNREGISTERING
22.11.2015 18:39:15.024 *INFO* [FelixStartLevel] org.apache.tika.parsers Service [161, [org.apache.tika.detect.Detector]] ServiceEvent UNREGISTERING
22.11.2015 18:39:15.025 *INFO* [FelixStartLevel] org.apache.tika.parsers BundleEvent STOPPED
22.11.2015 18:39:15.025 *INFO* [FelixStartLevel] org.apache.tika.core BundleEvent STOPPING
22.11.2015 18:39:15.026 *INFO* [FelixStartLevel] org.apache.tika.core BundleEvent STOPPED
22.11.2015 18:39:15.027 *INFO* [FelixStartLevel] com.adobe.xmp.schema.service BundleEvent STOPPING
22.11.2015 18:39:15.027 *INFO* [FelixStartLevel] com.adobe.xmp.schema.service BundleEvent STOPPED
22.11.2015 18:39:15.028 *INFO* [FelixStartLevel] com.adobe.xmp.schema.rngparser BundleEvent STOPPING
22.11.2015 18:39:15.028 *INFO* [FelixStartLevel] com.adobe.xmp.schema.rngparser BundleEvent STOPPED
22.11.2015 18:39:15.029 *INFO* [FelixStartLevel] rngom BundleEvent STOPPING
22.11.2015 18:39:15.029 *INFO* [FelixStartLevel] rngom BundleEvent STOPPED
22.11.2015 18:39:15.030 *INFO* [FelixStartLevel] rideau BundleEvent STOPPING
22.1
{noformat}

Thanks
Dheeraj

> Persistent Cache: support append-only mode
> ------------------------------------------
>
>                 Key: OAK-2549
>                 URL: https://issues.apache.org/jira/browse/OAK-2549
>             Project: Jackrabbit Oak
>          Issue Type: Bug
>          Components: core
>            Reporter: Thomas Mueller
>            Assignee: Thomas Mueller
>             Fix For: 1.1.8, 1.0.13
>
>
> The persistent cache mainly adds data (in some rare cases it overwrites existing entries: the list of child nodes, if more child nodes are read). Because of that, the storage backend (H2 MVStore currently) can operate in append-only mode.
> This should also avoid the following problem: "IllegalStateException: Chunk ... no longer exists [1.4.185/9]". This is probably a bug in H2, where old chunks are removed too early. This error is not (yet) reproducible, but happened while testing.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)