You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ignite.apache.org by "Maxim Muzafarov (Jira)" <ji...@apache.org> on 2021/02/26 16:42:00 UTC

[jira] [Created] (IGNITE-14252) CorruptedTreeException for persistence 2.7.5 running on 2.9.1 version

Maxim Muzafarov created IGNITE-14252:
----------------------------------------

             Summary: CorruptedTreeException for persistence 2.7.5 running on 2.9.1 version
                 Key: IGNITE-14252
                 URL: https://issues.apache.org/jira/browse/IGNITE-14252
             Project: Ignite
          Issue Type: Task
            Reporter: Maxim Muzafarov


PDS Version - 2.7.5
Ignite node verision - 2.9.1

h3. Cache configuration
{code}
DataRegionConfiguration dataRegionCfg = new DataRegionConfiguration();
dataRegionCfg.setName(DATA_REGION_NAME)
                  .setInitialSize(200_000_000)
                  .setMaxSize(200_000_000)
                  .setPersistenceEnabled(true)
                  .setMetricsEnabled(true);

DataStorageConfiguration storageCfg = new DataStorageConfiguration();
storageCfg.setDataRegionConfigurations(dataRegionCfg)
             .setWriteThrottlingEnabled(true)
             .setMetricsEnabled(true);

IgniteConfiguration ignCfg = new IgniteConfiguration();
ignCfg.setWorkDirectory(workDirectory)
      .setDataStorageConfiguration(storageCfg)
      .setIgniteInstanceName("instanceName")
      .setSystemWorkerBlockedTimeout(10000)
      .setFailureDetectionTimeout(10000)
{code}

h3. Exception
{code}
2021-02-19 13:30:38,175 ERROR STDIO [pool-32-thread-5] {} Feb 19, 2021 1:30:38 PM org.apache.ignite.logger.java.JavaLogger error
SEVERE: Critical system error detected. Will be handled accordingly to configured handler [hnd=StopNodeOrHaltFailureHandler [tryStop=false, timeout=0, super=AbstractFailureHandler 
[ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=FailureContext [type=CRITICAL_ERROR, err=class o.a.i.i.processors.cache.persistence.tree.CorruptedTreeException: B+Tree is corrupted [pages(groupId, pageId)=[IgniteBiTuple [val1=-128547534, val2=281474976721835]], msg=Runtime failure on lookup row: SearchRow [key=com.bloomberg.aim.wingman.cachemgr.Ts3DataCache$Ts3SecurityCacheKey [idHash=1436767547, hash=-931214342, accountCusip=com.bloomberg.aim.wingman.common.dto.submgr.AccountCusip [idHash=316813954, hash=343304888, accountId=0, cusip=com.bloomberg.aim.wingman.common.dto.Cusip [idHash=1325824124, hash=2123451959, cusip1=136125, cusip2=9001, cusip3=541401120, dept=2, subflag=2]]], hash=-931214342, cacheId=0]]]]
class org.apache.ignite.internal.processors.cache.persistence.tree.CorruptedTreeException: B+Tree is corrupted [pages(groupId, pageId)=[IgniteBiTuple [val1=-128547534, val2=281474976721835]], msg=Runtime failure on lookup row: SearchRow [key=com.bloomberg.aim.wingman.cachemgr.Ts3DataCache$Ts3SecurityCacheKey [idHash=1436767547, hash=-931214342, accountCusip=
com.bloomberg.aim.wingman.common.dto.submgr.AccountCusip [idHash=316813954, hash=343304888, accountId=0, cusip=com.bloomberg.aim.wingman.common.dto.Cusip [idHash=1325824124, hash=2123451959, cusip1=136125, cusip2=9001, cusip3=541401120, dept=2, subflag=2]]], hash=-931214342, cacheId=0]]
        at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.corruptedTreeException(BPlusTree.java:6106)
        at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.findOne(BPlusTree.java:1367)
        at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.findOne(BPlusTree.java:1344)
        at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.find(IgniteCacheOffheapManagerImpl.java:2755)
        at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore.find(GridCacheOffheapManager.java:2469)
        at org.apache.ignite.internal.processors.cache.IgniteCacheOffheapManagerImpl.read(IgniteCacheOffheapManagerImpl.java:637)
        at org.apache.ignite.internal.processors.cache.local.atomic.GridLocalAtomicCache.getAllInternal(GridLocalAtomicCache.java:410)
        at org.apache.ignite.internal.processors.cache.local.atomic.GridLocalAtomicCache.getAll(GridLocalAtomicCache.java:323)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.repairableGetAll(GridCacheAdapter.java:4907)
        at org.apache.ignite.internal.processors.cache.GridCacheAdapter.getAll(GridCacheAdapter.java:1617)
        at org.apache.ignite.internal.processors.cache.IgniteCacheProxyImpl.getAll(IgniteCacheProxyImpl.java:1157)
        at org.apache.ignite.internal.processors.cache.GatewayProtectedCacheProxy.getAll(GatewayProtectedCacheProxy.java:724)
        at com.bloomberg.aim.wingman.cachemgr.Ts3DataCache.fetchCalcrtDataByKeySync(Ts3DataCache.java:1535)
        at com.bloomberg.aim.wingman.cachemgr.Ts3DataCache.lambda$fetchCalcrtDataBySecurityKeyAccountAsync$11(Ts3DataCache.java:895)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: java.lang.IllegalStateException: Item not found: 1
        at org.apache.ignite.internal.processors.cache.persistence.tree.io.AbstractDataPageIO.findIndirectItemIndex(AbstractDataPageIO.java:351)
        at org.apache.ignite.internal.processors.cache.persistence.tree.io.AbstractDataPageIO.getDataOffset(AbstractDataPageIO.java:459)
        at org.apache.ignite.internal.processors.cache.persistence.tree.io.AbstractDataPageIO.readPayload(AbstractDataPageIO.java:501)
        at org.apache.ignite.internal.processors.cache.tree.CacheDataTree.compareKeys(CacheDataTree.java:447)
        at org.apache.ignite.internal.processors.cache.tree.CacheDataTree.compare(CacheDataTree.java:386)
        at org.apache.ignite.internal.processors.cache.tree.CacheDataTree.compare(CacheDataTree.java:63)
        at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.compare(BPlusTree.java:5377)
        at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.findInsertionPoint(BPlusTree.java:5297)
        at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.access$1100(BPlusTree.java:98)
        at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Search.run0(BPlusTree.java:302)
        at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$GetPageHandler.run(BPlusTree.java:5888)
        at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Search.run(BPlusTree.java:282)
        at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$GetPageHandler.run(BPlusTree.java:5874)
        at org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.readPage(PageHandler.java:169)
        at org.apache.ignite.internal.processors.cache.persistence.DataStructure.read(DataStructure.java:364)
        at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.read(BPlusTree.java:6075)
        at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.findDown(BPlusTree.java:1424)
        at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.findDown(BPlusTree.java:1433)
        at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.findDown(BPlusTree.java:1433)
        at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.doFind(BPlusTree.java:1391)
        at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.findOne(BPlusTree.java:1359)
        ... 16 more
2021-02-19 13:30:38,177 ERROR STDIO [pool-32-thread-5] {} Feb 19, 2021 1:30:38 PM org.apache.ignite.logger.java.JavaLogger error
SEVERE: A critical problem with persistence data structures was detected. Please make backup of persistence storage and WAL files for further analysis. Persistence storage path: null WAL path: db/wal WAL archive path: db/wal/archive
{code}




--
This message was sent by Atlassian Jira
(v8.3.4#803005)