You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by Mikhail Pochatkin <mp...@unison.team> on 2022/12/07 12:42:08 UTC

RE: Ignite upgrade 2.13.0 | Nodes getting crashed with classcastexception for same class with Critical system error

Hello. I did a little research on this issue. As I see it, between 2.9.1
and 2.13.0, the serialization backward compatibility of the
GridDhtPartitionFullMap and GridDhtPartitionMap classes has not changed.
Could you try to upgrade to some lower version, for example, try 2.12
2.11.1 2.10. It would be very helpful to find the root cause and narrow
down the scope of the problem.


On 2022/11/25 14:02:12 Tarun Gupta wrote:
> Hi All,
>
> While trying to upgrade ignite to 2.13.0 from 2.9.1, facing below error
> with node startup and it crashed with below errors.
> The class: GridDhtPartitionFullMap for which ClassCastException appears is
> the same in from/to as shown in error stacktrace.
> Can anyone please check and help me with what could be going wrong ?
>
> Gris starts fine with the same configuration with 2.9.1 ignite .
>
> [2022-11-24/08:18:18.865/GMT][INFO
> ][exchange-worker-#52%local%][o.a.i.i.e.time] - Finished exchange init
> [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], crd=false]
> [2022-11-24/08:18:19.263/GMT][INFO
> ][disco-notifier-worker-#44%local%][o.a.i.i.p.c.GridClusterStateProcessor]
> - Received state change finish message: ACTIVE
> [2022-11-24/08:18:19.264/GMT][INFO
> ][disco-notifier-worker-#44%local%][o.a.i.i.p.c.GridClusterStateProcessor]
> - Cluster state was changed from INACTIVE to ACTIVE
>
[2022-11-24/08:18:19.933/GMT][ERROR][sys-#58%local%][o.a.i.i.p.c.GridCacheIoManager]
> - Failed to process message
[senderId=b1611918-a34e-42cc-a5ca-7e5d12793407,
> msg=GridDhtPartitionsFullMessage [parts=HashMap
> {-956400361=GridDhtPartitionFullMap
> {b1611918-a34e-42cc-a5ca-7e5d12793407=GridDhtPartitionMap [moving=0,
> top=AffinityTopologyVersion [topVer=4, minorTopVer=1], updateSeq=2,
> size=1024]}, -1203633048=GridDhtPartitionFullMap
> {b1611918-a34e-42cc-a5ca-7e5d12793407=GridDhtPartitionMap [moving=0,
> top=AffinityTopologyVersion [topVer=4, minorTopVer=1], updateSeq=2,
> size=0]}, -1767936620=GridDhtPartitionFullMap
> {b1611918-a34e-42cc-a5ca-7e5d12793407=GridDhtPartitionMap [moving=0,
> top=AffinityTopologyVersion [topVer=4, minorTopVer=1], updateSeq=2,
> size=512]}, 1642541340=GridDhtPartitionFullMap
> {b1611918-a34e-42cc-a5ca-7e5d12793407=GridDhtPartitionMap [moving=0,
> top=AffinityTopologyVersion [topVer=4, minorTopVer=1], updateSeq=2,
> size=0]}, -2100569601=GridDhtPartitionFullMap
> {b1611918-a34e-42cc-a5ca-7e5d12793407=GridDhtPartitionMap [moving=0,
> top=AffinityTopologyVersion [topVer=4, minorTopVer=1], updateSeq=2,
> size=100]}, 1780489535=GridDhtPartitionFullMap
> {b1611918-a34e-42cc-a5ca-7e5d12793407=GridDhtPartitionMap [moving=0,
> top=AffinityTopologyVersion [topVer=4, minorTopVer=1], updateSeq=2,
> size=0]}}, partCntrs=null, partCntrs2=null, partHistSuppliers=null,
> partsToReload=null, topVer=AffinityTopologyVersion [topVer=4,
> minorTopVer=1], errs=null, resTopVer=null, flags=1, partCnt=6,
> super=GridDhtPartitionsAbstractMessage [exchId=GridDhtPartitionExchangeId
> [topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], discoEvt=null,
> nodeId=b1611918, evt=DISCOVERY_CUSTOM_EVT], lastVer=GridCacheVersion
> [topVer=0, order=1669277887347, nodeOrder=0, dataCenterId=0],
> super=GridCacheMessage [msgId=2, depInfo=null,
> lastAffChangedTopVer=AffinityTopologyVersion [topVer=4, minorTopVer=1],
> err=null, skipPrepare=false]]]]
> java.lang.ClassCastException:
>
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap
> cannot be cast to
>
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap
>         at
>
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsFullMessage.finishUnmarshal(GridDhtPartitionsFullMessage.java:600)
> ~[ignite-core-2.13.0.jar:2.13.0]
>         at
>
org.apache.ignite.internal.processors.cache.GridCacheIoManager.unmarshall(GridCacheIoManager.java:1643)
> [ignite-core-2.13.0.jar:2.13.0]
>         at
>
org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:587)
> [ignite-core-2.13.0.jar:2.13.0]
>         at
>
org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:393)
> [ignite-core-2.13.0.jar:2.13.0]
>         at
>
org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:319)
> [ignite-core-2.13.0.jar:2.13.0]
>         at
>
org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$100(GridCacheIoManager.java:110)
> [ignite-core-2.13.0.jar:2.13.0]
>         at
>
org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:309)
> [ignite-core-2.13.0.jar:2.13.0]
>         at
>
org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1909)
> [ignite-core-2.13.0.jar:2.13.0]
>         at
>
org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:1530)
> [ignite-core-2.13.0.jar:2.13.0]
>         at
>
org.apache.ignite.internal.managers.communication.GridIoManager.access$5300(GridIoManager.java:243)
> [ignite-core-2.13.0.jar:2.13.0]
>         at
>
org.apache.ignite.internal.managers.communication.GridIoManager$9.execute(GridIoManager.java:1423)
> [ignite-core-2.13.0.jar:2.13.0]
>         at
>
org.apache.ignite.internal.managers.communication.TraceRunnable.run(TraceRunnable.java:55)
> [ignite-core-2.13.0.jar:2.13.0]
>         at
>
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> [na:1.8.0_212]
>         at
>
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> [na:1.8.0_212]
>         at java.lang.Thread.run(Thread.java:748) [na:1.8.0_212]
> [2022-11-24/08:18:19.947/GMT][ERROR][sys-#58%local%][ROOT] - Critical
> system error detected. Will be handled accordingly to configured handler
> [hnd=StopNodeOrHaltFailureHandler [tryStop=false, timeout=0,
> super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet
> [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]],
> failureCtx=FailureContext [type=CRITICAL_ERROR,
> err=java.lang.ClassCastException:
> o.a.i.i.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap
> cannot be cast to
>
o.a.i.i.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap]]
> java.lang.ClassCastException:
>
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap
> cannot be cast to
>
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionFullMap
>         at
>
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsFullMessage.finishUnmarshal(GridDhtPartitionsFullMessage.java:600)
> ~[ignite-core-2.13.0.jar:2.13.0]
>         at
>
org.apache.ignite.internal.processors.cache.GridCacheIoManager.unmarshall(GridCacheIoManager.java:1643)
> [ignite-core-2.13.0.jar:2.13.0]
>         at
>
org.apache.ignite.internal.processors.cache.GridCacheIoManager.onMessage0(GridCacheIoManager.java:587)
> [ignite-core-2.13.0.jar:2.13.0]
>         at
>
org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:393)
> [ignite-core-2.13.0.jar:2.13.0]
>         at
>
org.apache.ignite.internal.processors.cache.GridCacheIoManager.handleMessage(GridCacheIoManager.java:319)
> [ignite-core-2.13.0.jar:2.13.0]
>         at
>
org.apache.ignite.internal.processors.cache.GridCacheIoManager.access$100(GridCacheIoManager.java:110)
> [ignite-core-2.13.0.jar:2.13.0]
>         at
>
org.apache.ignite.internal.processors.cache.GridCacheIoManager$1.onMessage(GridCacheIoManager.java:309)
> [ignite-core-2.13.0.jar:2.13.0]
>         at
>
org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1909)
> [ignite-core-2.13.0.jar:2.13.0]
>         at
>
org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:1530)
> [ignite-core-2.13.0.jar:2.13.0]
>         at
>
org.apache.ignite.internal.managers.communication.GridIoManager.access$5300(GridIoManager.java:243)
> [ignite-core-2.13.0.jar:2.13.0]
>         at
>
org.apache.ignite.internal.managers.communication.GridIoManager$9.execute(GridIoManager.java:1423)
> [ignite-core-2.13.0.jar:2.13.0]
>         at
>
org.apache.ignite.internal.managers.communication.TraceRunnable.run(TraceRunnable.java:55)
> [ignite-core-2.13.0.jar:2.13.0]
>         at
>
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> [na:1.8.0_212]
>         at
>
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> [na:1.8.0_212]
>         at java.lang.Thread.run(Thread.java:748) [na:1.8.0_212]
>
>
> --
> Warm Regards,
> Tarun Kumar
>