You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ignite.apache.org by "Ignite TC Bot (JIRA)" <ji...@apache.org> on 2019/06/16 15:04:00 UTC
[jira] [Commented] (IGNITE-1090)
GridCachePartitionedOptimisticTxNodeRestartTest hangs when node lefts
topology
[ https://issues.apache.org/jira/browse/IGNITE-1090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16865035#comment-16865035 ]
Ignite TC Bot commented on IGNITE-1090:
---------------------------------------
{panel:title=--> Run :: All: Possible Blockers|borderStyle=dashed|borderColor=#ccc|titleBGColor=#F7D6C1}
{color:#d04437}Platform .NET (Core Linux){color} [[tests 1|https://ci.ignite.apache.org/viewLog.html?buildId=4117867]]
* dll: ClientConnectorConfigurationParityTest.TestConnectorConfiguration
{color:#d04437}Platform .NET (Inspections)*{color} [[tests 0 Failure on metric |https://ci.ignite.apache.org/viewLog.html?buildId=4131052]]
{color:#d04437}Platform C++ (Linux)*{color} [[tests 2 Failure on metric |https://ci.ignite.apache.org/viewLog.html?buildId=4131062]]
{color:#d04437}Platform .NET{color} [[tests 10 TIMEOUT |https://ci.ignite.apache.org/viewLog.html?buildId=4131872]]
* exe: DataRegionMetricsTest.TestMemoryMetrics
* exe: ClientConnectorConfigurationParityTest.TestConnectorConfiguration
{color:#d04437}PDS (Indexing){color} [[tests 3|https://ci.ignite.apache.org/viewLog.html?buildId=4117959]]
* IgnitePdsWithIndexingCoreTestSuite: IgniteCacheGroupsWithRestartsTest.testNodeRestartRightAfterCacheStop
* IgnitePdsWithIndexingCoreTestSuite: IgniteLogicalRecoveryTest.testRecoveryOnCrushDuringCheckpointOnNodeStart
* IgnitePdsWithIndexingCoreTestSuite: IgnitePdsThreadInterruptionTest.testInterruptsOnWALWrite
{color:#d04437}Cache 6{color} [[tests 0 TIMEOUT , Exit Code |https://ci.ignite.apache.org/viewLog.html?buildId=4131072]]
{color:#d04437}Cache 2{color} [[tests 5|https://ci.ignite.apache.org/viewLog.html?buildId=4117913]]
* IgniteCacheTestSuite2: IgniteCacheClientNodeChangingTopologyTest.testPessimisticTx2
* IgniteCacheTestSuite2: IgniteClientCacheStartFailoverTest.testClientStartLastServerFailsTx
* IgniteCacheTestSuite2: IgniteCacheIncrementTxTest.testIncrementTxTopologyChange2
* IgniteCacheTestSuite2: GridCachePartitionedNearDisabledLockSelfTest.testLockReentrancy
{color:#d04437}Queries 1{color} [[tests 7|https://ci.ignite.apache.org/viewLog.html?buildId=4117903]]
* IgniteBinaryCacheQueryTestSuite: IgniteSqlSchemaIndexingTest.testCustomSchemaMultipleCachesTablesCollision
* IgniteBinaryCacheQueryTestSuite: IgniteCacheJoinPartitionedAndReplicatedTest.testReplicatedToPartitionedLeftJoin
* IgniteBinaryCacheQueryTestSuite: IgniteCacheSqlInsertValidationSelfTest.testMixedPlaceholderWithOtherKeyFields
* IgniteBinaryCacheQueryTestSuite: SchemaExchangeSelfTest.testNonEmptyStatic
* IgniteBinaryCacheQueryTestSuite: IgniteCheckClusterStateBeforeExecuteQueryTest.testDynamicSchemaChangesPersistence
* IgniteBinaryCacheQueryTestSuite: IgniteCacheJoinPartitionedAndReplicatedTest.testJoin
* IgniteBinaryCacheQueryTestSuite: IgniteSqlSchemaIndexingTest.testCaseSensitive
{color:#d04437}SPI{color} [[tests 2|https://ci.ignite.apache.org/viewLog.html?buildId=4117847]]
* IgniteSpiTestSuite: IgniteTcpCommunicationRecoveryAckClosureSelfTest.testQueueOverflow
{color:#d04437}ZooKeeper (Discovery) 1{color} [[tests 3|https://ci.ignite.apache.org/viewLog.html?buildId=4117857]]
* ZookeeperDiscoverySpiTestSuite1: ZookeeperDiscoverySpiTest.testDefaultCommunicationFailureResolver5
* ZookeeperDiscoverySpiTestSuite1: ZookeeperDiscoverySpiTest.testWithPersistence2
* ZookeeperDiscoverySpiTestSuite1: ZookeeperDiscoverySpiTest.testCommunicationFailureResolve_CachesInfo1
{color:#d04437}Data Structures{color} [[tests 5|https://ci.ignite.apache.org/viewLog.html?buildId=4117853]]
* IgniteCacheDataStructuresSelfTestSuite: GridCacheReplicatedDataStructuresFailoverSelfTest.testFairReentrantLockConstantMultipleTopologyChangeNonFailoverSafe
* IgniteCacheDataStructuresSelfTestSuite: GridCachePartitionedSetSelfTest.testMultithreaded
* IgniteCacheDataStructuresSelfTestSuite: IgnitePartitionedCountDownLatchSelfTest.testLatch
* IgniteCacheDataStructuresSelfTestSuite: GridCacheReplicatedDataStructuresFailoverSelfTest.testReentrantLockConstantMultipleTopologyChangeNonFailoverSafe
* IgniteCacheDataStructuresSelfTestSuite: GridCachePartitionedAtomicSetSelfTest.testMultithreaded
{color:#d04437}Scala (Examples){color} [[tests 1|https://ci.ignite.apache.org/viewLog.html?buildId=4117871]]
* ScalarExamplesSelfTestSuite: ScalarExamplesMultiNodeSelfTest.testScalarSharedRDDExample
{color:#d04437}Cache 7{color} [[tests 5|https://ci.ignite.apache.org/viewLog.html?buildId=4117921]]
* IgniteCacheTestSuite7: IgniteCachePartitionLossPolicySelfTest.testReadWriteAllWithPersistence
* IgniteCacheTestSuite7: IgniteCachePartitionLossPolicySelfTest.testIgnore
* IgniteCacheTestSuite7: IgniteCachePartitionLossPolicySelfTest.testReadOnlyAllWithPersistence
* IgniteCacheTestSuite7: IgniteCachePartitionLossPolicySelfTest.testIgnoreWithPersistence
* IgniteCacheTestSuite7: IgniteCachePartitionLossPolicySelfTest.testIgnoreKillThreeNodesWithPersistence
{color:#d04437}ZooKeeper (Discovery) 2{color} [[tests 0 TIMEOUT , Exit Code |https://ci.ignite.apache.org/viewLog.html?buildId=4131066]]
{color:#d04437}Cache 3{color} [[tests 0 TIMEOUT , Exit Code |https://ci.ignite.apache.org/viewLog.html?buildId=4131074]]
{color:#d04437}PDS 2{color} [[tests 3|https://ci.ignite.apache.org/viewLog.html?buildId=4131076]]
* IgnitePdsTestSuite2: IgnitePdsDestroyCacheWithoutCheckpointsTest.testDestroyCachesAbruptlyWithoutCheckpoints
* IgnitePdsTestSuite2: IgnitePersistentStoreDataStructuresTest.testSet
{color:#d04437}Hibernate 5.1{color} [[tests 2|https://ci.ignite.apache.org/viewLog.html?buildId=4117873]]
* IgniteHibernate5TestSuite: CacheHibernateStoreFactorySelfTest.testIncorrectBeanConfiguration
* IgniteHibernate5TestSuite: CacheHibernateBlobStoreSelfTest.testSimpleMultithreading
{color:#d04437}Hibernate 4.2{color} [[tests 2|https://ci.ignite.apache.org/viewLog.html?buildId=4117879]]
* IgniteHibernateTestSuite: CacheHibernateStoreFactorySelfTest.testIncorrectBeanConfiguration
* IgniteHibernateTestSuite: CacheHibernateBlobStoreSelfTest.testSimpleMultithreading
{color:#d04437}Thin client: Node.js{color} [[tests 0 Exit Code |https://ci.ignite.apache.org/viewLog.html?buildId=4131084]]
{color:#d04437}Thin client: PHP{color} [[tests 0 Exit Code |https://ci.ignite.apache.org/viewLog.html?buildId=4131080]]
{color:#d04437}Thin client: Python{color} [[tests 0 Exit Code |https://ci.ignite.apache.org/viewLog.html?buildId=4131082]]
{color:#d04437}Cache 1{color} [[tests 0 TIMEOUT , Exit Code |https://ci.ignite.apache.org/viewLog.html?buildId=4131056]]
{color:#d04437}Cache 5{color} [[tests 2|https://ci.ignite.apache.org/viewLog.html?buildId=4117933]]
* IgniteCacheWithIndexingTestSuite: RebuildIndexLogMessageTest.testRebuildIndexLogMessage
{color:#d04437}Basic 3{color} [[tests 3|https://ci.ignite.apache.org/viewLog.html?buildId=4117969]]
* IgniteBasicWithPersistenceTestSuite: SystemWorkersBlockingTest.testBlockingWorker
* IgniteBasicWithPersistenceTestSuite: PluginNodeValidationTest.testValidationException
* IgniteBasicWithPersistenceTestSuite: SystemWorkersTerminationTest.testSyntheticWorkerTermination
{color:#d04437}Cache (Restarts) 2{color} [[tests 1|https://ci.ignite.apache.org/viewLog.html?buildId=4117851]]
* IgniteCacheRestartTestSuite2: IgniteCacheAtomicNodeRestartTest.testRestartWithPutFourNodesNoBackups
{color:#d04437}Platform C++ (Win x64 / Release){color} [[tests 2 Failure on metric , BuildFailureOnMessage |https://ci.ignite.apache.org/viewLog.html?buildId=4131060]]
{color:#d04437}Platform C++ (Linux Clang){color} [[tests 0 Exit Code , Failure on metric |https://ci.ignite.apache.org/viewLog.html?buildId=4131046]]
{color:#d04437}Cache 9{color} [[tests 1|https://ci.ignite.apache.org/viewLog.html?buildId=4117905]]
* IgniteCacheTestSuite9: CleanupRestoredCachesSlowTest.testCleanupSlow
{color:#d04437}Cache (Deadlock Detection){color} [[tests 2|https://ci.ignite.apache.org/viewLog.html?buildId=4117957]]
* TxDeadlockDetectionTestSuite: TxDeadlockDetectionNoHangsTest.testNoHangsPessimistic
* TxDeadlockDetectionTestSuite: TxOptimisticDeadlockDetectionTest.testDeadlocksPartitioned
{color:#d04437}Continuous Query 2{color} [[tests 1|https://ci.ignite.apache.org/viewLog.html?buildId=4117861]]
* IgniteCacheQuerySelfTestSuite4: CacheContinuousQueryAsyncFailoverAtomicSelfTest.testFailoverStartStopBackup
{color:#d04437}Spring{color} [[tests 2|https://ci.ignite.apache.org/viewLog.html?buildId=4117889]]
* IgniteSpringTestSuite: CacheJdbcPojoStoreFactorySelfTest.testIncorrectBeanConfiguration
* IgniteSpringTestSuite: CacheJdbcBlobStoreFactorySelfTest.testIncorrectBeanConfiguration
{color:#d04437}Cache (Failover) 2{color} [[tests 1|https://ci.ignite.apache.org/viewLog.html?buildId=4117865]]
* IgniteCacheFailoverTestSuite2: CacheAsyncOperationsFailoverTxTest.testPutAllAsyncFailover
{panel}
[TeamCity *--> Run :: All* Results|https://ci.ignite.apache.org/viewLog.html?buildId=4086250&buildTypeId=IgniteTests24Java8_RunAll]
> GridCachePartitionedOptimisticTxNodeRestartTest hangs when node lefts topology
> ------------------------------------------------------------------------------
>
> Key: IGNITE-1090
> URL: https://issues.apache.org/jira/browse/IGNITE-1090
> Project: Ignite
> Issue Type: Sub-task
> Components: cache
> Reporter: Denis Magda
> Assignee: Semen Boikov
> Priority: Critical
> Labels: Muted_test, test-fail
> Fix For: 2.8
>
>
> The test hangs with the following errors:
> {noformat}
> [16:26:33] (err) Failed to execute compound future reducer: Compound future listener: GridCompoundIdentityFuture [super=GridCompoundFuture [lsnrCalls=0, finished=false, rdc=Map reducer: {}, init=true, res=java.util.concurrent.atomic.AtomicMarkableReference@3c6fff03, err=null, done=false, cancelled=false, err=null, futs=[true]]]class org.apache.ignite.IgniteCheckedException: Failed to wait for topology version to change: AffinityTopologyVersion [topVer=274, minorTopVer=0]
> at org.apache.ignite.internal.processors.cache.distributed.GridFutureRemapTimeoutObject.onTimeout(GridFutureRemapTimeoutObject.java:64)
> at org.apache.ignite.internal.processors.timeout.GridTimeoutProcessor$TimeoutWorker.body(GridTimeoutProcessor.java:158)
> at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:108)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: class org.apache.ignite.internal.cluster.ClusterTopologyCheckedException: Remote node left grid (will retry): 703c58e1-e099-4f22-b5c3-6c3676338007
> at org.apache.ignite.internal.processors.cache.distributed.near.GridNearGetFuture.onNodeLeft(GridNearGetFuture.java:215)
> at org.apache.ignite.internal.processors.cache.GridCacheMvccManager$3.onEvent(GridCacheMvccManager.java:186)
> at org.apache.ignite.internal.managers.eventstorage.GridEventStorageManager.notifyListeners(GridEventStorageManager.java:745)
> at org.apache.ignite.internal.managers.eventstorage.GridEventStorageManager.notifyListeners(GridEventStorageManager.java:730)
> at org.apache.ignite.internal.managers.eventstorage.GridEventStorageManager.record(GridEventStorageManager.java:270)
> at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryWorker.recordEvent(GridDiscoveryManager.java:1719)
> at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryWorker.body0(GridDiscoveryManager.java:1910)
> at org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryWorker.body(GridDiscoveryManager.java:1758)
> ... 2 more
> {noformat}
> This issue appeared after IGNITE-882 was fixed. Until it wasn't fixed the tests hung because of this issue:
> {noformat}
> Caused by: class org.apache.ignite.IgniteCheckedException: Remote node ID is not as expected [expected=9019c94c-84f5-4065-89b1-f16fdf708009, rcvd=707ed613-1b65-4771-ac98-5faa6857e007]
> at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.safeHandshake(TcpCommunicationSpi.java:2203)
> at org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.createTcpClient(TcpCommunicationSpi.java:2025)
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)