You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@geode.apache.org by "Jens Deppe (JIRA)" <ji...@apache.org> on 2015/12/21 16:17:46 UTC
[jira] [Reopened] (GEODE-355) Intermittent suspect string failure
of
PRClientServerRegionFunctionExecutionSelectorNoSingleHopDUnitTest.testserverMultiKeyExecution_SocektTimeOut
[ https://issues.apache.org/jira/browse/GEODE-355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jens Deppe reopened GEODE-355:
------------------------------
Assignee: Dan Smith (was: Anilkumar Gingade)
Recurred in build #945
{noformat}
Error Message
java.lang.AssertionError: Suspicious strings were written to the log during this run.
Fix the strings or use DistributedTestCase.addExpectedException to ignore.
-----------------------------------------------------------------------
Found suspect string in log4j at line 3242
[fatal 2015/12/18 12:49:41.432 PST <Cache Server Selector /0.0.0.0:20500 local port: 20500> tid=0x207e] Failed to send message <DestroyRegionOperation$DestroyRegionMessage(region path='/_gfe_non_durable_client_with_id_timor(21960:loner)<ec>:58718:c0b8dab6_1_queue'; sender=timor(21942)<ec><v870>:1025; callbackArg=null; processorId=14608; op=REGION_LOCAL_DESTROY; applied=false; directAck=false; posdup=false; hasDelta=false; hasOldValue=false; eventID=null; serialNum=4803; subregionSerialNumbers={}; notifyOfRegionDeparture=false)> to member <timor(21951)<ec><v873>:1026> view = View[timor(21937:locator)<ec><v0>:1024|876] members: [timor(21937:locator)<ec><v0>:1024, timor(21942)<ec><v870>:1025{lead}, timor(21951)<ec><v873>:1026, timor(21955)<ec><v876>:1027]
com.gemstone.gemfire.distributed.internal.direct.ShunnedMemberException: Member is being shunned: timor(21951)<ec><v873>:1026
at com.gemstone.gemfire.distributed.internal.direct.DirectChannel.getConnections(DirectChannel.java:599)
at com.gemstone.gemfire.distributed.internal.direct.DirectChannel.sendToMany(DirectChannel.java:374)
at com.gemstone.gemfire.distributed.internal.direct.DirectChannel.send(DirectChannel.java:667)
at com.gemstone.gemfire.distributed.internal.membership.gms.mgr.GMSMembershipManager.directChannelSend(GMSMembershipManager.java:1730)
at com.gemstone.gemfire.distributed.internal.membership.gms.mgr.GMSMembershipManager.send(GMSMembershipManager.java:1924)
at com.gemstone.gemfire.distributed.internal.DistributionChannel.send(DistributionChannel.java:88)
at com.gemstone.gemfire.distributed.internal.DistributionManager.sendOutgoing(DistributionManager.java:3474)
at com.gemstone.gemfire.distributed.internal.DistributionManager.sendMessage(DistributionManager.java:3515)
at com.gemstone.gemfire.distributed.internal.DistributionManager.putOutgoing(DistributionManager.java:1874)
at com.gemstone.gemfire.internal.cache.DistributedCacheOperation.distribute(DistributedCacheOperation.java:529)
at com.gemstone.gemfire.internal.cache.DistributedRegion.distributeDestroyRegion(DistributedRegion.java:1957)
at com.gemstone.gemfire.internal.cache.DistributedRegion.basicDestroyRegion(DistributedRegion.java:1932)
at com.gemstone.gemfire.internal.cache.LocalRegion.basicDestroyRegion(LocalRegion.java:6825)
at com.gemstone.gemfire.internal.cache.HARegion.destroyRegion(HARegion.java:347)
at com.gemstone.gemfire.internal.cache.AbstractRegion.destroyRegion(AbstractRegion.java:376)
at com.gemstone.gemfire.internal.cache.ha.HARegionQueue.destroy(HARegionQueue.java:3733)
at com.gemstone.gemfire.internal.cache.ha.HARegionQueue$BlockingHARegionQueue.destroy(HARegionQueue.java:2392)
at com.gemstone.gemfire.internal.cache.tier.sockets.CacheClientProxy.destroyRQ(CacheClientProxy.java:1065)
at com.gemstone.gemfire.internal.cache.tier.sockets.CacheClientProxy.terminateDispatching(CacheClientProxy.java:973)
at com.gemstone.gemfire.internal.cache.tier.sockets.CacheClientProxy.close(CacheClientProxy.java:850)
at com.gemstone.gemfire.internal.cache.tier.sockets.CacheClientNotifier.closeDeadProxies(CacheClientNotifier.java:1977)
at com.gemstone.gemfire.internal.cache.tier.sockets.CacheClientNotifier.unregisterClient(CacheClientNotifier.java:785)
at com.gemstone.gemfire.internal.cache.tier.sockets.ClientHealthMonitor.unregisterClient(ClientHealthMonitor.java:275)
at com.gemstone.gemfire.internal.cache.tier.sockets.ServerConnection.handleTermination(ServerConnection.java:906)
at com.gemstone.gemfire.internal.cache.tier.sockets.ServerConnection.handleTermination(ServerConnection.java:827)
at com.gemstone.gemfire.internal.cache.tier.sockets.AcceptorImpl.finishCon(AcceptorImpl.java:786)
at com.gemstone.gemfire.internal.cache.tier.sockets.AcceptorImpl.drainSelectorQueue(AcceptorImpl.java:807)
at com.gemstone.gemfire.internal.cache.tier.sockets.AcceptorImpl.runSelectorLoop(AcceptorImpl.java:1179)
at com.gemstone.gemfire.internal.cache.tier.sockets.AcceptorImpl$4.run(AcceptorImpl.java:709)
at java.lang.Thread.run(Thread.java:745)
Stacktrace
java.lang.AssertionError: Suspicious strings were written to the log during this run.
Fix the strings or use DistributedTestCase.addExpectedException to ignore.
-----------------------------------------------------------------------
Found suspect string in log4j at line 3242
[fatal 2015/12/18 12:49:41.432 PST <Cache Server Selector /0.0.0.0:20500 local port: 20500> tid=0x207e] Failed to send message <DestroyRegionOperation$DestroyRegionMessage(region path='/_gfe_non_durable_client_with_id_timor(21960:loner)<ec>:58718:c0b8dab6_1_queue'; sender=timor(21942)<ec><v870>:1025; callbackArg=null; processorId=14608; op=REGION_LOCAL_DESTROY; applied=false; directAck=false; posdup=false; hasDelta=false; hasOldValue=false; eventID=null; serialNum=4803; subregionSerialNumbers={}; notifyOfRegionDeparture=false)> to member <timor(21951)<ec><v873>:1026> view = View[timor(21937:locator)<ec><v0>:1024|876] members: [timor(21937:locator)<ec><v0>:1024, timor(21942)<ec><v870>:1025{lead}, timor(21951)<ec><v873>:1026, timor(21955)<ec><v876>:1027]
com.gemstone.gemfire.distributed.internal.direct.ShunnedMemberException: Member is being shunned: timor(21951)<ec><v873>:1026
at com.gemstone.gemfire.distributed.internal.direct.DirectChannel.getConnections(DirectChannel.java:599)
at com.gemstone.gemfire.distributed.internal.direct.DirectChannel.sendToMany(DirectChannel.java:374)
at com.gemstone.gemfire.distributed.internal.direct.DirectChannel.send(DirectChannel.java:667)
at com.gemstone.gemfire.distributed.internal.membership.gms.mgr.GMSMembershipManager.directChannelSend(GMSMembershipManager.java:1730)
at com.gemstone.gemfire.distributed.internal.membership.gms.mgr.GMSMembershipManager.send(GMSMembershipManager.java:1924)
at com.gemstone.gemfire.distributed.internal.DistributionChannel.send(DistributionChannel.java:88)
at com.gemstone.gemfire.distributed.internal.DistributionManager.sendOutgoing(DistributionManager.java:3474)
at com.gemstone.gemfire.distributed.internal.DistributionManager.sendMessage(DistributionManager.java:3515)
at com.gemstone.gemfire.distributed.internal.DistributionManager.putOutgoing(DistributionManager.java:1874)
at com.gemstone.gemfire.internal.cache.DistributedCacheOperation.distribute(DistributedCacheOperation.java:529)
at com.gemstone.gemfire.internal.cache.DistributedRegion.distributeDestroyRegion(DistributedRegion.java:1957)
at com.gemstone.gemfire.internal.cache.DistributedRegion.basicDestroyRegion(DistributedRegion.java:1932)
at com.gemstone.gemfire.internal.cache.LocalRegion.basicDestroyRegion(LocalRegion.java:6825)
at com.gemstone.gemfire.internal.cache.HARegion.destroyRegion(HARegion.java:347)
at com.gemstone.gemfire.internal.cache.AbstractRegion.destroyRegion(AbstractRegion.java:376)
at com.gemstone.gemfire.internal.cache.ha.HARegionQueue.destroy(HARegionQueue.java:3733)
at com.gemstone.gemfire.internal.cache.ha.HARegionQueue$BlockingHARegionQueue.destroy(HARegionQueue.java:2392)
at com.gemstone.gemfire.internal.cache.tier.sockets.CacheClientProxy.destroyRQ(CacheClientProxy.java:1065)
at com.gemstone.gemfire.internal.cache.tier.sockets.CacheClientProxy.terminateDispatching(CacheClientProxy.java:973)
at com.gemstone.gemfire.internal.cache.tier.sockets.CacheClientProxy.close(CacheClientProxy.java:850)
at com.gemstone.gemfire.internal.cache.tier.sockets.CacheClientNotifier.closeDeadProxies(CacheClientNotifier.java:1977)
at com.gemstone.gemfire.internal.cache.tier.sockets.CacheClientNotifier.unregisterClient(CacheClientNotifier.java:785)
at com.gemstone.gemfire.internal.cache.tier.sockets.ClientHealthMonitor.unregisterClient(ClientHealthMonitor.java:275)
at com.gemstone.gemfire.internal.cache.tier.sockets.ServerConnection.handleTermination(ServerConnection.java:906)
at com.gemstone.gemfire.internal.cache.tier.sockets.ServerConnection.handleTermination(ServerConnection.java:827)
at com.gemstone.gemfire.internal.cache.tier.sockets.AcceptorImpl.finishCon(AcceptorImpl.java:786)
at com.gemstone.gemfire.internal.cache.tier.sockets.AcceptorImpl.drainSelectorQueue(AcceptorImpl.java:807)
at com.gemstone.gemfire.internal.cache.tier.sockets.AcceptorImpl.runSelectorLoop(AcceptorImpl.java:1179)
at com.gemstone.gemfire.internal.cache.tier.sockets.AcceptorImpl$4.run(AcceptorImpl.java:709)
at java.lang.Thread.run(Thread.java:745)
at org.junit.Assert.fail(Assert.java:88)
at dunit.standalone.DUnitLauncher.closeAndCheckForSuspects(DUnitLauncher.java:354)
at dunit.DistributedTestCase.cleanupAllVms(DistributedTestCase.java:753)
at dunit.DistributedTestCase.realTearDown(DistributedTestCase.java:728)
at dunit.DistributedTestCase.tearDown(DistributedTestCase.java:706)
at junit.framework.TestCase.runBare(TestCase.java:146)
at junit.framework.TestResult$1.protect(TestResult.java:122)
at junit.framework.TestResult.runProtected(TestResult.java:142)
at junit.framework.TestResult.run(TestResult.java:125)
at junit.framework.TestCase.run(TestCase.java:129)
at junit.framework.TestSuite.runTest(TestSuite.java:252)
at junit.framework.TestSuite.run(TestSuite.java:247)
at org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:86)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:105)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:56)
at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:64)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:50)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:106)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:360)
at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:54)
at org.gradle.internal.concurrent.StoppableExecutorImpl$1.run(StoppableExecutorImpl.java:40)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Standard Output
Previously run tests: [PRColocationDUnitTest, PRTransactionDUnitTest, PRClientServerRegionFunctionExecutionFailoverDUnitTest, LocalDataSetIndexingDUnitTest, PRClientServerRegionFunctionExecutionDUnitTest, LocalDataSetDUnitTest, PRClientServerRegionFunctionExecutionSelectorNoSingleHopDUnitTest]
{noformat}
> Intermittent suspect string failure of PRClientServerRegionFunctionExecutionSelectorNoSingleHopDUnitTest.testserverMultiKeyExecution_SocektTimeOut
> --------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: GEODE-355
> URL: https://issues.apache.org/jira/browse/GEODE-355
> Project: Geode
> Issue Type: Bug
> Components: client/server
> Reporter: Darrel Schneider
> Assignee: Dan Smith
> Priority: Minor
> Labels: CI
>
> PRClientServerRegionFunctionExecutionSelectorNoSingleHopDUnitTest.testserverMultiKeyExecution_SocektTimeOut may fail with:
> {code}
> java.lang.AssertionError: Suspicious strings were written to the log during this run.
> Fix the strings or use DistributedTestCase.addExpectedException to ignore.
> -----------------------------------------------------------------------
> Found suspect string in log4j at line 3015
> java.net.SocketTimeoutException: Read timed out
> {code}
> The exception:
> {code}
> [vm_3][warn 2015/09/20 17:38:44.852 PDT <poolTimer-PRClientServerTestBase-2> tid=0x37e0] Could not connect to: cc2-rh6.gemstone.com:21380
> [vm_3]java.net.SocketTimeoutException: Read timed out
> [vm_3] at java.net.SocketInputStream.socketRead0(Native Method)
> [vm_3] at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
> [vm_3] at java.net.SocketInputStream.read(SocketInputStream.java:170)
> [vm_3] at java.net.SocketInputStream.read(SocketInputStream.java:141)
> [vm_3] at java.net.SocketInputStream.read(SocketInputStream.java:223)
> [vm_3] at java.io.DataInputStream.readByte(DataInputStream.java:265)
> [vm_3] at com.gemstone.gemfire.internal.cache.tier.sockets.HandShake.greet(HandShake.java:1291)
> [vm_3] at com.gemstone.gemfire.cache.client.internal.ConnectionImpl.connect(ConnectionImpl.java:127)
> [vm_3] at com.gemstone.gemfire.cache.client.internal.ConnectionFactoryImpl.createClientToServerConnection(ConnectionFactoryImpl.java:117)
> [vm_3] at com.gemstone.gemfire.cache.client.internal.ConnectionFactoryImpl.createClientToServerConnection(ConnectionFactoryImpl.java:233)
> [vm_3] at com.gemstone.gemfire.cache.client.internal.pooling.ConnectionManagerImpl.prefillConnection(ConnectionManagerImpl.java:795)
> [vm_3] at com.gemstone.gemfire.cache.client.internal.pooling.ConnectionManagerImpl.prefill(ConnectionManagerImpl.java:738)
> [vm_3] at com.gemstone.gemfire.cache.client.internal.pooling.ConnectionManagerImpl$PrefillConnectionsTask.run2(ConnectionManagerImpl.java:889)
> [vm_3] at com.gemstone.gemfire.cache.client.internal.PoolImpl$PoolTask.run(PoolImpl.java:1250)
> [vm_3] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> [vm_3] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [vm_3] at java.lang.Thread.run(Thread.java:745)
> {code}
> I also see this test adds SocketTimeoutException to its expected exceptions but it was not added before the above call stack
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)