You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/05/02 16:16:31 UTC
[JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.8.0_05) - Build # 10107
- Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/10107/
Java: 64bit/jdk1.8.0_05 -XX:+UseCompressedOops -XX:+UseParallelGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.OverseerRolesTest.testDistribSearch
Error Message:
could not set the new overseer . expected 127.0.0.1:60964_ current order : [127.0.0.1:55049_, 127.0.0.1:60964_, 127.0.0.1:46103_, 127.0.0.1:51544_, 127.0.0.1:58928_, 127.0.0.1:39755_, 127.0.0.1:55049_, 127.0.0.1:52918_] ldr :null
Stack Trace:
java.lang.AssertionError: could not set the new overseer . expected 127.0.0.1:60964_ current order : [127.0.0.1:55049_, 127.0.0.1:60964_, 127.0.0.1:46103_, 127.0.0.1:51544_, 127.0.0.1:58928_, 127.0.0.1:39755_, 127.0.0.1:55049_, 127.0.0.1:52918_] ldr :null
at __randomizedtesting.SeedInfo.seed([5785737EC740BE34:D663FD66B01FDE08]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.OverseerRolesTest.testOverseerRole(OverseerRolesTest.java:159)
at org.apache.solr.cloud.OverseerRolesTest.doTest(OverseerRolesTest.java:95)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11787 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerRolesTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/init-core-data-001
[junit4] 2> 965925 T5185 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 965927 T5185 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 965928 T5185 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 965928 T5186 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 966028 T5185 oasc.ZkTestServer.run start zk server on port:54976
[junit4] 2> 966029 T5185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 997490 T5189 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 31460ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 997492 T5187 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145bd4723fa0000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 997494 T5192 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2caba28e name:ZooKeeperConnection Watcher:127.0.0.1:54976 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 997494 T5185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 997495 T5185 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 997497 T5185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 997497 T5194 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1691c526 name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 997498 T5185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 997498 T5185 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 997499 T5185 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 997501 T5185 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 997502 T5185 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 997503 T5185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 997504 T5185 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 997506 T5185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 997506 T5185 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 997508 T5185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 997509 T5185 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 997513 T5185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 997513 T5185 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 997515 T5185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 997515 T5185 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 997516 T5185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 997517 T5185 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 997518 T5185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 997519 T5185 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 997520 T5185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 997520 T5185 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 997521 T5185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 997522 T5185 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 997523 T5185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 997523 T5185 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 997525 T5185 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 997525 T5185 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 997774 T5185 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 997778 T5185 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58928
[junit4] 2> 997778 T5185 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 997778 T5185 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 997779 T5185 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-002
[junit4] 2> 997779 T5185 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-002/'
[junit4] 2> 997790 T5185 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-002/solr.xml
[junit4] 2> 997796 T5185 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-002
[junit4] 2> 997796 T5185 oasc.CoreContainer.<init> New CoreContainer 234416715
[junit4] 2> 997796 T5185 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-002/]
[junit4] 2> 997797 T5185 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 997797 T5185 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 997797 T5185 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 997797 T5185 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 997798 T5185 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 997798 T5185 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 997798 T5185 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 997798 T5185 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 997799 T5185 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 997799 T5185 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 997799 T5185 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 997799 T5185 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 997800 T5185 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54976/solr
[junit4] 2> 997800 T5185 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 997801 T5185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 997802 T5205 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@45d96ad name:ZooKeeperConnection Watcher:127.0.0.1:54976 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 997802 T5185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 997803 T5185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 997804 T5207 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2dfec24f name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 997804 T5185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 997805 T5185 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 997807 T5185 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 997809 T5185 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 997810 T5185 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 997815 T5185 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 997817 T5185 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 997817 T5185 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58928_
[junit4] 2> 997818 T5185 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58928_
[junit4] 2> 997819 T5185 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 997821 T5185 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 997824 T5185 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:58928_
[junit4] 2> 997824 T5185 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 997825 T5185 oasc.Overseer.start Overseer (id=91687480674877445-127.0.0.1:58928_-n_0000000000) starting
[junit4] 2> 997827 T5185 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 997831 T5209 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 997831 T5185 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 997832 T5209 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes at 127.0.0.1:58928_
[junit4] 2> 997833 T5185 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 997833 T5185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 997834 T5208 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 997835 T5185 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-002
[junit4] 2> 997841 T5185 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-002/conf/
[junit4] 2> 997955 T5185 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 997956 T5185 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0
[junit4] 2> 997956 T5185 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 997957 T5185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 997958 T5212 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4dc448d1 name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 997958 T5185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 997959 T5185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 997960 T5185 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 998186 T5185 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 998186 T5185 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 998188 T5185 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52918
[junit4] 2> 998188 T5185 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 998188 T5185 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 998188 T5185 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-003
[junit4] 2> 998189 T5185 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-003/'
[junit4] 2> 998198 T5185 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-003/solr.xml
[junit4] 2> 998205 T5185 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-003
[junit4] 2> 998205 T5185 oasc.CoreContainer.<init> New CoreContainer 508859615
[junit4] 2> 998205 T5185 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-003/]
[junit4] 2> 998206 T5185 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 998206 T5185 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 998206 T5185 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 998207 T5185 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 998207 T5185 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 998207 T5185 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 998207 T5185 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 998207 T5185 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 998208 T5185 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 998208 T5185 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 998208 T5185 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 998209 T5185 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 998209 T5185 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54976/solr
[junit4] 2> 998209 T5185 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 998210 T5185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 998211 T5223 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@79b5b5ee name:ZooKeeperConnection Watcher:127.0.0.1:54976 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 998211 T5185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 998212 T5185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 998213 T5225 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@351da9c name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 998213 T5185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 998217 T5185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 999219 T5185 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52918_
[junit4] 2> 999221 T5185 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52918_
[junit4] 2> 999224 T5207 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 999224 T5212 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 999224 T5225 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 999226 T5185 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-003
[junit4] 2> 999232 T5185 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-003/conf/
[junit4] 2> 999347 T5185 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 999348 T5185 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0
[junit4] 2> 999348 T5185 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 999574 T5185 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 999574 T5185 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 999576 T5185 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:39755
[junit4] 2> 999576 T5185 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 999576 T5185 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 999577 T5185 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-004
[junit4] 2> 999577 T5185 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-004/'
[junit4] 2> 999586 T5185 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-004/solr.xml
[junit4] 2> 999592 T5185 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-004
[junit4] 2> 999592 T5185 oasc.CoreContainer.<init> New CoreContainer 905045590
[junit4] 2> 999593 T5185 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-004/]
[junit4] 2> 999593 T5185 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 999593 T5185 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 999593 T5185 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 999594 T5185 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 999594 T5185 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 999594 T5185 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 999594 T5185 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 999594 T5185 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 999595 T5185 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 999595 T5185 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 999595 T5185 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 999596 T5185 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 999596 T5185 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54976/solr
[junit4] 2> 999596 T5185 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 999597 T5185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 999598 T5237 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@20e206a3 name:ZooKeeperConnection Watcher:127.0.0.1:54976 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 999598 T5185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 999599 T5185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 999600 T5239 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@38a466cb name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 999600 T5185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 999604 T5185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1000605 T5185 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39755_
[junit4] 2> 1000607 T5185 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39755_
[junit4] 2> 1000609 T5225 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1000609 T5207 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1000609 T5239 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1000609 T5212 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1000611 T5185 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-004
[junit4] 2> 1000615 T5185 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-004/conf/
[junit4] 2> 1000705 T5185 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1000706 T5185 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0
[junit4] 2> 1000707 T5185 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1000931 T5185 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 1000931 T5185 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1000933 T5185 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55049
[junit4] 2> 1000934 T5185 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1000934 T5185 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1000935 T5185 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-005
[junit4] 2> 1000935 T5185 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-005/'
[junit4] 2> 1000954 T5185 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-005/solr.xml
[junit4] 2> 1000973 T5185 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-005
[junit4] 2> 1000974 T5185 oasc.CoreContainer.<init> New CoreContainer 543596444
[junit4] 2> 1000974 T5185 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-005/]
[junit4] 2> 1000974 T5185 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1000974 T5185 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1000975 T5185 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1000975 T5185 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1000975 T5185 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1000975 T5185 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1000976 T5185 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1000976 T5185 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1000976 T5185 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1000976 T5185 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1000977 T5185 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1000977 T5185 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1000977 T5185 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54976/solr
[junit4] 2> 1000977 T5185 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1000978 T5185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1000979 T5251 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6451511e name:ZooKeeperConnection Watcher:127.0.0.1:54976 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1000980 T5185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1000982 T5185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1000983 T5253 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1eb5095b name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1000984 T5185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1000994 T5185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1001996 T5185 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55049_
[junit4] 2> 1002012 T5185 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55049_
[junit4] 2> 1002033 T5207 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1002033 T5212 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1002033 T5239 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1002033 T5225 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1002033 T5253 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1008703 T5187 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145bd4723fa0006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1008803 T5212 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4dc448d1 name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 1008804 T5212 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 1009894 T5212 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4dc448d1 name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1015371 T5187 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145bd4723fa0005, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1015372 T5187 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145bd4723fa000c, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1015372 T5187 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145bd4723fa0008, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1015373 T5187 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145bd4723fa000a, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1015471 T5207 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2dfec24f name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 1015472 T5207 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 1015471 T5253 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1eb5095b name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 1015472 T5253 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 1015471 T5225 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@351da9c name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 1015473 T5225 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 1015472 T5207 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
[junit4] 2> 1015473 T5207 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
[junit4] 2> 1015473 T5239 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@38a466cb name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 1015474 T5239 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 1016490 T5225 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@351da9c name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1016564 T5187 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145bd4723fa0006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1016664 T5212 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4dc448d1 name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 1016664 T5212 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 1017338 T5253 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1eb5095b name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1017422 T5207 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2dfec24f name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1017422 T5207 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: SyncConnected type None
[junit4] 2> 1017422 T5207 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: SyncConnected type None
[junit4] 2> 1017461 T5239 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@38a466cb name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1018239 T5212 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4dc448d1 name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1024908 T5187 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145bd4723fa0006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1025009 T5212 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4dc448d1 name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 1025009 T5212 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 1026653 T5212 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4dc448d1 name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1029830 T5187 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145bd4723fa0008, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1029930 T5225 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@351da9c name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 1029930 T5225 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 1030674 T5187 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145bd4723fa000c, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1030756 T5187 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145bd4723fa0005, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1030774 T5253 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1eb5095b name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 1030774 T5253 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 1030801 T5187 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145bd4723fa000a, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1030856 T5207 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2dfec24f name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 1030857 T5207 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 1030857 T5207 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
[junit4] 2> 1030857 T5207 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
[junit4] 2> 1030901 T5239 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@38a466cb name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 1030901 T5239 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 1031412 T5225 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@351da9c name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1031958 T5207 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2dfec24f name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1031959 T5207 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: SyncConnected type None
[junit4] 2> 1031959 T5207 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: SyncConnected type None
[junit4] 2> 1032061 T5253 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1eb5095b name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1032365 T5239 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@38a466cb name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1032765 T5189 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 30730ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 1032765 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 1032766 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 1032766 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 1032766 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 1032766 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 1032767 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 1032767 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 1032767 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 1032767 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 1032768 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 1032768 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 1032768 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 1032768 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 1032769 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 1032769 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 1032769 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 1032769 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 1032771 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 1032771 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 1032772 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 1032772 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
[junit4] 2>
[junit4] 2> 1032776 T5185 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-005
[junit4] 2> 1032783 T5185 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-005/conf/
[junit4] 2> 1032880 T5185 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1032881 T5185 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0
[junit4] 2> 1032881 T5185 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1033115 T5185 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
[junit4] 2> 1033116 T5185 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1033118 T5185 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60964
[junit4] 2> 1033118 T5185 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1033119 T5185 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1033119 T5185 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-006
[junit4] 2> 1033119 T5185 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-006/'
[junit4] 2> 1033130 T5185 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-006/solr.xml
[junit4] 2> 1033136 T5185 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-006
[junit4] 2> 1033137 T5185 oasc.CoreContainer.<init> New CoreContainer 956736780
[junit4] 2> 1033137 T5185 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-006/]
[junit4] 2> 1033137 T5185 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1033137 T5185 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1033138 T5185 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1033138 T5185 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1033138 T5185 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1033138 T5185 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1033138 T5185 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1033139 T5185 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1033139 T5185 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1033139 T5185 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1033140 T5185 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1033140 T5185 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1033140 T5185 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54976/solr
[junit4] 2> 1033140 T5185 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1033141 T5185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1033142 T5265 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5a5d09df name:ZooKeeperConnection Watcher:127.0.0.1:54976 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1033142 T5185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1033143 T5185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1033144 T5267 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a13133f name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1033144 T5185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1033148 T5185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1034150 T5185 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60964_
[junit4] 2> 1034152 T5185 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60964_
[junit4] 2> 1034153 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)
[junit4] 2> at org.apache.zookeeper.server.DataTree.createNode(DataTree.java:523)
[junit4] 2> at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:791)
[junit4] 2> at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)
[junit4] 2> at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 1034154 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)
[junit4] 2> at org.apache.zookeeper.server.DataTree.createNode(DataTree.java:523)
[junit4] 2> at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:791)
[junit4] 2> at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)
[junit4] 2> at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 1034154 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)
[junit4] 2> at org.apache.zookeeper.server.DataTree.createNode(DataTree.java:523)
[junit4] 2> at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:791)
[junit4] 2> at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)
[junit4] 2> at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 1034154 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)
[junit4] 2> at org.apache.zookeeper.server.DataTree.createNode(DataTree.java:523)
[junit4] 2> at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:791)
[junit4] 2> at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)
[junit4] 2> at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 1034155 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)
[junit4] 2> at org.apache.zookeeper.server.DataTree.createNode(DataTree.java:523)
[junit4] 2> at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:791)
[junit4] 2> at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)
[junit4] 2> at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 1034155 T5189 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)
[junit4] 2> at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)
[junit4] 2> at org.apache.zookeeper.server.DataTree.createNode(DataTree.java:523)
[junit4] 2> at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:791)
[junit4] 2> at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)
[junit4] 2> at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 1034156 T5239 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1034156 T5225 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1034156 T5267 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1034156 T5207 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1034156 T5253 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1034156 T5212 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1034158 T5185 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-006
[junit4] 2> 1034163 T5185 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-006/conf/
[junit4] 2> 1034257 T5185 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1034258 T5185 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0
[junit4] 2> 1034258 T5185 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1034497 T5185 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 5
[junit4] 2> 1034497 T5185 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1034499 T5185 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:46103
[junit4] 2> 1034499 T5185 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1034499 T5185 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1034500 T5185 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-007
[junit4] 2> 1034500 T5185 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-007/'
[junit4] 2> 1034510 T5185 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-007/solr.xml
[junit4] 2> 1034517 T5185 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-007
[junit4] 2> 1034517 T5185 oasc.CoreContainer.<init> New CoreContainer 1752482967
[junit4] 2> 1034517 T5185 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-007/]
[junit4] 2> 1034518 T5185 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1034518 T5185 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1034518 T5185 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1034518 T5185 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1034519 T5185 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1034519 T5185 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1034519 T5185 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1034519 T5185 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1034520 T5185 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1034520 T5185 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1034520 T5185 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1034520 T5185 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1034521 T5185 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54976/solr
[junit4] 2> 1034521 T5185 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1034522 T5185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1034523 T5279 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@66a324b3 name:ZooKeeperConnection Watcher:127.0.0.1:54976 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1034523 T5185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1034524 T5185 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1034525 T5281 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3ea055e2 name:ZooKeeperConnection Watcher:127.0.0.1:54976/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1034525 T5185 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1034529 T5185 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1035531 T5185 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46103_
[junit4] 2> 1035532 T5185 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46103_
[junit4] 2> 1035534 T5212 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 1035534 T5225 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 1035534 T5239 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 1035534 T5281 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 1035534 T5267 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 1035534 T5253 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 1035534 T5207 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 1035536 T5185 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-007
[junit4] 2> 1035541 T5185 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-007/conf/
[junit4] 2> 1035656 T5185 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1035657 T5185 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0
[junit4] 2> 1035658 T5185 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1035878 T5185 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 6
[junit4] 2> 1035879 T5185 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1035881 T5185 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51544
[junit4] 2> 1035881 T5185 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1035882 T5185 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1035882 T5185 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-008
[junit4] 2> 1035882 T5185 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-008/'
[junit4] 2> 1035892 T5185 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-008/solr.xml
[junit4] 2> 1035908 T5185 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-008
[junit4] 2> 1035908 T5185 oasc.CoreContainer.<init> New CoreContainer 1902344842
[junit4] 2> 1035908 T5185 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001/tempDir-008/]
[junit4] 2> 1035909 T5185 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout t
[...truncated too long message...]
Session expired for /collections
[junit4] 2> at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:123)
[junit4] 2> ... 7 more
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:209)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:206)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:206)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:417)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:386)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:373)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:128)
[junit4] 2> at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
[junit4] 2> ... 8 more
[junit4] 2>
[junit4] 2> 1068717 T5267 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1068717 T5267 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 1068718 T5267 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/testOverseerQuit/leader_elect/shard2/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.OverseerRolesTest-5785737EC740BE34-001
[junit4] 2> NOTE: test params are: codec=Lucene3x, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ms, timezone=Africa/Blantyre
[junit4] 2> NOTE: Linux 3.8.0-38-generic amd64/Oracle Corporation 1.8.0_05 (64-bit)/cpus=8,threads=1,free=107648344,total=296747008
[junit4] 2> NOTE: All tests run in this JVM: [TestBM25SimilarityFactory, ZkControllerTest, TestJoin, DocExpirationUpdateProcessorFactoryTest, TestPerFieldSimilarity, PrimitiveFieldTypeTest, SampleTest, LegacyHTMLStripCharFilterTest, ReturnFieldsTest, ShardSplitTest, RegexBoostProcessorTest, SolrInfoMBeanTest, TestMaxScoreQueryParser, RecoveryZkTest, TestSuggestSpellingConverter, TestPseudoReturnFields, DistributedQueryComponentCustomSortTest, StatelessScriptUpdateProcessorFactoryTest, TestDocumentBuilder, TestSystemIdResolver, TestTrie, TestDefaultSearchFieldResource, SynonymTokenizerTest, DateMathParserTest, UpdateRequestProcessorFactoryTest, TestDocSet, ScriptEngineTest, ZkCLITest, UUIDFieldTest, SchemaVersionSpecificBehaviorTest, TestRealTimeGet, TestUniqueKeyFieldResource, TestFreeTextSuggestions, TestBadConfig, EchoParamsTest, TestLuceneMatchVersion, TestFieldSortValues, InfoHandlerTest, SpellPossibilityIteratorTest, CacheHeaderTest, IndexSchemaTest, TestExpandComponent, TestCollapseQParserPlugin, CSVRequestHandlerTest, FieldMutatingUpdateProcessorTest, ResourceLoaderTest, TestSerializedLuceneMatchVersion, TestRemoteStreaming, DOMUtilTest, CollectionsAPIAsyncDistributedZkTest, TestDocBasedVersionConstraints, TestClassNameShortening, HdfsRecoveryZkTest, TestFieldCollectionResource, ClusterStateUpdateTest, SolrCoreTest, WordBreakSolrSpellCheckerTest, FastVectorHighlighterTest, AnalysisAfterCoreReloadTest, HdfsUnloadDistributedZkTest, TestManagedSynonymFilterFactory, SuggesterFSTTest, AutoCommitTest, TestCollationKeyRangeQueries, HdfsSyncSliceTest, BadComponentTest, TestRestManager, TestSolrQueryParserResource, SoftAutoCommitTest, TestGroupingSearch, TestSolrXMLSerializer, PeerSyncTest, CoreAdminHandlerTest, TestWriterPerf, OverseerTest, LeaderElectionTest, URLClassifyProcessorTest, TestElisionMultitermQuery, TestPHPSerializedResponseWriter, TestFileDictionaryLookup, TestCustomSort, TestReplicationHandler, TestBlendedInfixSuggestions, TestStressVersions, ShowFileRequestHandlerTest, LoggingHandlerTest, SolrIndexSplitterTest, QueryEqualityTest, TestConfigSets, ClusterStateTest, TestFieldResource, QueryElevationComponentTest, FileBasedSpellCheckerTest, TermVectorComponentTest, DistributedQueryElevationComponentTest, TestManagedResource, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest, BasicZkTest, TestZkChroot, TestRandomDVFaceting, TestRecovery, DistributedSpellCheckComponentTest, TestMultiCoreConfBootstrap, TestRangeQuery, SimpleFacetsTest, StatsComponentTest, SpellCheckComponentTest, TestFunctionQuery, BasicFunctionalityTest, HighlighterTest, CurrencyFieldOpenExchangeTest, TestCoreDiscovery, SolrRequestParserTest, DocValuesTest, SpatialFilterTest, TestCSVLoader, DirectUpdateHandlerOptimizeTest, SortByFunctionTest, TestSolrDeletionPolicy1, TestSurroundQueryParser, DisMaxRequestHandlerTest, TestQueryUtils, TestReversedWildcardFilterFactory, TermsComponentTest, RequestHandlersTest, TestValueSourceCache, MoreLikeThisHandlerTest, IndexSchemaRuntimeFieldTest, TestJmxIntegration, JSONWriterTest, MBeansHandlerTest, UniqFieldsUpdateProcessorFactoryTest, BinaryUpdateRequestHandlerTest, SearchHandlerTest, TestLFUCache, TestQuerySenderListener, AlternateDirectoryTest, CopyFieldTest, SolrIndexConfigTest, TestBinaryField, MinimalSchemaTest, TestPostingsSolrHighlighter, TestCodecSupport, TestNumberUtils, TestLMJelinekMercerSimilarityFactory, TimeZoneUtilsTest, TestFastOutputStream, ChaosMonkeyNothingIsSafeTest, MigrateRouteKeyTest, OverseerRolesTest]
[junit4] Completed on J0 in 102.92s, 1 test, 1 failure <<< FAILURES!
[...truncated 192 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/lucene/common-build.xml:1297: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/lucene/common-build.xml:921: There were test failures: 389 suites, 1626 tests, 1 failure, 37 ignored (16 assumptions)
Total time: 51 minutes 59 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0_05 -XX:+UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure