You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/05/26 05:43:08 UTC
[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 505 -
Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/505/
Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseParallelGC
1 tests failed.
FAILED: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:51356/_e returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:51356/_e returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([97F5B1FAD6C68FBB:16133FE2A199EF87]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.GeneratedMethodAccessor34.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9960 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4:junit4] 2> 3505481 T7151 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /_e/
[junit4:junit4] 2> 3505489 T7151 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ShardSplitTest-1369539639405
[junit4:junit4] 2> 3505492 T7151 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 3505493 T7152 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 3505594 T7151 oasc.ZkTestServer.run start zk server on port:51349
[junit4:junit4] 2> 3505596 T7151 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3505606 T7158 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@609eb101 name:ZooKeeperConnection Watcher:127.0.0.1:51349 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3505607 T7151 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3505608 T7151 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 3505618 T7151 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3505626 T7160 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76d89bdf name:ZooKeeperConnection Watcher:127.0.0.1:51349/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3505627 T7151 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3505627 T7151 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 3505636 T7151 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 3505643 T7151 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 3505650 T7151 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 3505664 T7151 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 3505665 T7151 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 3505679 T7151 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 3505681 T7151 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 3505689 T7151 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 3505690 T7151 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 3505698 T7151 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 3505699 T7151 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 3505708 T7151 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 3505709 T7151 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 3505720 T7151 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 3505721 T7151 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 3505730 T7151 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 3505732 T7151 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 3505740 T7151 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 3505742 T7151 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 3505750 T7151 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 3505751 T7151 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 3506346 T7151 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 3506359 T7151 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51352
[junit4:junit4] 2> 3506361 T7151 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3506362 T7151 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3506363 T7151 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369539639675
[junit4:junit4] 2> 3506363 T7151 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369539639675/solr.xml
[junit4:junit4] 2> 3506364 T7151 oasc.CoreContainer.<init> New CoreContainer 1227247521
[junit4:junit4] 2> 3506365 T7151 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369539639675/'
[junit4:junit4] 2> 3506365 T7151 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369539639675/'
[junit4:junit4] 2> 3506620 T7151 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 3506622 T7151 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 3506623 T7151 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 3506624 T7151 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 3506626 T7151 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 3506628 T7151 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 3506629 T7151 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 3506630 T7151 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 3506631 T7151 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 3506632 T7151 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 3506662 T7151 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 3506663 T7151 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51349/solr
[junit4:junit4] 2> 3506664 T7151 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 3506669 T7151 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3506672 T7171 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5d4d66f2 name:ZooKeeperConnection Watcher:127.0.0.1:51349 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3506673 T7151 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3506684 T7151 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 3506711 T7151 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3506715 T7173 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@29a8e9a1 name:ZooKeeperConnection Watcher:127.0.0.1:51349/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3506716 T7151 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3506720 T7151 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 3506738 T7151 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 3506750 T7151 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 3506756 T7151 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51352__e
[junit4:junit4] 2> 3506759 T7151 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51352__e
[junit4:junit4] 2> 3506768 T7151 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 3506781 T7151 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 3506788 T7151 oasc.Overseer.start Overseer (id=89754149808832515-127.0.0.1:51352__e-n_0000000000) starting
[junit4:junit4] 2> 3506797 T7151 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 3506815 T7175 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 3506818 T7151 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 3506825 T7151 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 3506832 T7151 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3506840 T7174 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 3506851 T7176 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369539639675/collection1
[junit4:junit4] 2> 3506852 T7176 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 3506854 T7176 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 3506854 T7176 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 3506858 T7176 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369539639675/collection1/'
[junit4:junit4] 2> 3506860 T7176 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-controljetty-1369539639675/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 3506861 T7176 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-controljetty-1369539639675/collection1/lib/README' to classloader
[junit4:junit4] 2> 3506956 T7176 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 3507053 T7176 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 3507056 T7176 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 3507066 T7176 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 3508088 T7176 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 3508095 T7176 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 3508099 T7176 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 3508108 T7176 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 3508184 T7176 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 3508184 T7176 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1369539639675/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369539639404/control/data/
[junit4:junit4] 2> 3508185 T7176 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f91e749
[junit4:junit4] 2> 3508185 T7176 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 3508186 T7176 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369539639404/control/data
[junit4:junit4] 2> 3508187 T7176 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369539639404/control/data/index/
[junit4:junit4] 2> 3508187 T7176 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369539639404/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 3508188 T7176 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369539639404/control/data/index
[junit4:junit4] 2> 3508194 T7176 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@80109d1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65ed01d0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 3508195 T7176 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 3508199 T7176 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 3508199 T7176 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 3508200 T7176 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 3508201 T7176 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 3508202 T7176 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 3508203 T7176 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 3508203 T7176 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 3508204 T7176 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 3508205 T7176 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 3508232 T7176 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 3508243 T7176 oass.SolrIndexSearcher.<init> Opening Searcher@669ac7ed main
[junit4:junit4] 2> 3508244 T7176 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369539639404/control/data/tlog
[junit4:junit4] 2> 3508246 T7176 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 3508246 T7176 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 3508252 T7177 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@669ac7ed main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 3508254 T7176 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 3508255 T7176 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3508357 T7174 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3508359 T7174 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51352__e",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51352/_e"}
[junit4:junit4] 2> 3508359 T7174 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 3508360 T7174 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 3508370 T7173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3509260 T7176 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 3509260 T7176 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51352/_e collection:control_collection shard:shard1
[junit4:junit4] 2> 3509262 T7176 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 3509289 T7176 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 3509296 T7176 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 3509296 T7176 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 3509297 T7176 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51352/_e/collection1/
[junit4:junit4] 2> 3509297 T7176 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 3509297 T7176 oasc.SyncStrategy.syncToMe http://127.0.0.1:51352/_e/collection1/ has no replicas
[junit4:junit4] 2> 3509298 T7176 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51352/_e/collection1/
[junit4:junit4] 2> 3509298 T7176 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 3509888 T7174 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3509916 T7173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3509985 T7176 oasc.ZkController.register We are http://127.0.0.1:51352/_e/collection1/ and leader is http://127.0.0.1:51352/_e/collection1/
[junit4:junit4] 2> 3509986 T7176 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51352/_e
[junit4:junit4] 2> 3509986 T7176 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3509987 T7176 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3509987 T7176 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3509993 T7176 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3510002 T7151 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4] 2> 3510004 T7151 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3510005 T7151 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3510039 T7151 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3510044 T7151 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3510050 T7180 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@170fc880 name:ZooKeeperConnection Watcher:127.0.0.1:51349/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3510051 T7151 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3510055 T7151 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3510062 T7151 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 3510668 T7151 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 3510675 T7151 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51356
[junit4:junit4] 2> 3510678 T7151 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3510678 T7151 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3510679 T7151 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369539643976
[junit4:junit4] 2> 3510679 T7151 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369539643976/solr.xml
[junit4:junit4] 2> 3510680 T7151 oasc.CoreContainer.<init> New CoreContainer 1972994555
[junit4:junit4] 2> 3510681 T7151 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369539643976/'
[junit4:junit4] 2> 3510681 T7151 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369539643976/'
[junit4:junit4] 2> 3510900 T7151 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 3510901 T7151 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 3510902 T7151 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 3510903 T7151 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 3510903 T7151 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 3510904 T7151 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 3510904 T7151 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 3510905 T7151 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 3510905 T7151 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 3510906 T7151 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 3510936 T7151 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 3510938 T7151 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51349/solr
[junit4:junit4] 2> 3510938 T7151 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 3510940 T7151 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3510946 T7191 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6f861640 name:ZooKeeperConnection Watcher:127.0.0.1:51349 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3510947 T7151 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3510952 T7151 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 3510983 T7151 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3510988 T7193 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@29183a84 name:ZooKeeperConnection Watcher:127.0.0.1:51349/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3510989 T7151 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3511003 T7151 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3511437 T7174 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3511439 T7174 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:51352__e_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51352__e",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51352/_e"}
[junit4:junit4] 2> 3511451 T7180 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3511455 T7193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3511457 T7173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3512016 T7151 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51356__e
[junit4:junit4] 2> 3512020 T7151 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51356__e
[junit4:junit4] 2> 3512025 T7180 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3512030 T7180 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 3512032 T7193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3512033 T7173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3512042 T7194 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369539643976/collection1
[junit4:junit4] 2> 3512043 T7194 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 3512044 T7194 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 3512044 T7194 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 3512047 T7194 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369539643976/collection1/'
[junit4:junit4] 2> 3512048 T7194 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty1-1369539643976/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 3512049 T7194 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty1-1369539643976/collection1/lib/README' to classloader
[junit4:junit4] 2> 3512100 T7173 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 3512102 T7193 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 3512149 T7194 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 3512281 T7194 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 3512284 T7194 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 3512292 T7194 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 3513402 T7194 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 3513407 T7194 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 3513412 T7194 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 3513422 T7194 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 3513496 T7194 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 3513497 T7194 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1369539643976/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty1/
[junit4:junit4] 2> 3513497 T7194 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f91e749
[junit4:junit4] 2> 3513498 T7194 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 3513499 T7194 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty1
[junit4:junit4] 2> 3513500 T7194 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty1/index/
[junit4:junit4] 2> 3513500 T7194 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 3513501 T7194 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty1/index
[junit4:junit4] 2> 3513507 T7194 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b394ae7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5196baa8),segFN=segments_1,generation=1}
[junit4:junit4] 2> 3513508 T7194 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 3513513 T7194 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 3513514 T7194 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 3513516 T7194 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 3513517 T7194 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 3513518 T7194 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 3513518 T7194 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 3513519 T7194 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 3513520 T7194 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 3513521 T7194 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 3513553 T7194 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 3513567 T7194 oass.SolrIndexSearcher.<init> Opening Searcher@b1c4aa2 main
[junit4:junit4] 2> 3513568 T7194 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty1/tlog
[junit4:junit4] 2> 3513572 T7194 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 3513572 T7194 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 3513583 T7195 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b1c4aa2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 3513588 T7194 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 3513589 T7194 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3514497 T7174 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3514505 T7174 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51356__e",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51356/_e"}
[junit4:junit4] 2> 3514507 T7174 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 3514507 T7174 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 3514519 T7193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 3514520 T7173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 3514520 T7180 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 3514593 T7194 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 3514595 T7194 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51356/_e collection:collection1 shard:shard1
[junit4:junit4] 2> 3514597 T7194 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 3514630 T7194 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 3514645 T7194 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 3514646 T7194 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 3514646 T7194 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51356/_e/collection1/
[junit4:junit4] 2> 3514647 T7194 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 3514647 T7194 oasc.SyncStrategy.syncToMe http://127.0.0.1:51356/_e/collection1/ has no replicas
[junit4:junit4] 2> 3514647 T7194 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51356/_e/collection1/
[junit4:junit4] 2> 3514648 T7194 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 3516044 T7174 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3516069 T7173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 3516074 T7193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 3516077 T7180 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 3516129 T7194 oasc.ZkController.register We are http://127.0.0.1:51356/_e/collection1/ and leader is http://127.0.0.1:51356/_e/collection1/
[junit4:junit4] 2> 3516136 T7194 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51356/_e
[junit4:junit4] 2> 3516138 T7194 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3516139 T7194 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3516139 T7194 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3516158 T7194 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3516163 T7151 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4] 2> 3516164 T7151 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3516166 T7151 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3516948 T7151 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 3516956 T7151 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51359
[junit4:junit4] 2> 3516959 T7151 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3516960 T7151 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3516961 T7151 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369539650118
[junit4:junit4] 2> 3516962 T7151 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369539650118/solr.xml
[junit4:junit4] 2> 3516962 T7151 oasc.CoreContainer.<init> New CoreContainer 1102187133
[junit4:junit4] 2> 3516964 T7151 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369539650118/'
[junit4:junit4] 2> 3516965 T7151 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369539650118/'
[junit4:junit4] 2> 3517285 T7151 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 3517286 T7151 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 3517286 T7151 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 3517287 T7151 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 3517288 T7151 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 3517288 T7151 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 3517289 T7151 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 3517290 T7151 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 3517291 T7151 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 3517291 T7151 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 3517324 T7151 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 3517331 T7151 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51349/solr
[junit4:junit4] 2> 3517334 T7151 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 3517341 T7151 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3517347 T7207 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@480431ed name:ZooKeeperConnection Watcher:127.0.0.1:51349 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3517349 T7151 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3517355 T7151 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 3517385 T7151 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3517388 T7209 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@31eae68 name:ZooKeeperConnection Watcher:127.0.0.1:51349/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3517389 T7151 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3517405 T7151 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3517600 T7174 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3517602 T7174 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:51356__e_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51356__e",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51356/_e"}
[junit4:junit4] 2> 3517624 T7180 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 3517624 T7173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 3517624 T7193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 3517624 T7209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 3518426 T7151 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51359__e
[junit4:junit4] 2> 3518433 T7151 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51359__e
[junit4:junit4] 2> 3518443 T7193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 3518444 T7180 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 3518444 T7173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 3518451 T7209 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 3518452 T7209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 3518462 T7180 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 3518475 T7193 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 3518479 T7173 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 3518493 T7210 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369539650118/collection1
[junit4:junit4] 2> 3518494 T7210 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 3518496 T7210 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 3518496 T7210 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 3518501 T7210 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369539650118/collection1/'
[junit4:junit4] 2> 3518504 T7210 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty2-1369539650118/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 3518505 T7210 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty2-1369539650118/collection1/lib/README' to classloader
[junit4:junit4] 2> 3518648 T7210 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 3518746 T7210 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 3518755 T7210 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 3518764 T7210 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 3519984 T7210 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 3519990 T7210 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 3519994 T7210 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 3520004 T7210 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 3520086 T7210 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 3520087 T7210 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1369539650118/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty2/
[junit4:junit4] 2> 3520087 T7210 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f91e749
[junit4:junit4] 2> 3520088 T7210 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 3520089 T7210 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty2
[junit4:junit4] 2> 3520090 T7210 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty2/index/
[junit4:junit4] 2> 3520090 T7210 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 3520092 T7210 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty2/index
[junit4:junit4] 2> 3520098 T7210 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@163e39d1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ecd0485),segFN=segments_1,generation=1}
[junit4:junit4] 2> 3520099 T7210 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 3520111 T7210 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 3520115 T7210 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 3520116 T7210 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 3520117 T7210 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 3520118 T7210 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 3520119 T7210 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 3520119 T7210 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 3520120 T7210 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 3520121 T7210 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 3520144 T7210 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 3520156 T7210 oass.SolrIndexSearcher.<init> Opening Searcher@26522ef7 main
[junit4:junit4] 2> 3520157 T7210 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty2/tlog
[junit4:junit4] 2> 3520159 T7210 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 3520159 T7210 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 3520173 T7211 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@26522ef7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 3520176 T7210 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 3520176 T7210 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3520657 T7174 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3520660 T7174 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51359__e",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51359/_e"}
[junit4:junit4] 2> 3520660 T7174 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 3520661 T7174 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 3520674 T7180 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 3520674 T7209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 3520675 T7193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 3520675 T7173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 3521183 T7210 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 3521184 T7210 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51359/_e collection:collection1 shard:shard2
[junit4:junit4] 2> 3521187 T7210 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 3521204 T7210 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 3521211 T7210 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 3521212 T7210 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 3521212 T7210 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51359/_e/collection1/
[junit4:junit4] 2> 3521213 T7210 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 3521213 T7210 oasc.SyncStrategy.syncToMe http://127.0.0.1:51359/_e/collection1/ has no replicas
[junit4:junit4] 2> 3521214 T7210 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51359/_e/collection1/
[junit4:junit4] 2> 3521214 T7210 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 3522193 T7174 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3522218 T7180 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 3522218 T7209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 3522228 T7193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 3522236 T7173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 3522237 T7210 oasc.ZkController.register We are http://127.0.0.1:51359/_e/collection1/ and leader is http://127.0.0.1:51359/_e/collection1/
[junit4:junit4] 2> 3522238 T7210 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51359/_e
[junit4:junit4] 2> 3522238 T7210 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3522239 T7210 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3522239 T7210 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3522246 T7210 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3522251 T7151 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4] 2> 3522253 T7151 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3522254 T7151 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3522975 T7151 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 3522987 T7151 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51362
[junit4:junit4] 2> 3522990 T7151 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3522991 T7151 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3522992 T7151 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369539656205
[junit4:junit4] 2> 3522992 T7151 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369539656205/solr.xml
[junit4:junit4] 2> 3522993 T7151 oasc.CoreContainer.<init> New CoreContainer 202534996
[junit4:junit4] 2> 3522994 T7151 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369539656205/'
[junit4:junit4] 2> 3522995 T7151 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369539656205/'
[junit4:junit4] 2> 3523262 T7151 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 3523263 T7151 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 3523264 T7151 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 3523265 T7151 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 3523266 T7151 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 3523266 T7151 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 3523267 T7151 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 3523268 T7151 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 3523268 T7151 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 3523269 T7151 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 3523307 T7151 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 3523309 T7151 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51349/solr
[junit4:junit4] 2> 3523310 T7151 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 3523312 T7151 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3523320 T7223 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e7542a3 name:ZooKeeperConnection Watcher:127.0.0.1:51349 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3523322 T7151 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3523327 T7151 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 3523353 T7151 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3523359 T7225 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@56917899 name:ZooKeeperConnection Watcher:127.0.0.1:51349/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3523360 T7151 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3523383 T7151 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3523760 T7174 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3523762 T7174 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:51359__e_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51359__e",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51359/_e"}
[junit4:junit4] 2> 3523779 T7193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 3523785 T7209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 3523785 T7173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 3523785 T7180 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 3523785 T7225 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 3524395 T7151 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51362__e
[junit4:junit4] 2> 3524399 T7151 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51362__e
[junit4:junit4] 2> 3524418 T7225 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 3524420 T7180 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 3524426 T7173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 3524428 T7193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 3524432 T7209 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 3524433 T7209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 3524441 T7225 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 3524442 T7180 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 3524445 T7193 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 3524446 T7173 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 3524447 T7226 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369539656205/collection1
[junit4:junit4] 2> 3524448 T7226 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 3524450 T7226 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 3524451 T7226 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 3524456 T7226 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369539656205/collection1/'
[junit4:junit4] 2> 3524459 T7226 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty3-1369539656205/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 3524460 T7226 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty3-1369539656205/collection1/lib/README' to classloader
[junit4:junit4] 2> 3524623 T7226 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 3524785 T7226 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 3524789 T7226 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 3524797 T7226 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 3526159 T7226 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 3526164 T7226 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 3526167 T7226 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 3526175 T7226 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 3526258 T7226 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 3526259 T7226 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1369539656205/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty3/
[junit4:junit4] 2> 3526260 T7226 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f91e749
[junit4:junit4] 2> 3526261 T7226 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 3526262 T7226 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty3
[junit4:junit4] 2> 3526262 T7226 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty3/index/
[junit4:junit4] 2> 3526263 T7226 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 3526272 T7226 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty3/index
[junit4:junit4] 2> 3526278 T7226 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2db719a1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a0ed234),segFN=segments_1,generation=1}
[junit4:junit4] 2> 3526279 T7226 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 3526284 T7226 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 3526284 T7226 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 3526285 T7226 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 3526287 T7226 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 3526288 T7226 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 3526288 T7226 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 3526289 T7226 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 3526290 T7226 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 3526291 T7226 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 3526316 T7226 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 3526333 T7226 oass.SolrIndexSearcher.<init> Opening Searcher@78bf94be main
[junit4:junit4] 2> 3526333 T7226 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty3/tlog
[junit4:junit4] 2> 3526335 T7226 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 3526338 T7226 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 3526345 T7227 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@78bf94be main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 3526348 T7226 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 3526349 T7226 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3526817 T7174 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3526819 T7174 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51362__e",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51362/_e"}
[junit4:junit4] 2> 3526819 T7174 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 3526820 T7174 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 3526831 T7225 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 3526832 T7180 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 3526843 T7193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 3526847 T7173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 3526847 T7209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 3527354 T7226 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 3527354 T7226 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51362/_e collection:collection1 shard:shard1
[junit4:junit4] 2> 3527363 T7226 oasc.ZkController.register We are http://127.0.0.1:51362/_e/collection1/ and leader is http://127.0.0.1:51356/_e/collection1/
[junit4:junit4] 2> 3527365 T7226 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51362/_e
[junit4:junit4] 2> 3527365 T7226 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 3527366 T7226 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1988 name=collection1 org.apache.solr.core.SolrCore@38710c2f url=http://127.0.0.1:51362/_e/collection1 node=127.0.0.1:51362__e C1988_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:51362__e, base_url=http://127.0.0.1:51362/_e}
[junit4:junit4] 2> 3527367 T7228 C1988 P51362 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 3527367 T7228 C1988 P51362 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 3527367 T7228 C1988 P51362 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 3527367 T7228 C1988 P51362 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3527370 T7226 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3527372 T7228 C1988 P51362 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3527392 T7151 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4] 2> 3527395 T7151 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3527396 T7151 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3527457 T7187 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:51362__e_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 3528122 T7151 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 3528144 T7151 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51366
[junit4:junit4] 2> 3528151 T7151 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3528153 T7151 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3528154 T7151 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369539661333
[junit4:junit4] 2> 3528155 T7151 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369539661333/solr.xml
[junit4:junit4] 2> 3528155 T7151 oasc.CoreContainer.<init> New CoreContainer 33762164
[junit4:junit4] 2> 3528156 T7151 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369539661333/'
[junit4:junit4] 2> 3528158 T7151 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369539661333/'
[junit4:junit4] 2> 3528350 T7174 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3528352 T7174 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:51362__e_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51362__e",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51362/_e"}
[junit4:junit4] 2> 3528388 T7193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 3528389 T7225 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 3528389 T7180 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 3528389 T7209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 3528390 T7173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 3528443 T7151 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 3528444 T7151 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 3528445 T7151 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 3528446 T7151 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 3528447 T7151 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 3528447 T7151 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 3528448 T7151 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 3528449 T7151 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 3528449 T7151 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 3528450 T7151 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 3528459 T7187 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:51362__e_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 3528460 T7187 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:51362__e_collection1&state=recovering&nodeName=127.0.0.1:51362__e&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1003
[junit4:junit4] 2> 3528486 T7151 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 3528487 T7151 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51349/solr
[junit4:junit4] 2> 3528488 T7151 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 3528493 T7151 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3528497 T7240 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@67104333 name:ZooKeeperConnection Watcher:127.0.0.1:51349 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3528499 T7151 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3528505 T7151 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 3528536 T7151 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3528542 T7242 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a7699ab name:ZooKeeperConnection Watcher:127.0.0.1:51349/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3528543 T7151 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3528555 T7151 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3529569 T7151 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51366__e
[junit4:junit4] 2> 3529577 T7151 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51366__e
[junit4:junit4] 2> 3529586 T7225 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 3529587 T7173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 3529586 T7193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 3529588 T7180 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 3529590 T7209 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 3529591 T7209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 3529590 T7242 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 3529602 T7193 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 3529603 T7173 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 3529604 T7225 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 3529605 T7180 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 3529621 T7243 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369539661333/collection1
[junit4:junit4] 2> 3529621 T7243 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 3529624 T7243 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 3529624 T7243 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 3529628 T7243 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369539661333/collection1/'
[junit4:junit4] 2> 3529631 T7243 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty4-1369539661333/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 3529632 T7243 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty4-1369539661333/collection1/lib/README' to classloader
[junit4:junit4] 2> 3529754 T7243 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 3529903 T7243 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 3529908 T7243 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 3529929 T7243 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C1989 name=collection1 org.apache.solr.core.SolrCore@38710c2f url=http://127.0.0.1:51362/_e/collection1 node=127.0.0.1:51362__e C1989_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:51362__e, base_url=http://127.0.0.1:51362/_e}
[junit4:junit4] 2> 3530462 T7228 C1989 P51362 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:51356/_e/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 3530463 T7228 C1989 P51362 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51362/_e START replicas=[http://127.0.0.1:51356/_e/collection1/] nUpdates=100
[junit4:junit4] 2> 3530465 T7228 C1989 P51362 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 3530468 T7228 C1989 P51362 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 3530468 T7228 C1989 P51362 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 3530469 T7228 C1989 P51362 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 3530469 T7228 C1989 P51362 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 3530470 T7228 C1989 P51362 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:51356/_e/collection1/. core=collection1
[junit4:junit4] 2> 3530470 T7228 C1989 P51362 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C1990 name=collection1 org.apache.solr.core.SolrCore@5c4c7ecd url=http://127.0.0.1:51356/_e/collection1 node=127.0.0.1:51356__e C1990_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:51356__e, base_url=http://127.0.0.1:51356/_e, leader=true}
[junit4:junit4] 2> 3530512 T7187 C1990 P51356 oasc.SolrCore.execute [collection1] webapp=/_e path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 3530520 T7184 C1990 P51356 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 3530532 T7184 C1990 P51356 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b394ae7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5196baa8),segFN=segments_1,generation=1}
[junit4:junit4] 2> 3530534 T7184 C1990 P51356 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 3530535 T7184 C1990 P51356 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b394ae7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5196baa8),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b394ae7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5196baa8),segFN=segments_2,generation=2}
[junit4:junit4] 2> 3530535 T7184 C1990 P51356 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 3530536 T7184 C1990 P51356 oass.SolrIndexSearcher.<init> Opening Searcher@1bc44e48 realtime
[junit4:junit4] 2> 3530537 T7184 C1990 P51356 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 3530538 T7184 C1990 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 18
[junit4:junit4] 2> 3530540 T7228 C1989 P51362 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 3530541 T7228 C1989 P51362 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 3530550 T7186 C1990 P51356 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 3530551 T7186 C1990 P51356 oasc.SolrCore.execute [collection1] webapp=/_e path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=4
[junit4:junit4] 2> 3530552 T7228 C1989 P51362 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 3530552 T7228 C1989 P51362 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 3530552 T7228 C1989 P51362 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 3530555 T7188 C1990 P51356 oasc.SolrCore.execute [collection1] webapp=/_e path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 3530557 T7228 C1989 P51362 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 3530560 T7228 C1989 P51362 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty3/index.20130526004104471
[junit4:junit4] 2> 3530560 T7228 C1989 P51362 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@2358c0e2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5416a0da) fullCopy=false
[junit4:junit4] 2> 3530569 T7189 C1990 P51356 oasc.SolrCore.execute [collection1] webapp=/_e path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 3530594 T7228 C1989 P51362 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 3530606 T7228 C1989 P51362 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 3530606 T7228 C1989 P51362 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 3530609 T7228 C1989 P51362 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2db719a1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a0ed234),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2db719a1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a0ed234),segFN=segments_2,generation=2}
[junit4:junit4] 2> 3530620 T7228 C1989 P51362 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 3530621 T7228 C1989 P51362 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 3530622 T7228 C1989 P51362 oass.SolrIndexSearcher.<init> Opening Searcher@409bd9b5 main
[junit4:junit4] 2> 3530624 T7227 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@409bd9b5 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 3530641 T7228 C1989 P51362 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty3/index.20130526004104471 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty3/index.20130526004104471;done=true>>]
[junit4:junit4] 2> 3530641 T7228 C1989 P51362 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty3/index.20130526004104471
[junit4:junit4] 2> 3530642 T7228 C1989 P51362 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty3/index.20130526004104471
[junit4:junit4] 2> 3530642 T7228 C1989 P51362 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 3530642 T7228 C1989 P51362 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 3530642 T7228 C1989 P51362 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3530643 T7228 C1989 P51362 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3530662 T7228 C1989 P51362 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 3531182 T7243 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 3531187 T7243 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 3531191 T7243 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 3531202 T7243 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 3531286 T7243 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 3531287 T7243 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1369539661333/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty4/
[junit4:junit4] 2> 3531287 T7243 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5f91e749
[junit4:junit4] 2> 3531288 T7243 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 3531289 T7243 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty4
[junit4:junit4] 2> 3531289 T7243 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty4/index/
[junit4:junit4] 2> 3531290 T7243 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 3531291 T7243 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty4/index
[junit4:junit4] 2> 3531296 T7243 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5921cc9e lockFactory=org.apache.lucene.store.NativeFSLockFactory@b6bda14),segFN=segments_1,generation=1}
[junit4:junit4] 2> 3531296 T7243 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 3531300 T7243 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 3531301 T7243 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 3531302 T7243 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 3531304 T7243 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 3531305 T7243 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 3531306 T7243 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 3531308 T7243 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 3531309 T7243 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 3531310 T7243 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 3531332 T7243 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 3531344 T7243 oass.SolrIndexSearcher.<init> Opening Searcher@7703c4d1 main
[junit4:junit4] 2> 3531345 T7243 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty4/tlog
[junit4:junit4] 2> 3531347 T7243 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 3531347 T7243 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 3531354 T7246 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7703c4d1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 3531361 T7243 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 3531364 T7243 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3531437 T7174 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3531439 T7174 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:51362__e_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51362__e",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51362/_e"}
[junit4:junit4] 2> 3531453 T7174 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51366__e",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51366/_e"}
[junit4:junit4] 2> 3531454 T7174 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 3531454 T7174 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 3531474 T7209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 3531475 T7193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 3531475 T7225 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 3531475 T7180 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 3531477 T7242 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 3531478 T7173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 3532372 T7243 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 3532372 T7243 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51366/_e collection:collection1 shard:shard2
[junit4:junit4] 2> 3532386 T7243 oasc.ZkController.register We are http://127.0.0.1:51366/_e/collection1/ and leader is http://127.0.0.1:51359/_e/collection1/
[junit4:junit4] 2> 3532386 T7243 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51366/_e
[junit4:junit4] 2> 3532387 T7243 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 3532387 T7243 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1991 name=collection1 org.apache.solr.core.SolrCore@746134dd url=http://127.0.0.1:51366/_e/collection1 node=127.0.0.1:51366__e C1991_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:51366__e, base_url=http://127.0.0.1:51366/_e}
[junit4:junit4] 2> 3532389 T7247 C1991 P51366 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 3532389 T7247 C1991 P51366 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 3532390 T7247 C1991 P51366 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 3532390 T7247 C1991 P51366 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3532390 T7243 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3532394 T7247 C1991 P51366 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3532431 T7151 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4] 2> 3532433 T7151 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3532434 T7151 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3532433 T7201 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:51366__e_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 3532465 T7151 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3532469 T7151 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 3532470 T7151 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 3532472 T7151 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3533002 T7174 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3533004 T7174 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:51366__e_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51366__e",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51366/_e"}
[junit4:junit4] 2> 3533016 T7180 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 3533017 T7209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 3533017 T7193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 3533017 T7173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 3533017 T7225 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 3533017 T7242 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 3533447 T7201 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:51366__e_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 3533447 T7201 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:51366__e_collection1&state=recovering&nodeName=127.0.0.1:51366__e&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1015
[junit4:junit4] 2> 3533477 T7151 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3534481 T7151 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C1991_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:51366__e, base_url=http://127.0.0.1:51366/_e}
[junit4:junit4] 2> 3535450 T7247 C1991 P51366 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:51359/_e/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 3535450 T7247 C1991 P51366 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51366/_e START replicas=[http://127.0.0.1:51359/_e/collection1/] nUpdates=100
[junit4:junit4] 2> 3535451 T7247 C1991 P51366 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 3535452 T7247 C1991 P51366 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 3535452 T7247 C1991 P51366 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 3535452 T7247 C1991 P51366 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 3535453 T7247 C1991 P51366 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 3535454 T7247 C1991 P51366 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:51359/_e/collection1/. core=collection1
[junit4:junit4] 2> 3535456 T7247 C1991 P51366 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C1992 name=collection1 org.apache.solr.core.SolrCore@1e4cc6c2 url=http://127.0.0.1:51359/_e/collection1 node=127.0.0.1:51359__e C1992_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:51359__e, base_url=http://127.0.0.1:51359/_e, leader=true}
[junit4:junit4] 2> 3535481 T7201 C1992 P51359 oasc.SolrCore.execute [collection1] webapp=/_e path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 3535491 T7151 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3535492 T7205 C1992 P51359 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 3535503 T7205 C1992 P51359 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@163e39d1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ecd0485),segFN=segments_1,generation=1}
[junit4:junit4] 2> 3535505 T7205 C1992 P51359 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 3535506 T7205 C1992 P51359 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@163e39d1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ecd0485),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@163e39d1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ecd0485),segFN=segments_2,generation=2}
[junit4:junit4] 2> 3535507 T7205 C1992 P51359 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 3535508 T7205 C1992 P51359 oass.SolrIndexSearcher.<init> Opening Searcher@71316167 realtime
[junit4:junit4] 2> 3535509 T7205 C1992 P51359 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 3535510 T7205 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 18
[junit4:junit4] 2> 3535513 T7247 C1991 P51366 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 3535514 T7247 C1991 P51366 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 3535521 T7202 C1992 P51359 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 3535522 T7202 C1992 P51359 oasc.SolrCore.execute [collection1] webapp=/_e path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=3
[junit4:junit4] 2> 3535523 T7247 C1991 P51366 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 3535523 T7247 C1991 P51366 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 3535523 T7247 C1991 P51366 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 3535528 T7203 C1992 P51359 oasc.SolrCore.execute [collection1] webapp=/_e path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=2
[junit4:junit4] 2> 3535529 T7247 C1991 P51366 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 3535531 T7247 C1991 P51366 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty4/index.20130526004109443
[junit4:junit4] 2> 3535532 T7247 C1991 P51366 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@c77a1f1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ee8ce9d) fullCopy=false
[junit4:junit4] 2> 3535534 T7204 C1992 P51359 oasc.SolrCore.execute [collection1] webapp=/_e path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 3535538 T7247 C1991 P51366 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 3535540 T7247 C1991 P51366 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 3535540 T7247 C1991 P51366 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 3535545 T7247 C1991 P51366 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5921cc9e lockFactory=org.apache.lucene.store.NativeFSLockFactory@b6bda14),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5921cc9e lockFactory=org.apache.lucene.store.NativeFSLockFactory@b6bda14),segFN=segments_2,generation=2}
[junit4:junit4] 2> 3535548 T7247 C1991 P51366 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 3535550 T7247 C1991 P51366 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 3535551 T7247 C1991 P51366 oass.SolrIndexSearcher.<init> Opening Searcher@1d6483de main
[junit4:junit4] 2> 3535554 T7246 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d6483de main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 3535555 T7247 C1991 P51366 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty4/index.20130526004109443 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty4/index.20130526004109443;done=true>>]
[junit4:junit4] 2> 3535556 T7247 C1991 P51366 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty4/index.20130526004109443
[junit4:junit4] 2> 3535556 T7247 C1991 P51366 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1369539639404/jetty4/index.20130526004109443
[junit4:junit4] 2> 3535557 T7247 C1991 P51366 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 3535557 T7247 C1991 P51366 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 3535557 T7247 C1991 P51366 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3535558 T7247 C1991 P51366 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3535560 T7247 C1991 P51366 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 3536052 T7174 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3536054 T7174 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:51366__e_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:51366__e",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51366/_e"}
[junit4:junit4] 2> 3536067 T7209 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 3536067 T7242 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 3536068 T7180 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 3536067 T7225 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 3536068 T7173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 3536068 T7193 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 3536503 T7151 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3536510 T7151 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C1993 name=collection1 org.apache.solr.core.SolrCore@3c893a9b url=http://127.0.0.1:51352/_e/collection1 node=127.0.0.1:51352__e C1993_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:51352__e, base_url=http://127.0.0.1:51352/_e, leader=true}
[junit4:junit4] 2> 3536530 T7165 C1993 P51352 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 3536535 T7165 C1993 P51352 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@80109d1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65ed01d0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 3536536 T7165 C1993 P51352 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 3536539 T7165 C1993 P51352 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@80109d1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65ed01d0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@80109d1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65ed01d0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 3536544 T7165 C1993 P51352 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 3536546 T7165 C1993 P51352 oass.SolrIndexSearcher.<init> Opening Searcher@105055e6 main
[junit4:junit4] 2> 3536547 T7165 C1993 P51352 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 3536548 T7177 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@105055e6 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 3536549 T7165 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 19
[junit4:junit4] 2> 3536578 T7200 C1992 P51359 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 3536581 T7200 C1992 P51359 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@163e39d1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ecd0485),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@163e39d1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ecd0485),segFN=segments_3,generation=3}
[junit4:junit4] 2> 3536582 T7200 C1992 P51359 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 3536583 T7200 C1992 P51359 oass.SolrIndexSearcher.<init> Opening Searcher@50b932b3 main
[junit4:junit4] 2> 3536583 T7200 C1992 P51359 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 3536584 T7211 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@50b932b3 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 3536585 T7200 C1992 P51359 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:51356/_e/collection1/, StdNode: http://127.0.0.1:51362/_e/collection1/, StdNode: http://127.0.0.1:51366/_e/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> ASYNC NEW_CORE C1994 name=collection1 org.apache.solr.core.SolrCore@5c4c7ecd url=http://127.0.0.1:51356/_e/collection1 node=127.0.0.1:51356__e C1994_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:51356__e, base_url=http://127.0.0.1:51356/_e, leader=true}
[junit4:junit4] 2> 3536608 T7185 C1994 P51356 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C1995 name=collection1 org.apache.solr.core.SolrCore@38710c2f url=http://127.0.0.1:51362/_e/collection1 node=127.0.0.1:51362__e C1995_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:51362__e, base_url=http://127.0.0.1:51362/_e}
[junit4:junit4] 2> 3536632 T7218 C1995 P51362 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C1991_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:51366__e, base_url=http://127.0.0.1:51366/_e}
[junit4:junit4] 2> 3536638 T7236 C1991 P51366 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 3536640 T7185 C1994 P51356 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b394ae7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5196baa8),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b394ae7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5196baa8),segFN=segments_3,generation=3}
[junit4:junit4] 2> 3536641 T7185 C1994 P51356 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 3536642 T7218 C1995 P51362 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2db719a1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a0ed234),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2db719a1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a0ed234),segFN=segments_3,generation=3}
[junit4:junit4] 2> 3536643 T7218 C1995 P51362 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 3536642 T7185 C1994 P51356 oass.SolrIndexSearcher.<init> Opening Searcher@508663f9 main
[junit4:junit4] 2> 3536645 T7185 C1994 P51356 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 3536646 T7195 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@508663f9 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 3536644 T7236 C1991 P51366 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5921cc9e lockFactory=org.apache.lucene.store.NativeFSLockFactory@b6bda14),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5921cc9e lockFactory=org.apache.lucene.store.NativeFSLockFactory@b6bda14),segFN=segments_3,generation=3}
[junit4:junit4] 2> 3536648 T7236 C1991 P51366 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 3536647 T7185 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 39
[junit4:junit4] 2> 3536645 T7218 C1995 P51362 oass.SolrIndexSearcher.<init> Opening Searcher@67456f72 main
[junit4:junit4] 2> 3536651 T7218 C1995 P51362 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 3536650 T7236 C1991 P51366 oass.SolrIndexSearcher.<init> Opening Searcher@694253f1 main
[junit4:junit4] 2> 3536653 T7227 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@67456f72 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 3536656 T7246 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@694253f1 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 3536657 T7218 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 25
[junit4:junit4] 2> 3536658 T7236 C1991 P51366 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 3536658 T7236 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 20
[junit4:junit4] 2> 3536660 T7200 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 82
[junit4:junit4] 2> 3536663 T7151 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3536670 T7188 C1994 P51356 oasc.SolrCore.execute [collection1] webapp=/_e path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 3536676 T7220 C1995 P51362 oasc.SolrCore.execute [collection1] webapp=/_e path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 3536681 T7202 C1992 P51359 oasc.SolrCore.execute [collection1] webapp=/_e path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 3536692 T7237 C1991 P51366 oasc.SolrCore.execute [collection1] webapp=/_e path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=3
[junit4:junit4] 2> 3538704 T7164 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1436066431750897664)} 0 5
[junit4:junit4] 2> 3538728 T7237 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={update.distrib=FROMLEADER&_version_=-1436066431759286272&update.from=http://127.0.0.1:51359/_e/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1436066431759286272)} 0 5
[junit4:junit4] 2> 3538733 T7220 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={update.distrib=FROMLEADER&_version_=-1436066431766626304&update.from=http://127.0.0.1:51356/_e/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1436066431766626304)} 0 7
[junit4:junit4] 2> 3538736 T7188 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1436066431766626304)} 0 21
[junit4:junit4] 2> 3538738 T7202 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1436066431759286272)} 0 30
[junit4:junit4] 2> 3538747 T7166 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[a!0 (1436066431797035008)]} 0 4
[junit4:junit4] 2> 3538758 T7238 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!0 (1436066431806472192)]} 0 1
[junit4:junit4] 2> 3538760 T7203 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[a!0 (1436066431806472192)]} 0 7
[junit4:junit4] 2> 3538765 T7167 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[b!1 (1436066431818006528)]} 0 1
[junit4:junit4] 2> 3538776 T7221 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!1 (1436066431824297984)]} 0 2
[junit4:junit4] 2> 3538777 T7189 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[b!1 (1436066431824297984)]} 0 7
[junit4:junit4] 2> 3538782 T7168 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[c!2 (1436066431836880896)]} 0 1
[junit4:junit4] 2> 3538793 T7216 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!2 (1436066431844220928)]} 0 1
[junit4:junit4] 2> 3538795 T7187 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!2 (1436066431844220928)]} 0 7
[junit4:junit4] 2> 3538796 T7204 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[c!2]} 0 10
[junit4:junit4] 2> 3538801 T7169 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[d!3 (1436066431855755264)]} 0 1
[junit4:junit4] 2> 3538809 T7233 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!3 (1436066431860998144)]} 0 0
[junit4:junit4] 2> 3538811 T7201 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[d!3 (1436066431860998144)]} 0 7
[junit4:junit4] 2> 3538821 T7165 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[e!4 (1436066431876726784)]} 0 1
[junit4:junit4] 2> 3538837 T7234 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!4 (1436066431887212544)]} 0 1
[junit4:junit4] 2> 3538839 T7205 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!4 (1436066431887212544)]} 0 9
[junit4:junit4] 2> 3538840 T7184 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[e!4]} 0 15
[junit4:junit4] 2> 3538845 T7164 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[f!5 (1436066431901892608)]} 0 2
[junit4:junit4] 2> 3538854 T7235 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!5 (1436066431908184064)]} 0 1
[junit4:junit4] 2> 3538856 T7200 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[f!5 (1436066431908184064)]} 0 6
[junit4:junit4] 2> 3538860 T7166 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[g!6 (1436066431917621248)]} 0 1
[junit4:junit4] 2> 3538868 T7217 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!6 (1436066431923912704)]} 0 0
[junit4:junit4] 2> 3538870 T7185 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[g!6 (1436066431923912704)]} 0 6
[junit4:junit4] 2> 3538874 T7167 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[h!7 (1436066431933349888)]} 0 1
[junit4:junit4] 2> 3538887 T7218 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!7 (1436066431937544192)]} 0 5
[junit4:junit4] 2> 3538891 T7186 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[h!7 (1436066431937544192)]} 0 13
[junit4:junit4] 2> 3538896 T7168 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[i!8 (1436066431955369984)]} 0 1
[junit4:junit4] 2> 3538912 T7219 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!8 (1436066431963758592)]} 0 1
[junit4:junit4] 2> 3538913 T7188 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[i!8 (1436066431963758592)]} 0 10
[junit4:junit4] 2> 3538918 T7169 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[j!9 (1436066431978438656)]} 0 1
[junit4:junit4] 2> 3538929 T7220 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!9 (1436066431986827264)]} 0 1
[junit4:junit4] 2> 3538931 T7189 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!9 (1436066431986827264)]} 0 6
[junit4:junit4] 2> 3538934 T7202 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[j!9]} 0 12
[junit4:junit4] 2> 3538939 T7165 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[k!10 (1436066432000458752)]} 0 1
[junit4:junit4] 2> 3538956 T7221 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!10 (1436066432008847360)]} 0 4
[junit4:junit4] 2> 3538960 T7187 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!10 (1436066432008847360)]} 0 14
[junit4:junit4] 2> 3538962 T7203 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[k!10]} 0 19
[junit4:junit4] 2> 3538967 T7164 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[l!11 (1436066432030867456)]} 0 1
[junit4:junit4] 2> 3538979 T7236 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!11 (1436066432038207488)]} 0 1
[junit4:junit4] 2> 3538980 T7204 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!11 (1436066432038207488)]} 0 7
[junit4:junit4] 2> 3538982 T7184 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[l!11]} 0 12
[junit4:junit4] 2> 3538986 T7166 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[m!12 (1436066432050790400)]} 0 1
[junit4:junit4] 2> 3538998 T7237 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!12 (1436066432059179008)]} 0 1
[junit4:junit4] 2> 3539000 T7201 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!12 (1436066432059179008)]} 0 7
[junit4:junit4] 2> 3539002 T7185 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[m!12]} 0 12
[junit4:junit4] 2> 3539008 T7167 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[n!13 (1436066432071761920)]} 0 2
[junit4:junit4] 2> 3539019 T7216 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!13 (1436066432080150528)]} 0 1
[junit4:junit4] 2> 3539020 T7186 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!13 (1436066432080150528)]} 0 6
[junit4:junit4] 2> 3539021 T7205 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[n!13]} 0 9
[junit4:junit4] 2> 3539025 T7168 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[o!14 (1436066432091684864)]} 0 1
[junit4:junit4] 2> 3539036 T7238 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!14 (1436066432099024896)]} 0 1
[junit4:junit4] 2> 3539037 T7200 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!14 (1436066432099024896)]} 0 5
[junit4:junit4] 2> 3539038 T7188 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[o!14]} 0 9
[junit4:junit4] 2> 3539044 T7169 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[p!15 (1436066432110559232)]} 0 1
[junit4:junit4] 2> 3539057 T7217 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!15 (1436066432118947840)]} 0 1
[junit4:junit4] 2> 3539059 T7189 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[p!15 (1436066432118947840)]} 0 9
[junit4:junit4] 2> 3539063 T7165 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[q!16 (1436066432130482176)]} 0 1
[junit4:junit4] 2> 3539073 T7218 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!16 (1436066432137822208)]} 0 1
[junit4:junit4] 2> 3539075 T7187 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[q!16 (1436066432137822208)]} 0 6
[junit4:junit4] 2> 3539079 T7164 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[r!17 (1436066432148307968)]} 0 1
[junit4:junit4] 2> 3539087 T7233 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!17 (1436066432152502272)]} 0 1
[junit4:junit4] 2> 3539090 T7202 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[r!17 (1436066432152502272)]} 0 7
[junit4:junit4] 2> 3539094 T7166 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[s!18 (1436066432162988032)]} 0 1
[junit4:junit4] 2> 3539105 T7219 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!18 (1436066432170328064)]} 0 1
[junit4:junit4] 2> 3539107 T7184 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[s!18 (1436066432170328064)]} 0 8
[junit4:junit4] 2> 3539112 T7167 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[t!19 (1436066432181862400)]} 0 1
[junit4:junit4] 2> 3539128 T7221 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!19 (1436066432195493888)]} 0 1
[junit4:junit4] 2> 3539129 T7186 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[t!19 (1436066432195493888)]} 0 6
[junit4:junit4] 2> 3539130 T7204 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[t!19]} 0 10
[junit4:junit4] 2> 3539138 T7169 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[u!20 (1436066432209125376)]} 0 2
[junit4:junit4] 2> 3539146 T7234 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!20 (1436066432214368256)]} 0 1
[junit4:junit4] 2> 3539147 T7201 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[u!20 (1436066432214368256)]} 0 5
[junit4:junit4] 2> 3539152 T7165 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[v!21 (1436066432224854016)]} 0 1
[junit4:junit4] 2> 3539161 T7216 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!21 (1436066432230096896)]} 0 1
[junit4:junit4] 2> 3539162 T7188 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[v!21 (1436066432230096896)]} 0 6
[junit4:junit4] 2> 3539167 T7164 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[w!22 (1436066432239534080)]} 0 1
[junit4:junit4] 2> 3539175 T7217 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!22 (1436066432244776960)]} 0 1
[junit4:junit4] 2> 3539177 T7189 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[w!22 (1436066432244776960)]} 0 6
[junit4:junit4] 2> 3539187 T7166 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[x!23 (1436066432260505600)]} 0 2
[junit4:junit4] 2> 3539202 T7236 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!23 (1436066432272039936)]} 0 1
[junit4:junit4] 2> 3539204 T7205 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!23 (1436066432272039936)]} 0 8
[junit4:junit4] 2> 3539206 T7187 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[x!23]} 0 15
[junit4:junit4] 2> 3539210 T7168 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[y!24 (1436066432285671424)]} 0 1
[junit4:junit4] 2> 3539220 T7237 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!24 (1436066432293011456)]} 0 0
[junit4:junit4] 2> 3539222 T7200 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[y!24 (1436066432293011456)]} 0 5
[junit4:junit4] 2> 3539223 T7185 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[y!24]} 0 9
[junit4:junit4] 2> 3539228 T7167 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[z!25 (1436066432303497216)]} 0 1
[junit4:junit4] 2> 3539236 T7218 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!25 (1436066432308740096)]} 0 0
[junit4:junit4] 2> 3539238 T7184 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[z!25 (1436066432308740096)]} 0 7
[junit4:junit4] 2> 3539247 T7169 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[a!26 (1436066432320274432)]} 0 5
[junit4:junit4] 2> 3539269 T7238 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!26 (1436066432342294528)]} 0 1
[junit4:junit4] 2> 3539271 T7202 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!26 (1436066432342294528)]} 0 7
[junit4:junit4] 2> 3539273 T7186 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[a!26]} 0 12
[junit4:junit4] 2> 3539278 T7165 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[b!27 (1436066432355926016)]} 0 1
[junit4:junit4] 2> 3539291 T7220 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!27 (1436066432365363200)]} 0 1
[junit4:junit4] 2> 3539294 T7188 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!27 (1436066432365363200)]} 0 8
[junit4:junit4] 2> 3539295 T7203 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[b!27]} 0 14
[junit4:junit4] 2> 3539299 T7164 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[c!28 (1436066432377946112)]} 0 1
[junit4:junit4] 2> 3539311 T7219 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!28 (1436066432386334720)]} 0 1
[junit4:junit4] 2> 3539313 T7189 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!28 (1436066432386334720)]} 0 7
[junit4:junit4] 2> 3539319 T7204 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[c!28]} 0 16
[junit4:junit4] 2> 3539333 T7166 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[d!29 (1436066432413597696)]} 0 9
[junit4:junit4] 2> 3539357 T7233 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!29 (1436066432435617792)]} 0 1
[junit4:junit4] 2> 3539362 T7201 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!29 (1436066432435617792)]} 0 9
[junit4:junit4] 2> 3539363 T7187 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[d!29]} 0 14
[junit4:junit4] 2> 3539381 T7168 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[e!30 (1436066432463929344)]} 0 1
[junit4:junit4] 2> 3539388 T7235 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!30 (1436066432469172224)]} 0 0
[junit4:junit4] 2> 3539390 T7205 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[e!30 (1436066432469172224)]} 0 5
[junit4:junit4] 2> 3539395 T7167 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[f!31 (1436066432478609408)]} 0 1
[junit4:junit4] 2> 3539407 T7234 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!31 (1436066432488046592)]} 0 1
[junit4:junit4] 2> 3539408 T7200 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!31 (1436066432488046592)]} 0 6
[junit4:junit4] 2> 3539410 T7185 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[f!31]} 0 11
[junit4:junit4] 2> 3539419 T7169 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[g!32 (1436066432502726656)]} 0 3
[junit4:junit4] 2> 3539441 T7221 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!32 (1436066432515309568)]} 0 1
[junit4:junit4] 2> 3539443 T7184 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!32 (1436066432515309568)]} 0 14
[junit4:junit4] 2> 3539445 T7202 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[g!32]} 0 19
[junit4:junit4] 2> 3539450 T7165 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[h!33 (1436066432536281088)]} 0 1
[junit4:junit4] 2> 3539459 T7216 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!33 (1436066432541523968)]} 0 1
[junit4:junit4] 2> 3539461 T7186 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[h!33 (1436066432541523968)]} 0 7
[junit4:junit4] 2> 3539466 T7164 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[i!34 (1436066432553058304)]} 0 1
[junit4:junit4] 2> 3539477 T7217 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!34 (1436066432561446912)]} 0 0
[junit4:junit4] 2> 3539479 T7188 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!34 (1436066432561446912)]} 0 6
[junit4:junit4] 2> 3539481 T7203 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[i!34]} 0 11
[junit4:junit4] 2> 3539486 T7166 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[j!35 (1436066432575078400)]} 0 1
[junit4:junit4] 2> 3539496 T7218 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!35 (1436066432580321280)]} 0 1
[junit4:junit4] 2> 3539498 T7189 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[j!35 (1436066432580321280)]} 0 8
[junit4:junit4] 2> 3539503 T7168 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[k!36 (1436066432591855616)]} 0 2
[junit4:junit4] 2> 3539522 T7220 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!36 (1436066432608632832)]} 0 0
[junit4:junit4] 2> 3539524 T7185 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[k!36 (1436066432608632832)]} 0 7
[junit4:junit4] 2> 3539529 T7167 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[l!37 (1436066432619118592)]} 0 1
[junit4:junit4] 2> 3539538 T7236 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!37 (1436066432624361472)]} 0 1
[junit4:junit4] 2> 3539540 T7204 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[l!37 (1436066432624361472)]} 0 7
[junit4:junit4] 2> 3539544 T7165 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[m!38 (1436066432635895808)]} 0 0
[junit4:junit4] 2> 3539555 T7237 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!38 (1436066432643235840)]} 0 0
[junit4:junit4] 2> 3539557 T7205 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!38 (1436066432643235840)]} 0 6
[junit4:junit4] 2> 3539558 T7184 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[m!38]} 0 10
[junit4:junit4] 2> 3539563 T7164 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[n!39 (1436066432654770176)]} 0 1
[junit4:junit4] 2> 3539572 T7221 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!39 (1436066432662110208)]} 0 0
[junit4:junit4] 2> 3539574 T7186 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!39 (1436066432662110208)]} 0 5
[junit4:junit4] 2> 3539575 T7200 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[n!39]} 0 8
[junit4:junit4] 2> 3539580 T7166 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[o!40 (1436066432672595968)]} 0 1
[junit4:junit4] 2> 3539595 T7233 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!40 (1436066432684130304)]} 0 1
[junit4:junit4] 2> 3539600 T7202 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[o!40 (1436066432684130304)]} 0 12
[junit4:junit4] 2> 3539605 T7168 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[p!41 (1436066432698810368)]} 0 1
[junit4:junit4] 2> 3539614 T7216 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!41 (1436066432704053248)]} 0 1
[junit4:junit4] 2> 3539616 T7188 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[p!41 (1436066432704053248)]} 0 7
[junit4:junit4] 2> 3539621 T7169 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[q!42 (1436066432715587584)]} 0 0
[junit4:junit4] 2> 3539629 T7217 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!42 (1436066432720830464)]} 0 1
[junit4:junit4] 2> 3539630 T7189 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[q!42 (1436066432720830464)]} 0 5
[junit4:junit4] 2> 3539634 T7167 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[r!43 (1436066432729219072)]} 0 1
[junit4:junit4] 2> 3539643 T7235 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!43 (1436066432735510528)]} 0 1
[junit4:junit4] 2> 3539644 T7203 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!43 (1436066432735510528)]} 0 5
[junit4:junit4] 2> 3539646 T7187 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[r!43]} 0 9
[junit4:junit4] 2> 3539650 T7165 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[s!44 (1436066432745996288)]} 0 1
[junit4:junit4] 2> 3539661 T7218 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!44 (1436066432753336320)]} 0 1
[junit4:junit4] 2> 3539662 T7185 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!44 (1436066432753336320)]} 0 6
[junit4:junit4] 2> 3539663 T7201 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[s!44]} 0 10
[junit4:junit4] 2> 3539670 T7164 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[t!45 (1436066432768016384)]} 0 0
[junit4:junit4] 2> 3539684 T7219 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!45 (1436066432771162112)]} 0 1
[junit4:junit4] 2> 3539685 T7184 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[t!45 (1436066432771162112)]} 0 12
[junit4:junit4] 2> 3539689 T7166 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[u!46 (1436066432787939328)]} 0 1
[junit4:junit4] 2> 3539714 T7234 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!46 (1436066432802619392)]} 0 1
[junit4:junit4] 2> 3539715 T7204 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[u!46 (1436066432802619392)]} 0 13
[junit4:junit4] 2> 3539731 T7168 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[v!47 (1436066432831979520)]} 0 1
[junit4:junit4] 2> 3539742 T7220 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!47 (1436066432837222400)]} 0 2
[junit4:junit4] 2> 3539749 T7186 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[v!47 (1436066432837222400)]} 0 13
[junit4:junit4] 2> 3539753 T7169 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[w!48 (1436066432853999616)]} 0 1
[junit4:junit4] 2> 3539766 T7221 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!48 (1436066432862388224)]} 0 1
[junit4:junit4] 2> 3539768 T7188 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[w!48 (1436066432862388224)]} 0 8
[junit4:junit4] 2> 3539770 T7205 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[w!48]} 0 13
[junit4:junit4] 2> 3539774 T7167 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[x!49 (1436066432876019712)]} 0 1
[junit4:junit4] 2> 3539781 T7236 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!49 (1436066432881262592)]} 0 0
[junit4:junit4] 2> 3539783 T7200 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[x!49 (1436066432881262592)]} 0 6
[junit4:junit4] 2> 3539787 T7165 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[y!50 (1436066432889651200)]} 0 1
[junit4:junit4] 2> 3539796 T7238 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!50 (1436066432895942656)]} 0 1
[junit4:junit4] 2> 3539797 T7202 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[y!50 (1436066432895942656)]} 0 5
[junit4:junit4] 2> 3539802 T7164 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[z!51 (1436066432905379840)]} 0 1
[junit4:junit4] 2> 3539821 T7216 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!51 (1436066432916914176)]} 0 1
[junit4:junit4] 2> 3539823 T7189 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[z!51 (1436066432916914176)]} 0 12
[junit4:junit4] 2> 3539824 T7203 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[z!51]} 0 18
[junit4:junit4] 2> 3539830 T7166 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[a!52 (1436066432934739968)]} 0 1
[junit4:junit4] 2> 3539841 T7237 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!52 (1436066432943128576)]} 0 0
[junit4:junit4] 2> 3539842 T7201 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!52 (1436066432943128576)]} 0 5
[junit4:junit4] 2> 3539843 T7187 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[a!52]} 0 9
[junit4:junit4] 2> 3539847 T7168 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[b!53 (1436066432952565760)]} 0 1
[junit4:junit4] 2> 3539857 T7217 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!53 (1436066432959905792)]} 0 1
[junit4:junit4] 2> 3539858 T7185 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!53 (1436066432959905792)]} 0 6
[junit4:junit4] 2> 3539859 T7204 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[b!53]} 0 9
[junit4:junit4] 2> 3539869 T7169 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[c!54 (1436066432976683008)]} 0 0
[junit4:junit4] 2> 3539884 T7218 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!54 (1436066432984023040)]} 0 1
[junit4:junit4] 2> 3539886 T7184 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[c!54 (1436066432984023040)]} 0 11
[junit4:junit4] 2> 3539891 T7167 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[d!55 (1436066432998703104)]} 0 1
[junit4:junit4] 2> 3539904 T7233 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!55 (1436066433008140288)]} 0 1
[junit4:junit4] 2> 3539906 T7205 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!55 (1436066433008140288)]} 0 7
[junit4:junit4] 2> 3539907 T7186 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[d!55]} 0 11
[junit4:junit4] 2> 3539912 T7165 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[e!56 (1436066433020723200)]} 0 1
[junit4:junit4] 2> 3539924 T7235 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!56 (1436066433030160384)]} 0 1
[junit4:junit4] 2> 3539926 T7200 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!56 (1436066433030160384)]} 0 6
[junit4:junit4] 2> 3539927 T7189 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[e!56]} 0 10
[junit4:junit4] 2> 3539931 T7164 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[f!57 (1436066433041694720)]} 0 1
[junit4:junit4] 2> 3539941 T7234 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!57 (1436066433049034752)]} 0 1
[junit4:junit4] 2> 3539944 T7202 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!57 (1436066433049034752)]} 0 7
[junit4:junit4] 2> 3539950 T7187 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[f!57]} 0 15
[junit4:junit4] 2> 3539959 T7168 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[g!58 (1436066433070006272)]} 0 1
[junit4:junit4] 2> 3539967 T7219 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!58 (1436066433075249152)]} 0 1
[junit4:junit4] 2> 3539968 T7185 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[g!58 (1436066433075249152)]} 0 6
[junit4:junit4] 2> 3539972 T7169 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[h!59 (1436066433084686336)]} 0 1
[junit4:junit4] 2> 3539980 T7221 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!59 (1436066433088880640)]} 0 1
[junit4:junit4] 2> 3539982 T7184 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[h!59 (1436066433088880640)]} 0 6
[junit4:junit4] 2> 3539988 T7167 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[i!60 (1436066433101463552)]} 0 1
[junit4:junit4] 2> 3539999 T7216 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!60 (1436066433106706432)]} 0 2
[junit4:junit4] 2> 3540002 T7186 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[i!60 (1436066433106706432)]} 0 9
[junit4:junit4] 2> 3540007 T7165 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[j!61 (1436066433120337920)]} 0 2
[junit4:junit4] 2> 3540028 T7217 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!61 (1436066433130823680)]} 0 1
[junit4:junit4] 2> 3540029 T7188 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!61 (1436066433130823680)]} 0 14
[junit4:junit4] 2> 3540031 T7201 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[j!61]} 0 20
[junit4:junit4] 2> 3540036 T7166 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[k!62 (1436066433150746624)]} 0 1
[junit4:junit4] 2> 3540045 T7218 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!62 (1436066433157038080)]} 0 1
[junit4:junit4] 2> 3540047 T7189 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[k!62 (1436066433157038080)]} 0 6
[junit4:junit4] 2> 3540052 T7164 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[l!63 (1436066433167523840)]} 0 1
[junit4:junit4] 2> 3540064 T7236 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!63 (1436066433176961024)]} 0 1
[junit4:junit4] 2> 3540065 T7204 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!63 (1436066433176961024)]} 0 5
[junit4:junit4] 2> 3540067 T7187 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[l!63]} 0 10
[junit4:junit4] 2> 3540072 T7168 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[m!64 (1436066433188495360)]} 0 1
[junit4:junit4] 2> 3540079 T7237 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!64 (1436066433192689664)]} 0 1
[junit4:junit4] 2> 3540081 T7205 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[m!64 (1436066433192689664)]} 0 6
[junit4:junit4] 2> 3540085 T7169 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[n!65 (1436066433202126848)]} 0 1
[junit4:junit4] 2> 3540097 T7220 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!65 (1436066433210515456)]} 0 1
[junit4:junit4] 2> 3540100 T7185 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!65 (1436066433210515456)]} 0 8
[junit4:junit4] 2> 3540102 T7200 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[n!65]} 0 13
[junit4:junit4] 2> 3540106 T7167 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[o!66 (1436066433225195520)]} 0 1
[junit4:junit4] 2> 3540117 T7233 C1991 P51366 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51359/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!66 (1436066433232535552)]} 0 1
[junit4:junit4] 2> 3540119 T7203 C1992 P51359 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!66 (1436066433232535552)]} 0 7
[junit4:junit4] 2> 3540120 T7184 C1994 P51356 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[o!66]} 0 10
[junit4:junit4] 2> 3540127 T7165 C1993 P51352 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={wt=javabin&version=2} {add=[p!67 (1436066433246167040)]} 0 1
[junit4:junit4] 2> 3540144 T7219 C1995 P51362 oasup.LogUpdateProcessor.finish [collection1] webapp=/_e path=/update params={distrib.from=http://127.0.0.1:51356/_e/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!67 (1436066433258749952)]} 0 0
[junit4:junit4] 2> 3540146 T7186 C1994 P51
[...truncated too long message...]
AILED !!!!!
[junit4:junit4] 2> 3552988 T7151 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 3552989 T7151 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:51349 51349
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ShardSplitTest -Dtests.method=testDistribSearch -Dtests.seed=97F5B1FAD6C68FBB -Dtests.slow=true -Dtests.locale=ca_ES -Dtests.timezone=Canada/Atlantic -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR 47.5s | ShardSplitTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:51356/_e returned non ok status:500, message:Server Error
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([97F5B1FAD6C68FBB:16133FE2A199EF87]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 3553026 T7151 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 47552 T7150 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> 3554047 T7242 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 3554047 T7242 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3554047 T7242 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {id=PostingsFormat(name=Direct), _version_=PostingsFormat(name=Asserting)}, docValues:{}, sim=DefaultSimilarity, locale=ca_ES, timezone=Canada/Atlantic
[junit4:junit4] 2> NOTE: Mac OS X 10.8.3 x86_64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=2,threads=2,free=134479264,total=395051008
[junit4:junit4] 2> NOTE: All tests run in this JVM: [HighlighterConfigTest, TestSolrXMLSerializer, TestUniqueKeyFieldResource, TestDynamicFieldCollectionResource, PrimUtilsTest, TestSchemaNameResource, DistributedTermsComponentTest, TestMergePolicyConfig, UpdateRequestProcessorFactoryTest, ShowFileRequestHandlerTest, TestStressReorder, SolrCmdDistributorTest, MultiTermTest, FileBasedSpellCheckerTest, SampleTest, TestFuzzyAnalyzedSuggestions, TestFieldCollectionResource, SpellCheckComponentTest, DistanceFunctionTest, TestRecovery, FieldAnalysisRequestHandlerTest, FullSolrCloudDistribCmdsTest, TestSolrDeletionPolicy2, TermVectorComponentDistributedTest, TestCoreContainer, TestMultiCoreConfBootstrap, TestCloudManagedSchema, TestXIncludeConfig, TestDistributedSearch, TestSchemaSimilarityResource, PrimitiveFieldTypeTest, TestStressLucene, TestRemoteStreaming, TestSystemIdResolver, TestPropInjectDefaults, SchemaVersionSpecificBehaviorTest, OutputWriterTest, TestFastOutputStream, QueryEqualityTest, TestReversedWildcardFilterFactory, PreAnalyzedUpdateProcessorTest, TestQuerySenderNoQuery, TestSolrXml, TestCodecSupport, LoggingHandlerTest, SignatureUpdateProcessorFactoryTest, ZkControllerTest, UUIDFieldTest, SuggesterFSTTest, FileUtilsTest, TestDocumentBuilder, FieldMutatingUpdateProcessorTest, ClusterStateUpdateTest, ResourceLoaderTest, ChaosMonkeyNothingIsSafeTest, RecoveryZkTest, TermVectorComponentTest, TestArbitraryIndexDir, SolrPluginUtilsTest, HardAutoCommitTest, TestReplicationHandler, TestTrie, MBeansHandlerTest, DocValuesMultiTest, TestLFUCache, SpellCheckCollatorTest, ReturnFieldsTest, TestRTGBase, TestCSVResponseWriter, TestSolrQueryParserResource, CurrencyFieldOpenExchangeTest, SyncSliceTest, DistributedSpellCheckComponentTest, EchoParamsTest, IndexReaderFactoryTest, TestQueryUtils, HighlighterTest, SolrIndexSplitterTest, TestSolrQueryParser, DocValuesTest, ShardRoutingCustomTest, DOMUtilTest, DirectUpdateHandlerOptimizeTest, SliceStateTest, TestSuggestSpellingConverter, CopyFieldTest, NumericFieldsTest, TestCopyFieldCollectionResource, TestUtils, JsonLoaderTest, TestJmxMonitoredMap, TestManagedSchema, TestOmitPositions, TestAtomicUpdateErrorCases, TestAddFieldRealTimeGet, TestPluginEnable, TestDocSet, UnloadDistributedZkTest, ExternalFileFieldSortTest, PathHierarchyTokenizerFactoryTest, TestRandomDVFaceting, TestRandomFaceting, TestPseudoReturnFields, SolrCoreTest, ClusterStateTest, TestWriterPerf, NoCacheHeaderTest, TestPhraseSuggestions, TestJoin, TestComponentsName, DistributedQueryElevationComponentTest, CoreContainerCoreInitFailuresTest, WordBreakSolrSpellCheckerTest, BasicZkTest, LukeRequestHandlerTest, TestStressVersions, IndexBasedSpellCheckerTest, PreAnalyzedFieldTest, SoftAutoCommitTest, BasicDistributedZk2Test, TestMaxScoreQueryParser, ZkNodePropsTest, AutoCommitTest, RAMDirectoryFactoryTest, ChaosMonkeyShardSplitTest, TestWordDelimiterFilterFactory, TestCSVLoader, MoreLikeThisHandlerTest, TestDynamicFieldResource, ZkCLITest, SolrIndexConfigTest, DirectSolrConnectionTest, TestCloudManagedSchemaAddField, TestFieldResource, RequiredFieldsTest, TestBinaryResponseWriter, TestSolr4Spatial, SearchHandlerTest, MinimalSchemaTest, ConvertedLegacyTest, TestFastWriter, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, CollectionsAPIDistributedZkTest, OpenCloseCoreStressTest, OverseerTest, LeaderElectionIntegrationTest, ShardRoutingTest, LeaderElectionTest, ZkSolrClientTest, TestZkChroot, SliceStateUpdateTest, TestDistributedGrouping, TestFaceting, TestHashPartitioner, TestRealTimeGet, TestReload, TestRangeQuery, SimpleFacetsTest, StatsComponentTest, TestGroupingSearch, QueryElevationComponentTest, PeerSyncTest, BadIndexSchemaTest, TestSort, TestFiltering, TestFunctionQuery, BasicFunctionalityTest, TestLazyCores, DirectUpdateHandlerTest, TestBadConfig, OverseerCollectionProcessorTest, TestIndexSearcher, CurrencyFieldXmlFileTest, SimplePostToolTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, TestExtendedDismaxParser, CoreAdminHandlerTest, SolrRequestParserTest, TestFoldingMultitermQuery, SuggesterTSTTest, SuggesterTest, SpatialFilterTest, SuggesterWFSTTest, PolyFieldTest, SolrCoreCheckLockOnStartupTest, TestUpdate, DefaultValueUpdateProcessorTest, StatelessScriptUpdateProcessorFactoryTest, SortByFunctionTest, TestSolrDeletionPolicy1, SolrInfoMBeanTest, XsltUpdateRequestHandlerTest, DebugComponentTest, CacheHeaderTest, TestSurroundQueryParser, DisMaxRequestHandlerTest, StandardRequestHandlerTest, DirectSolrSpellCheckerTest, DocumentAnalysisRequestHandlerTest, TestQueryTypes, TermsComponentTest, XmlUpdateRequestHandlerTest, RequestHandlersTest, DocumentBuilderTest, TestValueSourceCache, TestIndexingPerformance, FastVectorHighlighterTest, IndexSchemaRuntimeFieldTest, RegexBoostProcessorTest, IndexSchemaTest, TestJmxIntegration, TestCollationField, JSONWriterTest, QueryParsingTest, TestAnalyzedSuggestions, UniqFieldsUpdateProcessorFactoryTest, BinaryUpdateRequestHandlerTest, TestPartialUpdateDeduplication, TestPHPSerializedResponseWriter, PingRequestHandlerTest, CSVRequestHandlerTest, SOLR749Test, TestPropInject, TestQuerySenderListener, UpdateParamsTest, AlternateDirectoryTest, TestSolrIndexConfig, ResponseLogComponentTest, BadComponentTest, TestStressRecovery, TestBinaryField, TestSearchPerf, TestElisionMultitermQuery, TestConfig, TestSolrCoreProperties, TestPostingsSolrHighlighter, NotRequiredUniqueKeyTest, TestLuceneMatchVersion, SpellPossibilityIteratorTest, TestCharFilters, SynonymTokenizerTest, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestNumberUtils, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestIBSimilarityFactory, TestBM25SimilarityFactory, TestDefaultSimilarityFactory, LegacyHTMLStripCharFilterTest, TimeZoneUtilsTest, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, PluginInfoTest, TestFastLRUCache, DateMathParserTest, DateFieldTest, SpellingQueryConverterTest, TestSolrJ, TestLRUCache, SystemInfoHandlerTest, CircularListTest, SolrTestCaseJ4Test, AliasIntegrationTest, ShardSplitTest]
[junit4:junit4] Completed in 48.63s, 1 test, 1 error <<< FAILURES!
[...truncated 48 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:380: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:360: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:181: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:437: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1240: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:884: There were test failures: 295 suites, 1231 tests, 1 error, 18 ignored (6 assumptions)
Total time: 109 minutes 33 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 507 -
Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/507/
Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
5 tests failed.
REGRESSION: org.apache.solr.cloud.OverseerTest.testShardAssignmentBigger
Error Message:
Unexpected KeeperException!org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /live_nodes/node10
Stack Trace:
java.lang.AssertionError: Unexpected KeeperException!org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /live_nodes/node10
at __randomizedtesting.SeedInfo.seed([EC0F4D9F7E441643:7FE1B3E4942DE920]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.OverseerTest$MockZKController.deleteNode(OverseerTest.java:90)
at org.apache.solr.cloud.OverseerTest$MockZKController.close(OverseerTest.java:97)
at org.apache.solr.cloud.OverseerTest.testShardAssignmentBigger(OverseerTest.java:373)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.OverseerTest
Error Message:
ERROR: SolrZkClient opens=132 closes=63
Stack Trace:
java.lang.AssertionError: ERROR: SolrZkClient opens=132 closes=63
at __randomizedtesting.SeedInfo.seed([EC0F4D9F7E441643]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.SolrTestCaseJ4.endTrackingZkClients(SolrTestCaseJ4.java:267)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:102)
at sun.reflect.GeneratedMethodAccessor22.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.OverseerTest
Error Message:
142 threads leaked from SUITE scope at org.apache.solr.cloud.OverseerTest: 1) Thread[id=4863, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 2) Thread[id=4850, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 3) Thread[id=4801, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 4) Thread[id=4765, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 5) Thread[id=4789, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 6) Thread[id=4791, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 7) Thread[id=4794, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 8) Thread[id=4811, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 9) Thread[id=4784, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 10) Thread[id=4861, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 11) Thread[id=4575, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 12) Thread[id=4846, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 13) Thread[id=4802, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 14) Thread[id=4648, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 15) Thread[id=4787, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 16) Thread[id=4617, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 17) Thread[id=4751, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 18) Thread[id=4618, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 19) Thread[id=4839, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 20) Thread[id=4835, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 21) Thread[id=4847, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 22) Thread[id=4797, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 23) Thread[id=4828, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 24) Thread[id=4806, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 25) Thread[id=4775, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 26) Thread[id=4827, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 27) Thread[id=4842, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 28) Thread[id=4766, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 29) Thread[id=4838, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 30) Thread[id=4755, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 31) Thread[id=4756, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 32) Thread[id=4647, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 33) Thread[id=4753, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 34) Thread[id=4757, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 35) Thread[id=4788, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 36) Thread[id=4790, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 37) Thread[id=4740, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 38) Thread[id=4825, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 39) Thread[id=4848, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 40) Thread[id=4486, name=Thread-1910, state=WAITING, group=TGRP-OverseerTest] at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1258) at java.lang.Thread.join(Thread.java:1332) at org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:302) at org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:107) at org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:221) 41) Thread[id=4552, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 42) Thread[id=4792, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 43) Thread[id=4818, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 44) Thread[id=4762, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 45) Thread[id=4814, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 46) Thread[id=4760, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 47) Thread[id=4528, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 48) Thread[id=4843, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 49) Thread[id=4764, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 50) Thread[id=4845, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 51) Thread[id=4771, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 52) Thread[id=4747, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 53) Thread[id=4785, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 54) Thread[id=4778, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 55) Thread[id=4815, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 56) Thread[id=4852, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 57) Thread[id=4772, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 58) Thread[id=4576, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 59) Thread[id=4782, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 60) Thread[id=4750, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 61) Thread[id=4777, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 62) Thread[id=4767, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 63) Thread[id=4761, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 64) Thread[id=4816, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 65) Thread[id=4744, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 66) Thread[id=4742, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 67) Thread[id=4821, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 68) Thread[id=4738, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 69) Thread[id=4568, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 70) Thread[id=4741, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 71) Thread[id=4833, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 72) Thread[id=4819, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 73) Thread[id=4832, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 74) Thread[id=4739, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 75) Thread[id=4829, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 76) Thread[id=4768, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 77) Thread[id=4754, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 78) Thread[id=4490, name=ProcessThread(sid:0 cport:-1):, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:120) 79) Thread[id=4853, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 80) Thread[id=4834, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 81) Thread[id=4849, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 82) Thread[id=4488, name=SessionTracker, state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Object.wait(Native Method) at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:146) 83) Thread[id=4551, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 84) Thread[id=4803, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 85) Thread[id=4800, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 86) Thread[id=4795, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 87) Thread[id=4841, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 88) Thread[id=4840, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 89) Thread[id=4643, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 90) Thread[id=4844, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 91) Thread[id=4820, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 92) Thread[id=4579, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 93) Thread[id=4770, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 94) Thread[id=4781, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 95) Thread[id=4759, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 96) Thread[id=4836, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 97) Thread[id=4862, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 98) Thread[id=4774, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 99) Thread[id=4749, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 100) Thread[id=4823, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 101) Thread[id=4783, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 102) Thread[id=4793, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 103) Thread[id=4807, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 104) Thread[id=4826, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 105) Thread[id=4837, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 106) Thread[id=4769, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 107) Thread[id=4780, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 108) Thread[id=4812, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 109) Thread[id=4851, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 110) Thread[id=4758, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 111) Thread[id=4831, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 112) Thread[id=4567, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 113) Thread[id=4752, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 114) Thread[id=4799, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 115) Thread[id=4830, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 116) Thread[id=4550, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 117) Thread[id=4798, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 118) Thread[id=4748, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 119) Thread[id=4580, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 120) Thread[id=4817, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 121) Thread[id=4743, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 122) Thread[id=4808, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 123) Thread[id=4745, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 124) Thread[id=4796, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 125) Thread[id=4773, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 126) Thread[id=4864, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 127) Thread[id=4813, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 128) Thread[id=4763, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 129) Thread[id=4487, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:178) at java.lang.Thread.run(Thread.java:722) 130) Thread[id=4810, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 131) Thread[id=4527, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 132) Thread[id=4824, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 133) Thread[id=4644, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 134) Thread[id=4786, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 135) Thread[id=4809, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 136) Thread[id=4779, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 137) Thread[id=4549, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 138) Thread[id=4822, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 139) Thread[id=4804, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 140) Thread[id=4805, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 141) Thread[id=4746, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 142) Thread[id=4776, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 142 threads leaked from SUITE scope at org.apache.solr.cloud.OverseerTest:
1) Thread[id=4863, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
2) Thread[id=4850, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
3) Thread[id=4801, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
4) Thread[id=4765, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
5) Thread[id=4789, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
6) Thread[id=4791, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
7) Thread[id=4794, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
8) Thread[id=4811, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
9) Thread[id=4784, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
10) Thread[id=4861, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
11) Thread[id=4575, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
12) Thread[id=4846, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
13) Thread[id=4802, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
14) Thread[id=4648, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
15) Thread[id=4787, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
16) Thread[id=4617, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
17) Thread[id=4751, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
18) Thread[id=4618, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
19) Thread[id=4839, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
20) Thread[id=4835, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
21) Thread[id=4847, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
22) Thread[id=4797, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
23) Thread[id=4828, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
24) Thread[id=4806, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
25) Thread[id=4775, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
26) Thread[id=4827, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
27) Thread[id=4842, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
28) Thread[id=4766, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
29) Thread[id=4838, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
30) Thread[id=4755, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
31) Thread[id=4756, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
32) Thread[id=4647, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
33) Thread[id=4753, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
34) Thread[id=4757, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
35) Thread[id=4788, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
36) Thread[id=4790, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
37) Thread[id=4740, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
38) Thread[id=4825, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
39) Thread[id=4848, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
40) Thread[id=4486, name=Thread-1910, state=WAITING, group=TGRP-OverseerTest]
at java.lang.Object.wait(Native Method)
at java.lang.Thread.join(Thread.java:1258)
at java.lang.Thread.join(Thread.java:1332)
at org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:302)
at org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:107)
at org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:221)
41) Thread[id=4552, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
42) Thread[id=4792, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
43) Thread[id=4818, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
44) Thread[id=4762, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
45) Thread[id=4814, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
46) Thread[id=4760, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
47) Thread[id=4528, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
48) Thread[id=4843, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
49) Thread[id=4764, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
50) Thread[id=4845, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
51) Thread[id=4771, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
52) Thread[id=4747, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
53) Thread[id=4785, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
54) Thread[id=4778, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
55) Thread[id=4815, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
56) Thread[id=4852, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
57) Thread[id=4772, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
58) Thread[id=4576, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
59) Thread[id=4782, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
60) Thread[id=4750, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
61) Thread[id=4777, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
62) Thread[id=4767, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
63) Thread[id=4761, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
64) Thread[id=4816, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
65) Thread[id=4744, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
66) Thread[id=4742, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
67) Thread[id=4821, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
68) Thread[id=4738, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
69) Thread[id=4568, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
70) Thread[id=4741, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
71) Thread[id=4833, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
72) Thread[id=4819, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
73) Thread[id=4832, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
74) Thread[id=4739, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
75) Thread[id=4829, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
76) Thread[id=4768, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
77) Thread[id=4754, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
78) Thread[id=4490, name=ProcessThread(sid:0 cport:-1):, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:120)
79) Thread[id=4853, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
80) Thread[id=4834, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
81) Thread[id=4849, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
82) Thread[id=4488, name=SessionTracker, state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Object.wait(Native Method)
at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:146)
83) Thread[id=4551, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
84) Thread[id=4803, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
85) Thread[id=4800, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
86) Thread[id=4795, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
87) Thread[id=4841, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
88) Thread[id=4840, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
89) Thread[id=4643, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
90) Thread[id=4844, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
91) Thread[id=4820, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
92) Thread[id=4579, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
93) Thread[id=4770, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
94) Thread[id=4781, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
95) Thread[id=4759, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
96) Thread[id=4836, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
97) Thread[id=4862, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
98) Thread[id=4774, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
99) Thread[id=4749, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
100) Thread[id=4823, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
101) Thread[id=4783, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
102) Thread[id=4793, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
103) Thread[id=4807, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
104) Thread[id=4826, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
105) Thread[id=4837, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
106) Thread[id=4769, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
107) Thread[id=4780, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
108) Thread[id=4812, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
109) Thread[id=4851, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
110) Thread[id=4758, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
111) Thread[id=4831, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
112) Thread[id=4567, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
113) Thread[id=4752, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
114) Thread[id=4799, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
115) Thread[id=4830, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
116) Thread[id=4550, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
117) Thread[id=4798, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
118) Thread[id=4748, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
119) Thread[id=4580, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
120) Thread[id=4817, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
121) Thread[id=4743, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
122) Thread[id=4808, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
123) Thread[id=4745, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
124) Thread[id=4796, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
125) Thread[id=4773, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
126) Thread[id=4864, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
127) Thread[id=4813, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
128) Thread[id=4763, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
129) Thread[id=4487, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:178)
at java.lang.Thread.run(Thread.java:722)
130) Thread[id=4810, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
131) Thread[id=4527, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
132) Thread[id=4824, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
133) Thread[id=4644, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
134) Thread[id=4786, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
135) Thread[id=4809, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
136) Thread[id=4779, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
137) Thread[id=4549, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
138) Thread[id=4822, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
139) Thread[id=4804, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
140) Thread[id=4805, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
141) Thread[id=4746, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
142) Thread[id=4776, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:159)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
at __randomizedtesting.SeedInfo.seed([EC0F4D9F7E441643]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.OverseerTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=4863, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984) 2) Thread[id=4850, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984) 3) Thread[id=4754, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 4) Thread[id=4768, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 5) Thread[id=4794, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 6) Thread[id=4784, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 7) Thread[id=4834, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984) 8) Thread[id=4861, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 9) Thread[id=4551, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984) 10) Thread[id=4846, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 11) Thread[id=4575, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 12) Thread[id=4802, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest] at
[...truncated too long message...]
] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4] > 52) Thread[id=4750, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4] > 53) Thread[id=4782, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4] > 54) Thread[id=4808, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4] > 55) Thread[id=4796, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4] > 56) Thread[id=4816, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4] > 57) Thread[id=4810, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4] > 58) Thread[id=4527, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4] > 59) Thread[id=4744, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4] > 60) Thread[id=4824, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4] > 61) Thread[id=4742, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4] > 62) Thread[id=4786, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4] > 63) Thread[id=4738, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4] > 64) Thread[id=4549, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4] > 65) Thread[id=4822, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4] > 66) Thread[id=4832, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4] > 67) Thread[id=4804, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4] > 68) Thread[id=4746, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4] > 69) Thread[id=4776, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[EC0F4D9F7E441643]-SendThread(localhost:50610), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([EC0F4D9F7E441643]:0)
[junit4:junit4] Completed in 119.97s, 8 tests, 2 failures, 2 errors <<< FAILURES!
[...truncated 437 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:380: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:360: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:181: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:437: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1240: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:884: There were test failures: 295 suites, 1231 tests, 3 suite-level errors, 1 error, 1 failure, 563 ignored (6 assumptions)
Total time: 92 minutes 20 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 506 -
Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/506/
Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
collection already exists: awholynewcollection_0
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: collection already exists: awholynewcollection_0
at __randomizedtesting.SeedInfo.seed([582ED054AA4ACC29:D9C85E4CDD15AC15]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:424)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:264)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:306)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1400)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:438)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:146)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9555 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4:junit4] 2> 2051960 T3431 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /wf_s/
[junit4:junit4] 2> 2051985 T3431 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-CollectionsAPIDistributedZkTest-1369557286267
[junit4:junit4] 2> 2051987 T3431 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 2051989 T3432 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 2052089 T3431 oasc.ZkTestServer.run start zk server on port:50360
[junit4:junit4] 2> 2052096 T3431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2052109 T3438 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2341e463 name:ZooKeeperConnection Watcher:127.0.0.1:50360 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2052110 T3431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2052111 T3431 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 2052124 T3431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2052134 T3440 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5eac3b15 name:ZooKeeperConnection Watcher:127.0.0.1:50360/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2052135 T3431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2052137 T3431 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 2052150 T3431 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 2052158 T3431 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 2052167 T3431 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 2052177 T3431 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 2052178 T3431 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 2052192 T3431 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 2052194 T3431 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 2052211 T3431 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 2052212 T3431 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 2052221 T3431 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 2052222 T3431 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 2052234 T3431 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 2052236 T3431 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 2052246 T3431 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 2052247 T3431 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 2052256 T3431 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 2052258 T3431 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 2052274 T3431 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 2052275 T3431 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 2052284 T3431 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 2052286 T3431 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 2053009 T3431 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 2053019 T3431 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50363
[junit4:junit4] 2> 2053020 T3431 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 2053021 T3431 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 2053021 T3431 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576
[junit4:junit4] 2> 2053022 T3431 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/solr.xml
[junit4:junit4] 2> 2053023 T3431 oasc.CoreContainer.<init> New CoreContainer 41931893
[junit4:junit4] 2> 2053024 T3431 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/'
[junit4:junit4] 2> 2053024 T3431 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/'
[junit4:junit4] 2> 2053250 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576
[junit4:junit4] 2> 2053252 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/collection1
[junit4:junit4] 2> 2053254 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/collection1/conf
[junit4:junit4] 2> 2053441 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/collection1/conf/xslt
[junit4:junit4] 2> 2053448 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/collection1/lib
[junit4:junit4] 2> 2053453 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/collection1/lib/classes
[junit4:junit4] 2> 2053460 T3431 oasc.SolrCoreDiscoverer.addCore Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/conf/core.properties, adding to cores
[junit4:junit4] 2> 2053478 T3431 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 2053479 T3431 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 2053479 T3431 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 2053480 T3431 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 2053481 T3431 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 2053482 T3431 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 2053482 T3431 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 2053483 T3431 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 2053484 T3431 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 2053484 T3431 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 2053521 T3431 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 2053522 T3431 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50360/solr
[junit4:junit4] 2> 2053523 T3431 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 2053525 T3431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2053530 T3451 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@41a8495b name:ZooKeeperConnection Watcher:127.0.0.1:50360 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2053532 T3431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2053538 T3431 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 2053563 T3431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2053568 T3453 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3979994f name:ZooKeeperConnection Watcher:127.0.0.1:50360/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2053569 T3431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2053574 T3431 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 2053599 T3431 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 2053626 T3431 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 2053635 T3431 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50363_wf_s
[junit4:junit4] 2> 2053641 T3431 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50363_wf_s
[junit4:junit4] 2> 2053658 T3431 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 2053677 T3431 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 2053693 T3431 oasc.Overseer.start Overseer (id=89755306313842691-127.0.0.1:50363_wf_s-n_0000000000) starting
[junit4:junit4] 2> 2053709 T3431 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 2053726 T3455 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 2053730 T3431 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 2053740 T3431 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 2053746 T3431 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 2053763 T3431 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4] 2> 2053764 T3431 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 2053765 T3431 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 2053775 T3454 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 2053790 T3431 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 2053798 T3431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2053806 T3458 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e475254 name:ZooKeeperConnection Watcher:127.0.0.1:50360/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2053807 T3431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2053812 T3431 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 2053823 T3431 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 2054795 T3431 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 2054825 T3431 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50367
[junit4:junit4] 2> 2054826 T3431 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 2054827 T3431 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 2054828 T3431 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104
[junit4:junit4] 2> 2054828 T3431 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/solr.xml
[junit4:junit4] 2> 2054829 T3431 oasc.CoreContainer.<init> New CoreContainer 1107122813
[junit4:junit4] 2> 2054830 T3431 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/'
[junit4:junit4] 2> 2054830 T3431 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/'
[junit4:junit4] 2> 2055027 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104
[junit4:junit4] 2> 2055030 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/collection1
[junit4:junit4] 2> 2055032 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/collection1/conf
[junit4:junit4] 2> 2055241 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/collection1/conf/xslt
[junit4:junit4] 2> 2055249 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/collection1/lib
[junit4:junit4] 2> 2055253 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/collection1/lib/classes
[junit4:junit4] 2> 2055258 T3431 oasc.SolrCoreDiscoverer.addCore Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/conf/core.properties, adding to cores
[junit4:junit4] 2> 2055292 T3431 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 2055293 T3431 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 2055294 T3431 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 2055295 T3431 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 2055296 T3431 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 2055297 T3431 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 2055299 T3431 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 2055302 T3431 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 2055303 T3431 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 2055304 T3431 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 2055344 T3431 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 2055345 T3431 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50360/solr
[junit4:junit4] 2> 2055346 T3431 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 2055348 T3431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2055353 T3469 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b2d1da4 name:ZooKeeperConnection Watcher:127.0.0.1:50360 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2055355 T3431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2055359 T3431 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 2055386 T3431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2055390 T3471 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@60c437cc name:ZooKeeperConnection Watcher:127.0.0.1:50360/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2055390 T3431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2055404 T3431 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 2056423 T3431 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50367_wf_s
[junit4:junit4] 2> 2056426 T3431 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50367_wf_s
[junit4:junit4] 2> 2056444 T3453 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 2056445 T3471 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 2056446 T3458 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 2056458 T3431 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4] 2> 2056459 T3431 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 2056460 T3431 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 2057085 T3431 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 2057096 T3431 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50370
[junit4:junit4] 2> 2057098 T3431 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 2057098 T3431 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 2057099 T3431 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763
[junit4:junit4] 2> 2057100 T3431 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/solr.xml
[junit4:junit4] 2> 2057100 T3431 oasc.CoreContainer.<init> New CoreContainer 1742248025
[junit4:junit4] 2> 2057101 T3431 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/'
[junit4:junit4] 2> 2057102 T3431 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/'
[junit4:junit4] 2> 2057310 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763
[junit4:junit4] 2> 2057312 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/collection1
[junit4:junit4] 2> 2057314 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/collection1/conf
[junit4:junit4] 2> 2057603 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/collection1/conf/xslt
[junit4:junit4] 2> 2057610 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/collection1/lib
[junit4:junit4] 2> 2057617 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/collection1/lib/classes
[junit4:junit4] 2> 2057622 T3431 oasc.SolrCoreDiscoverer.addCore Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/conf/core.properties, adding to cores
[junit4:junit4] 2> 2057652 T3431 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 2057654 T3431 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 2057655 T3431 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 2057657 T3431 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 2057658 T3431 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 2057659 T3431 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 2057660 T3431 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 2057662 T3431 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 2057663 T3431 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 2057664 T3431 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 2057722 T3431 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 2057723 T3431 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50360/solr
[junit4:junit4] 2> 2057725 T3431 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 2057728 T3431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2057736 T3483 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@857735b name:ZooKeeperConnection Watcher:127.0.0.1:50360 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2057742 T3431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2057750 T3431 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 2057793 T3431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2057801 T3485 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@386f792a name:ZooKeeperConnection Watcher:127.0.0.1:50360/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2057802 T3431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2057823 T3431 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 2058849 T3431 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50370_wf_s
[junit4:junit4] 2> 2058853 T3431 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50370_wf_s
[junit4:junit4] 2> 2058867 T3453 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 2058869 T3485 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 2058888 T3471 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 2058889 T3458 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 2058900 T3431 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4] 2> 2058901 T3431 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 2058901 T3431 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 2059482 T3431 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 2059489 T3431 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50373
[junit4:junit4] 2> 2059490 T3431 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 2059491 T3431 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 2059492 T3431 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203
[junit4:junit4] 2> 2059492 T3431 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/solr.xml
[junit4:junit4] 2> 2059493 T3431 oasc.CoreContainer.<init> New CoreContainer 158171351
[junit4:junit4] 2> 2059494 T3431 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/'
[junit4:junit4] 2> 2059494 T3431 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/'
[junit4:junit4] 2> 2059709 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203
[junit4:junit4] 2> 2059710 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/collection1
[junit4:junit4] 2> 2059712 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/collection1/conf
[junit4:junit4] 2> 2059898 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/collection1/conf/xslt
[junit4:junit4] 2> 2059904 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/collection1/lib
[junit4:junit4] 2> 2059905 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/collection1/lib/classes
[junit4:junit4] 2> 2059909 T3431 oasc.SolrCoreDiscoverer.addCore Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/conf/core.properties, adding to cores
[junit4:junit4] 2> 2059931 T3431 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 2059932 T3431 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 2059932 T3431 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 2059933 T3431 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 2059933 T3431 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 2059934 T3431 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 2059934 T3431 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 2059935 T3431 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 2059935 T3431 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 2059936 T3431 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 2059967 T3431 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 2059968 T3431 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50360/solr
[junit4:junit4] 2> 2059969 T3431 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 2059972 T3431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2059978 T3497 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f2181e8 name:ZooKeeperConnection Watcher:127.0.0.1:50360 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2059979 T3431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2059985 T3431 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 2060016 T3431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2060020 T3499 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ee73459 name:ZooKeeperConnection Watcher:127.0.0.1:50360/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2060020 T3431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2060032 T3431 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 2061044 T3431 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50373_wf_s
[junit4:junit4] 2> 2061047 T3431 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50373_wf_s
[junit4:junit4] 2> 2061067 T3471 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 2061068 T3485 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 2061068 T3458 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 2061069 T3499 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 2061069 T3453 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 2061085 T3431 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4] 2> 2061085 T3431 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 2061086 T3431 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 2061702 T3431 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 2061720 T3431 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50376
[junit4:junit4] 2> 2061723 T3431 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 2061723 T3431 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 2061724 T3431 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386
[junit4:junit4] 2> 2061724 T3431 oasc.CoreContainer$Initializer.initialize looking for solr config file: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/solr.xml
[junit4:junit4] 2> 2061725 T3431 oasc.CoreContainer.<init> New CoreContainer 576967835
[junit4:junit4] 2> 2061726 T3431 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/'
[junit4:junit4] 2> 2061726 T3431 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/'
[junit4:junit4] 2> 2061921 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386
[junit4:junit4] 2> 2061923 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/collection1
[junit4:junit4] 2> 2061924 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/collection1/conf
[junit4:junit4] 2> 2062111 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/collection1/conf/xslt
[junit4:junit4] 2> 2062116 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/collection1/lib
[junit4:junit4] 2> 2062118 T3431 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/collection1/lib/classes
[junit4:junit4] 2> 2062121 T3431 oasc.SolrCoreDiscoverer.addCore Discovered properties file /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/conf/core.properties, adding to cores
[junit4:junit4] 2> 2062143 T3431 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 2062144 T3431 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 2062145 T3431 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 2062145 T3431 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 2062146 T3431 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 2062146 T3431 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 2062147 T3431 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 2062148 T3431 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 2062148 T3431 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 2062149 T3431 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 2062178 T3431 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 2062179 T3431 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50360/solr
[junit4:junit4] 2> 2062179 T3431 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 2062182 T3431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2062188 T3511 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6ec5ddce name:ZooKeeperConnection Watcher:127.0.0.1:50360 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2062189 T3431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2062201 T3431 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 2062223 T3431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2062228 T3513 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@695d4f49 name:ZooKeeperConnection Watcher:127.0.0.1:50360/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2062228 T3431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2062244 T3431 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 2063257 T3431 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50376_wf_s
[junit4:junit4] 2> 2063260 T3431 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50376_wf_s
[junit4:junit4] 2> 2063267 T3485 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 2063271 T3513 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 2063276 T3453 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 2063276 T3499 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 2063277 T3458 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 2063277 T3471 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 2063290 T3431 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4:junit4] 2> 2063290 T3431 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 2063291 T3431 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 2063318 T3431 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 2063345 T3465 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2
[junit4:junit4] 2> 2063349 T3453 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 2063356 T3455 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4:junit4] 2> "operation":"createcollection",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "maxShardsPerNode":null,
[junit4:junit4] 2> "createNodeSet":null,
[junit4:junit4] 2> "name":"nodes_used_collection",
[junit4:junit4] 2> "replicationFactor":"2"}
[junit4:junit4] 2> 2063356 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica1 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:50373_wf_s
[junit4:junit4] 2> 2063357 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica2 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:50363_wf_s
[junit4:junit4] 2> 2063357 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica1 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:50370_wf_s
[junit4:junit4] 2> 2063358 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica2 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:50367_wf_s
[junit4:junit4] 2> 2063369 T3479 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 2063370 T3479 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 2063370 T3493 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/nodes_used_collection_shard1_replica1
[junit4:junit4] 2> 2063374 T3493 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 2063371 T3445 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica2' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 2063375 T3445 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 2063376 T3479 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 2063377 T3479 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 2063374 T3466 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica2' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 2063379 T3466 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 2063378 T3445 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 2063377 T3493 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 2063382 T3493 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 2063381 T3445 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 2063393 T3466 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 2063394 T3466 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 2063394 T3479 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 2063395 T3493 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 2063396 T3493 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 2063396 T3479 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 2063397 T3445 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 2063398 T3445 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 2063403 T3466 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 2063403 T3466 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 2063413 T3479 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 2063415 T3445 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 2063416 T3493 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 2063418 T3466 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 2063422 T3479 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/nodes_used_collection_shard2_replica1/'
[junit4:junit4] 2> 2063425 T3493 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/nodes_used_collection_shard1_replica1/'
[junit4:junit4] 2> 2063429 T3445 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/nodes_used_collection_shard1_replica2/'
[junit4:junit4] 2> 2063434 T3466 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/nodes_used_collection_shard2_replica2/'
[junit4:junit4] 2> 2063707 T3493 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 2063760 T3479 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 2063769 T3466 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 2063882 T3445 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 2064143 T3493 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2064149 T3445 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2064157 T3466 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2064161 T3493 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2064164 T3445 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2064175 T3445 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica2] Schema name=test
[junit4:junit4] 2> 2064181 T3479 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2064181 T3493 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica1] Schema name=test
[junit4:junit4] 2> 2064185 T3466 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2064193 T3466 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica2] Schema name=test
[junit4:junit4] 2> 2064198 T3479 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2064205 T3479 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica1] Schema name=test
[junit4:junit4] 2> 2067837 T3466 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 2067883 T3466 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 2067889 T3466 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 2068104 T3493 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 2068106 T3479 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 2068129 T3493 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 2068142 T3493 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 2068182 T3466 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2068202 T3479 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 2068209 T3479 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 2068210 T3466 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2068265 T3466 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2068277 T3466 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 2068278 T3466 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 2068279 T3466 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2068281 T3493 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2068284 T3466 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 2068285 T3466 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 2068287 T3466 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 2068287 T3466 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica2] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/nodes_used_collection_shard2_replica2/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/nodes_used_collection_shard2_replica2/data/
[junit4:junit4] 2> 2068288 T3466 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@27c2792c
[junit4:junit4] 2> 2068289 T3466 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 2068297 T3466 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/nodes_used_collection_shard2_replica2/data
[junit4:junit4] 2> 2068297 T3466 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/nodes_used_collection_shard2_replica2/data/index/
[junit4:junit4] 2> 2068298 T3466 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica2] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/nodes_used_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 2068299 T3466 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/nodes_used_collection_shard2_replica2/data/index
[junit4:junit4] 2> 2068308 T3466 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@321a9515 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c915046),segFN=segments_1,generation=1}
[junit4:junit4] 2> 2068310 T3466 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 2068338 T3493 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2068340 T3466 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 2068341 T3466 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 2068342 T3466 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 2068343 T3466 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 2068345 T3466 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 2068345 T3466 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 2068346 T3466 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 2068347 T3466 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 2068348 T3466 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 2068390 T3493 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2068399 T3466 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 2068410 T3493 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 2068423 T3493 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 2068427 T3493 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2068417 T3466 oass.SolrIndexSearcher.<init> Opening Searcher@2b3f5fc3 main
[junit4:junit4] 2> 2068430 T3466 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/nodes_used_collection_shard2_replica2/data/tlog
[junit4:junit4] 2> 2068417 T3445 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 2068438 T3493 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 2068440 T3493 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 2068441 T3493 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 2068442 T3493 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/nodes_used_collection_shard1_replica1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/nodes_used_collection_shard1_replica1/data/
[junit4:junit4] 2> 2068442 T3493 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@27c2792c
[junit4:junit4] 2> 2068444 T3493 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 2068447 T3493 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/nodes_used_collection_shard1_replica1/data
[junit4:junit4] 2> 2068448 T3493 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/nodes_used_collection_shard1_replica1/data/index/
[junit4:junit4] 2> 2068449 T3493 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/nodes_used_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 2068437 T3466 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 2068451 T3466 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 2068474 T3493 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/nodes_used_collection_shard1_replica1/data/index
[junit4:junit4] 2> 2068479 T3519 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica2] Registered new searcher Searcher@2b3f5fc3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 2068483 T3466 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=down
[junit4:junit4] 2> 2068488 T3479 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2068496 T3445 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 2068503 T3493 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@25e72f55 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2a35c382),segFN=segments_1,generation=1}
[junit4:junit4] 2> 2068504 T3493 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 2068513 T3493 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 2068513 T3493 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 2068515 T3493 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 2068517 T3493 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 2068518 T3493 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 2068518 T3493 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 2068519 T3493 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 2068520 T3493 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 2068521 T3493 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 2068532 T3445 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 2068559 T3493 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 2068568 T3479 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2068576 T3493 oass.SolrIndexSearcher.<init> Opening Searcher@3780cac8 main
[junit4:junit4] 2> 2068579 T3493 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/nodes_used_collection_shard1_replica1/data/tlog
[junit4:junit4] 2> 2068581 T3493 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 2068581 T3493 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 2068588 T3520 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica1] Registered new searcher Searcher@3780cac8 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 2068589 T3479 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2068596 T3493 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=down
[junit4:junit4] 2> 2068603 T3479 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 2068604 T3479 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 2068605 T3479 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2068613 T3479 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 2068615 T3479 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 2068616 T3479 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 2068617 T3479 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica1] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/nodes_used_collection_shard2_replica1/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/nodes_used_collection_shard2_replica1/data/
[junit4:junit4] 2> 2068618 T3479 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@27c2792c
[junit4:junit4] 2> 2068621 T3479 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 2068626 T3479 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/nodes_used_collection_shard2_replica1/data
[junit4:junit4] 2> 2068627 T3479 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/nodes_used_collection_shard2_replica1/data/index/
[junit4:junit4] 2> 2068627 T3479 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica1] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/nodes_used_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 2068629 T3479 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/nodes_used_collection_shard2_replica1/data/index
[junit4:junit4] 2> 2068646 T3479 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@77eb09e8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@57a10e),segFN=segments_1,generation=1}
[junit4:junit4] 2> 2068648 T3479 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 2068658 T3479 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 2068658 T3479 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 2068660 T3479 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 2068664 T3479 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 2068666 T3479 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 2068666 T3479 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 2068668 T3479 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 2068671 T3445 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2068672 T3479 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 2068674 T3479 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 2068712 T3479 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 2068723 T3479 oass.SolrIndexSearcher.<init> Opening Searcher@25a66630 main
[junit4:junit4] 2> 2068725 T3479 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/nodes_used_collection_shard2_replica1/data/tlog
[junit4:junit4] 2> 2068728 T3479 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 2068730 T3479 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 2068737 T3445 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2068744 T3479 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=down
[junit4:junit4] 2> 2068738 T3521 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica1] Registered new searcher Searcher@25a66630 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 2068763 T3445 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2068767 T3445 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 2068768 T3445 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 2068768 T3445 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2068773 T3445 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 2068774 T3445 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 2068775 T3445 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 2068776 T3445 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica2] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/nodes_used_collection_shard1_replica2/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/nodes_used_collection_shard1_replica2/data/
[junit4:junit4] 2> 2068777 T3445 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@27c2792c
[junit4:junit4] 2> 2068779 T3445 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 2068782 T3445 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/nodes_used_collection_shard1_replica2/data
[junit4:junit4] 2> 2068789 T3445 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/nodes_used_collection_shard1_replica2/data/index/
[junit4:junit4] 2> 2068795 T3445 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica2] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/nodes_used_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 2068796 T3445 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/nodes_used_collection_shard1_replica2/data/index
[junit4:junit4] 2> 2068803 T3445 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73de7ea4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1378ac90),segFN=segments_1,generation=1}
[junit4:junit4] 2> 2068804 T3445 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 2068810 T3445 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 2068811 T3445 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 2068813 T3445 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 2068815 T3445 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 2068817 T3445 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 2068818 T3445 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 2068819 T3445 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 2068820 T3445 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 2068821 T3445 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 2068849 T3445 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 2068871 T3445 oass.SolrIndexSearcher.<init> Opening Searcher@5dd506ef main
[junit4:junit4] 2> 2068872 T3445 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/nodes_used_collection_shard1_replica2/data/tlog
[junit4:junit4] 2> 2068874 T3445 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 2068875 T3445 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 2068884 T3522 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica2] Registered new searcher Searcher@5dd506ef main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 2068898 T3445 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=down
[junit4:junit4] 2> 2069010 T3454 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2069012 T3454 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50367_wf_s",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50367/wf_s"}
[junit4:junit4] 2> 2069012 T3454 oasc.Overseer$ClusterStateUpdater.createCollection Create collection nodes_used_collection with numShards 2
[junit4:junit4] 2> 2069025 T3454 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50373_wf_s",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50373/wf_s"}
[junit4:junit4] 2> 2069044 T3454 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50370_wf_s",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50370/wf_s"}
[junit4:junit4] 2> 2069058 T3454 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50363_wf_s",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50363/wf_s"}
[junit4:junit4] 2> 2069075 T3458 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2069077 T3485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2069077 T3471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2069078 T3513 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2069079 T3499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2069079 T3453 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2069493 T3466 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 2069494 T3466 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica2 address:http://127.0.0.1:50367/wf_s collection:nodes_used_collection shard:shard2
[junit4:junit4] 2> 2069497 T3466 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard2/election
[junit4:junit4] 2> 2069530 T3466 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2069541 T3466 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=179998
[junit4:junit4] 2> 2069603 T3493 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica1
[junit4:junit4] 2> 2069604 T3493 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica1 address:http://127.0.0.1:50373/wf_s collection:nodes_used_collection shard:shard1
[junit4:junit4] 2> 2069608 T3493 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard1/election
[junit4:junit4] 2> 2069635 T3493 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2069648 T3493 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=179997
[junit4:junit4] 2> 2069754 T3479 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 2069756 T3479 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica1 address:http://127.0.0.1:50370/wf_s collection:nodes_used_collection shard:shard2
[junit4:junit4] 2> 2069912 T3445 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 2069912 T3445 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica2 address:http://127.0.0.1:50363/wf_s collection:nodes_used_collection shard:shard1
[junit4:junit4] 2> 2070046 T3466 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2070047 T3466 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2070048 T3466 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50367/wf_s/nodes_used_collection_shard2_replica2/
[junit4:junit4] 2> 2070048 T3466 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:50367/wf_s START replicas=[http://127.0.0.1:50370/wf_s/nodes_used_collection_shard2_replica1/] nUpdates=100
[junit4:junit4] 2> 2070049 T3466 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:50367/wf_s DONE. We have no versions. sync failed.
[junit4:junit4] 2> 2070050 T3466 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4] 2> 2070050 T3466 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4] 2> 2070051 T3466 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50367/wf_s/nodes_used_collection_shard2_replica2/
[junit4:junit4] 2> 2070052 T3466 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard2
[junit4:junit4] 2> ASYNC NEW_CORE C6316 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@7d7bc595 url=http://127.0.0.1:50370/wf_s/nodes_used_collection_shard2_replica1 node=127.0.0.1:50370_wf_s C6316_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=down, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:50370_wf_s, base_url=http://127.0.0.1:50370/wf_s}
[junit4:junit4] 2> 2070090 T3481 C6316 P50370 oasc.SolrCore.execute [nodes_used_collection_shard2_replica1] webapp=/wf_s path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=2
[junit4:junit4] 2> 2070158 T3493 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2070159 T3493 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2070160 T3493 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50373/wf_s/nodes_used_collection_shard1_replica1/
[junit4:junit4] 2> 2070161 T3493 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica1 url=http://127.0.0.1:50373/wf_s START replicas=[http://127.0.0.1:50363/wf_s/nodes_used_collection_shard1_replica2/] nUpdates=100
[junit4:junit4] 2> 2070162 T3493 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica1 url=http://127.0.0.1:50373/wf_s DONE. We have no versions. sync failed.
[junit4:junit4] 2> 2070163 T3493 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4] 2> 2070164 T3493 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4] 2> 2070165 T3493 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50373/wf_s/nodes_used_collection_shard1_replica1/
[junit4:junit4] 2> 2070166 T3493 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard1
[junit4:junit4] 2> ASYNC NEW_CORE C6317 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@57303eeb url=http://127.0.0.1:50363/wf_s/nodes_used_collection_shard1_replica2 node=127.0.0.1:50363_wf_s C6317_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=down, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:50363_wf_s, base_url=http://127.0.0.1:50363/wf_s}
[junit4:junit4] 2> 2070204 T3447 C6317 P50363 oasc.SolrCore.execute [nodes_used_collection_shard1_replica2] webapp=/wf_s path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 2070654 T3454 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2070719 T3485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2070721 T3513 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2070722 T3471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2070728 T3499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2070729 T3458 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2070730 T3453 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2070779 T3479 oasc.ZkController.register We are http://127.0.0.1:50370/wf_s/nodes_used_collection_shard2_replica1/ and leader is http://127.0.0.1:50367/wf_s/nodes_used_collection_shard2_replica2/
[junit4:junit4] 2> 2070780 T3479 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica1 baseURL=http://127.0.0.1:50370/wf_s
[junit4:junit4] 2> 2070781 T3479 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 2070782 T3479 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> 2070783 T3466 oasc.ZkController.register We are http://127.0.0.1:50367/wf_s/nodes_used_collection_shard2_replica2/ and leader is http://127.0.0.1:50367/wf_s/nodes_used_collection_shard2_replica2/
[junit4:junit4] 2> 2070784 T3466 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica2 baseURL=http://127.0.0.1:50367/wf_s
[junit4:junit4] 2> 2070785 T3466 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 2070786 T3466 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=active
[junit4:junit4] 2> 2070784 T3493 oasc.ZkController.register We are http://127.0.0.1:50373/wf_s/nodes_used_collection_shard1_replica1/ and leader is http://127.0.0.1:50373/wf_s/nodes_used_collection_shard1_replica1/
[junit4:junit4] 2> 2070788 T3493 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica1 baseURL=http://127.0.0.1:50373/wf_s
[junit4:junit4] 2> 2070789 T3493 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 2070790 T3493 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=active
[junit4:junit4] 2> 2070785 T3525 C6316 P50370 oasc.RecoveryStrategy.run Starting recovery process. core=nodes_used_collection_shard2_replica1 recoveringAfterStartup=true
[junit4:junit4] 2> 2070792 T3525 C6316 P50370 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 2070791 T3479 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2070795 T3525 C6316 P50370 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=recovering
[junit4:junit4] 2> 2070804 T3479 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=7435
[junit4:junit4] 2> 2070810 T3525 C6316 P50370 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 2070820 T3466 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2070821 T3493 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2070825 T3466 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=7452
[junit4:junit4] 2> 2070827 T3493 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=7458
[junit4:junit4] 2> 2070872 T3463 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:50370_wf_s_nodes_used_collection_shard2_replica1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 2070926 T3445 oasc.ZkController.register We are http://127.0.0.1:50363/wf_s/nodes_used_collection_shard1_replica2/ and leader is http://127.0.0.1:50373/wf_s/nodes_used_collection_shard1_replica1/
[junit4:junit4] 2> 2070927 T3445 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica2 baseURL=http://127.0.0.1:50363/wf_s
[junit4:junit4] 2> 2070928 T3445 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 2070929 T3445 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> 2070930 T3526 C6317 P50363 oasc.RecoveryStrategy.run Starting recovery process. core=nodes_used_collection_shard1_replica2 recoveringAfterStartup=true
[junit4:junit4] 2> 2070931 T3526 C6317 P50363 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 2070932 T3526 C6317 P50363 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=recovering
[junit4:junit4] 2> 2070934 T3445 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2070936 T3526 C6317 P50363 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 2070946 T3445 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=7575
[junit4:junit4] 2> 2070949 T3455 oasc.OverseerCollectionProcessor.createCollection Finished create command on all shards for collection: nodes_used_collection
[junit4:junit4] 2> 2070963 T3471 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work/qnr-0000000000 state: SyncConnected type NodeDataChanged
[junit4:junit4] 2> 2070975 T3491 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:50363_wf_s_nodes_used_collection_shard1_replica2, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 2070982 T3453 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 2070983 T3465 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2} status=0 QTime=7638
[junit4:junit4] 2> 2070985 T3455 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000000 complete, response:{success={null={responseHeader={status=0,QTime=7435},core=nodes_used_collection_shard2_replica1},null={responseHeader={status=0,QTime=7452},core=nodes_used_collection_shard2_replica2},null={responseHeader={status=0,QTime=7458},core=nodes_used_collection_shard1_replica1},null={responseHeader={status=0,QTime=7575},core=nodes_used_collection_shard1_replica2}}}
[junit4:junit4] 2> 2070987 T3431 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 2070990 T3431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2071000 T3528 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@302a0003 name:ZooKeeperConnection Watcher:127.0.0.1:50360/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2071001 T3431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2071005 T3431 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 2071022 T3431 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 2071031 T3431 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2071039 T3530 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@204d9d3 name:ZooKeeperConnection Watcher:127.0.0.1:50360/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2071040 T3431 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2071044 T3431 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 2071087 T3494 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=4&maxShardsPerNode=5&name=awholynewcollection_0&replicationFactor=5&action=CREATE&wt=javabin&version=2
[junit4:junit4] 2> 2071092 T3453 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 2071101 T3455 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000002 message:{
[junit4:junit4] 2> "operation":"createcollection",
[junit4:junit4] 2> "numShards":"4",
[junit4:junit4] 2> "maxShardsPerNode":"5",
[junit4:junit4] 2> "createNodeSet":null,
[junit4:junit4] 2> "name":"awholynewcollection_0",
[junit4:junit4] 2> "replicationFactor":"5"}
[junit4:junit4] 2> 2071101 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica1 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:50363_wf_s
[junit4:junit4] 2> 2071102 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica2 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:50376_wf_s
[junit4:junit4] 2> 2071103 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica3 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:50373_wf_s
[junit4:junit4] 2> 2071103 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica4 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:50367_wf_s
[junit4:junit4] 2> 2071104 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica5 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:50370_wf_s
[junit4:junit4] 2> 2071105 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica1 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:50363_wf_s
[junit4:junit4] 2> 2071107 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica2 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:50376_wf_s
[junit4:junit4] 2> 2071112 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica3 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:50373_wf_s
[junit4:junit4] 2> 2071112 T3449 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/awholynewcollection_0_shard1_replica1
[junit4:junit4] 2> 2071132 T3449 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 2071129 T3446 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/awholynewcollection_0_shard2_replica1
[junit4:junit4] 2> 2071136 T3446 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 2071126 T3464 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica4' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/awholynewcollection_0_shard1_replica4
[junit4:junit4] 2> 2071138 T3464 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 2071139 T3449 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 2071140 T3449 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 2071125 T3477 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica5' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/awholynewcollection_0_shard1_replica5
[junit4:junit4] 2> 2071142 T3477 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 2071120 T3495 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica3' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/awholynewcollection_0_shard1_replica3
[junit4:junit4] 2> 2071144 T3495 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 2071119 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica4 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:50367_wf_s
[junit4:junit4] 2> 2071119 T3508 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica2' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/awholynewcollection_0_shard1_replica2
[junit4:junit4] 2> 2071147 T3508 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 2071143 T3464 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 2071142 T3446 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 2071155 T3446 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 2071135 T3509 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica2' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/awholynewcollection_0_shard2_replica2
[junit4:junit4] 2> 2071157 T3509 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 2071133 T3490 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica3' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/awholynewcollection_0_shard2_replica3
[junit4:junit4] 2> 2071160 T3490 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 2071154 T3464 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 2071154 T3477 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 2071153 T3462 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica4' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/awholynewcollection_0_shard2_replica4
[junit4:junit4] 2> 2071164 T3462 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 2071153 T3495 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 2071167 T3495 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 2071147 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica5 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:50370_wf_s
[junit4:junit4] 2> 2071168 T3490 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 2071170 T3490 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 2071176 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica1 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:50363_wf_s
[junit4:junit4] 2> 2071166 T3449 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 2071164 T3508 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 2071196 T3508 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 2071163 T3477 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 2071163 T3509 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 2071199 T3509 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 2071196 T3447 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/awholynewcollection_0_shard3_replica1
[junit4:junit4] 2> 2071201 T3447 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 2071195 T3449 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 2071185 T3480 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica5' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/awholynewcollection_0_shard2_replica5
[junit4:junit4] 2> 2071205 T3480 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 2071181 T3464 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 2071178 T3446 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 2071210 T3446 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 2071178 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica2 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:50376_wf_s
[junit4:junit4] 2> 2071170 T3462 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 2071214 T3462 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 2071214 T3490 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 2071208 T3464 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 2071200 T3495 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 2071222 T3504 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica2' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/awholynewcollection_0_shard3_replica2
[junit4:junit4] 2> 2071224 T3504 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 2071219 T3480 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 2071228 T3480 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 2071217 T3490 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 2071216 T3447 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 2071232 T3447 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 2071216 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica3 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:50373_wf_s
[junit4:junit4] 2> 2071235 T3509 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 2071237 T3509 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 2071235 T3477 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 2071243 T3477 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 2071227 T3508 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 2071223 T3495 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 2071245 T3508 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 2071243 T3493 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica3' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/awholynewcollection_0_shard3_replica3
[junit4:junit4] 2> 2071251 T3493 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 2071242 T3504 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 2071240 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica4 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:50367_wf_s
[junit4:junit4] 2> 2071253 T3504 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 2071258 T3462 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 2071259 T3462 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 2071264 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica5 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:50370_wf_s
[junit4:junit4] 2> 2071266 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica1 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:50363_wf_s
[junit4:junit4] 2> 2071275 T3480 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 2071281 T3480 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 2071274 T3446 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 2071272 T3466 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica4' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/awholynewcollection_0_shard3_replica4
[junit4:junit4] 2> 2071304 T3466 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 2071304 T3490 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 2071302 T3504 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 2071300 T3464 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 2071296 T3448 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica1' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/awholynewcollection_0_shard4_replica1
[junit4:junit4] 2> 2071311 T3448 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 2071280 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica2 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:50376_wf_s
[junit4:junit4] 2> 2071279 T3493 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 2071280 T3481 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica5' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/awholynewcollection_0_shard3_replica5
[junit4:junit4] 2> 2071317 T3481 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 2071316 T3493 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 2071314 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica3 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:50373_wf_s
[junit4:junit4] 2> 2071311 T3449 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 2071311 T3447 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 2071329 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica4 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:50367_wf_s
[junit4:junit4] 2> 2071328 T3508 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 2071326 T3477 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 2071326 T3466 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 2071357 T3466 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 2071358 T3464 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/awholynewcollection_0_shard1_replica4/'
[junit4:junit4] 2> 2071325 T3509 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 2071323 T3495 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 2071322 T3505 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica2' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/awholynewcollection_0_shard4_replica2
[junit4:junit4] 2> 2071368 T3505 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 2071356 T3447 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 2071356 T3465 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica4' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/awholynewcollection_0_shard4_replica4
[junit4:junit4] 2> 2071376 T3465 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 2071355 T3490 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/awholynewcollection_0_shard2_replica3/'
[junit4:junit4] 2> 2071355 T3448 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 2071414 T3448 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 2071349 T3455 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica5 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:50370_wf_s
[junit4:junit4] 2> 2071347 T3481 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 2071424 T3481 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 2071347 T3462 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 2071347 T3492 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica3' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/awholynewcollection_0_shard4_replica3
[junit4:junit4] 2> 2071431 T3492 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 2071431 T3476 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica5' using instanceDir: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/awholynewcollection_0_shard4_replica5
[junit4:junit4] 2> 2071434 T3476 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 2071438 T3480 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 2071443 T3465 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 2071444 T3465 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 2071444 T3504 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 2071448 T3446 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/awholynewcollection_0_shard2_replica1/'
[junit4:junit4] 2> 2071449 T3493 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/awholynewcollection_0_shard3_replica3/'
[junit4:junit4] 2> 2071464 T3476 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 2071466 T3476 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 2071468 T3466 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/awholynewcollection_0_shard3_replica4/'
[junit4:junit4] 2> 2071476 T3505 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 2071477 T3505 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 2071479 T3508 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/awholynewcollection_0_shard1_replica2/'
[junit4:junit4] 2> 2071500 T3492 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 2071501 T3492 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 2071528 T3481 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/awholynewcollection_0_shard3_replica5/'
[junit4:junit4] 2> 2071542 T3462 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/awholynewcollection_0_shard2_replica4/'
[junit4:junit4] 2> 2071543 T3465 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1369557288104/awholynewcollection_0_shard4_replica4/'
[junit4:junit4] 2> 2071542 T3477 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/awholynewcollection_0_shard1_replica5/'
[junit4:junit4] 2> 2071547 T3480 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/awholynewcollection_0_shard2_replica5/'
[junit4:junit4] 2> 2071553 T3509 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/awholynewcollection_0_shard2_replica2/'
[junit4:junit4] 2> 2071560 T3495 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/awholynewcollection_0_shard1_replica3/'
[junit4:junit4] 2> 2071567 T3449 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/awholynewcollection_0_shard1_replica1/'
[junit4:junit4] 2> 2071574 T3448 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/awholynewcollection_0_shard4_replica1/'
[junit4:junit4] 2> 2071614 T3476 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/awholynewcollection_0_shard4_replica5/'
[junit4:junit4] 2> 2071618 T3492 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/awholynewcollection_0_shard4_replica3/'
[junit4:junit4] 2> 2071623 T3504 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/awholynewcollection_0_shard3_replica2/'
[junit4:junit4] 2> 2071629 T3505 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/awholynewcollection_0_shard4_replica2/'
[junit4:junit4] 2> 2071629 T3447 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 2071673 T3447 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/awholynewcollection_0_shard3_replica1/'
[junit4:junit4] 2> 2072288 T3454 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2072314 T3454 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:50367_wf_s_nodes_used_collection_shard2_replica2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50367_wf_s",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50367/wf_s"}
[junit4:junit4] 2> 2072337 T3454 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:50373_wf_s_nodes_used_collection_shard1_replica1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50373_wf_s",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50373/wf_s"}
[junit4:junit4] 2> 2072389 T3454 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:50370_wf_s_nodes_used_collection_shard2_replica1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50370_wf_s",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50370/wf_s"}
[junit4:junit4] 2> 2072473 T3464 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 2072482 T3454 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:50363_wf_s_nodes_used_collection_shard1_replica2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50363_wf_s",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50363/wf_s"}
[junit4:junit4] 2> 2072534 T3480 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 2072537 T3476 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 2072595 T3530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2072603 T3471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2072605 T3458 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2072606 T3528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2072607 T3499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2072608 T3513 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2072606 T3485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2072617 T3453 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2072740 T3495 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 2072858 T3481 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 2072951 T3463 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:50370_wf_s_nodes_used_collection_shard2_replica1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 2072953 T3463 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:50370_wf_s_nodes_used_collection_shard2_replica1&state=recovering&nodeName=127.0.0.1:50370_wf_s&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard2_replica2&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2081
[junit4:junit4] 2> 2072976 T3466 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 2072979 T3491 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:50363_wf_s_nodes_used_collection_shard1_replica2, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 2072980 T3491 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:50363_wf_s_nodes_used_collection_shard1_replica2&state=recovering&nodeName=127.0.0.1:50363_wf_s&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard1_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2005
[junit4:junit4] 2> 2073161 T3493 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 2073270 T3462 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 2073338 T3447 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 2073541 T3504 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 2073565 T3490 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 2073566 T3509 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 2074033 T3449 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 2074275 T3505 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 2074595 T3465 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 2074700 T3446 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 2074885 T3448 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> ASYNC NEW_CORE C6318 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@7d7bc595 url=http://127.0.0.1:50370/wf_s/nodes_used_collection_shard2_replica1 node=127.0.0.1:50370_wf_s C6318_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:50370_wf_s, base_url=http://127.0.0.1:50370/wf_s}
[junit4:junit4] 2> 2074956 T3525 C6318 P50370 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:50367/wf_s/nodes_used_collection_shard2_replica2/ core=nodes_used_collection_shard2_replica1 - recoveringAfterStartup=true
[junit4:junit4] 2> 2074957 T3525 C6318 P50370 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica1 url=http://127.0.0.1:50370/wf_s START replicas=[http://127.0.0.1:50367/wf_s/nodes_used_collection_shard2_replica2/] nUpdates=100
[junit4:junit4] 2> 2074964 T3525 C6318 P50370 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 2074966 T3525 C6318 P50370 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 2074968 T3525 C6318 P50370 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 2074970 T3525 C6318 P50370 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 2074971 T3525 C6318 P50370 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 2074973 T3525 C6318 P50370 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:50367/wf_s/nodes_used_collection_shard2_replica2/. core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 2074980 T3525 C6318 P50370 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C6319 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@57303eeb url=http://127.0.0.1:50363/wf_s/nodes_used_collection_shard1_replica2 node=127.0.0.1:50363_wf_s C6319_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=recovering, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:50363_wf_s, base_url=http://127.0.0.1:50363/wf_s}
[junit4:junit4] 2> 2074984 T3526 C6319 P50363 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:50373/wf_s/nodes_used_collection_shard1_replica1/ core=nodes_used_collection_shard1_replica2 - recoveringAfterStartup=true
[junit4:junit4] 2> 2074985 T3526 C6319 P50363 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica2 url=http://127.0.0.1:50363/wf_s START replicas=[http://127.0.0.1:50373/wf_s/nodes_used_collection_shard1_replica1/] nUpdates=100
[junit4:junit4] 2> 2074990 T3526 C6319 P50363 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 2074991 T3526 C6319 P50363 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 2074996 T3526 C6319 P50363 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 2074997 T3526 C6319 P50363 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 2074997 T3526 C6319 P50363 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 2074998 T3526 C6319 P50363 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:50373/wf_s/nodes_used_collection_shard1_replica1/. core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 2074998 T3526 C6319 P50363 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C6320 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@1c4f94d5 url=http://127.0.0.1:50367/wf_s/nodes_used_collection_shard2_replica2 node=127.0.0.1:50367_wf_s C6320_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=active, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:50367_wf_s, base_url=http://127.0.0.1:50367/wf_s, leader=true}
[junit4:junit4] 2> 2075010 T3463 C6320 P50367 oasc.SolrCore.execute [nodes_used_collection_shard2_replica2] webapp=/wf_s path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=9
[junit4:junit4] 2> 2075021 T3495 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2075101 T3495 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2075137 T3495 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica3] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C6321 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@1c4f94d5 url=http://127.0.0.1:50367/wf_s/nodes_used_collection_shard2_replica2 node=127.0.0.1:50367_wf_s C6321_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=active, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:50367_wf_s, base_url=http://127.0.0.1:50367/wf_s, leader=true}
[junit4:junit4] 2> 2075196 T3467 C6321 P50367 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 2075225 T3508 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 2075252 T3467 C6321 P50367 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@321a9515 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c915046),segFN=segments_1,generation=1}
[junit4:junit4] 2> 2075259 T3467 C6321 P50367 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 2075262 T3467 C6321 P50367 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@321a9515 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c915046),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@321a9515 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6c915046),segFN=segments_2,generation=2}
[junit4:junit4] 2> 2075263 T3467 C6321 P50367 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 2075264 T3467 C6321 P50367 oass.SolrIndexSearcher.<init> Opening Searcher@5e443b9b realtime
[junit4:junit4] 2> 2075265 T3467 C6321 P50367 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 2075266 T3467 C6321 P50367 oasup.LogUpdateProcessor.finish [nodes_used_collection_shard2_replica2] webapp=/wf_s path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 70
[junit4:junit4] 2> ASYNC NEW_CORE C6322 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@7d7bc595 url=http://127.0.0.1:50370/wf_s/nodes_used_collection_shard2_replica1 node=127.0.0.1:50370_wf_s C6322_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:50370_wf_s, base_url=http://127.0.0.1:50370/wf_s}
[junit4:junit4] 2> 2075275 T3525 C6322 P50370 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 2075276 T3525 C6322 P50370 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> ASYNC NEW_CORE C6323 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@1c4f94d5 url=http://127.0.0.1:50367/wf_s/nodes_used_collection_shard2_replica2 node=127.0.0.1:50367_wf_s C6323_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=active, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:50367_wf_s, base_url=http://127.0.0.1:50367/wf_s, leader=true}
[junit4:junit4] 2> 2075326 T3467 C6323 P50367 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 2075327 T3467 C6323 P50367 oasc.SolrCore.execute [nodes_used_collection_shard2_replica2] webapp=/wf_s path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> ASYNC NEW_CORE C6324 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@7d7bc595 url=http://127.0.0.1:50370/wf_s/nodes_used_collection_shard2_replica1 node=127.0.0.1:50370_wf_s C6324_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:50370_wf_s, base_url=http://127.0.0.1:50370/wf_s}
[junit4:junit4] 2> 2075337 T3525 C6324 P50370 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 2075338 T3525 C6324 P50370 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 2075338 T3525 C6324 P50370 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 2075379 T3463 C6323 P50367 oasc.SolrCore.execute [nodes_used_collection_shard2_replica2] webapp=/wf_s path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=11
[junit4:junit4] 2> 2075382 T3525 C6324 P50370 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 2075456 T3492 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> ASYNC NEW_CORE C6325 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@7d7bc595 url=http://127.0.0.1:50370/wf_s/nodes_used_collection_shard2_replica1 node=127.0.0.1:50370_wf_s C6325_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:50370_wf_s, base_url=http://127.0.0.1:50370/wf_s}
[junit4:junit4] 2> 2075462 T3525 C6325 P50370 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/nodes_used_collection_shard2_replica1/data/index.20130526203509662
[junit4:junit4] 2> 2075462 T3525 C6325 P50370 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@53b1a8c3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@519d68e1) fullCopy=false
[junit4:junit4] 2> ASYNC NEW_CORE C6326 name=nodes_used_collection_shard2_replica2 org.apache.solr.core.SolrCore@1c4f94d5 url=http://127.0.0.1:50367/wf_s/nodes_used_collection_shard2_replica2 node=127.0.0.1:50367_wf_s C6326_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica2 props:{shard=shard2, state=active, core=nodes_used_collection_shard2_replica2, collection=nodes_used_collection, node_name=127.0.0.1:50367_wf_s, base_url=http://127.0.0.1:50367/wf_s, leader=true}
[junit4:junit4] 2> 2075492 T3467 C6326 P50367 oasc.SolrCore.execute [nodes_used_collection_shard2_replica2] webapp=/wf_s path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 2075632 T3476 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> ASYNC NEW_CORE C6327 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@7d7bc595 url=http://127.0.0.1:50370/wf_s/nodes_used_collection_shard2_replica1 node=127.0.0.1:50370_wf_s C6327_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:50370_wf_s, base_url=http://127.0.0.1:50370/wf_s}
[junit4:junit4] 2> 2075647 T3525 C6327 P50370 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 2075653 T3476 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2075662 T3525 C6327 P50370 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 2075663 T3525 C6327 P50370 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> ASYNC NEW_CORE C6328 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore@797bd1c url=http://127.0.0.1:50373/wf_s/nodes_used_collection_shard1_replica1 node=127.0.0.1:50373_wf_s C6328_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{shard=shard1, state=active, core=nodes_used_collection_shard1_replica1, collection=nodes_used_collection, node_name=127.0.0.1:50373_wf_s, base_url=http://127.0.0.1:50373/wf_s, leader=true}
[junit4:junit4] 2> 2075664 T3548 C6328 P50373 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp=/wf_s path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=39
[junit4:junit4] 2> 2075715 T3462 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2075744 T3462 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2075753 T3464 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2075759 T3480 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2075761 T3493 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2075771 T3464 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2075782 T3464 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica4] Schema name=test
[junit4:junit4] 2> 2075788 T3493 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2075772 T3480 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2075858 T3477 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 2075864 T3493 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica3] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C6329 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@7d7bc595 url=http://127.0.0.1:50370/wf_s/nodes_used_collection_shard2_replica1 node=127.0.0.1:50370_wf_s C6329_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:50370_wf_s, base_url=http://127.0.0.1:50370/wf_s}
[junit4:junit4] 2> 2075850 T3525 C6329 P50370 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@77eb09e8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@57a10e),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@77eb09e8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@57a10e),segFN=segments_2,generation=2}
[junit4:junit4] 2> 2075873 T3480 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica5] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C6330 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@7d7bc595 url=http://127.0.0.1:50370/wf_s/nodes_used_collection_shard2_replica1 node=127.0.0.1:50370_wf_s C6330_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=recovering, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:50370_wf_s, base_url=http://127.0.0.1:50370/wf_s}
[junit4:junit4] 2> 2075980 T3525 C6330 P50370 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 2075992 T3525 C6330 P50370 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 2075994 T3525 C6330 P50370 oass.SolrIndexSearcher.<init> Opening Searcher@8f58a2c main
[junit4:junit4] 2> 2075997 T3521 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica1] Registered new searcher Searcher@8f58a2c main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 2076005 T3525 C6330 P50370 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/nodes_used_collection_shard2_replica1/data/index.20130526203509662 [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/nodes_used_collection_shard2_replica1/data/index.20130526203509662;done=true>>]
[junit4:junit4] 2> 2076006 T3525 C6330 P50370 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/nodes_used_collection_shard2_replica1/data/index.20130526203509662
[junit4:junit4] 2> 2076007 T3525 C6330 P50370 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1369557290763/nodes_used_collection_shard2_replica1/data/index.20130526203509662
[junit4:junit4] 2> 2076007 T3525 C6330 P50370 oasc.RecoveryStrategy.replay No replay needed. core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 2076008 T3525 C6330 P50370 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 2076008 T3525 C6330 P50370 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=active
[junit4:junit4] 2> 2076013 T3525 C6330 P50370 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=nodes_used_collection_shard2_replica1
[junit4:junit4] 2> ASYNC NEW_CORE C6331 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore@797bd1c url=http://127.0.0.1:50373/wf_s/nodes_used_collection_shard1_replica1 node=127.0.0.1:50373_wf_s C6331_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{shard=shard1, state=active, core=nodes_used_collection_shard1_replica1, collection=nodes_used_collection, node_name=127.0.0.1:50373_wf_s, base_url=http://127.0.0.1:50373/wf_s, leader=true}
[junit4:junit4] 2> 2076041 T3491 C6331 P50373 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 2076044 T3462 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica4] Schema name=test
[junit4:junit4] 2> 2076051 T3476 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica5] Schema name=test
[junit4:junit4] 2> 2076064 T3504 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2076060 T3454 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2076091 T3504 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2076092 T3454 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:50370_wf_s_nodes_used_collection_shard2_replica1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50370_wf_s",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50370/wf_s"}
[junit4:junit4] 2> 2076152 T3504 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica2] Schema name=test
[junit4:junit4] 2> 2076154 T3491 C6331 P50373 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@25e72f55 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2a35c382),segFN=segments_1,generation=1}
[junit4:junit4] 2> 2076157 T3491 C6331 P50373 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 2076159 T3491 C6331 P50373 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@25e72f55 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2a35c382),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@25e72f55 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2a35c382),segFN=segments_2,generation=2}
[junit4:junit4] 2> 2076161 T3491 C6331 P50373 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 2076162 T3491 C6331 P50373 oass.SolrIndexSearcher.<init> Opening Searcher@70d6e9b9 realtime
[junit4:junit4] 2> 2076163 T3491 C6331 P50373 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 2076174 T3491 C6331 P50373 oasup.LogUpdateProcessor.finish [nodes_used_collection_shard1_replica1] webapp=/wf_s path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 133
[junit4:junit4] 2> ASYNC NEW_CORE C6332 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@57303eeb url=http://127.0.0.1:50363/wf_s/nodes_used_collection_shard1_replica2 node=127.0.0.1:50363_wf_s C6332_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=recovering, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:50363_wf_s, base_url=http://127.0.0.1:50363/wf_s}
[junit4:junit4] 2> 2076178 T3526 C6332 P50363 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 2076179 T3526 C6332 P50363 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 2076205 T3481 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2076233 T3481 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2076272 T3548 C6331 P50373 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 2076273 T3548 C6331 P50373 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp=/wf_s path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=4
[junit4:junit4] 2> ASYNC NEW_CORE C6333 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@57303eeb url=http://127.0.0.1:50363/wf_s/nodes_used_collection_shard1_replica2 node=127.0.0.1:50363_wf_s C6333_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=recovering, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:50363_wf_s, base_url=http://127.0.0.1:50363/wf_s}
[junit4:junit4] 2> 2076275 T3526 C6333 P50363 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 2076277 T3526 C6333 P50363 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 2076277 T3526 C6333 P50363 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 2076310 T3485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2076311 T3499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2076311 T3471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2076313 T3513 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2076312 T3458 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2076312 T3530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2076312 T3528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2076326 T3453 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2076332 T3491 C6331 P50373 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp=/wf_s path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=33
[junit4:junit4] 2> 2076334 T3526 C6333 P50363 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 2076388 T3526 C6333 P50363 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/nodes_used_collection_shard1_replica2/data/index.20130526203510615
[junit4:junit4] 2> 2076389 T3526 C6333 P50363 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@20a162a5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@13ae56a4) fullCopy=false
[junit4:junit4] 2> 2076457 T3548 C6331 P50373 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp=/wf_s path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=3
[junit4:junit4] 2> ASYNC NEW_CORE C6334 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@57303eeb url=http://127.0.0.1:50363/wf_s/nodes_used_collection_shard1_replica2 node=127.0.0.1:50363_wf_s C6334_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=recovering, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:50363_wf_s, base_url=http://127.0.0.1:50363/wf_s}
[junit4:junit4] 2> 2076472 T3526 C6334 P50363 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 2076474 T3526 C6334 P50363 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 2076474 T3526 C6334 P50363 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 2076479 T3526 C6334 P50363 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73de7ea4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1378ac90),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73de7ea4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1378ac90),segFN=segments_2,generation=2}
[junit4:junit4] 2> 2076506 T3526 C6334 P50363 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 2076506 T3526 C6334 P50363 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 2076507 T3526 C6334 P50363 oass.SolrIndexSearcher.<init> Opening Searcher@65457e63 main
[junit4:junit4] 2> 2076509 T3522 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica2] Registered new searcher Searcher@65457e63 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 2076510 T3526 C6334 P50363 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/nodes_used_collection_shard1_replica2/data/index.20130526203510615 [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/nodes_used_collection_shard1_replica2/data/index.20130526203510615;done=true>>]
[junit4:junit4] 2> 2076511 T3526 C6334 P50363 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/nodes_used_collection_shard1_replica2/data/index.20130526203510615
[junit4:junit4] 2> ASYNC NEW_CORE C6335 name=nodes_used_collection_shard1_replica2 org.apache.solr.core.SolrCore@57303eeb url=http://127.0.0.1:50363/wf_s/nodes_used_collection_shard1_replica2 node=127.0.0.1:50363_wf_s C6335_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica2 props:{shard=shard1, state=recovering, core=nodes_used_collection_shard1_replica2, collection=nodes_used_collection, node_name=127.0.0.1:50363_wf_s, base_url=http://127.0.0.1:50363/wf_s}
[junit4:junit4] 2> 2076529 T3526 C6335 P50363 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1369557286576/nodes_used_collection_shard1_replica2/data/index.20130526203510615
[junit4:junit4] 2> 2076576 T3526 C6335 P50363 oasc.RecoveryStrategy.replay No replay needed. core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 2076577 T3526 C6335 P50363 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 2076577 T3526 C6335 P50363 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=active
[junit4:junit4] 2> 2076602 T3526 C6335 P50363 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 2076745 T3481 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica5] Schema name=test
[junit4:junit4] 2> 2076746 T3466 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2076760 T3466 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2076761 T3509 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2076814 T3490 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2076815 T3509 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2076846 T3490 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2076856 T3509 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica2] Schema name=test
[junit4:junit4] 2> 2076889 T3490 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica3] Schema name=test
[junit4:junit4] 2> 2077119 T3447 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2077142 T3505 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2077144 T3447 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2077163 T3505 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2077204 T3446 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2077274 T3466 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica4] Schema name=test
[junit4:junit4] 2> 2077278 T3449 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2077288 T3446 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2077292 T3449 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2077298 T3446 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica1] Schema name=test
[junit4:junit4] 2> 2077322 T3449 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica1] Schema name=test
[junit4:junit4] 2> 2077405 T3505 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica2] Schema name=test
[junit4:junit4] 2> 2077647 T3447 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica1] Schema name=test
[junit4:junit4] 2> 2077993 T3454 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2077998 T3454 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:50363_wf_s_nodes_used_collection_shard1_replica2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50363_wf_s",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50363/wf_s"}
[junit4:junit4] 2> 2078047 T3492 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2078052 T3471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2078053 T3485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2078054 T3530 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2078054 T3528 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2078056 T3513 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2078057 T3499 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2078054 T3458 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2078088 T3492 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2078089 T3453 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 2078226 T3492 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica3] Schema name=test
[junit4:junit4] 2> 2078480 T3465 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2078491 T3465 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2078507 T3465 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica4] Schema name=test
[junit4:junit4] 2> 2078637 T3508 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2078737 T3508 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2078771 T3508 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica2] Schema name=test
[junit4:junit4] 2> 2079058 T3477 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2079112 T3477 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2079176 T3448 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2079328 T3448 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 2079394 T3477 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica5] Schema name=test
[junit4:junit4] 2> 2079726 T3448 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica1] Schema name=test
[junit4:junit4] 2> 2100180 T3504 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 2100260 T3504 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 2100266 T3504 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 2100476 T3493 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 2100634 T3493 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 2100642 T3493 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 2100846 T3508 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 2100937 T3504 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2100980 T3508 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 2100986 T3508 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 2100991 T3493 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2101021 T3493 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2101073 T3493 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2101087 T3504 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2101089 T3493 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 2101096 T3493 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 2101094 T3478 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=4&maxShardsPerNode=5&name=awholynewcollection_0&replicationFactor=5&action=CREATE&wt=javabin&version=2
[junit4:junit4] 2> 2101099 T3493 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2101102 T3453 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 2101117 T3493 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 2101117 T3493 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 2101118 T3493 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 2101119 T3493 oasc.SolrCore.<init> [awholynewcollection_0_shard3_replica3] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/awholynewcollection_0_shard3_replica3/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/awholynewcollection_0_shard3_replica3/data/
[junit4:junit4] 2> 2101120 T3493 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@27c2792c
[junit4:junit4] 2> 2101120 T3493 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 2101126 T3480 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 2101132 T3493 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/awholynewcollection_0_shard3_replica3/data
[junit4:junit4] 2> 2101133 T3493 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/awholynewcollection_0_shard3_replica3/data/index/
[junit4:junit4] 2> 2101133 T3493 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard3_replica3] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/awholynewcollection_0_shard3_replica3/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 2101165 T3493 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1369557293203/awholynewcollection_0_shard3_replica3/data/index
[junit4:junit4] 2> 2101187 T3504 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2101211 T3504 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 2101212 T3504 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 2101213 T3504 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2101260 T3493 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6b3ebe7b lockFactory=org.apache.lucene.store.NativeFSLockFactory@45602368),segFN=segments_1,generation=1}
[junit4:junit4] 2> 2101261 T3493 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 2101277 T3447 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 2101279 T3449 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 2101281 T3504 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 2101282 T3504 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 2101282 T3504 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 2101283 T3504 oasc.SolrCore.<init> [awholynewcollection_0_shard3_replica2] Opening new SolrCore at /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/awholynewcollection_0_shard3_replica2/, dataDir=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/awholynewcollection_0_shard3_replica2/data/
[junit4:junit4] 2> 2101284 T3504 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@27c2792c
[junit4:junit4] 2> 2101285 T3504 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 2101296 T3504 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/awholynewcollection_0_shard3_replica2/data
[junit4:junit4] 2> 2101308 T3504 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/awholynewcollection_0_shard3_replica2/data/index/
[junit4:junit4] 2> 2101309 T3504 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard3_replica2] Solr index directory '/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/awholynewcollection_0_shard3_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 2101322 T3462 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 2101327 T3504 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/awholynewcollection_0_shard3_replica2/data/index
[junit4:junit4] 2> 21
[...truncated too long message...]
seSearcher [awholynewcollection_0_shard1_replica2] Closing main searcher on request.
[junit4:junit4] 2> 2122368 T3431 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 2122369 T3431 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/awholynewcollection_0_shard1_replica2/data [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/awholynewcollection_0_shard1_replica2/data;done=false>>]
[junit4:junit4] 2> 2122370 T3431 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/awholynewcollection_0_shard1_replica2/data
[junit4:junit4] 2> 2122371 T3431 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/awholynewcollection_0_shard1_replica2/data/index [CachedDir<<refCount=0;path=/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/awholynewcollection_0_shard1_replica2/data/index;done=false>>]
[junit4:junit4] 2> 2122372 T3431 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1369557295386/awholynewcollection_0_shard1_replica2/data/index
[junit4:junit4] 2> 2122374 T3657 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89755306313842700-127.0.0.1:50376_wf_s-n_0000000004) am no longer a leader.
[junit4:junit4] 2> 2122406 T3431 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/wf_s,null}
[junit4:junit4] 2> 2122470 T3431 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 2122478 T3431 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:50360 50360
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=582ED054AA4ACC29 -Dtests.slow=true -Dtests.locale=ca -Dtests.timezone=Pacific/Majuro -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR 70.6s | CollectionsAPIDistributedZkTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: collection already exists: awholynewcollection_0
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([582ED054AA4ACC29:D9C85E4CDD15AC15]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:424)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:264)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:306)
[junit4:junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1400)
[junit4:junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:438)
[junit4:junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:146)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 2122550 T3431 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 70598 T3430 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> 2123689 T3513 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 2123690 T3513 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2123690 T3513 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Lucene41, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=ca, timezone=Pacific/Majuro
[junit4:junit4] 2> NOTE: Mac OS X 10.8.3 x86_64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=2,threads=3,free=120490280,total=267866112
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestStressRecovery, BasicZkTest, TestExtendedDismaxParser, StatsComponentTest, TestFieldResource, PolyFieldTest, TestWriterPerf, ChaosMonkeyShardSplitTest, TestCoreDiscovery, TestCollationField, LeaderElectionTest, TestCSVResponseWriter, AlternateDirectoryTest, MultiTermTest, TestSolrIndexConfig, EchoParamsTest, StandardRequestHandlerTest, DistributedSpellCheckComponentTest, AliasIntegrationTest, TestHashPartitioner, TestPhraseSuggestions, TestMaxScoreQueryParser, FastVectorHighlighterTest, FieldAnalysisRequestHandlerTest, NotRequiredUniqueKeyTest, TestSolrQueryParserResource, ClusterStateTest, CircularListTest, TestLuceneMatchVersion, SuggesterTest, TestMultiCoreConfBootstrap, TestCopyFieldCollectionResource, URLClassifyProcessorTest, SolrRequestParserTest, UUIDFieldTest, IndexBasedSpellCheckerTest, TestDistributedGrouping, DateMathParserTest, TestCodecSupport, StatelessScriptUpdateProcessorFactoryTest, TestDefaultSearchFieldResource, TestPHPSerializedResponseWriter, TestReload, NoCacheHeaderTest, LeaderElectionIntegrationTest, ZkSolrClientTest, SchemaVersionSpecificBehaviorTest, TestSort, TestPluginEnable, DefaultValueUpdateProcessorTest, TestRangeQuery, NumericFieldsTest, SoftAutoCommitTest, TestElisionMultitermQuery, TestQuerySenderListener, TestRTGBase, SolrCmdDistributorTest, SpatialFilterTest, HighlighterConfigTest, TestPseudoReturnFields, TestFieldCollectionResource, ExternalFileFieldSortTest, TestDynamicFieldCollectionResource, MBeansHandlerTest, PingRequestHandlerTest, SpellCheckCollatorTest, SolrCoreCheckLockOnStartupTest, TestConfig, TestReversedWildcardFilterFactory, RAMDirectoryFactoryTest, TestXIncludeConfig, OutputWriterTest, TestPropInjectDefaults, TestLRUCache, TestNumberUtils, TimeZoneUtilsTest, LegacyHTMLStripCharFilterTest, TestPropInject, SystemInfoHandlerTest, TestPostingsSolrHighlighter, TestAddFieldRealTimeGet, DirectUpdateHandlerOptimizeTest, ChaosMonkeySafeLeaderTest, TestFastLRUCache, ShardRoutingCustomTest, OpenCloseCoreStressTest, PrimitiveFieldTypeTest, TestCSVLoader, ConvertedLegacyTest, DistributedQueryElevationComponentTest, CoreContainerCoreInitFailuresTest, TestSolrCoreProperties, SpellPossibilityIteratorTest, TestPerFieldSimilarity, DOMUtilTest, SolrTestCaseJ4Test, MinimalSchemaTest, TestLMJelinekMercerSimilarityFactory, IndexSchemaRuntimeFieldTest, TestBM25SimilarityFactory, TestUniqueKeyFieldResource, TestDynamicFieldResource, TestSchemaNameResource, SuggesterWFSTTest, TestDFRSimilarityFactory, ZkNodePropsTest, TestFiltering, BasicDistributedZk2Test, PluginInfoTest, IndexReaderFactoryTest, TestSearchPerf, TestIBSimilarityFactory, RequiredFieldsTest, TestWordDelimiterFilterFactory, DocumentBuilderTest, BasicFunctionalityTest, TestSolrDeletionPolicy1, SolrInfoMBeanTest, ResourceLoaderTest, SuggesterTSTTest, OverseerCollectionProcessorTest, AnalysisAfterCoreReloadTest, ZkControllerTest, ZkCLITest, ReturnFieldsTest, TestOmitPositions, ResponseLogComponentTest, TestSweetSpotSimilarityFactory, DirectSolrSpellCheckerTest, ScriptEngineTest, DistributedTermsComponentTest, TestSerializedLuceneMatchVersion, SpellingQueryConverterTest, TermsComponentTest, QueryEqualityTest, TestDefaultSimilarityFactory, SimpleFacetsTest, CSVRequestHandlerTest, TestFieldTypeCollectionResource, TestSolrXMLSerializer, TestJmxMonitoredMap, CoreAdminHandlerTest, HardAutoCommitTest, BasicDistributedZkTest, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest]
[junit4:junit4] Completed in 71.98s, 1 test, 1 error <<< FAILURES!
[...truncated 451 lines...]
BUILD FAILED
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:380: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:360: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:181: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:437: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1240: The following error occurred while executing this line:
/Users/jenkins/jenkins-slave/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:884: There were test failures: 295 suites, 1231 tests, 1 error, 18 ignored (6 assumptions)
Total time: 107 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure