You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/05/19 11:45:42 UTC
[JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3998 - Still
Failing
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3998/
1 tests failed.
REGRESSION: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:60887 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:60887 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([51CC87C365F5FFBD:D02A09DB12AA9F81]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9991 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4:junit4] 2> 1422828 T3697 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 1422833 T3697 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./solrtest-ShardSplitTest-1368956564901
[junit4:junit4] 2> 1422834 T3697 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 1422835 T3698 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 1422936 T3697 oasc.ZkTestServer.run start zk server on port:60877
[junit4:junit4] 2> 1422937 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1422941 T3704 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@420f42a1 name:ZooKeeperConnection Watcher:127.0.0.1:60877 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1422941 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1422941 T3697 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 1422957 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1422959 T3706 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6cfad7bb name:ZooKeeperConnection Watcher:127.0.0.1:60877/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1422959 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1422960 T3697 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 1422970 T3697 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 1422974 T3697 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 1422977 T3697 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 1422985 T3697 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1422986 T3697 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1423000 T3697 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 1423001 T3697 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 1423105 T3697 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1423106 T3697 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1423109 T3697 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 1423110 T3697 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 1423113 T3697 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 1423114 T3697 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 1423117 T3697 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1423118 T3697 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1423121 T3697 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1423121 T3697 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1423124 T3697 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1423125 T3697 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1423133 T3697 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1423134 T3697 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1423348 T3697 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1423354 T3697 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60880
[junit4:junit4] 2> 1423355 T3697 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1423356 T3697 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1423356 T3697 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368956565204
[junit4:junit4] 2> 1423357 T3697 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368956565204/solr.xml
[junit4:junit4] 2> 1423357 T3697 oasc.CoreContainer.<init> New CoreContainer 1073431746
[junit4:junit4] 2> 1423358 T3697 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368956565204/'
[junit4:junit4] 2> 1423359 T3697 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368956565204/'
[junit4:junit4] 2> 1423477 T3697 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1423478 T3697 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1423479 T3697 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1423480 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1423480 T3697 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1423481 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1423481 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1423482 T3697 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1423482 T3697 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1423483 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1423499 T3697 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1423500 T3697 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60877/solr
[junit4:junit4] 2> 1423500 T3697 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1423501 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1423504 T3717 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9f58c51 name:ZooKeeperConnection Watcher:127.0.0.1:60877 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1423505 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1423507 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1423519 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1423521 T3719 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48e329e2 name:ZooKeeperConnection Watcher:127.0.0.1:60877/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1423521 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1423523 T3697 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 1423533 T3697 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 1423536 T3697 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 1423544 T3697 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60880_
[junit4:junit4] 2> 1423545 T3697 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60880_
[junit4:junit4] 2> 1423549 T3697 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 1423565 T3697 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 1423568 T3697 oasc.Overseer.start Overseer (id=89715937437745155-127.0.0.1:60880_-n_0000000000) starting
[junit4:junit4] 2> 1423578 T3697 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 1423588 T3721 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 1423589 T3697 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 1423591 T3697 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 1423599 T3697 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1423601 T3720 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 1423606 T3722 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368956565204/collection1
[junit4:junit4] 2> 1423606 T3722 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 1423607 T3722 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1423607 T3722 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 1423608 T3722 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368956565204/collection1/'
[junit4:junit4] 2> 1423610 T3722 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-controljetty-1368956565204/collection1/lib/README' to classloader
[junit4:junit4] 2> 1423610 T3722 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-controljetty-1368956565204/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1423663 T3722 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1423728 T3722 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1423829 T3722 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1423835 T3722 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1424434 T3722 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1424438 T3722 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1424441 T3722 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1424446 T3722 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1424468 T3722 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1424469 T3722 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368956565204/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368956564901/control/data/
[junit4:junit4] 2> 1424469 T3722 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b29b889
[junit4:junit4] 2> 1424470 T3722 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1424470 T3722 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/control/data
[junit4:junit4] 2> 1424471 T3722 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368956564901/control/data/index/
[junit4:junit4] 2> 1424471 T3722 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368956564901/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1424472 T3722 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/control/data/index
[junit4:junit4] 2> 1424475 T3722 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@57cfb4c6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@38690cf3),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1424476 T3722 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1424479 T3722 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1424479 T3722 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1424480 T3722 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1424480 T3722 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1424481 T3722 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1424481 T3722 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1424482 T3722 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1424482 T3722 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1424483 T3722 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1424495 T3722 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1424502 T3722 oass.SolrIndexSearcher.<init> Opening Searcher@6665eff main
[junit4:junit4] 2> 1424502 T3722 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368956564901/control/data/tlog
[junit4:junit4] 2> 1424503 T3722 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1424503 T3722 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1424507 T3723 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6665eff main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1424509 T3722 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1424509 T3722 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1425104 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1425105 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60880_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60880"}
[junit4:junit4] 2> 1425105 T3720 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1425106 T3720 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1425120 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1425511 T3722 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1425511 T3722 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60880 collection:control_collection shard:shard1
[junit4:junit4] 2> 1425512 T3722 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 1425530 T3722 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1425540 T3722 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1425540 T3722 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1425541 T3722 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60880/collection1/
[junit4:junit4] 2> 1425541 T3722 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1425541 T3722 oasc.SyncStrategy.syncToMe http://127.0.0.1:60880/collection1/ has no replicas
[junit4:junit4] 2> 1425542 T3722 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60880/collection1/
[junit4:junit4] 2> 1425542 T3722 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 1426623 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1426643 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1426670 T3722 oasc.ZkController.register We are http://127.0.0.1:60880/collection1/ and leader is http://127.0.0.1:60880/collection1/
[junit4:junit4] 2> 1426670 T3722 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60880
[junit4:junit4] 2> 1426670 T3722 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1426671 T3722 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1426671 T3722 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1426673 T3722 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1426674 T3697 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1426675 T3697 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1426675 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1426689 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 1426691 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1426693 T3726 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@509e4f6d name:ZooKeeperConnection Watcher:127.0.0.1:60877/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1426693 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1426695 T3697 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1426697 T3697 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 1426908 T3697 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1426913 T3697 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60887
[junit4:junit4] 2> 1426914 T3697 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1426914 T3697 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1426915 T3697 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368956568764
[junit4:junit4] 2> 1426915 T3697 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368956568764/solr.xml
[junit4:junit4] 2> 1426916 T3697 oasc.CoreContainer.<init> New CoreContainer 268109419
[junit4:junit4] 2> 1426917 T3697 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368956568764/'
[junit4:junit4] 2> 1426917 T3697 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368956568764/'
[junit4:junit4] 2> 1427036 T3697 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1427037 T3697 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1427038 T3697 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1427038 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1427039 T3697 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1427039 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1427040 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1427040 T3697 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1427041 T3697 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1427042 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1427056 T3697 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1427056 T3697 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60877/solr
[junit4:junit4] 2> 1427057 T3697 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1427058 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1427062 T3737 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@249a97b name:ZooKeeperConnection Watcher:127.0.0.1:60877 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1427062 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1427079 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1427090 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1427092 T3739 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@34d0434c name:ZooKeeperConnection Watcher:127.0.0.1:60877/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1427092 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1427103 T3697 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1428106 T3697 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60887_
[junit4:junit4] 2> 1428109 T3697 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60887_
[junit4:junit4] 2> 1428111 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1428112 T3739 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1428112 T3726 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1428126 T3719 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1428133 T3740 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368956568764/collection1
[junit4:junit4] 2> 1428133 T3740 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1428134 T3740 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1428134 T3740 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1428136 T3740 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368956568764/collection1/'
[junit4:junit4] 2> 1428137 T3740 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty1-1368956568764/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1428138 T3740 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty1-1368956568764/collection1/lib/README' to classloader
[junit4:junit4] 2> 1428157 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1428158 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:60880__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60880_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60880"}
[junit4:junit4] 2> 1428163 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1428164 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1428164 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1428192 T3740 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1428255 T3740 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1428356 T3740 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1428362 T3740 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1428888 T3740 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1428891 T3740 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1428892 T3740 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1428896 T3740 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1428912 T3740 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1428913 T3740 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368956568764/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty1/
[junit4:junit4] 2> 1428913 T3740 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b29b889
[junit4:junit4] 2> 1428913 T3740 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1428914 T3740 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty1
[junit4:junit4] 2> 1428914 T3740 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty1/index/
[junit4:junit4] 2> 1428914 T3740 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1428915 T3740 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty1/index
[junit4:junit4] 2> 1428917 T3740 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2b8b6aec lockFactory=org.apache.lucene.store.NativeFSLockFactory@249f3e5d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1428917 T3740 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1428919 T3740 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1428920 T3740 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1428920 T3740 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1428921 T3740 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1428921 T3740 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1428921 T3740 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1428922 T3740 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1428922 T3740 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1428922 T3740 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1428931 T3740 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1428935 T3740 oass.SolrIndexSearcher.<init> Opening Searcher@3d0d7fbb main
[junit4:junit4] 2> 1428935 T3740 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty1/tlog
[junit4:junit4] 2> 1428936 T3740 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1428936 T3740 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1428939 T3741 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3d0d7fbb main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1428941 T3740 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1428941 T3740 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1429678 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1429679 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60887_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60887"}
[junit4:junit4] 2> 1429679 T3720 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 1429680 T3720 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1429684 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1429684 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1429684 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1429970 T3740 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1429970 T3740 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60887 collection:collection1 shard:shard1
[junit4:junit4] 2> 1429971 T3740 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 1429990 T3740 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1429993 T3740 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1429994 T3740 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1429994 T3740 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60887/collection1/
[junit4:junit4] 2> 1429994 T3740 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1429995 T3740 oasc.SyncStrategy.syncToMe http://127.0.0.1:60887/collection1/ has no replicas
[junit4:junit4] 2> 1429995 T3740 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60887/collection1/
[junit4:junit4] 2> 1429995 T3740 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1431200 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1431242 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1431242 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1431242 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1431328 T3740 oasc.ZkController.register We are http://127.0.0.1:60887/collection1/ and leader is http://127.0.0.1:60887/collection1/
[junit4:junit4] 2> 1431328 T3740 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60887
[junit4:junit4] 2> 1431328 T3740 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1431329 T3740 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1431329 T3740 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1431331 T3740 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1431332 T3697 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1431333 T3697 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1431333 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1431559 T3697 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1431563 T3697 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60894
[junit4:junit4] 2> 1431564 T3697 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1431565 T3697 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1431565 T3697 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368956573414
[junit4:junit4] 2> 1431566 T3697 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368956573414/solr.xml
[junit4:junit4] 2> 1431566 T3697 oasc.CoreContainer.<init> New CoreContainer 1094803956
[junit4:junit4] 2> 1431567 T3697 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368956573414/'
[junit4:junit4] 2> 1431568 T3697 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368956573414/'
[junit4:junit4] 2> 1431685 T3697 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1431686 T3697 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1431687 T3697 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1431688 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1431688 T3697 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1431689 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1431689 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1431690 T3697 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1431690 T3697 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1431691 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1431705 T3697 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1431706 T3697 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60877/solr
[junit4:junit4] 2> 1431706 T3697 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1431708 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1431712 T3753 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e0db1f7 name:ZooKeeperConnection Watcher:127.0.0.1:60877 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1431713 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1431732 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1431742 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1431744 T3755 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@178cdef7 name:ZooKeeperConnection Watcher:127.0.0.1:60877/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1431744 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1431753 T3697 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1432757 T3697 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60894_
[junit4:junit4] 2> 1432771 T3697 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60894_
[junit4:junit4] 2> 1432785 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1432786 T3755 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1432785 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1432785 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1432788 T3719 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1432788 T3739 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1432788 T3726 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1432793 T3756 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368956573414/collection1
[junit4:junit4] 2> 1432794 T3756 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1432794 T3756 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1432795 T3756 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1432796 T3756 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368956573414/collection1/'
[junit4:junit4] 2> 1432797 T3756 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty2-1368956573414/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1432798 T3756 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty2-1368956573414/collection1/lib/README' to classloader
[junit4:junit4] 2> 1432807 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1432808 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:60887__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60887_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60887"}
[junit4:junit4] 2> 1432821 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1432821 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1432821 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1432821 T3755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1432853 T3756 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1432915 T3756 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1433016 T3756 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1433022 T3756 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1433621 T3756 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1433625 T3756 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1433628 T3756 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1433633 T3756 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1433654 T3756 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1433655 T3756 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368956573414/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty2/
[junit4:junit4] 2> 1433655 T3756 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b29b889
[junit4:junit4] 2> 1433655 T3756 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1433656 T3756 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty2
[junit4:junit4] 2> 1433657 T3756 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty2/index/
[junit4:junit4] 2> 1433657 T3756 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1433657 T3756 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty2/index
[junit4:junit4] 2> 1433660 T3756 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@34aeb9d7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d779f92),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1433661 T3756 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1433664 T3756 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1433664 T3756 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1433665 T3756 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1433666 T3756 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1433666 T3756 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1433667 T3756 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1433667 T3756 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1433668 T3756 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1433668 T3756 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1433681 T3756 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1433687 T3756 oass.SolrIndexSearcher.<init> Opening Searcher@6d1ac52d main
[junit4:junit4] 2> 1433688 T3756 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty2/tlog
[junit4:junit4] 2> 1433689 T3756 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1433689 T3756 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1433694 T3757 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6d1ac52d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1433696 T3756 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1433696 T3756 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1434325 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1434326 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60894_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60894"}
[junit4:junit4] 2> 1434326 T3720 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1434327 T3720 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1434426 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1434426 T3755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1434426 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1434426 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1434699 T3756 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1434699 T3756 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60894 collection:collection1 shard:shard2
[junit4:junit4] 2> 1434700 T3756 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 1434718 T3756 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1434722 T3756 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1434722 T3756 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1434722 T3756 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60894/collection1/
[junit4:junit4] 2> 1434722 T3756 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1434723 T3756 oasc.SyncStrategy.syncToMe http://127.0.0.1:60894/collection1/ has no replicas
[junit4:junit4] 2> 1434723 T3756 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60894/collection1/
[junit4:junit4] 2> 1434723 T3756 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 1435931 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1435954 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1435955 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1435955 T3755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1435955 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1435961 T3756 oasc.ZkController.register We are http://127.0.0.1:60894/collection1/ and leader is http://127.0.0.1:60894/collection1/
[junit4:junit4] 2> 1435961 T3756 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60894
[junit4:junit4] 2> 1435961 T3756 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1435962 T3756 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1435962 T3756 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1435964 T3756 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1435965 T3697 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1435966 T3697 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1435967 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1436206 T3697 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1436210 T3697 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:48732
[junit4:junit4] 2> 1436211 T3697 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1436211 T3697 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1436212 T3697 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368956578048
[junit4:junit4] 2> 1436212 T3697 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368956578048/solr.xml
[junit4:junit4] 2> 1436213 T3697 oasc.CoreContainer.<init> New CoreContainer 1827383621
[junit4:junit4] 2> 1436214 T3697 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368956578048/'
[junit4:junit4] 2> 1436214 T3697 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368956578048/'
[junit4:junit4] 2> 1436334 T3697 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1436335 T3697 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1436336 T3697 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1436336 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1436337 T3697 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1436337 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1436338 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1436339 T3697 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1436339 T3697 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1436340 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1436354 T3697 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1436355 T3697 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60877/solr
[junit4:junit4] 2> 1436355 T3697 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1436357 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1436386 T3769 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6c52bf33 name:ZooKeeperConnection Watcher:127.0.0.1:60877 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1436387 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1436423 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1436435 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1436444 T3771 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d949ad5 name:ZooKeeperConnection Watcher:127.0.0.1:60877/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1436445 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1436450 T3697 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1437453 T3697 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48732_
[junit4:junit4] 2> 1437457 T3697 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48732_
[junit4:junit4] 2> 1437459 T3755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1437459 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1437460 T3771 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1437459 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1437459 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1437461 T3755 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1437471 T3739 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1437472 T3719 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1437472 T3726 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1437474 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1437474 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:60894__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60894_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60894"}
[junit4:junit4] 2> 1437480 T3772 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368956578048/collection1
[junit4:junit4] 2> 1437480 T3772 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1437486 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1437486 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1437487 T3755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1437486 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1437486 T3772 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1437486 T3771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1437488 T3772 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1437490 T3772 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368956578048/collection1/'
[junit4:junit4] 2> 1437492 T3772 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty3-1368956578048/collection1/lib/README' to classloader
[junit4:junit4] 2> 1437493 T3772 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty3-1368956578048/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1437552 T3772 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1437622 T3772 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1437723 T3772 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1437730 T3772 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1438313 T3772 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1438317 T3772 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1438320 T3772 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1438325 T3772 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1438347 T3772 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1438348 T3772 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368956578048/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty3/
[junit4:junit4] 2> 1438348 T3772 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b29b889
[junit4:junit4] 2> 1438349 T3772 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1438349 T3772 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty3
[junit4:junit4] 2> 1438350 T3772 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty3/index/
[junit4:junit4] 2> 1438350 T3772 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1438351 T3772 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty3/index
[junit4:junit4] 2> 1438353 T3772 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@76357127 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7785d2f4),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1438354 T3772 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1438357 T3772 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1438357 T3772 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1438358 T3772 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1438358 T3772 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1438359 T3772 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1438359 T3772 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1438360 T3772 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1438360 T3772 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1438361 T3772 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1438373 T3772 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1438379 T3772 oass.SolrIndexSearcher.<init> Opening Searcher@138e826d main
[junit4:junit4] 2> 1438379 T3772 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty3/tlog
[junit4:junit4] 2> 1438380 T3772 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1438381 T3772 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1438384 T3773 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@138e826d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1438386 T3772 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1438386 T3772 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1438990 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1438991 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:48732_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:48732"}
[junit4:junit4] 2> 1438991 T3720 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1438992 T3720 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1439005 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1439005 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1439005 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1439005 T3771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1439005 T3755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1439389 T3772 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1439389 T3772 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:48732 collection:collection1 shard:shard1
[junit4:junit4] 2> 1439393 T3772 oasc.ZkController.register We are http://127.0.0.1:48732/collection1/ and leader is http://127.0.0.1:60887/collection1/
[junit4:junit4] 2> 1439393 T3772 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48732
[junit4:junit4] 2> 1439393 T3772 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1439393 T3772 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C247 name=collection1 org.apache.solr.core.SolrCore@39b4f2e5 url=http://127.0.0.1:48732/collection1 node=127.0.0.1:48732_ C247_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:48732_, base_url=http://127.0.0.1:48732}
[junit4:junit4] 2> 1439394 T3774 C247 P48732 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1439394 T3772 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1439396 T3774 C247 P48732 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1439396 T3774 C247 P48732 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1439396 T3774 C247 P48732 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1439397 T3697 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1439398 T3697 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1439398 T3774 C247 P48732 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1439398 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1439420 T3729 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:48732__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1439634 T3697 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1439637 T3697 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:33065
[junit4:junit4] 2> 1439638 T3697 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1439639 T3697 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1439639 T3697 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368956581486
[junit4:junit4] 2> 1439640 T3697 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368956581486/solr.xml
[junit4:junit4] 2> 1439640 T3697 oasc.CoreContainer.<init> New CoreContainer 298187213
[junit4:junit4] 2> 1439641 T3697 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368956581486/'
[junit4:junit4] 2> 1439642 T3697 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368956581486/'
[junit4:junit4] 2> 1439761 T3697 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1439762 T3697 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1439763 T3697 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1439763 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1439764 T3697 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1439764 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1439765 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1439766 T3697 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1439766 T3697 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1439767 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1439781 T3697 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1439782 T3697 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60877/solr
[junit4:junit4] 2> 1439782 T3697 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1439783 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1439786 T3786 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e41a6aa name:ZooKeeperConnection Watcher:127.0.0.1:60877 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1439787 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1439789 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1439799 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1439801 T3788 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5a265e17 name:ZooKeeperConnection Watcher:127.0.0.1:60877/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1439801 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1439813 T3697 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1440509 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1440510 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:48732__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:48732_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:48732"}
[junit4:junit4] 2> 1440523 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1440523 T3755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1440523 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1440523 T3771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1440523 T3788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1440523 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1440816 T3697 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33065_
[junit4:junit4] 2> 1440818 T3697 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33065_
[junit4:junit4] 2> 1440821 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1440821 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1440821 T3788 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1440821 T3755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1440821 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1440821 T3771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1440821 T3788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1440823 T3726 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1440830 T3719 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1440830 T3755 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1440831 T3739 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1440831 T3771 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1440837 T3789 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368956581486/collection1
[junit4:junit4] 2> 1440837 T3789 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1440838 T3789 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1440838 T3789 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1440839 T3789 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368956581486/collection1/'
[junit4:junit4] 2> 1440841 T3789 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty4-1368956581486/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1440841 T3789 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty4-1368956581486/collection1/lib/README' to classloader
[junit4:junit4] 2> 1440894 T3789 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1440956 T3789 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1441058 T3789 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1441064 T3789 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1441423 T3729 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:48732__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 1441423 T3729 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:48732__collection1&state=recovering&nodeName=127.0.0.1:48732_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 1441854 T3789 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1441858 T3789 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1441861 T3789 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1441866 T3789 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1441889 T3789 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1441889 T3789 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368956581486/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/
[junit4:junit4] 2> 1441890 T3789 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b29b889
[junit4:junit4] 2> 1441890 T3789 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1441891 T3789 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4
[junit4:junit4] 2> 1441891 T3789 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/index/
[junit4:junit4] 2> 1441892 T3789 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1441892 T3789 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/index
[junit4:junit4] 2> 1441895 T3789 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c28b563 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bb11600),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1441896 T3789 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1441899 T3789 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1441899 T3789 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1441900 T3789 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1441900 T3789 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1441901 T3789 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1441901 T3789 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1441902 T3789 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1441902 T3789 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1441903 T3789 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1441915 T3789 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1441922 T3789 oass.SolrIndexSearcher.<init> Opening Searcher@5315f39c main
[junit4:junit4] 2> 1441923 T3789 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/tlog
[junit4:junit4] 2> 1441924 T3789 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1441924 T3789 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1441928 T3790 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5315f39c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1441930 T3789 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1441931 T3789 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1442027 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1442027 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:33065_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33065"}
[junit4:junit4] 2> 1442028 T3720 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1442028 T3720 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1442044 T3755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1442044 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1442044 T3771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1442044 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1442044 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1442044 T3788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1442934 T3789 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1442934 T3789 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:33065 collection:collection1 shard:shard2
[junit4:junit4] 2> 1442964 T3789 oasc.ZkController.register We are http://127.0.0.1:33065/collection1/ and leader is http://127.0.0.1:60894/collection1/
[junit4:junit4] 2> 1442965 T3789 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33065
[junit4:junit4] 2> 1442965 T3789 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1442965 T3789 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C248 name=collection1 org.apache.solr.core.SolrCore@402a7abc url=http://127.0.0.1:33065/collection1 node=127.0.0.1:33065_ C248_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:33065_, base_url=http://127.0.0.1:33065}
[junit4:junit4] 2> 1442966 T3791 C248 P33065 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1442966 T3789 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1442967 T3791 C248 P33065 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1442968 T3791 C248 P33065 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1442968 T3791 C248 P33065 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1442968 T3697 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1442969 T3697 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1442969 T3791 C248 P33065 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1442970 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1442986 T3697 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1442987 T3745 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:33065__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1442988 T3697 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 1442989 T3697 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 1442989 T3697 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C247_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:48732_, base_url=http://127.0.0.1:48732}
[junit4:junit4] 2> 1443425 T3774 C247 P48732 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:60887/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1443425 T3774 C247 P48732 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:48732 START replicas=[http://127.0.0.1:60887/collection1/] nUpdates=100
[junit4:junit4] 2> 1443426 T3774 C247 P48732 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1443426 T3774 C247 P48732 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1443426 T3774 C247 P48732 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1443426 T3774 C247 P48732 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1443427 T3774 C247 P48732 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1443427 T3774 C247 P48732 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:60887/collection1/. core=collection1
[junit4:junit4] 2> 1443427 T3774 C247 P48732 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C249 name=collection1 org.apache.solr.core.SolrCore@2277f2e8 url=http://127.0.0.1:60887/collection1 node=127.0.0.1:60887_ C249_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:60887_, base_url=http://127.0.0.1:60887, leader=true}
[junit4:junit4] 2> 1443434 T3730 C249 P60887 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1443440 T3731 C249 P60887 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1443443 T3731 C249 P60887 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2b8b6aec lockFactory=org.apache.lucene.store.NativeFSLockFactory@249f3e5d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1443444 T3731 C249 P60887 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1443445 T3731 C249 P60887 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2b8b6aec lockFactory=org.apache.lucene.store.NativeFSLockFactory@249f3e5d),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2b8b6aec lockFactory=org.apache.lucene.store.NativeFSLockFactory@249f3e5d),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1443445 T3731 C249 P60887 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1443446 T3731 C249 P60887 oass.SolrIndexSearcher.<init> Opening Searcher@1634536a realtime
[junit4:junit4] 2> 1443446 T3731 C249 P60887 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1443447 T3731 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1443448 T3774 C247 P48732 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1443448 T3774 C247 P48732 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1443450 T3732 C249 P60887 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1443451 T3732 C249 P60887 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 1443451 T3774 C247 P48732 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1443452 T3774 C247 P48732 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1443452 T3774 C247 P48732 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1443454 T3732 C249 P60887 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1443455 T3774 C247 P48732 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1443456 T3774 C247 P48732 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty3/index.20130519194305522
[junit4:junit4] 2> 1443456 T3774 C247 P48732 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@3e386a55 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3709d67a) fullCopy=false
[junit4:junit4] 2> 1443459 T3732 C249 P60887 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1443460 T3774 C247 P48732 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1443461 T3774 C247 P48732 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1443461 T3774 C247 P48732 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1443463 T3774 C247 P48732 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@76357127 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7785d2f4),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@76357127 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7785d2f4),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1443464 T3774 C247 P48732 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1443464 T3774 C247 P48732 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1443465 T3774 C247 P48732 oass.SolrIndexSearcher.<init> Opening Searcher@20e54357 main
[junit4:junit4] 2> 1443466 T3773 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@20e54357 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1443466 T3774 C247 P48732 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty3/index.20130519194305522 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty3/index.20130519194305522;done=true>>]
[junit4:junit4] 2> 1443466 T3774 C247 P48732 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty3/index.20130519194305522
[junit4:junit4] 2> 1443467 T3774 C247 P48732 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty3/index.20130519194305522
[junit4:junit4] 2> 1443467 T3774 C247 P48732 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1443467 T3774 C247 P48732 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1443467 T3774 C247 P48732 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1443468 T3774 C247 P48732 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1443469 T3774 C247 P48732 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1443548 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1443549 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:33065__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:33065_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33065"}
[junit4:junit4] 2> 1443552 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:48732__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:48732_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:48732"}
[junit4:junit4] 2> 1443564 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1443564 T3755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1443564 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1443564 T3788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1443564 T3771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1443564 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1443989 T3745 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:33065__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 1443989 T3745 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:33065__collection1&state=recovering&nodeName=127.0.0.1:33065_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 1443991 T3697 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1444993 T3697 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C248_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:33065_, base_url=http://127.0.0.1:33065}
[junit4:junit4] 2> 1445991 T3791 C248 P33065 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:60894/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1445991 T3791 C248 P33065 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:33065 START replicas=[http://127.0.0.1:60894/collection1/] nUpdates=100
[junit4:junit4] 2> 1445992 T3791 C248 P33065 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1445992 T3791 C248 P33065 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1445992 T3791 C248 P33065 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1445992 T3791 C248 P33065 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1445993 T3791 C248 P33065 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1445993 T3791 C248 P33065 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:60894/collection1/. core=collection1
[junit4:junit4] 2> 1445993 T3791 C248 P33065 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1445995 T3697 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C250 name=collection1 org.apache.solr.core.SolrCore@3396deb url=http://127.0.0.1:60894/collection1 node=127.0.0.1:60894_ C250_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:60894_, base_url=http://127.0.0.1:60894, leader=true}
[junit4:junit4] 2> 1446001 T3746 C250 P60894 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 1446005 T3747 C250 P60894 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1446008 T3747 C250 P60894 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@34aeb9d7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d779f92),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1446009 T3747 C250 P60894 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1446010 T3747 C250 P60894 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@34aeb9d7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d779f92),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@34aeb9d7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d779f92),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1446010 T3747 C250 P60894 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1446011 T3747 C250 P60894 oass.SolrIndexSearcher.<init> Opening Searcher@5ff89427 realtime
[junit4:junit4] 2> 1446011 T3747 C250 P60894 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1446012 T3747 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1446013 T3791 C248 P33065 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1446013 T3791 C248 P33065 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1446015 T3748 C250 P60894 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1446015 T3748 C250 P60894 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 1446016 T3791 C248 P33065 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1446016 T3791 C248 P33065 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1446016 T3791 C248 P33065 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1446018 T3748 C250 P60894 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1446019 T3791 C248 P33065 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1446020 T3791 C248 P33065 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/index.20130519194308086
[junit4:junit4] 2> 1446020 T3791 C248 P33065 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@2f3174a9 lockFactory=org.apache.lucene.store.NativeFSLockFactory@23c53f2f) fullCopy=false
[junit4:junit4] 2> 1446023 T3748 C250 P60894 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1446024 T3791 C248 P33065 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1446025 T3791 C248 P33065 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1446025 T3791 C248 P33065 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1446027 T3791 C248 P33065 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c28b563 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bb11600),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c28b563 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bb11600),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1446028 T3791 C248 P33065 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1446028 T3791 C248 P33065 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1446028 T3791 C248 P33065 oass.SolrIndexSearcher.<init> Opening Searcher@7a0a994 main
[junit4:junit4] 2> 1446029 T3790 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7a0a994 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1446030 T3791 C248 P33065 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/index.20130519194308086 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/index.20130519194308086;done=true>>]
[junit4:junit4] 2> 1446030 T3791 C248 P33065 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/index.20130519194308086
[junit4:junit4] 2> 1446030 T3791 C248 P33065 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/index.20130519194308086
[junit4:junit4] 2> 1446031 T3791 C248 P33065 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1446031 T3791 C248 P33065 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1446031 T3791 C248 P33065 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1446031 T3791 C248 P33065 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1446033 T3791 C248 P33065 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1446579 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1446581 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:33065__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:33065_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33065"}
[junit4:junit4] 2> 1446613 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1446613 T3755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1446613 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1446613 T3771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1446613 T3788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1446613 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1446997 T3697 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1446998 T3697 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C251 name=collection1 org.apache.solr.core.SolrCore@4fddb4da url=http://127.0.0.1:60880/collection1 node=127.0.0.1:60880_ C251_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:60880_, base_url=http://127.0.0.1:60880, leader=true}
[junit4:junit4] 2> 1447007 T3709 C251 P60880 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1447011 T3709 C251 P60880 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@57cfb4c6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@38690cf3),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1447012 T3709 C251 P60880 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1447012 T3709 C251 P60880 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@57cfb4c6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@38690cf3),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@57cfb4c6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@38690cf3),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1447013 T3709 C251 P60880 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1447014 T3709 C251 P60880 oass.SolrIndexSearcher.<init> Opening Searcher@60e3bd34 main
[junit4:junit4] 2> 1447014 T3709 C251 P60880 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1447015 T3723 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@60e3bd34 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1447015 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 1447026 T3733 C249 P60887 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1447027 T3733 C249 P60887 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2b8b6aec lockFactory=org.apache.lucene.store.NativeFSLockFactory@249f3e5d),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2b8b6aec lockFactory=org.apache.lucene.store.NativeFSLockFactory@249f3e5d),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1447028 T3733 C249 P60887 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1447028 T3733 C249 P60887 oass.SolrIndexSearcher.<init> Opening Searcher@7d8427da main
[junit4:junit4] 2> 1447029 T3733 C249 P60887 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1447030 T3741 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7d8427da main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1447030 T3733 C249 P60887 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:48732/collection1/, StdNode: http://127.0.0.1:60894/collection1/, StdNode: http://127.0.0.1:33065/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 1447033 T3749 C250 P60894 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1447036 T3749 C250 P60894 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@34aeb9d7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d779f92),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@34aeb9d7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d779f92),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1447036 T3749 C250 P60894 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1447037 T3749 C250 P60894 oass.SolrIndexSearcher.<init> Opening Searcher@25e41feb main
[junit4:junit4] 2> 1447037 T3749 C250 P60894 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1447038 T3757 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@25e41feb main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1447039 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> C248_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:33065_, base_url=http://127.0.0.1:33065}
[junit4:junit4] 2> 1447043 T3778 C248 P33065 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C247_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:48732_, base_url=http://127.0.0.1:48732}
[junit4:junit4] 2> 1447043 T3761 C247 P48732 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1447045 T3778 C248 P33065 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c28b563 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bb11600),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c28b563 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bb11600),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1447045 T3761 C247 P48732 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@76357127 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7785d2f4),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@76357127 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7785d2f4),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1447046 T3778 C248 P33065 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1447046 T3761 C247 P48732 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1447047 T3778 C248 P33065 oass.SolrIndexSearcher.<init> Opening Searcher@5bdf75fc main
[junit4:junit4] 2> 1447048 T3761 C247 P48732 oass.SolrIndexSearcher.<init> Opening Searcher@1aff73e8 main
[junit4:junit4] 2> 1447048 T3778 C248 P33065 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1447049 T3790 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5bdf75fc main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1447049 T3773 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1aff73e8 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1447050 T3778 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1447049 T3761 C247 P48732 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1447051 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 1447051 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 25
[junit4:junit4] 2> 1447052 T3697 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1447055 T3734 C249 P60887 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1447057 T3762 C247 P48732 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1447059 T3750 C250 P60894 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1447061 T3779 C248 P33065 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 1449066 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435455026501779456)} 0 2
[junit4:junit4] 2> 1449074 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435455026505973760&update.from=http://127.0.0.1:60894/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435455026505973760)} 0 2
[junit4:junit4] 2> 1449076 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435455026510168064&update.from=http://127.0.0.1:60887/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435455026510168064)} 0 1
[junit4:junit4] 2> 1449077 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1435455026510168064)} 0 5
[junit4:junit4] 2> 1449077 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435455026505973760)} 0 9
[junit4:junit4] 2> 1449081 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0 (1435455026518556672)]} 0 1
[junit4:junit4] 2> 1449088 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!0 (1435455026523799552)]} 0 0
[junit4:junit4] 2> 1449089 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!0 (1435455026523799552)]} 0 4
[junit4:junit4] 2> 1449090 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0]} 0 7
[junit4:junit4] 2> 1449092 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1435455026531139584)]} 0 0
[junit4:junit4] 2> 1449099 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!1 (1435455026536382464)]} 0 0
[junit4:junit4] 2> 1449100 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!1 (1435455026536382464)]} 0 3
[junit4:junit4] 2> 1449101 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1]} 0 6
[junit4:junit4] 2> 1449103 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2 (1435455026542673920)]} 0 0
[junit4:junit4] 2> 1449110 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!2 (1435455026547916800)]} 0 0
[junit4:junit4] 2> 1449111 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!2 (1435455026547916800)]} 0 3
[junit4:junit4] 2> 1449112 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2]} 0 6
[junit4:junit4] 2> 1449114 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1435455026554208256)]} 0 0
[junit4:junit4] 2> 1449119 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!3 (1435455026557353984)]} 0 0
[junit4:junit4] 2> 1449120 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1435455026557353984)]} 0 3
[junit4:junit4] 2> 1449122 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4 (1435455026562596864)]} 0 0
[junit4:junit4] 2> 1449129 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!4 (1435455026567839744)]} 0 0
[junit4:junit4] 2> 1449130 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!4 (1435455026567839744)]} 0 3
[junit4:junit4] 2> 1449130 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4]} 0 5
[junit4:junit4] 2> 1449133 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5 (1435455026574131200)]} 0 0
[junit4:junit4] 2> 1449138 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!5 (1435455026577276928)]} 0 0
[junit4:junit4] 2> 1449139 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5 (1435455026577276928)]} 0 3
[junit4:junit4] 2> 1449141 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6 (1435455026582519808)]} 0 0
[junit4:junit4] 2> 1449148 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!6 (1435455026587762688)]} 0 0
[junit4:junit4] 2> 1449149 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!6 (1435455026587762688)]} 0 3
[junit4:junit4] 2> 1449150 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6]} 0 6
[junit4:junit4] 2> 1449152 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7 (1435455026594054144)]} 0 0
[junit4:junit4] 2> 1449159 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!7 (1435455026599297024)]} 0 0
[junit4:junit4] 2> 1449160 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!7 (1435455026599297024)]} 0 3
[junit4:junit4] 2> 1449160 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7]} 0 5
[junit4:junit4] 2> 1449163 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1435455026605588480)]} 0 0
[junit4:junit4] 2> 1449168 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!8 (1435455026608734208)]} 0 0
[junit4:junit4] 2> 1449169 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1435455026608734208)]} 0 3
[junit4:junit4] 2> 1449171 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9 (1435455026613977088)]} 0 0
[junit4:junit4] 2> 1449176 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!9 (1435455026617122816)]} 0 0
[junit4:junit4] 2> 1449177 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9 (1435455026617122816)]} 0 3
[junit4:junit4] 2> 1449179 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10 (1435455026622365696)]} 0 0
[junit4:junit4] 2> 1449186 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!10 (1435455026627608576)]} 0 0
[junit4:junit4] 2> 1449187 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!10 (1435455026627608576)]} 0 3
[junit4:junit4] 2> 1449187 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10]} 0 5
[junit4:junit4] 2> 1449190 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11 (1435455026633900032)]} 0 0
[junit4:junit4] 2> 1449197 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!11 (1435455026639142912)]} 0 0
[junit4:junit4] 2> 1449198 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!11 (1435455026639142912)]} 0 3
[junit4:junit4] 2> 1449198 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11]} 0 5
[junit4:junit4] 2> 1449201 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12 (1435455026645434368)]} 0 0
[junit4:junit4] 2> 1449206 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!12 (1435455026648580096)]} 0 0
[junit4:junit4] 2> 1449207 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12 (1435455026648580096)]} 0 3
[junit4:junit4] 2> 1449209 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13 (1435455026653822976)]} 0 0
[junit4:junit4] 2> 1449216 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!13 (1435455026659065856)]} 0 0
[junit4:junit4] 2> 1449217 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!13 (1435455026659065856)]} 0 3
[junit4:junit4] 2> 1449217 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13]} 0 5
[junit4:junit4] 2> 1449220 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1435455026665357312)]} 0 0
[junit4:junit4] 2> 1449225 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!14 (1435455026668503040)]} 0 0
[junit4:junit4] 2> 1449226 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1435455026668503040)]} 0 3
[junit4:junit4] 2> 1449228 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1435455026673745920)]} 0 0
[junit4:junit4] 2> 1449235 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!15 (1435455026678988800)]} 0 0
[junit4:junit4] 2> 1449236 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!15 (1435455026678988800)]} 0 3
[junit4:junit4] 2> 1449236 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15]} 0 5
[junit4:junit4] 2> 1449239 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16 (1435455026685280256)]} 0 0
[junit4:junit4] 2> 1449244 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!16 (1435455026688425984)]} 0 0
[junit4:junit4] 2> 1449245 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16 (1435455026688425984)]} 0 3
[junit4:junit4] 2> 1449247 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1435455026693668864)]} 0 0
[junit4:junit4] 2> 1449252 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!17 (1435455026696814592)]} 0 0
[junit4:junit4] 2> 1449253 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1435455026696814592)]} 0 3
[junit4:junit4] 2> 1449255 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18 (1435455026702057472)]} 0 0
[junit4:junit4] 2> 1449262 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!18 (1435455026707300352)]} 0 0
[junit4:junit4] 2> 1449263 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!18 (1435455026707300352)]} 0 3
[junit4:junit4] 2> 1449263 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18]} 0 5
[junit4:junit4] 2> 1449266 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1435455026713591808)]} 0 0
[junit4:junit4] 2> 1449273 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!19 (1435455026718834688)]} 0 0
[junit4:junit4] 2> 1449274 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[t!19 (1435455026718834688)]} 0 3
[junit4:junit4] 2> 1449274 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19]} 0 5
[junit4:junit4] 2> 1449277 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20 (1435455026725126144)]} 0 0
[junit4:junit4] 2> 1449284 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!20 (1435455026730369024)]} 0 0
[junit4:junit4] 2> 1449285 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!20 (1435455026730369024)]} 0 3
[junit4:junit4] 2> 1449285 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20]} 0 5
[junit4:junit4] 2> 1449288 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1435455026736660480)]} 0 0
[junit4:junit4] 2> 1449293 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!21 (1435455026739806208)]} 0 0
[junit4:junit4] 2> 1449294 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1435455026739806208)]} 0 3
[junit4:junit4] 2> 1449299 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22 (1435455026747146240)]} 0 1
[junit4:junit4] 2> 1449307 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!22 (1435455026754486272)]} 0 0
[junit4:junit4] 2> 1449308 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[w!22 (1435455026754486272)]} 0 3
[junit4:junit4] 2> 1449308 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22]} 0 6
[junit4:junit4] 2> 1449311 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23 (1435455026760777728)]} 0 0
[junit4:junit4] 2> 1449316 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!23 (1435455026763923456)]} 0 0
[junit4:junit4] 2> 1449317 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23 (1435455026763923456)]} 0 3
[junit4:junit4] 2> 1449319 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24 (1435455026769166336)]} 0 0
[junit4:junit4] 2> 1449324 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!24 (1435455026772312064)]} 0 0
[junit4:junit4] 2> 1449325 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24 (1435455026772312064)]} 0 3
[junit4:junit4] 2> 1449327 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25 (1435455026777554944)]} 0 0
[junit4:junit4] 2> 1449334 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!25 (1435455026782797824)]} 0 0
[junit4:junit4] 2> 1449335 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[z!25 (1435455026782797824)]} 0 3
[junit4:junit4] 2> 1449335 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25]} 0 5
[junit4:junit4] 2> 1449338 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26 (1435455026789089280)]} 0 0
[junit4:junit4] 2> 1449345 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!26 (1435455026794332160)]} 0 0
[junit4:junit4] 2> 1449346 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!26 (1435455026794332160)]} 0 3
[junit4:junit4] 2> 1449346 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26]} 0 5
[junit4:junit4] 2> 1449349 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27 (1435455026800623616)]} 0 0
[junit4:junit4] 2> 1449356 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!27 (1435455026805866496)]} 0 0
[junit4:junit4] 2> 1449357 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!27 (1435455026805866496)]} 0 3
[junit4:junit4] 2> 1449357 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27]} 0 5
[junit4:junit4] 2> 1449360 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28 (1435455026812157952)]} 0 0
[junit4:junit4] 2> 1449367 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!28 (1435455026817400832)]} 0 0
[junit4:junit4] 2> 1449368 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!28 (1435455026817400832)]} 0 3
[junit4:junit4] 2> 1449369 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28]} 0 6
[junit4:junit4] 2> 1449371 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29 (1435455026823692288)]} 0 0
[junit4:junit4] 2> 1449378 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!29 (1435455026828935168)]} 0 0
[junit4:junit4] 2> 1449379 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!29 (1435455026828935168)]} 0 3
[junit4:junit4] 2> 1449379 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29]} 0 5
[junit4:junit4] 2> 1449382 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1435455026835226624)]} 0 0
[junit4:junit4] 2> 1449387 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!30 (1435455026838372352)]} 0 0
[junit4:junit4] 2> 1449388 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1435455026838372352)]} 0 3
[junit4:junit4] 2> 1449391 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31 (1435455026844663808)]} 0 0
[junit4:junit4] 2> 1449398 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!31 (1435455026849906688)]} 0 0
[junit4:junit4] 2> 1449399 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!31 (1435455026849906688)]} 0 3
[junit4:junit4] 2> 1449400 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31]} 0 6
[junit4:junit4] 2> 1449403 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1435455026857246720)]} 0 0
[junit4:junit4] 2> 1449409 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!32 (1435455026861441024)]} 0 0
[junit4:junit4] 2> 1449410 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1435455026861441024)]} 0 4
[junit4:junit4] 2> 1449412 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33 (1435455026866683904)]} 0 0
[junit4:junit4] 2> 1449419 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!33 (1435455026871926784)]} 0 0
[junit4:junit4] 2> 1449420 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!33 (1435455026871926784)]} 0 3
[junit4:junit4] 2> 1449420 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33]} 0 5
[junit4:junit4] 2> 1449423 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34 (1435455026878218240)]} 0 0
[junit4:junit4] 2> 1449430 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!34 (1435455026883461120)]} 0 0
[junit4:junit4] 2> 1449431 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!34 (1435455026883461120)]} 0 3
[junit4:junit4] 2> 1449431 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34]} 0 5
[junit4:junit4] 2> 1449434 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35 (1435455026889752576)]} 0 0
[junit4:junit4] 2> 1449441 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!35 (1435455026894995456)]} 0 0
[junit4:junit4] 2> 1449442 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!35 (1435455026894995456)]} 0 3
[junit4:junit4] 2> 1449442 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35]} 0 5
[junit4:junit4] 2> 1449445 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36 (1435455026901286912)]} 0 0
[junit4:junit4] 2> 1449450 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!36 (1435455026904432640)]} 0 0
[junit4:junit4] 2> 1449451 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36 (1435455026904432640)]} 0 3
[junit4:junit4] 2> 1449453 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37 (1435455026909675520)]} 0 0
[junit4:junit4] 2> 1449460 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!37 (1435455026914918400)]} 0 0
[junit4:junit4] 2> 1449461 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!37 (1435455026914918400)]} 0 3
[junit4:junit4] 2> 1449461 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37]} 0 5
[junit4:junit4] 2> 1449464 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1435455026921209856)]} 0 0
[junit4:junit4] 2> 1449469 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!38 (1435455026924355584)]} 0 0
[junit4:junit4] 2> 1449470 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1435455026924355584)]} 0 3
[junit4:junit4] 2> 1449472 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39 (1435455026929598464)]} 0 0
[junit4:junit4] 2> 1449479 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!39 (1435455026934841344)]} 0 0
[junit4:junit4] 2> 1449480 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!39 (1435455026934841344)]} 0 3
[junit4:junit4] 2> 1449480 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39]} 0 5
[junit4:junit4] 2> 1449483 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40 (1435455026941132800)]} 0 0
[junit4:junit4] 2> 1449490 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!40 (1435455026946375680)]} 0 0
[junit4:junit4] 2> 1449491 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!40 (1435455026946375680)]} 0 3
[junit4:junit4] 2> 1449491 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40]} 0 5
[junit4:junit4] 2> 1449494 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41 (1435455026952667136)]} 0 0
[junit4:junit4] 2> 1449501 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!41 (1435455026957910016)]} 0 0
[junit4:junit4] 2> 1449502 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!41 (1435455026957910016)]} 0 3
[junit4:junit4] 2> 1449503 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41]} 0 6
[junit4:junit4] 2> 1449505 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1435455026964201472)]} 0 0
[junit4:junit4] 2> 1449512 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!42 (1435455026969444352)]} 0 0
[junit4:junit4] 2> 1449513 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!42 (1435455026969444352)]} 0 3
[junit4:junit4] 2> 1449513 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42]} 0 5
[junit4:junit4] 2> 1449516 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1435455026975735808)]} 0 0
[junit4:junit4] 2> 1449521 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!43 (1435455026978881536)]} 0 0
[junit4:junit4] 2> 1449522 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1435455026978881536)]} 0 3
[junit4:junit4] 2> 1449524 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1435455026984124416)]} 0 0
[junit4:junit4] 2> 1449529 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!44 (1435455026987270144)]} 0 0
[junit4:junit4] 2> 1449530 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1435455026987270144)]} 0 3
[junit4:junit4] 2> 1449532 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45 (1435455026992513024)]} 0 0
[junit4:junit4] 2> 1449539 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!45 (1435455026997755904)]} 0 0
[junit4:junit4] 2> 1449540 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[t!45 (1435455026997755904)]} 0 3
[junit4:junit4] 2> 1449540 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45]} 0 5
[junit4:junit4] 2> 1449543 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1435455027004047360)]} 0 0
[junit4:junit4] 2> 1449548 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!46 (1435455027007193088)]} 0 0
[junit4:junit4] 2> 1449549 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1435455027007193088)]} 0 3
[junit4:junit4] 2> 1449551 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47 (1435455027012435968)]} 0 0
[junit4:junit4] 2> 1449558 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!47 (1435455027017678848)]} 0 0
[junit4:junit4] 2> 1449559 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[v!47 (1435455027017678848)]} 0 3
[junit4:junit4] 2> 1449559 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47]} 0 5
[junit4:junit4] 2> 1449562 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1435455027023970304)]} 0 0
[junit4:junit4] 2> 1449567 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!48 (1435455027027116032)]} 0 0
[junit4:junit4] 2> 1449568 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1435455027027116032)]} 0 3
[junit4:junit4] 2> 1449570 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49 (1435455027032358912)]} 0 0
[junit4:junit4] 2> 1449577 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!49 (1435455027037601792)]} 0 0
[junit4:junit4] 2> 1449578 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!49 (1435455027037601792)]} 0 3
[junit4:junit4] 2> 1449578 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49]} 0 5
[junit4:junit4] 2> 1449581 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50 (1435455027043893248)]} 0 0
[junit4:junit4] 2> 1449586 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!50 (1435455027047038976)]} 0 0
[junit4:junit4] 2> 1449587 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50 (1435455027047038976)]} 0 3
[junit4:junit4] 2> 1449589 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51 (1435455027052281856)]} 0 0
[junit4:junit4] 2> 1449594 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!51 (1435455027055427584)]} 0 0
[junit4:junit4] 2> 1449595 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51 (1435455027055427584)]} 0 3
[junit4:junit4] 2> 1449597 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52 (1435455027060670464)]} 0 0
[junit4:junit4] 2> 1449604 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!52 (1435455027065913344)]} 0 0
[junit4:junit4] 2> 1449605 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!52 (1435455027065913344)]} 0 3
[junit4:junit4] 2> 1449605 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52]} 0 5
[junit4:junit4] 2> 1449608 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53 (1435455027072204800)]} 0 0
[junit4:junit4] 2> 1449613 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!53 (1435455027075350528)]} 0 0
[junit4:junit4] 2> 1449614 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53 (1435455027075350528)]} 0 3
[junit4:junit4] 2> 1449616 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1435455027080593408)]} 0 0
[junit4:junit4] 2> 1449621 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!54 (1435455027083739136)]} 0 0
[junit4:junit4] 2> 1449622 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1435455027083739136)]} 0 3
[junit4:junit4] 2> 1449624 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55 (1435455027088982016)]} 0 0
[junit4:junit4] 2> 1449629 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!55 (1435455027092127744)]} 0 0
[junit4:junit4] 2> 1449630 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55 (1435455027092127744)]} 0 3
[junit4:junit4] 2> 1449632 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56 (1435455027097370624)]} 0 0
[junit4:junit4] 2> 1449639 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!56 (1435455027102613504)]} 0 0
[junit4:junit4] 2> 1449640 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!56 (1435455027102613504)]} 0 3
[junit4:junit4] 2> 1449640 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56]} 0 5
[junit4:junit4] 2> 1449643 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57 (1435455027108904960)]} 0 0
[junit4:junit4] 2> 1449650 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!57 (1435455027114147840)]} 0 0
[junit4:junit4] 2> 1449651 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!57 (1435455027114147840)]} 0 3
[junit4:junit4] 2> 1449651 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57]} 0 5
[junit4:junit4] 2> 1449654 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58 (1435455027120439296)]} 0 0
[junit4:junit4] 2> 1449659 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!58 (1435455027123585024)]} 0 0
[junit4:junit4] 2> 1449660 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58 (1435455027123585024)]} 0 3
[junit4:junit4] 2> 1449662 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59 (1435455027128827904)]} 0 0
[junit4:junit4] 2> 1449669 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!59 (1435455027134070784)]} 0 0
[junit4:junit4] 2> 1449670 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!59 (1435455027134070784)]} 0 3
[junit4:junit4] 2> 1449670 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59]} 0 5
[junit4:junit4] 2> 1449673 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60 (1435455027140362240)]} 0 0
[junit4:junit4] 2> 1449680 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!60 (1435455027145605120)]} 0 0
[junit4:junit4] 2> 1449681 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!60 (1435455027145605120)]} 0 3
[junit4:junit4] 2> 1449681 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60]} 0 5
[junit4:junit4] 2> 1449684 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61 (1435455027151896576)]} 0 0
[junit4:junit4] 2> 1449689 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!61 (1435455027155042304)]} 0 0
[junit4:junit4] 2> 1449690 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61 (1435455027155042304)]} 0 3
[junit4:junit4] 2> 1449692 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62 (1435455027160285184)]} 0 0
[junit4:junit4] 2> 1449697 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!62 (1435455027163430912)]} 0 0
[junit4:junit4] 2> 1449698 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62 (1435455027163430912)]} 0 3
[junit4:junit4] 2> 1449700 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63 (1435455027168673792)]} 0 0
[junit4:junit4] 2> 1449707 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!63 (1435455027173916672)]} 0 0
[junit4:junit4] 2> 1449708 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!63 (1435455027173916672)]} 0 3
[junit4:junit4] 2> 1449708 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63]} 0 5
[junit4:junit4] 2> 1449711 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64 (1435455027180208128)]} 0 0
[junit4:junit4] 2> 1449718 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!64 (1435455027185451008)]} 0 0
[junit4:junit4] 2> 1449719 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!64 (1435455027185451008)]} 0 3
[junit4:junit4] 2> 1449719 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64]} 0 5
[junit4:junit4] 2> 1449722 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!65 (1435455027191742464)]} 0 0
[junit4:junit4] 2> 1449727 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!65 (1435455027194888192)]} 0 0
[junit4:junit4] 2> 1449728 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!65 (1435455027194888192)]} 0 3
[junit4:junit4] 2> 1449730 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!66 (1435455027200131072)]} 0 0
[junit4:junit4] 2> 1449737 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!66 (1435455027205373952)]} 0 0
[junit4:junit4] 2> 1449738 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!66 (1435455027205373952)]} 0 3
[junit4:junit4] 2> 1449738 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!66]} 0 5
[junit4:junit4] 2> 1449741 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!67 (1435455027211665408)]} 0 0
[junit4:junit4] 2> 1449746 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!67 (1435455027214811136)]} 0 0
[junit4:junit4] 2> 1449747 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!67 (1435455027214811136)]} 0 3
[junit4:junit4] 2> 1449749 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!68 (1435455027220054016)]} 0 0
[junit4:junit4] 2> 1449756 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!68 (1435455027225296896)]} 0 0
[junit4:junit4] 2> 1449757 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!68 (1435455027225296896)]} 0 3
[junit4:junit4] 2> 1449757 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!68]} 0 5
[junit4:junit4] 2> 1449760 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!69 (1435455027
[...truncated too long message...]
ate
[junit4:junit4] 2> 1458587 T3697 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 1458587 T3697 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> C248_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:33065_, base_url=http://127.0.0.1:33065, leader=true}
[junit4:junit4] 2> 1458590 T3697 C248 P33065 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c28b563 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bb11600),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c28b563 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bb11600),segFN=segments_5,generation=5}
[junit4:junit4] 2> 1458591 T3697 C248 P33065 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 1458593 T3697 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 1458594 T3697 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 1458594 T3697 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4;done=false>>]
[junit4:junit4] 2> 1458595 T3697 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4
[junit4:junit4] 2> 1458595 T3697 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/index;done=false>>]
[junit4:junit4] 2> 1458596 T3697 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/index
[junit4:junit4] 2> 1458597 T3818 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89715937437745164-127.0.0.1:33065_-n_0000000004) am no longer a leader.
[junit4:junit4] 2> 1458599 T3697 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 1458671 T3697 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 1458673 T3697 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:60877 60877
[junit4:junit4] 2> 1458742 T3697 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 60880
[junit4:junit4] 2> !!!! WARNING: best effort to remove /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-1368956564901 FAILED !!!!!
[junit4:junit4] 2> 1458743 T3697 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 1458744 T3697 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:60877 60877
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ShardSplitTest -Dtests.method=testDistribSearch -Dtests.seed=51CC87C365F5FFBD -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_EG -Dtests.timezone=Australia/Victoria -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR 35.9s J0 | ShardSplitTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:60887 returned non ok status:500, message:Server Error
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([51CC87C365F5FFBD:D02A09DB12AA9F81]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 1458764 T3697 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 35941 T3696 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> 1459899 T3788 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1459899 T3788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1459899 T3788 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {id=Lucene41(blocksize=128), _version_=PostingsFormat(name=Asserting)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ar_EG, timezone=Australia/Victoria
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=1,free=253256256,total=529530880
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestQuerySenderListener, MoreLikeThisHandlerTest, LukeRequestHandlerTest, DirectSolrConnectionTest, TestSearchPerf, SliceStateUpdateTest, TestGroupingSearch, SOLR749Test, WordBreakSolrSpellCheckerTest, TestFuzzyAnalyzedSuggestions, TestSurroundQueryParser, TestPluginEnable, SearchHandlerTest, TermVectorComponentTest, TestSolrDeletionPolicy2, SoftAutoCommitTest, TestXIncludeConfig, QueryResultKeyTest, PreAnalyzedFieldTest, TestFastLRUCache, CircularListTest, TermsComponentTest, TestRealTimeGet, DistributedQueryElevationComponentTest, TestPHPSerializedResponseWriter, OverseerTest, TestSolrQueryParser, TestPseudoReturnFields, TestConfig, AutoCommitTest, TestSort, SuggesterTest, FieldMutatingUpdateProcessorTest, IndexSchemaTest, RAMDirectoryFactoryTest, BadCopyFieldTest, SuggesterFSTTest, TestValueSourceCache, TestBadConfig, TestStressRecovery, SolrIndexSplitterTest, TestRandomDVFaceting, MBeansHandlerTest, TestSolrDeletionPolicy1, TestWriterPerf, BadComponentTest, DistributedTermsComponentTest, OverseerCollectionProcessorTest, DocumentBuilderTest, ExternalFileFieldSortTest, BasicDistributedZkTest, TestCharFilters, ZkCLITest, RegexBoostProcessorTest, TestManagedSchema, RecoveryZkTest, TestPerFieldSimilarity, AnalysisAfterCoreReloadTest, TestQueryUtils, LeaderElectionTest, TestSchemaResource, TestFieldTypeCollectionResource, TestDocumentBuilder, PreAnalyzedUpdateProcessorTest, PeerSyncTest, TestCloudManagedSchema, MinimalSchemaTest, TestCoreContainer, StatelessScriptUpdateProcessorFactoryTest, BinaryUpdateRequestHandlerTest, LegacyHTMLStripCharFilterTest, CollectionsAPIDistributedZkTest, OpenCloseCoreStressTest, LeaderElectionIntegrationTest, BasicZkTest, ClusterStateUpdateTest, TestRandomFaceting, TestStressReorder, TestMultiCoreConfBootstrap, TestReload, TestStressVersions, HardAutoCommitTest, SimpleFacetsTest, SolrCoreTest, StatsComponentTest, BadIndexSchemaTest, TestFunctionQuery, BasicFunctionalityTest, ShowFileRequestHandlerTest, CurrencyFieldXmlFileTest, SimplePostToolTest, TestExtendedDismaxParser, SpellCheckCollatorTest, CoreAdminHandlerTest, SolrRequestParserTest, DocValuesTest, TestTrie, SuggesterWFSTTest, PolyFieldTest, SolrCoreCheckLockOnStartupTest, TestAtomicUpdateErrorCases, QueryEqualityTest, SortByFunctionTest, DocValuesMultiTest, XsltUpdateRequestHandlerTest, DisMaxRequestHandlerTest, TestReversedWildcardFilterFactory, PrimitiveFieldTypeTest, FileBasedSpellCheckerTest, TestArbitraryIndexDir, ReturnFieldsTest, TestCSVResponseWriter, UniqFieldsUpdateProcessorFactoryTest, CSVRequestHandlerTest, TestLFUCache, TestPropInject, AlternateDirectoryTest, TestSolrIndexConfig, CopyFieldTest, MultiTermTest, TestDocSet, SpellPossibilityIteratorTest, SynonymTokenizerTest, TestSweetSpotSimilarityFactory, TestLMDirichletSimilarityFactory, TestIBSimilarityFactory, TestDefaultSimilarityFactory, ResourceLoaderTest, PluginInfoTest, ChaosMonkeyNothingIsSafeTest, TestSystemIdResolver, TestSuggestSpellingConverter, DateFieldTest, DOMUtilTest, TestUtils, UUIDFieldTest, TestRTGBase, AliasIntegrationTest, ShardSplitTest]
[junit4:junit4] Completed on J0 in 37.23s, 1 test, 1 error <<< FAILURES!
[...truncated 61 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:377: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:357: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1240: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:884: There were test failures: 295 suites, 1231 tests, 1 error, 27 ignored (8 assumptions)
Total time: 47 minutes 4 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 4000 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/4000/
3 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:22126/k returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:22126/k returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([7C8A44DAB2799276:FD6CCAC2C526F24A]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
REGRESSION: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
shard1 is not consistent. Got 305 from http://127.0.0.1:59229/collection1lastClient and got 5 from http://127.0.0.1:59234/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:59229/collection1lastClient and got 5 from http://127.0.0.1:59234/collection1
at __randomizedtesting.SeedInfo.seed([7C8A44DAB2799276:FD6CCAC2C526F24A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
FAILED: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:22220 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:22220 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([7C8A44DAB2799276:FD6CCAC2C526F24A]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9255 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeyShardSplitTest
[junit4:junit4] 2> 118358 T375 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /k/
[junit4:junit4] 2> 118366 T375 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeyShardSplitTest-1369006298906
[junit4:junit4] 2> 118378 T375 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 118386 T376 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 118588 T375 oasc.ZkTestServer.run start zk server on port:22112
[junit4:junit4] 2> 118864 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 118994 T382 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d12cf29 name:ZooKeeperConnection Watcher:127.0.0.1:22112 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 118995 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 119001 T375 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 119108 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 119111 T384 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e13a7b1 name:ZooKeeperConnection Watcher:127.0.0.1:22112/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 119111 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 119119 T375 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 119125 T375 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 119130 T375 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 119134 T375 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 119139 T375 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 119140 T375 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 119155 T375 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 119156 T375 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 119262 T375 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 119263 T375 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 119268 T375 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 119269 T375 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 119274 T375 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 119275 T375 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 119280 T375 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 119281 T375 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 119286 T375 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 119287 T375 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 119292 T375 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 119293 T375 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 119298 T375 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 119299 T375 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 119578 T375 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 119582 T375 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:22115
[junit4:junit4] 2> 119583 T375 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 119584 T375 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 119584 T375 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369006299844
[junit4:junit4] 2> 119585 T375 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369006299844/solr.xml
[junit4:junit4] 2> 119585 T375 oasc.CoreContainer.<init> New CoreContainer 1335115928
[junit4:junit4] 2> 119586 T375 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369006299844/'
[junit4:junit4] 2> 119586 T375 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369006299844/'
[junit4:junit4] 2> 119717 T375 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 119718 T375 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 119719 T375 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 119719 T375 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 119720 T375 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 119720 T375 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 119721 T375 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 119721 T375 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 119722 T375 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 119722 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 119740 T375 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 119741 T375 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:22112/solr
[junit4:junit4] 2> 119761 T375 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 119762 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 119765 T395 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17341fe4 name:ZooKeeperConnection Watcher:127.0.0.1:22112 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 119766 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 119775 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 119793 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 119795 T397 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@51bcbe0b name:ZooKeeperConnection Watcher:127.0.0.1:22112/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 119796 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 119810 T375 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 119828 T375 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 119851 T375 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 119854 T375 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:22115_k
[junit4:junit4] 2> 119863 T375 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:22115_k
[junit4:junit4] 2> 119869 T375 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 119906 T375 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 119911 T375 oasc.Overseer.start Overseer (id=89719196821422083-127.0.0.1:22115_k-n_0000000000) starting
[junit4:junit4] 2> 119935 T375 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 119961 T399 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 119962 T375 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 119966 T375 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 119969 T375 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 120002 T398 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 120021 T400 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369006299844/collection1
[junit4:junit4] 2> 120021 T400 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 120023 T400 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 120023 T400 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 120025 T400 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369006299844/collection1/'
[junit4:junit4] 2> 120027 T400 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369006299844/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 120027 T400 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369006299844/collection1/lib/README' to classloader
[junit4:junit4] 2> 120114 T400 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 120178 T400 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 120280 T400 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 120288 T400 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 121047 T400 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 121052 T400 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 121057 T400 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 121066 T400 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 121114 T400 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 121115 T400 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369006299844/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/control/data/
[junit4:junit4] 2> 121115 T400 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@46192223
[junit4:junit4] 2> 121116 T400 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 121117 T400 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/control/data
[junit4:junit4] 2> 121117 T400 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/control/data/index/
[junit4:junit4] 2> 121117 T400 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 121118 T400 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/control/data/index
[junit4:junit4] 2> 121125 T400 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16b374ce lockFactory=org.apache.lucene.store.NativeFSLockFactory@21019571),segFN=segments_1,generation=1}
[junit4:junit4] 2> 121125 T400 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 121128 T400 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 121129 T400 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 121130 T400 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 121131 T400 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 121132 T400 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 121132 T400 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 121132 T400 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 121133 T400 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 121133 T400 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 121158 T400 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 121169 T400 oass.SolrIndexSearcher.<init> Opening Searcher@5af984fb main
[junit4:junit4] 2> 121169 T400 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/control/data/tlog
[junit4:junit4] 2> 121171 T400 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 121171 T400 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 121175 T401 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5af984fb main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 121176 T400 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 121177 T400 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 121514 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 121515 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22115_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22115/k"}
[junit4:junit4] 2> 121516 T398 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 121537 T398 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 121569 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 122215 T400 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 122215 T400 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:22115/k collection:control_collection shard:shard1
[junit4:junit4] 2> 122224 T400 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 122237 T400 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 122256 T400 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 122268 T400 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 122269 T400 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 122269 T400 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:22115/k/collection1/
[junit4:junit4] 2> 122269 T400 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 122269 T400 oasc.SyncStrategy.syncToMe http://127.0.0.1:22115/k/collection1/ has no replicas
[junit4:junit4] 2> 122270 T400 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:22115/k/collection1/
[junit4:junit4] 2> 122270 T400 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 123078 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 123097 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 123153 T400 oasc.ZkController.register We are http://127.0.0.1:22115/k/collection1/ and leader is http://127.0.0.1:22115/k/collection1/
[junit4:junit4] 2> 123153 T400 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:22115/k
[junit4:junit4] 2> 123153 T400 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 123154 T400 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 123154 T400 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 123157 T400 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 123158 T375 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 123159 T375 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 123160 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 123173 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 123180 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 123183 T404 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9b98c71 name:ZooKeeperConnection Watcher:127.0.0.1:22112/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 123183 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 123185 T375 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 123192 T375 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 123465 T375 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 123468 T375 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:22126
[junit4:junit4] 2> 123469 T375 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 123469 T375 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 123470 T375 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369006303731
[junit4:junit4] 2> 123470 T375 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369006303731/solr.xml
[junit4:junit4] 2> 123471 T375 oasc.CoreContainer.<init> New CoreContainer 1297274696
[junit4:junit4] 2> 123472 T375 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369006303731/'
[junit4:junit4] 2> 123472 T375 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369006303731/'
[junit4:junit4] 2> 123602 T375 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 123603 T375 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 123604 T375 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 123604 T375 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 123605 T375 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 123605 T375 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 123606 T375 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 123606 T375 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 123607 T375 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 123607 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 123627 T375 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 123628 T375 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:22112/solr
[junit4:junit4] 2> 123629 T375 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 123630 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 123634 T415 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6c342410 name:ZooKeeperConnection Watcher:127.0.0.1:22112 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 123634 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 123638 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 123652 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 123654 T417 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b5f2d1f name:ZooKeeperConnection Watcher:127.0.0.1:22112/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 123655 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 123668 T375 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 124613 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 124614 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:22115_k_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22115_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22115/k"}
[junit4:junit4] 2> 124656 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 124656 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 124656 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 124673 T375 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:22126_k
[junit4:junit4] 2> 124675 T375 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:22126_k
[junit4:junit4] 2> 124679 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 124679 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 124679 T397 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 124680 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 124681 T404 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 124682 T417 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 124696 T418 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369006303731/collection1
[junit4:junit4] 2> 124696 T418 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 124697 T418 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 124697 T418 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 124700 T418 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369006303731/collection1/'
[junit4:junit4] 2> 124701 T418 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369006303731/collection1/lib/README' to classloader
[junit4:junit4] 2> 124702 T418 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369006303731/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 124757 T418 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 124823 T418 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 124925 T418 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 124932 T418 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 125513 T418 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 125517 T418 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 125519 T418 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 125525 T418 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 125570 T418 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 125570 T418 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369006303731/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty1/
[junit4:junit4] 2> 125571 T418 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@46192223
[junit4:junit4] 2> 125571 T418 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 125572 T418 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty1
[junit4:junit4] 2> 125572 T418 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty1/index/
[junit4:junit4] 2> 125573 T418 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 125574 T418 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty1/index
[junit4:junit4] 2> 125583 T418 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@293962c5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19fa46c7),segFN=segments_1,generation=1}
[junit4:junit4] 2> 125584 T418 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 125587 T418 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 125587 T418 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 125588 T418 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 125589 T418 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 125589 T418 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 125590 T418 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 125590 T418 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 125591 T418 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 125591 T418 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 125607 T418 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 125615 T418 oass.SolrIndexSearcher.<init> Opening Searcher@5805ff17 main
[junit4:junit4] 2> 125615 T418 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty1/tlog
[junit4:junit4] 2> 125616 T418 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 125617 T418 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 125621 T419 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5805ff17 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 125623 T418 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 125624 T418 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 126164 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 126165 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22126_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22126/k"}
[junit4:junit4] 2> 126165 T398 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 126166 T398 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 126205 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 126205 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 126205 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 126627 T418 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 126627 T418 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:22126/k collection:collection1 shard:shard1
[junit4:junit4] 2> 126628 T418 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 126653 T418 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 126662 T418 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 126662 T418 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 126662 T418 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:22126/k/collection1/
[junit4:junit4] 2> 126663 T418 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 126663 T418 oasc.SyncStrategy.syncToMe http://127.0.0.1:22126/k/collection1/ has no replicas
[junit4:junit4] 2> 126663 T418 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:22126/k/collection1/
[junit4:junit4] 2> 126663 T418 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 127713 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 127757 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 127757 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 127757 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 127803 T418 oasc.ZkController.register We are http://127.0.0.1:22126/k/collection1/ and leader is http://127.0.0.1:22126/k/collection1/
[junit4:junit4] 2> 127803 T418 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:22126/k
[junit4:junit4] 2> 127803 T418 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 127803 T418 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 127804 T418 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 127806 T418 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 127808 T375 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 127809 T375 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 127809 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 128097 T375 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 128101 T375 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:22136
[junit4:junit4] 2> 128101 T375 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 128102 T375 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 128102 T375 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369006308366
[junit4:junit4] 2> 128103 T375 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369006308366/solr.xml
[junit4:junit4] 2> 128103 T375 oasc.CoreContainer.<init> New CoreContainer 116032026
[junit4:junit4] 2> 128104 T375 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369006308366/'
[junit4:junit4] 2> 128105 T375 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369006308366/'
[junit4:junit4] 2> 128233 T375 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 128234 T375 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 128235 T375 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 128235 T375 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 128236 T375 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 128236 T375 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 128237 T375 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 128237 T375 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 128238 T375 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 128238 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 128257 T375 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 128257 T375 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:22112/solr
[junit4:junit4] 2> 128258 T375 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 128259 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 128262 T431 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@461800f1 name:ZooKeeperConnection Watcher:127.0.0.1:22112 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 128263 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 128266 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 128279 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 128282 T433 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16175c73 name:ZooKeeperConnection Watcher:127.0.0.1:22112/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 128282 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 128295 T375 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 129273 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 129274 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:22126_k_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22126_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22126/k"}
[junit4:junit4] 2> 129301 T375 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:22136_k
[junit4:junit4] 2> 129304 T375 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:22136_k
[junit4:junit4] 2> 129315 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 129315 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 129316 T433 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 129317 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 129318 T404 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 129318 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 129319 T417 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 129319 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 129326 T397 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 129326 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 129328 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 129332 T434 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369006308366/collection1
[junit4:junit4] 2> 129332 T434 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 129333 T434 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 129334 T434 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 129336 T434 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369006308366/collection1/'
[junit4:junit4] 2> 129337 T434 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369006308366/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 129338 T434 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369006308366/collection1/lib/README' to classloader
[junit4:junit4] 2> 129390 T434 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 129465 T434 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 129567 T434 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 129574 T434 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 130182 T434 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 130186 T434 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 130189 T434 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 130195 T434 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 130238 T434 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 130238 T434 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369006308366/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty2/
[junit4:junit4] 2> 130238 T434 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@46192223
[junit4:junit4] 2> 130239 T434 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 130240 T434 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty2
[junit4:junit4] 2> 130241 T434 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty2/index/
[junit4:junit4] 2> 130241 T434 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 130241 T434 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty2/index
[junit4:junit4] 2> 130246 T434 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@65d289a2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@33ad860c),segFN=segments_1,generation=1}
[junit4:junit4] 2> 130246 T434 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 130249 T434 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 130250 T434 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 130250 T434 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 130251 T434 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 130252 T434 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 130252 T434 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 130252 T434 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 130253 T434 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 130253 T434 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 130273 T434 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 130281 T434 oass.SolrIndexSearcher.<init> Opening Searcher@60feb3a7 main
[junit4:junit4] 2> 130282 T434 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty2/tlog
[junit4:junit4] 2> 130283 T434 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 130283 T434 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 130288 T435 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@60feb3a7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 130290 T434 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 130291 T434 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 130823 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 130824 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22136_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22136/k"}
[junit4:junit4] 2> 130824 T398 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 130824 T398 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 130843 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 130843 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 130843 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 130843 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 131304 T434 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 131304 T434 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:22136/k collection:collection1 shard:shard2
[junit4:junit4] 2> 131305 T434 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 131323 T434 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 131334 T434 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 131334 T434 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 131335 T434 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:22136/k/collection1/
[junit4:junit4] 2> 131335 T434 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 131335 T434 oasc.SyncStrategy.syncToMe http://127.0.0.1:22136/k/collection1/ has no replicas
[junit4:junit4] 2> 131335 T434 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:22136/k/collection1/
[junit4:junit4] 2> 131335 T434 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 132351 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 132414 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 132414 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 132414 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 132414 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 132419 T434 oasc.ZkController.register We are http://127.0.0.1:22136/k/collection1/ and leader is http://127.0.0.1:22136/k/collection1/
[junit4:junit4] 2> 132419 T434 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:22136/k
[junit4:junit4] 2> 132419 T434 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 132419 T434 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 132420 T434 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 132424 T434 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 132426 T375 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 132427 T375 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 132428 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 132714 T375 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 132718 T375 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:22140
[junit4:junit4] 2> 132719 T375 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 132719 T375 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 132720 T375 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369006312984
[junit4:junit4] 2> 132720 T375 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369006312984/solr.xml
[junit4:junit4] 2> 132721 T375 oasc.CoreContainer.<init> New CoreContainer 1263131874
[junit4:junit4] 2> 132721 T375 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369006312984/'
[junit4:junit4] 2> 132722 T375 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369006312984/'
[junit4:junit4] 2> 132866 T375 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 132867 T375 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 132867 T375 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 132868 T375 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 132868 T375 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 132869 T375 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 132869 T375 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 132870 T375 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 132870 T375 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 132871 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 132889 T375 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 132890 T375 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:22112/solr
[junit4:junit4] 2> 132891 T375 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 132892 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 132895 T447 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@304c186f name:ZooKeeperConnection Watcher:127.0.0.1:22112 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 132896 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 132899 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 132912 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 132915 T449 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4893faed name:ZooKeeperConnection Watcher:127.0.0.1:22112/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 132915 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 132927 T375 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 133930 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 133931 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:22136_k_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22136_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22136/k"}
[junit4:junit4] 2> 133933 T375 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:22140_k
[junit4:junit4] 2> 133935 T375 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:22140_k
[junit4:junit4] 2> 133948 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 133949 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 133955 T449 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 133955 T449 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 133955 T433 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 133956 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 133957 T404 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 133957 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 133957 T417 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 133957 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 133959 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 133960 T397 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 133960 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 133961 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 133963 T450 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369006312984/collection1
[junit4:junit4] 2> 133963 T450 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 133964 T450 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 133964 T450 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 133966 T450 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369006312984/collection1/'
[junit4:junit4] 2> 133968 T450 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369006312984/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 133968 T450 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369006312984/collection1/lib/README' to classloader
[junit4:junit4] 2> 134021 T450 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 134082 T450 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 134183 T450 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 134187 T450 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 134652 T450 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 134656 T450 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 134659 T450 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 134665 T450 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 134708 T450 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 134708 T450 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369006312984/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty3/
[junit4:junit4] 2> 134709 T450 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@46192223
[junit4:junit4] 2> 134709 T450 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 134710 T450 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty3
[junit4:junit4] 2> 134710 T450 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty3/index/
[junit4:junit4] 2> 134711 T450 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 134711 T450 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty3/index
[junit4:junit4] 2> 134715 T450 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5fd016bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ebb7672),segFN=segments_1,generation=1}
[junit4:junit4] 2> 134716 T450 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 134719 T450 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 134719 T450 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 134720 T450 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 134721 T450 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 134721 T450 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 134722 T450 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 134722 T450 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 134723 T450 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 134723 T450 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 134740 T450 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 134747 T450 oass.SolrIndexSearcher.<init> Opening Searcher@40e44b84 main
[junit4:junit4] 2> 134748 T450 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty3/tlog
[junit4:junit4] 2> 134749 T450 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 134749 T450 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 134753 T451 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@40e44b84 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 134756 T450 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 134756 T450 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 135463 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 135464 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22140_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22140/k"}
[junit4:junit4] 2> 135464 T398 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 135464 T398 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 135490 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 135491 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 135491 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 135491 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 135491 T449 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 135759 T450 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 135759 T450 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:22140/k collection:collection1 shard:shard1
[junit4:junit4] 2> 135771 T450 oasc.ZkController.register We are http://127.0.0.1:22140/k/collection1/ and leader is http://127.0.0.1:22126/k/collection1/
[junit4:junit4] 2> 135771 T450 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:22140/k
[junit4:junit4] 2> 135771 T450 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 135772 T450 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C19 name=collection1 org.apache.solr.core.SolrCore@5b9755a9 url=http://127.0.0.1:22140/k/collection1 node=127.0.0.1:22140_k C19_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:22140_k, base_url=http://127.0.0.1:22140/k}
[junit4:junit4] 2> 135780 T452 C19 P22140 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 135780 T450 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 135781 T452 C19 P22140 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 135782 T452 C19 P22140 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 135782 T452 C19 P22140 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 135783 T375 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 135783 T375 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 135784 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 135784 T452 C19 P22140 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 135834 T407 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:22140_k_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 136095 T375 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 136099 T375 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:22146
[junit4:junit4] 2> 136100 T375 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 136101 T375 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 136101 T375 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369006316350
[junit4:junit4] 2> 136102 T375 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369006316350/solr.xml
[junit4:junit4] 2> 136102 T375 oasc.CoreContainer.<init> New CoreContainer 1996356364
[junit4:junit4] 2> 136103 T375 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369006316350/'
[junit4:junit4] 2> 136103 T375 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369006316350/'
[junit4:junit4] 2> 136231 T375 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 136232 T375 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 136233 T375 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 136233 T375 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 136234 T375 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 136234 T375 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 136235 T375 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 136235 T375 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 136236 T375 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 136236 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 136253 T375 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 136254 T375 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:22112/solr
[junit4:junit4] 2> 136255 T375 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 136256 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 136263 T464 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@461c5b7d name:ZooKeeperConnection Watcher:127.0.0.1:22112 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 136264 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 136276 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 136289 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 136291 T466 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36753693 name:ZooKeeperConnection Watcher:127.0.0.1:22112/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 136292 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 136304 T375 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 136998 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 136999 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:22140_k_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22140_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22140/k"}
[junit4:junit4] 2> 137039 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 137039 T449 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 137039 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 137039 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 137039 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 137039 T466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 137309 T375 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:22146_k
[junit4:junit4] 2> 137311 T375 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:22146_k
[junit4:junit4] 2> 137315 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 137315 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 137315 T466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 137315 T397 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 137316 T449 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 137316 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 137316 T433 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 137316 T449 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 137316 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 137318 T417 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 137318 T404 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 137318 T466 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 137326 T467 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369006316350/collection1
[junit4:junit4] 2> 137327 T467 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 137328 T467 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 137328 T467 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 137330 T467 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369006316350/collection1/'
[junit4:junit4] 2> 137331 T467 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369006316350/collection1/lib/README' to classloader
[junit4:junit4] 2> 137332 T467 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369006316350/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 137384 T467 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 137446 T467 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 137548 T467 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 137555 T467 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 137837 T407 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:22140_k_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 137838 T407 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:22140_k_collection1&state=recovering&nodeName=127.0.0.1:22140_k&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2011
[junit4:junit4] 2> 138221 T467 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 138226 T467 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 138229 T467 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 138235 T467 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 138275 T467 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 138275 T467 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369006316350/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty4/
[junit4:junit4] 2> 138275 T467 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@46192223
[junit4:junit4] 2> 138276 T467 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 138277 T467 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty4
[junit4:junit4] 2> 138277 T467 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty4/index/
[junit4:junit4] 2> 138277 T467 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 138278 T467 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty4/index
[junit4:junit4] 2> 138283 T467 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4dc6d6d4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@52334621),segFN=segments_1,generation=1}
[junit4:junit4] 2> 138283 T467 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 138287 T467 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 138287 T467 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 138288 T467 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 138289 T467 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 138289 T467 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 138290 T467 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 138290 T467 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 138291 T467 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 138291 T467 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 138313 T467 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 138322 T467 oass.SolrIndexSearcher.<init> Opening Searcher@1d418a9 main
[junit4:junit4] 2> 138323 T467 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty4/tlog
[junit4:junit4] 2> 138324 T467 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 138324 T467 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 138329 T468 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d418a9 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 138331 T467 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 138332 T467 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 138547 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 138548 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22146_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22146/k"}
[junit4:junit4] 2> 138548 T398 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 138548 T398 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 138562 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 138562 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 138562 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 138562 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 138562 T449 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 138562 T466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 139335 T467 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 139335 T467 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:22146/k collection:collection1 shard:shard2
[junit4:junit4] 2> 139340 T467 oasc.ZkController.register We are http://127.0.0.1:22146/k/collection1/ and leader is http://127.0.0.1:22136/k/collection1/
[junit4:junit4] 2> 139340 T467 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:22146/k
[junit4:junit4] 2> 139341 T467 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 139341 T467 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C20 name=collection1 org.apache.solr.core.SolrCore@7fcc441 url=http://127.0.0.1:22146/k/collection1 node=127.0.0.1:22146_k C20_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:22146_k, base_url=http://127.0.0.1:22146/k}
[junit4:junit4] 2> 139341 T469 C20 P22146 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 139343 T467 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 139343 T469 C20 P22146 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 139343 T469 C20 P22146 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 139343 T469 C20 P22146 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 139344 T375 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 139345 T375 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 139345 T469 C20 P22146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 139345 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 139364 T375 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 139366 T423 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:22146_k_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 139367 T375 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 139368 T375 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 139369 T375 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C19_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:22140_k, base_url=http://127.0.0.1:22140/k}
[junit4:junit4] 2> 139840 T452 C19 P22140 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:22126/k/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 139852 T452 C19 P22140 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 139873 T452 C19 P22140 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:22140/k START replicas=[http://127.0.0.1:22126/k/collection1/] nUpdates=100
[junit4:junit4] 2> 139874 T452 C19 P22140 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 139875 T452 C19 P22140 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 139875 T452 C19 P22140 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 139875 T452 C19 P22140 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 139875 T452 C19 P22140 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 139876 T452 C19 P22140 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:22126/k/collection1/. core=collection1
[junit4:junit4] 2> 139876 T452 C19 P22140 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C21 name=collection1 org.apache.solr.core.SolrCore@2d287af3 url=http://127.0.0.1:22126/k/collection1 node=127.0.0.1:22126_k C21_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:22126_k, base_url=http://127.0.0.1:22126/k, leader=true}
[junit4:junit4] 2> 139884 T408 C21 P22126 oasc.SolrCore.execute [collection1] webapp=/k path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 139911 T409 C21 P22126 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 139914 T409 C21 P22126 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@293962c5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19fa46c7),segFN=segments_1,generation=1}
[junit4:junit4] 2> 139915 T409 C21 P22126 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 139915 T409 C21 P22126 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@293962c5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19fa46c7),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@293962c5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19fa46c7),segFN=segments_2,generation=2}
[junit4:junit4] 2> 139916 T409 C21 P22126 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 139916 T409 C21 P22126 oass.SolrIndexSearcher.<init> Opening Searcher@584b11a5 realtime
[junit4:junit4] 2> 139917 T409 C21 P22126 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 139917 T409 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 27
[junit4:junit4] 2> 139993 T452 C19 P22140 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 139994 T452 C19 P22140 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4] 2> 140017 T452 C19 P22140 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 140020 T410 C21 P22126 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 140021 T410 C21 P22126 oasc.SolrCore.execute [collection1] webapp=/k path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 140023 T452 C19 P22140 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 140023 T452 C19 P22140 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 140023 T452 C19 P22140 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 140027 T410 C21 P22126 oasc.SolrCore.execute [collection1] webapp=/k path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 140028 T452 C19 P22140 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 140029 T452 C19 P22140 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty3/index.20130520053200567
[junit4:junit4] 2> 140029 T452 C19 P22140 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@282b4cce lockFactory=org.apache.lucene.store.NativeFSLockFactory@69eaa05e) fullCopy=false
[junit4:junit4] 2> 140044 T410 C21 P22126 oasc.SolrCore.execute [collection1] webapp=/k path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=6
[junit4:junit4] 2> 140061 T452 C19 P22140 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 140062 T452 C19 P22140 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 140063 T452 C19 P22140 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 140070 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 140071 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:22146_k_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22146_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22146/k"}
[junit4:junit4] 2> 140072 T452 C19 P22140 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5fd016bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ebb7672),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5fd016bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ebb7672),segFN=segments_2,generation=2}
[junit4:junit4] 2> 140072 T452 C19 P22140 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 140073 T452 C19 P22140 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 140073 T452 C19 P22140 oass.SolrIndexSearcher.<init> Opening Searcher@971372b main
[junit4:junit4] 2> 140074 T451 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@971372b main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 140075 T452 C19 P22140 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty3/index.20130520053200567 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty3/index.20130520053200567;done=true>>]
[junit4:junit4] 2> 140075 T452 C19 P22140 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty3/index.20130520053200567
[junit4:junit4] 2> 140076 T452 C19 P22140 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty3/index.20130520053200567
[junit4:junit4] 2> 140076 T452 C19 P22140 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 140076 T452 C19 P22140 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 140076 T452 C19 P22140 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 140077 T452 C19 P22140 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 140085 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 140085 T466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 140085 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 140085 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 140085 T449 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 140085 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 140086 T452 C19 P22140 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 140368 T423 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:22146_k_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 140368 T423 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:22146_k_collection1&state=recovering&nodeName=127.0.0.1:22146_k&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 140371 T375 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 141375 T375 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 141593 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 141595 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:22140_k_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22140_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22140/k"}
[junit4:junit4] 2> 141614 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 141614 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 141614 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 141614 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 141614 T449 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 141614 T466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> C20_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:22146_k, base_url=http://127.0.0.1:22146/k}
[junit4:junit4] 2> 142370 T469 C20 P22146 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:22136/k/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 142370 T469 C20 P22146 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:22146/k START replicas=[http://127.0.0.1:22136/k/collection1/] nUpdates=100
[junit4:junit4] 2> 142371 T469 C20 P22146 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 142371 T469 C20 P22146 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 142371 T469 C20 P22146 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 142371 T469 C20 P22146 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 142372 T469 C20 P22146 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 142372 T469 C20 P22146 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:22136/k/collection1/. core=collection1
[junit4:junit4] 2> 142373 T469 C20 P22146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 142379 T375 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C22 name=collection1 org.apache.solr.core.SolrCore@38731ea3 url=http://127.0.0.1:22136/k/collection1 node=127.0.0.1:22136_k C22_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:22136_k, base_url=http://127.0.0.1:22136/k, leader=true}
[junit4:junit4] 2> 142385 T424 C22 P22136 oasc.SolrCore.execute [collection1] webapp=/k path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 142393 T425 C22 P22136 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 142396 T425 C22 P22136 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@65d289a2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@33ad860c),segFN=segments_1,generation=1}
[junit4:junit4] 2> 142396 T425 C22 P22136 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 142397 T425 C22 P22136 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@65d289a2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@33ad860c),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@65d289a2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@33ad860c),segFN=segments_2,generation=2}
[junit4:junit4] 2> 142397 T425 C22 P22136 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 142398 T425 C22 P22136 oass.SolrIndexSearcher.<init> Opening Searcher@103e479c realtime
[junit4:junit4] 2> 142399 T425 C22 P22136 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 142399 T425 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 142400 T469 C20 P22146 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 142401 T469 C20 P22146 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 142404 T426 C22 P22136 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 142404 T426 C22 P22136 oasc.SolrCore.execute [collection1] webapp=/k path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 142405 T469 C20 P22146 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 142405 T469 C20 P22146 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 142405 T469 C20 P22146 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 142409 T426 C22 P22136 oasc.SolrCore.execute [collection1] webapp=/k path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 142410 T469 C20 P22146 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 142411 T469 C20 P22146 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty4/index.20130520053202949
[junit4:junit4] 2> 142411 T469 C20 P22146 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@4854b21a lockFactory=org.apache.lucene.store.NativeFSLockFactory@7eb1c060) fullCopy=false
[junit4:junit4] 2> 142414 T426 C22 P22136 oasc.SolrCore.execute [collection1] webapp=/k path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 142416 T469 C20 P22146 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 142417 T469 C20 P22146 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 142417 T469 C20 P22146 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 142419 T469 C20 P22146 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4dc6d6d4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@52334621),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4dc6d6d4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@52334621),segFN=segments_2,generation=2}
[junit4:junit4] 2> 142419 T469 C20 P22146 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 142420 T469 C20 P22146 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 142420 T469 C20 P22146 oass.SolrIndexSearcher.<init> Opening Searcher@20fef93d main
[junit4:junit4] 2> 142421 T468 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@20fef93d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 142422 T469 C20 P22146 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty4/index.20130520053202949 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty4/index.20130520053202949;done=true>>]
[junit4:junit4] 2> 142422 T469 C20 P22146 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty4/index.20130520053202949
[junit4:junit4] 2> 142423 T469 C20 P22146 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty4/index.20130520053202949
[junit4:junit4] 2> 142423 T469 C20 P22146 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 142423 T469 C20 P22146 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 142423 T469 C20 P22146 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 142423 T469 C20 P22146 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 142425 T469 C20 P22146 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 143123 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 143124 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:22146_k_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22146_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22146/k"}
[junit4:junit4] 2> 143137 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 143137 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 143137 T466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 143137 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 143137 T449 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 143137 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 143381 T375 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 143383 T375 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C23 name=collection1 org.apache.solr.core.SolrCore@78344b3e url=http://127.0.0.1:22115/k/collection1 node=127.0.0.1:22115_k C23_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:22115_k, base_url=http://127.0.0.1:22115/k, leader=true}
[junit4:junit4] 2> 143393 T387 C23 P22115 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 143396 T387 C23 P22115 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16b374ce lockFactory=org.apache.lucene.store.NativeFSLockFactory@21019571),segFN=segments_1,generation=1}
[junit4:junit4] 2> 143396 T387 C23 P22115 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 143397 T387 C23 P22115 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16b374ce lockFactory=org.apache.lucene.store.NativeFSLockFactory@21019571),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16b374ce lockFactory=org.apache.lucene.store.NativeFSLockFactory@21019571),segFN=segments_2,generation=2}
[junit4:junit4] 2> 143397 T387 C23 P22115 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 143398 T387 C23 P22115 oass.SolrIndexSearcher.<init> Opening Searcher@7aad6070 main
[junit4:junit4] 2> 143399 T387 C23 P22115 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 143399 T401 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7aad6070 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 143400 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 143416 T427 C22 P22136 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 143417 T427 C22 P22136 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@65d289a2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@33ad860c),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@65d289a2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@33ad860c),segFN=segments_3,generation=3}
[junit4:junit4] 2> 143417 T427 C22 P22136 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 143418 T427 C22 P22136 oass.SolrIndexSearcher.<init> Opening Searcher@30dfc977 main
[junit4:junit4] 2> 143418 T427 C22 P22136 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 143419 T435 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@30dfc977 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 143437 T427 C22 P22136 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:22126/k/collection1/, StdNode: http://127.0.0.1:22140/k/collection1/, StdNode: http://127.0.0.1:22146/k/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 143446 T411 C21 P22126 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 143448 T411 C21 P22126 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@293962c5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19fa46c7),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@293962c5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19fa46c7),segFN=segments_3,generation=3}
[junit4:junit4] 2> 143448 T411 C21 P22126 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 143449 T411 C21 P22126 oass.SolrIndexSearcher.<init> Opening Searcher@432209af main
[junit4:junit4] 2> 143449 T411 C21 P22126 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 143450 T419 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@432209af main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 143451 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> C20_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:22146_k, base_url=http://127.0.0.1:22146/k}
[junit4:junit4] 2> 143455 T456 C20 P22146 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C19_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:22140_k, base_url=http://127.0.0.1:22140/k}
[junit4:junit4] 2> 143455 T439 C19 P22140 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 143456 T456 C20 P22146 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4dc6d6d4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@52334621),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4dc6d6d4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@52334621),segFN=segments_3,generation=3}
[junit4:junit4] 2> 143457 T439 C19 P22140 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5fd016bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ebb7672),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5fd016bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ebb7672),segFN=segments_3,generation=3}
[junit4:junit4] 2> 143457 T456 C20 P22146 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 143458 T439 C19 P22140 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 143458 T456 C20 P22146 oass.SolrIndexSearcher.<init> Opening Searcher@4da79a2e main
[junit4:junit4] 2> 143459 T439 C19 P22140 oass.SolrIndexSearcher.<init> Opening Searcher@2037bb1c main
[junit4:junit4] 2> 143459 T456 C20 P22146 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 143460 T439 C19 P22140 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 143460 T468 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4da79a2e main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 143460 T451 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2037bb1c main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 143461 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 143461 T439 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 143462 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 47
[junit4:junit4] 2> 143464 T375 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 143468 T412 C21 P22126 oasc.SolrCore.execute [collection1] webapp=/k path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 143471 T440 C19 P22140 oasc.SolrCore.execute [collection1] webapp=/k path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 143474 T428 C22 P22136 oasc.SolrCore.execute [collection1] webapp=/k path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 143476 T457 C20 P22146 oasc.SolrCore.execute [collection1] webapp=/k path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 145488 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435507177319038976)} 0 7
[junit4:junit4] 2> 145505 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={update.distrib=FROMLEADER&_version_=-1435507177325330432&update.from=http://127.0.0.1:22136/k/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435507177325330432)} 0 2
[junit4:junit4] 2> 145510 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={update.distrib=FROMLEADER&_version_=-1435507177337913344&update.from=http://127.0.0.1:22126/k/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435507177337913344)} 0 1
[junit4:junit4] 2> 145511 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1435507177337913344)} 0 7
[junit4:junit4] 2> 145512 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435507177325330432)} 0 20
[junit4:junit4] 2> 145516 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[0 (1435507177349447680)]} 0 1
[junit4:junit4] 2> 145544 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1435507177374613504)]} 0 1
[junit4:junit4] 2> 145545 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[0 (1435507177374613504)]} 0 6
[junit4:junit4] 2> 145546 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[0]} 0 27
[junit4:junit4] 2> 145550 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[1 (1435507177384050688)]} 0 1
[junit4:junit4] 2> 145558 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1435507177389293568)]} 0 1
[junit4:junit4] 2> 145559 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[1 (1435507177389293568)]} 0 6
[junit4:junit4] 2> 145563 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[2 (1435507177398730752)]} 0 1
[junit4:junit4] 2> 145573 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1435507177405022208)]} 0 1
[junit4:junit4] 2> 145574 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[2 (1435507177405022208)]} 0 6
[junit4:junit4] 2> 145575 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[2]} 0 9
[junit4:junit4] 2> 145580 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[3 (1435507177415507968)]} 0 1
[junit4:junit4] 2> 145589 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1435507177421799424)]} 0 1
[junit4:junit4] 2> 145590 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[3 (1435507177421799424)]} 0 5
[junit4:junit4] 2> 145594 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[4 (1435507177431236608)]} 0 1
[junit4:junit4] 2> 145601 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1435507177435430912)]} 0 1
[junit4:junit4] 2> 145602 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[4 (1435507177435430912)]} 0 5
[junit4:junit4] 2> 145606 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[5 (1435507177443819520)]} 0 1
[junit4:junit4] 2> 145616 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1435507177451159552)]} 0 1
[junit4:junit4] 2> 145617 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[5 (1435507177451159552)]} 0 5
[junit4:junit4] 2> 145618 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[5]} 0 9
[junit4:junit4] 2> 145622 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[6 (1435507177460596736)]} 0 1
[junit4:junit4] 2> 145629 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1435507177464791040)]} 0 1
[junit4:junit4] 2> 145630 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[6 (1435507177464791040)]} 0 5
[junit4:junit4] 2> 145634 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[7 (1435507177473179648)]} 0 1
[junit4:junit4] 2> 145644 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1435507177480519680)]} 0 1
[junit4:junit4] 2> 145645 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[7 (1435507177480519680)]} 0 5
[junit4:junit4] 2> 145646 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[7]} 0 9
[junit4:junit4] 2> 145650 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[8 (1435507177489956864)]} 0 1
[junit4:junit4] 2> 145657 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1435507177494151168)]} 0 1
[junit4:junit4] 2> 145658 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[8 (1435507177494151168)]} 0 5
[junit4:junit4] 2> 145662 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[9 (1435507177501491200)]} 0 1
[junit4:junit4] 2> 145669 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[9 (1435507177506734080)]} 0 1
[junit4:junit4] 2> 145670 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[9 (1435507177506734080)]} 0 5
[junit4:junit4] 2> 145674 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[10 (1435507177515122688)]} 0 1
[junit4:junit4] 2> 145684 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1435507177522462720)]} 0 1
[junit4:junit4] 2> 145685 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[10 (1435507177522462720)]} 0 5
[junit4:junit4] 2> 145686 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[10]} 0 9
[junit4:junit4] 2> 145690 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[11 (1435507177531899904)]} 0 1
[junit4:junit4] 2> 145700 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1435507177539239936)]} 0 1
[junit4:junit4] 2> 145701 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[11 (1435507177539239936)]} 0 5
[junit4:junit4] 2> 145702 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[11]} 0 9
[junit4:junit4] 2> 145706 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[12 (1435507177548677120)]} 0 1
[junit4:junit4] 2> 145713 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[12 (1435507177551822848)]} 0 1
[junit4:junit4] 2> 145714 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[12 (1435507177551822848)]} 0 5
[junit4:junit4] 2> 145718 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[13 (1435507177561260032)]} 0 1
[junit4:junit4] 2> 145725 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[13 (1435507177565454336)]} 0 1
[junit4:junit4] 2> 145726 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[13 (1435507177565454336)]} 0 5
[junit4:junit4] 2> 145730 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[14 (1435507177573842944)]} 0 1
[junit4:junit4] 2> 145741 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[14 (1435507177581182976)]} 0 1
[junit4:junit4] 2> 145742 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[14 (1435507177581182976)]} 0 6
[junit4:junit4] 2> 145743 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[14]} 0 10
[junit4:junit4] 2> 145747 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[15 (1435507177590620160)]} 0 1
[junit4:junit4] 2> 145754 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[15 (1435507177595863040)]} 0 1
[junit4:junit4] 2> 145755 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[15 (1435507177595863040)]} 0 5
[junit4:junit4] 2> 145759 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[16 (1435507177604251648)]} 0 1
[junit4:junit4] 2> 145767 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[16 (1435507177608445952)]} 0 1
[junit4:junit4] 2> 145768 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[16 (1435507177608445952)]} 0 5
[junit4:junit4] 2> 145772 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[17 (1435507177617883136)]} 0 1
[junit4:junit4] 2> 145782 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[17 (1435507177625223168)]} 0 1
[junit4:junit4] 2> 145783 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[17 (1435507177625223168)]} 0 5
[junit4:junit4] 2> 145784 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[17]} 0 9
[junit4:junit4] 2> 145788 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[18 (1435507177634660352)]} 0 1
[junit4:junit4] 2> 145798 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[18 (1435507177642000384)]} 0 1
[junit4:junit4] 2> 145799 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[18 (1435507177642000384)]} 0 5
[junit4:junit4] 2> 145799 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[18]} 0 8
[junit4:junit4] 2> 145803 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[19 (1435507177649340416)]} 0 1
[junit4:junit4] 2> 145810 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[19 (1435507177653534720)]} 0 1
[junit4:junit4] 2> 145811 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[19 (1435507177653534720)]} 0 5
[junit4:junit4] 2> 145815 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[20 (1435507177661923328)]} 0 1
[junit4:junit4] 2> 145822 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[20 (1435507177666117632)]} 0 1
[junit4:junit4] 2> 145823 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[20 (1435507177666117632)]} 0 5
[junit4:junit4] 2> 145827 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[21 (1435507177674506240)]} 0 1
[junit4:junit4] 2> 145837 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[21 (1435507177682894848)]} 0 1
[junit4:junit4] 2> 145838 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[21 (1435507177682894848)]} 0 5
[junit4:junit4] 2> 145838 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[21]} 0 8
[junit4:junit4] 2> 145842 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[22 (1435507177690234880)]} 0 1
[junit4:junit4] 2> 145852 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[22 (1435507177698623488)]} 0 1
[junit4:junit4] 2> 145853 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[22 (1435507177698623488)]} 0 5
[junit4:junit4] 2> 145853 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[22]} 0 8
[junit4:junit4] 2> 145857 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[23 (1435507177705963520)]} 0 1
[junit4:junit4] 2> 145867 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[23 (1435507177713303552)]} 0 1
[junit4:junit4] 2> 145868 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[23 (1435507177713303552)]} 0 5
[junit4:junit4] 2> 145869 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[23]} 0 9
[junit4:junit4] 2> 145873 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[24 (1435507177722740736)]} 0 1
[junit4:junit4] 2> 145883 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[24 (1435507177731129344)]} 0 1
[junit4:junit4] 2> 145884 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[24 (1435507177731129344)]} 0 5
[junit4:junit4] 2> 145884 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[24]} 0 8
[junit4:junit4] 2> 145888 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[25 (1435507177739517952)]} 0 1
[junit4:junit4] 2> 145898 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[25 (1435507177746857984)]} 0 1
[junit4:junit4] 2> 145899 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[25 (1435507177746857984)]} 0 5
[junit4:junit4] 2> 145899 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[25]} 0 8
[junit4:junit4] 2> 145903 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[26 (1435507177754198016)]} 0 1
[junit4:junit4] 2> 145913 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[26 (1435507177762586624)]} 0 1
[junit4:junit4] 2> 145914 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[26 (1435507177762586624)]} 0 5
[junit4:junit4] 2> 145915 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[26]} 0 9
[junit4:junit4] 2> 145918 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[27 (1435507177769926656)]} 0 1
[junit4:junit4] 2> 145925 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[27 (1435507177774120960)]} 0 1
[junit4:junit4] 2> 145926 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[27 (1435507177774120960)]} 0 5
[junit4:junit4] 2> 145930 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[28 (1435507177783558144)]} 0 1
[junit4:junit4] 2> 145940 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[28 (1435507177789849600)]} 0 1
[junit4:junit4] 2> 145941 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[28 (1435507177789849600)]} 0 5
[junit4:junit4] 2> 145941 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[28]} 0 8
[junit4:junit4] 2> 145945 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[29 (1435507177798238208)]} 0 1
[junit4:junit4] 2> 145952 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[29 (1435507177803481088)]} 0 1
[junit4:junit4] 2> 145953 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[29 (1435507177803481088)]} 0 5
[junit4:junit4] 2> 145957 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[30 (1435507177810821120)]} 0 1
[junit4:junit4] 2> 145964 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[30 (1435507177816064000)]} 0 1
[junit4:junit4] 2> 145965 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[30 (1435507177816064000)]} 0 5
[junit4:junit4] 2> 145969 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[31 (1435507177823404032)]} 0 1
[junit4:junit4] 2> 145976 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[31 (1435507177827598336)]} 0 1
[junit4:junit4] 2> 145977 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[31 (1435507177827598336)]} 0 5
[junit4:junit4] 2> 145981 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[32 (1435507177835986944)]} 0 1
[junit4:junit4] 2> 145991 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[32 (1435507177844375552)]} 0 1
[junit4:junit4] 2> 145992 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[32 (1435507177844375552)]} 0 5
[junit4:junit4] 2> 145992 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[32]} 0 8
[junit4:junit4] 2> 145996 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[33 (1435507177851715584)]} 0 1
[junit4:junit4] 2> 146006 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[33 (1435507177860104192)]} 0 1
[junit4:junit4] 2> 146007 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[33 (1435507177860104192)]} 0 5
[junit4:junit4] 2> 146007 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[33]} 0 8
[junit4:junit4] 2> 146011 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[34 (1435507177867444224)]} 0 1
[junit4:junit4] 2> 146021 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[34 (1435507177874784256)]} 0 1
[junit4:junit4] 2> 146022 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[34 (1435507177874784256)]} 0 5
[junit4:junit4] 2> 146022 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[34]} 0 8
[junit4:junit4] 2> 146026 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[35 (1435507177883172864)]} 0 1
[junit4:junit4] 2> 146036 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[35 (1435507177890512896)]} 0 1
[junit4:junit4] 2> 146037 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[35 (1435507177890512896)]} 0 5
[junit4:junit4] 2> 146037 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[35]} 0 8
[junit4:junit4] 2> 146041 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[36 (1435507177898901504)]} 0 1
[junit4:junit4] 2> 146048 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[36 (1435507177903095808)]} 0 1
[junit4:junit4] 2> 146049 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[36 (1435507177903095808)]} 0 5
[junit4:junit4] 2> 146053 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[37 (1435507177911484416)]} 0 1
[junit4:junit4] 2> 146063 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[37 (1435507177918824448)]} 0 1
[junit4:junit4] 2> 146064 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[37 (1435507177918824448)]} 0 5
[junit4:junit4] 2> 146065 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[37]} 0 9
[junit4:junit4] 2> 146069 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[38 (1435507177928261632)]} 0 1
[junit4:junit4] 2> 146079 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[38 (1435507177936650240)]} 0 1
[junit4:junit4] 2> 146080 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[38 (1435507177936650240)]} 0 5
[junit4:junit4] 2> 146080 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[38]} 0 8
[junit4:junit4] 2> 146084 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[39 (1435507177943990272)]} 0 1
[junit4:junit4] 2> 146091 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[39 (1435507177948184576)]} 0 1
[junit4:junit4] 2> 146092 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[39 (1435507177948184576)]} 0 5
[junit4:junit4] 2> 146096 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[40 (1435507177956573184)]} 0 1
[junit4:junit4] 2> 146103 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[40 (1435507177960767488)]} 0 1
[junit4:junit4] 2> 146104 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[40 (1435507177960767488)]} 0 5
[junit4:junit4] 2> 146108 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[41 (1435507177969156096)]} 0 1
[junit4:junit4] 2> 146118 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[41 (1435507177977544704)]} 0 1
[junit4:junit4] 2> 146119 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[41 (1435507177977544704)]} 0 5
[junit4:junit4] 2> 146119 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[41]} 0 8
[junit4:junit4] 2> 146123 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[42 (1435507177984884736)]} 0 1
[junit4:junit4] 2> 146130 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[42 (1435507177990127616)]} 0 1
[junit4:junit4] 2> 146131 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[42 (1435507177990127616)]} 0 5
[junit4:junit4] 2> 146135 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[43 (1435507177997467648)]} 0 1
[junit4:junit4] 2> 146142 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[43 (1435507178001661952)]} 0 1
[junit4:junit4] 2> 146143 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[43 (1435507178001661952)]} 0 5
[junit4:junit4] 2> 146146 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[44 (1435507178009001984)]} 0 1
[junit4:junit4] 2> 146153 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[44 (1435507178014244864)]} 0 1
[junit4:junit4] 2> 146154 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[44 (1435507178014244864)]} 0 5
[junit4:junit4] 2> 146158 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[45 (1435507178021584896)]} 0 1
[junit4:junit4] 2> 146168 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[45 (1435507178029973504)]} 0 1
[junit4:junit4] 2> 146169 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[45 (1435507178029973504)]} 0 5
[junit4:junit4] 2> 146170 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[45]} 0 9
[junit4:junit4] 2> 146173 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[46 (1435507178037313536)]} 0 1
[junit4:junit4] 2> 146183 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[46 (1435507178044653568)]} 0 1
[junit4:junit4] 2> 146184 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[46 (1435507178044653568)]} 0 5
[junit4:junit4] 2> 146185 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[46]} 0 8
[junit4:junit4] 2> 146188 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[47 (1435507178053042176)]} 0 1
[junit4:junit4] 2> 146198 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[47 (1435507178060382208)]} 0 1
[junit4:junit4] 2> 146199 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[47 (1435507178060382208)]} 0 5
[junit4:junit4] 2> 146199 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[47]} 0 8
[junit4:junit4] 2> 146203 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[48 (1435507178068770816)]} 0 1
[junit4:junit4] 2> 146210 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[48 (1435507178072965120)]} 0 1
[junit4:junit4] 2> 146211 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[48 (1435507178072965120)]} 0 5
[junit4:junit4] 2> 146215 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[49 (1435507178081353728)]} 0 1
[junit4:junit4] 2> 146222 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[49 (1435507178085548032)]} 0 1
[junit4:junit4] 2> 146223 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[49 (1435507178085548032)]} 0 5
[junit4:junit4] 2> 146227 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[50 (1435507178093936640)]} 0 1
[junit4:junit4] 2> 146237 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[50 (1435507178101276672)]} 0 1
[junit4:junit4] 2> 146238 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[50 (1435507178101276672)]} 0 5
[junit4:junit4] 2> 146238 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[50]} 0 8
[junit4:junit4] 2> 146242 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[51 (1435507178109665280)]} 0 1
[junit4:junit4] 2> 146249 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[51 (1435507178113859584)]} 0 1
[junit4:junit4] 2> 146250 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[51 (1435507178113859584)]} 0 5
[junit4:junit4] 2> 146254 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[52 (1435507178122248192)]} 0 1
[junit4:junit4] 2> 146261 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[52 (1435507178126442496)]} 0 1
[junit4:junit4] 2> 146262 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[52 (1435507178126442496)]} 0 5
[junit4:junit4] 2> 146266 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[53 (1435507178135879680)]} 0 1
[junit4:junit4] 2> 146276 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[53 (1435507178143219712)]} 0 1
[junit4:junit4] 2> 146277 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[53 (1435507178143219712)]} 0 5
[junit4:junit4] 2> 146277 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[53]} 0 8
[junit4:junit4] 2> 146281 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[54 (1435507178150559744)]} 0 1
[junit4:junit4] 2> 146291 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[54 (1435507178158948352)]} 0 1
[junit4:junit4] 2> 146292 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[54 (1435507178158948352)]} 0 5
[junit4:junit4] 2> 146292 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[54]} 0 8
[junit4:junit4] 2> 146296 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[55 (1435507178166288384)]} 0 1
[junit4:junit4] 2> 146303 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[55 (1435507178170482688)]} 0 1
[junit4:junit4] 2> 14630
[...truncated too long message...]
[junit4:junit4] 2> 1794675 T2237 oasc.SyncStrategy.syncReplicas We have been closed, won't attempt to sync replicas back to leader
[junit4:junit4] 2> 1794676 T2237 oasc.ShardLeaderElectionContext.runLeaderProcess Sync was not a success but no one else is active! I am the leader
[junit4:junit4] 2> 1794676 T2237 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59234/collection1/
[junit4:junit4] 2> 1794676 T2237 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@433b9799
[junit4:junit4] 2> 1794678 T2237 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=51,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 1794678 T2237 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 1794679 T2237 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 1794679 T2237 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 1794697 T2237 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 1794700 T2237 oasc.CachingDirectoryFactory.close Closing NRTCachingDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 1794700 T2237 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369007107831/jetty4/index [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369007107831/jetty4/index;done=false>>]
[junit4:junit4] 2> 1794700 T2237 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369007107831/jetty4/index
[junit4:junit4] 2> 1794701 T2237 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369007107831/jetty4 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369007107831/jetty4;done=false>>]
[junit4:junit4] 2> 1794701 T2237 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369007107831/jetty4
[junit4:junit4] 2> 1794702 T2237 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1794704 T2237 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election/89719249819336716-127.0.0.1:59234__collection1-n_0000000006
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:152)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:260)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 1794705 T2237 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 1794706 T2237 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1794706 T2237 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1794706 T2237 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=ar_BH, timezone=America/Argentina/ComodRivadavia
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=3,free=205963144,total=334495744
[junit4:junit4] 2> NOTE: All tests run in this JVM: [QueryResultKeyTest, TestSchemaResource, SolrIndexSplitterTest, TestCoreContainer, TestFastWriter, TestQuerySenderListener, FastVectorHighlighterTest, DistributedSpellCheckComponentTest, TestDocumentBuilder, SynonymTokenizerTest, BasicFunctionalityTest, TestValueSourceCache, SchemaVersionSpecificBehaviorTest, TestRealTimeGet, TestPHPSerializedResponseWriter, TestSolrCoreProperties, FileBasedSpellCheckerTest, PluginInfoTest, CSVRequestHandlerTest, ChaosMonkeyShardSplitTest, ShowFileRequestHandlerTest, TestConfig, ScriptEngineTest, TestCloudManagedSchemaAddField, ZkCLITest, SliceStateUpdateTest, TestWriterPerf, SearchHandlerTest, LukeRequestHandlerTest, IndexSchemaTest, TestFunctionQuery, TestSweetSpotSimilarityFactory, PreAnalyzedFieldTest, BasicDistributedZkTest, TestSearchPerf, TestIBSimilarityFactory, TestTrie, PolyFieldTest, TestExtendedDismaxParser, ShardRoutingTest, TestPerFieldSimilarity, SpatialFilterTest, ShardSplitTest, AliasIntegrationTest, PeerSyncTest, TestReversedWildcardFilterFactory, MoreLikeThisHandlerTest, TestQueryUtils, FieldMutatingUpdateProcessorTest, CoreAdminHandlerTest, TestBadConfig, TestSurroundQueryParser, TestSolrDeletionPolicy1, MBeansHandlerTest, LoggingHandlerTest, BinaryUpdateRequestHandlerTest, UpdateRequestProcessorFactoryTest, WordBreakSolrSpellCheckerTest, TestCharFilters, SliceStateTest, RAMDirectoryFactoryTest, SuggesterFSTTest, TestDocSet, TermsComponentTest, TestManagedSchema, ZkControllerTest, AnalysisAfterCoreReloadTest, SimpleFacetsTest, TestPhraseSuggestions, PreAnalyzedUpdateProcessorTest, AutoCommitTest, DocumentBuilderTest, SyncSliceTest]
[junit4:junit4] Completed on J0 in 867.82s, 1 test, 1 failure <<< FAILURES!
[...truncated 397 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:377: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:357: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:1240: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:884: There were test failures: 295 suites, 1231 tests, 2 errors, 1 failure, 27 ignored (8 assumptions)
Total time: 53 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 3999 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/3999/
No tests ran.
Build Log:
[...truncated 7890 lines...]