You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/05/18 23:22:51 UTC
[JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3997 - Still
Failing
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3997/
1 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
There are still nodes recoverying - waited for 230 seconds
Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 230 seconds
at __randomizedtesting.SeedInfo.seed([318F5A6EBD38FDE5:B069D476CA679DD9]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:173)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:126)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:512)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:146)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9276 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4:junit4] 2> 57697 T270 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 57702 T270 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./solrtest-CollectionsAPIDistributedZkTest-1368910142315
[junit4:junit4] 2> 57709 T270 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 57714 T271 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 57915 T270 oasc.ZkTestServer.run start zk server on port:43768
[junit4:junit4] 2> 58113 T270 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 58154 T272 oazs.NIOServerCnxn.doIO WARN Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
[junit4:junit4] 2> 60192 T276 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2bf06943 name:ZooKeeperConnection Watcher:127.0.0.1:43768 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 60193 T270 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 60200 T270 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 60288 T270 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 60328 T279 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@135faeac name:ZooKeeperConnection Watcher:127.0.0.1:43768/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 60328 T270 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 60329 T270 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 60367 T270 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 60391 T270 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 60416 T270 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 60439 T270 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 60440 T270 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 60480 T270 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 60481 T270 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 60589 T270 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 60590 T270 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 60596 T270 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 60597 T270 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 60603 T270 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 60604 T270 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 60617 T270 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 60618 T270 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 60624 T270 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 60624 T270 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 60630 T270 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 60631 T270 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 60637 T270 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 60638 T270 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 60878 T270 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 60883 T270 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:43772
[junit4:junit4] 2> 60884 T270 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 60884 T270 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 60885 T270 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257
[junit4:junit4] 2> 60886 T270 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/solr.xml
[junit4:junit4] 2> 60886 T270 oasc.CoreContainer.<init> New CoreContainer 382674052
[junit4:junit4] 2> 60887 T270 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/'
[junit4:junit4] 2> 60887 T270 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/'
[junit4:junit4] 2> 61009 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257
[junit4:junit4] 2> 61011 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/collection1
[junit4:junit4] 2> 61012 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/collection1/lib
[junit4:junit4] 2> 61013 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/collection1/lib/classes
[junit4:junit4] 2> 61015 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/collection1/conf
[junit4:junit4] 2> 61139 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/collection1/conf/xslt
[junit4:junit4] 2> 61158 T270 oasc.SolrCoreDiscoverer.addCore Discovered properties file /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/conf/core.properties, adding to cores
[junit4:junit4] 2> 61168 T270 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 61169 T270 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 61169 T270 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 61170 T270 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 61170 T270 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 61171 T270 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 61171 T270 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 61172 T270 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 61173 T270 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 61173 T270 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 61194 T270 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 61194 T270 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43768/solr
[junit4:junit4] 2> 61224 T270 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 61225 T270 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 61251 T290 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6ec9ffaa name:ZooKeeperConnection Watcher:127.0.0.1:43768 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 61252 T270 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 61256 T270 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 61274 T270 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 61277 T292 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5c7df596 name:ZooKeeperConnection Watcher:127.0.0.1:43768/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 61278 T270 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 61291 T270 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 61315 T270 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 61342 T270 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 61345 T270 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43772_
[junit4:junit4] 2> 61352 T270 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43772_
[junit4:junit4] 2> 61366 T270 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 61402 T270 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 61415 T270 oasc.Overseer.start Overseer (id=89712895107203075-127.0.0.1:43772_-n_0000000000) starting
[junit4:junit4] 2> 61435 T270 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 61453 T294 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 61455 T270 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 61460 T270 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 61468 T270 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 61488 T293 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 61497 T270 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 61498 T270 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 61499 T270 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 61518 T270 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 61524 T270 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 61528 T297 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@166c8a0b name:ZooKeeperConnection Watcher:127.0.0.1:43768/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 61528 T270 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 61530 T270 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 61537 T270 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 61759 T270 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 61762 T270 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:43780
[junit4:junit4] 2> 61763 T270 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 61764 T270 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 61764 T270 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149
[junit4:junit4] 2> 61765 T270 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/solr.xml
[junit4:junit4] 2> 61766 T270 oasc.CoreContainer.<init> New CoreContainer 1692051098
[junit4:junit4] 2> 61766 T270 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/'
[junit4:junit4] 2> 61767 T270 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/'
[junit4:junit4] 2> 61876 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149
[junit4:junit4] 2> 61877 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/collection1
[junit4:junit4] 2> 61878 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/collection1/conf
[junit4:junit4] 2> 61948 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/collection1/conf/xslt
[junit4:junit4] 2> 62020 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/collection1/lib
[junit4:junit4] 2> 62021 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/collection1/lib/classes
[junit4:junit4] 2> 62029 T270 oasc.SolrCoreDiscoverer.addCore Discovered properties file /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/conf/core.properties, adding to cores
[junit4:junit4] 2> 62035 T270 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 62035 T270 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 62036 T270 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 62036 T270 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 62037 T270 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 62037 T270 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 62038 T270 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 62039 T270 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 62039 T270 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 62040 T270 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 62057 T270 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 62058 T270 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43768/solr
[junit4:junit4] 2> 62058 T270 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 62060 T270 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 62064 T308 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@575b6472 name:ZooKeeperConnection Watcher:127.0.0.1:43768 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 62065 T270 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 62081 T270 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 62097 T270 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 62099 T310 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@283f62e2 name:ZooKeeperConnection Watcher:127.0.0.1:43768/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 62100 T270 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 62113 T270 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 63119 T270 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43780_
[junit4:junit4] 2> 63148 T270 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43780_
[junit4:junit4] 2> 63159 T292 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 63159 T310 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 63159 T297 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 63172 T270 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 63173 T270 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 63173 T270 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 63406 T270 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 63409 T270 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:43783
[junit4:junit4] 2> 63410 T270 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 63411 T270 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 63411 T270 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799
[junit4:junit4] 2> 63412 T270 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/solr.xml
[junit4:junit4] 2> 63412 T270 oasc.CoreContainer.<init> New CoreContainer 973294279
[junit4:junit4] 2> 63413 T270 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/'
[junit4:junit4] 2> 63414 T270 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/'
[junit4:junit4] 2> 63531 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799
[junit4:junit4] 2> 63532 T270 oasc.SolrCoreDiscoverer.addCore Discovered properties file /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/conf/core.properties, adding to cores
[junit4:junit4] 2> 63534 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/collection1
[junit4:junit4] 2> 63535 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/collection1/conf
[junit4:junit4] 2> 63616 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/collection1/conf/xslt
[junit4:junit4] 2> 63676 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/collection1/lib
[junit4:junit4] 2> 63677 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/collection1/lib/classes
[junit4:junit4] 2> 63690 T270 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 63691 T270 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 63691 T270 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 63692 T270 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 63693 T270 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 63693 T270 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 63694 T270 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 63694 T270 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 63695 T270 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 63696 T270 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 63714 T270 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 63714 T270 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43768/solr
[junit4:junit4] 2> 63715 T270 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 63716 T270 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 63719 T322 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1af938fc name:ZooKeeperConnection Watcher:127.0.0.1:43768 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 63720 T270 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 63724 T270 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 63738 T270 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 63741 T324 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f029cdd name:ZooKeeperConnection Watcher:127.0.0.1:43768/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 63742 T270 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 63754 T270 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 64760 T270 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43783_
[junit4:junit4] 2> 64762 T270 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43783_
[junit4:junit4] 2> 64767 T297 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 64767 T324 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 64767 T310 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 64767 T292 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 64777 T270 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 64777 T270 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 64778 T270 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 65012 T270 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 65016 T270 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:43786
[junit4:junit4] 2> 65016 T270 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 65017 T270 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 65018 T270 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404
[junit4:junit4] 2> 65018 T270 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/solr.xml
[junit4:junit4] 2> 65019 T270 oasc.CoreContainer.<init> New CoreContainer 1137569142
[junit4:junit4] 2> 65020 T270 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/'
[junit4:junit4] 2> 65020 T270 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/'
[junit4:junit4] 2> 65128 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404
[junit4:junit4] 2> 65134 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/collection1
[junit4:junit4] 2> 65135 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/collection1/conf
[junit4:junit4] 2> 65178 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/collection1/conf/xslt
[junit4:junit4] 2> 65286 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/collection1/lib
[junit4:junit4] 2> 65289 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/collection1/lib/classes
[junit4:junit4] 2> 65291 T270 oasc.SolrCoreDiscoverer.addCore Discovered properties file /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/conf/core.properties, adding to cores
[junit4:junit4] 2> 65299 T270 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 65299 T270 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 65300 T270 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 65300 T270 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 65301 T270 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 65301 T270 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 65302 T270 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 65303 T270 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 65303 T270 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 65304 T270 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 65323 T270 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 65323 T270 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43768/solr
[junit4:junit4] 2> 65324 T270 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 65325 T270 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 65329 T336 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f1b2852 name:ZooKeeperConnection Watcher:127.0.0.1:43768 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 65330 T270 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 65333 T270 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 65338 T272 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13eb9671ca30009, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 65347 T270 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 65350 T338 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@402e74d7 name:ZooKeeperConnection Watcher:127.0.0.1:43768/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 65350 T270 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 65392 T270 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 66399 T270 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43786_
[junit4:junit4] 2> 66404 T270 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43786_
[junit4:junit4] 2> 66409 T324 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 66409 T292 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 66409 T297 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 66409 T338 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 66410 T310 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 66418 T270 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 66419 T270 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 66420 T270 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 66670 T270 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 66674 T270 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:43789
[junit4:junit4] 2> 66675 T270 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 66675 T270 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 66676 T270 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044
[junit4:junit4] 2> 66676 T270 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/solr.xml
[junit4:junit4] 2> 66677 T270 oasc.CoreContainer.<init> New CoreContainer 2111292825
[junit4:junit4] 2> 66678 T270 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/'
[junit4:junit4] 2> 66678 T270 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/'
[junit4:junit4] 2> 66812 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044
[junit4:junit4] 2> 66821 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/collection1
[junit4:junit4] 2> 66822 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/collection1/lib
[junit4:junit4] 2> 66823 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/collection1/lib/classes
[junit4:junit4] 2> 66826 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/collection1/conf
[junit4:junit4] 2> 66946 T270 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/collection1/conf/xslt
[junit4:junit4] 2> 66983 T270 oasc.SolrCoreDiscoverer.addCore Discovered properties file /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/conf/core.properties, adding to cores
[junit4:junit4] 2> 66990 T270 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 66990 T270 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 66991 T270 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 66991 T270 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 66992 T270 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 66992 T270 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 66993 T270 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 66994 T270 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 66994 T270 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 66995 T270 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 67013 T270 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 67014 T270 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43768/solr
[junit4:junit4] 2> 67015 T270 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 67016 T270 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 67018 T350 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8d7b3f0 name:ZooKeeperConnection Watcher:127.0.0.1:43768 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 67019 T270 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 67022 T270 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 67034 T270 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 67036 T352 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ee96caf name:ZooKeeperConnection Watcher:127.0.0.1:43768/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 67036 T270 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 67048 T270 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 68053 T270 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43789_
[junit4:junit4] 2> 68055 T270 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43789_
[junit4:junit4] 2> 68060 T324 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 68060 T338 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 68060 T297 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 68061 T352 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 68061 T292 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 68061 T310 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 68068 T270 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 68068 T270 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 68069 T270 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 68080 T270 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 68096 T300 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2
[junit4:junit4] 2> 68099 T292 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 68105 T294 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4:junit4] 2> "operation":"createcollection",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "maxShardsPerNode":null,
[junit4:junit4] 2> "createNodeSet":null,
[junit4:junit4] 2> "name":"nodes_used_collection",
[junit4:junit4] 2> "replicationFactor":"2"}
[junit4:junit4] 2> 68105 T294 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica1 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:43783_
[junit4:junit4] 2> 68120 T294 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica2 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:43780_
[junit4:junit4] 2> 68120 T294 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica1 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:43789_
[junit4:junit4] 2> 68120 T294 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica2 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:43786_
[junit4:junit4] 2> 68133 T342 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 68133 T328 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 68133 T342 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 68133 T314 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/nodes_used_collection_shard1_replica1
[junit4:junit4] 2> 68133 T301 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 68135 T342 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 68135 T314 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 68134 T328 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 68136 T342 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 68136 T301 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 68138 T328 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 68137 T314 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 68138 T328 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 68139 T301 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 68139 T314 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 68139 T342 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 68140 T301 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 68141 T342 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 68140 T328 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 68142 T314 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 68142 T328 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 68142 T314 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 68143 T301 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 68144 T301 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 68145 T342 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 68146 T328 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 68155 T314 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 68157 T342 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/nodes_used_collection_shard2_replica1/'
[junit4:junit4] 2> 68157 T301 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 68157 T328 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/nodes_used_collection_shard2_replica2/'
[junit4:junit4] 2> 68158 T314 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/nodes_used_collection_shard1_replica1/'
[junit4:junit4] 2> 68160 T301 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/nodes_used_collection_shard1_replica2/'
[junit4:junit4] 2> 68305 T301 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 68305 T328 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 68305 T342 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 68319 T314 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 68375 T301 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 68376 T328 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 68376 T342 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 68410 T314 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 68477 T301 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 68478 T328 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 68479 T342 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 68484 T301 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica2] Schema name=test
[junit4:junit4] 2> 68484 T328 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica2] Schema name=test
[junit4:junit4] 2> 68485 T342 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica1] Schema name=test
[junit4:junit4] 2> 68520 T314 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 68528 T314 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica1] Schema name=test
[junit4:junit4] 2> 69412 T314 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 69422 T314 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 69426 T314 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 69446 T314 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 69452 T314 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 69457 T314 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 69459 T314 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 69459 T314 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 69460 T314 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 69461 T314 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 69462 T314 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 69462 T314 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 69462 T314 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/nodes_used_collection_shard1_replica1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/nodes_used_collection_shard1_replica1/data/
[junit4:junit4] 2> 69463 T314 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@991e092
[junit4:junit4] 2> 69464 T314 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 69465 T314 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/nodes_used_collection_shard1_replica1/data
[junit4:junit4] 2> 69465 T314 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/nodes_used_collection_shard1_replica1/data/index/
[junit4:junit4] 2> 69465 T314 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/nodes_used_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 69466 T314 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/nodes_used_collection_shard1_replica1/data/index
[junit4:junit4] 2> 69470 T314 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@90638c7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@117e7259),segFN=segments_1,generation=1}
[junit4:junit4] 2> 69470 T314 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 69473 T314 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 69473 T314 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 69474 T314 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 69475 T314 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 69475 T314 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 69476 T314 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 69476 T314 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 69477 T314 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 69477 T314 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 69491 T314 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 69495 T314 oass.SolrIndexSearcher.<init> Opening Searcher@7337cbea main
[junit4:junit4] 2> 69496 T314 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/nodes_used_collection_shard1_replica1/data/tlog
[junit4:junit4] 2> 69497 T314 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 69497 T314 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 69501 T358 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica1] Registered new searcher Searcher@7337cbea main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 69504 T314 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=down
[junit4:junit4] 2> 69574 T328 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 69586 T328 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 69591 T328 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 69615 T328 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 69630 T328 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 69635 T328 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 69649 T328 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 69650 T328 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 69651 T328 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 69653 T328 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 69653 T328 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 69654 T328 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 69655 T328 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica2] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/nodes_used_collection_shard2_replica2/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/nodes_used_collection_shard2_replica2/data/
[junit4:junit4] 2> 69655 T328 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@991e092
[junit4:junit4] 2> 69656 T328 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 69657 T328 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/nodes_used_collection_shard2_replica2/data
[junit4:junit4] 2> 69658 T328 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/nodes_used_collection_shard2_replica2/data/index/
[junit4:junit4] 2> 69658 T328 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica2] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/nodes_used_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 69659 T328 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/nodes_used_collection_shard2_replica2/data/index
[junit4:junit4] 2> 69661 T342 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 69664 T328 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4bb6ae36 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6cb59bd9),segFN=segments_1,generation=1}
[junit4:junit4] 2> 69665 T328 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 69669 T328 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 69669 T328 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 69670 T328 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 69671 T328 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 69672 T328 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 69673 T328 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 69673 T328 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 69674 T328 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 69675 T328 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 69676 T342 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 69680 T342 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 69688 T328 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 69692 T328 oass.SolrIndexSearcher.<init> Opening Searcher@3f13af36 main
[junit4:junit4] 2> 69692 T328 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/nodes_used_collection_shard2_replica2/data/tlog
[junit4:junit4] 2> 69693 T328 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 69694 T328 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 69698 T359 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica2] Registered new searcher Searcher@3f13af36 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 69699 T301 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 69701 T328 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=down
[junit4:junit4] 2> 69707 T301 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 69710 T301 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 69719 T342 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 69731 T301 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 69733 T342 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 69737 T301 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 69738 T342 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 69739 T342 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 69740 T342 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 69740 T342 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 69742 T342 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 69743 T342 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 69743 T301 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 69743 T342 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 69744 T342 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/nodes_used_collection_shard2_replica1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/nodes_used_collection_shard2_replica1/data/
[junit4:junit4] 2> 69744 T342 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@991e092
[junit4:junit4] 2> 69744 T301 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 69745 T342 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 69745 T301 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 69745 T301 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 69746 T342 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/nodes_used_collection_shard2_replica1/data
[junit4:junit4] 2> 69746 T342 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/nodes_used_collection_shard2_replica1/data/index/
[junit4:junit4] 2> 69747 T342 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/nodes_used_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 69747 T301 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 69747 T342 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/nodes_used_collection_shard2_replica1/data/index
[junit4:junit4] 2> 69748 T301 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 69748 T301 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 69749 T301 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica2] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/nodes_used_collection_shard1_replica2/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/nodes_used_collection_shard1_replica2/data/
[junit4:junit4] 2> 69749 T301 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@991e092
[junit4:junit4] 2> 69750 T301 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 69750 T301 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/nodes_used_collection_shard1_replica2/data
[junit4:junit4] 2> 69751 T301 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/nodes_used_collection_shard1_replica2/data/index/
[junit4:junit4] 2> 69751 T342 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@559582d9 lockFactory=org.apache.lucene.store.NativeFSLockFactory@296fa767),segFN=segments_1,generation=1}
[junit4:junit4] 2> 69751 T301 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica2] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/nodes_used_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 69751 T342 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 69752 T301 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/nodes_used_collection_shard1_replica2/data/index
[junit4:junit4] 2> 69754 T342 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 69755 T342 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 69755 T301 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7ae9dc0f lockFactory=org.apache.lucene.store.NativeFSLockFactory@1bae6216),segFN=segments_1,generation=1}
[junit4:junit4] 2> 69756 T301 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 69756 T342 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 69757 T342 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 69757 T342 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 69758 T342 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 69758 T342 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 69758 T301 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 69759 T342 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 69759 T301 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 69759 T342 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 69760 T301 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 69760 T301 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 69761 T301 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 69761 T301 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 69762 T301 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 69762 T301 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 69763 T301 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 69770 T342 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 69770 T301 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 69776 T342 oass.SolrIndexSearcher.<init> Opening Searcher@375046d6 main
[junit4:junit4] 2> 69777 T342 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/nodes_used_collection_shard2_replica1/data/tlog
[junit4:junit4] 2> 69777 T301 oass.SolrIndexSearcher.<init> Opening Searcher@302a18fd main
[junit4:junit4] 2> 69778 T301 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/nodes_used_collection_shard1_replica2/data/tlog
[junit4:junit4] 2> 69778 T342 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 69779 T342 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 69779 T301 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 69780 T301 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 69783 T360 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica1] Registered new searcher Searcher@375046d6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 69785 T342 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=down
[junit4:junit4] 2> 69785 T361 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica2] Registered new searcher Searcher@302a18fd main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 69789 T301 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=down
[junit4:junit4] 2> 70509 T293 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 70510 T293 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:43783_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43783"}
[junit4:junit4] 2> 70511 T293 oasc.Overseer$ClusterStateUpdater.createCollection Create collection nodes_used_collection with numShards 2
[junit4:junit4] 2> 70526 T293 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:43786_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43786"}
[junit4:junit4] 2> 70541 T293 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:43789_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43789"}
[junit4:junit4] 2> 70547 T293 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:43780_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43780"}
[junit4:junit4] 2> 70569 T297 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 70570 T292 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 70569 T338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 70569 T324 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 70569 T310 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 70569 T352 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 70716 T328 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 70716 T328 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica2 address:http://127.0.0.1:43786 collection:nodes_used_collection shard:shard2
[junit4:junit4] 2> 70723 T328 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 70740 T328 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard2/election
[junit4:junit4] 2> 70766 T328 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 70777 T328 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=180000
[junit4:junit4] 2> 70789 T342 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 70789 T342 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica1 address:http://127.0.0.1:43789 collection:nodes_used_collection shard:shard2
[junit4:junit4] 2> 70793 T301 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 70793 T301 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica2 address:http://127.0.0.1:43780 collection:nodes_used_collection shard:shard1
[junit4:junit4] 2> 70794 T301 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard1/election
[junit4:junit4] 2> 70803 T301 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 70807 T301 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=179999
[junit4:junit4] 2> 71280 T328 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 71281 T328 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 71281 T328 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:43786/nodes_used_collection_shard2_replica2/
[junit4:junit4] 2> 71292 T328 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 71315 T328 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:43786 START replicas=[http://127.0.0.1:43789/nodes_used_collection_shard2_replica1/] nUpdates=100
[junit4:junit4] 2> 71316 T328 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:43786 DONE. We have no versions. sync failed.
[junit4:junit4] 2> 71317 T328 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4] 2> 71318 T328 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4] 2> 71318 T328 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:43786/nodes_used_collection_shard2_replica2/
[junit4:junit4] 2> 71319 T328 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard2
[junit4:junit4] 2> ASYNC NEW_CORE C25 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@3e6cd583 url=http://127.0.0.1:43789/nodes_used_collection_shard2_replica1 node=127.0.0.1:43789_ C25_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=down, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:43789_, base_url=http://127.0.0.1:43789}
[junit4:junit4] 2> 71327 T343 C25 P43789 oasc.SolrCore.execute [nodes_used_collection_shard2_replica1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 71509 T314 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica1
[junit4:junit4] 2> 71509 T314 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica1 address:http://127.0.0.1:43783 collection:nodes_used_collection shard:shard1
[junit4:junit4] 2> 71814 T301 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 71814 T301 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 71815 T301 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:43780/nodes_used_collection_shard1_replica2/
[junit4:junit4] 2> 71816 T301 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica2 url=http://127.0.0.1:43780 START replicas=[http://127.0.0.1:43783/nodes_used_collection_shard1_replica1/] nUpdates=100
[junit4:junit4] 2> 71817 T301 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica2 url=http://127.0.0.1:43780 DONE. We have no versions. sync failed.
[junit4:junit4] 2> 71817 T301 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4] 2> 71818 T301 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4] 2> 71819 T301 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:43780/nodes_used_collection_shard1_replica2/
[junit4:junit4] 2> 71819 T301 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard1
[junit4:junit4] 2> ASYNC NEW_CORE C26 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore@45c0280a url=http://127.0.0.1:43783/nodes_used_collection_shard1_replica1 node=127.0.0.1:43783_ C26_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{shard=shard1, state=down, core=nodes_used_collection_shard1_replica1, collection=nodes_used_collection, node_name=127.0.0.1:43783_, base_url=http://127.0.0.1:43783}
[junit4:junit4] 2> 71827 T315 C26 P43783 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 72090 T293 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 72127 T297 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 72128 T292 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 72128 T338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 72128 T352 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 72128 T310 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 72128 T324 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 72142 T301 oasc.ZkController.register We are http://127.0.0.1:43780/nodes_used_collection_shard1_replica2/ and leader is http://127.0.0.1:43780/nodes_used_collection_shard1_replica2/
[junit4:junit4] 2> 72142 T301 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica2 baseURL=http://127.0.0.1:43780
[junit4:junit4] 2> 72142 T301 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 72143 T301 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=active
[junit4:junit4] 2> 72145 T301 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 72154 T342 oasc.ZkController.register We are http://127.0.0.1:43789/nodes_used_collection_shard2_replica1/ and leader is http://127.0.0.1:43786/nodes_used_collection_shard2_replica2/
[junit4:junit4] 2> 72154 T301 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=4026
[junit4:junit4] 2> 72154 T342 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica1 baseURL=http://127.0.0.1:43789
[junit4:junit4] 2> 72155 T342 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 72155 T342 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> 72158 T328 oasc.ZkController.register We are http://127.0.0.1:43786/nodes_used_collection_shard2_replica2/ and leader is http://127.0.0.1:43786/nodes_used_collection_shard2_replica2/
[junit4:junit4] 2> 72158 T328 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica2 baseURL=http://127.0.0.1:43786
[junit4:junit4] 2> 72158 T328 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 72159 T328 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=active
[junit4:junit4] 2> 72161 T364 C25 P43789 oasc.RecoveryStrategy.run Starting recovery process. core=nodes_used_collection_shard2_replica1 recoveringAfterStartup=true
[junit4:junit4] 2> 72161 T364 C25 P43789 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 72161 T328 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 72161 T364 C25 P43789 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=recovering
[junit4:junit4] 2> 72161 T342 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 72163 T328 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=4034
[junit4:junit4] 2> 72164 T364 C25 P43789 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 72164 T342 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=4035
[junit4:junit4] 2> 72179 T329 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:43789__nodes_used_collection_shard2_replica1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 72516 T314 oasc.ZkController.register We are http://127.0.0.1:43783/nodes_used_collection_shard1_replica1/ and leader is http://127.0.0.1:43780/nodes_used_collection_shard1_replica2/
[junit4:junit4] 2> 72516 T314 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica1 baseURL=http://127.0.0.1:43783
[junit4:junit4] 2> 72517 T314 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard1_replica1
[junit4:junit4] 2> 72517 T314 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> 72517 T365 C26 P43783 oasc.RecoveryStrategy.run Starting recovery process. core=nodes_used_collection_shard1_replica1 recoveringAfterStartup=true
[junit4:junit4] 2> 72518 T365 C26 P43783 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 72518 T314 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 72518 T365 C26 P43783 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=recovering
[junit4:junit4] 2> 72520 T314 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=4391
[junit4:junit4] 2> 72521 T365 C26 P43783 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 72521 T294 oasc.OverseerCollectionProcessor.createCollection Finished create command on all shards for collection: nodes_used_collection
[junit4:junit4] 2> 72537 T302 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:43783__nodes_used_collection_shard1_replica1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 72543 T310 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work/qnr-0000000000 state: SyncConnected type NodeDataChanged
[junit4:junit4] 2> 72546 T292 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 72546 T294 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000000 complete, response:{success={null={responseHeader={status=0,QTime=4026},core=nodes_used_collection_shard1_replica2},null={responseHeader={status=0,QTime=4034},core=nodes_used_collection_shard2_replica2},null={responseHeader={status=0,QTime=4035},core=nodes_used_collection_shard2_replica1},null={responseHeader={status=0,QTime=4391},core=nodes_used_collection_shard1_replica1}}}
[junit4:junit4] 2> 72559 T300 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2} status=0 QTime=4468
[junit4:junit4] 2> 72560 T270 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 72561 T270 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 72564 T367 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36dfc365 name:ZooKeeperConnection Watcher:127.0.0.1:43768/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 72564 T270 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 72566 T270 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 72571 T270 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 72574 T270 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 72576 T369 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@270747d1 name:ZooKeeperConnection Watcher:127.0.0.1:43768/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 72576 T270 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 72579 T270 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 72628 T316 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=5&maxShardsPerNode=3&name=awholynewcollection_0&replicationFactor=2&action=CREATE&wt=javabin&version=2
[junit4:junit4] 2> 72631 T292 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 72633 T292 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 72634 T294 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000002 message:{
[junit4:junit4] 2> "operation":"createcollection",
[junit4:junit4] 2> "numShards":"5",
[junit4:junit4] 2> "maxShardsPerNode":"3",
[junit4:junit4] 2> "createNodeSet":null,
[junit4:junit4] 2> "name":"awholynewcollection_0",
[junit4:junit4] 2> "replicationFactor":"2"}
[junit4:junit4] 2> 72634 T294 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica1 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:43780_
[junit4:junit4] 2> 72635 T294 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica2 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:43783_
[junit4:junit4] 2> 72635 T294 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica1 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:43786_
[junit4:junit4] 2> 72635 T294 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica2 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:43789_
[junit4:junit4] 2> 72636 T294 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica1 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:43772_
[junit4:junit4] 2> 72636 T294 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica2 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:43780_
[junit4:junit4] 2> 72637 T294 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica1 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:43783_
[junit4:junit4] 2> 72637 T294 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica2 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:43786_
[junit4:junit4] 2> 72638 T301 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/awholynewcollection_0_shard1_replica1
[junit4:junit4] 2> 72639 T282 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/awholynewcollection_0_shard3_replica1
[junit4:junit4] 2> 72640 T317 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/awholynewcollection_0_shard4_replica1
[junit4:junit4] 2> 72639 T303 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/awholynewcollection_0_shard3_replica2
[junit4:junit4] 2> 72639 T301 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 72639 T314 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/awholynewcollection_0_shard1_replica2
[junit4:junit4] 2> 72639 T328 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/awholynewcollection_0_shard2_replica1
[junit4:junit4] 2> 72639 T342 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/awholynewcollection_0_shard2_replica2
[junit4:junit4] 2> 72639 T294 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard5_replica1 as part of slice shard5 of collection awholynewcollection_0 on 127.0.0.1:43789_
[junit4:junit4] 2> 72643 T342 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 72642 T328 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 72642 T301 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 72642 T314 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 72641 T330 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/awholynewcollection_0_shard4_replica2
[junit4:junit4] 2> 72641 T303 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 72640 T317 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 72640 T282 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 72647 T303 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 72646 T314 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 72646 T330 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 72646 T344 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard5_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/awholynewcollection_0_shard5_replica1
[junit4:junit4] 2> 72645 T328 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 72645 T301 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 72644 T342 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 72643 T294 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard5_replica2 as part of slice shard5 of collection awholynewcollection_0 on 127.0.0.1:43772_
[junit4:junit4] 2> 72651 T342 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 72650 T328 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 72650 T330 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 72650 T344 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 72649 T314 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 72648 T282 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 72648 T303 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 72648 T317 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 72656 T314 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 72655 T282 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 72655 T328 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 72655 T344 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 72654 T283 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard5_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/awholynewcollection_0_shard5_replica2
[junit4:junit4] 2> 72654 T342 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 72653 T330 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 72652 T301 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 72659 T342 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 72659 T283 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 72659 T282 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 72658 T344 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 72658 T328 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 72657 T303 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 72657 T314 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 72656 T317 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 72664 T303 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 72662 T282 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 72662 T283 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 72661 T330 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 72661 T301 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 72667 T330 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 72667 T317 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 72667 T283 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 72666 T328 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 72666 T344 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 72665 T342 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 72675 T314 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 72677 T282 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 72678 T283 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 72677 T303 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 72679 T330 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 72679 T314 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/awholynewcollection_0_shard1_replica2/'
[junit4:junit4] 2> 72679 T342 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/awholynewcollection_0_shard2_replica2/'
[junit4:junit4] 2> 72679 T328 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/awholynewcollection_0_shard2_replica1/'
[junit4:junit4] 2> 72679 T301 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 72688 T317 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 72688 T344 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 72691 T282 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/awholynewcollection_0_shard3_replica1/'
[junit4:junit4] 2> 72691 T303 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/awholynewcollection_0_shard3_replica2/'
[junit4:junit4] 2> 72691 T330 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/awholynewcollection_0_shard4_replica2/'
[junit4:junit4] 2> 72691 T283 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 72691 T301 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/awholynewcollection_0_shard1_replica1/'
[junit4:junit4] 2> 72693 T317 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/awholynewcollection_0_shard4_replica1/'
[junit4:junit4] 2> 72695 T344 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/awholynewcollection_0_shard5_replica1/'
[junit4:junit4] 2> 72696 T283 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/awholynewcollection_0_shard5_replica2/'
[junit4:junit4] 2> 72793 T330 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 72794 T303 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 72802 T314 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 72807 T342 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 72809 T282 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 72810 T344 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 72816 T328 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 72833 T301 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 72842 T317 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 72871 T283 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 72998 T330 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 73008 T303 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 73013 T344 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 73013 T314 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 73015 T282 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 73017 T301 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 73018 T282 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 73018 T303 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 73020 T301 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 73022 T317 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 73022 T328 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 73023 T314 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 73023 T330 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 73023 T342 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 73025 T317 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 73025 T328 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 73026 T282 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica1] Schema name=test
[junit4:junit4] 2> 73027 T342 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 73029 T301 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica1] Schema name=test
[junit4:junit4] 2> 73031 T303 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica2] Schema name=test
[junit4:junit4] 2> 73026 T344 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 73044 T283 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 73045 T317 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica1] Schema name=test
[junit4:junit4] 2> 73045 T342 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica2] Schema name=test
[junit4:junit4] 2> 73045 T328 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica1] Schema name=test
[junit4:junit4] 2> 73045 T314 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica2] Schema name=test
[junit4:junit4] 2> 73045 T330 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica2] Schema name=test
[junit4:junit4] 2> 73047 T283 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 73046 T344 oass.IndexSchema.readSchema [awholynewcollection_0_shard5_replica1] Schema name=test
[junit4:junit4] 2> 73060 T283 oass.IndexSchema.readSchema [awholynewcollection_0_shard5_replica2] Schema name=test
[junit4:junit4] 2> 73659 T293 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 73676 T293 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:43780__nodes_used_collection_shard1_replica2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:43780_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43780"}
[junit4:junit4] 2> 73685 T293 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:43786__nodes_used_collection_shard2_replica2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:43786_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43786"}
[junit4:junit4] 2> 73694 T293 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:43789__nodes_used_collection_shard2_replica1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:43789_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43789"}
[junit4:junit4] 2> 73704 T293 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:43783__nodes_used_collection_shard1_replica1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:43783_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43783"}
[junit4:junit4] 2> 73717 T297 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 73718 T352 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 73718 T367 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 73718 T369 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 73718 T310 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 73718 T324 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 73718 T292 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 73718 T338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 74182 T329 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:43789__nodes_used_collection_shard2_replica1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 74183 T329 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:43789__nodes_used_collection_shard2_replica1&state=recovering&nodeName=127.0.0.1:43789_&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard2_replica2&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2004
[junit4:junit4] 2> 74292 T344 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 74312 T344 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 74318 T344 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 74347 T344 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 74355 T344 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 74364 T344 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 74366 T344 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 74367 T344 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 74367 T344 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 74369 T344 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 74384 T344 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 74385 T344 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 74386 T344 oasc.SolrCore.<init> [awholynewcollection_0_shard5_replica1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/awholynewcollection_0_shard5_replica1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/awholynewcollection_0_shard5_replica1/data/
[junit4:junit4] 2> 74387 T344 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@991e092
[junit4:junit4] 2> 74388 T344 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 74389 T344 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/awholynewcollection_0_shard5_replica1/data
[junit4:junit4] 2> 74390 T344 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/awholynewcollection_0_shard5_replica1/data/index/
[junit4:junit4] 2> 74391 T344 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard5_replica1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/awholynewcollection_0_shard5_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 74391 T282 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 74392 T344 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/awholynewcollection_0_shard5_replica1/data/index
[junit4:junit4] 2> 74398 T328 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 74401 T344 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@60f2441a lockFactory=org.apache.lucene.store.NativeFSLockFactory@2af40265),segFN=segments_1,generation=1}
[junit4:junit4] 2> 74402 T344 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 74409 T344 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 74410 T344 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 74411 T344 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 74412 T344 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 74414 T282 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 74414 T344 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 74415 T344 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 74416 T344 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 74417 T344 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 74418 T344 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 74419 T282 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 74422 T328 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 74428 T328 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 74431 T301 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 74440 T314 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 74449 T344 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 74450 T301 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 74456 T344 oass.SolrIndexSearcher.<init> Opening Searcher@2ba49598 main
[junit4:junit4] 2> 74457 T344 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/awholynewcollection_0_shard5_replica1/data/tlog
[junit4:junit4] 2> 74459 T301 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 74459 T344 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 74459 T314 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 74460 T344 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 74464 T317 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 74468 T314 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 74469 T283 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 74469 T376 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard5_replica1] Registered new searcher Searcher@2ba49598 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 74474 T344 oasc.ZkController.publish publishing core=awholynewcollection_0_shard5_replica1 state=down
[junit4:junit4] 2> 74477 T282 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 74480 T330 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 74482 T317 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 74487 T283 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 74491 T317 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 74494 T330 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 74494 T283 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 74501 T330 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 74510 T328 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 74519 T301 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 74525 T328 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 74526 T282 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 74529 T301 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 74530 T283 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 74530 T303 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 74531 T314 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 74535 T328 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 74535 T282 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 74537 T301 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 74538 T317 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 74538 T282 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 74537 T328 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 74540 T302 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:43783__nodes_used_collection_shard1_replica1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 74539 T282 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 74538 T283 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 74541 T282 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 74540 T302 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:43783__nodes_used_collection_shard1_replica1&state=recovering&nodeName=127.0.0.1:43783_&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard1_replica2&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 74540 T328 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 74543 T328 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 74543 T314 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 74547 T342 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 74547 T303 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 74554 T303 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 74561 T342 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 74566 T342 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 74624 T301 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 74624 T328 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 74624 T282 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 74625 T301 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 74625 T330 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 74627 T301 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 74626 T328 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 74626 T282 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 74629 T314 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 74629 T328 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 74629 T283 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 74631 T328 oasc.SolrCore.<init> [awholynewcollection_0_shard2_replica1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/awholynewcollection_0_shard2_replica1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/awholynewcollection_0_shard2_replica1/data/
[junit4:junit4] 2> 74630 T301 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 74630 T317 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 74630 T282 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 74634 T330 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 74634 T283 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 74633 T301 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 74633 T314 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 74632 T328 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@991e092
[junit4:junit4] 2> 74637 T314 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 74636 T301 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 74635 T283 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 74634 T282 oasc.SolrCore.<init> [awholynewcollection_0_shard3_replica1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/awholynewcollection_0_shard3_replica1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/awholynewcollection_0_shard3_replica1/data/
[junit4:junit4] 2> 74639 T283 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 74639 T301 oasc.SolrCore.<init> [awholynewcollection_0_shard1_replica1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/awholynewcollection_0_shard1_replica1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/awholynewcollection_0_shard1_replica1/data/
[junit4:junit4] 2> 74638 T314 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 74638 T328 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 74642 T283 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 74642 T301 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@991e092
[junit4:junit4] 2> 74641 T317 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 74645 T301 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 74641 T330 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 74640 T282 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@991e092
[junit4:junit4] 2> 74646 T301 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/awholynewcollection_0_shard1_replica1/data
[junit4:junit4] 2> 74644 T328 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/awholynewcollection_0_shard2_replica1/data
[junit4:junit4] 2> 74644 T314 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 74643 T283 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 74649 T314 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 74648 T328 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/awholynewcollection_0_shard2_replica1/data/index/
[junit4:junit4] 2> 74648 T330 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 74651 T330 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 74648 T342 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 74648 T301 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/awholynewcollection_0_shard1_replica1/data/index/
[junit4:junit4] 2> 74647 T282 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 74647 T317 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 74647 T303 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 74654 T282 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/awholynewcollection_0_shard3_replica1/data
[junit4:junit4] 2> 74654 T317 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 74653 T301 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard1_replica1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/awholynewcollection_0_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 74651 T330 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 74650 T328 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard2_replica1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/awholynewcollection_0_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 74650 T314 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 74649 T283 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 74658 T314 oasc.SolrCore.<init> [awholynewcollection_0_shard1_replica2] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/awholynewcollection_0_shard1_replica2/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/awholynewcollection_0_shard1_replica2/data/
[junit4:junit4] 2> 74657 T328 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/awholynewcollection_0_shard2_replica1/data/index
[junit4:junit4] 2> 74656 T301 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/awholynewcollection_0_shard1_replica1/data/index
[junit4:junit4] 2> 74655 T317 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 74655 T282 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/awholynewcollection_0_shard3_replica1/data/index/
[junit4:junit4] 2> 74660 T303 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 74660 T342 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 74662 T317 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 74659 T330 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 74659 T314 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@991e092
[junit4:junit4] 2> 74664 T328 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7a611515 lockFactory=org.apache.lucene.store.NativeFSLockFactory@44f066ab),segFN=segments_1,generation=1}
[junit4:junit4] 2> 74664 T314 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 74658 T283 oasc.SolrCore.<init> [awholynewcollection_0_shard5_replica2] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/awholynewcollection_0_shard5_replica2/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/awholynewcollection_0_shard5_replica2/data/
[junit4:junit4] 2> 74665 T314 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/awholynewcollection_0_shard1_replica2/data
[junit4:junit4] 2> 74664 T328 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 74663 T330 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 74663 T317 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 74661 T282 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard3_replica1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/awholynewcollection_0_shard3_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 74667 T317 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 74668 T282 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/awholynewcollection_0_shard3_replica1/data/index
[junit4:junit4] 2> 74667 T330 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 74666 T314 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/awholynewcollection_0_shard1_replica2/data/index/
[junit4:junit4] 2> 74665 T301 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1f7f6aba lockFactory=org.apache.lucene.store.NativeFSLockFactory@71793268),segFN=segments_1,generation=1}
[junit4:junit4] 2> 74665 T283 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@991e092
[junit4:junit4] 2> 74671 T301 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 74671 T328 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 74670 T314 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard1_replica2] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/awholynewcollection_0_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 74670 T330 oasc.SolrCore.<init> [awholynewcollection_0_shard4_replica2] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/awholynewcollection_0_shard4_replica2/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/awholynewcollection_0_shard4_replica2/data/
[junit4:junit4] 2> 74669 T317 oasc.SolrCore.<init> [awholynewcollection_0_shard4_replica1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/awholynewcollection_0_shard4_replica1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/awholynewcollection_0_shard4_replica1/data/
[junit4:junit4] 2> 74674 T330 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@991e092
[junit4:junit4] 2> 74674 T314 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/awholynewcollection_0_shard1_replica2/data/index
[junit4:junit4] 2> 74674 T328 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 74673 T303 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 74672 T283 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 74677 T328 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 74676 T330 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 74675 T282 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e186131 lockFactory=org.apache.lucene.store.NativeFSLockFactory@612e92f4),segFN=segments_1,generation=1}
[junit4:junit4] 2> 74679 T330 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/awholynewcollection_0_shard4_replica2/data
[junit4:junit4] 2> 74675 T317 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@991e092
[junit4:junit4] 2> 74680 T330 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/awholynewcollection_0_shard4_replica2/data/index/
[junit4:junit4] 2> 74680 T314 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2ee418b0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@492d8921),segFN=segments_1,generation=1}
[junit4:junit4] 2> 74679 T282 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 74679 T328 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 74678 T303 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 74683 T303 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 74678 T301 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 74678 T283 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/awholynewcollection_0_shard5_replica2/data
[junit4:junit4] 2> 74684 T301 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 74683 T303 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 74683 T328 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 74682 T314 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 74681 T330 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard4_replica2] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/awholynewcollection_0_shard4_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 74681 T317 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 74688 T330 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/awholynewcollection_0_shard4_replica2/data/index
[junit4:junit4] 2> 74686 T328 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 74686 T301 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 74685 T282 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 74685 T283 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/awholynewcollection_0_shard5_replica2/data/index/
[junit4:junit4] 2> 74691 T301 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 74691 T282 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 74691 T314 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 74693 T282 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 74689 T328 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 74688 T317 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/awholynewcollection_0_shard4_replica1/data
[junit4:junit4] 2> 74694 T342 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 74688 T303 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 74694 T317 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/awholynewcollection_0_shard4_replica1/data/index/
[junit4:junit4] 2> 74694 T328 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 74694 T330 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1c3d98d6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@69370e39),segFN=segments_1,generation=1}
[junit4:junit4] 2> 74694 T282 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 74693 T314 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 74692 T301 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 74691 T283 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard5_replica2] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/awholynewcollection_0_shard5_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 74699 T301 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 74699 T314 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 74698 T282 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 74697 T330 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 74697 T328 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 74697 T342 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 74696 T317 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard4_replica1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/awholynewcollection_0_shard4_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 74695 T303 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 74704 T317 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/awholynewcollection_0_shard4_replica1/data/index
[junit4:junit4] 2> 74703 T342 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 74701 T314 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 74701 T282 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 74706 T330 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 74700 T301 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 74700 T283 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/awholynewcollection_0_shard5_replica2/data/index
[junit4:junit4] 2> 74708 T301 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 74707 T330 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 74706 T282 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 74706 T314 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 74711 T282 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 74705 T342 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 74704 T303 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 74711 T282 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 74711 T314 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 74710 T330 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 74709 T301 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 74709 T317 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@32060461 lockFactory=org.apache.lucene.store.NativeFSLockFactory@192e2da9),segFN=segments_1,generation=1}
[junit4:junit4] 2> 74715 T342 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 74714 T330 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 74713 T314 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 74713 T303 oasc.SolrCore.<init> [awholynewcollection_0_shard3_replica2] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/awholynewcollection_0_shard3_replica2/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/awholynewcollection_0_shard3_replica2/data/
[junit4:junit4] 2> 74713 T283 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@8b3b1de lockFactory=org.apache.lucene.store.NativeFSLockFactory@8182f3d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 74717 T303 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@991e092
[junit4:junit4] 2> 74717 T314 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 74717 T330 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 74716 T342 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 74720 T328 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 74715 T317 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 74720 T342 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 74720 T301 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 74720 T282 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 74719 T330 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 74719 T314 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 74718 T303 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 74718 T283 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 74724 T317 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 74723 T330 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 74722 T342 oasc.SolrCore.<init> [awholynewcollection_0_shard2_replica2] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/awholynewcollection_0_shard2_replica2/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/awholynewcollection_0_shard2_replica2/data/
[junit4:junit4] 2> 74726 T330 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 74726 T317 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 74725 T303 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/awholynewcollection_0_shard3_replica2/data
[junit4:junit4] 2> 74728 T330 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 74727 T342 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@991e092
[junit4:junit4] 2> 74729 T303 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/awholynewcollection_0_shard3_replica2/data/index/
[junit4:junit4] 2> 74729 T283 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 74729 T317 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 74731 T283 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 74730 T303 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard3_replica2] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/awholynewcollection_0_shard3_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 74730 T342 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 74733 T303 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/awholynewcollection_0_shard3_replica2/data/index
[junit4:junit4] 2> 74733 T283 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 74733 T328 oass.SolrIndexSearcher.<init> Opening Searcher@776657b0 main
[junit4:junit4] 2> 74732 T317 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 74732 T282 oass.SolrIndexSearcher.<init> Opening Searcher@74c4178a main
[junit4:junit4] 2> 74736 T317 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 74735 T328 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/awholynewcollection_0_shard2_replica1/data/tlog
[junit4:junit4] 2> 74735 T283 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 74734 T301 oass.SolrIndexSearcher.<init> Opening Searcher@2168212f main
[junit4:junit4] 2> 74734 T342 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/awholynewcollection_0_shard2_replica2/data
[junit4:junit4] 2> 74739 T301 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/awholynewcollection_0_shard1_replica1/data/tlog
[junit4:junit4] 2> 74738 T328 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 74738 T283 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 74737 T317 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 74736 T282 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/awholynewcollection_0_shard3_replica1/data/tlog
[junit4:junit4] 2> 74741 T317 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 74741 T301 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 74741 T303 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6007210d lockFactory=org.apache.lucene.store.NativeFSLockFactory@7919e4ac),segFN=segments_1,generation=1}
[junit4:junit4] 2> 74741 T283 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 74740 T328 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 74739 T342 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/awholynewcollection_0_shard2_replica2/data/index/
[junit4:junit4] 2> 74744 T283 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 74744 T303 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 74743 T301 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 74743 T282 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 74743 T317 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 74748 T282 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 74747 T283 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 74746 T314 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 74746 T330 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 74746 T342 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard2_replica2] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/awholynewcollection_0_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 74751 T303 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 74751 T378 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard2_replica1] Registered new searcher Searcher@776657b0 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 74750 T283 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 74749 T317 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 74754 T379 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard1_replica1] Registered new searcher Searcher@2168212f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 74753 T303 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 74752 T342 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368910151044/awholynewcollection_0_shard2_replica2/data/index
[junit4:junit4] 2> 74756 T303 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 74755 T377 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard3_replica1] Registered new searcher Searcher@74c4178a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 74757 T303 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 74758 T328 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica1 state=down
[junit4:junit4] 2> 74759 T303 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 74760 T303 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 74760 T301 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica1 state=down
[junit4:junit4] 2> 74761 T303 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 74761 T330 oass.SolrIndexSearcher.<init> Opening Searcher@53f9f28b main
[junit4:junit4] 2> 74762 T282 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica1 state=down
[junit4:junit4] 2> 74763 T330 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368910149404/awholynewcollection_0_shard4_replica2/data/tlog
[junit4:junit4] 2> 74762 T303 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 74764 T314 oass.SolrIndexSearcher.<init> Opening Searcher@2ee79db main
[junit4:junit4] 2> 74764 T342 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4ae79e6a lockFactory=org.apache.lucene.store.NativeFSLockFactory@5323b2f4),segFN=segments_1,generation=1}
[junit4:junit4] 2> 74765 T314 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/awholynewcollection_0_shard1_replica2/data/tlog
[junit4:junit4] 2> 74765 T330 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 74764 T303 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 74766 T330 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 74765 T342 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 74767 T314 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 74769 T314 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 74772 T380 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard4_replica2] Registered new searcher Searcher@53f9f28b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 74773 T342 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 74774 T381 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard1_replica2] Registered new searcher Searcher@2ee79db main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 74774 T342 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 74775 T283 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 74776 T303 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 74775 T342 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 74776 T330 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica2 state=down
[junit4:junit4] 2> 74776 T317 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 74778 T342 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 74777 T314 oasc.ZkController.publish publishing core=awholynewcollection_0_shard1_replica2 state=down
[junit4:junit4] 2> 74779 T342 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 74780 T342 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 74781 T342 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 74782 T342 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 74783 T342 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 74784 T283 oass.SolrIndexSearcher.<init> Opening Searcher@6ec9a940 main
[junit4:junit4] 2> 74784 T303 oass.SolrIndexSearcher.<init> Opening Searcher@6203118c main
[junit4:junit4] 2> 74785 T283 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368910145257/awholynewcollection_0_shard5_replica2/data/tlog
[junit4:junit4] 2> 74785 T317 oass.SolrIndexSearcher.<init> Opening Searcher@576ec5d6 main
[junit4:junit4] 2> 74785 T303 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368910146149/awholynewcollection_0_shard3_replica2/data/tlog
[junit4:junit4] 2> 74787 T283 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 74787 T317 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368910147799/awholynewcollection_0_shard
[...truncated too long message...]
ction_1/leader_elect/shard2 (1)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard2/election (5)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard2/election/89712895107203078-127.0.0.1:43780__awholynewcollection_1_shard2_replica2-n_0000000001 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard2/election/89712895107203084-127.0.0.1:43789__awholynewcollection_1_shard2_replica5-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard2/election/89712895107203082-127.0.0.1:43786__awholynewcollection_1_shard2_replica1-n_0000000002 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard2/election/89712895107203075-127.0.0.1:43772__awholynewcollection_1_shard2_replica3-n_0000000003 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard2/election/89712895107203080-127.0.0.1:43783__awholynewcollection_1_shard2_replica4-n_0000000004 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leaders (2)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"awholynewcollection_1_shard1_replica1",
[junit4:junit4] 1> "node_name":"127.0.0.1:43786_",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:43786"}
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leaders/shard2 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"awholynewcollection_1_shard2_replica5",
[junit4:junit4] 1> "node_name":"127.0.0.1:43789_",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:43789"}
[junit4:junit4] 1> /solr/overseer_elect (2)
[junit4:junit4] 1> /solr/overseer_elect/election (5)
[junit4:junit4] 1> /solr/overseer_elect/election/89712895107203075-127.0.0.1:43772_-n_0000000000 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89712895107203082-127.0.0.1:43786_-n_0000000003 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89712895107203080-127.0.0.1:43783_-n_0000000002 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89712895107203078-127.0.0.1:43780_-n_0000000001 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89712895107203084-127.0.0.1:43789_-n_0000000004 (0)
[junit4:junit4] 1> /solr/overseer_elect/leader (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"id":"89712895107203075-127.0.0.1:43772_-n_0000000000"}
[junit4:junit4] 1> /zookeeper (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=318F5A6EBD38FDE5 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=da -Dtests.timezone=America/Bahia -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE 290s J1 | CollectionsAPIDistributedZkTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 230 seconds
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([318F5A6EBD38FDE5:B069D476CA679DD9]:0)
[junit4:junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:173)
[junit4:junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131)
[junit4:junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:126)
[junit4:junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:512)
[junit4:junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:146)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 347785 T270 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 290095 T269 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> 348708 T352 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/awholynewcollection_4/leader_elect/shard2/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 348709 T352 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/awholynewcollection_4/leader_elect/shard1/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 348709 T352 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 348710 T352 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 348710 T352 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=112), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=112)), sim=DefaultSimilarity, locale=da, timezone=America/Bahia
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=10,free=148460824,total=475004928
[junit4:junit4] 2> NOTE: All tests run in this JVM: [CopyFieldTest, PingRequestHandlerTest, SolrCmdDistributorTest, DirectSolrSpellCheckerTest, TestQuerySenderNoQuery, TestRecovery, CachingDirectoryFactoryTest, TestDFRSimilarityFactory, TestJmxIntegration, TestMaxScoreQueryParser, OpenExchangeRatesOrgProviderTest, ClusterStateTest, CollectionsAPIDistributedZkTest]
[junit4:junit4] Completed on J1 in 291.13s, 1 test, 1 failure <<< FAILURES!
[...truncated 801 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:377: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:357: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1240: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:884: There were test failures: 295 suites, 1231 tests, 1 failure, 27 ignored (8 assumptions)
Total time: 54 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 4000 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/4000/
3 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:22126/k returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:22126/k returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([7C8A44DAB2799276:FD6CCAC2C526F24A]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
REGRESSION: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
shard1 is not consistent. Got 305 from http://127.0.0.1:59229/collection1lastClient and got 5 from http://127.0.0.1:59234/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:59229/collection1lastClient and got 5 from http://127.0.0.1:59234/collection1
at __randomizedtesting.SeedInfo.seed([7C8A44DAB2799276:FD6CCAC2C526F24A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
FAILED: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:22220 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:22220 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([7C8A44DAB2799276:FD6CCAC2C526F24A]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9255 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeyShardSplitTest
[junit4:junit4] 2> 118358 T375 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /k/
[junit4:junit4] 2> 118366 T375 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeyShardSplitTest-1369006298906
[junit4:junit4] 2> 118378 T375 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 118386 T376 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 118588 T375 oasc.ZkTestServer.run start zk server on port:22112
[junit4:junit4] 2> 118864 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 118994 T382 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d12cf29 name:ZooKeeperConnection Watcher:127.0.0.1:22112 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 118995 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 119001 T375 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 119108 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 119111 T384 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e13a7b1 name:ZooKeeperConnection Watcher:127.0.0.1:22112/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 119111 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 119119 T375 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 119125 T375 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 119130 T375 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 119134 T375 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 119139 T375 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 119140 T375 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 119155 T375 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 119156 T375 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 119262 T375 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 119263 T375 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 119268 T375 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 119269 T375 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 119274 T375 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 119275 T375 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 119280 T375 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 119281 T375 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 119286 T375 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 119287 T375 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 119292 T375 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 119293 T375 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 119298 T375 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 119299 T375 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 119578 T375 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 119582 T375 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:22115
[junit4:junit4] 2> 119583 T375 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 119584 T375 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 119584 T375 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369006299844
[junit4:junit4] 2> 119585 T375 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369006299844/solr.xml
[junit4:junit4] 2> 119585 T375 oasc.CoreContainer.<init> New CoreContainer 1335115928
[junit4:junit4] 2> 119586 T375 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369006299844/'
[junit4:junit4] 2> 119586 T375 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369006299844/'
[junit4:junit4] 2> 119717 T375 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 119718 T375 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 119719 T375 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 119719 T375 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 119720 T375 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 119720 T375 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 119721 T375 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 119721 T375 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 119722 T375 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 119722 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 119740 T375 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 119741 T375 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:22112/solr
[junit4:junit4] 2> 119761 T375 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 119762 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 119765 T395 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17341fe4 name:ZooKeeperConnection Watcher:127.0.0.1:22112 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 119766 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 119775 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 119793 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 119795 T397 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@51bcbe0b name:ZooKeeperConnection Watcher:127.0.0.1:22112/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 119796 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 119810 T375 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 119828 T375 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 119851 T375 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 119854 T375 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:22115_k
[junit4:junit4] 2> 119863 T375 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:22115_k
[junit4:junit4] 2> 119869 T375 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 119906 T375 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 119911 T375 oasc.Overseer.start Overseer (id=89719196821422083-127.0.0.1:22115_k-n_0000000000) starting
[junit4:junit4] 2> 119935 T375 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 119961 T399 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 119962 T375 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 119966 T375 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 119969 T375 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 120002 T398 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 120021 T400 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369006299844/collection1
[junit4:junit4] 2> 120021 T400 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 120023 T400 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 120023 T400 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 120025 T400 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369006299844/collection1/'
[junit4:junit4] 2> 120027 T400 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369006299844/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 120027 T400 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369006299844/collection1/lib/README' to classloader
[junit4:junit4] 2> 120114 T400 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 120178 T400 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 120280 T400 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 120288 T400 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 121047 T400 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 121052 T400 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 121057 T400 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 121066 T400 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 121114 T400 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 121115 T400 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1369006299844/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/control/data/
[junit4:junit4] 2> 121115 T400 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@46192223
[junit4:junit4] 2> 121116 T400 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 121117 T400 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/control/data
[junit4:junit4] 2> 121117 T400 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/control/data/index/
[junit4:junit4] 2> 121117 T400 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 121118 T400 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/control/data/index
[junit4:junit4] 2> 121125 T400 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16b374ce lockFactory=org.apache.lucene.store.NativeFSLockFactory@21019571),segFN=segments_1,generation=1}
[junit4:junit4] 2> 121125 T400 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 121128 T400 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 121129 T400 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 121130 T400 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 121131 T400 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 121132 T400 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 121132 T400 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 121132 T400 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 121133 T400 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 121133 T400 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 121158 T400 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 121169 T400 oass.SolrIndexSearcher.<init> Opening Searcher@5af984fb main
[junit4:junit4] 2> 121169 T400 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/control/data/tlog
[junit4:junit4] 2> 121171 T400 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 121171 T400 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 121175 T401 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5af984fb main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 121176 T400 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 121177 T400 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 121514 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 121515 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22115_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22115/k"}
[junit4:junit4] 2> 121516 T398 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 121537 T398 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 121569 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 122215 T400 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 122215 T400 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:22115/k collection:control_collection shard:shard1
[junit4:junit4] 2> 122224 T400 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 122237 T400 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 122256 T400 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 122268 T400 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 122269 T400 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 122269 T400 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:22115/k/collection1/
[junit4:junit4] 2> 122269 T400 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 122269 T400 oasc.SyncStrategy.syncToMe http://127.0.0.1:22115/k/collection1/ has no replicas
[junit4:junit4] 2> 122270 T400 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:22115/k/collection1/
[junit4:junit4] 2> 122270 T400 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 123078 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 123097 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 123153 T400 oasc.ZkController.register We are http://127.0.0.1:22115/k/collection1/ and leader is http://127.0.0.1:22115/k/collection1/
[junit4:junit4] 2> 123153 T400 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:22115/k
[junit4:junit4] 2> 123153 T400 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 123154 T400 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 123154 T400 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 123157 T400 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 123158 T375 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 123159 T375 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 123160 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 123173 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 123180 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 123183 T404 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9b98c71 name:ZooKeeperConnection Watcher:127.0.0.1:22112/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 123183 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 123185 T375 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 123192 T375 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 123465 T375 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 123468 T375 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:22126
[junit4:junit4] 2> 123469 T375 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 123469 T375 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 123470 T375 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369006303731
[junit4:junit4] 2> 123470 T375 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369006303731/solr.xml
[junit4:junit4] 2> 123471 T375 oasc.CoreContainer.<init> New CoreContainer 1297274696
[junit4:junit4] 2> 123472 T375 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369006303731/'
[junit4:junit4] 2> 123472 T375 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369006303731/'
[junit4:junit4] 2> 123602 T375 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 123603 T375 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 123604 T375 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 123604 T375 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 123605 T375 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 123605 T375 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 123606 T375 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 123606 T375 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 123607 T375 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 123607 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 123627 T375 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 123628 T375 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:22112/solr
[junit4:junit4] 2> 123629 T375 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 123630 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 123634 T415 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6c342410 name:ZooKeeperConnection Watcher:127.0.0.1:22112 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 123634 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 123638 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 123652 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 123654 T417 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b5f2d1f name:ZooKeeperConnection Watcher:127.0.0.1:22112/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 123655 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 123668 T375 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 124613 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 124614 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:22115_k_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22115_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22115/k"}
[junit4:junit4] 2> 124656 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 124656 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 124656 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 124673 T375 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:22126_k
[junit4:junit4] 2> 124675 T375 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:22126_k
[junit4:junit4] 2> 124679 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 124679 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 124679 T397 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 124680 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 124681 T404 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 124682 T417 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 124696 T418 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369006303731/collection1
[junit4:junit4] 2> 124696 T418 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 124697 T418 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 124697 T418 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 124700 T418 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369006303731/collection1/'
[junit4:junit4] 2> 124701 T418 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369006303731/collection1/lib/README' to classloader
[junit4:junit4] 2> 124702 T418 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369006303731/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 124757 T418 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 124823 T418 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 124925 T418 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 124932 T418 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 125513 T418 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 125517 T418 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 125519 T418 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 125525 T418 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 125570 T418 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 125570 T418 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1369006303731/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty1/
[junit4:junit4] 2> 125571 T418 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@46192223
[junit4:junit4] 2> 125571 T418 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 125572 T418 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty1
[junit4:junit4] 2> 125572 T418 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty1/index/
[junit4:junit4] 2> 125573 T418 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 125574 T418 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty1/index
[junit4:junit4] 2> 125583 T418 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@293962c5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19fa46c7),segFN=segments_1,generation=1}
[junit4:junit4] 2> 125584 T418 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 125587 T418 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 125587 T418 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 125588 T418 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 125589 T418 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 125589 T418 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 125590 T418 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 125590 T418 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 125591 T418 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 125591 T418 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 125607 T418 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 125615 T418 oass.SolrIndexSearcher.<init> Opening Searcher@5805ff17 main
[junit4:junit4] 2> 125615 T418 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty1/tlog
[junit4:junit4] 2> 125616 T418 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 125617 T418 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 125621 T419 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5805ff17 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 125623 T418 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 125624 T418 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 126164 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 126165 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22126_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22126/k"}
[junit4:junit4] 2> 126165 T398 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 126166 T398 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 126205 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 126205 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 126205 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 126627 T418 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 126627 T418 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:22126/k collection:collection1 shard:shard1
[junit4:junit4] 2> 126628 T418 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 126653 T418 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 126662 T418 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 126662 T418 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 126662 T418 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:22126/k/collection1/
[junit4:junit4] 2> 126663 T418 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 126663 T418 oasc.SyncStrategy.syncToMe http://127.0.0.1:22126/k/collection1/ has no replicas
[junit4:junit4] 2> 126663 T418 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:22126/k/collection1/
[junit4:junit4] 2> 126663 T418 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 127713 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 127757 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 127757 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 127757 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 127803 T418 oasc.ZkController.register We are http://127.0.0.1:22126/k/collection1/ and leader is http://127.0.0.1:22126/k/collection1/
[junit4:junit4] 2> 127803 T418 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:22126/k
[junit4:junit4] 2> 127803 T418 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 127803 T418 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 127804 T418 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 127806 T418 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 127808 T375 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 127809 T375 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 127809 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 128097 T375 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 128101 T375 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:22136
[junit4:junit4] 2> 128101 T375 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 128102 T375 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 128102 T375 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369006308366
[junit4:junit4] 2> 128103 T375 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369006308366/solr.xml
[junit4:junit4] 2> 128103 T375 oasc.CoreContainer.<init> New CoreContainer 116032026
[junit4:junit4] 2> 128104 T375 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369006308366/'
[junit4:junit4] 2> 128105 T375 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369006308366/'
[junit4:junit4] 2> 128233 T375 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 128234 T375 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 128235 T375 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 128235 T375 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 128236 T375 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 128236 T375 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 128237 T375 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 128237 T375 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 128238 T375 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 128238 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 128257 T375 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 128257 T375 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:22112/solr
[junit4:junit4] 2> 128258 T375 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 128259 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 128262 T431 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@461800f1 name:ZooKeeperConnection Watcher:127.0.0.1:22112 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 128263 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 128266 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 128279 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 128282 T433 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16175c73 name:ZooKeeperConnection Watcher:127.0.0.1:22112/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 128282 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 128295 T375 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 129273 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 129274 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:22126_k_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22126_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22126/k"}
[junit4:junit4] 2> 129301 T375 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:22136_k
[junit4:junit4] 2> 129304 T375 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:22136_k
[junit4:junit4] 2> 129315 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 129315 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 129316 T433 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 129317 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 129318 T404 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 129318 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 129319 T417 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 129319 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 129326 T397 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 129326 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 129328 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 129332 T434 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369006308366/collection1
[junit4:junit4] 2> 129332 T434 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 129333 T434 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 129334 T434 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 129336 T434 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369006308366/collection1/'
[junit4:junit4] 2> 129337 T434 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369006308366/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 129338 T434 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369006308366/collection1/lib/README' to classloader
[junit4:junit4] 2> 129390 T434 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 129465 T434 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 129567 T434 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 129574 T434 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 130182 T434 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 130186 T434 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 130189 T434 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 130195 T434 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 130238 T434 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 130238 T434 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1369006308366/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty2/
[junit4:junit4] 2> 130238 T434 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@46192223
[junit4:junit4] 2> 130239 T434 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 130240 T434 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty2
[junit4:junit4] 2> 130241 T434 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty2/index/
[junit4:junit4] 2> 130241 T434 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 130241 T434 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty2/index
[junit4:junit4] 2> 130246 T434 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@65d289a2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@33ad860c),segFN=segments_1,generation=1}
[junit4:junit4] 2> 130246 T434 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 130249 T434 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 130250 T434 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 130250 T434 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 130251 T434 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 130252 T434 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 130252 T434 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 130252 T434 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 130253 T434 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 130253 T434 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 130273 T434 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 130281 T434 oass.SolrIndexSearcher.<init> Opening Searcher@60feb3a7 main
[junit4:junit4] 2> 130282 T434 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty2/tlog
[junit4:junit4] 2> 130283 T434 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 130283 T434 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 130288 T435 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@60feb3a7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 130290 T434 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 130291 T434 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 130823 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 130824 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22136_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22136/k"}
[junit4:junit4] 2> 130824 T398 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 130824 T398 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 130843 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 130843 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 130843 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 130843 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 131304 T434 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 131304 T434 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:22136/k collection:collection1 shard:shard2
[junit4:junit4] 2> 131305 T434 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 131323 T434 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 131334 T434 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 131334 T434 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 131335 T434 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:22136/k/collection1/
[junit4:junit4] 2> 131335 T434 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 131335 T434 oasc.SyncStrategy.syncToMe http://127.0.0.1:22136/k/collection1/ has no replicas
[junit4:junit4] 2> 131335 T434 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:22136/k/collection1/
[junit4:junit4] 2> 131335 T434 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 132351 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 132414 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 132414 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 132414 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 132414 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 132419 T434 oasc.ZkController.register We are http://127.0.0.1:22136/k/collection1/ and leader is http://127.0.0.1:22136/k/collection1/
[junit4:junit4] 2> 132419 T434 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:22136/k
[junit4:junit4] 2> 132419 T434 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 132419 T434 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 132420 T434 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 132424 T434 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 132426 T375 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 132427 T375 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 132428 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 132714 T375 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 132718 T375 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:22140
[junit4:junit4] 2> 132719 T375 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 132719 T375 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 132720 T375 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369006312984
[junit4:junit4] 2> 132720 T375 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369006312984/solr.xml
[junit4:junit4] 2> 132721 T375 oasc.CoreContainer.<init> New CoreContainer 1263131874
[junit4:junit4] 2> 132721 T375 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369006312984/'
[junit4:junit4] 2> 132722 T375 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369006312984/'
[junit4:junit4] 2> 132866 T375 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 132867 T375 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 132867 T375 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 132868 T375 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 132868 T375 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 132869 T375 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 132869 T375 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 132870 T375 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 132870 T375 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 132871 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 132889 T375 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 132890 T375 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:22112/solr
[junit4:junit4] 2> 132891 T375 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 132892 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 132895 T447 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@304c186f name:ZooKeeperConnection Watcher:127.0.0.1:22112 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 132896 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 132899 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 132912 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 132915 T449 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4893faed name:ZooKeeperConnection Watcher:127.0.0.1:22112/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 132915 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 132927 T375 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 133930 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 133931 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:22136_k_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22136_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22136/k"}
[junit4:junit4] 2> 133933 T375 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:22140_k
[junit4:junit4] 2> 133935 T375 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:22140_k
[junit4:junit4] 2> 133948 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 133949 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 133955 T449 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 133955 T449 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 133955 T433 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 133956 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 133957 T404 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 133957 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 133957 T417 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 133957 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 133959 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 133960 T397 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 133960 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 133961 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 133963 T450 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369006312984/collection1
[junit4:junit4] 2> 133963 T450 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 133964 T450 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 133964 T450 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 133966 T450 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369006312984/collection1/'
[junit4:junit4] 2> 133968 T450 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369006312984/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 133968 T450 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369006312984/collection1/lib/README' to classloader
[junit4:junit4] 2> 134021 T450 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 134082 T450 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 134183 T450 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 134187 T450 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 134652 T450 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 134656 T450 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 134659 T450 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 134665 T450 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 134708 T450 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 134708 T450 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1369006312984/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty3/
[junit4:junit4] 2> 134709 T450 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@46192223
[junit4:junit4] 2> 134709 T450 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 134710 T450 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty3
[junit4:junit4] 2> 134710 T450 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty3/index/
[junit4:junit4] 2> 134711 T450 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 134711 T450 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty3/index
[junit4:junit4] 2> 134715 T450 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5fd016bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ebb7672),segFN=segments_1,generation=1}
[junit4:junit4] 2> 134716 T450 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 134719 T450 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 134719 T450 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 134720 T450 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 134721 T450 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 134721 T450 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 134722 T450 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 134722 T450 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 134723 T450 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 134723 T450 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 134740 T450 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 134747 T450 oass.SolrIndexSearcher.<init> Opening Searcher@40e44b84 main
[junit4:junit4] 2> 134748 T450 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty3/tlog
[junit4:junit4] 2> 134749 T450 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 134749 T450 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 134753 T451 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@40e44b84 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 134756 T450 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 134756 T450 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 135463 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 135464 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22140_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22140/k"}
[junit4:junit4] 2> 135464 T398 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 135464 T398 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 135490 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 135491 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 135491 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 135491 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 135491 T449 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 135759 T450 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 135759 T450 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:22140/k collection:collection1 shard:shard1
[junit4:junit4] 2> 135771 T450 oasc.ZkController.register We are http://127.0.0.1:22140/k/collection1/ and leader is http://127.0.0.1:22126/k/collection1/
[junit4:junit4] 2> 135771 T450 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:22140/k
[junit4:junit4] 2> 135771 T450 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 135772 T450 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C19 name=collection1 org.apache.solr.core.SolrCore@5b9755a9 url=http://127.0.0.1:22140/k/collection1 node=127.0.0.1:22140_k C19_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:22140_k, base_url=http://127.0.0.1:22140/k}
[junit4:junit4] 2> 135780 T452 C19 P22140 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 135780 T450 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 135781 T452 C19 P22140 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 135782 T452 C19 P22140 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 135782 T452 C19 P22140 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 135783 T375 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 135783 T375 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 135784 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 135784 T452 C19 P22140 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 135834 T407 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:22140_k_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 136095 T375 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 136099 T375 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:22146
[junit4:junit4] 2> 136100 T375 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 136101 T375 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 136101 T375 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369006316350
[junit4:junit4] 2> 136102 T375 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369006316350/solr.xml
[junit4:junit4] 2> 136102 T375 oasc.CoreContainer.<init> New CoreContainer 1996356364
[junit4:junit4] 2> 136103 T375 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369006316350/'
[junit4:junit4] 2> 136103 T375 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369006316350/'
[junit4:junit4] 2> 136231 T375 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 136232 T375 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 136233 T375 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 136233 T375 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 136234 T375 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 136234 T375 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 136235 T375 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 136235 T375 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 136236 T375 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 136236 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 136253 T375 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 136254 T375 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:22112/solr
[junit4:junit4] 2> 136255 T375 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 136256 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 136263 T464 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@461c5b7d name:ZooKeeperConnection Watcher:127.0.0.1:22112 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 136264 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 136276 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 136289 T375 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 136291 T466 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36753693 name:ZooKeeperConnection Watcher:127.0.0.1:22112/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 136292 T375 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 136304 T375 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 136998 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 136999 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:22140_k_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22140_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22140/k"}
[junit4:junit4] 2> 137039 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 137039 T449 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 137039 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 137039 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 137039 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 137039 T466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 137309 T375 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:22146_k
[junit4:junit4] 2> 137311 T375 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:22146_k
[junit4:junit4] 2> 137315 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 137315 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 137315 T466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 137315 T397 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 137316 T449 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 137316 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 137316 T433 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 137316 T449 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 137316 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 137318 T417 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 137318 T404 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 137318 T466 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 137326 T467 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369006316350/collection1
[junit4:junit4] 2> 137327 T467 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 137328 T467 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 137328 T467 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 137330 T467 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369006316350/collection1/'
[junit4:junit4] 2> 137331 T467 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369006316350/collection1/lib/README' to classloader
[junit4:junit4] 2> 137332 T467 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369006316350/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 137384 T467 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 137446 T467 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 137548 T467 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 137555 T467 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 137837 T407 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:22140_k_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 137838 T407 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:22140_k_collection1&state=recovering&nodeName=127.0.0.1:22140_k&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2011
[junit4:junit4] 2> 138221 T467 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 138226 T467 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 138229 T467 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 138235 T467 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 138275 T467 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 138275 T467 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1369006316350/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty4/
[junit4:junit4] 2> 138275 T467 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@46192223
[junit4:junit4] 2> 138276 T467 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 138277 T467 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty4
[junit4:junit4] 2> 138277 T467 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty4/index/
[junit4:junit4] 2> 138277 T467 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 138278 T467 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty4/index
[junit4:junit4] 2> 138283 T467 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4dc6d6d4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@52334621),segFN=segments_1,generation=1}
[junit4:junit4] 2> 138283 T467 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 138287 T467 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 138287 T467 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 138288 T467 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 138289 T467 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 138289 T467 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 138290 T467 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 138290 T467 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 138291 T467 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 138291 T467 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 138313 T467 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 138322 T467 oass.SolrIndexSearcher.<init> Opening Searcher@1d418a9 main
[junit4:junit4] 2> 138323 T467 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty4/tlog
[junit4:junit4] 2> 138324 T467 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 138324 T467 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 138329 T468 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d418a9 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 138331 T467 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 138332 T467 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 138547 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 138548 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22146_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22146/k"}
[junit4:junit4] 2> 138548 T398 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 138548 T398 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 138562 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 138562 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 138562 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 138562 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 138562 T449 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 138562 T466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 139335 T467 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 139335 T467 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:22146/k collection:collection1 shard:shard2
[junit4:junit4] 2> 139340 T467 oasc.ZkController.register We are http://127.0.0.1:22146/k/collection1/ and leader is http://127.0.0.1:22136/k/collection1/
[junit4:junit4] 2> 139340 T467 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:22146/k
[junit4:junit4] 2> 139341 T467 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 139341 T467 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C20 name=collection1 org.apache.solr.core.SolrCore@7fcc441 url=http://127.0.0.1:22146/k/collection1 node=127.0.0.1:22146_k C20_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:22146_k, base_url=http://127.0.0.1:22146/k}
[junit4:junit4] 2> 139341 T469 C20 P22146 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 139343 T467 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 139343 T469 C20 P22146 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 139343 T469 C20 P22146 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 139343 T469 C20 P22146 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 139344 T375 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 139345 T375 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 139345 T469 C20 P22146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 139345 T375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 139364 T375 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 139366 T423 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:22146_k_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 139367 T375 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 139368 T375 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 139369 T375 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C19_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:22140_k, base_url=http://127.0.0.1:22140/k}
[junit4:junit4] 2> 139840 T452 C19 P22140 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:22126/k/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 139852 T452 C19 P22140 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 139873 T452 C19 P22140 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:22140/k START replicas=[http://127.0.0.1:22126/k/collection1/] nUpdates=100
[junit4:junit4] 2> 139874 T452 C19 P22140 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 139875 T452 C19 P22140 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 139875 T452 C19 P22140 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 139875 T452 C19 P22140 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 139875 T452 C19 P22140 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 139876 T452 C19 P22140 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:22126/k/collection1/. core=collection1
[junit4:junit4] 2> 139876 T452 C19 P22140 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C21 name=collection1 org.apache.solr.core.SolrCore@2d287af3 url=http://127.0.0.1:22126/k/collection1 node=127.0.0.1:22126_k C21_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:22126_k, base_url=http://127.0.0.1:22126/k, leader=true}
[junit4:junit4] 2> 139884 T408 C21 P22126 oasc.SolrCore.execute [collection1] webapp=/k path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 139911 T409 C21 P22126 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 139914 T409 C21 P22126 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@293962c5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19fa46c7),segFN=segments_1,generation=1}
[junit4:junit4] 2> 139915 T409 C21 P22126 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 139915 T409 C21 P22126 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@293962c5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19fa46c7),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@293962c5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19fa46c7),segFN=segments_2,generation=2}
[junit4:junit4] 2> 139916 T409 C21 P22126 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 139916 T409 C21 P22126 oass.SolrIndexSearcher.<init> Opening Searcher@584b11a5 realtime
[junit4:junit4] 2> 139917 T409 C21 P22126 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 139917 T409 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 27
[junit4:junit4] 2> 139993 T452 C19 P22140 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 139994 T452 C19 P22140 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4] 2> 140017 T452 C19 P22140 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 140020 T410 C21 P22126 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 140021 T410 C21 P22126 oasc.SolrCore.execute [collection1] webapp=/k path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 140023 T452 C19 P22140 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 140023 T452 C19 P22140 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 140023 T452 C19 P22140 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 140027 T410 C21 P22126 oasc.SolrCore.execute [collection1] webapp=/k path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 140028 T452 C19 P22140 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 140029 T452 C19 P22140 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty3/index.20130520053200567
[junit4:junit4] 2> 140029 T452 C19 P22140 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@282b4cce lockFactory=org.apache.lucene.store.NativeFSLockFactory@69eaa05e) fullCopy=false
[junit4:junit4] 2> 140044 T410 C21 P22126 oasc.SolrCore.execute [collection1] webapp=/k path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=6
[junit4:junit4] 2> 140061 T452 C19 P22140 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 140062 T452 C19 P22140 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 140063 T452 C19 P22140 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 140070 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 140071 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:22146_k_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22146_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22146/k"}
[junit4:junit4] 2> 140072 T452 C19 P22140 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5fd016bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ebb7672),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5fd016bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ebb7672),segFN=segments_2,generation=2}
[junit4:junit4] 2> 140072 T452 C19 P22140 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 140073 T452 C19 P22140 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 140073 T452 C19 P22140 oass.SolrIndexSearcher.<init> Opening Searcher@971372b main
[junit4:junit4] 2> 140074 T451 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@971372b main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 140075 T452 C19 P22140 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty3/index.20130520053200567 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty3/index.20130520053200567;done=true>>]
[junit4:junit4] 2> 140075 T452 C19 P22140 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty3/index.20130520053200567
[junit4:junit4] 2> 140076 T452 C19 P22140 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty3/index.20130520053200567
[junit4:junit4] 2> 140076 T452 C19 P22140 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 140076 T452 C19 P22140 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 140076 T452 C19 P22140 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 140077 T452 C19 P22140 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 140085 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 140085 T466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 140085 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 140085 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 140085 T449 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 140085 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 140086 T452 C19 P22140 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 140368 T423 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:22146_k_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 140368 T423 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:22146_k_collection1&state=recovering&nodeName=127.0.0.1:22146_k&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 140371 T375 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 141375 T375 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 141593 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 141595 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:22140_k_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22140_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22140/k"}
[junit4:junit4] 2> 141614 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 141614 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 141614 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 141614 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 141614 T449 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 141614 T466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> C20_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:22146_k, base_url=http://127.0.0.1:22146/k}
[junit4:junit4] 2> 142370 T469 C20 P22146 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:22136/k/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 142370 T469 C20 P22146 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:22146/k START replicas=[http://127.0.0.1:22136/k/collection1/] nUpdates=100
[junit4:junit4] 2> 142371 T469 C20 P22146 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 142371 T469 C20 P22146 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 142371 T469 C20 P22146 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 142371 T469 C20 P22146 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 142372 T469 C20 P22146 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 142372 T469 C20 P22146 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:22136/k/collection1/. core=collection1
[junit4:junit4] 2> 142373 T469 C20 P22146 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 142379 T375 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C22 name=collection1 org.apache.solr.core.SolrCore@38731ea3 url=http://127.0.0.1:22136/k/collection1 node=127.0.0.1:22136_k C22_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:22136_k, base_url=http://127.0.0.1:22136/k, leader=true}
[junit4:junit4] 2> 142385 T424 C22 P22136 oasc.SolrCore.execute [collection1] webapp=/k path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 142393 T425 C22 P22136 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 142396 T425 C22 P22136 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@65d289a2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@33ad860c),segFN=segments_1,generation=1}
[junit4:junit4] 2> 142396 T425 C22 P22136 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 142397 T425 C22 P22136 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@65d289a2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@33ad860c),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@65d289a2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@33ad860c),segFN=segments_2,generation=2}
[junit4:junit4] 2> 142397 T425 C22 P22136 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 142398 T425 C22 P22136 oass.SolrIndexSearcher.<init> Opening Searcher@103e479c realtime
[junit4:junit4] 2> 142399 T425 C22 P22136 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 142399 T425 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 142400 T469 C20 P22146 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 142401 T469 C20 P22146 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 142404 T426 C22 P22136 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 142404 T426 C22 P22136 oasc.SolrCore.execute [collection1] webapp=/k path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 142405 T469 C20 P22146 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 142405 T469 C20 P22146 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 142405 T469 C20 P22146 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 142409 T426 C22 P22136 oasc.SolrCore.execute [collection1] webapp=/k path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 142410 T469 C20 P22146 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 142411 T469 C20 P22146 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty4/index.20130520053202949
[junit4:junit4] 2> 142411 T469 C20 P22146 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@4854b21a lockFactory=org.apache.lucene.store.NativeFSLockFactory@7eb1c060) fullCopy=false
[junit4:junit4] 2> 142414 T426 C22 P22136 oasc.SolrCore.execute [collection1] webapp=/k path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 142416 T469 C20 P22146 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 142417 T469 C20 P22146 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 142417 T469 C20 P22146 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 142419 T469 C20 P22146 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4dc6d6d4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@52334621),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4dc6d6d4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@52334621),segFN=segments_2,generation=2}
[junit4:junit4] 2> 142419 T469 C20 P22146 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 142420 T469 C20 P22146 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 142420 T469 C20 P22146 oass.SolrIndexSearcher.<init> Opening Searcher@20fef93d main
[junit4:junit4] 2> 142421 T468 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@20fef93d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 142422 T469 C20 P22146 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty4/index.20130520053202949 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty4/index.20130520053202949;done=true>>]
[junit4:junit4] 2> 142422 T469 C20 P22146 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty4/index.20130520053202949
[junit4:junit4] 2> 142423 T469 C20 P22146 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1369006298906/jetty4/index.20130520053202949
[junit4:junit4] 2> 142423 T469 C20 P22146 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 142423 T469 C20 P22146 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 142423 T469 C20 P22146 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 142423 T469 C20 P22146 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 142425 T469 C20 P22146 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 143123 T398 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 143124 T398 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:22146_k_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:22146_k",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22146/k"}
[junit4:junit4] 2> 143137 T397 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 143137 T417 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 143137 T466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 143137 T433 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 143137 T449 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 143137 T404 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 143381 T375 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 143383 T375 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C23 name=collection1 org.apache.solr.core.SolrCore@78344b3e url=http://127.0.0.1:22115/k/collection1 node=127.0.0.1:22115_k C23_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:22115_k, base_url=http://127.0.0.1:22115/k, leader=true}
[junit4:junit4] 2> 143393 T387 C23 P22115 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 143396 T387 C23 P22115 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16b374ce lockFactory=org.apache.lucene.store.NativeFSLockFactory@21019571),segFN=segments_1,generation=1}
[junit4:junit4] 2> 143396 T387 C23 P22115 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 143397 T387 C23 P22115 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16b374ce lockFactory=org.apache.lucene.store.NativeFSLockFactory@21019571),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16b374ce lockFactory=org.apache.lucene.store.NativeFSLockFactory@21019571),segFN=segments_2,generation=2}
[junit4:junit4] 2> 143397 T387 C23 P22115 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 143398 T387 C23 P22115 oass.SolrIndexSearcher.<init> Opening Searcher@7aad6070 main
[junit4:junit4] 2> 143399 T387 C23 P22115 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 143399 T401 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7aad6070 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 143400 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 143416 T427 C22 P22136 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 143417 T427 C22 P22136 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@65d289a2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@33ad860c),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@65d289a2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@33ad860c),segFN=segments_3,generation=3}
[junit4:junit4] 2> 143417 T427 C22 P22136 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 143418 T427 C22 P22136 oass.SolrIndexSearcher.<init> Opening Searcher@30dfc977 main
[junit4:junit4] 2> 143418 T427 C22 P22136 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 143419 T435 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@30dfc977 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 143437 T427 C22 P22136 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:22126/k/collection1/, StdNode: http://127.0.0.1:22140/k/collection1/, StdNode: http://127.0.0.1:22146/k/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 143446 T411 C21 P22126 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 143448 T411 C21 P22126 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@293962c5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19fa46c7),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@293962c5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19fa46c7),segFN=segments_3,generation=3}
[junit4:junit4] 2> 143448 T411 C21 P22126 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 143449 T411 C21 P22126 oass.SolrIndexSearcher.<init> Opening Searcher@432209af main
[junit4:junit4] 2> 143449 T411 C21 P22126 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 143450 T419 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@432209af main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 143451 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> C20_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:22146_k, base_url=http://127.0.0.1:22146/k}
[junit4:junit4] 2> 143455 T456 C20 P22146 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C19_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:22140_k, base_url=http://127.0.0.1:22140/k}
[junit4:junit4] 2> 143455 T439 C19 P22140 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 143456 T456 C20 P22146 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4dc6d6d4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@52334621),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4dc6d6d4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@52334621),segFN=segments_3,generation=3}
[junit4:junit4] 2> 143457 T439 C19 P22140 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5fd016bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ebb7672),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5fd016bb lockFactory=org.apache.lucene.store.NativeFSLockFactory@2ebb7672),segFN=segments_3,generation=3}
[junit4:junit4] 2> 143457 T456 C20 P22146 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 143458 T439 C19 P22140 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 143458 T456 C20 P22146 oass.SolrIndexSearcher.<init> Opening Searcher@4da79a2e main
[junit4:junit4] 2> 143459 T439 C19 P22140 oass.SolrIndexSearcher.<init> Opening Searcher@2037bb1c main
[junit4:junit4] 2> 143459 T456 C20 P22146 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 143460 T439 C19 P22140 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 143460 T468 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4da79a2e main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 143460 T451 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2037bb1c main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 143461 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 143461 T439 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 143462 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 47
[junit4:junit4] 2> 143464 T375 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 143468 T412 C21 P22126 oasc.SolrCore.execute [collection1] webapp=/k path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 143471 T440 C19 P22140 oasc.SolrCore.execute [collection1] webapp=/k path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 143474 T428 C22 P22136 oasc.SolrCore.execute [collection1] webapp=/k path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 143476 T457 C20 P22146 oasc.SolrCore.execute [collection1] webapp=/k path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 145488 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435507177319038976)} 0 7
[junit4:junit4] 2> 145505 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={update.distrib=FROMLEADER&_version_=-1435507177325330432&update.from=http://127.0.0.1:22136/k/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435507177325330432)} 0 2
[junit4:junit4] 2> 145510 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={update.distrib=FROMLEADER&_version_=-1435507177337913344&update.from=http://127.0.0.1:22126/k/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435507177337913344)} 0 1
[junit4:junit4] 2> 145511 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1435507177337913344)} 0 7
[junit4:junit4] 2> 145512 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435507177325330432)} 0 20
[junit4:junit4] 2> 145516 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[0 (1435507177349447680)]} 0 1
[junit4:junit4] 2> 145544 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1435507177374613504)]} 0 1
[junit4:junit4] 2> 145545 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[0 (1435507177374613504)]} 0 6
[junit4:junit4] 2> 145546 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[0]} 0 27
[junit4:junit4] 2> 145550 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[1 (1435507177384050688)]} 0 1
[junit4:junit4] 2> 145558 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1435507177389293568)]} 0 1
[junit4:junit4] 2> 145559 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[1 (1435507177389293568)]} 0 6
[junit4:junit4] 2> 145563 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[2 (1435507177398730752)]} 0 1
[junit4:junit4] 2> 145573 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1435507177405022208)]} 0 1
[junit4:junit4] 2> 145574 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[2 (1435507177405022208)]} 0 6
[junit4:junit4] 2> 145575 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[2]} 0 9
[junit4:junit4] 2> 145580 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[3 (1435507177415507968)]} 0 1
[junit4:junit4] 2> 145589 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1435507177421799424)]} 0 1
[junit4:junit4] 2> 145590 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[3 (1435507177421799424)]} 0 5
[junit4:junit4] 2> 145594 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[4 (1435507177431236608)]} 0 1
[junit4:junit4] 2> 145601 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1435507177435430912)]} 0 1
[junit4:junit4] 2> 145602 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[4 (1435507177435430912)]} 0 5
[junit4:junit4] 2> 145606 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[5 (1435507177443819520)]} 0 1
[junit4:junit4] 2> 145616 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1435507177451159552)]} 0 1
[junit4:junit4] 2> 145617 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[5 (1435507177451159552)]} 0 5
[junit4:junit4] 2> 145618 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[5]} 0 9
[junit4:junit4] 2> 145622 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[6 (1435507177460596736)]} 0 1
[junit4:junit4] 2> 145629 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1435507177464791040)]} 0 1
[junit4:junit4] 2> 145630 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[6 (1435507177464791040)]} 0 5
[junit4:junit4] 2> 145634 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[7 (1435507177473179648)]} 0 1
[junit4:junit4] 2> 145644 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1435507177480519680)]} 0 1
[junit4:junit4] 2> 145645 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[7 (1435507177480519680)]} 0 5
[junit4:junit4] 2> 145646 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[7]} 0 9
[junit4:junit4] 2> 145650 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[8 (1435507177489956864)]} 0 1
[junit4:junit4] 2> 145657 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1435507177494151168)]} 0 1
[junit4:junit4] 2> 145658 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[8 (1435507177494151168)]} 0 5
[junit4:junit4] 2> 145662 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[9 (1435507177501491200)]} 0 1
[junit4:junit4] 2> 145669 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[9 (1435507177506734080)]} 0 1
[junit4:junit4] 2> 145670 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[9 (1435507177506734080)]} 0 5
[junit4:junit4] 2> 145674 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[10 (1435507177515122688)]} 0 1
[junit4:junit4] 2> 145684 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1435507177522462720)]} 0 1
[junit4:junit4] 2> 145685 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[10 (1435507177522462720)]} 0 5
[junit4:junit4] 2> 145686 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[10]} 0 9
[junit4:junit4] 2> 145690 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[11 (1435507177531899904)]} 0 1
[junit4:junit4] 2> 145700 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1435507177539239936)]} 0 1
[junit4:junit4] 2> 145701 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[11 (1435507177539239936)]} 0 5
[junit4:junit4] 2> 145702 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[11]} 0 9
[junit4:junit4] 2> 145706 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[12 (1435507177548677120)]} 0 1
[junit4:junit4] 2> 145713 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[12 (1435507177551822848)]} 0 1
[junit4:junit4] 2> 145714 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[12 (1435507177551822848)]} 0 5
[junit4:junit4] 2> 145718 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[13 (1435507177561260032)]} 0 1
[junit4:junit4] 2> 145725 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[13 (1435507177565454336)]} 0 1
[junit4:junit4] 2> 145726 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[13 (1435507177565454336)]} 0 5
[junit4:junit4] 2> 145730 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[14 (1435507177573842944)]} 0 1
[junit4:junit4] 2> 145741 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[14 (1435507177581182976)]} 0 1
[junit4:junit4] 2> 145742 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[14 (1435507177581182976)]} 0 6
[junit4:junit4] 2> 145743 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[14]} 0 10
[junit4:junit4] 2> 145747 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[15 (1435507177590620160)]} 0 1
[junit4:junit4] 2> 145754 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[15 (1435507177595863040)]} 0 1
[junit4:junit4] 2> 145755 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[15 (1435507177595863040)]} 0 5
[junit4:junit4] 2> 145759 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[16 (1435507177604251648)]} 0 1
[junit4:junit4] 2> 145767 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[16 (1435507177608445952)]} 0 1
[junit4:junit4] 2> 145768 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[16 (1435507177608445952)]} 0 5
[junit4:junit4] 2> 145772 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[17 (1435507177617883136)]} 0 1
[junit4:junit4] 2> 145782 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[17 (1435507177625223168)]} 0 1
[junit4:junit4] 2> 145783 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[17 (1435507177625223168)]} 0 5
[junit4:junit4] 2> 145784 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[17]} 0 9
[junit4:junit4] 2> 145788 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[18 (1435507177634660352)]} 0 1
[junit4:junit4] 2> 145798 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[18 (1435507177642000384)]} 0 1
[junit4:junit4] 2> 145799 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[18 (1435507177642000384)]} 0 5
[junit4:junit4] 2> 145799 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[18]} 0 8
[junit4:junit4] 2> 145803 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[19 (1435507177649340416)]} 0 1
[junit4:junit4] 2> 145810 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[19 (1435507177653534720)]} 0 1
[junit4:junit4] 2> 145811 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[19 (1435507177653534720)]} 0 5
[junit4:junit4] 2> 145815 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[20 (1435507177661923328)]} 0 1
[junit4:junit4] 2> 145822 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[20 (1435507177666117632)]} 0 1
[junit4:junit4] 2> 145823 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[20 (1435507177666117632)]} 0 5
[junit4:junit4] 2> 145827 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[21 (1435507177674506240)]} 0 1
[junit4:junit4] 2> 145837 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[21 (1435507177682894848)]} 0 1
[junit4:junit4] 2> 145838 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[21 (1435507177682894848)]} 0 5
[junit4:junit4] 2> 145838 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[21]} 0 8
[junit4:junit4] 2> 145842 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[22 (1435507177690234880)]} 0 1
[junit4:junit4] 2> 145852 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[22 (1435507177698623488)]} 0 1
[junit4:junit4] 2> 145853 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[22 (1435507177698623488)]} 0 5
[junit4:junit4] 2> 145853 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[22]} 0 8
[junit4:junit4] 2> 145857 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[23 (1435507177705963520)]} 0 1
[junit4:junit4] 2> 145867 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[23 (1435507177713303552)]} 0 1
[junit4:junit4] 2> 145868 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[23 (1435507177713303552)]} 0 5
[junit4:junit4] 2> 145869 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[23]} 0 9
[junit4:junit4] 2> 145873 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[24 (1435507177722740736)]} 0 1
[junit4:junit4] 2> 145883 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[24 (1435507177731129344)]} 0 1
[junit4:junit4] 2> 145884 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[24 (1435507177731129344)]} 0 5
[junit4:junit4] 2> 145884 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[24]} 0 8
[junit4:junit4] 2> 145888 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[25 (1435507177739517952)]} 0 1
[junit4:junit4] 2> 145898 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[25 (1435507177746857984)]} 0 1
[junit4:junit4] 2> 145899 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[25 (1435507177746857984)]} 0 5
[junit4:junit4] 2> 145899 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[25]} 0 8
[junit4:junit4] 2> 145903 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[26 (1435507177754198016)]} 0 1
[junit4:junit4] 2> 145913 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[26 (1435507177762586624)]} 0 1
[junit4:junit4] 2> 145914 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[26 (1435507177762586624)]} 0 5
[junit4:junit4] 2> 145915 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[26]} 0 9
[junit4:junit4] 2> 145918 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[27 (1435507177769926656)]} 0 1
[junit4:junit4] 2> 145925 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[27 (1435507177774120960)]} 0 1
[junit4:junit4] 2> 145926 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[27 (1435507177774120960)]} 0 5
[junit4:junit4] 2> 145930 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[28 (1435507177783558144)]} 0 1
[junit4:junit4] 2> 145940 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[28 (1435507177789849600)]} 0 1
[junit4:junit4] 2> 145941 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[28 (1435507177789849600)]} 0 5
[junit4:junit4] 2> 145941 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[28]} 0 8
[junit4:junit4] 2> 145945 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[29 (1435507177798238208)]} 0 1
[junit4:junit4] 2> 145952 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[29 (1435507177803481088)]} 0 1
[junit4:junit4] 2> 145953 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[29 (1435507177803481088)]} 0 5
[junit4:junit4] 2> 145957 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[30 (1435507177810821120)]} 0 1
[junit4:junit4] 2> 145964 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[30 (1435507177816064000)]} 0 1
[junit4:junit4] 2> 145965 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[30 (1435507177816064000)]} 0 5
[junit4:junit4] 2> 145969 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[31 (1435507177823404032)]} 0 1
[junit4:junit4] 2> 145976 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[31 (1435507177827598336)]} 0 1
[junit4:junit4] 2> 145977 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[31 (1435507177827598336)]} 0 5
[junit4:junit4] 2> 145981 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[32 (1435507177835986944)]} 0 1
[junit4:junit4] 2> 145991 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[32 (1435507177844375552)]} 0 1
[junit4:junit4] 2> 145992 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[32 (1435507177844375552)]} 0 5
[junit4:junit4] 2> 145992 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[32]} 0 8
[junit4:junit4] 2> 145996 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[33 (1435507177851715584)]} 0 1
[junit4:junit4] 2> 146006 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[33 (1435507177860104192)]} 0 1
[junit4:junit4] 2> 146007 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[33 (1435507177860104192)]} 0 5
[junit4:junit4] 2> 146007 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[33]} 0 8
[junit4:junit4] 2> 146011 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[34 (1435507177867444224)]} 0 1
[junit4:junit4] 2> 146021 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[34 (1435507177874784256)]} 0 1
[junit4:junit4] 2> 146022 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[34 (1435507177874784256)]} 0 5
[junit4:junit4] 2> 146022 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[34]} 0 8
[junit4:junit4] 2> 146026 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[35 (1435507177883172864)]} 0 1
[junit4:junit4] 2> 146036 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[35 (1435507177890512896)]} 0 1
[junit4:junit4] 2> 146037 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[35 (1435507177890512896)]} 0 5
[junit4:junit4] 2> 146037 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[35]} 0 8
[junit4:junit4] 2> 146041 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[36 (1435507177898901504)]} 0 1
[junit4:junit4] 2> 146048 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[36 (1435507177903095808)]} 0 1
[junit4:junit4] 2> 146049 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[36 (1435507177903095808)]} 0 5
[junit4:junit4] 2> 146053 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[37 (1435507177911484416)]} 0 1
[junit4:junit4] 2> 146063 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[37 (1435507177918824448)]} 0 1
[junit4:junit4] 2> 146064 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[37 (1435507177918824448)]} 0 5
[junit4:junit4] 2> 146065 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[37]} 0 9
[junit4:junit4] 2> 146069 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[38 (1435507177928261632)]} 0 1
[junit4:junit4] 2> 146079 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[38 (1435507177936650240)]} 0 1
[junit4:junit4] 2> 146080 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[38 (1435507177936650240)]} 0 5
[junit4:junit4] 2> 146080 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[38]} 0 8
[junit4:junit4] 2> 146084 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[39 (1435507177943990272)]} 0 1
[junit4:junit4] 2> 146091 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[39 (1435507177948184576)]} 0 1
[junit4:junit4] 2> 146092 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[39 (1435507177948184576)]} 0 5
[junit4:junit4] 2> 146096 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[40 (1435507177956573184)]} 0 1
[junit4:junit4] 2> 146103 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[40 (1435507177960767488)]} 0 1
[junit4:junit4] 2> 146104 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[40 (1435507177960767488)]} 0 5
[junit4:junit4] 2> 146108 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[41 (1435507177969156096)]} 0 1
[junit4:junit4] 2> 146118 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[41 (1435507177977544704)]} 0 1
[junit4:junit4] 2> 146119 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[41 (1435507177977544704)]} 0 5
[junit4:junit4] 2> 146119 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[41]} 0 8
[junit4:junit4] 2> 146123 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[42 (1435507177984884736)]} 0 1
[junit4:junit4] 2> 146130 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[42 (1435507177990127616)]} 0 1
[junit4:junit4] 2> 146131 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[42 (1435507177990127616)]} 0 5
[junit4:junit4] 2> 146135 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[43 (1435507177997467648)]} 0 1
[junit4:junit4] 2> 146142 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[43 (1435507178001661952)]} 0 1
[junit4:junit4] 2> 146143 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[43 (1435507178001661952)]} 0 5
[junit4:junit4] 2> 146146 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[44 (1435507178009001984)]} 0 1
[junit4:junit4] 2> 146153 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[44 (1435507178014244864)]} 0 1
[junit4:junit4] 2> 146154 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[44 (1435507178014244864)]} 0 5
[junit4:junit4] 2> 146158 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[45 (1435507178021584896)]} 0 1
[junit4:junit4] 2> 146168 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[45 (1435507178029973504)]} 0 1
[junit4:junit4] 2> 146169 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[45 (1435507178029973504)]} 0 5
[junit4:junit4] 2> 146170 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[45]} 0 9
[junit4:junit4] 2> 146173 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[46 (1435507178037313536)]} 0 1
[junit4:junit4] 2> 146183 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[46 (1435507178044653568)]} 0 1
[junit4:junit4] 2> 146184 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[46 (1435507178044653568)]} 0 5
[junit4:junit4] 2> 146185 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[46]} 0 8
[junit4:junit4] 2> 146188 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[47 (1435507178053042176)]} 0 1
[junit4:junit4] 2> 146198 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[47 (1435507178060382208)]} 0 1
[junit4:junit4] 2> 146199 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[47 (1435507178060382208)]} 0 5
[junit4:junit4] 2> 146199 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[47]} 0 8
[junit4:junit4] 2> 146203 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[48 (1435507178068770816)]} 0 1
[junit4:junit4] 2> 146210 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[48 (1435507178072965120)]} 0 1
[junit4:junit4] 2> 146211 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[48 (1435507178072965120)]} 0 5
[junit4:junit4] 2> 146215 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[49 (1435507178081353728)]} 0 1
[junit4:junit4] 2> 146222 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[49 (1435507178085548032)]} 0 1
[junit4:junit4] 2> 146223 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[49 (1435507178085548032)]} 0 5
[junit4:junit4] 2> 146227 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[50 (1435507178093936640)]} 0 1
[junit4:junit4] 2> 146237 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[50 (1435507178101276672)]} 0 1
[junit4:junit4] 2> 146238 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[50 (1435507178101276672)]} 0 5
[junit4:junit4] 2> 146238 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[50]} 0 8
[junit4:junit4] 2> 146242 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[51 (1435507178109665280)]} 0 1
[junit4:junit4] 2> 146249 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[51 (1435507178113859584)]} 0 1
[junit4:junit4] 2> 146250 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[51 (1435507178113859584)]} 0 5
[junit4:junit4] 2> 146254 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[52 (1435507178122248192)]} 0 1
[junit4:junit4] 2> 146261 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[52 (1435507178126442496)]} 0 1
[junit4:junit4] 2> 146262 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[52 (1435507178126442496)]} 0 5
[junit4:junit4] 2> 146266 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[53 (1435507178135879680)]} 0 1
[junit4:junit4] 2> 146276 T456 C20 P22146 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[53 (1435507178143219712)]} 0 1
[junit4:junit4] 2> 146277 T429 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[53 (1435507178143219712)]} 0 5
[junit4:junit4] 2> 146277 T413 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[53]} 0 8
[junit4:junit4] 2> 146281 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[54 (1435507178150559744)]} 0 1
[junit4:junit4] 2> 146291 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[54 (1435507178158948352)]} 0 1
[junit4:junit4] 2> 146292 T411 C21 P22126 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22136/k/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[54 (1435507178158948352)]} 0 5
[junit4:junit4] 2> 146292 T427 C22 P22136 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[54]} 0 8
[junit4:junit4] 2> 146296 T387 C23 P22115 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={wt=javabin&version=2} {add=[55 (1435507178166288384)]} 0 1
[junit4:junit4] 2> 146303 T441 C19 P22140 oasup.LogUpdateProcessor.finish [collection1] webapp=/k path=/update params={distrib.from=http://127.0.0.1:22126/k/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[55 (1435507178170482688)]} 0 1
[junit4:junit4] 2> 14630
[...truncated too long message...]
[junit4:junit4] 2> 1794675 T2237 oasc.SyncStrategy.syncReplicas We have been closed, won't attempt to sync replicas back to leader
[junit4:junit4] 2> 1794676 T2237 oasc.ShardLeaderElectionContext.runLeaderProcess Sync was not a success but no one else is active! I am the leader
[junit4:junit4] 2> 1794676 T2237 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59234/collection1/
[junit4:junit4] 2> 1794676 T2237 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@433b9799
[junit4:junit4] 2> 1794678 T2237 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=51,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 1794678 T2237 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 1794679 T2237 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 1794679 T2237 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 1794697 T2237 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 1794700 T2237 oasc.CachingDirectoryFactory.close Closing NRTCachingDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 1794700 T2237 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369007107831/jetty4/index [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369007107831/jetty4/index;done=false>>]
[junit4:junit4] 2> 1794700 T2237 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369007107831/jetty4/index
[junit4:junit4] 2> 1794701 T2237 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369007107831/jetty4 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369007107831/jetty4;done=false>>]
[junit4:junit4] 2> 1794701 T2237 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1369007107831/jetty4
[junit4:junit4] 2> 1794702 T2237 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1794704 T2237 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election/89719249819336716-127.0.0.1:59234__collection1-n_0000000006
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:152)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:260)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 1794705 T2237 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 1794706 T2237 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1794706 T2237 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1794706 T2237 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=ar_BH, timezone=America/Argentina/ComodRivadavia
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=3,free=205963144,total=334495744
[junit4:junit4] 2> NOTE: All tests run in this JVM: [QueryResultKeyTest, TestSchemaResource, SolrIndexSplitterTest, TestCoreContainer, TestFastWriter, TestQuerySenderListener, FastVectorHighlighterTest, DistributedSpellCheckComponentTest, TestDocumentBuilder, SynonymTokenizerTest, BasicFunctionalityTest, TestValueSourceCache, SchemaVersionSpecificBehaviorTest, TestRealTimeGet, TestPHPSerializedResponseWriter, TestSolrCoreProperties, FileBasedSpellCheckerTest, PluginInfoTest, CSVRequestHandlerTest, ChaosMonkeyShardSplitTest, ShowFileRequestHandlerTest, TestConfig, ScriptEngineTest, TestCloudManagedSchemaAddField, ZkCLITest, SliceStateUpdateTest, TestWriterPerf, SearchHandlerTest, LukeRequestHandlerTest, IndexSchemaTest, TestFunctionQuery, TestSweetSpotSimilarityFactory, PreAnalyzedFieldTest, BasicDistributedZkTest, TestSearchPerf, TestIBSimilarityFactory, TestTrie, PolyFieldTest, TestExtendedDismaxParser, ShardRoutingTest, TestPerFieldSimilarity, SpatialFilterTest, ShardSplitTest, AliasIntegrationTest, PeerSyncTest, TestReversedWildcardFilterFactory, MoreLikeThisHandlerTest, TestQueryUtils, FieldMutatingUpdateProcessorTest, CoreAdminHandlerTest, TestBadConfig, TestSurroundQueryParser, TestSolrDeletionPolicy1, MBeansHandlerTest, LoggingHandlerTest, BinaryUpdateRequestHandlerTest, UpdateRequestProcessorFactoryTest, WordBreakSolrSpellCheckerTest, TestCharFilters, SliceStateTest, RAMDirectoryFactoryTest, SuggesterFSTTest, TestDocSet, TermsComponentTest, TestManagedSchema, ZkControllerTest, AnalysisAfterCoreReloadTest, SimpleFacetsTest, TestPhraseSuggestions, PreAnalyzedUpdateProcessorTest, AutoCommitTest, DocumentBuilderTest, SyncSliceTest]
[junit4:junit4] Completed on J0 in 867.82s, 1 test, 1 failure <<< FAILURES!
[...truncated 397 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:377: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:357: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:1240: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:884: There were test failures: 295 suites, 1231 tests, 2 errors, 1 failure, 27 ignored (8 assumptions)
Total time: 53 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 3999 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/3999/
No tests ran.
Build Log:
[...truncated 7890 lines...]
[JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3998 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3998/
1 tests failed.
REGRESSION: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:60887 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:60887 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([51CC87C365F5FFBD:D02A09DB12AA9F81]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9991 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4:junit4] 2> 1422828 T3697 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 1422833 T3697 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./solrtest-ShardSplitTest-1368956564901
[junit4:junit4] 2> 1422834 T3697 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 1422835 T3698 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 1422936 T3697 oasc.ZkTestServer.run start zk server on port:60877
[junit4:junit4] 2> 1422937 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1422941 T3704 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@420f42a1 name:ZooKeeperConnection Watcher:127.0.0.1:60877 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1422941 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1422941 T3697 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 1422957 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1422959 T3706 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6cfad7bb name:ZooKeeperConnection Watcher:127.0.0.1:60877/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1422959 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1422960 T3697 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 1422970 T3697 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 1422974 T3697 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 1422977 T3697 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 1422985 T3697 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1422986 T3697 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1423000 T3697 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 1423001 T3697 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 1423105 T3697 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1423106 T3697 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1423109 T3697 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 1423110 T3697 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 1423113 T3697 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 1423114 T3697 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 1423117 T3697 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1423118 T3697 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1423121 T3697 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1423121 T3697 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1423124 T3697 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1423125 T3697 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1423133 T3697 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1423134 T3697 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1423348 T3697 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1423354 T3697 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60880
[junit4:junit4] 2> 1423355 T3697 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1423356 T3697 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1423356 T3697 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368956565204
[junit4:junit4] 2> 1423357 T3697 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368956565204/solr.xml
[junit4:junit4] 2> 1423357 T3697 oasc.CoreContainer.<init> New CoreContainer 1073431746
[junit4:junit4] 2> 1423358 T3697 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368956565204/'
[junit4:junit4] 2> 1423359 T3697 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368956565204/'
[junit4:junit4] 2> 1423477 T3697 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1423478 T3697 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1423479 T3697 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1423480 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1423480 T3697 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1423481 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1423481 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1423482 T3697 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1423482 T3697 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1423483 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1423499 T3697 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1423500 T3697 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60877/solr
[junit4:junit4] 2> 1423500 T3697 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1423501 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1423504 T3717 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9f58c51 name:ZooKeeperConnection Watcher:127.0.0.1:60877 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1423505 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1423507 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1423519 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1423521 T3719 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48e329e2 name:ZooKeeperConnection Watcher:127.0.0.1:60877/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1423521 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1423523 T3697 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 1423533 T3697 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 1423536 T3697 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 1423544 T3697 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60880_
[junit4:junit4] 2> 1423545 T3697 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60880_
[junit4:junit4] 2> 1423549 T3697 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 1423565 T3697 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 1423568 T3697 oasc.Overseer.start Overseer (id=89715937437745155-127.0.0.1:60880_-n_0000000000) starting
[junit4:junit4] 2> 1423578 T3697 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 1423588 T3721 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 1423589 T3697 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 1423591 T3697 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 1423599 T3697 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1423601 T3720 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 1423606 T3722 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368956565204/collection1
[junit4:junit4] 2> 1423606 T3722 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 1423607 T3722 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1423607 T3722 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 1423608 T3722 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368956565204/collection1/'
[junit4:junit4] 2> 1423610 T3722 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-controljetty-1368956565204/collection1/lib/README' to classloader
[junit4:junit4] 2> 1423610 T3722 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-controljetty-1368956565204/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1423663 T3722 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1423728 T3722 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1423829 T3722 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1423835 T3722 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1424434 T3722 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1424438 T3722 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1424441 T3722 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1424446 T3722 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1424468 T3722 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1424469 T3722 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368956565204/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368956564901/control/data/
[junit4:junit4] 2> 1424469 T3722 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b29b889
[junit4:junit4] 2> 1424470 T3722 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1424470 T3722 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/control/data
[junit4:junit4] 2> 1424471 T3722 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368956564901/control/data/index/
[junit4:junit4] 2> 1424471 T3722 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368956564901/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1424472 T3722 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/control/data/index
[junit4:junit4] 2> 1424475 T3722 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@57cfb4c6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@38690cf3),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1424476 T3722 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1424479 T3722 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1424479 T3722 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1424480 T3722 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1424480 T3722 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1424481 T3722 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1424481 T3722 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1424482 T3722 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1424482 T3722 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1424483 T3722 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1424495 T3722 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1424502 T3722 oass.SolrIndexSearcher.<init> Opening Searcher@6665eff main
[junit4:junit4] 2> 1424502 T3722 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368956564901/control/data/tlog
[junit4:junit4] 2> 1424503 T3722 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1424503 T3722 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1424507 T3723 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6665eff main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1424509 T3722 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1424509 T3722 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1425104 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1425105 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60880_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60880"}
[junit4:junit4] 2> 1425105 T3720 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1425106 T3720 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1425120 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1425511 T3722 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1425511 T3722 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60880 collection:control_collection shard:shard1
[junit4:junit4] 2> 1425512 T3722 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 1425530 T3722 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1425540 T3722 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1425540 T3722 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1425541 T3722 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60880/collection1/
[junit4:junit4] 2> 1425541 T3722 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1425541 T3722 oasc.SyncStrategy.syncToMe http://127.0.0.1:60880/collection1/ has no replicas
[junit4:junit4] 2> 1425542 T3722 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60880/collection1/
[junit4:junit4] 2> 1425542 T3722 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 1426623 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1426643 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1426670 T3722 oasc.ZkController.register We are http://127.0.0.1:60880/collection1/ and leader is http://127.0.0.1:60880/collection1/
[junit4:junit4] 2> 1426670 T3722 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60880
[junit4:junit4] 2> 1426670 T3722 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1426671 T3722 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1426671 T3722 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1426673 T3722 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1426674 T3697 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1426675 T3697 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1426675 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1426689 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 1426691 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1426693 T3726 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@509e4f6d name:ZooKeeperConnection Watcher:127.0.0.1:60877/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1426693 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1426695 T3697 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1426697 T3697 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 1426908 T3697 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1426913 T3697 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60887
[junit4:junit4] 2> 1426914 T3697 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1426914 T3697 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1426915 T3697 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368956568764
[junit4:junit4] 2> 1426915 T3697 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368956568764/solr.xml
[junit4:junit4] 2> 1426916 T3697 oasc.CoreContainer.<init> New CoreContainer 268109419
[junit4:junit4] 2> 1426917 T3697 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368956568764/'
[junit4:junit4] 2> 1426917 T3697 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368956568764/'
[junit4:junit4] 2> 1427036 T3697 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1427037 T3697 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1427038 T3697 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1427038 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1427039 T3697 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1427039 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1427040 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1427040 T3697 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1427041 T3697 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1427042 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1427056 T3697 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1427056 T3697 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60877/solr
[junit4:junit4] 2> 1427057 T3697 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1427058 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1427062 T3737 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@249a97b name:ZooKeeperConnection Watcher:127.0.0.1:60877 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1427062 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1427079 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1427090 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1427092 T3739 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@34d0434c name:ZooKeeperConnection Watcher:127.0.0.1:60877/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1427092 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1427103 T3697 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1428106 T3697 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60887_
[junit4:junit4] 2> 1428109 T3697 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60887_
[junit4:junit4] 2> 1428111 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1428112 T3739 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1428112 T3726 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1428126 T3719 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1428133 T3740 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368956568764/collection1
[junit4:junit4] 2> 1428133 T3740 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1428134 T3740 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1428134 T3740 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1428136 T3740 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368956568764/collection1/'
[junit4:junit4] 2> 1428137 T3740 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty1-1368956568764/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1428138 T3740 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty1-1368956568764/collection1/lib/README' to classloader
[junit4:junit4] 2> 1428157 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1428158 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:60880__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60880_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60880"}
[junit4:junit4] 2> 1428163 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1428164 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1428164 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1428192 T3740 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1428255 T3740 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1428356 T3740 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1428362 T3740 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1428888 T3740 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1428891 T3740 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1428892 T3740 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1428896 T3740 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1428912 T3740 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1428913 T3740 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368956568764/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty1/
[junit4:junit4] 2> 1428913 T3740 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b29b889
[junit4:junit4] 2> 1428913 T3740 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1428914 T3740 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty1
[junit4:junit4] 2> 1428914 T3740 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty1/index/
[junit4:junit4] 2> 1428914 T3740 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1428915 T3740 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty1/index
[junit4:junit4] 2> 1428917 T3740 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2b8b6aec lockFactory=org.apache.lucene.store.NativeFSLockFactory@249f3e5d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1428917 T3740 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1428919 T3740 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1428920 T3740 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1428920 T3740 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1428921 T3740 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1428921 T3740 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1428921 T3740 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1428922 T3740 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1428922 T3740 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1428922 T3740 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1428931 T3740 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1428935 T3740 oass.SolrIndexSearcher.<init> Opening Searcher@3d0d7fbb main
[junit4:junit4] 2> 1428935 T3740 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty1/tlog
[junit4:junit4] 2> 1428936 T3740 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1428936 T3740 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1428939 T3741 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3d0d7fbb main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1428941 T3740 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1428941 T3740 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1429678 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1429679 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60887_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60887"}
[junit4:junit4] 2> 1429679 T3720 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 1429680 T3720 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1429684 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1429684 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1429684 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1429970 T3740 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1429970 T3740 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60887 collection:collection1 shard:shard1
[junit4:junit4] 2> 1429971 T3740 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 1429990 T3740 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1429993 T3740 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1429994 T3740 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1429994 T3740 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60887/collection1/
[junit4:junit4] 2> 1429994 T3740 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1429995 T3740 oasc.SyncStrategy.syncToMe http://127.0.0.1:60887/collection1/ has no replicas
[junit4:junit4] 2> 1429995 T3740 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60887/collection1/
[junit4:junit4] 2> 1429995 T3740 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1431200 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1431242 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1431242 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1431242 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1431328 T3740 oasc.ZkController.register We are http://127.0.0.1:60887/collection1/ and leader is http://127.0.0.1:60887/collection1/
[junit4:junit4] 2> 1431328 T3740 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60887
[junit4:junit4] 2> 1431328 T3740 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1431329 T3740 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1431329 T3740 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1431331 T3740 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1431332 T3697 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1431333 T3697 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1431333 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1431559 T3697 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1431563 T3697 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60894
[junit4:junit4] 2> 1431564 T3697 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1431565 T3697 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1431565 T3697 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368956573414
[junit4:junit4] 2> 1431566 T3697 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368956573414/solr.xml
[junit4:junit4] 2> 1431566 T3697 oasc.CoreContainer.<init> New CoreContainer 1094803956
[junit4:junit4] 2> 1431567 T3697 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368956573414/'
[junit4:junit4] 2> 1431568 T3697 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368956573414/'
[junit4:junit4] 2> 1431685 T3697 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1431686 T3697 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1431687 T3697 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1431688 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1431688 T3697 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1431689 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1431689 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1431690 T3697 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1431690 T3697 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1431691 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1431705 T3697 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1431706 T3697 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60877/solr
[junit4:junit4] 2> 1431706 T3697 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1431708 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1431712 T3753 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e0db1f7 name:ZooKeeperConnection Watcher:127.0.0.1:60877 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1431713 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1431732 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1431742 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1431744 T3755 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@178cdef7 name:ZooKeeperConnection Watcher:127.0.0.1:60877/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1431744 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1431753 T3697 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1432757 T3697 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60894_
[junit4:junit4] 2> 1432771 T3697 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60894_
[junit4:junit4] 2> 1432785 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1432786 T3755 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1432785 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1432785 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1432788 T3719 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1432788 T3739 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1432788 T3726 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1432793 T3756 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368956573414/collection1
[junit4:junit4] 2> 1432794 T3756 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1432794 T3756 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1432795 T3756 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1432796 T3756 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368956573414/collection1/'
[junit4:junit4] 2> 1432797 T3756 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty2-1368956573414/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1432798 T3756 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty2-1368956573414/collection1/lib/README' to classloader
[junit4:junit4] 2> 1432807 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1432808 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:60887__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60887_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60887"}
[junit4:junit4] 2> 1432821 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1432821 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1432821 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1432821 T3755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1432853 T3756 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1432915 T3756 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1433016 T3756 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1433022 T3756 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1433621 T3756 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1433625 T3756 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1433628 T3756 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1433633 T3756 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1433654 T3756 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1433655 T3756 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368956573414/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty2/
[junit4:junit4] 2> 1433655 T3756 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b29b889
[junit4:junit4] 2> 1433655 T3756 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1433656 T3756 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty2
[junit4:junit4] 2> 1433657 T3756 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty2/index/
[junit4:junit4] 2> 1433657 T3756 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1433657 T3756 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty2/index
[junit4:junit4] 2> 1433660 T3756 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@34aeb9d7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d779f92),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1433661 T3756 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1433664 T3756 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1433664 T3756 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1433665 T3756 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1433666 T3756 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1433666 T3756 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1433667 T3756 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1433667 T3756 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1433668 T3756 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1433668 T3756 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1433681 T3756 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1433687 T3756 oass.SolrIndexSearcher.<init> Opening Searcher@6d1ac52d main
[junit4:junit4] 2> 1433688 T3756 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty2/tlog
[junit4:junit4] 2> 1433689 T3756 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1433689 T3756 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1433694 T3757 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6d1ac52d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1433696 T3756 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1433696 T3756 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1434325 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1434326 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60894_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60894"}
[junit4:junit4] 2> 1434326 T3720 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1434327 T3720 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1434426 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1434426 T3755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1434426 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1434426 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1434699 T3756 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1434699 T3756 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60894 collection:collection1 shard:shard2
[junit4:junit4] 2> 1434700 T3756 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 1434718 T3756 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1434722 T3756 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1434722 T3756 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1434722 T3756 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60894/collection1/
[junit4:junit4] 2> 1434722 T3756 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1434723 T3756 oasc.SyncStrategy.syncToMe http://127.0.0.1:60894/collection1/ has no replicas
[junit4:junit4] 2> 1434723 T3756 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60894/collection1/
[junit4:junit4] 2> 1434723 T3756 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 1435931 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1435954 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1435955 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1435955 T3755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1435955 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1435961 T3756 oasc.ZkController.register We are http://127.0.0.1:60894/collection1/ and leader is http://127.0.0.1:60894/collection1/
[junit4:junit4] 2> 1435961 T3756 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60894
[junit4:junit4] 2> 1435961 T3756 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1435962 T3756 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1435962 T3756 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1435964 T3756 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1435965 T3697 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1435966 T3697 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1435967 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1436206 T3697 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1436210 T3697 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:48732
[junit4:junit4] 2> 1436211 T3697 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1436211 T3697 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1436212 T3697 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368956578048
[junit4:junit4] 2> 1436212 T3697 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368956578048/solr.xml
[junit4:junit4] 2> 1436213 T3697 oasc.CoreContainer.<init> New CoreContainer 1827383621
[junit4:junit4] 2> 1436214 T3697 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368956578048/'
[junit4:junit4] 2> 1436214 T3697 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368956578048/'
[junit4:junit4] 2> 1436334 T3697 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1436335 T3697 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1436336 T3697 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1436336 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1436337 T3697 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1436337 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1436338 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1436339 T3697 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1436339 T3697 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1436340 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1436354 T3697 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1436355 T3697 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60877/solr
[junit4:junit4] 2> 1436355 T3697 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1436357 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1436386 T3769 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6c52bf33 name:ZooKeeperConnection Watcher:127.0.0.1:60877 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1436387 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1436423 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1436435 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1436444 T3771 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d949ad5 name:ZooKeeperConnection Watcher:127.0.0.1:60877/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1436445 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1436450 T3697 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1437453 T3697 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48732_
[junit4:junit4] 2> 1437457 T3697 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48732_
[junit4:junit4] 2> 1437459 T3755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1437459 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1437460 T3771 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1437459 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1437459 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1437461 T3755 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1437471 T3739 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1437472 T3719 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1437472 T3726 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1437474 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1437474 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:60894__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60894_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60894"}
[junit4:junit4] 2> 1437480 T3772 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368956578048/collection1
[junit4:junit4] 2> 1437480 T3772 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1437486 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1437486 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1437487 T3755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1437486 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1437486 T3772 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1437486 T3771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1437488 T3772 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1437490 T3772 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368956578048/collection1/'
[junit4:junit4] 2> 1437492 T3772 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty3-1368956578048/collection1/lib/README' to classloader
[junit4:junit4] 2> 1437493 T3772 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty3-1368956578048/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1437552 T3772 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1437622 T3772 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1437723 T3772 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1437730 T3772 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1438313 T3772 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1438317 T3772 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1438320 T3772 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1438325 T3772 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1438347 T3772 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1438348 T3772 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368956578048/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty3/
[junit4:junit4] 2> 1438348 T3772 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b29b889
[junit4:junit4] 2> 1438349 T3772 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1438349 T3772 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty3
[junit4:junit4] 2> 1438350 T3772 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty3/index/
[junit4:junit4] 2> 1438350 T3772 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1438351 T3772 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty3/index
[junit4:junit4] 2> 1438353 T3772 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@76357127 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7785d2f4),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1438354 T3772 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1438357 T3772 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1438357 T3772 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1438358 T3772 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1438358 T3772 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1438359 T3772 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1438359 T3772 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1438360 T3772 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1438360 T3772 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1438361 T3772 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1438373 T3772 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1438379 T3772 oass.SolrIndexSearcher.<init> Opening Searcher@138e826d main
[junit4:junit4] 2> 1438379 T3772 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty3/tlog
[junit4:junit4] 2> 1438380 T3772 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1438381 T3772 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1438384 T3773 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@138e826d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1438386 T3772 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1438386 T3772 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1438990 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1438991 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:48732_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:48732"}
[junit4:junit4] 2> 1438991 T3720 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1438992 T3720 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1439005 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1439005 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1439005 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1439005 T3771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1439005 T3755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1439389 T3772 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1439389 T3772 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:48732 collection:collection1 shard:shard1
[junit4:junit4] 2> 1439393 T3772 oasc.ZkController.register We are http://127.0.0.1:48732/collection1/ and leader is http://127.0.0.1:60887/collection1/
[junit4:junit4] 2> 1439393 T3772 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48732
[junit4:junit4] 2> 1439393 T3772 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1439393 T3772 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C247 name=collection1 org.apache.solr.core.SolrCore@39b4f2e5 url=http://127.0.0.1:48732/collection1 node=127.0.0.1:48732_ C247_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:48732_, base_url=http://127.0.0.1:48732}
[junit4:junit4] 2> 1439394 T3774 C247 P48732 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1439394 T3772 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1439396 T3774 C247 P48732 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1439396 T3774 C247 P48732 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1439396 T3774 C247 P48732 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1439397 T3697 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1439398 T3697 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1439398 T3774 C247 P48732 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1439398 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1439420 T3729 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:48732__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1439634 T3697 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1439637 T3697 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:33065
[junit4:junit4] 2> 1439638 T3697 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1439639 T3697 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1439639 T3697 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368956581486
[junit4:junit4] 2> 1439640 T3697 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368956581486/solr.xml
[junit4:junit4] 2> 1439640 T3697 oasc.CoreContainer.<init> New CoreContainer 298187213
[junit4:junit4] 2> 1439641 T3697 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368956581486/'
[junit4:junit4] 2> 1439642 T3697 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368956581486/'
[junit4:junit4] 2> 1439761 T3697 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1439762 T3697 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1439763 T3697 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1439763 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1439764 T3697 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1439764 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1439765 T3697 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1439766 T3697 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1439766 T3697 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1439767 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1439781 T3697 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1439782 T3697 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60877/solr
[junit4:junit4] 2> 1439782 T3697 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1439783 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1439786 T3786 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e41a6aa name:ZooKeeperConnection Watcher:127.0.0.1:60877 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1439787 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1439789 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1439799 T3697 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1439801 T3788 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5a265e17 name:ZooKeeperConnection Watcher:127.0.0.1:60877/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1439801 T3697 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1439813 T3697 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1440509 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1440510 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:48732__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:48732_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:48732"}
[junit4:junit4] 2> 1440523 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1440523 T3755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1440523 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1440523 T3771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1440523 T3788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1440523 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1440816 T3697 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33065_
[junit4:junit4] 2> 1440818 T3697 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33065_
[junit4:junit4] 2> 1440821 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1440821 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1440821 T3788 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1440821 T3755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1440821 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1440821 T3771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1440821 T3788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1440823 T3726 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1440830 T3719 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1440830 T3755 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1440831 T3739 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1440831 T3771 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1440837 T3789 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368956581486/collection1
[junit4:junit4] 2> 1440837 T3789 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1440838 T3789 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1440838 T3789 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1440839 T3789 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368956581486/collection1/'
[junit4:junit4] 2> 1440841 T3789 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty4-1368956581486/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1440841 T3789 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty4-1368956581486/collection1/lib/README' to classloader
[junit4:junit4] 2> 1440894 T3789 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1440956 T3789 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1441058 T3789 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1441064 T3789 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1441423 T3729 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:48732__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 1441423 T3729 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:48732__collection1&state=recovering&nodeName=127.0.0.1:48732_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 1441854 T3789 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1441858 T3789 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1441861 T3789 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1441866 T3789 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1441889 T3789 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1441889 T3789 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368956581486/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/
[junit4:junit4] 2> 1441890 T3789 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b29b889
[junit4:junit4] 2> 1441890 T3789 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1441891 T3789 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4
[junit4:junit4] 2> 1441891 T3789 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/index/
[junit4:junit4] 2> 1441892 T3789 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1441892 T3789 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/index
[junit4:junit4] 2> 1441895 T3789 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c28b563 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bb11600),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1441896 T3789 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1441899 T3789 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1441899 T3789 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1441900 T3789 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1441900 T3789 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1441901 T3789 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1441901 T3789 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1441902 T3789 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1441902 T3789 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1441903 T3789 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1441915 T3789 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1441922 T3789 oass.SolrIndexSearcher.<init> Opening Searcher@5315f39c main
[junit4:junit4] 2> 1441923 T3789 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/tlog
[junit4:junit4] 2> 1441924 T3789 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1441924 T3789 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1441928 T3790 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5315f39c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1441930 T3789 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1441931 T3789 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1442027 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1442027 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:33065_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33065"}
[junit4:junit4] 2> 1442028 T3720 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1442028 T3720 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1442044 T3755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1442044 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1442044 T3771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1442044 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1442044 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1442044 T3788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1442934 T3789 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1442934 T3789 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:33065 collection:collection1 shard:shard2
[junit4:junit4] 2> 1442964 T3789 oasc.ZkController.register We are http://127.0.0.1:33065/collection1/ and leader is http://127.0.0.1:60894/collection1/
[junit4:junit4] 2> 1442965 T3789 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33065
[junit4:junit4] 2> 1442965 T3789 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1442965 T3789 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C248 name=collection1 org.apache.solr.core.SolrCore@402a7abc url=http://127.0.0.1:33065/collection1 node=127.0.0.1:33065_ C248_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:33065_, base_url=http://127.0.0.1:33065}
[junit4:junit4] 2> 1442966 T3791 C248 P33065 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1442966 T3789 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1442967 T3791 C248 P33065 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1442968 T3791 C248 P33065 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1442968 T3791 C248 P33065 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1442968 T3697 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1442969 T3697 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1442969 T3791 C248 P33065 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1442970 T3697 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1442986 T3697 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1442987 T3745 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:33065__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1442988 T3697 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 1442989 T3697 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 1442989 T3697 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C247_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:48732_, base_url=http://127.0.0.1:48732}
[junit4:junit4] 2> 1443425 T3774 C247 P48732 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:60887/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1443425 T3774 C247 P48732 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:48732 START replicas=[http://127.0.0.1:60887/collection1/] nUpdates=100
[junit4:junit4] 2> 1443426 T3774 C247 P48732 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1443426 T3774 C247 P48732 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1443426 T3774 C247 P48732 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1443426 T3774 C247 P48732 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1443427 T3774 C247 P48732 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1443427 T3774 C247 P48732 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:60887/collection1/. core=collection1
[junit4:junit4] 2> 1443427 T3774 C247 P48732 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C249 name=collection1 org.apache.solr.core.SolrCore@2277f2e8 url=http://127.0.0.1:60887/collection1 node=127.0.0.1:60887_ C249_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:60887_, base_url=http://127.0.0.1:60887, leader=true}
[junit4:junit4] 2> 1443434 T3730 C249 P60887 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1443440 T3731 C249 P60887 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1443443 T3731 C249 P60887 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2b8b6aec lockFactory=org.apache.lucene.store.NativeFSLockFactory@249f3e5d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1443444 T3731 C249 P60887 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1443445 T3731 C249 P60887 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2b8b6aec lockFactory=org.apache.lucene.store.NativeFSLockFactory@249f3e5d),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2b8b6aec lockFactory=org.apache.lucene.store.NativeFSLockFactory@249f3e5d),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1443445 T3731 C249 P60887 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1443446 T3731 C249 P60887 oass.SolrIndexSearcher.<init> Opening Searcher@1634536a realtime
[junit4:junit4] 2> 1443446 T3731 C249 P60887 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1443447 T3731 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1443448 T3774 C247 P48732 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1443448 T3774 C247 P48732 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1443450 T3732 C249 P60887 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1443451 T3732 C249 P60887 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 1443451 T3774 C247 P48732 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1443452 T3774 C247 P48732 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1443452 T3774 C247 P48732 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1443454 T3732 C249 P60887 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1443455 T3774 C247 P48732 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1443456 T3774 C247 P48732 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty3/index.20130519194305522
[junit4:junit4] 2> 1443456 T3774 C247 P48732 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@3e386a55 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3709d67a) fullCopy=false
[junit4:junit4] 2> 1443459 T3732 C249 P60887 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1443460 T3774 C247 P48732 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1443461 T3774 C247 P48732 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1443461 T3774 C247 P48732 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1443463 T3774 C247 P48732 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@76357127 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7785d2f4),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@76357127 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7785d2f4),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1443464 T3774 C247 P48732 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1443464 T3774 C247 P48732 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1443465 T3774 C247 P48732 oass.SolrIndexSearcher.<init> Opening Searcher@20e54357 main
[junit4:junit4] 2> 1443466 T3773 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@20e54357 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1443466 T3774 C247 P48732 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty3/index.20130519194305522 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty3/index.20130519194305522;done=true>>]
[junit4:junit4] 2> 1443466 T3774 C247 P48732 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty3/index.20130519194305522
[junit4:junit4] 2> 1443467 T3774 C247 P48732 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty3/index.20130519194305522
[junit4:junit4] 2> 1443467 T3774 C247 P48732 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1443467 T3774 C247 P48732 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1443467 T3774 C247 P48732 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1443468 T3774 C247 P48732 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1443469 T3774 C247 P48732 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1443548 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1443549 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:33065__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:33065_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33065"}
[junit4:junit4] 2> 1443552 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:48732__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:48732_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:48732"}
[junit4:junit4] 2> 1443564 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1443564 T3755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1443564 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1443564 T3788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1443564 T3771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1443564 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1443989 T3745 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:33065__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 1443989 T3745 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:33065__collection1&state=recovering&nodeName=127.0.0.1:33065_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 1443991 T3697 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1444993 T3697 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C248_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:33065_, base_url=http://127.0.0.1:33065}
[junit4:junit4] 2> 1445991 T3791 C248 P33065 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:60894/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1445991 T3791 C248 P33065 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:33065 START replicas=[http://127.0.0.1:60894/collection1/] nUpdates=100
[junit4:junit4] 2> 1445992 T3791 C248 P33065 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1445992 T3791 C248 P33065 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1445992 T3791 C248 P33065 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1445992 T3791 C248 P33065 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1445993 T3791 C248 P33065 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1445993 T3791 C248 P33065 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:60894/collection1/. core=collection1
[junit4:junit4] 2> 1445993 T3791 C248 P33065 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1445995 T3697 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C250 name=collection1 org.apache.solr.core.SolrCore@3396deb url=http://127.0.0.1:60894/collection1 node=127.0.0.1:60894_ C250_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:60894_, base_url=http://127.0.0.1:60894, leader=true}
[junit4:junit4] 2> 1446001 T3746 C250 P60894 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 1446005 T3747 C250 P60894 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1446008 T3747 C250 P60894 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@34aeb9d7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d779f92),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1446009 T3747 C250 P60894 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1446010 T3747 C250 P60894 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@34aeb9d7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d779f92),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@34aeb9d7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d779f92),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1446010 T3747 C250 P60894 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1446011 T3747 C250 P60894 oass.SolrIndexSearcher.<init> Opening Searcher@5ff89427 realtime
[junit4:junit4] 2> 1446011 T3747 C250 P60894 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1446012 T3747 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1446013 T3791 C248 P33065 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1446013 T3791 C248 P33065 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1446015 T3748 C250 P60894 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1446015 T3748 C250 P60894 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 1446016 T3791 C248 P33065 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1446016 T3791 C248 P33065 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1446016 T3791 C248 P33065 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1446018 T3748 C250 P60894 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1446019 T3791 C248 P33065 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1446020 T3791 C248 P33065 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/index.20130519194308086
[junit4:junit4] 2> 1446020 T3791 C248 P33065 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@2f3174a9 lockFactory=org.apache.lucene.store.NativeFSLockFactory@23c53f2f) fullCopy=false
[junit4:junit4] 2> 1446023 T3748 C250 P60894 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1446024 T3791 C248 P33065 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1446025 T3791 C248 P33065 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1446025 T3791 C248 P33065 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1446027 T3791 C248 P33065 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c28b563 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bb11600),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c28b563 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bb11600),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1446028 T3791 C248 P33065 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1446028 T3791 C248 P33065 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1446028 T3791 C248 P33065 oass.SolrIndexSearcher.<init> Opening Searcher@7a0a994 main
[junit4:junit4] 2> 1446029 T3790 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7a0a994 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1446030 T3791 C248 P33065 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/index.20130519194308086 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/index.20130519194308086;done=true>>]
[junit4:junit4] 2> 1446030 T3791 C248 P33065 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/index.20130519194308086
[junit4:junit4] 2> 1446030 T3791 C248 P33065 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/index.20130519194308086
[junit4:junit4] 2> 1446031 T3791 C248 P33065 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1446031 T3791 C248 P33065 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1446031 T3791 C248 P33065 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1446031 T3791 C248 P33065 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1446033 T3791 C248 P33065 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1446579 T3720 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1446581 T3720 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:33065__collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:33065_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33065"}
[junit4:junit4] 2> 1446613 T3719 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1446613 T3755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1446613 T3726 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1446613 T3771 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1446613 T3788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1446613 T3739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1446997 T3697 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1446998 T3697 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C251 name=collection1 org.apache.solr.core.SolrCore@4fddb4da url=http://127.0.0.1:60880/collection1 node=127.0.0.1:60880_ C251_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:60880_, base_url=http://127.0.0.1:60880, leader=true}
[junit4:junit4] 2> 1447007 T3709 C251 P60880 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1447011 T3709 C251 P60880 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@57cfb4c6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@38690cf3),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1447012 T3709 C251 P60880 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1447012 T3709 C251 P60880 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@57cfb4c6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@38690cf3),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@57cfb4c6 lockFactory=org.apache.lucene.store.NativeFSLockFactory@38690cf3),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1447013 T3709 C251 P60880 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1447014 T3709 C251 P60880 oass.SolrIndexSearcher.<init> Opening Searcher@60e3bd34 main
[junit4:junit4] 2> 1447014 T3709 C251 P60880 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1447015 T3723 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@60e3bd34 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1447015 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 1447026 T3733 C249 P60887 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1447027 T3733 C249 P60887 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2b8b6aec lockFactory=org.apache.lucene.store.NativeFSLockFactory@249f3e5d),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2b8b6aec lockFactory=org.apache.lucene.store.NativeFSLockFactory@249f3e5d),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1447028 T3733 C249 P60887 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1447028 T3733 C249 P60887 oass.SolrIndexSearcher.<init> Opening Searcher@7d8427da main
[junit4:junit4] 2> 1447029 T3733 C249 P60887 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1447030 T3741 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7d8427da main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1447030 T3733 C249 P60887 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:48732/collection1/, StdNode: http://127.0.0.1:60894/collection1/, StdNode: http://127.0.0.1:33065/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 1447033 T3749 C250 P60894 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1447036 T3749 C250 P60894 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@34aeb9d7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d779f92),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@34aeb9d7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d779f92),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1447036 T3749 C250 P60894 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1447037 T3749 C250 P60894 oass.SolrIndexSearcher.<init> Opening Searcher@25e41feb main
[junit4:junit4] 2> 1447037 T3749 C250 P60894 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1447038 T3757 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@25e41feb main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1447039 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> C248_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:33065_, base_url=http://127.0.0.1:33065}
[junit4:junit4] 2> 1447043 T3778 C248 P33065 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C247_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:48732_, base_url=http://127.0.0.1:48732}
[junit4:junit4] 2> 1447043 T3761 C247 P48732 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1447045 T3778 C248 P33065 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c28b563 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bb11600),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c28b563 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bb11600),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1447045 T3761 C247 P48732 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@76357127 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7785d2f4),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@76357127 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7785d2f4),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1447046 T3778 C248 P33065 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1447046 T3761 C247 P48732 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1447047 T3778 C248 P33065 oass.SolrIndexSearcher.<init> Opening Searcher@5bdf75fc main
[junit4:junit4] 2> 1447048 T3761 C247 P48732 oass.SolrIndexSearcher.<init> Opening Searcher@1aff73e8 main
[junit4:junit4] 2> 1447048 T3778 C248 P33065 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1447049 T3790 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5bdf75fc main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1447049 T3773 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1aff73e8 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1447050 T3778 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1447049 T3761 C247 P48732 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1447051 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 1447051 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 25
[junit4:junit4] 2> 1447052 T3697 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1447055 T3734 C249 P60887 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1447057 T3762 C247 P48732 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1447059 T3750 C250 P60894 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1447061 T3779 C248 P33065 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 1449066 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435455026501779456)} 0 2
[junit4:junit4] 2> 1449074 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435455026505973760&update.from=http://127.0.0.1:60894/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435455026505973760)} 0 2
[junit4:junit4] 2> 1449076 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1435455026510168064&update.from=http://127.0.0.1:60887/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435455026510168064)} 0 1
[junit4:junit4] 2> 1449077 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1435455026510168064)} 0 5
[junit4:junit4] 2> 1449077 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435455026505973760)} 0 9
[junit4:junit4] 2> 1449081 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0 (1435455026518556672)]} 0 1
[junit4:junit4] 2> 1449088 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!0 (1435455026523799552)]} 0 0
[junit4:junit4] 2> 1449089 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!0 (1435455026523799552)]} 0 4
[junit4:junit4] 2> 1449090 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0]} 0 7
[junit4:junit4] 2> 1449092 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1435455026531139584)]} 0 0
[junit4:junit4] 2> 1449099 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!1 (1435455026536382464)]} 0 0
[junit4:junit4] 2> 1449100 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!1 (1435455026536382464)]} 0 3
[junit4:junit4] 2> 1449101 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1]} 0 6
[junit4:junit4] 2> 1449103 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2 (1435455026542673920)]} 0 0
[junit4:junit4] 2> 1449110 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!2 (1435455026547916800)]} 0 0
[junit4:junit4] 2> 1449111 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!2 (1435455026547916800)]} 0 3
[junit4:junit4] 2> 1449112 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2]} 0 6
[junit4:junit4] 2> 1449114 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1435455026554208256)]} 0 0
[junit4:junit4] 2> 1449119 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!3 (1435455026557353984)]} 0 0
[junit4:junit4] 2> 1449120 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1435455026557353984)]} 0 3
[junit4:junit4] 2> 1449122 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4 (1435455026562596864)]} 0 0
[junit4:junit4] 2> 1449129 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!4 (1435455026567839744)]} 0 0
[junit4:junit4] 2> 1449130 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!4 (1435455026567839744)]} 0 3
[junit4:junit4] 2> 1449130 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4]} 0 5
[junit4:junit4] 2> 1449133 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5 (1435455026574131200)]} 0 0
[junit4:junit4] 2> 1449138 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!5 (1435455026577276928)]} 0 0
[junit4:junit4] 2> 1449139 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5 (1435455026577276928)]} 0 3
[junit4:junit4] 2> 1449141 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6 (1435455026582519808)]} 0 0
[junit4:junit4] 2> 1449148 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!6 (1435455026587762688)]} 0 0
[junit4:junit4] 2> 1449149 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!6 (1435455026587762688)]} 0 3
[junit4:junit4] 2> 1449150 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6]} 0 6
[junit4:junit4] 2> 1449152 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7 (1435455026594054144)]} 0 0
[junit4:junit4] 2> 1449159 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!7 (1435455026599297024)]} 0 0
[junit4:junit4] 2> 1449160 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!7 (1435455026599297024)]} 0 3
[junit4:junit4] 2> 1449160 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7]} 0 5
[junit4:junit4] 2> 1449163 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1435455026605588480)]} 0 0
[junit4:junit4] 2> 1449168 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!8 (1435455026608734208)]} 0 0
[junit4:junit4] 2> 1449169 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1435455026608734208)]} 0 3
[junit4:junit4] 2> 1449171 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9 (1435455026613977088)]} 0 0
[junit4:junit4] 2> 1449176 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!9 (1435455026617122816)]} 0 0
[junit4:junit4] 2> 1449177 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9 (1435455026617122816)]} 0 3
[junit4:junit4] 2> 1449179 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10 (1435455026622365696)]} 0 0
[junit4:junit4] 2> 1449186 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!10 (1435455026627608576)]} 0 0
[junit4:junit4] 2> 1449187 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!10 (1435455026627608576)]} 0 3
[junit4:junit4] 2> 1449187 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10]} 0 5
[junit4:junit4] 2> 1449190 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11 (1435455026633900032)]} 0 0
[junit4:junit4] 2> 1449197 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!11 (1435455026639142912)]} 0 0
[junit4:junit4] 2> 1449198 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!11 (1435455026639142912)]} 0 3
[junit4:junit4] 2> 1449198 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11]} 0 5
[junit4:junit4] 2> 1449201 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12 (1435455026645434368)]} 0 0
[junit4:junit4] 2> 1449206 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!12 (1435455026648580096)]} 0 0
[junit4:junit4] 2> 1449207 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12 (1435455026648580096)]} 0 3
[junit4:junit4] 2> 1449209 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13 (1435455026653822976)]} 0 0
[junit4:junit4] 2> 1449216 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!13 (1435455026659065856)]} 0 0
[junit4:junit4] 2> 1449217 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!13 (1435455026659065856)]} 0 3
[junit4:junit4] 2> 1449217 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13]} 0 5
[junit4:junit4] 2> 1449220 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1435455026665357312)]} 0 0
[junit4:junit4] 2> 1449225 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!14 (1435455026668503040)]} 0 0
[junit4:junit4] 2> 1449226 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1435455026668503040)]} 0 3
[junit4:junit4] 2> 1449228 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1435455026673745920)]} 0 0
[junit4:junit4] 2> 1449235 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!15 (1435455026678988800)]} 0 0
[junit4:junit4] 2> 1449236 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!15 (1435455026678988800)]} 0 3
[junit4:junit4] 2> 1449236 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15]} 0 5
[junit4:junit4] 2> 1449239 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16 (1435455026685280256)]} 0 0
[junit4:junit4] 2> 1449244 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!16 (1435455026688425984)]} 0 0
[junit4:junit4] 2> 1449245 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16 (1435455026688425984)]} 0 3
[junit4:junit4] 2> 1449247 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1435455026693668864)]} 0 0
[junit4:junit4] 2> 1449252 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!17 (1435455026696814592)]} 0 0
[junit4:junit4] 2> 1449253 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1435455026696814592)]} 0 3
[junit4:junit4] 2> 1449255 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18 (1435455026702057472)]} 0 0
[junit4:junit4] 2> 1449262 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!18 (1435455026707300352)]} 0 0
[junit4:junit4] 2> 1449263 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!18 (1435455026707300352)]} 0 3
[junit4:junit4] 2> 1449263 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18]} 0 5
[junit4:junit4] 2> 1449266 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1435455026713591808)]} 0 0
[junit4:junit4] 2> 1449273 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!19 (1435455026718834688)]} 0 0
[junit4:junit4] 2> 1449274 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[t!19 (1435455026718834688)]} 0 3
[junit4:junit4] 2> 1449274 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19]} 0 5
[junit4:junit4] 2> 1449277 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20 (1435455026725126144)]} 0 0
[junit4:junit4] 2> 1449284 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!20 (1435455026730369024)]} 0 0
[junit4:junit4] 2> 1449285 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!20 (1435455026730369024)]} 0 3
[junit4:junit4] 2> 1449285 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20]} 0 5
[junit4:junit4] 2> 1449288 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1435455026736660480)]} 0 0
[junit4:junit4] 2> 1449293 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!21 (1435455026739806208)]} 0 0
[junit4:junit4] 2> 1449294 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1435455026739806208)]} 0 3
[junit4:junit4] 2> 1449299 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22 (1435455026747146240)]} 0 1
[junit4:junit4] 2> 1449307 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!22 (1435455026754486272)]} 0 0
[junit4:junit4] 2> 1449308 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[w!22 (1435455026754486272)]} 0 3
[junit4:junit4] 2> 1449308 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22]} 0 6
[junit4:junit4] 2> 1449311 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23 (1435455026760777728)]} 0 0
[junit4:junit4] 2> 1449316 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!23 (1435455026763923456)]} 0 0
[junit4:junit4] 2> 1449317 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23 (1435455026763923456)]} 0 3
[junit4:junit4] 2> 1449319 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24 (1435455026769166336)]} 0 0
[junit4:junit4] 2> 1449324 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!24 (1435455026772312064)]} 0 0
[junit4:junit4] 2> 1449325 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24 (1435455026772312064)]} 0 3
[junit4:junit4] 2> 1449327 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25 (1435455026777554944)]} 0 0
[junit4:junit4] 2> 1449334 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!25 (1435455026782797824)]} 0 0
[junit4:junit4] 2> 1449335 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[z!25 (1435455026782797824)]} 0 3
[junit4:junit4] 2> 1449335 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25]} 0 5
[junit4:junit4] 2> 1449338 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26 (1435455026789089280)]} 0 0
[junit4:junit4] 2> 1449345 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!26 (1435455026794332160)]} 0 0
[junit4:junit4] 2> 1449346 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!26 (1435455026794332160)]} 0 3
[junit4:junit4] 2> 1449346 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26]} 0 5
[junit4:junit4] 2> 1449349 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27 (1435455026800623616)]} 0 0
[junit4:junit4] 2> 1449356 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!27 (1435455026805866496)]} 0 0
[junit4:junit4] 2> 1449357 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!27 (1435455026805866496)]} 0 3
[junit4:junit4] 2> 1449357 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27]} 0 5
[junit4:junit4] 2> 1449360 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28 (1435455026812157952)]} 0 0
[junit4:junit4] 2> 1449367 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!28 (1435455026817400832)]} 0 0
[junit4:junit4] 2> 1449368 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!28 (1435455026817400832)]} 0 3
[junit4:junit4] 2> 1449369 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28]} 0 6
[junit4:junit4] 2> 1449371 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29 (1435455026823692288)]} 0 0
[junit4:junit4] 2> 1449378 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!29 (1435455026828935168)]} 0 0
[junit4:junit4] 2> 1449379 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!29 (1435455026828935168)]} 0 3
[junit4:junit4] 2> 1449379 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29]} 0 5
[junit4:junit4] 2> 1449382 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1435455026835226624)]} 0 0
[junit4:junit4] 2> 1449387 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!30 (1435455026838372352)]} 0 0
[junit4:junit4] 2> 1449388 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1435455026838372352)]} 0 3
[junit4:junit4] 2> 1449391 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31 (1435455026844663808)]} 0 0
[junit4:junit4] 2> 1449398 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!31 (1435455026849906688)]} 0 0
[junit4:junit4] 2> 1449399 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!31 (1435455026849906688)]} 0 3
[junit4:junit4] 2> 1449400 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31]} 0 6
[junit4:junit4] 2> 1449403 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1435455026857246720)]} 0 0
[junit4:junit4] 2> 1449409 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!32 (1435455026861441024)]} 0 0
[junit4:junit4] 2> 1449410 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1435455026861441024)]} 0 4
[junit4:junit4] 2> 1449412 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33 (1435455026866683904)]} 0 0
[junit4:junit4] 2> 1449419 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!33 (1435455026871926784)]} 0 0
[junit4:junit4] 2> 1449420 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!33 (1435455026871926784)]} 0 3
[junit4:junit4] 2> 1449420 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33]} 0 5
[junit4:junit4] 2> 1449423 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34 (1435455026878218240)]} 0 0
[junit4:junit4] 2> 1449430 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!34 (1435455026883461120)]} 0 0
[junit4:junit4] 2> 1449431 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!34 (1435455026883461120)]} 0 3
[junit4:junit4] 2> 1449431 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34]} 0 5
[junit4:junit4] 2> 1449434 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35 (1435455026889752576)]} 0 0
[junit4:junit4] 2> 1449441 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!35 (1435455026894995456)]} 0 0
[junit4:junit4] 2> 1449442 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!35 (1435455026894995456)]} 0 3
[junit4:junit4] 2> 1449442 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35]} 0 5
[junit4:junit4] 2> 1449445 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36 (1435455026901286912)]} 0 0
[junit4:junit4] 2> 1449450 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!36 (1435455026904432640)]} 0 0
[junit4:junit4] 2> 1449451 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36 (1435455026904432640)]} 0 3
[junit4:junit4] 2> 1449453 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37 (1435455026909675520)]} 0 0
[junit4:junit4] 2> 1449460 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!37 (1435455026914918400)]} 0 0
[junit4:junit4] 2> 1449461 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!37 (1435455026914918400)]} 0 3
[junit4:junit4] 2> 1449461 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37]} 0 5
[junit4:junit4] 2> 1449464 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1435455026921209856)]} 0 0
[junit4:junit4] 2> 1449469 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!38 (1435455026924355584)]} 0 0
[junit4:junit4] 2> 1449470 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1435455026924355584)]} 0 3
[junit4:junit4] 2> 1449472 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39 (1435455026929598464)]} 0 0
[junit4:junit4] 2> 1449479 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!39 (1435455026934841344)]} 0 0
[junit4:junit4] 2> 1449480 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!39 (1435455026934841344)]} 0 3
[junit4:junit4] 2> 1449480 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39]} 0 5
[junit4:junit4] 2> 1449483 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40 (1435455026941132800)]} 0 0
[junit4:junit4] 2> 1449490 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!40 (1435455026946375680)]} 0 0
[junit4:junit4] 2> 1449491 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!40 (1435455026946375680)]} 0 3
[junit4:junit4] 2> 1449491 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40]} 0 5
[junit4:junit4] 2> 1449494 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41 (1435455026952667136)]} 0 0
[junit4:junit4] 2> 1449501 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!41 (1435455026957910016)]} 0 0
[junit4:junit4] 2> 1449502 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!41 (1435455026957910016)]} 0 3
[junit4:junit4] 2> 1449503 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41]} 0 6
[junit4:junit4] 2> 1449505 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1435455026964201472)]} 0 0
[junit4:junit4] 2> 1449512 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!42 (1435455026969444352)]} 0 0
[junit4:junit4] 2> 1449513 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!42 (1435455026969444352)]} 0 3
[junit4:junit4] 2> 1449513 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42]} 0 5
[junit4:junit4] 2> 1449516 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1435455026975735808)]} 0 0
[junit4:junit4] 2> 1449521 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!43 (1435455026978881536)]} 0 0
[junit4:junit4] 2> 1449522 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1435455026978881536)]} 0 3
[junit4:junit4] 2> 1449524 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1435455026984124416)]} 0 0
[junit4:junit4] 2> 1449529 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!44 (1435455026987270144)]} 0 0
[junit4:junit4] 2> 1449530 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1435455026987270144)]} 0 3
[junit4:junit4] 2> 1449532 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45 (1435455026992513024)]} 0 0
[junit4:junit4] 2> 1449539 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!45 (1435455026997755904)]} 0 0
[junit4:junit4] 2> 1449540 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[t!45 (1435455026997755904)]} 0 3
[junit4:junit4] 2> 1449540 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45]} 0 5
[junit4:junit4] 2> 1449543 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1435455027004047360)]} 0 0
[junit4:junit4] 2> 1449548 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!46 (1435455027007193088)]} 0 0
[junit4:junit4] 2> 1449549 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1435455027007193088)]} 0 3
[junit4:junit4] 2> 1449551 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47 (1435455027012435968)]} 0 0
[junit4:junit4] 2> 1449558 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!47 (1435455027017678848)]} 0 0
[junit4:junit4] 2> 1449559 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[v!47 (1435455027017678848)]} 0 3
[junit4:junit4] 2> 1449559 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47]} 0 5
[junit4:junit4] 2> 1449562 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1435455027023970304)]} 0 0
[junit4:junit4] 2> 1449567 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!48 (1435455027027116032)]} 0 0
[junit4:junit4] 2> 1449568 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1435455027027116032)]} 0 3
[junit4:junit4] 2> 1449570 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49 (1435455027032358912)]} 0 0
[junit4:junit4] 2> 1449577 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!49 (1435455027037601792)]} 0 0
[junit4:junit4] 2> 1449578 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!49 (1435455027037601792)]} 0 3
[junit4:junit4] 2> 1449578 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49]} 0 5
[junit4:junit4] 2> 1449581 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50 (1435455027043893248)]} 0 0
[junit4:junit4] 2> 1449586 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!50 (1435455027047038976)]} 0 0
[junit4:junit4] 2> 1449587 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50 (1435455027047038976)]} 0 3
[junit4:junit4] 2> 1449589 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51 (1435455027052281856)]} 0 0
[junit4:junit4] 2> 1449594 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!51 (1435455027055427584)]} 0 0
[junit4:junit4] 2> 1449595 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51 (1435455027055427584)]} 0 3
[junit4:junit4] 2> 1449597 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52 (1435455027060670464)]} 0 0
[junit4:junit4] 2> 1449604 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!52 (1435455027065913344)]} 0 0
[junit4:junit4] 2> 1449605 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!52 (1435455027065913344)]} 0 3
[junit4:junit4] 2> 1449605 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52]} 0 5
[junit4:junit4] 2> 1449608 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53 (1435455027072204800)]} 0 0
[junit4:junit4] 2> 1449613 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!53 (1435455027075350528)]} 0 0
[junit4:junit4] 2> 1449614 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53 (1435455027075350528)]} 0 3
[junit4:junit4] 2> 1449616 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1435455027080593408)]} 0 0
[junit4:junit4] 2> 1449621 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!54 (1435455027083739136)]} 0 0
[junit4:junit4] 2> 1449622 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1435455027083739136)]} 0 3
[junit4:junit4] 2> 1449624 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55 (1435455027088982016)]} 0 0
[junit4:junit4] 2> 1449629 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!55 (1435455027092127744)]} 0 0
[junit4:junit4] 2> 1449630 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55 (1435455027092127744)]} 0 3
[junit4:junit4] 2> 1449632 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56 (1435455027097370624)]} 0 0
[junit4:junit4] 2> 1449639 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!56 (1435455027102613504)]} 0 0
[junit4:junit4] 2> 1449640 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!56 (1435455027102613504)]} 0 3
[junit4:junit4] 2> 1449640 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56]} 0 5
[junit4:junit4] 2> 1449643 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57 (1435455027108904960)]} 0 0
[junit4:junit4] 2> 1449650 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!57 (1435455027114147840)]} 0 0
[junit4:junit4] 2> 1449651 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!57 (1435455027114147840)]} 0 3
[junit4:junit4] 2> 1449651 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57]} 0 5
[junit4:junit4] 2> 1449654 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58 (1435455027120439296)]} 0 0
[junit4:junit4] 2> 1449659 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!58 (1435455027123585024)]} 0 0
[junit4:junit4] 2> 1449660 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58 (1435455027123585024)]} 0 3
[junit4:junit4] 2> 1449662 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59 (1435455027128827904)]} 0 0
[junit4:junit4] 2> 1449669 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!59 (1435455027134070784)]} 0 0
[junit4:junit4] 2> 1449670 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!59 (1435455027134070784)]} 0 3
[junit4:junit4] 2> 1449670 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59]} 0 5
[junit4:junit4] 2> 1449673 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60 (1435455027140362240)]} 0 0
[junit4:junit4] 2> 1449680 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!60 (1435455027145605120)]} 0 0
[junit4:junit4] 2> 1449681 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!60 (1435455027145605120)]} 0 3
[junit4:junit4] 2> 1449681 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60]} 0 5
[junit4:junit4] 2> 1449684 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61 (1435455027151896576)]} 0 0
[junit4:junit4] 2> 1449689 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!61 (1435455027155042304)]} 0 0
[junit4:junit4] 2> 1449690 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61 (1435455027155042304)]} 0 3
[junit4:junit4] 2> 1449692 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62 (1435455027160285184)]} 0 0
[junit4:junit4] 2> 1449697 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!62 (1435455027163430912)]} 0 0
[junit4:junit4] 2> 1449698 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62 (1435455027163430912)]} 0 3
[junit4:junit4] 2> 1449700 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63 (1435455027168673792)]} 0 0
[junit4:junit4] 2> 1449707 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!63 (1435455027173916672)]} 0 0
[junit4:junit4] 2> 1449708 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!63 (1435455027173916672)]} 0 3
[junit4:junit4] 2> 1449708 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63]} 0 5
[junit4:junit4] 2> 1449711 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64 (1435455027180208128)]} 0 0
[junit4:junit4] 2> 1449718 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!64 (1435455027185451008)]} 0 0
[junit4:junit4] 2> 1449719 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!64 (1435455027185451008)]} 0 3
[junit4:junit4] 2> 1449719 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64]} 0 5
[junit4:junit4] 2> 1449722 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!65 (1435455027191742464)]} 0 0
[junit4:junit4] 2> 1449727 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!65 (1435455027194888192)]} 0 0
[junit4:junit4] 2> 1449728 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!65 (1435455027194888192)]} 0 3
[junit4:junit4] 2> 1449730 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!66 (1435455027200131072)]} 0 0
[junit4:junit4] 2> 1449737 T3780 C248 P33065 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!66 (1435455027205373952)]} 0 0
[junit4:junit4] 2> 1449738 T3749 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!66 (1435455027205373952)]} 0 3
[junit4:junit4] 2> 1449738 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!66]} 0 5
[junit4:junit4] 2> 1449741 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!67 (1435455027211665408)]} 0 0
[junit4:junit4] 2> 1449746 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!67 (1435455027214811136)]} 0 0
[junit4:junit4] 2> 1449747 T3733 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!67 (1435455027214811136)]} 0 3
[junit4:junit4] 2> 1449749 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!68 (1435455027220054016)]} 0 0
[junit4:junit4] 2> 1449756 T3761 C247 P48732 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60887/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!68 (1435455027225296896)]} 0 0
[junit4:junit4] 2> 1449757 T3735 C249 P60887 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:60894/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!68 (1435455027225296896)]} 0 3
[junit4:junit4] 2> 1449757 T3751 C250 P60894 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!68]} 0 5
[junit4:junit4] 2> 1449760 T3709 C251 P60880 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!69 (1435455027
[...truncated too long message...]
ate
[junit4:junit4] 2> 1458587 T3697 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 1458587 T3697 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> C248_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:33065_, base_url=http://127.0.0.1:33065, leader=true}
[junit4:junit4] 2> 1458590 T3697 C248 P33065 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c28b563 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bb11600),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c28b563 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bb11600),segFN=segments_5,generation=5}
[junit4:junit4] 2> 1458591 T3697 C248 P33065 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 1458593 T3697 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 1458594 T3697 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 1458594 T3697 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4;done=false>>]
[junit4:junit4] 2> 1458595 T3697 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4
[junit4:junit4] 2> 1458595 T3697 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/index;done=false>>]
[junit4:junit4] 2> 1458596 T3697 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368956564901/jetty4/index
[junit4:junit4] 2> 1458597 T3818 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89715937437745164-127.0.0.1:33065_-n_0000000004) am no longer a leader.
[junit4:junit4] 2> 1458599 T3697 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 1458671 T3697 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 1458673 T3697 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:60877 60877
[junit4:junit4] 2> 1458742 T3697 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 60880
[junit4:junit4] 2> !!!! WARNING: best effort to remove /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-1368956564901 FAILED !!!!!
[junit4:junit4] 2> 1458743 T3697 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 1458744 T3697 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:60877 60877
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ShardSplitTest -Dtests.method=testDistribSearch -Dtests.seed=51CC87C365F5FFBD -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_EG -Dtests.timezone=Australia/Victoria -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR 35.9s J0 | ShardSplitTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:60887 returned non ok status:500, message:Server Error
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([51CC87C365F5FFBD:D02A09DB12AA9F81]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:133)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 1458764 T3697 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 35941 T3696 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> 1459899 T3788 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1459899 T3788 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1459899 T3788 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {id=Lucene41(blocksize=128), _version_=PostingsFormat(name=Asserting)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ar_EG, timezone=Australia/Victoria
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=1,free=253256256,total=529530880
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestQuerySenderListener, MoreLikeThisHandlerTest, LukeRequestHandlerTest, DirectSolrConnectionTest, TestSearchPerf, SliceStateUpdateTest, TestGroupingSearch, SOLR749Test, WordBreakSolrSpellCheckerTest, TestFuzzyAnalyzedSuggestions, TestSurroundQueryParser, TestPluginEnable, SearchHandlerTest, TermVectorComponentTest, TestSolrDeletionPolicy2, SoftAutoCommitTest, TestXIncludeConfig, QueryResultKeyTest, PreAnalyzedFieldTest, TestFastLRUCache, CircularListTest, TermsComponentTest, TestRealTimeGet, DistributedQueryElevationComponentTest, TestPHPSerializedResponseWriter, OverseerTest, TestSolrQueryParser, TestPseudoReturnFields, TestConfig, AutoCommitTest, TestSort, SuggesterTest, FieldMutatingUpdateProcessorTest, IndexSchemaTest, RAMDirectoryFactoryTest, BadCopyFieldTest, SuggesterFSTTest, TestValueSourceCache, TestBadConfig, TestStressRecovery, SolrIndexSplitterTest, TestRandomDVFaceting, MBeansHandlerTest, TestSolrDeletionPolicy1, TestWriterPerf, BadComponentTest, DistributedTermsComponentTest, OverseerCollectionProcessorTest, DocumentBuilderTest, ExternalFileFieldSortTest, BasicDistributedZkTest, TestCharFilters, ZkCLITest, RegexBoostProcessorTest, TestManagedSchema, RecoveryZkTest, TestPerFieldSimilarity, AnalysisAfterCoreReloadTest, TestQueryUtils, LeaderElectionTest, TestSchemaResource, TestFieldTypeCollectionResource, TestDocumentBuilder, PreAnalyzedUpdateProcessorTest, PeerSyncTest, TestCloudManagedSchema, MinimalSchemaTest, TestCoreContainer, StatelessScriptUpdateProcessorFactoryTest, BinaryUpdateRequestHandlerTest, LegacyHTMLStripCharFilterTest, CollectionsAPIDistributedZkTest, OpenCloseCoreStressTest, LeaderElectionIntegrationTest, BasicZkTest, ClusterStateUpdateTest, TestRandomFaceting, TestStressReorder, TestMultiCoreConfBootstrap, TestReload, TestStressVersions, HardAutoCommitTest, SimpleFacetsTest, SolrCoreTest, StatsComponentTest, BadIndexSchemaTest, TestFunctionQuery, BasicFunctionalityTest, ShowFileRequestHandlerTest, CurrencyFieldXmlFileTest, SimplePostToolTest, TestExtendedDismaxParser, SpellCheckCollatorTest, CoreAdminHandlerTest, SolrRequestParserTest, DocValuesTest, TestTrie, SuggesterWFSTTest, PolyFieldTest, SolrCoreCheckLockOnStartupTest, TestAtomicUpdateErrorCases, QueryEqualityTest, SortByFunctionTest, DocValuesMultiTest, XsltUpdateRequestHandlerTest, DisMaxRequestHandlerTest, TestReversedWildcardFilterFactory, PrimitiveFieldTypeTest, FileBasedSpellCheckerTest, TestArbitraryIndexDir, ReturnFieldsTest, TestCSVResponseWriter, UniqFieldsUpdateProcessorFactoryTest, CSVRequestHandlerTest, TestLFUCache, TestPropInject, AlternateDirectoryTest, TestSolrIndexConfig, CopyFieldTest, MultiTermTest, TestDocSet, SpellPossibilityIteratorTest, SynonymTokenizerTest, TestSweetSpotSimilarityFactory, TestLMDirichletSimilarityFactory, TestIBSimilarityFactory, TestDefaultSimilarityFactory, ResourceLoaderTest, PluginInfoTest, ChaosMonkeyNothingIsSafeTest, TestSystemIdResolver, TestSuggestSpellingConverter, DateFieldTest, DOMUtilTest, TestUtils, UUIDFieldTest, TestRTGBase, AliasIntegrationTest, ShardSplitTest]
[junit4:junit4] Completed on J0 in 37.23s, 1 test, 1 error <<< FAILURES!
[...truncated 61 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:377: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:357: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1240: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:884: There were test failures: 295 suites, 1231 tests, 1 error, 27 ignored (8 assumptions)
Total time: 47 minutes 4 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure