You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/05/18 05:27:35 UTC
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_21) - Build #
5708 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/5708/
Java: 32bit/jdk1.7.0_21 -server -XX:+UseSerialGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
There are still nodes recoverying - waited for 230 seconds
Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 230 seconds
at __randomizedtesting.SeedInfo.seed([C7F25445C4C37706:4614DA5DB39C173A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:173)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:126)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:512)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:146)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9528 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4:junit4] 2> 242153 T615 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /_p/
[junit4:junit4] 2> 242159 T615 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-CollectionsAPIDistributedZkTest-1368846614121
[junit4:junit4] 2> 242160 T615 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 242161 T616 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 242261 T615 oasc.ZkTestServer.run start zk server on port:53514
[junit4:junit4] 2> 242262 T615 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 242301 T622 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1226aa1 name:ZooKeeperConnection Watcher:127.0.0.1:53514 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 242302 T615 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 242302 T615 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 242306 T615 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 242307 T624 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13f4031 name:ZooKeeperConnection Watcher:127.0.0.1:53514/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 242308 T615 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 242308 T615 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 242312 T615 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 242316 T615 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 242318 T615 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 242321 T615 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 242322 T615 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 242326 T615 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 242327 T615 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 242330 T615 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 242330 T615 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 242332 T615 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 242333 T615 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 242335 T615 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 242336 T615 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 242339 T615 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 242340 T615 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 242342 T615 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 242343 T615 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 242347 T615 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 242347 T615 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 242350 T615 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 242350 T615 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 242425 T615 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 242428 T615 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49175
[junit4:junit4] 2> 242428 T615 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 242429 T615 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 242429 T615 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315
[junit4:junit4] 2> 242429 T615 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/solr.xml
[junit4:junit4] 2> 242430 T615 oasc.CoreContainer.<init> New CoreContainer 30958590
[junit4:junit4] 2> 242430 T615 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/'
[junit4:junit4] 2> 242430 T615 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/'
[junit4:junit4] 2> 242469 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315
[junit4:junit4] 2> 242470 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/collection1
[junit4:junit4] 2> 242471 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/collection1/conf
[junit4:junit4] 2> 242478 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/collection1/conf/xslt
[junit4:junit4] 2> 242502 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/collection1/lib
[junit4:junit4] 2> 242503 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/collection1/lib/classes
[junit4:junit4] 2> 242505 T615 oasc.SolrCoreDiscoverer.addCore Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/conf/core.properties, adding to cores
[junit4:junit4] 2> 242507 T615 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 242508 T615 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 242508 T615 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 242509 T615 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 242509 T615 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 242510 T615 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 242510 T615 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 242511 T615 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 242511 T615 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 242512 T615 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 242517 T615 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 242518 T615 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53514/solr
[junit4:junit4] 2> 242518 T615 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 242520 T615 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 242521 T635 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10336e8 name:ZooKeeperConnection Watcher:127.0.0.1:53514 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 242522 T615 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 242524 T615 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 242538 T615 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 242538 T637 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c70fe5 name:ZooKeeperConnection Watcher:127.0.0.1:53514/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 242539 T615 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 242541 T615 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 242545 T615 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 242548 T615 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 242550 T615 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49175__p
[junit4:junit4] 2> 242552 T615 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49175__p
[junit4:junit4] 2> 242555 T615 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 242564 T615 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 242567 T615 oasc.Overseer.start Overseer (id=89708731703230467-127.0.0.1:49175__p-n_0000000000) starting
[junit4:junit4] 2> 242570 T615 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 242576 T615 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 242576 T639 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 242579 T615 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 242583 T615 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 242586 T638 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 242587 T615 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 242588 T615 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 242589 T615 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 242596 T615 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 242597 T615 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 242600 T642 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ee3e27 name:ZooKeeperConnection Watcher:127.0.0.1:53514/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 242601 T615 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 242602 T615 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 242606 T615 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 242695 T615 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 242697 T615 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:33436
[junit4:junit4] 2> 242698 T615 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 242699 T615 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 242699 T615 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368846614567
[junit4:junit4] 2> 242700 T615 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368846614567/solr.xml
[junit4:junit4] 2> 242700 T615 oasc.CoreContainer.<init> New CoreContainer 16906201
[junit4:junit4] 2> 242701 T615 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368846614567/'
[junit4:junit4] 2> 242701 T615 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368846614567/'
[junit4:junit4] 2> 242766 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368846614567
[junit4:junit4] 2> 242768 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368846614567/collection1
[junit4:junit4] 2> 242768 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368846614567/collection1/conf
[junit4:junit4] 2> 242775 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368846614567/collection1/conf/xslt
[junit4:junit4] 2> 242793 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368846614567/collection1/lib
[junit4:junit4] 2> 242794 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368846614567/collection1/lib/classes
[junit4:junit4] 2> 242795 T615 oasc.SolrCoreDiscoverer.addCore Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368846614567/conf/core.properties, adding to cores
[junit4:junit4] 2> 242797 T615 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 242798 T615 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 242798 T615 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 242798 T615 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 242799 T615 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 242799 T615 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 242799 T615 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 242800 T615 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 242800 T615 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 242801 T615 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 242805 T615 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 242805 T615 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53514/solr
[junit4:junit4] 2> 242806 T615 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 242806 T615 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 242809 T653 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12216a2 name:ZooKeeperConnection Watcher:127.0.0.1:53514 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 242809 T615 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 242812 T615 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 242816 T615 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 242817 T655 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1efac4 name:ZooKeeperConnection Watcher:127.0.0.1:53514/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 242818 T615 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 242825 T615 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 243829 T615 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33436__p
[junit4:junit4] 2> 243831 T615 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33436__p
[junit4:junit4] 2> 243834 T642 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 243834 T637 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 243834 T655 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 243838 T615 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 243838 T615 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 243839 T615 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 243903 T615 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 243905 T615 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60216
[junit4:junit4] 2> 243905 T615 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 243905 T615 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 243906 T615 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803
[junit4:junit4] 2> 243906 T615 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/solr.xml
[junit4:junit4] 2> 243906 T615 oasc.CoreContainer.<init> New CoreContainer 13951889
[junit4:junit4] 2> 243907 T615 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/'
[junit4:junit4] 2> 243907 T615 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/'
[junit4:junit4] 2> 243947 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803
[junit4:junit4] 2> 243948 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/collection1
[junit4:junit4] 2> 243948 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/collection1/conf
[junit4:junit4] 2> 243952 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/collection1/conf/xslt
[junit4:junit4] 2> 243967 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/collection1/lib
[junit4:junit4] 2> 243968 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/collection1/lib/classes
[junit4:junit4] 2> 243969 T615 oasc.SolrCoreDiscoverer.addCore Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/conf/core.properties, adding to cores
[junit4:junit4] 2> 243971 T615 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 243972 T615 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 243972 T615 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 243972 T615 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 243973 T615 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 243973 T615 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 243973 T615 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 243974 T615 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 243974 T615 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 243974 T615 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 243978 T615 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 243978 T615 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53514/solr
[junit4:junit4] 2> 243979 T615 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 243979 T615 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 243981 T667 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@127a89c name:ZooKeeperConnection Watcher:127.0.0.1:53514 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 243981 T615 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 243983 T615 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 243986 T615 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 243987 T669 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e7d550 name:ZooKeeperConnection Watcher:127.0.0.1:53514/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 243987 T615 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 243990 T615 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 244993 T615 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60216__p
[junit4:junit4] 2> 244994 T615 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60216__p
[junit4:junit4] 2> 244996 T642 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 244997 T637 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 244997 T655 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 244997 T669 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 245001 T615 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 245001 T615 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 245002 T615 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 245064 T615 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 245066 T615 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:34577
[junit4:junit4] 2> 245067 T615 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 245067 T615 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 245068 T615 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965
[junit4:junit4] 2> 245068 T615 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/solr.xml
[junit4:junit4] 2> 245068 T615 oasc.CoreContainer.<init> New CoreContainer 23652632
[junit4:junit4] 2> 245069 T615 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/'
[junit4:junit4] 2> 245069 T615 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/'
[junit4:junit4] 2> 245109 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965
[junit4:junit4] 2> 245110 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/collection1
[junit4:junit4] 2> 245111 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/collection1/conf
[junit4:junit4] 2> 245115 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/collection1/conf/xslt
[junit4:junit4] 2> 245129 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/collection1/lib
[junit4:junit4] 2> 245130 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/collection1/lib/classes
[junit4:junit4] 2> 245131 T615 oasc.SolrCoreDiscoverer.addCore Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/conf/core.properties, adding to cores
[junit4:junit4] 2> 245133 T615 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 245133 T615 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 245133 T615 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 245134 T615 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 245134 T615 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 245134 T615 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 245135 T615 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 245135 T615 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 245135 T615 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 245136 T615 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 245139 T615 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 245140 T615 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53514/solr
[junit4:junit4] 2> 245140 T615 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 245141 T615 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 245142 T681 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ba736d name:ZooKeeperConnection Watcher:127.0.0.1:53514 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 245142 T615 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 245144 T615 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 245147 T615 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 245148 T683 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8bf171 name:ZooKeeperConnection Watcher:127.0.0.1:53514/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 245149 T615 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 245153 T615 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 246155 T615 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34577__p
[junit4:junit4] 2> 246156 T615 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34577__p
[junit4:junit4] 2> 246159 T637 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 246159 T669 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 246159 T683 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 246159 T655 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 246159 T642 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 246163 T615 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 246163 T615 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 246164 T615 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 246233 T615 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 246235 T615 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54177
[junit4:junit4] 2> 246236 T615 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 246236 T615 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 246237 T615 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128
[junit4:junit4] 2> 246237 T615 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/solr.xml
[junit4:junit4] 2> 246237 T615 oasc.CoreContainer.<init> New CoreContainer 10057123
[junit4:junit4] 2> 246238 T615 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/'
[junit4:junit4] 2> 246238 T615 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/'
[junit4:junit4] 2> 246282 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128
[junit4:junit4] 2> 246283 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/collection1
[junit4:junit4] 2> 246283 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/collection1/conf
[junit4:junit4] 2> 246288 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/collection1/conf/xslt
[junit4:junit4] 2> 246304 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/collection1/lib
[junit4:junit4] 2> 246305 T615 oasc.SolrCoreDiscoverer.walkFromHere Looking for cores in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/collection1/lib/classes
[junit4:junit4] 2> 246306 T615 oasc.SolrCoreDiscoverer.addCore Discovered properties file /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/conf/core.properties, adding to cores
[junit4:junit4] 2> 246308 T615 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4:junit4] 2> 246308 T615 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 246309 T615 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4:junit4] 2> 246309 T615 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 246309 T615 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 246310 T615 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 246310 T615 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 246310 T615 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 246311 T615 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 246311 T615 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4] 2> 246315 T615 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 246315 T615 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53514/solr
[junit4:junit4] 2> 246316 T615 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 246316 T615 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 246318 T695 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@26e957 name:ZooKeeperConnection Watcher:127.0.0.1:53514 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 246318 T615 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 246320 T615 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 246324 T615 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 246325 T697 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@65c32b name:ZooKeeperConnection Watcher:127.0.0.1:53514/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 246325 T615 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 246328 T615 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 247331 T615 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54177__p
[junit4:junit4] 2> 247333 T615 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54177__p
[junit4:junit4] 2> 247335 T669 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 247335 T642 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 247335 T697 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 247335 T683 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 247336 T655 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 247336 T637 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 247340 T615 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4:junit4] 2> 247340 T615 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 247341 T615 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 247345 T615 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 247350 T649 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2
[junit4:junit4] 2> 247351 T637 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 247353 T639 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4:junit4] 2> "operation":"createcollection",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "maxShardsPerNode":null,
[junit4:junit4] 2> "createNodeSet":null,
[junit4:junit4] 2> "name":"nodes_used_collection",
[junit4:junit4] 2> "replicationFactor":"2"}
[junit4:junit4] 2> 247353 T639 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica1 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:60216__p
[junit4:junit4] 2> 247354 T639 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard1_replica2 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:54177__p
[junit4:junit4] 2> 247354 T639 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica1 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:49175__p
[junit4:junit4] 2> 247355 T639 oasc.OverseerCollectionProcessor.createCollection Creating shard nodes_used_collection_shard2_replica2 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:34577__p
[junit4:junit4] 2> 247355 T663 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/nodes_used_collection_shard1_replica1
[junit4:junit4] 2> 247356 T663 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 247357 T677 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 247358 T677 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 247358 T663 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 247358 T693 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard1_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 247356 T633 oasc.CoreContainer.create Creating SolrCore 'nodes_used_collection_shard2_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 247359 T633 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 247359 T677 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 247360 T677 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 247359 T693 oasc.ZkController.createCollectionZkNode Check for collection zkNode:nodes_used_collection
[junit4:junit4] 2> 247358 T663 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 247361 T633 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 247362 T633 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 247362 T693 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4] 2> 247363 T677 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 247363 T693 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 247363 T677 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 247363 T663 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 247363 T633 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 247364 T693 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 247364 T663 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 247365 T693 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 247364 T633 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection
[junit4:junit4] 2> 247365 T677 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 247366 T663 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 247367 T693 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 247367 T677 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/nodes_used_collection_shard2_replica2/'
[junit4:junit4] 2> 247368 T633 oasc.ZkController.readConfigName Load collection config from:/collections/nodes_used_collection
[junit4:junit4] 2> 247368 T663 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/nodes_used_collection_shard1_replica1/'
[junit4:junit4] 2> 247369 T693 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/nodes_used_collection_shard1_replica2/'
[junit4:junit4] 2> 247369 T633 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/nodes_used_collection_shard2_replica1/'
[junit4:junit4] 2> 247408 T677 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 247424 T693 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 247426 T663 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 247429 T633 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 247468 T677 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 247469 T677 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 247482 T677 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica2] Schema name=test
[junit4:junit4] 2> 247489 T633 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 247490 T633 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 247491 T693 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 247491 T663 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 247492 T693 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 247492 T663 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 247496 T633 oass.IndexSchema.readSchema [nodes_used_collection_shard2_replica1] Schema name=test
[junit4:junit4] 2> 247512 T663 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica1] Schema name=test
[junit4:junit4] 2> 247515 T693 oass.IndexSchema.readSchema [nodes_used_collection_shard1_replica2] Schema name=test
[junit4:junit4] 2> 247954 T693 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 247960 T693 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 247962 T693 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 247983 T693 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 247987 T693 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 247996 T693 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 247998 T693 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 247998 T693 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 247999 T693 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 248000 T693 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 248000 T693 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 248001 T693 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 248001 T693 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/nodes_used_collection_shard1_replica2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/nodes_used_collection_shard1_replica2/data/
[junit4:junit4] 2> 248001 T693 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3fd07b
[junit4:junit4] 2> 248002 T693 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 248003 T693 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/nodes_used_collection_shard1_replica2/data
[junit4:junit4] 2> 248003 T693 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/nodes_used_collection_shard1_replica2/data/index/
[junit4:junit4] 2> 248004 T693 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/nodes_used_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 248004 T693 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/nodes_used_collection_shard1_replica2/data/index
[junit4:junit4] 2> 248007 T693 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@13ddc08 lockFactory=org.apache.lucene.store.NativeFSLockFactory@a3973c),segFN=segments_1,generation=1}
[junit4:junit4] 2> 248007 T693 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 248010 T693 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 248016 T693 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 248017 T693 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 248017 T693 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 248018 T693 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 248019 T693 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 248019 T693 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 248020 T693 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 248020 T693 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 248024 T693 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 248026 T693 oass.SolrIndexSearcher.<init> Opening Searcher@1c6d6dc main
[junit4:junit4] 2> 248026 T693 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/nodes_used_collection_shard1_replica2/data/tlog
[junit4:junit4] 2> 248027 T693 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 248027 T693 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 248031 T677 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 248031 T703 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica2] Registered new searcher Searcher@1c6d6dc main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 248032 T663 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 248033 T693 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=down
[junit4:junit4] 2> 248045 T663 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 248046 T677 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 248047 T663 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 248050 T677 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 248060 T663 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 248064 T677 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 248064 T633 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 248065 T663 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 248067 T663 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 248068 T677 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 248068 T663 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 248070 T663 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 248070 T663 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 248071 T663 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 248071 T663 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 248071 T663 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 248072 T633 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 248072 T663 oasc.SolrCore.<init> [nodes_used_collection_shard1_replica1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/nodes_used_collection_shard1_replica1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/nodes_used_collection_shard1_replica1/data/
[junit4:junit4] 2> 248072 T677 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 248073 T663 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3fd07b
[junit4:junit4] 2> 248074 T663 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 248074 T677 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 248075 T677 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 248075 T663 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/nodes_used_collection_shard1_replica1/data
[junit4:junit4] 2> 248075 T633 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 248075 T677 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 248075 T663 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/nodes_used_collection_shard1_replica1/data/index/
[junit4:junit4] 2> 248077 T663 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard1_replica1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/nodes_used_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 248077 T677 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 248078 T677 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 248077 T663 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/nodes_used_collection_shard1_replica1/data/index
[junit4:junit4] 2> 248078 T677 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 248079 T677 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/nodes_used_collection_shard2_replica2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/nodes_used_collection_shard2_replica2/data/
[junit4:junit4] 2> 248079 T677 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3fd07b
[junit4:junit4] 2> 248080 T663 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4b839 lockFactory=org.apache.lucene.store.NativeFSLockFactory@ac9b33),segFN=segments_1,generation=1}
[junit4:junit4] 2> 248080 T677 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 248080 T663 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 248081 T677 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/nodes_used_collection_shard2_replica2/data
[junit4:junit4] 2> 248082 T677 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/nodes_used_collection_shard2_replica2/data/index/
[junit4:junit4] 2> 248082 T677 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/nodes_used_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 248083 T677 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/nodes_used_collection_shard2_replica2/data/index
[junit4:junit4] 2> 248086 T663 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 248086 T677 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1c082ec lockFactory=org.apache.lucene.store.NativeFSLockFactory@9f3bdd),segFN=segments_1,generation=1}
[junit4:junit4] 2> 248087 T677 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 248086 T663 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 248088 T663 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 248088 T663 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 248089 T677 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 248089 T663 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 248089 T663 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 248089 T677 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 248090 T663 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 248090 T677 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 248090 T633 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 248091 T677 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 248091 T663 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 248092 T677 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 248092 T677 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 248092 T663 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 248092 T677 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 248093 T677 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 248094 T677 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 248095 T677 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 248095 T663 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 248097 T633 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 248098 T677 oass.SolrIndexSearcher.<init> Opening Searcher@1b1ba33 main
[junit4:junit4] 2> 248098 T663 oass.SolrIndexSearcher.<init> Opening Searcher@2c1d96 main
[junit4:junit4] 2> 248098 T677 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/nodes_used_collection_shard2_replica2/data/tlog
[junit4:junit4] 2> 248099 T663 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/nodes_used_collection_shard1_replica1/data/tlog
[junit4:junit4] 2> 248099 T677 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 248100 T677 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 248100 T663 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 248108 T633 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 248108 T663 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 248109 T633 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 248110 T633 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 248110 T633 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 248110 T704 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica2] Registered new searcher Searcher@1b1ba33 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 248111 T633 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 248111 T633 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 248112 T633 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 248112 T677 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=down
[junit4:junit4] 2> 248112 T705 oasc.SolrCore.registerSearcher [nodes_used_collection_shard1_replica1] Registered new searcher Searcher@2c1d96 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 248112 T633 oasc.SolrCore.<init> [nodes_used_collection_shard2_replica1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/nodes_used_collection_shard2_replica1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/nodes_used_collection_shard2_replica1/data/
[junit4:junit4] 2> 248113 T633 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3fd07b
[junit4:junit4] 2> 248113 T633 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 248114 T663 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=down
[junit4:junit4] 2> 248114 T633 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/nodes_used_collection_shard2_replica1/data
[junit4:junit4] 2> 248114 T633 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/nodes_used_collection_shard2_replica1/data/index/
[junit4:junit4] 2> 248115 T633 oasc.SolrCore.initIndex WARN [nodes_used_collection_shard2_replica1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/nodes_used_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 248115 T633 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/nodes_used_collection_shard2_replica1/data/index
[junit4:junit4] 2> 248117 T633 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@fe7cca lockFactory=org.apache.lucene.store.NativeFSLockFactory@39ce3c),segFN=segments_1,generation=1}
[junit4:junit4] 2> 248117 T633 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 248118 T633 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 248119 T633 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 248119 T633 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 248120 T633 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 248120 T633 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 248120 T633 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 248121 T633 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 248121 T633 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 248122 T633 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 248124 T633 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 248126 T633 oass.SolrIndexSearcher.<init> Opening Searcher@159d3ad main
[junit4:junit4] 2> 248127 T633 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/nodes_used_collection_shard2_replica1/data/tlog
[junit4:junit4] 2> 248127 T633 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 248128 T633 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 248131 T706 oasc.SolrCore.registerSearcher [nodes_used_collection_shard2_replica1] Registered new searcher Searcher@159d3ad main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 248132 T633 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=down
[junit4:junit4] 2> 248595 T638 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 248595 T638 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:54177__p",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:54177/_p"}
[junit4:junit4] 2> 248596 T638 oasc.Overseer$ClusterStateUpdater.createCollection Create collection nodes_used_collection with numShards 2
[junit4:junit4] 2> 248599 T638 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:34577__p",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34577/_p"}
[junit4:junit4] 2> 248602 T638 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60216__p",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60216/_p"}
[junit4:junit4] 2> 248607 T638 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49175__p",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49175/_p"}
[junit4:junit4] 2> 248612 T642 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 248612 T683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 248612 T669 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 248612 T697 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 248613 T637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 248612 T655 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 249036 T693 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica2
[junit4:junit4] 2> 249036 T693 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica2 address:http://127.0.0.1:54177/_p collection:nodes_used_collection shard:shard1
[junit4:junit4] 2> 249037 T693 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard1/election
[junit4:junit4] 2> 249043 T693 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 249046 T693 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=179999
[junit4:junit4] 2> 249114 T677 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica2
[junit4:junit4] 2> 249114 T677 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica2 address:http://127.0.0.1:34577/_p collection:nodes_used_collection shard:shard2
[junit4:junit4] 2> 249115 T663 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard1_replica1
[junit4:junit4] 2> 249115 T663 oasc.ZkController.register Register replica - core:nodes_used_collection_shard1_replica1 address:http://127.0.0.1:60216/_p collection:nodes_used_collection shard:shard1
[junit4:junit4] 2> 249115 T677 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leader_elect/shard2/election
[junit4:junit4] 2> 249121 T677 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 249123 T677 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up: total=2 found=1 timeoutin=180000
[junit4:junit4] 2> 249133 T633 oasc.CoreContainer.registerCore registering core: nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 249134 T633 oasc.ZkController.register Register replica - core:nodes_used_collection_shard2_replica1 address:http://127.0.0.1:49175/_p collection:nodes_used_collection shard:shard2
[junit4:junit4] 2> 249547 T693 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 249548 T693 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 249548 T693 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54177/_p/nodes_used_collection_shard1_replica2/
[junit4:junit4] 2> 249548 T693 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica2 url=http://127.0.0.1:54177/_p START replicas=[http://127.0.0.1:60216/_p/nodes_used_collection_shard1_replica1/] nUpdates=100
[junit4:junit4] 2> 249549 T693 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard1_replica2 url=http://127.0.0.1:54177/_p DONE. We have no versions. sync failed.
[junit4:junit4] 2> 249549 T693 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4] 2> 249549 T693 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4] 2> 249550 T693 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54177/_p/nodes_used_collection_shard1_replica2/
[junit4:junit4] 2> 249550 T693 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard1
[junit4:junit4] 2> ASYNC NEW_CORE C71 name=nodes_used_collection_shard1_replica1 org.apache.solr.core.SolrCore@1ada186 url=http://127.0.0.1:60216/_p/nodes_used_collection_shard1_replica1 node=127.0.0.1:60216__p C71_STATE=coll:nodes_used_collection core:nodes_used_collection_shard1_replica1 props:{shard=shard1, state=down, core=nodes_used_collection_shard1_replica1, collection=nodes_used_collection, node_name=127.0.0.1:60216__p, base_url=http://127.0.0.1:60216/_p}
[junit4:junit4] 2> 249555 T662 C71 P60216 oasc.SolrCore.execute [nodes_used_collection_shard1_replica1] webapp=/_p path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 249624 T677 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 249625 T677 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 249625 T677 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:34577/_p/nodes_used_collection_shard2_replica2/
[junit4:junit4] 2> 249625 T677 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:34577/_p START replicas=[http://127.0.0.1:49175/_p/nodes_used_collection_shard2_replica1/] nUpdates=100
[junit4:junit4] 2> 249626 T677 oasu.PeerSync.sync PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:34577/_p DONE. We have no versions. sync failed.
[junit4:junit4] 2> 249626 T677 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4] 2> 249626 T677 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4] 2> 249627 T677 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:34577/_p/nodes_used_collection_shard2_replica2/
[junit4:junit4] 2> 249627 T677 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard2
[junit4:junit4] 2> ASYNC NEW_CORE C72 name=nodes_used_collection_shard2_replica1 org.apache.solr.core.SolrCore@4dfbc6 url=http://127.0.0.1:49175/_p/nodes_used_collection_shard2_replica1 node=127.0.0.1:49175__p C72_STATE=coll:nodes_used_collection core:nodes_used_collection_shard2_replica1 props:{shard=shard2, state=down, core=nodes_used_collection_shard2_replica1, collection=nodes_used_collection, node_name=127.0.0.1:49175__p, base_url=http://127.0.0.1:49175/_p}
[junit4:junit4] 2> 249631 T630 C72 P49175 oasc.SolrCore.execute [nodes_used_collection_shard2_replica1] webapp=/_p path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 250123 T638 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 250134 T642 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 250135 T655 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 250135 T637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 250135 T683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 250135 T669 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 250135 T697 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 250157 T693 oasc.ZkController.register We are http://127.0.0.1:54177/_p/nodes_used_collection_shard1_replica2/ and leader is http://127.0.0.1:54177/_p/nodes_used_collection_shard1_replica2/
[junit4:junit4] 2> 250157 T693 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica2 baseURL=http://127.0.0.1:54177/_p
[junit4:junit4] 2> 250158 T693 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 250158 T693 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica2 state=active
[junit4:junit4] 2> 250160 T693 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 250161 T693 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=2804
[junit4:junit4] 2> 250169 T663 oasc.ZkController.register We are http://127.0.0.1:60216/_p/nodes_used_collection_shard1_replica1/ and leader is http://127.0.0.1:54177/_p/nodes_used_collection_shard1_replica2/
[junit4:junit4] 2> 250169 T663 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard1_replica1 baseURL=http://127.0.0.1:60216/_p
[junit4:junit4] 2> 250169 T663 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard1_replica1
[junit4:junit4] 2> 250170 T663 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> 250170 T709 C71 P60216 oasc.RecoveryStrategy.run Starting recovery process. core=nodes_used_collection_shard1_replica1 recoveringAfterStartup=true
[junit4:junit4] 2> 250170 T709 C71 P60216 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 250171 T709 C71 P60216 oasc.ZkController.publish publishing core=nodes_used_collection_shard1_replica1 state=recovering
[junit4:junit4] 2> 250171 T663 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 250172 T709 C71 P60216 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 250172 T663 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=2817
[junit4:junit4] 2> 250177 T691 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:60216__p_nodes_used_collection_shard1_replica1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 250184 T677 oasc.ZkController.register We are http://127.0.0.1:34577/_p/nodes_used_collection_shard2_replica2/ and leader is http://127.0.0.1:34577/_p/nodes_used_collection_shard2_replica2/
[junit4:junit4] 2> 250184 T677 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica2 baseURL=http://127.0.0.1:34577/_p
[junit4:junit4] 2> 250184 T677 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 250184 T677 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica2 state=active
[junit4:junit4] 2> 250186 T677 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 250187 T677 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=2830
[junit4:junit4] 2> 250188 T633 oasc.ZkController.register We are http://127.0.0.1:49175/_p/nodes_used_collection_shard2_replica1/ and leader is http://127.0.0.1:34577/_p/nodes_used_collection_shard2_replica2/
[junit4:junit4] 2> 250188 T633 oasc.ZkController.register No LogReplay needed for core=nodes_used_collection_shard2_replica1 baseURL=http://127.0.0.1:49175/_p
[junit4:junit4] 2> 250188 T633 oasc.ZkController.checkRecovery Core needs to recover:nodes_used_collection_shard2_replica1
[junit4:junit4] 2> 250189 T633 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> 250189 T710 C72 P49175 oasc.RecoveryStrategy.run Starting recovery process. core=nodes_used_collection_shard2_replica1 recoveringAfterStartup=true
[junit4:junit4] 2> 250189 T710 C72 P49175 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 250189 T633 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 250190 T710 C72 P49175 oasc.ZkController.publish publishing core=nodes_used_collection_shard2_replica1 state=recovering
[junit4:junit4] 2> 250191 T633 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=2835
[junit4:junit4] 2> 250191 T710 C72 P49175 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 250192 T639 oasc.OverseerCollectionProcessor.createCollection Finished create command on all shards for collection: nodes_used_collection
[junit4:junit4] 2> 250197 T678 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:49175__p_nodes_used_collection_shard2_replica1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 250205 T655 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work/qnr-0000000000 state: SyncConnected type NodeDataChanged
[junit4:junit4] 2> 250206 T637 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 250206 T639 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000000 complete, response:{success={null={responseHeader={status=0,QTime=2804},core=nodes_used_collection_shard1_replica2},null={responseHeader={status=0,QTime=2817},core=nodes_used_collection_shard1_replica1},null={responseHeader={status=0,QTime=2830},core=nodes_used_collection_shard2_replica2},null={responseHeader={status=0,QTime=2835},core=nodes_used_collection_shard2_replica1}}}
[junit4:junit4] 2> 250209 T649 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/collections params={numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2} status=0 QTime=2860
[junit4:junit4] 2> 250210 T615 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 250211 T615 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 250213 T712 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@101f8f4 name:ZooKeeperConnection Watcher:127.0.0.1:53514/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 250213 T615 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 250214 T615 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 250217 T615 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 250219 T615 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 250220 T714 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1609fd name:ZooKeeperConnection Watcher:127.0.0.1:53514/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 250220 T615 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 250221 T615 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 250228 T631 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=5&maxShardsPerNode=4&name=awholynewcollection_0&replicationFactor=3&action=CREATE&wt=javabin&version=2
[junit4:junit4] 2> 250230 T637 oasc.DistributedQueue$LatchChildWatcher.process Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4] 2> 250231 T639 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000002 message:{
[junit4:junit4] 2> "operation":"createcollection",
[junit4:junit4] 2> "numShards":"5",
[junit4:junit4] 2> "maxShardsPerNode":"4",
[junit4:junit4] 2> "createNodeSet":null,
[junit4:junit4] 2> "name":"awholynewcollection_0",
[junit4:junit4] 2> "replicationFactor":"3"}
[junit4:junit4] 2> 250231 T639 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica1 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:34577__p
[junit4:junit4] 2> 250231 T639 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica2 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:54177__p
[junit4:junit4] 2> 250232 T639 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard1_replica3 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:33436__p
[junit4:junit4] 2> 250232 T639 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica1 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:49175__p
[junit4:junit4] 2> 250233 T639 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica2 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:60216__p
[junit4:junit4] 2> 250233 T639 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard2_replica3 as part of slice shard2 of collection awholynewcollection_0 on 127.0.0.1:34577__p
[junit4:junit4] 2> 250233 T639 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica1 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:54177__p
[junit4:junit4] 2> 250234 T679 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard1_replica1
[junit4:junit4] 2> 250234 T692 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/awholynewcollection_0_shard1_replica2
[junit4:junit4] 2> 250235 T632 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/awholynewcollection_0_shard2_replica1
[junit4:junit4] 2> 250235 T632 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 250234 T639 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica2 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:33436__p
[junit4:junit4] 2> 250234 T650 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard1_replica3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368846614567/awholynewcollection_0_shard1_replica3
[junit4:junit4] 2> 250236 T650 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 250236 T639 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard3_replica3 as part of slice shard3 of collection awholynewcollection_0 on 127.0.0.1:49175__p
[junit4:junit4] 2> 250237 T649 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368846614567/awholynewcollection_0_shard3_replica2
[junit4:junit4] 2> 250237 T649 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 250235 T664 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/awholynewcollection_0_shard2_replica2
[junit4:junit4] 2> 250238 T664 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 250235 T693 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/awholynewcollection_0_shard3_replica1
[junit4:junit4] 2> 250239 T664 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 250235 T676 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard2_replica3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard2_replica3
[junit4:junit4] 2> 250239 T676 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 250235 T692 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 250234 T679 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 250240 T676 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 250239 T664 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 250239 T693 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 250238 T649 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 250238 T630 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard3_replica3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/awholynewcollection_0_shard3_replica3
[junit4:junit4] 2> 250242 T630 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 250237 T639 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica1 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:60216__p
[junit4:junit4] 2> 250237 T650 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 250237 T632 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 250243 T650 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 250243 T639 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica2 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:34577__p
[junit4:junit4] 2> 250242 T630 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 250242 T693 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 250244 T650 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 250242 T664 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 250242 T649 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 250241 T679 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 250241 T676 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 250240 T692 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 250246 T649 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 250246 T679 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 250245 T664 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 250245 T677 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard4_replica2
[junit4:junit4] 2> 250248 T677 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 250245 T650 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 250244 T693 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 250244 T630 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 250244 T665 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/awholynewcollection_0_shard4_replica1
[junit4:junit4] 2> 250244 T639 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard4_replica3 as part of slice shard4 of collection awholynewcollection_0 on 127.0.0.1:54177__p
[junit4:junit4] 2> 250243 T632 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 250250 T639 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard5_replica1 as part of slice shard5 of collection awholynewcollection_0 on 127.0.0.1:33436__p
[junit4:junit4] 2> 250250 T664 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 250249 T665 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 250251 T630 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 250248 T677 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4] 2> 250248 T679 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 250247 T649 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 250247 T676 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 250246 T692 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 250253 T630 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 250253 T676 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 250253 T664 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/awholynewcollection_0_shard2_replica2/'
[junit4:junit4] 2> 250253 T679 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 250255 T692 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 250255 T630 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/awholynewcollection_0_shard3_replica3/'
[junit4:junit4] 2> 250252 T665 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 250256 T665 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 250252 T677 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 250252 T690 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard4_replica3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/awholynewcollection_0_shard4_replica3
[junit4:junit4] 2> 250252 T632 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 250252 T651 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard5_replica1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368846614567/awholynewcollection_0_shard5_replica1
[junit4:junit4] 2> 250258 T651 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 250251 T693 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 250251 T650 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 250259 T677 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_0
[junit4:junit4] 2> 250260 T651 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 250260 T651 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 250250 T639 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard5_replica2 as part of slice shard5 of collection awholynewcollection_0 on 127.0.0.1:49175__p
[junit4:junit4] 2> 250260 T692 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 250260 T679 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 250259 T665 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/awholynewcollection_0_shard4_replica1/'
[junit4:junit4] 2> 250257 T690 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 250257 T676 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 250255 T649 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 250262 T639 oasc.OverseerCollectionProcessor.createCollection Creating shard awholynewcollection_0_shard5_replica3 as part of slice shard5 of collection awholynewcollection_0 on 127.0.0.1:60216__p
[junit4:junit4] 2> 250279 T650 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368846614567/awholynewcollection_0_shard1_replica3/'
[junit4:junit4] 2> 250280 T690 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 250280 T690 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 250281 T692 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/awholynewcollection_0_shard1_replica2/'
[junit4:junit4] 2> 250263 T633 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard5_replica2' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/awholynewcollection_0_shard5_replica2
[junit4:junit4] 2> 250281 T677 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 250281 T632 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 250280 T693 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 250280 T651 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368846614567/awholynewcollection_0_shard5_replica1/'
[junit4:junit4] 2> 250283 T676 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard2_replica3/'
[junit4:junit4] 2> 250283 T679 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard1_replica1/'
[junit4:junit4] 2> 250283 T649 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368846614567/awholynewcollection_0_shard3_replica2/'
[junit4:junit4] 2> 250281 T633 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 250286 T693 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/awholynewcollection_0_shard3_replica1/'
[junit4:junit4] 2> 250286 T632 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/awholynewcollection_0_shard2_replica1/'
[junit4:junit4] 2> 250286 T690 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/awholynewcollection_0_shard4_replica3/'
[junit4:junit4] 2> 250290 T633 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 250290 T633 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 250285 T662 oasc.CoreContainer.create Creating SolrCore 'awholynewcollection_0_shard5_replica3' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/awholynewcollection_0_shard5_replica3
[junit4:junit4] 2> 250292 T662 oasc.ZkController.createCollectionZkNode Check for collection zkNode:awholynewcollection_0
[junit4:junit4] 2> 250289 T677 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard4_replica2/'
[junit4:junit4] 2> 250293 T633 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/awholynewcollection_0_shard5_replica2/'
[junit4:junit4] 2> 250293 T662 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 250294 T662 oasc.ZkController.readConfigName Load collection config from:/collections/awholynewcollection_0
[junit4:junit4] 2> 250301 T662 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/awholynewcollection_0_shard5_replica3/'
[junit4:junit4] 2> 250351 T664 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 250361 T665 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 250391 T630 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 250397 T692 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 250403 T651 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 250414 T632 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 250436 T676 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 250438 T649 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 250450 T650 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 250471 T693 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 250472 T690 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 250483 T677 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 250490 T679 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 250528 T662 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 250540 T630 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 250541 T665 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 250543 T665 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 250544 T630 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 250548 T632 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 250559 T632 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 250559 T630 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica3] Schema name=test
[junit4:junit4] 2> 250565 T665 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica1] Schema name=test
[junit4:junit4] 2> 250566 T632 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica1] Schema name=test
[junit4:junit4] 2> 250570 T664 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 250580 T633 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 250582 T664 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 250590 T651 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 250601 T676 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 250602 T664 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica2] Schema name=test
[junit4:junit4] 2> 250603 T676 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 250604 T651 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 250608 T676 oass.IndexSchema.readSchema [awholynewcollection_0_shard2_replica3] Schema name=test
[junit4:junit4] 2> 250609 T651 oass.IndexSchema.readSchema [awholynewcollection_0_shard5_replica1] Schema name=test
[junit4:junit4] 2> 250644 T649 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 250644 T677 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 250652 T677 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 250654 T649 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 250665 T649 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica2] Schema name=test
[junit4:junit4] 2> 250665 T677 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica2] Schema name=test
[junit4:junit4] 2> 250682 T690 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 250687 T690 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 250688 T692 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 250689 T693 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 250690 T692 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 250700 T650 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 250692 T693 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 250692 T679 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 250707 T650 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 250708 T679 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 250711 T662 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 250712 T650 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica3] Schema name=test
[junit4:junit4] 2> 250722 T662 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 250725 T693 oass.IndexSchema.readSchema [awholynewcollection_0_shard3_replica1] Schema name=test
[junit4:junit4] 2> 250724 T692 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica2] Schema name=test
[junit4:junit4] 2> 250729 T662 oass.IndexSchema.readSchema [awholynewcollection_0_shard5_replica3] Schema name=test
[junit4:junit4] 2> 250724 T690 oass.IndexSchema.readSchema [awholynewcollection_0_shard4_replica3] Schema name=test
[junit4:junit4] 2> 250750 T679 oass.IndexSchema.readSchema [awholynewcollection_0_shard1_replica1] Schema name=test
[junit4:junit4] 2> 250800 T633 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 250816 T633 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 250821 T633 oass.IndexSchema.readSchema [awholynewcollection_0_shard5_replica2] Schema name=test
[junit4:junit4] 2> 251644 T638 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 251645 T638 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:54177__p_nodes_used_collection_shard1_replica2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:54177__p",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:54177/_p"}
[junit4:junit4] 2> 251656 T638 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:60216__p_nodes_used_collection_shard1_replica1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard1_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60216__p",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60216/_p"}
[junit4:junit4] 2> 251660 T638 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:34577__p_nodes_used_collection_shard2_replica2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:34577__p",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:34577/_p"}
[junit4:junit4] 2> 251664 T638 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:49175__p_nodes_used_collection_shard2_replica1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"nodes_used_collection_shard2_replica1",
[junit4:junit4] 2> "collection":"nodes_used_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:49175__p",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:49175/_p"}
[junit4:junit4] 2> 251669 T669 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 251669 T642 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 251669 T655 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 251669 T712 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 251669 T637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 251670 T683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 251669 T697 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 251669 T714 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 252182 T691 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:60216__p_nodes_used_collection_shard1_replica1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 252182 T691 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:60216__p_nodes_used_collection_shard1_replica1&state=recovering&nodeName=127.0.0.1:60216__p&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard1_replica2&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2005
[junit4:junit4] 2> 252205 T678 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:49175__p_nodes_used_collection_shard2_replica1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 252206 T678 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:49175__p_nodes_used_collection_shard2_replica1&state=recovering&nodeName=127.0.0.1:49175__p&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard2_replica2&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2009
[junit4:junit4] 2> 252711 T630 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 252732 T664 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 252733 T630 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 252748 T630 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 252751 T677 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 252755 T665 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 252757 T664 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 252761 T664 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 252762 T677 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 252771 T665 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 252774 T651 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 252777 T665 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 252780 T630 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 252783 T677 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 252795 T630 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 252800 T651 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 252804 T651 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 252809 T630 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 252811 T664 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 252821 T630 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 252822 T630 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 252822 T630 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 252825 T630 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 252826 T630 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 252826 T630 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 252827 T630 oasc.SolrCore.<init> [awholynewcollection_0_shard3_replica3] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/awholynewcollection_0_shard3_replica3/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/awholynewcollection_0_shard3_replica3/data/
[junit4:junit4] 2> 252827 T630 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3fd07b
[junit4:junit4] 2> 252825 T665 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 252826 T664 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 252831 T630 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 252835 T677 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 252837 T630 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/awholynewcollection_0_shard3_replica3/data
[junit4:junit4] 2> 252837 T630 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/awholynewcollection_0_shard3_replica3/data/index/
[junit4:junit4] 2> 252838 T630 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard3_replica3] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/awholynewcollection_0_shard3_replica3/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 252839 T630 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/awholynewcollection_0_shard3_replica3/data/index
[junit4:junit4] 2> 252840 T677 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 252838 T665 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 252852 T664 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 252839 T651 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 252854 T664 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 252854 T664 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 252855 T664 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 252856 T679 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 252857 T664 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 252857 T664 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 252857 T632 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 252858 T664 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 252861 T664 oasc.SolrCore.<init> [awholynewcollection_0_shard2_replica2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/awholynewcollection_0_shard2_replica2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/awholynewcollection_0_shard2_replica2/data/
[junit4:junit4] 2> 252862 T664 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3fd07b
[junit4:junit4] 2> 252862 T664 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 252863 T651 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 252863 T633 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 252864 T677 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 252873 T664 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/awholynewcollection_0_shard2_replica2/data
[junit4:junit4] 2> 252873 T664 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/awholynewcollection_0_shard2_replica2/data/index/
[junit4:junit4] 2> 252874 T664 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard2_replica2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/awholynewcollection_0_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 252875 T664 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/awholynewcollection_0_shard2_replica2/data/index
[junit4:junit4] 2> 252875 T651 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 252877 T665 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 252877 T664 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@9280d8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@9d5fc),segFN=segments_1,generation=1}
[junit4:junit4] 2> 252878 T664 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 252875 T676 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 252879 T632 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 252880 T664 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 252880 T664 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 252881 T664 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 252882 T664 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 252883 T664 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 252883 T664 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 252878 T677 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 252884 T677 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 252884 T677 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 252885 T665 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 252885 T665 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 252886 T665 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 252887 T677 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 252888 T677 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 252888 T677 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 252889 T677 oasc.SolrCore.<init> [awholynewcollection_0_shard4_replica2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard4_replica2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard4_replica2/data/
[junit4:junit4] 2> 252889 T677 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3fd07b
[junit4:junit4] 2> 252890 T677 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 252891 T677 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard4_replica2/data
[junit4:junit4] 2> 252891 T665 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 252892 T665 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 252892 T665 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 252893 T665 oasc.SolrCore.<init> [awholynewcollection_0_shard4_replica1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/awholynewcollection_0_shard4_replica1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/awholynewcollection_0_shard4_replica1/data/
[junit4:junit4] 2> 252877 T630 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2af567 lockFactory=org.apache.lucene.store.NativeFSLockFactory@134dbd0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 252903 T630 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 252877 T651 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 252904 T651 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 252896 T665 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3fd07b
[junit4:junit4] 2> 252905 T665 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 252906 T665 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/awholynewcollection_0_shard4_replica1/data
[junit4:junit4] 2> 252906 T665 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/awholynewcollection_0_shard4_replica1/data/index/
[junit4:junit4] 2> 252907 T665 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard4_replica1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/awholynewcollection_0_shard4_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 252895 T677 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard4_replica2/data/index/
[junit4:junit4] 2> 252894 T649 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 252889 T633 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 252885 T676 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 252884 T690 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 252884 T664 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 252883 T632 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 252883 T679 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 252915 T664 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 252916 T664 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 252912 T677 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard4_replica2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard4_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 252919 T679 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 252921 T664 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 252922 T690 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 252923 T677 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard4_replica2/data/index
[junit4:junit4] 2> 252926 T677 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@a9e9e0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@af7423),segFN=segments_1,generation=1}
[junit4:junit4] 2> 252926 T677 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 252929 T677 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 252912 T665 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/awholynewcollection_0_shard4_replica1/data/index
[junit4:junit4] 2> 252930 T664 oass.SolrIndexSearcher.<init> Opening Searcher@180a743 main
[junit4:junit4] 2> 252906 T630 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 252904 T651 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 252931 T664 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/awholynewcollection_0_shard2_replica2/data/tlog
[junit4:junit4] 2> 252931 T630 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 252930 T632 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 252943 T664 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 252944 T664 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 252945 T665 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5bf112 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1343c57),segFN=segments_1,generation=1}
[junit4:junit4] 2> 252946 T665 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 252947 T692 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 252948 T649 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 252948 T665 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 252949 T665 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 252930 T677 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 252926 T690 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 252950 T632 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 252951 T677 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 252952 T733 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard2_replica2] Registered new searcher Searcher@180a743 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 252924 T676 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 252918 T633 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 252953 T664 oasc.ZkController.publish publishing core=awholynewcollection_0_shard2_replica2 state=down
[junit4:junit4] 2> 252953 T677 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 252958 T677 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 252959 T677 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 252959 T677 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 252960 T677 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 252950 T665 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 252942 T630 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 252962 T630 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 252963 T630 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 252963 T630 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 252964 T630 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 252964 T630 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 252965 T630 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 252967 T632 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 252968 T693 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 252969 T630 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 252969 T690 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 252942 T651 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 252970 T651 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 252971 T651 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 252971 T651 oasc.SolrCore.<init> [awholynewcollection_0_shard5_replica1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368846614567/awholynewcollection_0_shard5_replica1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368846614567/awholynewcollection_0_shard5_replica1/data/
[junit4:junit4] 2> 252972 T651 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3fd07b
[junit4:junit4] 2> 252972 T665 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 252965 T662 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 252988 T690 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 252961 T677 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 252960 T679 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 252960 T692 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 252959 T649 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 252990 T677 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 252987 T665 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 252991 T665 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 252992 T665 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 252993 T692 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 252986 T693 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 252986 T630 oass.SolrIndexSearcher.<init> Opening Searcher@ce7028 main
[junit4:junit4] 2> 252972 T651 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 252970 T632 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 252995 T630 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/awholynewcollection_0_shard3_replica3/data/tlog
[junit4:junit4] 2> 252993 T690 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 252993 T679 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 252993 T677 oass.SolrIndexSearcher.<init> Opening Searcher@ef5f05 main
[junit4:junit4] 2> 252999 T662 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 252999 T693 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 253000 T690 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 253000 T690 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 253001 T690 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 253001 T662 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 252993 T665 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 252999 T676 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 252999 T677 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard4_replica2/data/tlog
[junit4:junit4] 2> 252996 T630 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 252996 T633 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 252995 T651 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368846614567/awholynewcollection_0_shard5_replica1/data
[junit4:junit4] 2> 252995 T632 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 253004 T651 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368846614567/awholynewcollection_0_shard5_replica1/data/index/
[junit4:junit4] 2> 253005 T651 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard5_replica1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368846614567/awholynewcollection_0_shard5_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 253004 T677 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 253006 T677 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 253007 T650 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 253009 T676 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 253003 T630 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 253003 T679 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 253002 T665 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 253012 T735 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard4_replica2] Registered new searcher Searcher@ef5f05 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 253011 T677 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica2 state=down
[junit4:junit4] 2> 253009 T633 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 253006 T690 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 253006 T651 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1368846614567/awholynewcollection_0_shard5_replica1/data/index
[junit4:junit4] 2> 253005 T632 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 253014 T649 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 253015 T676 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 253013 T665 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 253017 T734 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard3_replica3] Registered new searcher Searcher@ce7028 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 253017 T690 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 253016 T651 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@91fc7b lockFactory=org.apache.lucene.store.NativeFSLockFactory@510e03),segFN=segments_1,generation=1}
[junit4:junit4] 2> 253018 T651 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 253017 T690 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 253019 T679 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 253019 T676 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 253020 T676 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 253020 T676 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 253019 T679 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 253019 T632 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 253034 T632 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 253019 T690 oasc.SolrCore.<init> [awholynewcollection_0_shard4_replica3] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/awholynewcollection_0_shard4_replica3/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/awholynewcollection_0_shard4_replica3/data/
[junit4:junit4] 2> 253019 T633 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 253018 T649 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 253035 T690 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3fd07b
[junit4:junit4] 2> 253034 T632 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 253033 T630 oasc.ZkController.publish publishing core=awholynewcollection_0_shard3_replica3 state=down
[junit4:junit4] 2> 253033 T650 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 253033 T679 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 253032 T651 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 253032 T665 oass.SolrIndexSearcher.<init> Opening Searcher@10a6d76 main
[junit4:junit4] 2> 253038 T651 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 253036 T632 oasc.SolrCore.<init> [awholynewcollection_0_shard2_replica1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/awholynewcollection_0_shard2_replica1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/awholynewcollection_0_shard2_replica1/data/
[junit4:junit4] 2> 253039 T651 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 253036 T690 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 253040 T651 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 253041 T633 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 253039 T632 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3fd07b
[junit4:junit4] 2> 253042 T690 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/awholynewcollection_0_shard4_replica3/data
[junit4:junit4] 2> 253042 T690 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/awholynewcollection_0_shard4_replica3/data/index/
[junit4:junit4] 2> 253042 T690 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard4_replica3] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/awholynewcollection_0_shard4_replica3/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 253038 T665 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1368846615803/awholynewcollection_0_shard4_replica1/data/tlog
[junit4:junit4] 2> 253043 T690 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1368846618128/awholynewcollection_0_shard4_replica3/data/index
[junit4:junit4] 2> 253044 T665 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 253045 T665 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 253046 T690 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@21b438 lockFactory=org.apache.lucene.store.NativeFSLockFactory@529ca2),segFN=segments_1,generation=1}
[junit4:junit4] 2> 253046 T690 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 253042 T679 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 253042 T632 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 253042 T650 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 253041 T633 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 253041 T676 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 253050 T676 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 253051 T676 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 253052 T676 oasc.SolrCore.<init> [awholynewcollection_0_shard2_replica3] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard2_replica3/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard2_replica3/data/
[junit4:junit4] 2> 253052 T676 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3fd07b
[junit4:junit4] 2> 253053 T676 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 253054 T736 oasc.SolrCore.registerSearcher [awholynewcollection_0_shard4_replica1] Registered new searcher Searcher@10a6d76 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 253041 T651 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 253054 T651 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 253053 T662 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 253052 T693 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 253051 T692 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 253050 T633 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 253050 T632 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/awholynewcollection_0_shard2_replica1/data
[junit4:junit4] 2> 253049 T690 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 253049 T679 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 253058 T679 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 253059 T679 oasc.SolrCore.<init> [awholynewcollection_0_shard1_replica1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard1_replica1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard1_replica1/data/
[junit4:junit4] 2> 253059 T679 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3fd07b
[junit4:junit4] 2> 253060 T679 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 253046 T649 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 253061 T679 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard1_replica1/data
[junit4:junit4] 2> 253061 T633 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 253060 T690 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 253060 T692 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 253060 T693 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 253060 T662 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 253057 T632 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/awholynewcollection_0_shard2_replica1/data/index/
[junit4:junit4] 2> 253055 T676 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard2_replica3/data
[junit4:junit4] 2> 253055 T651 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 253054 T665 oasc.ZkController.publish publishing core=awholynewcollection_0_shard4_replica1 state=down
[junit4:junit4] 2> 253067 T693 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 253066 T662 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 253066 T692 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 253064 T676 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard2_replica3/data/index/
[junit4:junit4] 2> 253064 T632 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard2_replica1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/awholynewcollection_0_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 253071 T632 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/awholynewcollection_0_shard2_replica1/data/index
[junit4:junit4] 2> 253072 T650 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 253073 T632 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@174b597 lockFactory=org.apache.lucene.store.NativeFSLockFactory@ffbd69),segFN=segments_1,generation=1}
[junit4:junit4] 2> 253073 T632 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 253063 T690 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 253062 T649 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 253075 T649 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 253062 T633 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 253061 T679 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard1_replica1/data/index/
[junit4:junit4] 2> 253076 T632 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 253076 T633 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 253075 T649 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 253075 T690 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 253077 T650 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 253074 T662 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 253071 T692 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 253079 T692 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 253070 T676 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard2_replica3] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard2_replica3/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 253069 T693 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 253080 T693 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 253068 T651 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 253080 T693 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 253080 T676 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard2_replica3/data/index
[junit4:junit4] 2> 253079 T692 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 253078 T662 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 253082 T693 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 253078 T649 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 253083 T649 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 253078 T690 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 253083 T690 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 253077 T633 oasc.SolrCore.<init> [awholynewcollection_0_shard5_replica2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/awholynewcollection_0_shard5_replica2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1368846614315/awholynewcollection_0_shard5_replica2/data/
[junit4:junit4] 2> 253076 T632 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 253076 T679 oasc.SolrCore.initIndex WARN [awholynewcollection_0_shard1_replica1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 253085 T632 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 253085 T679 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1368846616965/awholynewcollection_0_shard1_replica1/data/index
[junit4:junit4] 2> 253084 T633 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3fd07b
[junit4:junit4] 2> 253084 T690 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 253083 T649 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 253083 T676 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@ec071a lockFactory=org.apache.lucene.store.NativeFSLockFactory@492867),segFN=segments_1,generation=1}
[junit4:junit4] 2> 253087 T676 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 253082 T693 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 253082 T692 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 253088 T692 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 253082 T662 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 253081 T650 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 253081 T651 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 253089 T676 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 253088 T692 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 253088 T693 oasc.SolrCore.initDirectoryFactory org.apach
[...truncated too long message...]
"base_url":"http://127.0.0.1:49175/_p"}
[junit4:junit4] 1> /solr/collections/collection1 (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/collection1/shards (0)
[junit4:junit4] 1> /solr/collections/control_collection (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/control_collection/shards (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1 (2)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "configName":"conf1",
[junit4:junit4] 1> "router":"compositeId"}
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect (3)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard1/election (4)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard1/election/89708731703230467-127.0.0.1:49175__p_awholynewcollection_1_shard1_replica1-n_0000000002 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard1/election/89708731703230472-127.0.0.1:60216__p_awholynewcollection_1_shard1_replica2-n_0000000003 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard1/election/89708731703230472-127.0.0.1:60216__p_awholynewcollection_1_shard1_replica2-n_0000000001 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard1/election/89708731703230467-127.0.0.1:49175__p_awholynewcollection_1_shard1_replica1-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard2 (1)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard2/election (4)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard2/election/89708731703230470-127.0.0.1:33436__p_awholynewcollection_1_shard2_replica2-n_0000000001 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard2/election/89708731703230470-127.0.0.1:33436__p_awholynewcollection_1_shard2_replica2-n_0000000002 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard2/election/89708731703230476-127.0.0.1:54177__p_awholynewcollection_1_shard2_replica1-n_0000000003 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard2/election/89708731703230476-127.0.0.1:54177__p_awholynewcollection_1_shard2_replica1-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard3 (1)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard3/election (4)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard3/election/89708731703230474-127.0.0.1:34577__p_awholynewcollection_1_shard3_replica1-n_0000000002 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard3/election/89708731703230467-127.0.0.1:49175__p_awholynewcollection_1_shard3_replica2-n_0000000001 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard3/election/89708731703230474-127.0.0.1:34577__p_awholynewcollection_1_shard3_replica1-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leader_elect/shard3/election/89708731703230467-127.0.0.1:49175__p_awholynewcollection_1_shard3_replica2-n_0000000003 (0)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leaders (3)
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"awholynewcollection_1_shard1_replica1",
[junit4:junit4] 1> "node_name":"127.0.0.1:49175__p",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:49175/_p"}
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leaders/shard2 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"awholynewcollection_1_shard2_replica1",
[junit4:junit4] 1> "node_name":"127.0.0.1:54177__p",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:54177/_p"}
[junit4:junit4] 1> /solr/collections/awholynewcollection_1/leaders/shard3 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"awholynewcollection_1_shard3_replica1",
[junit4:junit4] 1> "node_name":"127.0.0.1:34577__p",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:34577/_p"}
[junit4:junit4] 1> /solr/overseer_elect (2)
[junit4:junit4] 1> /solr/overseer_elect/election (5)
[junit4:junit4] 1> /solr/overseer_elect/election/89708731703230474-127.0.0.1:34577__p-n_0000000003 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89708731703230472-127.0.0.1:60216__p-n_0000000002 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89708731703230470-127.0.0.1:33436__p-n_0000000001 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89708731703230476-127.0.0.1:54177__p-n_0000000004 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89708731703230467-127.0.0.1:49175__p-n_0000000000 (0)
[junit4:junit4] 1> /solr/overseer_elect/leader (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"id":"89708731703230467-127.0.0.1:49175__p-n_0000000000"}
[junit4:junit4] 1> /zookeeper (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=C7F25445C4C37706 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_AR -Dtests.timezone=Antarctica/Casey -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 269s J1 | CollectionsAPIDistributedZkTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 230 seconds
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([C7F25445C4C37706:4614DA5DB39C173A]:0)
[junit4:junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:173)
[junit4:junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131)
[junit4:junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:126)
[junit4:junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:512)
[junit4:junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:146)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 511013 T615 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 268863 T614 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4] 2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=306), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=306)), sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=es_AR, timezone=Antarctica/Casey
[junit4:junit4] 2> NOTE: Linux 3.2.0-41-generic i386/Oracle Corporation 1.7.0_21 (32-bit)/cpus=8,threads=1,free=65945576,total=128262144
[junit4:junit4] 2> NOTE: All tests run in this JVM: [RequiredFieldsTest, TestPropInject, TestShardHandlerFactory, BasicDistributedZk2Test, SpellCheckCollatorTest, DebugComponentTest, SpellCheckComponentTest, TestJmxIntegration, TestCoreDiscovery, LeaderElectionIntegrationTest, TestSerializedLuceneMatchVersion, DefaultValueUpdateProcessorTest, TestDefaultSimilarityFactory, TestIndexSearcher, TestAnalyzedSuggestions, CachingDirectoryFactoryTest, BadIndexSchemaTest, TestReload, TestBM25SimilarityFactory, SolrPluginUtilsTest, TestBinaryResponseWriter, NotRequiredUniqueKeyTest, SolrCoreCheckLockOnStartupTest, TestSchemaSimilarityResource, OutputWriterTest, XsltUpdateRequestHandlerTest, SimplePostToolTest, ShardRoutingCustomTest, RequestHandlersTest, CollectionsAPIDistributedZkTest]
[junit4:junit4] Completed on J1 in 269.14s, 1 test, 1 failure <<< FAILURES!
[...truncated 593 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:377: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:357: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:437: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1240: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:884: There were test failures: 295 suites, 1231 tests, 1 failure, 13 ignored (7 assumptions)
Total time: 39 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_21 -server -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_21) - Build #
5709 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/5709/
Java: 64bit/jdk1.7.0_21 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Wrong doc count on shard1_0 expected:<417> but was:<416>
Stack Trace:
java.lang.AssertionError: Wrong doc count on shard1_0 expected:<417> but was:<416>
at __randomizedtesting.SeedInfo.seed([5EED0D812EEE1723:DF0B839959B1771F]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.ShardSplitTest.checkDocCountsAndShardStates(ShardSplitTest.java:166)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:142)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9421 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4:junit4] 2> 101177 T442 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /tndz/l
[junit4:junit4] 2> 101184 T442 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-ShardSplitTest-1368851308481
[junit4:junit4] 2> 101185 T442 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 101186 T443 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 101286 T442 oasc.ZkTestServer.run start zk server on port:37908
[junit4:junit4] 2> 101288 T442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 101385 T449 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b57358d name:ZooKeeperConnection Watcher:127.0.0.1:37908 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 101385 T442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 101385 T442 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 101396 T442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 101404 T451 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@684c308f name:ZooKeeperConnection Watcher:127.0.0.1:37908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 101405 T442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 101405 T442 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 101409 T442 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 101413 T442 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 101415 T442 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 101419 T442 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 101420 T442 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 101425 T442 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 101426 T442 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 101431 T442 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 101432 T442 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 101436 T442 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 101436 T442 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 101440 T442 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 101441 T442 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 101448 T442 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 101449 T442 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 101452 T442 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 101453 T442 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 101457 T442 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 101458 T442 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 101462 T442 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 101463 T442 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 101554 T442 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 101559 T442 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:57341
[junit4:junit4] 2> 101560 T442 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 101561 T442 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 101561 T442 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368851308764
[junit4:junit4] 2> 101561 T442 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368851308764/solr.xml
[junit4:junit4] 2> 101562 T442 oasc.CoreContainer.<init> New CoreContainer 1232238029
[junit4:junit4] 2> 101562 T442 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368851308764/'
[junit4:junit4] 2> 101562 T442 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368851308764/'
[junit4:junit4] 2> 101607 T442 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 101608 T442 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 101608 T442 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 101609 T442 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 101609 T442 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 101609 T442 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 101610 T442 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 101610 T442 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 101610 T442 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 101611 T442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 101614 T442 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 101615 T442 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:37908/solr
[junit4:junit4] 2> 101615 T442 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 101616 T442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 101618 T462 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2877f9df name:ZooKeeperConnection Watcher:127.0.0.1:37908 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 101619 T442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 101623 T442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 101629 T442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 101630 T464 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e3cf795 name:ZooKeeperConnection Watcher:127.0.0.1:37908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 101631 T442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 101633 T442 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 101637 T442 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 101641 T442 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 101643 T442 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57341_tndz%2Fl
[junit4:junit4] 2> 101645 T442 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57341_tndz%2Fl
[junit4:junit4] 2> 101649 T442 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 101654 T442 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 101657 T442 oasc.Overseer.start Overseer (id=89709039352938499-127.0.0.1:57341_tndz%2Fl-n_0000000000) starting
[junit4:junit4] 2> 101661 T442 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 101665 T466 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 101666 T442 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 101673 T442 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 101676 T442 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 101680 T465 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 101682 T467 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368851308764/collection1
[junit4:junit4] 2> 101683 T467 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 101684 T467 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 101684 T467 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 101685 T467 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368851308764/collection1/'
[junit4:junit4] 2> 101686 T467 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-controljetty-1368851308764/collection1/lib/README' to classloader
[junit4:junit4] 2> 101686 T467 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-controljetty-1368851308764/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 101711 T467 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 101753 T467 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 101755 T467 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 101758 T467 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 102107 T467 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 102109 T467 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 102111 T467 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 102115 T467 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 102144 T467 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 102145 T467 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-controljetty-1368851308764/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368851308480/control/data/
[junit4:junit4] 2> 102145 T467 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d8ae503
[junit4:junit4] 2> 102146 T467 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 102146 T467 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368851308480/control/data
[junit4:junit4] 2> 102146 T467 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368851308480/control/data/index/
[junit4:junit4] 2> 102146 T467 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368851308480/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 102147 T467 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368851308480/control/data/index
[junit4:junit4] 2> 102148 T467 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4f61306c lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f196801),segFN=segments_1,generation=1}
[junit4:junit4] 2> 102149 T467 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 102150 T467 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 102151 T467 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 102151 T467 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 102152 T467 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 102152 T467 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 102152 T467 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 102153 T467 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 102153 T467 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 102153 T467 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 102156 T467 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 102158 T467 oass.SolrIndexSearcher.<init> Opening Searcher@3e8ffc2 main
[junit4:junit4] 2> 102158 T467 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368851308480/control/data/tlog
[junit4:junit4] 2> 102159 T467 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 102159 T467 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 102163 T468 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3e8ffc2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 102164 T467 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 102164 T467 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 103184 T465 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 103185 T465 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:57341_tndz%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57341/tndz/l"}
[junit4:junit4] 2> 103186 T465 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 103186 T465 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 103190 T464 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 104167 T467 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 104167 T467 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:57341/tndz/l collection:control_collection shard:shard1
[junit4:junit4] 2> 104168 T467 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 104178 T467 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 104181 T467 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 104182 T467 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 104182 T467 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:57341/tndz/l/collection1/
[junit4:junit4] 2> 104182 T467 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 104183 T467 oasc.SyncStrategy.syncToMe http://127.0.0.1:57341/tndz/l/collection1/ has no replicas
[junit4:junit4] 2> 104183 T467 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:57341/tndz/l/collection1/
[junit4:junit4] 2> 104183 T467 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 104694 T465 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 104703 T464 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 104743 T467 oasc.ZkController.register We are http://127.0.0.1:57341/tndz/l/collection1/ and leader is http://127.0.0.1:57341/tndz/l/collection1/
[junit4:junit4] 2> 104743 T467 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57341/tndz/l
[junit4:junit4] 2> 104743 T467 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 104744 T467 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 104744 T467 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 104746 T467 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 104748 T442 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 104748 T442 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 104749 T442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 104754 T442 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 104757 T442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 104758 T471 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@34775a91 name:ZooKeeperConnection Watcher:127.0.0.1:37908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 104758 T442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 104760 T442 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 104763 T442 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 104832 T442 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 104834 T442 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50204
[junit4:junit4] 2> 104835 T442 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 104836 T442 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 104836 T442 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368851312060
[junit4:junit4] 2> 104836 T442 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368851312060/solr.xml
[junit4:junit4] 2> 104837 T442 oasc.CoreContainer.<init> New CoreContainer 1057223493
[junit4:junit4] 2> 104837 T442 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368851312060/'
[junit4:junit4] 2> 104837 T442 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368851312060/'
[junit4:junit4] 2> 104899 T442 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 104900 T442 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 104900 T442 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 104901 T442 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 104901 T442 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 104902 T442 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 104902 T442 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 104903 T442 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 104904 T442 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 104904 T442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 104910 T442 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 104911 T442 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:37908/solr
[junit4:junit4] 2> 104911 T442 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 104912 T442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 104914 T482 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@527c6c33 name:ZooKeeperConnection Watcher:127.0.0.1:37908 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 104915 T442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 104919 T442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 104924 T442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 104926 T484 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4bd7ceca name:ZooKeeperConnection Watcher:127.0.0.1:37908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 104926 T442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 104934 T442 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 105939 T442 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50204_tndz%2Fl
[junit4:junit4] 2> 105940 T442 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50204_tndz%2Fl
[junit4:junit4] 2> 105944 T471 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 105944 T464 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 105944 T484 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 105944 T464 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 105949 T485 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368851312060/collection1
[junit4:junit4] 2> 105950 T485 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 105950 T485 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 105950 T485 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 105952 T485 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368851312060/collection1/'
[junit4:junit4] 2> 105952 T485 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty1-1368851312060/collection1/lib/README' to classloader
[junit4:junit4] 2> 105953 T485 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty1-1368851312060/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 105976 T485 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 106016 T485 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 106018 T485 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 106021 T485 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 106216 T465 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 106217 T465 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:57341_tndz%2Fl_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:57341_tndz%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57341/tndz/l"}
[junit4:junit4] 2> 106222 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 106222 T464 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 106222 T471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 106348 T485 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 106350 T485 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 106352 T485 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 106356 T485 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 106390 T485 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 106390 T485 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty1-1368851312060/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty1/
[junit4:junit4] 2> 106390 T485 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d8ae503
[junit4:junit4] 2> 106391 T485 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 106391 T485 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty1
[junit4:junit4] 2> 106392 T485 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty1/index/
[junit4:junit4] 2> 106392 T485 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 106392 T485 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty1/index
[junit4:junit4] 2> 106394 T485 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@796afcd3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4218b65),segFN=segments_1,generation=1}
[junit4:junit4] 2> 106394 T485 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 106396 T485 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 106396 T485 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 106397 T485 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 106398 T485 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 106398 T485 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 106399 T485 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 106399 T485 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 106400 T485 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 106400 T485 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 106404 T485 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 106408 T485 oass.SolrIndexSearcher.<init> Opening Searcher@365ac848 main
[junit4:junit4] 2> 106408 T485 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty1/tlog
[junit4:junit4] 2> 106409 T485 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 106409 T485 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 106413 T486 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@365ac848 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 106415 T485 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 106415 T485 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 107728 T465 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 107729 T465 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50204_tndz%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50204/tndz/l"}
[junit4:junit4] 2> 107730 T465 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 107730 T465 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 107783 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 107783 T464 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 107783 T471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 108417 T485 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 108417 T485 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50204/tndz/l collection:collection1 shard:shard1
[junit4:junit4] 2> 108418 T485 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 108426 T485 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 108429 T485 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 108429 T485 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 108430 T485 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50204/tndz/l/collection1/
[junit4:junit4] 2> 108430 T485 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 108430 T485 oasc.SyncStrategy.syncToMe http://127.0.0.1:50204/tndz/l/collection1/ has no replicas
[junit4:junit4] 2> 108430 T485 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50204/tndz/l/collection1/
[junit4:junit4] 2> 108431 T485 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 109291 T465 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 109300 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 109300 T464 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 109300 T471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 109340 T485 oasc.ZkController.register We are http://127.0.0.1:50204/tndz/l/collection1/ and leader is http://127.0.0.1:50204/tndz/l/collection1/
[junit4:junit4] 2> 109341 T485 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50204/tndz/l
[junit4:junit4] 2> 109341 T485 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 109341 T485 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 109342 T485 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 109354 T485 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 109355 T442 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 109356 T442 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 109356 T442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 109437 T442 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 109440 T442 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:33281
[junit4:junit4] 2> 109440 T442 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 109441 T442 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 109441 T442 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368851316655
[junit4:junit4] 2> 109441 T442 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368851316655/solr.xml
[junit4:junit4] 2> 109442 T442 oasc.CoreContainer.<init> New CoreContainer 1183392549
[junit4:junit4] 2> 109442 T442 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368851316655/'
[junit4:junit4] 2> 109442 T442 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368851316655/'
[junit4:junit4] 2> 109495 T442 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 109496 T442 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 109496 T442 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 109497 T442 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 109497 T442 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 109497 T442 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 109498 T442 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 109498 T442 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 109498 T442 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 109499 T442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 109502 T442 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 109503 T442 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:37908/solr
[junit4:junit4] 2> 109503 T442 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 109504 T442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 109518 T498 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@381ba8c1 name:ZooKeeperConnection Watcher:127.0.0.1:37908 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 109518 T442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 109523 T442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 109527 T442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 109529 T500 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@662dba8d name:ZooKeeperConnection Watcher:127.0.0.1:37908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 109529 T442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 109534 T442 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 110538 T442 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33281_tndz%2Fl
[junit4:junit4] 2> 110540 T442 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33281_tndz%2Fl
[junit4:junit4] 2> 110543 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 110543 T471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 110545 T464 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 110545 T464 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 110546 T500 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 110546 T484 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 110548 T471 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 110552 T501 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368851316655/collection1
[junit4:junit4] 2> 110552 T501 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 110553 T501 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 110553 T501 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 110555 T501 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368851316655/collection1/'
[junit4:junit4] 2> 110555 T501 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty2-1368851316655/collection1/lib/README' to classloader
[junit4:junit4] 2> 110556 T501 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty2-1368851316655/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 110585 T501 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 110617 T501 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 110619 T501 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 110623 T501 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 110810 T465 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 110811 T465 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:50204_tndz%2Fl_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:50204_tndz%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50204/tndz/l"}
[junit4:junit4] 2> 110816 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 110816 T464 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 110816 T500 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 110816 T471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 110921 T501 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 110923 T501 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 110925 T501 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 110930 T501 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 110963 T501 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 110964 T501 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty2-1368851316655/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty2/
[junit4:junit4] 2> 110964 T501 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d8ae503
[junit4:junit4] 2> 110965 T501 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 110965 T501 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty2
[junit4:junit4] 2> 110966 T501 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty2/index/
[junit4:junit4] 2> 110966 T501 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 110967 T501 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty2/index
[junit4:junit4] 2> 110969 T501 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2abc4320 lockFactory=org.apache.lucene.store.NativeFSLockFactory@52d8eb55),segFN=segments_1,generation=1}
[junit4:junit4] 2> 110969 T501 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 110972 T501 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 110972 T501 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 110973 T501 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 110973 T501 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 110982 T501 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 110982 T501 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 110982 T501 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 110983 T501 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 110983 T501 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 110985 T501 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 110987 T501 oass.SolrIndexSearcher.<init> Opening Searcher@48204e5a main
[junit4:junit4] 2> 110988 T501 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty2/tlog
[junit4:junit4] 2> 110988 T501 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 110989 T501 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 110993 T502 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@48204e5a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 110995 T501 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 110995 T501 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 112322 T465 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 112323 T465 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:33281_tndz%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33281/tndz/l"}
[junit4:junit4] 2> 112323 T465 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 112323 T465 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 112363 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 112363 T464 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 112363 T471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 112363 T500 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 112997 T501 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 112997 T501 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:33281/tndz/l collection:collection1 shard:shard2
[junit4:junit4] 2> 112998 T501 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 113005 T501 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 113008 T501 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 113008 T501 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 113008 T501 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:33281/tndz/l/collection1/
[junit4:junit4] 2> 113008 T501 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 113009 T501 oasc.SyncStrategy.syncToMe http://127.0.0.1:33281/tndz/l/collection1/ has no replicas
[junit4:junit4] 2> 113009 T501 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:33281/tndz/l/collection1/
[junit4:junit4] 2> 113009 T501 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 113871 T465 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 113881 T500 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 113881 T471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 113881 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 113882 T464 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 113916 T501 oasc.ZkController.register We are http://127.0.0.1:33281/tndz/l/collection1/ and leader is http://127.0.0.1:33281/tndz/l/collection1/
[junit4:junit4] 2> 113917 T501 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33281/tndz/l
[junit4:junit4] 2> 113917 T501 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 113917 T501 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 113917 T501 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 113919 T501 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 113921 T442 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 113921 T442 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 113922 T442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 113992 T442 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 113995 T442 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53106
[junit4:junit4] 2> 113995 T442 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 113996 T442 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 113996 T442 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368851321223
[junit4:junit4] 2> 113996 T442 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368851321223/solr.xml
[junit4:junit4] 2> 113997 T442 oasc.CoreContainer.<init> New CoreContainer 484453119
[junit4:junit4] 2> 113997 T442 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368851321223/'
[junit4:junit4] 2> 113997 T442 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368851321223/'
[junit4:junit4] 2> 114041 T442 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 114042 T442 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 114042 T442 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 114042 T442 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 114043 T442 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 114043 T442 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 114043 T442 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 114044 T442 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 114044 T442 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 114044 T442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 114048 T442 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 114048 T442 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:37908/solr
[junit4:junit4] 2> 114048 T442 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 114049 T442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 114051 T514 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6df13522 name:ZooKeeperConnection Watcher:127.0.0.1:37908 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 114051 T442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 114053 T442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 114057 T442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 114058 T516 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1116ff1c name:ZooKeeperConnection Watcher:127.0.0.1:37908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 114058 T442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 114062 T442 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 115066 T442 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53106_tndz%2Fl
[junit4:junit4] 2> 115067 T442 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53106_tndz%2Fl
[junit4:junit4] 2> 115070 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 115070 T500 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 115070 T471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 115072 T464 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 115072 T464 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 115072 T516 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 115073 T484 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 115073 T471 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 115074 T500 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 115078 T517 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368851321223/collection1
[junit4:junit4] 2> 115079 T517 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 115080 T517 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 115080 T517 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 115081 T517 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368851321223/collection1/'
[junit4:junit4] 2> 115082 T517 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty3-1368851321223/collection1/lib/README' to classloader
[junit4:junit4] 2> 115082 T517 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty3-1368851321223/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 115108 T517 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 115137 T517 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 115139 T517 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 115142 T517 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 115388 T465 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 115390 T465 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:33281_tndz%2Fl_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:33281_tndz%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33281/tndz/l"}
[junit4:junit4] 2> 115394 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 115394 T464 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 115394 T471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 115394 T500 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 115394 T516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 115436 T517 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 115439 T517 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 115440 T517 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 115444 T517 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 115467 T517 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 115467 T517 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty3-1368851321223/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty3/
[junit4:junit4] 2> 115468 T517 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d8ae503
[junit4:junit4] 2> 115468 T517 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 115469 T517 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty3
[junit4:junit4] 2> 115469 T517 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty3/index/
[junit4:junit4] 2> 115469 T517 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 115469 T517 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty3/index
[junit4:junit4] 2> 115471 T517 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b02d0a5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63ed96d8),segFN=segments_1,generation=1}
[junit4:junit4] 2> 115471 T517 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 115473 T517 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 115473 T517 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 115474 T517 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 115475 T517 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 115475 T517 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 115475 T517 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 115476 T517 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 115476 T517 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 115476 T517 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 115479 T517 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 115481 T517 oass.SolrIndexSearcher.<init> Opening Searcher@fbfb6c7 main
[junit4:junit4] 2> 115481 T517 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty3/tlog
[junit4:junit4] 2> 115482 T517 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 115482 T517 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 115486 T518 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@fbfb6c7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 115488 T517 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 115488 T517 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 116901 T465 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 116902 T465 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53106_tndz%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53106/tndz/l"}
[junit4:junit4] 2> 116902 T465 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 116902 T465 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 116906 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 116907 T471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 116906 T516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 116907 T500 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 116907 T464 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 117490 T517 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 117491 T517 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53106/tndz/l collection:collection1 shard:shard1
[junit4:junit4] 2> 117495 T517 oasc.ZkController.register We are http://127.0.0.1:53106/tndz/l/collection1/ and leader is http://127.0.0.1:50204/tndz/l/collection1/
[junit4:junit4] 2> 117495 T517 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53106/tndz/l
[junit4:junit4] 2> 117495 T517 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 117496 T517 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C36 name=collection1 org.apache.solr.core.SolrCore@4deb122f url=http://127.0.0.1:53106/tndz/l/collection1 node=127.0.0.1:53106_tndz%2Fl C36_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:53106_tndz%2Fl, base_url=http://127.0.0.1:53106/tndz/l}
[junit4:junit4] 2> 117496 T519 C36 P53106 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 117497 T519 C36 P53106 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 117497 T517 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 117497 T519 C36 P53106 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 117498 T519 C36 P53106 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 117499 T442 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 117499 T442 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 117499 T519 C36 P53106 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 117500 T442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 117504 T479 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:53106_tndz%2Fl_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 117570 T442 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 117572 T442 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:43174
[junit4:junit4] 2> 117573 T442 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 117573 T442 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 117574 T442 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368851324799
[junit4:junit4] 2> 117574 T442 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368851324799/solr.xml
[junit4:junit4] 2> 117574 T442 oasc.CoreContainer.<init> New CoreContainer 2038617833
[junit4:junit4] 2> 117575 T442 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368851324799/'
[junit4:junit4] 2> 117575 T442 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368851324799/'
[junit4:junit4] 2> 117614 T442 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 117615 T442 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 117615 T442 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 117615 T442 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 117616 T442 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 117616 T442 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 117616 T442 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 117617 T442 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 117617 T442 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 117617 T442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 117624 T442 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 117625 T442 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:37908/solr
[junit4:junit4] 2> 117625 T442 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 117626 T442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 117627 T531 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@708ce5ef name:ZooKeeperConnection Watcher:127.0.0.1:37908 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 117628 T442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 117630 T442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 117633 T442 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 117635 T533 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cac1495 name:ZooKeeperConnection Watcher:127.0.0.1:37908/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 117635 T442 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 117639 T442 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 118412 T465 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 118413 T465 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:53106_tndz%2Fl_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53106_tndz%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53106/tndz/l"}
[junit4:junit4] 2> 118418 T516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 118418 T471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 118418 T464 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 118418 T533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 118418 T500 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 118418 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 118505 T479 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:53106_tndz%2Fl_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 118506 T479 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:53106_tndz%252Fl_collection1&state=recovering&nodeName=127.0.0.1:53106_tndz%252Fl&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 118642 T442 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43174_tndz%2Fl
[junit4:junit4] 2> 118645 T442 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43174_tndz%2Fl
[junit4:junit4] 2> 118647 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 118647 T471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 118647 T500 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 118647 T516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 118647 T533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 118649 T464 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 118649 T464 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 118650 T471 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 118651 T500 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 118651 T516 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 118651 T484 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 118652 T533 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 118657 T534 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368851324799/collection1
[junit4:junit4] 2> 118657 T534 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 118658 T534 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 118658 T534 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 118660 T534 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368851324799/collection1/'
[junit4:junit4] 2> 118660 T534 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty4-1368851324799/collection1/lib/README' to classloader
[junit4:junit4] 2> 118661 T534 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.ShardSplitTest-jetty4-1368851324799/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 118684 T534 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 118716 T534 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 118718 T534 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 118721 T534 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 119009 T534 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 119012 T534 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 119013 T534 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 119017 T534 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 119041 T534 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 119042 T534 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368851324799/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty4/
[junit4:junit4] 2> 119042 T534 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@d8ae503
[junit4:junit4] 2> 119042 T534 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 119043 T534 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty4
[junit4:junit4] 2> 119043 T534 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty4/index/
[junit4:junit4] 2> 119043 T534 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 119044 T534 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty4/index
[junit4:junit4] 2> 119045 T534 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1eedd539 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65f9cb06),segFN=segments_1,generation=1}
[junit4:junit4] 2> 119046 T534 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 119047 T534 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 119048 T534 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 119048 T534 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 119049 T534 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 119049 T534 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 119049 T534 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 119050 T534 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 119050 T534 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 119050 T534 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 119053 T534 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 119055 T534 oass.SolrIndexSearcher.<init> Opening Searcher@7867698 main
[junit4:junit4] 2> 119055 T534 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty4/tlog
[junit4:junit4] 2> 119056 T534 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 119056 T534 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 119061 T535 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7867698 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 119063 T534 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 119064 T534 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 119924 T465 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 119925 T465 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:43174_tndz%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43174/tndz/l"}
[junit4:junit4] 2> 119925 T465 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 119926 T465 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 119930 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 119931 T533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 119930 T516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 119930 T464 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 119930 T471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 119931 T500 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 120065 T534 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 120066 T534 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:43174/tndz/l collection:collection1 shard:shard2
[junit4:junit4] 2> 120071 T534 oasc.ZkController.register We are http://127.0.0.1:43174/tndz/l/collection1/ and leader is http://127.0.0.1:33281/tndz/l/collection1/
[junit4:junit4] 2> 120071 T534 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:43174/tndz/l
[junit4:junit4] 2> 120072 T534 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 120072 T534 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C37 name=collection1 org.apache.solr.core.SolrCore@37264694 url=http://127.0.0.1:43174/tndz/l/collection1 node=127.0.0.1:43174_tndz%2Fl C37_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:43174_tndz%2Fl, base_url=http://127.0.0.1:43174/tndz/l}
[junit4:junit4] 2> 120073 T536 C37 P43174 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 120073 T536 C37 P43174 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 120074 T536 C37 P43174 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 120074 T536 C37 P43174 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 120074 T534 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 120078 T536 C37 P43174 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 120083 T442 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 120084 T442 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 120085 T442 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 120085 T495 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:43174_tndz%2Fl_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 120090 T442 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 120091 T442 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 120092 T442 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 120093 T442 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C36_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:53106_tndz%2Fl, base_url=http://127.0.0.1:53106/tndz/l}
[junit4:junit4] 2> 120507 T519 C36 P53106 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:50204/tndz/l/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 120507 T519 C36 P53106 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:53106/tndz/l START replicas=[http://127.0.0.1:50204/tndz/l/collection1/] nUpdates=100
[junit4:junit4] 2> 120507 T519 C36 P53106 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 120508 T519 C36 P53106 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 120508 T519 C36 P53106 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 120508 T519 C36 P53106 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 120508 T519 C36 P53106 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 120509 T519 C36 P53106 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:50204/tndz/l/collection1/. core=collection1
[junit4:junit4] 2> 120509 T519 C36 P53106 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C38 name=collection1 org.apache.solr.core.SolrCore@72febf4 url=http://127.0.0.1:50204/tndz/l/collection1 node=127.0.0.1:50204_tndz%2Fl C38_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:50204_tndz%2Fl, base_url=http://127.0.0.1:50204/tndz/l, leader=true}
[junit4:junit4] 2> 120514 T479 C38 P50204 oasc.SolrCore.execute [collection1] webapp=/tndz/l path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 120516 T480 C38 P50204 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 120518 T480 C38 P50204 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@796afcd3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4218b65),segFN=segments_1,generation=1}
[junit4:junit4] 2> 120518 T480 C38 P50204 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 120519 T480 C38 P50204 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@796afcd3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4218b65),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@796afcd3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4218b65),segFN=segments_2,generation=2}
[junit4:junit4] 2> 120519 T480 C38 P50204 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 120520 T480 C38 P50204 oass.SolrIndexSearcher.<init> Opening Searcher@1397919c realtime
[junit4:junit4] 2> 120520 T480 C38 P50204 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 120520 T480 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> 120521 T519 C36 P53106 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 120522 T519 C36 P53106 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 120524 T477 C38 P50204 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 120525 T477 C38 P50204 oasc.SolrCore.execute [collection1] webapp=/tndz/l path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 120526 T519 C36 P53106 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 120526 T519 C36 P53106 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 120526 T519 C36 P53106 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 120529 T479 C38 P50204 oasc.SolrCore.execute [collection1] webapp=/tndz/l path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 120530 T519 C36 P53106 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 120531 T519 C36 P53106 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty3/index.20130518145847826
[junit4:junit4] 2> 120531 T519 C36 P53106 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@513113f1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2aa0240c) fullCopy=false
[junit4:junit4] 2> 120534 T480 C38 P50204 oasc.SolrCore.execute [collection1] webapp=/tndz/l path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 120536 T519 C36 P53106 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 120537 T519 C36 P53106 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 120537 T519 C36 P53106 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 120538 T519 C36 P53106 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b02d0a5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63ed96d8),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b02d0a5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63ed96d8),segFN=segments_2,generation=2}
[junit4:junit4] 2> 120544 T519 C36 P53106 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 120545 T519 C36 P53106 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 120545 T519 C36 P53106 oass.SolrIndexSearcher.<init> Opening Searcher@3fe59648 main
[junit4:junit4] 2> 120546 T518 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3fe59648 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 120547 T519 C36 P53106 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty3/index.20130518145847826 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty3/index.20130518145847826;done=true>>]
[junit4:junit4] 2> 120547 T519 C36 P53106 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty3/index.20130518145847826
[junit4:junit4] 2> 120547 T519 C36 P53106 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty3/index.20130518145847826
[junit4:junit4] 2> 120548 T519 C36 P53106 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 120548 T519 C36 P53106 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 120548 T519 C36 P53106 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 120549 T519 C36 P53106 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 120550 T519 C36 P53106 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 121095 T442 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 121437 T465 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 121438 T465 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:43174_tndz%2Fl_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:43174_tndz%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43174/tndz/l"}
[junit4:junit4] 2> 121443 T465 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:53106_tndz%2Fl_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:53106_tndz%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53106/tndz/l"}
[junit4:junit4] 2> 121463 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 121463 T500 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 121464 T516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 121464 T533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 121463 T464 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 121464 T471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 122086 T495 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:43174_tndz%2Fl_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 122087 T495 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:43174_tndz%252Fl_collection1&state=recovering&nodeName=127.0.0.1:43174_tndz%252Fl&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 122098 T442 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 123100 T442 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C37_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:43174_tndz%2Fl, base_url=http://127.0.0.1:43174/tndz/l}
[junit4:junit4] 2> 124088 T536 C37 P43174 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:33281/tndz/l/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 124089 T536 C37 P43174 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:43174/tndz/l START replicas=[http://127.0.0.1:33281/tndz/l/collection1/] nUpdates=100
[junit4:junit4] 2> 124089 T536 C37 P43174 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 124089 T536 C37 P43174 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 124090 T536 C37 P43174 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 124090 T536 C37 P43174 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 124090 T536 C37 P43174 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 124090 T536 C37 P43174 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:33281/tndz/l/collection1/. core=collection1
[junit4:junit4] 2> 124091 T536 C37 P43174 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C39 name=collection1 org.apache.solr.core.SolrCore@6a23d344 url=http://127.0.0.1:33281/tndz/l/collection1 node=127.0.0.1:33281_tndz%2Fl C39_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:33281_tndz%2Fl, base_url=http://127.0.0.1:33281/tndz/l, leader=true}
[junit4:junit4] 2> 124097 T493 C39 P33281 oasc.SolrCore.execute [collection1] webapp=/tndz/l path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 124098 T496 C39 P33281 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 124100 T496 C39 P33281 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2abc4320 lockFactory=org.apache.lucene.store.NativeFSLockFactory@52d8eb55),segFN=segments_1,generation=1}
[junit4:junit4] 2> 124100 T496 C39 P33281 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 124101 T496 C39 P33281 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2abc4320 lockFactory=org.apache.lucene.store.NativeFSLockFactory@52d8eb55),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2abc4320 lockFactory=org.apache.lucene.store.NativeFSLockFactory@52d8eb55),segFN=segments_2,generation=2}
[junit4:junit4] 2> 124102 T496 C39 P33281 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 124103 T496 C39 P33281 oass.SolrIndexSearcher.<init> Opening Searcher@29200d25 realtime
[junit4:junit4] 2> 124103 T496 C39 P33281 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 124103 T442 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 124104 T496 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 124106 T536 C37 P43174 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 124106 T536 C37 P43174 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 124109 T493 C39 P33281 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 124110 T493 C39 P33281 oasc.SolrCore.execute [collection1] webapp=/tndz/l path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 124111 T536 C37 P43174 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 124111 T536 C37 P43174 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 124112 T536 C37 P43174 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 124115 T496 C39 P33281 oasc.SolrCore.execute [collection1] webapp=/tndz/l path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 124116 T536 C37 P43174 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 124117 T536 C37 P43174 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty4/index.20130518145851412
[junit4:junit4] 2> 124118 T536 C37 P43174 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@29dbe68c lockFactory=org.apache.lucene.store.NativeFSLockFactory@28017a7f) fullCopy=false
[junit4:junit4] 2> 124121 T494 C39 P33281 oasc.SolrCore.execute [collection1] webapp=/tndz/l path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=1
[junit4:junit4] 2> 124122 T536 C37 P43174 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 124128 T536 C37 P43174 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 124129 T536 C37 P43174 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 124130 T536 C37 P43174 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1eedd539 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65f9cb06),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1eedd539 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65f9cb06),segFN=segments_2,generation=2}
[junit4:junit4] 2> 124130 T536 C37 P43174 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 124131 T536 C37 P43174 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 124131 T536 C37 P43174 oass.SolrIndexSearcher.<init> Opening Searcher@400edaea main
[junit4:junit4] 2> 124132 T535 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@400edaea main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 124133 T536 C37 P43174 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty4/index.20130518145851412 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty4/index.20130518145851412;done=true>>]
[junit4:junit4] 2> 124134 T536 C37 P43174 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty4/index.20130518145851412
[junit4:junit4] 2> 124134 T536 C37 P43174 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1368851308480/jetty4/index.20130518145851412
[junit4:junit4] 2> 124134 T536 C37 P43174 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 124134 T536 C37 P43174 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 124135 T536 C37 P43174 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 124135 T536 C37 P43174 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 124137 T536 C37 P43174 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 124476 T465 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 124477 T465 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:43174_tndz%2Fl_collection1",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:43174_tndz%2Fl",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43174/tndz/l"}
[junit4:junit4] 2> 124483 T484 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 124483 T516 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 124483 T464 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 124484 T533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 124484 T471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 124484 T500 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 125106 T442 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 125107 T442 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C40 name=collection1 org.apache.solr.core.SolrCore@70de7d0f url=http://127.0.0.1:57341/tndz/l/collection1 node=127.0.0.1:57341_tndz%2Fl C40_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:57341_tndz%2Fl, base_url=http://127.0.0.1:57341/tndz/l, leader=true}
[junit4:junit4] 2> 125113 T460 C40 P57341 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 125115 T460 C40 P57341 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4f61306c lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f196801),segFN=segments_1,generation=1}
[junit4:junit4] 2> 125116 T460 C40 P57341 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 125120 T460 C40 P57341 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4f61306c lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f196801),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4f61306c lockFactory=org.apache.lucene.store.NativeFSLockFactory@6f196801),segFN=segments_2,generation=2}
[junit4:junit4] 2> 125121 T460 C40 P57341 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 125122 T460 C40 P57341 oass.SolrIndexSearcher.<init> Opening Searcher@719f8f46 main
[junit4:junit4] 2> 125124 T468 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@719f8f46 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 125125 T460 C40 P57341 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 125125 T460 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 12
[junit4:junit4] 2> 125130 T494 C39 P33281 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 125131 T494 C39 P33281 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2abc4320 lockFactory=org.apache.lucene.store.NativeFSLockFactory@52d8eb55),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2abc4320 lockFactory=org.apache.lucene.store.NativeFSLockFactory@52d8eb55),segFN=segments_3,generation=3}
[junit4:junit4] 2> 125132 T494 C39 P33281 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 125133 T494 C39 P33281 oass.SolrIndexSearcher.<init> Opening Searcher@4c7b883f main
[junit4:junit4] 2> 125133 T494 C39 P33281 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 125135 T502 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4c7b883f main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 125135 T494 C39 P33281 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:50204/tndz/l/collection1/, StdNode: http://127.0.0.1:53106/tndz/l/collection1/, StdNode: http://127.0.0.1:43174/tndz/l/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 125139 T477 C38 P50204 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 125141 T477 C38 P50204 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@796afcd3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4218b65),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@796afcd3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4218b65),segFN=segments_3,generation=3}
[junit4:junit4] 2> 125141 T477 C38 P50204 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 125142 T477 C38 P50204 oass.SolrIndexSearcher.<init> Opening Searcher@3cc9c60c main
[junit4:junit4] 2> 125143 T477 C38 P50204 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> C36_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53106_tndz%2Fl, base_url=http://127.0.0.1:53106/tndz/l}
[junit4:junit4] 2> 125144 T512 C36 P53106 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 125144 T486 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3cc9c60c main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 125146 T477 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> C37_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:43174_tndz%2Fl, base_url=http://127.0.0.1:43174/tndz/l}
[junit4:junit4] 2> 125146 T527 C37 P43174 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 125147 T512 C36 P53106 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b02d0a5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63ed96d8),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b02d0a5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@63ed96d8),segFN=segments_3,generation=3}
[junit4:junit4] 2> 125147 T527 C37 P43174 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1eedd539 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65f9cb06),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1eedd539 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65f9cb06),segFN=segments_3,generation=3}
[junit4:junit4] 2> 125148 T512 C36 P53106 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 125148 T527 C37 P43174 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 125149 T512 C36 P53106 oass.SolrIndexSearcher.<init> Opening Searcher@38f6fef0 main
[junit4:junit4] 2> 125149 T527 C37 P43174 oass.SolrIndexSearcher.<init> Opening Searcher@254256b1 main
[junit4:junit4] 2> 125150 T512 C36 P53106 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 125151 T535 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@254256b1 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 125150 T518 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@38f6fef0 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 125150 T527 C37 P43174 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 125152 T527 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 125152 T512 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 125153 T494 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 23
[junit4:junit4] 2> 125155 T442 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 125158 T480 C38 P50204 oasc.SolrCore.execute [collection1] webapp=/tndz/l path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 125161 T511 C36 P53106 oasc.SolrCore.execute [collection1] webapp=/tndz/l path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 125164 T493 C39 P33281 oasc.SolrCore.execute [collection1] webapp=/tndz/l path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 125166 T529 C37 P43174 oasc.SolrCore.execute [collection1] webapp=/tndz/l path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 127171 T459 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435344656889020416)} 0 1
[junit4:junit4] 2> 127178 T512 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={update.distrib=FROMLEADER&_version_=-1435344656893214720&update.from=http://127.0.0.1:50204/tndz/l/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435344656893214720)} 0 1
[junit4:junit4] 2> 127182 T528 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={update.distrib=FROMLEADER&_version_=-1435344656897409024&update.from=http://127.0.0.1:33281/tndz/l/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435344656897409024)} 0 1
[junit4:junit4] 2> 127183 T493 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1435344656897409024)} 0 5
[junit4:junit4] 2> 127184 T480 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435344656893214720)} 0 11
[junit4:junit4] 2> 127189 T460 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[a!0 (1435344656907894784)]} 0 1
[junit4:junit4] 2> 127199 T529 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!0 (1435344656914186240)]} 0 1
[junit4:junit4] 2> 127199 T496 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[a!0 (1435344656914186240)]} 0 5
[junit4:junit4] 2> 127203 T458 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[b!1 (1435344656923623424)]} 0 1
[junit4:junit4] 2> 127215 T511 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!1 (1435344656930963456)]} 0 2
[junit4:junit4] 2> 127216 T478 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[b!1 (1435344656930963456)]} 0 6
[junit4:junit4] 2> 127217 T494 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[b!1]} 0 10
[junit4:junit4] 2> 127220 T459 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[c!2 (1435344656941449216)]} 0 0
[junit4:junit4] 2> 127228 T510 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!2 (1435344656945643520)]} 0 1
[junit4:junit4] 2> 127229 T477 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[c!2 (1435344656945643520)]} 0 6
[junit4:junit4] 2> 127233 T457 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[d!3 (1435344656954032128)]} 0 1
[junit4:junit4] 2> 127242 T526 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!3 (1435344656961372160)]} 0 1
[junit4:junit4] 2> 127243 T495 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!3 (1435344656961372160)]} 0 5
[junit4:junit4] 2> 127249 T479 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[d!3]} 0 13
[junit4:junit4] 2> 127252 T460 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[e!4 (1435344656975003648)]} 0 0
[junit4:junit4] 2> 127268 T527 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!4 (1435344656981295104)]} 0 7
[junit4:junit4] 2> 127269 T493 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!4 (1435344656981295104)]} 0 11
[junit4:junit4] 2> 127270 T480 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[e!4]} 0 15
[junit4:junit4] 2> 127274 T458 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[f!5 (1435344656998072320)]} 0 1
[junit4:junit4] 2> 127284 T528 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!5 (1435344657004363776)]} 0 1
[junit4:junit4] 2> 127285 T496 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!5 (1435344657004363776)]} 0 5
[junit4:junit4] 2> 127286 T478 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[f!5]} 0 9
[junit4:junit4] 2> 127290 T459 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[g!6 (1435344657013800960)]} 0 1
[junit4:junit4] 2> 127300 T509 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!6 (1435344657021140992)]} 0 1
[junit4:junit4] 2> 127301 T477 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!6 (1435344657021140992)]} 0 5
[junit4:junit4] 2> 127302 T494 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[g!6]} 0 9
[junit4:junit4] 2> 127306 T457 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[h!7 (1435344657031626752)]} 0 1
[junit4:junit4] 2> 127315 T512 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!7 (1435344657037918208)]} 0 0
[junit4:junit4] 2> 127316 T479 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!7 (1435344657037918208)]} 0 4
[junit4:junit4] 2> 127317 T495 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[h!7]} 0 8
[junit4:junit4] 2> 127321 T460 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[i!8 (1435344657046306816)]} 0 1
[junit4:junit4] 2> 127330 T511 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!8 (1435344657052598272)]} 0 1
[junit4:junit4] 2> 127331 T480 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!8 (1435344657052598272)]} 0 5
[junit4:junit4] 2> 127331 T493 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[i!8]} 0 8
[junit4:junit4] 2> 127335 T458 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[j!9 (1435344657062035456)]} 0 1
[junit4:junit4] 2> 127345 T510 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!9 (1435344657069375488)]} 0 0
[junit4:junit4] 2> 127347 T478 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!9 (1435344657069375488)]} 0 6
[junit4:junit4] 2> 127348 T496 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[j!9]} 0 9
[junit4:junit4] 2> 127351 T459 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[k!10 (1435344657078812672)]} 0 0
[junit4:junit4] 2> 127361 T509 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!10 (1435344657086152704)]} 0 1
[junit4:junit4] 2> 127362 T477 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!10 (1435344657086152704)]} 0 5
[junit4:junit4] 2> 127363 T494 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[k!10]} 0 8
[junit4:junit4] 2> 127367 T457 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[l!11 (1435344657094541312)]} 0 1
[junit4:junit4] 2> 127374 T529 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!11 (1435344657098735616)]} 0 1
[junit4:junit4] 2> 127375 T495 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[l!11 (1435344657098735616)]} 0 5
[junit4:junit4] 2> 127379 T460 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[m!12 (1435344657108172800)]} 0 1
[junit4:junit4] 2> 127387 T526 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!12 (1435344657112367104)]} 0 1
[junit4:junit4] 2> 127388 T493 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[m!12 (1435344657112367104)]} 0 6
[junit4:junit4] 2> 127392 T458 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[n!13 (1435344657120755712)]} 0 1
[junit4:junit4] 2> 127402 T512 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!13 (1435344657129144320)]} 0 1
[junit4:junit4] 2> 127403 T479 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!13 (1435344657129144320)]} 0 5
[junit4:junit4] 2> 127404 T496 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[n!13]} 0 9
[junit4:junit4] 2> 127408 T459 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[o!14 (1435344657137532928)]} 0 1
[junit4:junit4] 2> 127415 T527 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!14 (1435344657141727232)]} 0 1
[junit4:junit4] 2> 127415 T494 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[o!14 (1435344657141727232)]} 0 4
[junit4:junit4] 2> 127419 T457 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[p!15 (1435344657149067264)]} 0 1
[junit4:junit4] 2> 127426 T511 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!15 (1435344657154310144)]} 0 1
[junit4:junit4] 2> 127427 T480 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[p!15 (1435344657154310144)]} 0 5
[junit4:junit4] 2> 127430 T460 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[q!16 (1435344657161650176)]} 0 1
[junit4:junit4] 2> 127437 T510 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!16 (1435344657164795904)]} 0 1
[junit4:junit4] 2> 127437 T478 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[q!16 (1435344657164795904)]} 0 4
[junit4:junit4] 2> 127441 T458 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[r!17 (1435344657172135936)]} 0 1
[junit4:junit4] 2> 127447 T528 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!17 (1435344657176330240)]} 0 1
[junit4:junit4] 2> 127448 T495 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[r!17 (1435344657176330240)]} 0 4
[junit4:junit4] 2> 127452 T459 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[s!18 (1435344657184718848)]} 0 1
[junit4:junit4] 2> 127461 T509 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!18 (1435344657191010304)]} 0 1
[junit4:junit4] 2> 127462 T477 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!18 (1435344657191010304)]} 0 5
[junit4:junit4] 2> 127463 T493 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[s!18]} 0 8
[junit4:junit4] 2> 127467 T457 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[t!19 (1435344657199398912)]} 0 1
[junit4:junit4] 2> 127476 T512 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!19 (1435344657206738944)]} 0 1
[junit4:junit4] 2> 127477 T479 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[t!19 (1435344657206738944)]} 0 5
[junit4:junit4] 2> 127477 T496 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[t!19]} 0 7
[junit4:junit4] 2> 127481 T460 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[u!20 (1435344657215127552)]} 0 1
[junit4:junit4] 2> 127490 T529 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!20 (1435344657221419008)]} 0 1
[junit4:junit4] 2> 127492 T494 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!20 (1435344657221419008)]} 0 6
[junit4:junit4] 2> 127492 T480 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[u!20]} 0 8
[junit4:junit4] 2> 127496 T458 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[v!21 (1435344657229807616)]} 0 1
[junit4:junit4] 2> 127503 T511 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!21 (1435344657235050496)]} 0 0
[junit4:junit4] 2> 127504 T478 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[v!21 (1435344657235050496)]} 0 5
[junit4:junit4] 2> 127508 T459 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[w!22 (1435344657243439104)]} 0 1
[junit4:junit4] 2> 127517 T510 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!22 (1435344657249730560)]} 0 0
[junit4:junit4] 2> 127518 T477 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[w!22 (1435344657249730560)]} 0 5
[junit4:junit4] 2> 127519 T495 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[w!22]} 0 8
[junit4:junit4] 2> 127522 T457 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[x!23 (1435344657258119168)]} 0 0
[junit4:junit4] 2> 127532 T526 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!23 (1435344657264410624)]} 0 1
[junit4:junit4] 2> 127533 T493 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!23 (1435344657264410624)]} 0 5
[junit4:junit4] 2> 127534 T479 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[x!23]} 0 9
[junit4:junit4] 2> 127537 T460 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[y!24 (1435344657273847808)]} 0 0
[junit4:junit4] 2> 127544 T527 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!24 (1435344657276993536)]} 0 1
[junit4:junit4] 2> 127545 T496 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[y!24 (1435344657276993536)]} 0 5
[junit4:junit4] 2> 127548 T459 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[z!25 (1435344657285382144)]} 0 0
[junit4:junit4] 2> 127555 T509 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!25 (1435344657289576448)]} 0 1
[junit4:junit4] 2> 127556 T480 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[z!25 (1435344657289576448)]} 0 5
[junit4:junit4] 2> 127559 T457 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[a!26 (1435344657296916480)]} 0 0
[junit4:junit4] 2> 127566 T528 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!26 (1435344657301110784)]} 0 1
[junit4:junit4] 2> 127567 T494 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[a!26 (1435344657301110784)]} 0 5
[junit4:junit4] 2> 127574 T458 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[b!27 (1435344657311596544)]} 0 1
[junit4:junit4] 2> 127581 T511 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!27 (1435344657316839424)]} 0 0
[junit4:junit4] 2> 127582 T477 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[b!27 (1435344657316839424)]} 0 5
[junit4:junit4] 2> 127586 T460 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[c!28 (1435344657325228032)]} 0 1
[junit4:junit4] 2> 127595 T509 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!28 (1435344657331519488)]} 0 1
[junit4:junit4] 2> 127596 T480 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!28 (1435344657331519488)]} 0 4
[junit4:junit4] 2> 127597 T496 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[c!28]} 0 8
[junit4:junit4] 2> 127600 T459 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[d!29 (1435344657339908096)]} 0 1
[junit4:junit4] 2> 127607 T527 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!29 (1435344657343053824)]} 0 1
[junit4:junit4] 2> 127608 T495 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[d!29 (1435344657343053824)]} 0 5
[junit4:junit4] 2> 127612 T457 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[e!30 (1435344657351442432)]} 0 1
[junit4:junit4] 2> 127621 T529 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!30 (1435344657357733888)]} 0 1
[junit4:junit4] 2> 127622 T493 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!30 (1435344657357733888)]} 0 5
[junit4:junit4] 2> 127623 T478 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[e!30]} 0 8
[junit4:junit4] 2> 127627 T458 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[f!31 (1435344657367171072)]} 0 1
[junit4:junit4] 2> 127633 T528 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!31 (1435344657371365376)]} 0 1
[junit4:junit4] 2> 127635 T494 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[f!31 (1435344657371365376)]} 0 5
[junit4:junit4] 2> 127638 T460 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[g!32 (1435344657379753984)]} 0 1
[junit4:junit4] 2> 127647 T512 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!32 (1435344657386045440)]} 0 0
[junit4:junit4] 2> 127648 T479 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!32 (1435344657386045440)]} 0 4
[junit4:junit4] 2> 127649 T496 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[g!32]} 0 8
[junit4:junit4] 2> 127652 T459 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[h!33 (1435344657394434048)]} 0 0
[junit4:junit4] 2> 127659 T510 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!33 (1435344657398628352)]} 0 0
[junit4:junit4] 2> 127660 T477 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[h!33 (1435344657398628352)]} 0 5
[junit4:junit4] 2> 127664 T457 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[i!34 (1435344657407016960)]} 0 0
[junit4:junit4] 2> 127671 T511 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!34 (1435344657410162688)]} 0 1
[junit4:junit4] 2> 127671 T480 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[i!34 (1435344657410162688)]} 0 4
[junit4:junit4] 2> 127678 T458 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[j!35 (1435344657421697024)]} 0 0
[junit4:junit4] 2> 127685 T509 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!35 (1435344657424842752)]} 0 1
[junit4:junit4] 2> 127686 T478 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[j!35 (1435344657424842752)]} 0 4
[junit4:junit4] 2> 127689 T460 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[k!36 (1435344657433231360)]} 0 1
[junit4:junit4] 2> 127698 T512 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!36 (1435344657439522816)]} 0 1
[junit4:junit4] 2> 127699 T479 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!36 (1435344657439522816)]} 0 5
[junit4:junit4] 2> 127699 T495 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[k!36]} 0 7
[junit4:junit4] 2> 127702 T459 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[l!37 (1435344657446862848)]} 0 0
[junit4:junit4] 2> 127709 T526 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!37 (1435344657451057152)]} 0 1
[junit4:junit4] 2> 127710 T493 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[l!37 (1435344657451057152)]} 0 5
[junit4:junit4] 2> 127714 T457 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[m!38 (1435344657459445760)]} 0 1
[junit4:junit4] 2> 127720 T527 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!38 (1435344657462591488)]} 0 0
[junit4:junit4] 2> 127721 T494 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[m!38 (1435344657462591488)]} 0 4
[junit4:junit4] 2> 127725 T458 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[n!39 (1435344657469931520)]} 0 1
[junit4:junit4] 2> 127733 T510 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!39 (1435344657476222976)]} 0 0
[junit4:junit4] 2> 127734 T477 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!39 (1435344657476222976)]} 0 4
[junit4:junit4] 2> 127735 T496 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[n!39]} 0 7
[junit4:junit4] 2> 127739 T460 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[o!40 (1435344657484611584)]} 0 1
[junit4:junit4] 2> 127749 T529 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!40 (1435344657491951616)]} 0 1
[junit4:junit4] 2> 127750 T495 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!40 (1435344657491951616)]} 0 5
[junit4:junit4] 2> 127751 T480 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[o!40]} 0 9
[junit4:junit4] 2> 127755 T459 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[p!41 (1435344657501388800)]} 0 1
[junit4:junit4] 2> 127766 T511 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!41 (1435344657510825984)]} 0 0
[junit4:junit4] 2> 127767 T478 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[p!41 (1435344657510825984)]} 0 4
[junit4:junit4] 2> 127771 T457 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[q!42 (1435344657519214592)]} 0 1
[junit4:junit4] 2> 127780 T509 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!42 (1435344657525506048)]} 0 0
[junit4:junit4] 2> 127781 T479 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!42 (1435344657525506048)]} 0 4
[junit4:junit4] 2> 127782 T493 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[q!42]} 0 8
[junit4:junit4] 2> 127786 T458 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[r!43 (1435344657533894656)]} 0 1
[junit4:junit4] 2> 127793 T528 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!43 (1435344657538088960)]} 0 1
[junit4:junit4] 2> 127794 T494 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[r!43 (1435344657538088960)]} 0 5
[junit4:junit4] 2> 127798 T460 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[s!44 (1435344657546477568)]} 0 1
[junit4:junit4] 2> 127807 T512 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!44 (1435344657552769024)]} 0 1
[junit4:junit4] 2> 127808 T477 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!44 (1435344657552769024)]} 0 5
[junit4:junit4] 2> 127808 T496 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[s!44]} 0 7
[junit4:junit4] 2> 127812 T459 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[t!45 (1435344657562206208)]} 0 1
[junit4:junit4] 2> 127819 T510 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!45 (1435344657566400512)]} 0 1
[junit4:junit4] 2> 127820 T480 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[t!45 (1435344657566400512)]} 0 5
[junit4:junit4] 2> 127823 T457 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[u!46 (1435344657573740544)]} 0 1
[junit4:junit4] 2> 127833 T526 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!46 (1435344657581080576)]} 0 1
[junit4:junit4] 2> 127834 T495 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[u!46 (1435344657581080576)]} 0 5
[junit4:junit4] 2> 127835 T478 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[u!46]} 0 9
[junit4:junit4] 2> 127838 T458 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[v!47 (1435344657589469184)]} 0 0
[junit4:junit4] 2> 127847 T511 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!47 (1435344657595760640)]} 0 0
[junit4:junit4] 2> 127848 T479 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[v!47 (1435344657595760640)]} 0 4
[junit4:junit4] 2> 127849 T493 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[v!47]} 0 8
[junit4:junit4] 2> 127852 T460 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[w!48 (1435344657604149248)]} 0 1
[junit4:junit4] 2> 127861 T509 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!48 (1435344657610440704)]} 0 1
[junit4:junit4] 2> 127862 T477 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[w!48 (1435344657610440704)]} 0 4
[junit4:junit4] 2> 127862 T494 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[w!48]} 0 7
[junit4:junit4] 2> 127867 T459 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[x!49 (1435344657618829312)]} 0 1
[junit4:junit4] 2> 127876 T527 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!49 (1435344657626169344)]} 0 1
[junit4:junit4] 2> 127877 T496 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!49 (1435344657626169344)]} 0 5
[junit4:junit4] 2> 127878 T480 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[x!49]} 0 8
[junit4:junit4] 2> 127882 T457 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[y!50 (1435344657634557952)]} 0 1
[junit4:junit4] 2> 127889 T529 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!50 (1435344657639800832)]} 0 0
[junit4:junit4] 2> 127890 T495 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[y!50 (1435344657639800832)]} 0 5
[junit4:junit4] 2> 127895 T458 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[z!51 (1435344657648189440)]} 0 2
[junit4:junit4] 2> 127906 T512 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!51 (1435344657656578048)]} 0 1
[junit4:junit4] 2> 127907 T478 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[z!51 (1435344657656578048)]} 0 5
[junit4:junit4] 2> 127909 T493 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[z!51]} 0 11
[junit4:junit4] 2> 127915 T460 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[a!52 (1435344657670209536)]} 0 3
[junit4:junit4] 2> 127923 T528 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!52 (1435344657674403840)]} 0 1
[junit4:junit4] 2> 127924 T494 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[a!52 (1435344657674403840)]} 0 5
[junit4:junit4] 2> 127927 T459 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[b!53 (1435344657682792448)]} 0 1
[junit4:junit4] 2> 127934 T510 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!53 (1435344657685938176)]} 0 1
[junit4:junit4] 2> 127935 T479 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[b!53 (1435344657685938176)]} 0 5
[junit4:junit4] 2> 127939 T457 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[c!54 (1435344657695375360)]} 0 0
[junit4:junit4] 2> 127949 T511 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!54 (1435344657701666816)]} 0 1
[junit4:junit4] 2> 127950 T477 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!54 (1435344657701666816)]} 0 5
[junit4:junit4] 2> 127950 T496 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[c!54]} 0 8
[junit4:junit4] 2> 127954 T460 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[d!55 (1435344657711104000)]} 0 1
[junit4:junit4] 2> 127962 T526 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!55 (1435344657715298304)]} 0 1
[junit4:junit4] 2> 127963 T495 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[d!55 (1435344657715298304)]} 0 6
[junit4:junit4] 2> 127967 T459 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[e!56 (1435344657724735488)]} 0 0
[junit4:junit4] 2> 127980 T527 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!56 (1435344657734172672)]} 0 1
[junit4:junit4] 2> 127981 T496 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!56 (1435344657734172672)]} 0 5
[junit4:junit4] 2> 127983 T478 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[e!56]} 0 9
[junit4:junit4] 2> 127986 T458 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[f!57 (1435344657744658432)]} 0 1
[junit4:junit4] 2> 127995 T528 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!57 (1435344657750949888)]} 0 1
[junit4:junit4] 2> 127996 T495 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!57 (1435344657750949888)]} 0 4
[junit4:junit4] 2> 127997 T477 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[f!57]} 0 8
[junit4:junit4] 2> 128001 T460 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[g!58 (1435344657759338496)]} 0 1
[junit4:junit4] 2> 128010 T512 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!58 (1435344657765629952)]} 0 1
[junit4:junit4] 2> 128011 T480 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!58 (1435344657765629952)]} 0 5
[junit4:junit4] 2> 128012 T493 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[g!58]} 0 8
[junit4:junit4] 2> 128015 T459 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[h!59 (1435344657775067136)]} 0 1
[junit4:junit4] 2> 128021 T511 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!59 (1435344657778212864)]} 0 1
[junit4:junit4] 2> 128022 T478 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[h!59 (1435344657778212864)]} 0 4
[junit4:junit4] 2> 128025 T458 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[i!60 (1435344657785552896)]} 0 1
[junit4:junit4] 2> 128032 T509 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!60 (1435344657789747200)]} 0 1
[junit4:junit4] 2> 128033 T479 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[i!60 (1435344657789747200)]} 0 5
[junit4:junit4] 2> 128036 T457 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[j!61 (1435344657797087232)]} 0 0
[junit4:junit4] 2> 128046 T512 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!61 (1435344657803378688)]} 0 1
[junit4:junit4] 2> 128047 T477 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!61 (1435344657803378688)]} 0 5
[junit4:junit4] 2> 128048 T494 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[j!61]} 0 9
[junit4:junit4] 2> 128051 T460 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[k!62 (1435344657812815872)]} 0 0
[junit4:junit4] 2> 128058 T510 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!62 (1435344657817010176)]} 0 1
[junit4:junit4] 2> 128059 T480 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[k!62 (1435344657817010176)]} 0 5
[junit4:junit4] 2> 128064 T459 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[l!63 (1435344657826447360)]} 0 1
[junit4:junit4] 2> 128074 T526 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!63 (1435344657833787392)]} 0 0
[junit4:junit4] 2> 128076 T496 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!63 (1435344657833787392)]} 0 6
[junit4:junit4] 2> 128077 T478 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[l!63]} 0 9
[junit4:junit4] 2> 128082 T458 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[m!64 (1435344657844273152)]} 0 2
[junit4:junit4] 2> 128090 T529 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!64 (1435344657849516032)]} 0 1
[junit4:junit4] 2> 128091 T495 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[m!64 (1435344657849516032)]} 0 5
[junit4:junit4] 2> 128095 T457 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[n!65 (1435344657858953216)]} 0 1
[junit4:junit4] 2> 128102 T511 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!65 (1435344657862098944)]} 0 1
[junit4:junit4] 2> 128103 T479 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[n!65 (1435344657862098944)]} 0 5
[junit4:junit4] 2> 128106 T460 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[o!66 (1435344657870487552)]} 0 0
[junit4:junit4] 2> 128113 T527 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!66 (1435344657874681856)]} 0 1
[junit4:junit4] 2> 128114 T493 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[o!66 (1435344657874681856)]} 0 5
[junit4:junit4] 2> 128119 T459 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[p!67 (1435344657883070464)]} 0 1
[junit4:junit4] 2> 128127 T509 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!67 (1435344657888313344)]} 0 1
[junit4:junit4] 2> 128128 T477 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[p!67 (1435344657888313344)]} 0 6
[junit4:junit4] 2> 128132 T458 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[q!68 (1435344657896701952)]} 0 1
[junit4:junit4] 2> 128142 T512 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!68 (1435344657904041984)]} 0 1
[junit4:junit4] 2> 128143 T480 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!68 (1435344657904041984)]} 0 5
[junit4:junit4] 2> 128144 T494 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[q!68]} 0 9
[junit4:junit4] 2> 128147 T457 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[r!69 (1435344657913479168)]} 0 1
[junit4:junit4] 2> 128154 T528 C37 P43174 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!69 (1435344657916624896)]} 0 1
[junit4:junit4] 2> 128156 T496 C39 P33281 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[r!69 (1435344657916624896)]} 0 6
[junit4:junit4] 2> 128159 T460 C40 P57341 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={wt=javabin&version=2} {add=[s!70 (1435344657926062080)]} 0 0
[junit4:junit4] 2> 128170 T510 C36 P53106 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:50204/tndz/l/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!70 (1435344657933402112)]} 0 1
[junit4:junit4] 2> 128171 T478 C38 P50204 oasup.LogUpdateProcessor.finish [collection1] webapp=/tndz/l path=/update params={distrib.from=http://127.0.0.1:33281/tndz/l/collectio
[...truncated too long message...]
68851324799/collection1_shard1_1_replica2/data
[junit4:junit4] 2> 314061 T442 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368851324799/collection1_shard1_1_replica2/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368851324799/collection1_shard1_1_replica2/data/index;done=false>>]
[junit4:junit4] 2> 314061 T442 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-jetty4-1368851324799/collection1_shard1_1_replica2/data/index
[junit4:junit4] 2> 314062 T587 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89709039352938508-127.0.0.1:43174_tndz%2Fl-n_0000000004) am no longer a leader.
[junit4:junit4] 2> 314064 T572 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 314064 T533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 314065 T533 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 314065 T533 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 314067 T572 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4:junit4] 2> 314088 T442 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/tndz/l,null}
[junit4:junit4] 2> 314144 T442 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 314146 T442 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:37908 37908
[junit4:junit4] 2> 314251 T572 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5ed8f8ec name:ZooKeeperConnection Watcher:127.0.0.1:37908/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4:junit4] 2> 314251 T572 oascc.ConnectionManager.process Client->ZooKeeper status change trigger but we are already closed
[junit4:junit4] 2> 314252 T442 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 57341
[junit4:junit4] 2> !!!! WARNING: best effort to remove /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ShardSplitTest-1368851308480 FAILED !!!!!
[junit4:junit4] 2> 314252 T442 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 314253 T442 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:37908 37908
[junit4:junit4] 1> /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:50204_tndz%2Fl",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:50204/tndz/l"}
[junit4:junit4] 1> /solr/collections/collection1/leaders/shard1_0 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"collection1_shard1_0_replica1",
[junit4:junit4] 1> "node_name":"127.0.0.1:50204_tndz%2Fl",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:50204/tndz/l"}
[junit4:junit4] 1> /solr/collections/collection1/leaders/shard1_1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"collection1_shard1_1_replica1",
[junit4:junit4] 1> "node_name":"127.0.0.1:50204_tndz%2Fl",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:50204/tndz/l"}
[junit4:junit4] 1> /solr/collections/collection1/leaders/shard2 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:33281_tndz%2Fl",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:33281/tndz/l"}
[junit4:junit4] 1> /solr/collections/control_collection (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/control_collection/shards (0)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election/89709039352938499-127.0.0.1:57341_tndz%2Fl_collection1-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/control_collection/leaders (1)
[junit4:junit4] 1> /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:57341_tndz%2Fl",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:57341/tndz/l"}
[junit4:junit4] 1> /solr/overseer_elect (2)
[junit4:junit4] 1> /solr/overseer_elect/election (5)
[junit4:junit4] 1> /solr/overseer_elect/election/89709039352938506-127.0.0.1:53106_tndz%2Fl-n_0000000003 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89709039352938508-127.0.0.1:43174_tndz%2Fl-n_0000000004 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89709039352938502-127.0.0.1:50204_tndz%2Fl-n_0000000001 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89709039352938504-127.0.0.1:33281_tndz%2Fl-n_0000000002 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89709039352938499-127.0.0.1:57341_tndz%2Fl-n_0000000000 (0)
[junit4:junit4] 1> /solr/overseer_elect/leader (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"id":"89709039352938499-127.0.0.1:57341_tndz%2Fl-n_0000000000"}
[junit4:junit4] 1> /zookeeper (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ShardSplitTest -Dtests.method=testDistribSearch -Dtests.seed=5EED0D812EEE1723 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=de_DE -Dtests.timezone=Australia/LHI -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 213s J0 | ShardSplitTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: Wrong doc count on shard1_0 expected:<417> but was:<416>
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([5EED0D812EEE1723:DF0B839959B1771F]:0)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.checkDocCountsAndShardStates(ShardSplitTest.java:166)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:142)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 314270 T442 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 213096 T441 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=216), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=216)), sim=DefaultSimilarity, locale=de_DE, timezone=Australia/LHI
[junit4:junit4] 2> NOTE: Linux 3.2.0-41-generic amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=8,threads=1,free=52789496,total=126484480
[junit4:junit4] 2> NOTE: All tests run in this JVM: [CSVRequestHandlerTest, ResponseLogComponentTest, QueryElevationComponentTest, TestLFUCache, SchemaVersionSpecificBehaviorTest, LegacyHTMLStripCharFilterTest, SearchHandlerTest, CacheHeaderTest, TestQuerySenderListener, TestSolrDeletionPolicy1, MinimalSchemaTest, WordBreakSolrSpellCheckerTest, TestSolrQueryParser, TestCoreContainer, AliasIntegrationTest, DistributedSpellCheckComponentTest, SimpleFacetsTest, AlternateDirectoryTest, BadCopyFieldTest, LukeRequestHandlerTest, TestPHPSerializedResponseWriter, QueryResultKeyTest, PreAnalyzedUpdateProcessorTest, ScriptEngineTest, JsonLoaderTest, ShardSplitTest]
[junit4:junit4] Completed on J0 in 214.13s, 1 test, 1 failure <<< FAILURES!
[...truncated 643 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:377: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:357: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:437: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1240: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:884: There were test failures: 295 suites, 1231 tests, 1 failure, 13 ignored (7 assumptions)
Total time: 37 minutes 59 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_21 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure