You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/06/21 11:40:00 UTC
[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 4080 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/4080/
1 tests failed.
REGRESSION: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
shard1 is not consistent. Got 305 from http://127.0.0.1:14331/b/collection1lastClient and got 245 from http://127.0.0.1:14366/b/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:14331/b/collection1lastClient and got 245 from http://127.0.0.1:14366/b/collection1
at __randomizedtesting.SeedInfo.seed([F9C993BC192946A7:782F1DA46E76269B]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1018)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9728 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4] 2> 1054563 T2815 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /b/
[junit4:junit4] 2> 1054571 T2815 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1371806763276
[junit4:junit4] 2> 1054573 T2815 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 1054573 T2816 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 1054674 T2815 oasc.ZkTestServer.run start zk server on port:14306
[junit4:junit4] 2> 1054675 T2815 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1054680 T2822 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@da7a4ae name:ZooKeeperConnection Watcher:127.0.0.1:14306 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1054681 T2815 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1054681 T2815 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 1054685 T2815 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1054695 T2824 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7aa22786 name:ZooKeeperConnection Watcher:127.0.0.1:14306/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1054695 T2815 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1054696 T2815 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 1054699 T2815 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 1054707 T2815 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 1054709 T2815 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 1054712 T2815 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1054713 T2815 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1054718 T2815 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 1054718 T2815 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 1054822 T2815 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1054824 T2815 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1054826 T2815 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 1054827 T2815 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 1054838 T2815 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 1054839 T2815 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 1054842 T2815 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1054843 T2815 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1054845 T2815 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1054846 T2815 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1054849 T2815 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1054850 T2815 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1054857 T2815 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1054858 T2815 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1055127 T2815 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1055132 T2815 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:14311
[junit4:junit4] 2> 1055137 T2815 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1055138 T2815 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1055139 T2815 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371806763566
[junit4:junit4] 2> 1055140 T2815 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371806763566/solr.xml
[junit4:junit4] 2> 1055140 T2815 oasc.CoreContainer.<init> New CoreContainer 1799446609
[junit4:junit4] 2> 1055141 T2815 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371806763566/'
[junit4:junit4] 2> 1055142 T2815 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371806763566/'
[junit4:junit4] 2> 1055276 T2815 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1055277 T2815 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1055278 T2815 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1055279 T2815 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1055279 T2815 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1055280 T2815 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1055280 T2815 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1055281 T2815 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1055281 T2815 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1055282 T2815 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1055298 T2815 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1055299 T2815 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:14306/solr
[junit4:junit4] 2> 1055300 T2815 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1055301 T2815 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1055304 T2835 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@29f634e0 name:ZooKeeperConnection Watcher:127.0.0.1:14306 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1055305 T2815 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1055374 T2815 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1055385 T2815 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1055428 T2837 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14ec0d95 name:ZooKeeperConnection Watcher:127.0.0.1:14306/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1055428 T2815 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1055474 T2815 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 1055509 T2815 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 1055513 T2815 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 1055567 T2815 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:14311_b
[junit4:junit4] 2> 1055576 T2815 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:14311_b
[junit4:junit4] 2> 1055585 T2815 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 1055599 T2815 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 1055612 T2815 oasc.Overseer.start Overseer (id=89902728038711299-127.0.0.1:14311_b-n_0000000000) starting
[junit4:junit4] 2> 1055631 T2815 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 1055648 T2839 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 1055649 T2815 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 1055657 T2815 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 1055667 T2815 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1055669 T2838 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 1055674 T2840 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1055674 T2840 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1057173 T2838 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1057174 T2838 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:14311_b",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:14311/b"}
[junit4:junit4] 2> 1057174 T2838 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1057175 T2838 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1057191 T2837 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1057678 T2840 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371806763566/collection1
[junit4:junit4] 2> 1057678 T2840 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 1057679 T2840 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1057679 T2840 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 1057681 T2840 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371806763566/collection1/'
[junit4:junit4] 2> 1057682 T2840 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1371806763566/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1057683 T2840 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1371806763566/collection1/lib/README' to classloader
[junit4:junit4] 2> 1057737 T2840 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1057800 T2840 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1057901 T2840 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1057909 T2840 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1058650 T2840 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1058666 T2840 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1058670 T2840 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1058684 T2840 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1058690 T2840 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1058694 T2840 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1058708 T2840 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1058709 T2840 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1058709 T2840 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1058710 T2840 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1058711 T2840 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1058711 T2840 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 1058711 T2840 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371806763566/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371806763275/control/data/
[junit4:junit4] 2> 1058712 T2840 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@552d7308
[junit4:junit4] 2> 1058712 T2840 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 1058714 T2840 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/control/data
[junit4:junit4] 2> 1058715 T2840 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371806763275/control/data/index/
[junit4:junit4] 2> 1058716 T2840 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371806763275/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1058718 T2840 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/control/data/index
[junit4:junit4] 2> 1058727 T2840 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@70e63ee0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1058728 T2840 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1058732 T2840 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1058732 T2840 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1058733 T2840 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1058734 T2840 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1058734 T2840 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1058735 T2840 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1058735 T2840 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1058736 T2840 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1058736 T2840 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1058758 T2840 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1058771 T2840 oass.SolrIndexSearcher.<init> Opening Searcher@6253ad0f main
[junit4:junit4] 2> 1058773 T2840 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1058773 T2840 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1058777 T2841 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6253ad0f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1058779 T2840 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1058779 T2840 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:14311/b collection:control_collection shard:shard1
[junit4:junit4] 2> 1058780 T2840 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 1058797 T2840 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1058800 T2840 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1058800 T2840 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1058800 T2840 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:14311/b/collection1/
[junit4:junit4] 2> 1058801 T2840 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1058801 T2840 oasc.SyncStrategy.syncToMe http://127.0.0.1:14311/b/collection1/ has no replicas
[junit4:junit4] 2> 1058801 T2840 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:14311/b/collection1/
[junit4:junit4] 2> 1058802 T2840 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 1060210 T2838 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1060292 T2837 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1060455 T2840 oasc.ZkController.register We are http://127.0.0.1:14311/b/collection1/ and leader is http://127.0.0.1:14311/b/collection1/
[junit4:junit4] 2> 1060455 T2840 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:14311/b
[junit4:junit4] 2> 1060455 T2840 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1060456 T2840 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1060456 T2840 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1060584 T2840 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1060585 T2815 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1060586 T2815 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1060587 T2815 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1060604 T2815 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 1060606 T2815 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1060632 T2844 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e157c90 name:ZooKeeperConnection Watcher:127.0.0.1:14306/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1060632 T2815 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1060634 T2815 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1060636 T2815 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 1060895 T2815 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1060898 T2815 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:14331
[junit4:junit4] 2> 1060899 T2815 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1060900 T2815 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1060900 T2815 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371806769340
[junit4:junit4] 2> 1060901 T2815 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371806769340/solr.xml
[junit4:junit4] 2> 1060901 T2815 oasc.CoreContainer.<init> New CoreContainer 1121662003
[junit4:junit4] 2> 1060902 T2815 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371806769340/'
[junit4:junit4] 2> 1060903 T2815 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371806769340/'
[junit4:junit4] 2> 1061035 T2815 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1061036 T2815 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1061037 T2815 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1061037 T2815 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1061038 T2815 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1061038 T2815 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1061039 T2815 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1061039 T2815 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1061040 T2815 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1061041 T2815 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1061056 T2815 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1061057 T2815 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:14306/solr
[junit4:junit4] 2> 1061057 T2815 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1061059 T2815 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1061066 T2855 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b9c523d name:ZooKeeperConnection Watcher:127.0.0.1:14306 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1061066 T2815 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1061074 T2815 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1061084 T2815 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1061086 T2857 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@49c968f name:ZooKeeperConnection Watcher:127.0.0.1:14306/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1061087 T2815 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1061103 T2815 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1061911 T2838 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1061912 T2838 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:14311_b",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:14311/b"}
[junit4:junit4] 2> 1061960 T2857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1061960 T2844 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1061960 T2837 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1062107 T2815 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:14331_b
[junit4:junit4] 2> 1062109 T2815 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:14331_b
[junit4:junit4] 2> 1062111 T2857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1062111 T2837 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1062111 T2844 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1062111 T2844 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1062112 T2857 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1062120 T2837 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1062126 T2858 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1062126 T2858 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1063463 T2838 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1063464 T2838 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:14331_b",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:14331/b"}
[junit4:junit4] 2> 1063464 T2838 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 1063465 T2838 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1063480 T2837 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1063480 T2857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1063480 T2844 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1064130 T2858 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371806769340/collection1
[junit4:junit4] 2> 1064130 T2858 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1064131 T2858 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1064131 T2858 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1064133 T2858 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371806769340/collection1/'
[junit4:junit4] 2> 1064134 T2858 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1371806769340/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1064135 T2858 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1371806769340/collection1/lib/README' to classloader
[junit4:junit4] 2> 1064189 T2858 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1064250 T2858 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1064351 T2858 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1064358 T2858 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1064992 T2858 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1065006 T2858 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1065010 T2858 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1065024 T2858 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1065029 T2858 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1065033 T2858 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1065034 T2858 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1065035 T2858 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1065035 T2858 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1065036 T2858 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1065037 T2858 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1065037 T2858 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 1065037 T2858 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371806769340/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty1/
[junit4:junit4] 2> 1065038 T2858 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@552d7308
[junit4:junit4] 2> 1065038 T2858 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 1065039 T2858 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty1
[junit4:junit4] 2> 1065040 T2858 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty1/index/
[junit4:junit4] 2> 1065041 T2858 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1065042 T2858 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty1/index
[junit4:junit4] 2> 1065049 T2858 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d61da22; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1065050 T2858 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1065053 T2858 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1065054 T2858 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1065054 T2858 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1065055 T2858 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1065056 T2858 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1065056 T2858 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1065057 T2858 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1065057 T2858 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1065058 T2858 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1065074 T2858 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1065084 T2858 oass.SolrIndexSearcher.<init> Opening Searcher@3546f508 main
[junit4:junit4] 2> 1065085 T2858 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1065086 T2858 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1065090 T2859 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3546f508 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1065092 T2858 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1065092 T2858 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:14331/b collection:collection1 shard:shard1
[junit4:junit4] 2> 1065093 T2858 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 1065114 T2858 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1065123 T2858 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1065124 T2858 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1065124 T2858 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:14331/b/collection1/
[junit4:junit4] 2> 1065124 T2858 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1065125 T2858 oasc.SyncStrategy.syncToMe http://127.0.0.1:14331/b/collection1/ has no replicas
[junit4:junit4] 2> 1065125 T2858 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:14331/b/collection1/
[junit4:junit4] 2> 1065125 T2858 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1066486 T2838 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1066504 T2837 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1066504 T2857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1066504 T2844 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1066522 T2858 oasc.ZkController.register We are http://127.0.0.1:14331/b/collection1/ and leader is http://127.0.0.1:14331/b/collection1/
[junit4:junit4] 2> 1066522 T2858 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:14331/b
[junit4:junit4] 2> 1066523 T2858 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1066523 T2858 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1066523 T2858 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1066525 T2858 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1066526 T2815 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1066527 T2815 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1066528 T2815 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1066902 T2815 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1066906 T2815 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:14356
[junit4:junit4] 2> 1066907 T2815 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1066907 T2815 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1066908 T2815 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371806775250
[junit4:junit4] 2> 1066909 T2815 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371806775250/solr.xml
[junit4:junit4] 2> 1066909 T2815 oasc.CoreContainer.<init> New CoreContainer 1915732089
[junit4:junit4] 2> 1066910 T2815 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371806775250/'
[junit4:junit4] 2> 1066910 T2815 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371806775250/'
[junit4:junit4] 2> 1067075 T2815 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1067076 T2815 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1067076 T2815 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1067077 T2815 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1067077 T2815 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1067078 T2815 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1067078 T2815 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1067079 T2815 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1067080 T2815 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1067080 T2815 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1067099 T2815 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1067100 T2815 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:14306/solr
[junit4:junit4] 2> 1067100 T2815 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1067102 T2815 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1067129 T2871 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5d06bf46 name:ZooKeeperConnection Watcher:127.0.0.1:14306 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1067130 T2815 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1067133 T2815 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1067141 T2815 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1067143 T2873 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@374422d8 name:ZooKeeperConnection Watcher:127.0.0.1:14306/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1067144 T2815 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1067155 T2815 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1068015 T2838 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1068016 T2838 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:14331_b",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:14331/b"}
[junit4:junit4] 2> 1068052 T2873 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1068053 T2837 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1068053 T2844 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1068052 T2857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1068159 T2815 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:14356_b
[junit4:junit4] 2> 1068161 T2815 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:14356_b
[junit4:junit4] 2> 1068163 T2857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1068163 T2837 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1068163 T2873 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1068163 T2844 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1068164 T2873 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1068164 T2844 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1068164 T2857 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1068172 T2837 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1068178 T2874 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1068179 T2874 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1069556 T2838 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1069557 T2838 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:14356_b",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:14356/b"}
[junit4:junit4] 2> 1069557 T2838 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 1069558 T2838 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1069580 T2844 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1069580 T2873 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1069580 T2837 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1069580 T2857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1070182 T2874 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371806775250/collection1
[junit4:junit4] 2> 1070182 T2874 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1070183 T2874 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1070183 T2874 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1070185 T2874 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371806775250/collection1/'
[junit4:junit4] 2> 1070186 T2874 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1371806775250/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1070187 T2874 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1371806775250/collection1/lib/README' to classloader
[junit4:junit4] 2> 1070243 T2874 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1070305 T2874 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1070406 T2874 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1070413 T2874 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1071072 T2874 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1071087 T2874 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1071092 T2874 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1071106 T2874 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1071112 T2874 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1071117 T2874 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1071119 T2874 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1071121 T2874 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1071121 T2874 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1071123 T2874 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1071124 T2874 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1071124 T2874 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 1071125 T2874 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371806775250/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty2/
[junit4:junit4] 2> 1071125 T2874 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@552d7308
[junit4:junit4] 2> 1071126 T2874 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 1071128 T2874 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty2
[junit4:junit4] 2> 1071129 T2874 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty2/index/
[junit4:junit4] 2> 1071130 T2874 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1071131 T2874 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty2/index
[junit4:junit4] 2> 1071138 T2874 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@362a9f71; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1071138 T2874 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1071142 T2874 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1071142 T2874 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1071143 T2874 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1071144 T2874 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1071144 T2874 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1071145 T2874 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1071145 T2874 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1071146 T2874 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1071146 T2874 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1071167 T2874 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1071179 T2874 oass.SolrIndexSearcher.<init> Opening Searcher@7263f98d main
[junit4:junit4] 2> 1071180 T2874 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1071180 T2874 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1071185 T2875 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7263f98d main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1071187 T2874 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1071187 T2874 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:14356/b collection:collection1 shard:shard1
[junit4:junit4] 2> 1071190 T2874 oasc.ZkController.register We are http://127.0.0.1:14356/b/collection1/ and leader is http://127.0.0.1:14331/b/collection1/
[junit4:junit4] 2> 1071190 T2874 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:14356/b
[junit4:junit4] 2> 1071190 T2874 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1071191 T2874 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1099 name=collection1 org.apache.solr.core.SolrCore@5db972ef url=http://127.0.0.1:14356/b/collection1 node=127.0.0.1:14356_b C1099_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:14356_b, base_url=http://127.0.0.1:14356/b}
[junit4:junit4] 2> 1071191 T2876 C1099 P14356 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1071191 T2874 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1071192 T2876 C1099 P14356 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1071192 T2876 C1099 P14356 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1071192 T2876 C1099 P14356 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1071193 T2815 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1071193 T2815 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1071194 T2876 C1099 P14356 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1071194 T2815 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1071216 T2847 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 3, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1071523 T2815 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1071526 T2815 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:14366
[junit4:junit4] 2> 1071526 T2815 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1071527 T2815 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1071528 T2815 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371806779919
[junit4:junit4] 2> 1071528 T2815 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371806779919/solr.xml
[junit4:junit4] 2> 1071529 T2815 oasc.CoreContainer.<init> New CoreContainer 1153779505
[junit4:junit4] 2> 1071529 T2815 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371806779919/'
[junit4:junit4] 2> 1071530 T2815 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371806779919/'
[junit4:junit4] 2> 1071679 T2815 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1071680 T2815 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1071681 T2815 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1071681 T2815 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1071682 T2815 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1071682 T2815 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1071683 T2815 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1071683 T2815 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1071684 T2815 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1071684 T2815 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1071702 T2815 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1071703 T2815 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:14306/solr
[junit4:junit4] 2> 1071704 T2815 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1071705 T2815 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1071707 T2888 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@291696d3 name:ZooKeeperConnection Watcher:127.0.0.1:14306 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1071709 T2815 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1071711 T2815 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1071723 T2815 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1071725 T2890 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@37dabbe2 name:ZooKeeperConnection Watcher:127.0.0.1:14306/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1071725 T2815 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1071737 T2815 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1072586 T2838 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1072587 T2838 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:14356_b",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:14356/b"}
[junit4:junit4] 2> 1072631 T2890 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1072631 T2837 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1072631 T2857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1072631 T2873 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1072631 T2844 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1072740 T2815 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:14366_b
[junit4:junit4] 2> 1072742 T2815 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:14366_b
[junit4:junit4] 2> 1072744 T2890 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1072744 T2837 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1072744 T2857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1072744 T2873 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1072744 T2844 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1072745 T2873 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1072745 T2890 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1072745 T2844 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1072753 T2837 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1072753 T2857 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1072759 T2891 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1072759 T2891 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1073219 T2847 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 3, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 1073219 T2847 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=3&state=recovering&nodeName=127.0.0.1:14356_b&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 1074135 T2838 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1074136 T2838 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:14366_b",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:14366/b"}
[junit4:junit4] 2> 1074136 T2838 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 1074137 T2838 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1074166 T2890 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1074166 T2873 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1074166 T2837 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1074166 T2857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1074166 T2844 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1074763 T2891 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371806779919/collection1
[junit4:junit4] 2> 1074763 T2891 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1074764 T2891 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1074764 T2891 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1074766 T2891 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371806779919/collection1/'
[junit4:junit4] 2> 1074767 T2891 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1371806779919/collection1/lib/README' to classloader
[junit4:junit4] 2> 1074768 T2891 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1371806779919/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1074823 T2891 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1074884 T2891 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1074985 T2891 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1074992 T2891 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C1100 name=collection1 org.apache.solr.core.SolrCore@5db972ef url=http://127.0.0.1:14356/b/collection1 node=127.0.0.1:14356_b C1100_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:14356_b, base_url=http://127.0.0.1:14356/b}
[junit4:junit4] 2> 1075221 T2876 C1100 P14356 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:14331/b/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1075221 T2876 C1100 P14356 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:14356/b START replicas=[http://127.0.0.1:14331/b/collection1/] nUpdates=100
[junit4:junit4] 2> 1075222 T2876 C1100 P14356 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1075222 T2876 C1100 P14356 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1075223 T2876 C1100 P14356 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1075223 T2876 C1100 P14356 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1075223 T2876 C1100 P14356 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1075223 T2876 C1100 P14356 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:14331/b/collection1/. core=collection1
[junit4:junit4] 2> 1075224 T2876 C1100 P14356 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C1101 name=collection1 org.apache.solr.core.SolrCore@6513bc9f url=http://127.0.0.1:14331/b/collection1 node=127.0.0.1:14331_b C1101_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:14331_b, base_url=http://127.0.0.1:14331/b, leader=true}
[junit4:junit4] 2> 1075232 T2848 C1101 P14331 oasc.SolrCore.execute [collection1] webapp=/b path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1075236 T2849 C1101 P14331 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1075242 T2849 C1101 P14331 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d61da22; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1075243 T2849 C1101 P14331 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1075289 T2849 C1101 P14331 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d61da22; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d61da22; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1075290 T2849 C1101 P14331 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1075292 T2849 C1101 P14331 oass.SolrIndexSearcher.<init> Opening Searcher@288c2c89 realtime
[junit4:junit4] 2> 1075292 T2849 C1101 P14331 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1075293 T2849 C1101 P14331 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 57
[junit4:junit4] 2> 1075294 T2876 C1100 P14356 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1075294 T2876 C1100 P14356 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1075297 T2850 C1101 P14331 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1075298 T2850 C1101 P14331 oasc.SolrCore.execute [collection1] webapp=/b path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 1075298 T2876 C1100 P14356 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1075299 T2876 C1100 P14356 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1075299 T2876 C1100 P14356 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1075302 T2850 C1101 P14331 oasc.SolrCore.execute [collection1] webapp=/b path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 1075303 T2876 C1100 P14356 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1075304 T2876 C1100 P14356 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty2/index.20130621042624007
[junit4:junit4] 2> 1075305 T2876 C1100 P14356 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty2/index.20130621042624007 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4a66875b; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 1075309 T2850 C1101 P14331 oasc.SolrCore.execute [collection1] webapp=/b path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1075311 T2876 C1100 P14356 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1075313 T2876 C1100 P14356 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1075314 T2876 C1100 P14356 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1075319 T2876 C1100 P14356 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@362a9f71; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@362a9f71; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1075320 T2876 C1100 P14356 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1075320 T2876 C1100 P14356 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1075322 T2876 C1100 P14356 oass.SolrIndexSearcher.<init> Opening Searcher@1fc9a6ad main
[junit4:junit4] 2> 1075323 T2875 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1fc9a6ad main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1075323 T2876 C1100 P14356 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty2/index.20130621042624007 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty2/index.20130621042624007;done=true>>]
[junit4:junit4] 2> 1075323 T2876 C1100 P14356 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty2/index.20130621042624007
[junit4:junit4] 2> 1075324 T2876 C1100 P14356 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty2/index.20130621042624007
[junit4:junit4] 2> 1075325 T2876 C1100 P14356 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1075325 T2876 C1100 P14356 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1075325 T2876 C1100 P14356 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1075326 T2876 C1100 P14356 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1075358 T2876 C1100 P14356 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1075665 T2891 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1075678 T2838 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1075678 T2891 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1075679 T2838 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:14356_b",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:14356/b"}
[junit4:junit4] 2> 1075683 T2891 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1075727 T2890 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1075727 T2873 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1075727 T2837 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1075727 T2844 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1075727 T2857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1075736 T2891 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1075756 T2891 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1075760 T2891 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1075761 T2891 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1075762 T2891 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1075762 T2891 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1075763 T2891 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1075764 T2891 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1075764 T2891 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 1075764 T2891 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371806779919/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty3/
[junit4:junit4] 2> 1075765 T2891 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@552d7308
[junit4:junit4] 2> 1075765 T2891 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 1075766 T2891 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty3
[junit4:junit4] 2> 1075767 T2891 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty3/index/
[junit4:junit4] 2> 1075768 T2891 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1075769 T2891 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty3/index
[junit4:junit4] 2> 1075776 T2891 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4304dc4f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1075777 T2891 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1075780 T2891 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1075781 T2891 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1075782 T2891 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1075782 T2891 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1075783 T2891 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1075783 T2891 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1075787 T2891 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1075787 T2891 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1075788 T2891 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1075804 T2891 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1075814 T2891 oass.SolrIndexSearcher.<init> Opening Searcher@1b533820 main
[junit4:junit4] 2> 1075815 T2891 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1075816 T2891 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1075820 T2894 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b533820 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1075822 T2891 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1075822 T2891 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:14366/b collection:collection1 shard:shard1
[junit4:junit4] 2> 1075825 T2891 oasc.ZkController.register We are http://127.0.0.1:14366/b/collection1/ and leader is http://127.0.0.1:14331/b/collection1/
[junit4:junit4] 2> 1075825 T2891 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:14366/b
[junit4:junit4] 2> 1075826 T2891 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1075826 T2891 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1102 name=collection1 org.apache.solr.core.SolrCore@687d5966 url=http://127.0.0.1:14366/b/collection1 node=127.0.0.1:14366_b C1102_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:14366_b, base_url=http://127.0.0.1:14366/b}
[junit4:junit4] 2> 1075826 T2895 C1102 P14366 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1075827 T2891 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1075827 T2895 C1102 P14366 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1075828 T2895 C1102 P14366 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1075828 T2895 C1102 P14366 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1075828 T2815 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1075829 T2815 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1075830 T2895 C1102 P14366 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1075830 T2815 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1075854 T2851 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1076121 T2815 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1076124 T2815 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:14375
[junit4:junit4] 2> 1076125 T2815 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1076125 T2815 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1076126 T2815 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371806784557
[junit4:junit4] 2> 1076126 T2815 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371806784557/solr.xml
[junit4:junit4] 2> 1076127 T2815 oasc.CoreContainer.<init> New CoreContainer 2112606755
[junit4:junit4] 2> 1076128 T2815 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371806784557/'
[junit4:junit4] 2> 1076128 T2815 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371806784557/'
[junit4:junit4] 2> 1076258 T2815 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1076259 T2815 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1076259 T2815 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1076260 T2815 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1076261 T2815 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1076261 T2815 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1076262 T2815 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1076262 T2815 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1076263 T2815 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1076263 T2815 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1076279 T2815 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1076280 T2815 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:14306/solr
[junit4:junit4] 2> 1076280 T2815 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1076281 T2815 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1076284 T2907 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e257e06 name:ZooKeeperConnection Watcher:127.0.0.1:14306 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1076285 T2815 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1076287 T2815 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1076297 T2815 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1076299 T2909 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4dd82f8f name:ZooKeeperConnection Watcher:127.0.0.1:14306/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1076300 T2815 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1076311 T2815 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1077231 T2838 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1077232 T2838 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:14366_b",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:14366/b"}
[junit4:junit4] 2> 1077277 T2857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1077277 T2873 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1077277 T2909 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1077277 T2837 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1077277 T2890 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1077277 T2844 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1077314 T2815 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:14375_b
[junit4:junit4] 2> 1077316 T2815 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:14375_b
[junit4:junit4] 2> 1077318 T2890 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1077318 T2837 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1077318 T2909 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1077318 T2857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1077319 T2844 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1077319 T2873 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1077320 T2844 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1077320 T2890 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1077320 T2873 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1077326 T2837 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1077327 T2909 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1077327 T2857 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1077333 T2910 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1077333 T2910 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1077856 T2851 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 1077856 T2851 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=4&state=recovering&nodeName=127.0.0.1:14366_b&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 1078787 T2838 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1078788 T2838 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:14375_b",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:14375/b"}
[junit4:junit4] 2> 1078788 T2838 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 1078789 T2838 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1078810 T2890 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1078810 T2909 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1078810 T2837 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1078810 T2873 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1078810 T2857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1078810 T2844 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1079337 T2910 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371806784557/collection1
[junit4:junit4] 2> 1079337 T2910 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1079338 T2910 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1079338 T2910 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1079340 T2910 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371806784557/collection1/'
[junit4:junit4] 2> 1079341 T2910 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1371806784557/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1079342 T2910 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1371806784557/collection1/lib/README' to classloader
[junit4:junit4] 2> 1079396 T2910 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1079478 T2910 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1079579 T2910 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1079586 T2910 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C1103 name=collection1 org.apache.solr.core.SolrCore@687d5966 url=http://127.0.0.1:14366/b/collection1 node=127.0.0.1:14366_b C1103_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:14366_b, base_url=http://127.0.0.1:14366/b}
[junit4:junit4] 2> 1079858 T2895 C1103 P14366 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:14331/b/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1079858 T2895 C1103 P14366 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:14366/b START replicas=[http://127.0.0.1:14331/b/collection1/] nUpdates=100
[junit4:junit4] 2> 1079859 T2895 C1103 P14366 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1079859 T2895 C1103 P14366 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1079859 T2895 C1103 P14366 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1079859 T2895 C1103 P14366 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1079860 T2895 C1103 P14366 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1079860 T2895 C1103 P14366 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:14331/b/collection1/. core=collection1
[junit4:junit4] 2> 1079860 T2895 C1103 P14366 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C1104 name=collection1 org.apache.solr.core.SolrCore@6513bc9f url=http://127.0.0.1:14331/b/collection1 node=127.0.0.1:14331_b C1104_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:14331_b, base_url=http://127.0.0.1:14331/b, leader=true}
[junit4:junit4] 2> 1079861 T2848 C1104 P14331 oasc.SolrCore.execute [collection1] webapp=/b path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1079873 T2852 C1104 P14331 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1079883 T2852 C1104 P14331 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d61da22; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d61da22; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1079884 T2852 C1104 P14331 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1079886 T2852 C1104 P14331 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1079886 T2852 C1104 P14331 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 13
[junit4:junit4] 2> 1079887 T2895 C1103 P14366 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1079887 T2895 C1103 P14366 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1079890 T2850 C1104 P14331 oasc.SolrCore.execute [collection1] webapp=/b path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 1079891 T2895 C1103 P14366 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4] 2> 1079891 T2895 C1103 P14366 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1079892 T2895 C1103 P14366 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1079895 T2850 C1104 P14331 oasc.SolrCore.execute [collection1] webapp=/b path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=1
[junit4:junit4] 2> 1079896 T2895 C1103 P14366 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1079899 T2895 C1103 P14366 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty3/index.20130621042628600
[junit4:junit4] 2> 1079900 T2895 C1103 P14366 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty3/index.20130621042628600 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4e348f4a; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 1079904 T2850 C1104 P14331 oasc.SolrCore.execute [collection1] webapp=/b path=/replication params={file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4:junit4] 2> 1079906 T2895 C1103 P14366 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1079909 T2895 C1103 P14366 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1079909 T2895 C1103 P14366 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1079916 T2895 C1103 P14366 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4304dc4f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4304dc4f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1079917 T2895 C1103 P14366 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1079917 T2895 C1103 P14366 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1079919 T2895 C1103 P14366 oass.SolrIndexSearcher.<init> Opening Searcher@2ff3ce7b main
[junit4:junit4] 2> 1079920 T2894 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2ff3ce7b main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 1079921 T2895 C1103 P14366 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty3/index.20130621042628600 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty3/index.20130621042628600;done=true>>]
[junit4:junit4] 2> 1079921 T2895 C1103 P14366 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty3/index.20130621042628600
[junit4:junit4] 2> 1079922 T2895 C1103 P14366 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty3/index.20130621042628600
[junit4:junit4] 2> 1079923 T2895 C1103 P14366 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1079923 T2895 C1103 P14366 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1079924 T2895 C1103 P14366 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1079924 T2895 C1103 P14366 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1079926 T2895 C1103 P14366 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1080228 T2910 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1080240 T2910 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1080243 T2910 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1080256 T2910 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1080276 T2910 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1080281 T2910 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1080282 T2910 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1080282 T2910 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1080283 T2910 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1080283 T2910 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1080284 T2910 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1080284 T2910 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 1080284 T2910 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371806784557/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty4/
[junit4:junit4] 2> 1080285 T2910 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@552d7308
[junit4:junit4] 2> 1080285 T2910 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 1080286 T2910 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty4
[junit4:junit4] 2> 1080287 T2910 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty4/index/
[junit4:junit4] 2> 1080288 T2910 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1080288 T2910 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty4/index
[junit4:junit4] 2> 1080314 T2838 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1080315 T2838 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:14366_b",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:14366/b"}
[junit4:junit4] 2> 1080354 T2910 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c5484e2; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1080355 T2910 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1080360 T2910 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1080360 T2910 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1080361 T2910 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1080362 T2910 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1080362 T2910 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1080363 T2910 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1080367 T2910 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1080368 T2910 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1080369 T2910 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1080394 T2910 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1080408 T2910 oass.SolrIndexSearcher.<init> Opening Searcher@180339df main
[junit4:junit4] 2> 1080410 T2910 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1080410 T2910 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1080415 T2913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@180339df main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1080417 T2890 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1080417 T2873 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1080417 T2844 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1080417 T2837 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1080417 T2857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1080417 T2909 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1080418 T2910 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1080419 T2910 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:14375/b collection:collection1 shard:shard1
[junit4:junit4] 2> 1080459 T2910 oasc.ZkController.register We are http://127.0.0.1:14375/b/collection1/ and leader is http://127.0.0.1:14331/b/collection1/
[junit4:junit4] 2> 1080460 T2910 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:14375/b
[junit4:junit4] 2> 1080460 T2910 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1080461 T2910 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1105 name=collection1 org.apache.solr.core.SolrCore@69aff4a6 url=http://127.0.0.1:14375/b/collection1 node=127.0.0.1:14375_b C1105_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:14375_b, base_url=http://127.0.0.1:14375/b}
[junit4:junit4] 2> 1080461 T2914 C1105 P14375 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1080461 T2910 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1080463 T2914 C1105 P14375 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1080463 T2914 C1105 P14375 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1080463 T2914 C1105 P14375 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1080464 T2815 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1080465 T2815 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1080465 T2914 C1105 P14375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1080465 T2815 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1080500 T2815 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1080500 T2853 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1080504 T2815 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 1080505 T2815 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 1080505 T2815 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1081507 T2815 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1081921 T2838 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1081922 T2838 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:14375_b",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:14375/b"}
[junit4:junit4] 2> 1081940 T2844 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1081940 T2909 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1081940 T2837 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1081940 T2890 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1081940 T2873 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1081940 T2857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1082504 T2853 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 1082504 T2853 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:14375_b&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2004
[junit4:junit4] 2> 1082509 T2815 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1083511 T2815 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C1105_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:14375_b, base_url=http://127.0.0.1:14375/b}
[junit4:junit4] 2> 1084506 T2914 C1105 P14375 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:14331/b/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1084506 T2914 C1105 P14375 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:14375/b START replicas=[http://127.0.0.1:14331/b/collection1/] nUpdates=100
[junit4:junit4] 2> 1084507 T2914 C1105 P14375 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1084507 T2914 C1105 P14375 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1084507 T2914 C1105 P14375 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1084507 T2914 C1105 P14375 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1084508 T2914 C1105 P14375 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1084508 T2914 C1105 P14375 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:14331/b/collection1/. core=collection1
[junit4:junit4] 2> 1084508 T2914 C1105 P14375 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1084509 T2848 C1104 P14331 oasc.SolrCore.execute [collection1] webapp=/b path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1084513 T2815 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1084520 T2847 C1104 P14331 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1084525 T2847 C1104 P14331 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d61da22; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d61da22; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d61da22; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 1084526 T2847 C1104 P14331 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 1084527 T2847 C1104 P14331 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1084528 T2847 C1104 P14331 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 1084529 T2914 C1105 P14375 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1084529 T2914 C1105 P14375 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1084532 T2850 C1104 P14331 oasc.SolrCore.execute [collection1] webapp=/b path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 1084533 T2914 C1105 P14375 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 1084533 T2914 C1105 P14375 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1084533 T2914 C1105 P14375 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1084537 T2850 C1104 P14331 oasc.SolrCore.execute [collection1] webapp=/b path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=1
[junit4:junit4] 2> 1084537 T2914 C1105 P14375 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1084540 T2914 C1105 P14375 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty4/index.20130621042633242
[junit4:junit4] 2> 1084541 T2914 C1105 P14375 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty4/index.20130621042633242 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b663483; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 1084545 T2850 C1104 P14331 oasc.SolrCore.execute [collection1] webapp=/b path=/replication params={file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4:junit4] 2> 1084547 T2914 C1105 P14375 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1084550 T2914 C1105 P14375 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1084550 T2914 C1105 P14375 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1084555 T2914 C1105 P14375 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c5484e2; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c5484e2; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 1084556 T2914 C1105 P14375 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 1084557 T2914 C1105 P14375 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1084558 T2914 C1105 P14375 oass.SolrIndexSearcher.<init> Opening Searcher@3351b95 main
[junit4:junit4] 2> 1084559 T2913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3351b95 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 1084560 T2914 C1105 P14375 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty4/index.20130621042633242 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty4/index.20130621042633242;done=true>>]
[junit4:junit4] 2> 1084560 T2914 C1105 P14375 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty4/index.20130621042633242
[junit4:junit4] 2> 1084560 T2914 C1105 P14375 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty4/index.20130621042633242
[junit4:junit4] 2> 1084562 T2914 C1105 P14375 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1084562 T2914 C1105 P14375 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1084562 T2914 C1105 P14375 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1084562 T2914 C1105 P14375 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1084564 T2914 C1105 P14375 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1084946 T2838 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1084947 T2838 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:14375_b",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:14375/b"}
[junit4:junit4] 2> 1084960 T2844 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1084960 T2873 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1084960 T2890 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1084960 T2837 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1084960 T2909 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1084960 T2857 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1085515 T2815 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1085516 T2815 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C1106 name=collection1 org.apache.solr.core.SolrCore@4f32e33 url=http://127.0.0.1:14311/b/collection1 node=127.0.0.1:14311_b C1106_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:14311_b, base_url=http://127.0.0.1:14311/b, leader=true}
[junit4:junit4] 2> 1085526 T2827 C1106 P14311 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1085530 T2827 C1106 P14311 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@70e63ee0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1085530 T2827 C1106 P14311 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1085546 T2827 C1106 P14311 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@70e63ee0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@70e63ee0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1085546 T2827 C1106 P14311 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1085548 T2827 C1106 P14311 oass.SolrIndexSearcher.<init> Opening Searcher@322b8caa main
[junit4:junit4] 2> 1085548 T2827 C1106 P14311 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1085549 T2841 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@322b8caa main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1085550 T2827 C1106 P14311 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 25
[junit4:junit4] 2> ASYNC NEW_CORE C1107 name=collection1 org.apache.solr.core.SolrCore@6513bc9f url=http://127.0.0.1:14331/b/collection1 node=127.0.0.1:14331_b C1107_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:14331_b, base_url=http://127.0.0.1:14331/b, leader=true}
[junit4:junit4] 2> 1085573 T2849 C1107 P14331 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:14331/b/collection1/, StdNode: http://127.0.0.1:14356/b/collection1/, StdNode: http://127.0.0.1:14366/b/collection1/, StdNode: http://127.0.0.1:14375/b/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 1085576 T2851 C1107 P14331 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1085583 T2851 C1107 P14331 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=4
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d61da22; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d61da22; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d61da22; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d61da22; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 1085583 T2851 C1107 P14331 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 1085586 T2851 C1107 P14331 oass.SolrIndexSearcher.<init> Opening Searcher@4974ddbb main
[junit4:junit4] 2> 1085586 T2851 C1107 P14331 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1085587 T2859 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4974ddbb main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1085588 T2851 C1107 P14331 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 12
[junit4:junit4] 2> ASYNC NEW_CORE C1108 name=collection1 org.apache.solr.core.SolrCore@687d5966 url=http://127.0.0.1:14366/b/collection1 node=127.0.0.1:14366_b C1108_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:14366_b, base_url=http://127.0.0.1:14366/b}
[junit4:junit4] 2> 1085596 T2880 C1108 P14366 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1085601 T2880 C1108 P14366 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4304dc4f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4304dc4f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 1085602 T2880 C1108 P14366 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> ASYNC NEW_CORE C1109 name=collection1 org.apache.solr.core.SolrCore@69aff4a6 url=http://127.0.0.1:14375/b/collection1 node=127.0.0.1:14375_b C1109_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:14375_b, base_url=http://127.0.0.1:14375/b}
[junit4:junit4] 2> 1085604 T2899 C1109 P14375 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1085605 T2880 C1108 P14366 oass.SolrIndexSearcher.<init> Opening Searcher@1e95f7a1 main
[junit4:junit4] 2> ASYNC NEW_CORE C1110 name=collection1 org.apache.solr.core.SolrCore@5db972ef url=http://127.0.0.1:14356/b/collection1 node=127.0.0.1:14356_b C1110_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:14356_b, base_url=http://127.0.0.1:14356/b}
[junit4:junit4] 2> 1085604 T2863 C1110 P14356 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1085606 T2880 C1108 P14366 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1085606 T2894 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1e95f7a1 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 1085607 T2880 C1108 P14366 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 11
[junit4:junit4] 2> 1085617 T2899 C1109 P14375 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c5484e2; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c5484e2; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 1085618 T2863 C1110 P14356 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@362a9f71; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@362a9f71; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1085618 T2899 C1109 P14375 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 1085618 T2863 C1110 P14356 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1085621 T2899 C1109 P14375 oass.SolrIndexSearcher.<init> Opening Searcher@29126397 main
[junit4:junit4] 2> 1085621 T2863 C1110 P14356 oass.SolrIndexSearcher.<init> Opening Searcher@a810142 main
[junit4:junit4] 2> 1085622 T2899 C1109 P14375 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1085622 T2913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@29126397 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 1085622 T2863 C1110 P14356 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1085623 T2899 C1109 P14375 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 19
[junit4:junit4] 2> 1085623 T2875 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@a810142 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1085624 T2863 C1110 P14356 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 20
[junit4:junit4] 2> 1085625 T2849 C1107 P14331 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 52
[junit4:junit4] 2> 1085626 T2815 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1085629 T2852 C1107 P14331 oasc.SolrCore.execute [collection1] webapp=/b path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 1085631 T2864 C1110 P14356 oasc.SolrCore.execute [collection1] webapp=/b path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 1085632 T2881 C1108 P14366 oasc.SolrCore.execute [collection1] webapp=/b path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1085634 T2900 C1109 P14375 oasc.SolrCore.execute [collection1] webapp=/b path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> ASYNC NEW_CORE C1111 name=collection1 org.apache.solr.core.SolrCore@4f32e33 url=http://127.0.0.1:14311/b/collection1 node=127.0.0.1:14311_b C1111_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:14311_b, base_url=http://127.0.0.1:14311/b, leader=true}
[junit4:junit4] 2> 1087641 T2827 C1111 P14311 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438443683282157568)} 0 3
[junit4:junit4] 2> 1087653 T2863 C1110 P14356 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={update.distrib=FROMLEADER&_version_=-1438443683289497600&update.from=http://127.0.0.1:14331/b/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438443683289497600)} 0 2
[junit4:junit4] 2> 1087653 T2880 C1108 P14366 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={update.distrib=FROMLEADER&_version_=-1438443683289497600&update.from=http://127.0.0.1:14331/b/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438443683289497600)} 0 2
[junit4:junit4] 2> 1087653 T2899 C1109 P14375 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={update.distrib=FROMLEADER&_version_=-1438443683289497600&update.from=http://127.0.0.1:14331/b/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438443683289497600)} 0 2
[junit4:junit4] 2> 1087655 T2853 C1107 P14331 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1438443683289497600)} 0 9
[junit4:junit4] 2> 1087655 T2865 C1110 P14356 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 12
[junit4:junit4] 2> 1087661 T2827 C1111 P14311 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={wt=javabin&version=2} {add=[0 (1438443683302080512)]} 0 3
[junit4:junit4] 2> 1087673 T2863 C1110 P14356 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={distrib.from=http://127.0.0.1:14331/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438443683309420544)]} 0 3
[junit4:junit4] 2> 1087673 T2880 C1108 P14366 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={distrib.from=http://127.0.0.1:14331/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438443683309420544)]} 0 3
[junit4:junit4] 2> 1087673 T2899 C1109 P14375 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={distrib.from=http://127.0.0.1:14331/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438443683309420544)]} 0 3
[junit4:junit4] 2> 1087675 T2847 C1107 P14331 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={distrib.from=http://127.0.0.1:14375/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[0 (1438443683309420544)]} 0 10
[junit4:junit4] 2> 1087676 T2901 C1109 P14375 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={wt=javabin&version=2} {add=[0]} 0 13
[junit4:junit4] 2> 1087680 T2827 C1111 P14311 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={wt=javabin&version=2} {add=[1 (1438443683324100608)]} 0 1
[junit4:junit4] 2> 1087688 T2863 C1110 P14356 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={distrib.from=http://127.0.0.1:14331/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438443683329343488)]} 0 1
[junit4:junit4] 2> 1087688 T2880 C1108 P14366 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={distrib.from=http://127.0.0.1:14331/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438443683329343488)]} 0 1
[junit4:junit4] 2> 1087688 T2899 C1109 P14375 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={distrib.from=http://127.0.0.1:14331/b/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438443683329343488)]} 0 1
[junit4:junit4] 2> 1087689 T2925 C1107 P14331 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={distrib.from=http://127.0.0.1:14366/b/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[1 (1438443683329343488)]} 0 5
[junit4:junit4] 2> 1087690 T2882 C1108 P14366 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={wt=javabin&version=2} {add=[1]} 0 8
[junit4:junit4] 2> 1087694 T2827 C1111 P14311 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={wt=javabin&version=2} {add=[2 (1438443683338780672)]} 0 1
[junit4:junit4] 2> 1087699 T2853 C1107 P14331 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:14356/b/collection1/]
[junit4:junit4] 2> 1087700 T2853 C1107 P14331 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:14356/b/collection1/ against:[http://127.0.0.1:14356/b/collection1/] result:true
[junit4:junit4] 2> 1087700 T2853 C1107 P14331 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:14366/b/collection1/ against:[http://127.0.0.1:14356/b/collection1/] result:false
[junit4:junit4] 2> 1087701 T2853 C1107 P14331 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:14375/b/collection1/ against:[http://127.0.0.1:14356/b/collection1/] result:false
[junit4:junit4] 2> 1087705 T2899 C1109 P14375 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={distrib.from=http://127.0.0.1:14331/b/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:14356/b/collection1/&wt=javabin&version=2} {add=[2 (1438443683347169280)]} 0 1
[junit4:junit4] 2> 1087705 T2880 C1108 P14366 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={distrib.from=http://127.0.0.1:14331/b/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:14356/b/collection1/&wt=javabin&version=2} {add=[2 (1438443683347169280)]} 0 1
[junit4:junit4] 2> 1087706 T2853 C1107 P14331 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={distrib.from=http://127.0.0.1:14356/b/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:14356/b/collection1/&wt=javabin&version=2} {add=[2 (1438443683347169280)]} 0 7
[junit4:junit4] 2> 1087707 T2865 C1110 P14356 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={test.distrib.skip.servers=http://127.0.0.1:14356/b/collection1/&wt=javabin&version=2} {add=[2]} 0 10
[junit4:junit4] 2> 1087710 T2827 C1111 P14311 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={wt=javabin&version=2} {add=[3 (1438443683355557888)]} 0 1
[junit4:junit4] 2> 1087713 T2849 C1107 P14331 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:14366/b/collection1/, http://127.0.0.1:14356/b/collection1/]
[junit4:junit4] 2> 1087714 T2849 C1107 P14331 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:14356/b/collection1/ against:[http://127.0.0.1:14366/b/collection1/, http://127.0.0.1:14356/b/collection1/] result:true
[junit4:junit4] 2> 1087714 T2849 C1107 P14331 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:14366/b/collection1/ against:[http://127.0.0.1:14366/b/collection1/, http://127.0.0.1:14356/b/collection1/] result:true
[junit4:junit4] 2> 1087715 T2849 C1107 P14331 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:14375/b/collection1/ against:[http://127.0.0.1:14366/b/collection1/, http://127.0.0.1:14356/b/collection1/] result:false
[junit4:junit4] 2> 1087719 T2899 C1109 P14375 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={distrib.from=http://127.0.0.1:14331/b/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:14356/b/collection1/&wt=javabin&version=2} {add=[3 (1438443683361849344)]} 0 1
[junit4:junit4] 2> 1087720 T2849 C1107 P14331 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={test.distrib.skip.servers=http://127.0.0.1:14356/b/collection1/&test.distrib.skip.servers=http://127.0.0.1:14366/b/collection1/&wt=javabin&version=2} {add=[3 (1438443683361849344)]} 0 7
[junit4:junit4] 2> 1087722 T2827 C1111 P14311 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1087873 T2827 C1111 P14311 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@70e63ee0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@70e63ee0; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1087874 T2827 C1111 P14311 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1087891 T2827 C1111 P14311 oass.SolrIndexSearcher.<init> Opening Searcher@61d702b4 main
[junit4:junit4] 2> 1087892 T2827 C1111 P14311 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1087893 T2841 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@61d702b4 main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C4)}
[junit4:junit4] 2> 1087894 T2827 C1111 P14311 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 172
[junit4:junit4] 2> 1087897 T2901 C1109 P14375 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:14331/b/collection1/, StdNode: http://127.0.0.1:14356/b/collection1/, StdNode: http://127.0.0.1:14366/b/collection1/, StdNode: http://127.0.0.1:14375/b/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 1087900 T2866 C1110 P14356 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1087900 T2902 C1109 P14375 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1087900 T2847 C1107 P14331 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1087900 T2883 C1108 P14366 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1088081 T2902 C1109 P14375 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c5484e2; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3c5484e2; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> 1088081 T2883 C1108 P14366 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4304dc4f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4304dc4f; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 1088082 T2866 C1110 P14356 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@362a9f71; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@362a9f71; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 1088082 T2847 C1107 P14331 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=4
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d61da22; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d61da22; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d61da22; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371806763275/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4d61da22; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> 1088082 T2902 C1109 P14375 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 1088084 T2847 C1107 P14331 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 1088083 T2866 C1110 P14356 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 1088082 T2883 C1108 P14366 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 1088106 T2902 C1109 P14375 oass.SolrIndexSearcher.<init> Opening Searcher@218f2830 main
[junit4:junit4] 2> 1088107 T2902 C1109 P14375 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1088107 T2866 C1110 P14356 oass.SolrIndexSearcher.<init> Opening Searcher@5889625c main
[junit4:junit4] 2> 1088107 T2883 C1108 P14366 oass.SolrIndexSearcher.<init> Opening Searcher@7504d6d0 main
[junit4:junit4] 2> 1088108 T2866 C1110 P14356 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1088107 T2913 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@218f2830 main{StandardDirectoryReader(segments_6:3:nrt _0(5.0):C4)}
[junit4:junit4] 2> 1088109 T2894 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7504d6d0 main{StandardDirectoryReader(segments_5:3:nrt _0(5.0):C3)}
[junit4:junit4] 2> 1088108 T2875 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5889625c main{StandardDirectoryReader(segments_4:3:nrt _0(5.0):C2)}
[junit4:junit4] 2> 1088108 T2883 C1108 P14366 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1088108 T2847 C1107 P14331 oass.SolrIndexSearcher.<init> Opening Searcher@6d3445ba main
[junit4:junit4] 2> 1088110 T2883 C1108 P14366 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 210
[junit4:junit4] 2> 1088110 T2866 C1110 P14356 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 210
[junit4:junit4] 2> 1088109 T2902 C1109 P14375 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 209
[junit4:junit4] 2> 1088111 T2859 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6d3445ba main{StandardDirectoryReader(segments_6:3:nrt _0(5.0):C4)}
[junit4:junit4] 2> 1088111 T2847 C1107 P14331 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1088113 T2847 C1107 P14331 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 213
[junit4:junit4] 2> 1088113 T2901 C1109 P14375 oasup.LogUpdateProcessor.finish [collection1] webapp=/b path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 216
[junit4:junit4] 2> 1088114 T2815 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 1088115 T2815 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1088116 T2815 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 1088119 T2852 C1107 P14331 oasc.SolrCore.execute [collection1] webapp=/b path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 1088122 T2864 C1110 P14356 oasc.SolrCore.execute [collection1] webapp=/b path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=2 status=0 QTime=0
[junit4:junit4] 2> 1088125 T2881 C1108 P14366 oasc.SolrCore.execute [collection1] webapp=/b path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=3 status=0 QTime=0
[junit4:junit4] 2> 1088128 T2900 C1109 P14375 oasc.SolrCore.execute [collection1] webapp=/b path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 1088129 T2815 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1088149 T2884 oasha.CollectionsHandler.handleSyncShardAction Syncing shard : shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2
[junit4:junit4] 2> 1088149 T2884 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1088163 T2929 oasha.CoreAdminHandler.handleRequestSyncAction I have been requested to sync up my shard
[junit4:junit4] 2> 1088163 T2929 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:14331/b/collection1/
[junit4:junit4] 2> 1088164 T2929 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:14331/b START replicas=[http://127.0.0.1:14356/b/collection1/, http://127.0.0.1:14366/b/collection1/, http://127.0.0.1:14375/b/collection1/] nUpdates=100
[junit4:junit4] 2> 1088166 T2867 C1110 P14356 oasc.SolrCore.execute [collection1] webapp=/b path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 1088166 T2885 C1108 P14366 oasc.SolrCore.execute [collection1] webapp=/b path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1088166 T2929 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:14331/b Received 3 versions from 127.0.0.1:14356/b/collection1/
[junit4:junit4] 2> 1088166 T2903 C1109 P14375 oasc.SolrCore.execute [collection1] webapp=/b path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1088167 T2929 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:14331/b Our versions are newer. ourLowThreshold=1438443683289497600 otherHigh=1438443683329343488
[junit4:junit4] 2> 1088168 T2929 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:14331/b Received 4 versions from 127.0.0.1:14366/b/collection1/
[junit4:junit4] 2> 1088169 T2929 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:14331/b Our versions are newer. ourLowThreshold=1438443683289497600 otherHigh=1438443683347169280
[junit4:junit4] 2> 1088169 T2929 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:14331/b Received 5 versions from 127.0.0.1:14375/b/collection1/
[junit4:junit4] 2> 1088169 T2929 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:14331/b Our versions are newer. ourLowThreshold=1438443683289497600 otherHigh=1438443683347169280
[junit4:junit4] 2> 1088170 T2929 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:14331/b DONE. sync succeeded
[junit4:junit4] 2> 1088170 T2929 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1088171 T2929 oasc.SyncStrategy.syncToMe http://127.0.0.1:14331/b/collection1/: try and ask http://127.0.0.1:14356/b/collection1/ to sync
[junit4:junit4] 2> 1088171 T2929 oasc.SyncStrategy.syncToMe http://127.0.0.1:14331/b/collection1/: try and ask http://127.0.0.1:14366/b/collection1/ to sync
[junit4:junit4] 2> 1088172 T2929 oasc.SyncStrategy.syncToMe http://127.0.0.1:14331/b/collection1/: try and ask http://127.0.0.1:14375/b/collection1/ to sync
[junit4:junit4] 2> 1088172 T2868 C1110 P14356 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:14356/b START replicas=[http://127.0.0.1:14331/b/collection1/] nUpdates=100
[junit4:junit4] 2> 1088173 T2886 C1108 P14366 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:14366/b START replicas=[http://127.0.0.1:14331/b/collection1/] nUpdates=100
[junit4:junit4] 2> 1088174 T2904 C1109 P14375 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:14375/b START replicas=[http://127.0.0.1:14331/b/collection1/] nUpdates=100
[junit4:junit4] 2> 1088175 T2939 C1107 P14331 oasc.SolrCore.execute [collection1] webapp=/b path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1088175 T2848 C1107 P14331 oasc.SolrCore.execute [collection1] webapp=/b path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1088175 T2886 C1108 P14366 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:14366/b Received 5 versions from 127.0.0.1:14331/b/collection1/
[junit4:junit4] 2> 1088175 T2940 C1107 P14331 oasc.SolrCore.execute [collection1] webapp=/b path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1088176 T2886 C1108 P14366 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:14366/b Requesting updates from 127.0.0.1:14331/b/collection1/n=1 versions=[1438443683361849344]
[junit4:junit4] 2> 1088176 T2868 C1110 P14356 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:14356/b Received 5 versions from 127.0.0.1:14331/b/collection1/
[junit4:junit4] 2> 1088177 T2904 C1109 P14375 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:14375/b Received 5 versions from 127.0.0.1:14331/b/collection1/
[junit4:junit4] 2> 1088177 T2868 C1110 P14356 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:14356/b Requesting updates from 127.0.0.1:14331/b/collection1/n=2 versions=[1438443683361849344, 1438443683347169280]
[junit4:junit4] 2> 1088178 T2904 C1109 P14375 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:14375/b Our versions are newer. ourLowThreshold=1438443683289497600 otherHigh=1438443683347169280
[junit4:junit4] 2> 1088179 T2904 C1109 P14375 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:14375/b DONE. sync succeeded
[junit4:junit4] 2> 1088179 T2904 C1109 P14375 oasc.SolrCore.execute [collection1] webapp=/b path=/get params={sync=http://127.0.0.1:14331/b/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=6
[junit4:junit4] 2> 1088179 T2940 C1107 P14331 oasc.SolrCore.execute [collection1] webapp=/b path=/get params={distrib=false&getUpdates=1438443683361849344&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1088180 T2929 oasc.SyncStrategy.syncToMe http://127.0.0.1:14331/b/collection1/: sync completed with http://127.0.0.1:14375/b/collection1/
[junit4:junit4] 2> 1088180 T2848 C1107 P14331 oasc.SolrCore.execute [collection1] webapp=/b path=/get params={distrib=false&getUpdates=1438443683361849344,1438443683347169280&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1088186 T2886 C1108 P14366 oasup.LogUpdateProcessor.finish [collection1] {add=[3 (1438443683361849344)]} 0 6
[junit4:junit4] 2> 1088186 T2886 C1108 P14366 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:14366/b DONE. sync succeeded
[junit4:junit4] 2> 1088187 T2868 C1110 P14356 oasup.LogUpdateProcessor.finish [collection1] {add=[2 (1438443683347169280), 3 (1438443683361849344)]} 0 5
[junit4:junit4] 2> 1088187 T2886 C1108 P14366 oasc.SolrCore.execute [collection1] webapp=/b path=/get params={sync=http://127.0.0.1:14331/b/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=14
[junit4:junit4]
[...truncated too long message...]
"router":"compositeId"},
[junit4:junit4] 1> "control_collection":{
[junit4:junit4] 1> "shards":{"shard1":{
[junit4:junit4] 1> "range":"80000000-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{"1":{
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "collection":"control_collection",
[junit4:junit4] 1> "node_name":"127.0.0.1:14311_b",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:14311/b",
[junit4:junit4] 1> "leader":"true"}}}},
[junit4:junit4] 1> "router":"compositeId"}}
[junit4:junit4] 1> /solr/aliases.json (0)
[junit4:junit4] 1> /solr/live_nodes (4)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:14331_b (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:14311_b (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:14375_b (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:14366_b (0)
[junit4:junit4] 1> /solr/overseer (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/overseer/queue (0)
[junit4:junit4] 1> /solr/overseer/queue-work (0)
[junit4:junit4] 1> /solr/overseer/collection-queue-work (0)
[junit4:junit4] 1> /solr/collections (2)
[junit4:junit4] 1> /solr/collections/collection1 (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/collection1/shards (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect (1)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election (3)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89902728038711306-4-n_0000000002 (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89902728038711308-5-n_0000000003 (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89902728038711310-2-n_0000000004 (0)
[junit4:junit4] 1> /solr/collections/collection1/leaders (1)
[junit4:junit4] 1> /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:14366_b",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:14366/b"}
[junit4:junit4] 1> /solr/collections/control_collection (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/control_collection/shards (0)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election/89902728038711299-1-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/control_collection/leaders (1)
[junit4:junit4] 1> /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "node_name":"127.0.0.1:14311_b",
[junit4:junit4] 1> "base_url":"http://127.0.0.1:14311/b"}
[junit4:junit4] 1> /solr/overseer_elect (2)
[junit4:junit4] 1> /solr/overseer_elect/election (4)
[junit4:junit4] 1> /solr/overseer_elect/election/89902728038711310-127.0.0.1:14331_b-n_0000000005 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89902728038711299-127.0.0.1:14311_b-n_0000000000 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89902728038711308-127.0.0.1:14375_b-n_0000000004 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89902728038711306-127.0.0.1:14366_b-n_0000000003 (0)
[junit4:junit4] 1> /solr/overseer_elect/leader (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"id":"89902728038711299-127.0.0.1:14311_b-n_0000000000"}
[junit4:junit4] 1> /zookeeper (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=F9C993BC192946A7 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_VE -Dtests.timezone=America/North_Dakota/Center -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 530s J0 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:14331/b/collection1lastClient and got 245 from http://127.0.0.1:14366/b/collection1
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([F9C993BC192946A7:782F1DA46E76269B]:0)
[junit4:junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1018)
[junit4:junit4] > at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 1584941 T2815 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 530382 T2814 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {range_facet_l=MockVariableIntBlock(baseBlockSize=24), text=PostingsFormat(name=MockSep), _version_=MockVariableIntBlock(baseBlockSize=24), rnd_b=PostingsFormat(name=Lucene41WithOrds), intDefault=MockVariableIntBlock(baseBlockSize=24), timestamp=MockVariableIntBlock(baseBlockSize=24), id=PostingsFormat(name=Lucene41WithOrds), a_t=MockVariableIntBlock(baseBlockSize=24), range_facet_sl=PostingsFormat(name=MockSep), range_facet_si=Pulsing41(freqCutoff=15 minBlockSize=32 maxBlockSize=76), other_tl1=MockVariableIntBlock(baseBlockSize=24), multiDefault=Pulsing41(freqCutoff=15 minBlockSize=32 maxBlockSize=76), a_si=Pulsing41(freqCutoff=15 minBlockSize=32 maxBlockSize=76)}, docValues:{timestamp=DocValuesFormat(name=SimpleText)}, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=es_VE, timezone=America/North_Dakota/Center
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=1,free=219881800,total=456130560
[junit4:junit4] 2> NOTE: All tests run in this JVM: [MinimalSchemaTest, TestManagedSchema, SimpleFacetsTest, RecoveryZkTest, DistributedQueryElevationComponentTest, TestSweetSpotSimilarityFactory, TestIBSimilarityFactory, AutoCommitTest, TestSolrDeletionPolicy1, SliceStateTest, TestDocumentBuilder, ZkControllerTest, ShardSplitTest, ExternalFileFieldSortTest, TestSolrDeletionPolicy2, SchemaVersionSpecificBehaviorTest, StatelessScriptUpdateProcessorFactoryTest, TestSurroundQueryParser, SoftAutoCommitTest, TestExtendedDismaxParser, PolyFieldTest, TestFastWriter, TestFaceting, OverseerTest, TestPropInjectDefaults, CircularListTest, PreAnalyzedFieldTest, IndexSchemaTest, TestStressRecovery, TestDocSet, TestLMDirichletSimilarityFactory, SearchHandlerTest, SuggesterFSTTest, TestPseudoReturnFields, OverseerCollectionProcessorTest, TestStressVersions, DocValuesTest, SolrIndexSplitterTest, CoreAdminHandlerTest, TestJoin, TestFunctionQuery, PluginInfoTest, PrimitiveFieldTypeTest, ClusterStateUpdateTest, TestSolrCoreProperties, SuggesterTest, SpellingQueryConverterTest, AnalysisAfterCoreReloadTest, BadCopyFieldTest, TestFuzzyAnalyzedSuggestions, ResourceLoaderTest, UpdateRequestProcessorFactoryTest, ShardRoutingTest, TestCharFilters, SolrCoreTest, TestPluginEnable, LegacyHTMLStripCharFilterTest, FastVectorHighlighterTest, DirectSolrConnectionTest, TestReplicationHandler, TestReversedWildcardFilterFactory, UUIDFieldTest, DirectUpdateHandlerOptimizeTest, TermVectorComponentTest, CachingDirectoryFactoryTest, RegexBoostProcessorTest, DocumentBuilderTest, TestClassNameShortening, BasicDistributedZkTest, BasicFunctionalityTest, TestQuerySenderListener, SliceStateUpdateTest, TestPHPSerializedResponseWriter, TestSolrIndexConfig, SyncSliceTest]
[junit4:junit4] Completed on J0 in 530.93s, 1 test, 1 failure <<< FAILURES!
[...truncated 438 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:386: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:366: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:1243: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:887: There were test failures: 297 suites, 1251 tests, 1 failure, 13 ignored (7 assumptions)
Total time: 51 minutes 20 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 4083 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/4083/
1 tests failed.
REGRESSION: org.apache.solr.cloud.RecoveryZkTest.testDistribSearch
Error Message:
expected:<230> but was:<42>
Stack Trace:
java.lang.AssertionError: expected:<230> but was:<42>
at __randomizedtesting.SeedInfo.seed([20A86B6850A159DE:A14EE57027FE39E2]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.RecoveryZkTest.doTest(RecoveryZkTest.java:108)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9690 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.RecoveryZkTest
[junit4:junit4] 2> 1222265 T3042 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 1222270 T3042 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./solrtest-RecoveryZkTest-1371905739796
[junit4:junit4] 2> 1222272 T3042 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 1222272 T3043 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 1222373 T3042 oasc.ZkTestServer.run start zk server on port:26370
[junit4:junit4] 2> 1222374 T3042 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1222378 T3049 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6dbab31c name:ZooKeeperConnection Watcher:127.0.0.1:26370 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1222378 T3042 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1222379 T3042 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 1222392 T3042 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1222394 T3051 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19a63a57 name:ZooKeeperConnection Watcher:127.0.0.1:26370/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1222394 T3042 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1222395 T3042 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 1222403 T3042 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 1222410 T3042 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 1222412 T3042 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 1222415 T3042 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1222416 T3042 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1222427 T3042 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 1222428 T3042 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 1222533 T3042 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1222534 T3042 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1222537 T3042 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 1222537 T3042 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 1222546 T3042 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 1222547 T3042 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 1222550 T3042 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1222550 T3042 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1222553 T3042 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1222554 T3042 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1222557 T3042 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1222558 T3042 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1222560 T3042 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1222561 T3042 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1222841 T3042 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1222847 T3042 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60630
[junit4:junit4] 2> 1222848 T3042 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1222848 T3042 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1222849 T3042 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1371905740094
[junit4:junit4] 2> 1222849 T3042 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1371905740094/solr.xml
[junit4:junit4] 2> 1222850 T3042 oasc.CoreContainer.<init> New CoreContainer 987203425
[junit4:junit4] 2> 1222850 T3042 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1371905740094/'
[junit4:junit4] 2> 1222851 T3042 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1371905740094/'
[junit4:junit4] 2> 1222979 T3042 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1222980 T3042 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1222980 T3042 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1222981 T3042 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1222981 T3042 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1222982 T3042 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1222982 T3042 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1222983 T3042 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1222983 T3042 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1222984 T3042 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1223002 T3042 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1223002 T3042 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:26370/solr
[junit4:junit4] 2> 1223003 T3042 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1223004 T3042 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1223007 T3062 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b8ef813 name:ZooKeeperConnection Watcher:127.0.0.1:26370 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1223007 T3042 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1223031 T3042 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1223043 T3042 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1223065 T3064 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4584febf name:ZooKeeperConnection Watcher:127.0.0.1:26370/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1223065 T3042 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1223092 T3042 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 1223136 T3042 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 1223202 T3042 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 1223204 T3042 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60630_
[junit4:junit4] 2> 1223219 T3042 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60630_
[junit4:junit4] 2> 1223275 T3042 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 1223344 T3042 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 1223347 T3042 oasc.Overseer.start Overseer (id=89909214563729411-127.0.0.1:60630_-n_0000000000) starting
[junit4:junit4] 2> 1223357 T3042 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 1223370 T3066 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 1223370 T3042 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 1223373 T3042 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 1223380 T3042 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1223383 T3065 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 1223388 T3067 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1223388 T3067 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1224886 T3065 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1224887 T3065 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60630_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60630"}
[junit4:junit4] 2> 1224887 T3065 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1224888 T3065 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1224906 T3064 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1225393 T3067 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1371905740094/collection1
[junit4:junit4] 2> 1225393 T3067 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 1225394 T3067 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1225394 T3067 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 1225396 T3067 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1371905740094/collection1/'
[junit4:junit4] 2> 1225397 T3067 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-controljetty-1371905740094/collection1/lib/README' to classloader
[junit4:junit4] 2> 1225398 T3067 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-controljetty-1371905740094/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1225450 T3067 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1225548 T3067 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1225650 T3067 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1225656 T3067 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1226261 T3067 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1226273 T3067 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1226277 T3067 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1226291 T3067 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1226296 T3067 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1226301 T3067 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1226302 T3067 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1226302 T3067 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1226303 T3067 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1226303 T3067 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1226304 T3067 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1226304 T3067 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1226304 T3067 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-controljetty-1371905740094/collection1/, dataDir=./org.apache.solr.cloud.RecoveryZkTest-1371905739795/control/data/
[junit4:junit4] 2> 1226305 T3067 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@593aa24f
[junit4:junit4] 2> 1226305 T3067 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1226306 T3067 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1371905739795/control/data
[junit4:junit4] 2> 1226306 T3067 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.RecoveryZkTest-1371905739795/control/data/index/
[junit4:junit4] 2> 1226307 T3067 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.RecoveryZkTest-1371905739795/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1226307 T3067 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1371905739795/control/data/index
[junit4:junit4] 2> 1226312 T3067 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2073da2b lockFactory=org.apache.lucene.store.NativeFSLockFactory@60b4788),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1226312 T3067 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1226315 T3067 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1226316 T3067 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1226317 T3067 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1226317 T3067 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1226318 T3067 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1226318 T3067 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1226319 T3067 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1226319 T3067 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1226320 T3067 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1226336 T3067 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1226344 T3067 oass.SolrIndexSearcher.<init> Opening Searcher@d3f29dc main
[junit4:junit4] 2> 1226344 T3067 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.RecoveryZkTest-1371905739795/control/data/tlog
[junit4:junit4] 2> 1226346 T3067 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1226346 T3067 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1226350 T3068 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d3f29dc main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1226351 T3067 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1226351 T3067 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60630 collection:control_collection shard:shard1
[junit4:junit4] 2> 1226352 T3067 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 1226370 T3067 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1226384 T3067 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1226384 T3067 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1226384 T3067 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60630/collection1/
[junit4:junit4] 2> 1226384 T3067 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1226385 T3067 oasc.SyncStrategy.syncToMe http://127.0.0.1:60630/collection1/ has no replicas
[junit4:junit4] 2> 1226385 T3067 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60630/collection1/
[junit4:junit4] 2> 1226385 T3067 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 1226410 T3065 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1226426 T3064 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1226450 T3067 oasc.ZkController.register We are http://127.0.0.1:60630/collection1/ and leader is http://127.0.0.1:60630/collection1/
[junit4:junit4] 2> 1226450 T3067 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60630
[junit4:junit4] 2> 1226450 T3067 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1226450 T3067 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1226451 T3067 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1226452 T3067 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1226453 T3042 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1226454 T3042 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1226454 T3042 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1226471 T3042 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 1226472 T3042 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1226474 T3071 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76a4cca name:ZooKeeperConnection Watcher:127.0.0.1:26370/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1226474 T3042 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1226476 T3042 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1226478 T3042 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 1226741 T3042 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1226744 T3042 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:10817
[junit4:junit4] 2> 1226745 T3042 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1226746 T3042 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1226746 T3042 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1371905744003
[junit4:junit4] 2> 1226747 T3042 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1371905744003/solr.xml
[junit4:junit4] 2> 1226747 T3042 oasc.CoreContainer.<init> New CoreContainer 120602151
[junit4:junit4] 2> 1226748 T3042 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1371905744003/'
[junit4:junit4] 2> 1226748 T3042 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1371905744003/'
[junit4:junit4] 2> 1226875 T3042 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1226875 T3042 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1226876 T3042 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1226876 T3042 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1226877 T3042 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1226877 T3042 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1226878 T3042 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1226878 T3042 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1226879 T3042 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1226879 T3042 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1226897 T3042 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1226898 T3042 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:26370/solr
[junit4:junit4] 2> 1226898 T3042 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1226899 T3042 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1226902 T3082 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@51089e65 name:ZooKeeperConnection Watcher:127.0.0.1:26370 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1226903 T3042 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1226917 T3042 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1226928 T3042 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1226930 T3084 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4beb9eb0 name:ZooKeeperConnection Watcher:127.0.0.1:26370/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1226931 T3042 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1226942 T3042 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1227941 T3065 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1227942 T3065 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:60630__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:60630_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60630"}
[junit4:junit4] 2> 1228045 T3042 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:10817_
[junit4:junit4] 2> 1228048 T3084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1228048 T3071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1228048 T3064 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1228049 T3042 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:10817_
[junit4:junit4] 2> 1228065 T3084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1228065 T3064 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1228066 T3071 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1228066 T3071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1228067 T3084 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1228067 T3064 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1228143 T3085 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1228143 T3085 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1229567 T3065 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1229568 T3065 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:10817_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:10817"}
[junit4:junit4] 2> 1229568 T3065 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 1229569 T3065 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1229591 T3064 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1229591 T3071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1229591 T3084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1230152 T3085 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1371905744003/collection1
[junit4:junit4] 2> 1230152 T3085 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1230153 T3085 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1230153 T3085 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1230154 T3085 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1371905744003/collection1/'
[junit4:junit4] 2> 1230156 T3085 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty1-1371905744003/collection1/lib/README' to classloader
[junit4:junit4] 2> 1230156 T3085 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty1-1371905744003/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1230208 T3085 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1230268 T3085 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1230370 T3085 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1230376 T3085 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1230993 T3085 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1231005 T3085 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1231009 T3085 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1231023 T3085 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1231028 T3085 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1231032 T3085 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1231033 T3085 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1231033 T3085 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1231034 T3085 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1231034 T3085 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1231035 T3085 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1231035 T3085 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1231035 T3085 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty1-1371905744003/collection1/, dataDir=./org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty1/
[junit4:junit4] 2> 1231036 T3085 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@593aa24f
[junit4:junit4] 2> 1231036 T3085 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1231037 T3085 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty1
[junit4:junit4] 2> 1231037 T3085 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty1/index/
[junit4:junit4] 2> 1231038 T3085 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1231038 T3085 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty1/index
[junit4:junit4] 2> 1231042 T3085 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@38c9d6b2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@237d7328),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1231042 T3085 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1231045 T3085 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1231046 T3085 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1231046 T3085 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1231047 T3085 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1231048 T3085 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1231048 T3085 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1231048 T3085 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1231049 T3085 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1231050 T3085 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1231066 T3085 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1231073 T3085 oass.SolrIndexSearcher.<init> Opening Searcher@5afaf245 main
[junit4:junit4] 2> 1231073 T3085 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty1/tlog
[junit4:junit4] 2> 1231075 T3085 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1231075 T3085 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1231079 T3086 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5afaf245 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1231081 T3085 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1231082 T3085 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:10817 collection:collection1 shard:shard1
[junit4:junit4] 2> 1231082 T3085 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 1231105 T3085 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1231108 T3085 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1231108 T3085 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1231108 T3085 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:10817/collection1/
[junit4:junit4] 2> 1231108 T3085 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1231109 T3085 oasc.SyncStrategy.syncToMe http://127.0.0.1:10817/collection1/ has no replicas
[junit4:junit4] 2> 1231109 T3085 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:10817/collection1/
[junit4:junit4] 2> 1231109 T3085 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1232606 T3065 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1232659 T3064 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1232659 T3084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1232659 T3071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1232714 T3085 oasc.ZkController.register We are http://127.0.0.1:10817/collection1/ and leader is http://127.0.0.1:10817/collection1/
[junit4:junit4] 2> 1232714 T3085 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:10817
[junit4:junit4] 2> 1232714 T3085 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1232714 T3085 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1232715 T3085 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1232716 T3085 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1232717 T3042 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1232718 T3042 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1232719 T3042 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1233005 T3042 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1233008 T3042 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:31504
[junit4:junit4] 2> 1233009 T3042 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1233009 T3042 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1233010 T3042 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1371905750260
[junit4:junit4] 2> 1233010 T3042 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1371905750260/solr.xml
[junit4:junit4] 2> 1233011 T3042 oasc.CoreContainer.<init> New CoreContainer 1768880862
[junit4:junit4] 2> 1233012 T3042 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1371905750260/'
[junit4:junit4] 2> 1233012 T3042 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1371905750260/'
[junit4:junit4] 2> 1233141 T3042 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1233142 T3042 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1233143 T3042 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1233143 T3042 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1233144 T3042 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1233144 T3042 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1233145 T3042 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1233145 T3042 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1233146 T3042 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1233146 T3042 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1233162 T3042 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1233163 T3042 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:26370/solr
[junit4:junit4] 2> 1233163 T3042 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1233164 T3042 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1233174 T3098 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6a4ad4e2 name:ZooKeeperConnection Watcher:127.0.0.1:26370 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1233174 T3042 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1233193 T3042 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1233203 T3042 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1233205 T3100 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4103ff42 name:ZooKeeperConnection Watcher:127.0.0.1:26370/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1233206 T3042 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1233221 T3042 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1234174 T3065 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1234175 T3065 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:10817__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:10817_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:10817"}
[junit4:junit4] 2> 1234193 T3100 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1234193 T3064 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1234193 T3084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1234193 T3071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1234226 T3042 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:31504_
[junit4:junit4] 2> 1234228 T3042 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:31504_
[junit4:junit4] 2> 1234230 T3064 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1234230 T3084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1234230 T3071 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1234230 T3100 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1234231 T3071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1234231 T3100 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1234232 T3064 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1234238 T3084 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1234244 T3101 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1234244 T3101 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1235697 T3065 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1235698 T3065 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:31504_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:31504"}
[junit4:junit4] 2> 1235698 T3065 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 1235699 T3065 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1235716 T3064 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1235716 T3071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1235716 T3100 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1235716 T3084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1236249 T3101 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1371905750260/collection1
[junit4:junit4] 2> 1236249 T3101 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1236250 T3101 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1236250 T3101 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1236251 T3101 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1371905750260/collection1/'
[junit4:junit4] 2> 1236253 T3101 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty2-1371905750260/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1236253 T3101 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-jetty2-1371905750260/collection1/lib/README' to classloader
[junit4:junit4] 2> 1236306 T3101 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1236367 T3101 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1236470 T3101 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1236476 T3101 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1237091 T3101 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1237104 T3101 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1237108 T3101 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1237122 T3101 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1237126 T3101 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1237130 T3101 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1237131 T3101 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1237132 T3101 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1237132 T3101 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1237133 T3101 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1237133 T3101 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 1237134 T3101 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1237134 T3101 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.RecoveryZkTest-jetty2-1371905750260/collection1/, dataDir=./org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty2/
[junit4:junit4] 2> 1237134 T3101 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@593aa24f
[junit4:junit4] 2> 1237135 T3101 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1237136 T3101 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty2
[junit4:junit4] 2> 1237137 T3101 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty2/index/
[junit4:junit4] 2> 1237137 T3101 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1237137 T3101 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty2/index
[junit4:junit4] 2> 1237141 T3101 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7376134 lockFactory=org.apache.lucene.store.NativeFSLockFactory@54e038e6),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1237141 T3101 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1237144 T3101 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1237144 T3101 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1237145 T3101 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1237146 T3101 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1237146 T3101 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1237146 T3101 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1237147 T3101 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1237147 T3101 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1237148 T3101 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1237163 T3101 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1237169 T3101 oass.SolrIndexSearcher.<init> Opening Searcher@343734b5 main
[junit4:junit4] 2> 1237170 T3101 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty2/tlog
[junit4:junit4] 2> 1237171 T3101 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1237171 T3101 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1237176 T3102 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@343734b5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1237178 T3101 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1237178 T3101 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:31504 collection:collection1 shard:shard1
[junit4:junit4] 2> 1237181 T3101 oasc.ZkController.register We are http://127.0.0.1:31504/collection1/ and leader is http://127.0.0.1:10817/collection1/
[junit4:junit4] 2> 1237181 T3101 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:31504
[junit4:junit4] 2> 1237182 T3101 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1237182 T3101 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C528 name=collection1 org.apache.solr.core.SolrCore@55a6d031 url=http://127.0.0.1:31504/collection1 node=127.0.0.1:31504_ C528_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:31504_, base_url=http://127.0.0.1:31504}
[junit4:junit4] 2> 1237182 T3103 C528 P31504 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1237182 T3101 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1237183 T3103 C528 P31504 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1237183 T3103 C528 P31504 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1237184 T3103 C528 P31504 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1237184 T3042 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1237185 T3042 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1237185 T3103 C528 P31504 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1237185 T3042 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1237203 T3042 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1237204 T3074 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:31504__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> ASYNC NEW_CORE C529 name=collection1 org.apache.solr.core.SolrCore@7e54ea77 url=http://127.0.0.1:60630/collection1 node=127.0.0.1:60630_ C529_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:60630_, base_url=http://127.0.0.1:60630, leader=true}
[junit4:junit4] 2> 1237217 T3055 C529 P60630 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2073da2b lockFactory=org.apache.lucene.store.NativeFSLockFactory@60b4788),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1237218 T3055 C529 P60630 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1237222 T3065 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1237223 T3065 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:31504__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:31504_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:31504"}
[junit4:junit4] 2> 1237223 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1438547448682250240)]} 0 8
[junit4:junit4] 2> 1237223 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10001 (1438547448682250241)]} 0 8
[junit4:junit4] 2> 1237235 T3100 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1237235 T3071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1237235 T3084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1237235 T3064 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> ASYNC NEW_CORE C530 name=collection1 org.apache.solr.core.SolrCore@65e3ec36 url=http://127.0.0.1:10817/collection1 node=127.0.0.1:10817_ C530_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:10817_, base_url=http://127.0.0.1:10817, leader=true}
[junit4:junit4] 2> 1237243 T3075 C530 P10817 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@38c9d6b2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@237d7328),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1237244 T3075 C530 P10817 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> C528_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:31504_, base_url=http://127.0.0.1:31504}
[junit4:junit4] 2> 1237257 T3090 C528 P31504 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7376134 lockFactory=org.apache.lucene.store.NativeFSLockFactory@54e038e6),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1237258 T3090 C528 P31504 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1237260 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438547448709513216)]} 0 5
[junit4:junit4] 2> 1237260 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10001 (1438547448709513217)]} 0 5
[junit4:junit4] 2> 1237261 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1438547448709513216)]} 0 21
[junit4:junit4] 2> 1237261 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10001 (1438547448709513217)]} 0 21
[junit4:junit4] 2> 1237313 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10002 (1438547448783962112)]} 0 1
[junit4:junit4] 2> 1237314 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1438547448785010688)]} 0 1
[junit4:junit4] 2> 1237320 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10002 (1438547448788156416)]} 0 1
[junit4:junit4] 2> 1237320 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1438547448788156417)]} 0 1
[junit4:junit4] 2> 1237320 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10002 (1438547448788156416)]} 0 4
[junit4:junit4] 2> 1237321 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1438547448788156417)]} 0 5
[junit4:junit4] 2> 1237415 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1438547448890916864)]} 0 1
[junit4:junit4] 2> 1237415 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10003 (1438547448890916865)]} 0 1
[junit4:junit4] 2> 1237422 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10003 (1438547448895111169)]} 0 1
[junit4:junit4] 2> 1237422 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1438547448895111168)]} 0 1
[junit4:junit4] 2> 1237422 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10003 (1438547448895111169)]} 0 4
[junit4:junit4] 2> 1237423 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1438547448895111168)]} 0 5
[junit4:junit4] 2> 1237517 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10004 (1438547448997871616)]} 0 1
[junit4:junit4] 2> 1237518 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4 (1438547448998920192)]} 0 1
[junit4:junit4] 2> 1237524 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10004 (1438547449002065920)]} 0 1
[junit4:junit4] 2> 1237524 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10004 (1438547449002065920)]} 0 4
[junit4:junit4] 2> 1237525 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1438547449002065921)]} 0 1
[junit4:junit4] 2> 1237525 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[4 (1438547449002065921)]} 0 5
[junit4:junit4] 2> 1237611 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10005 (1438547449096437760)]} 0 1
[junit4:junit4] 2> 1237612 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5 (1438547449097486336)]} 0 1
[junit4:junit4] 2> 1237618 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10005 (1438547449100632064)]} 0 1
[junit4:junit4] 2> 1237618 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10005 (1438547449100632064)]} 0 4
[junit4:junit4] 2> 1237619 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1438547449101680640)]} 0 1
[junit4:junit4] 2> 1237619 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[5 (1438547449101680640)]} 0 4
[junit4:junit4] 2> 1237722 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10006 (1438547449212829696)]} 0 1
[junit4:junit4] 2> 1237723 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6 (1438547449213878272)]} 0 1
[junit4:junit4] 2> 1237728 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10006 (1438547449215975424)]} 0 1
[junit4:junit4] 2> 1237728 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10006 (1438547449215975424)]} 0 4
[junit4:junit4] 2> 1237729 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1438547449217024000)]} 0 1
[junit4:junit4] 2> 1237730 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[6 (1438547449217024000)]} 0 5
[junit4:junit4] 2> 1237817 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10006 (-1438547449312444416)]} 0 1
[junit4:junit4] 2> 1237817 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[6 (-1438547449312444417)]} 0 1
[junit4:junit4] 2> 1237824 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10006 (-1438547449316638720)]} 0 1
[junit4:junit4] 2> 1237824 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[6 (-1438547449316638721)]} 0 1
[junit4:junit4] 2> 1237824 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10006 (-1438547449316638720)]} 0 4
[junit4:junit4] 2> 1237825 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[6 (-1438547449316638721)]} 0 5
[junit4:junit4] 2> 1237829 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10007 (1438547449325027328)]} 0 1
[junit4:junit4] 2> 1237829 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7 (1438547449325027329)]} 0 1
[junit4:junit4] 2> 1237836 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1438547449329221632)]} 0 1
[junit4:junit4] 2> 1237836 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10007 (1438547449329221633)]} 0 1
[junit4:junit4] 2> 1237836 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[7 (1438547449329221632)]} 0 4
[junit4:junit4] 2> 1237837 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10007 (1438547449329221633)]} 0 5
[junit4:junit4] 2> 1237866 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8 (1438547449363824640)]} 0 1
[junit4:junit4] 2> 1237867 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10008 (1438547449364873216)]} 0 1
[junit4:junit4] 2> 1237873 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10008 (1438547449368018944)]} 0 1
[junit4:junit4] 2> 1237873 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1438547449366970368)]} 0 1
[junit4:junit4] 2> 1237873 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10008 (1438547449368018944)]} 0 4
[junit4:junit4] 2> 1237874 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[8 (1438547449366970368)]} 0 6
[junit4:junit4] 2> 1237897 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10008 (-1438547449397379072)]} 0 0
[junit4:junit4] 2> 1237898 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[8 (-1438547449398427648)]} 0 0
[junit4:junit4] 2> 1237902 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10008 (-1438547449400524800)]} 0 0
[junit4:junit4] 2> 1237903 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10008 (-1438547449400524800)]} 0 3
[junit4:junit4] 2> 1237903 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[8 (-1438547449401573376)]} 0 0
[junit4:junit4] 2> 1237904 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[8 (-1438547449401573376)]} 0 3
[junit4:junit4] 2> 1237906 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[9 (1438547449405767680)]} 0 1
[junit4:junit4] 2> 1237906 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10009 (1438547449405767681)]} 0 1
[junit4:junit4] 2> 1237912 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[9 (1438547449408913408)]} 0 1
[junit4:junit4] 2> 1237912 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[9 (1438547449408913408)]} 0 4
[junit4:junit4] 2> 1237913 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10009 (1438547449409961984)]} 0 1
[junit4:junit4] 2> 1237913 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10009 (1438547449409961984)]} 0 4
[junit4:junit4] 2> 1238006 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10 (1438547449510625280)]} 0 1
[junit4:junit4] 2> 1238007 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10010 (1438547449511673856)]} 0 1
[junit4:junit4] 2> 1238013 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1438547449514819584)]} 0 1
[junit4:junit4] 2> 1238013 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10010 (1438547449514819585)]} 0 1
[junit4:junit4] 2> 1238013 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10 (1438547449514819584)]} 0 4
[junit4:junit4] 2> 1238014 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10010 (1438547449514819585)]} 0 5
[junit4:junit4] 2> 1238018 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10 (-1438547449524256768)]} 0 0
[junit4:junit4] 2> 1238018 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10010 (-1438547449524256769)]} 0 0
[junit4:junit4] 2> 1238023 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10010 (-1438547449527402496)]} 0 0
[junit4:junit4] 2> 1238023 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10 (-1438547449527402497)]} 0 0
[junit4:junit4] 2> 1238024 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10010 (-1438547449527402496)]} 0 3
[junit4:junit4] 2> 1238024 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10 (-1438547449527402497)]} 0 3
[junit4:junit4] 2> 1238028 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10011 (1438547449533693953)]} 0 1
[junit4:junit4] 2> 1238028 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[11 (1438547449533693952)]} 0 1
[junit4:junit4] 2> 1238034 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10011 (1438547449536839680)]} 0 1
[junit4:junit4] 2> 1238034 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10011 (1438547449536839680)]} 0 4
[junit4:junit4] 2> 1238035 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1438547449537888256)]} 0 1
[junit4:junit4] 2> 1238035 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[11 (1438547449537888256)]} 0 4
[junit4:junit4] 2> 1238058 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10012 (1438547449565151232)]} 0 1
[junit4:junit4] 2> 1238059 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[12 (1438547449566199808)]} 0 1
[junit4:junit4] 2> 1238066 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[12 (1438547449570394112)]} 0 1
[junit4:junit4] 2> 1238066 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10012 (1438547449569345536)]} 0 1
[junit4:junit4] 2> 1238066 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[12 (1438547449570394112)]} 0 4
[junit4:junit4] 2> 1238067 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10012 (1438547449569345536)]} 0 6
[junit4:junit4] 2> 1238120 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[12 (-1438547449631211520)]} 0 0
[junit4:junit4] 2> 1238121 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10012 (-1438547449632260096)]} 0 0
[junit4:junit4] 2> 1238127 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[12 (-1438547449635405824)]} 0 0
[junit4:junit4] 2> 1238127 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10012 (-1438547449636454400)]} 0 0
[junit4:junit4] 2> 1238128 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[12 (-1438547449635405824)]} 0 4
[junit4:junit4] 2> 1238128 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10012 (-1438547449636454400)]} 0 3
[junit4:junit4] 2> 1238132 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10013 (1438547449642745856)]} 0 1
[junit4:junit4] 2> 1238132 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[13 (1438547449642745857)]} 0 1
[junit4:junit4] 2> 1238138 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10013 (1438547449645891584)]} 0 1
[junit4:junit4] 2> 1238138 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10013 (1438547449645891584)]} 0 4
[junit4:junit4] 2> 1238139 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[13 (1438547449646940160)]} 0 1
[junit4:junit4] 2> 1238139 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[13 (1438547449646940160)]} 0 4
[junit4:junit4] 2> 1238184 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10013 (-1438547449698320384)]} 0 0
[junit4:junit4] 2> 1238185 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[13 (-1438547449699368960)]} 0 0
[junit4:junit4] 2> 1238190 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[13 (-1438547449702514689)]} 0 0
[junit4:junit4] 2> 1238190 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10013 (-1438547449702514688)]} 0 0
[junit4:junit4] 2> 1238191 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[13 (-1438547449702514689)]} 0 3
[junit4:junit4] 2> 1238191 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10013 (-1438547449702514688)]} 0 3
[junit4:junit4] 2> 1238196 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[14 (1438547449709854721)]} 0 1
[junit4:junit4] 2> 1238196 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10014 (1438547449709854720)]} 0 1
[junit4:junit4] 2> 1238203 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[14 (1438547449714049024)]} 0 1
[junit4:junit4] 2> 1238203 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[14 (1438547449714049024)]} 0 4
[junit4:junit4] 2> 1238204 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10014 (1438547449715097600)]} 0 1
[junit4:junit4] 2> 1238205 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10014 (1438547449715097600)]} 0 5
[junit4:junit4] 2> 1238206 T3074 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:31504__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 1238206 T3074 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:31504__collection1&state=recovering&nodeName=127.0.0.1:31504_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002
[junit4:junit4] 2> 1238242 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[14 (-1438547449759137792)]} 0 0
[junit4:junit4] 2> 1238243 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10014 (-1438547449760186368)]} 0 0
[junit4:junit4] 2> 1238248 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[14 (-1438547449763332096)]} 0 0
[junit4:junit4] 2> 1238249 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[14 (-1438547449763332096)]} 0 3
[junit4:junit4] 2> 1238249 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10014 (-1438547449764380672)]} 0 0
[junit4:junit4] 2> 1238250 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10014 (-1438547449764380672)]} 0 3
[junit4:junit4] 2> 1238253 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[15 (1438547449769623552)]} 0 1
[junit4:junit4] 2> 1238254 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10015 (1438547449770672128)]} 0 1
[junit4:junit4] 2> 1238259 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[15 (1438547449772769280)]} 0 1
[junit4:junit4] 2> 1238259 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[15 (1438547449772769280)]} 0 4
[junit4:junit4] 2> 1238261 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10015 (1438547449773817856)]} 0 1
[junit4:junit4] 2> 1238261 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10015 (1438547449773817856)]} 0 5
[junit4:junit4] 2> 1238273 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[16 (1438547449790595072)]} 0 1
[junit4:junit4] 2> 1238275 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10016 (1438547449792692224)]} 0 1
[junit4:junit4] 2> 1238280 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[16 (1438547449794789376)]} 0 1
[junit4:junit4] 2> 1238281 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10016 (1438547449795837952)]} 0 1
[junit4:junit4] 2> 1238281 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[16 (1438547449794789376)]} 0 5
[junit4:junit4] 2> 1238282 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10016 (1438547449795837952)]} 0 5
[junit4:junit4] 2> 1238303 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[16 (-1438547449823100928)]} 0 0
[junit4:junit4] 2> 1238304 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10016 (-1438547449824149504)]} 0 0
[junit4:junit4] 2> 1238308 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[16 (-1438547449826246656)]} 0 0
[junit4:junit4] 2> 1238309 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[16 (-1438547449826246656)]} 0 3
[junit4:junit4] 2> 1238310 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10016 (-1438547449827295232)]} 0 0
[junit4:junit4] 2> 1238311 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10016 (-1438547449827295232)]} 0 4
[junit4:junit4] 2> 1238313 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[17 (1438547449832538112)]} 0 1
[junit4:junit4] 2> 1238315 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10017 (1438547449834635264)]} 0 1
[junit4:junit4] 2> 1238319 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[17 (1438547449835683840)]} 0 1
[junit4:junit4] 2> 1238319 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[17 (1438547449835683840)]} 0 4
[junit4:junit4] 2> 1238321 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10017 (1438547449837780992)]} 0 1
[junit4:junit4] 2> 1238321 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10017 (1438547449837780992)]} 0 4
[junit4:junit4] 2> 1238386 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[18 (1438547449909084160)]} 0 1
[junit4:junit4] 2> 1238388 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10018 (1438547449911181312)]} 0 1
[junit4:junit4] 2> 1238393 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[18 (1438547449913278464)]} 0 1
[junit4:junit4] 2> 1238393 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[18 (1438547449913278464)]} 0 4
[junit4:junit4] 2> 1238394 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10018 (1438547449914327040)]} 0 1
[junit4:junit4] 2> 1238394 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10018 (1438547449914327040)]} 0 4
[junit4:junit4] 2> 1238427 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[19 (1438547449952075776)]} 0 1
[junit4:junit4] 2> 1238429 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10019 (1438547449954172928)]} 0 1
[junit4:junit4] 2> 1238433 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[19 (1438547449955221504)]} 0 1
[junit4:junit4] 2> 1238433 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[19 (1438547449955221504)]} 0 4
[junit4:junit4] 2> 1238436 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10019 (1438547449957318656)]} 0 1
[junit4:junit4] 2> 1238436 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10019 (1438547449957318656)]} 0 5
[junit4:junit4] 2> 1238458 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[18 (-1438547449985630208)]} 0 0
[junit4:junit4] 2> 1238461 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10018 (-1438547449988775936)]} 0 0
[junit4:junit4] 2> 1238463 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[18 (-1438547449988775936)]} 0 0
[junit4:junit4] 2> 1238464 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[18 (-1438547449988775936)]} 0 3
[junit4:junit4] 2> 1238467 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10018 (-1438547449991921664)]} 0 0
[junit4:junit4] 2> 1238468 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[20 (1438547449995067392)]} 0 1
[junit4:junit4] 2> 1238468 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10018 (-1438547449991921664)]} 0 4
[junit4:junit4] 2> 1238472 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10020 (1438547449999261696)]} 0 1
[junit4:junit4] 2> 1238475 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[20 (1438547449998213120)]} 0 1
[junit4:junit4] 2> 1238475 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[20 (1438547449998213120)]} 0 5
[junit4:junit4] 2> 1238478 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10020 (1438547450002407424)]} 0 1
[junit4:junit4] 2> 1238478 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10020 (1438547450002407424)]} 0 4
[junit4:junit4] 2> 1238529 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[20 (-1438547450060079104)]} 0 0
[junit4:junit4] 2> 1238533 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10020 (-1438547450064273408)]} 0 0
[junit4:junit4] 2> 1238536 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[20 (-1438547450064273408)]} 0 0
[junit4:junit4] 2> 1238537 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[20 (-1438547450064273408)]} 0 4
[junit4:junit4] 2> 1238538 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10020 (-1438547450067419136)]} 0 0
[junit4:junit4] 2> 1238539 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10020 (-1438547450067419136)]} 0 3
[junit4:junit4] 2> 1238541 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[21 (1438547450071613440)]} 0 1
[junit4:junit4] 2> 1238543 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10021 (1438547450073710592)]} 0 1
[junit4:junit4] 2> 1238547 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[21 (1438547450074759168)]} 0 1
[junit4:junit4] 2> 1238547 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[21 (1438547450074759168)]} 0 4
[junit4:junit4] 2> 1238549 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10021 (1438547450076856320)]} 0 1
[junit4:junit4] 2> 1238549 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10021 (1438547450076856320)]} 0 4
[junit4:junit4] 2> 1238586 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[21 (-1438547450119847936)]} 0 0
[junit4:junit4] 2> 1238588 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10021 (-1438547450121945088)]} 0 0
[junit4:junit4] 2> 1238591 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[21 (-1438547450122993664)]} 0 0
[junit4:junit4] 2> 1238592 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[21 (-1438547450122993664)]} 0 3
[junit4:junit4] 2> 1238595 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10021 (-1438547450126139392)]} 0 0
[junit4:junit4] 2> 1238596 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[22 (1438547450129285120)]} 0 1
[junit4:junit4] 2> 1238596 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10021 (-1438547450126139392)]} 0 4
[junit4:junit4] 2> 1238600 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10022 (1438547450133479424)]} 0 1
[junit4:junit4] 2> 1238603 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[22 (1438547450132430848)]} 0 1
[junit4:junit4] 2> 1238603 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[22 (1438547450132430848)]} 0 5
[junit4:junit4] 2> 1238608 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10022 (1438547450137673728)]} 0 1
[junit4:junit4] 2> 1238608 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10022 (1438547450137673728)]} 0 5
[junit4:junit4] 2> 1238681 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[22 (-1438547450219462656)]} 0 0
[junit4:junit4] 2> 1238686 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10022 (-1438547450224705536)]} 0 0
[junit4:junit4] 2> 1238687 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[22 (-1438547450223656960)]} 0 0
[junit4:junit4] 2> 1238688 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[22 (-1438547450223656960)]} 0 3
[junit4:junit4] 2> 1238691 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10022 (-1438547450227851264)]} 0 0
[junit4:junit4] 2> 1238692 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[23 (1438547450229948416)]} 0 1
[junit4:junit4] 2> 1238692 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10022 (-1438547450227851264)]} 0 3
[junit4:junit4] 2> 1238696 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10023 (1438547450234142720)]} 0 1
[junit4:junit4] 2> 1238699 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[23 (1438547450233094144)]} 0 1
[junit4:junit4] 2> 1238699 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[23 (1438547450233094144)]} 0 5
[junit4:junit4] 2> 1238703 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10023 (1438547450237288448)]} 0 1
[junit4:junit4] 2> 1238703 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10023 (1438547450237288448)]} 0 5
[junit4:junit4] 2> 1238720 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[24 (1438547450259308544)]} 0 1
[junit4:junit4] 2> 1238723 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10024 (1438547450262454272)]} 0 1
[junit4:junit4] 2> 1238727 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[24 (1438547450262454272)]} 0 1
[junit4:junit4] 2> 1238727 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[24 (1438547450262454272)]} 0 5
[junit4:junit4] 2> 1238730 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10024 (1438547450266648576)]} 0 1
[junit4:junit4] 2> 1238730 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10024 (1438547450266648576)]} 0 4
[junit4:junit4] 2> 1238769 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[24 (-1438547450311737344)]} 0 0
[junit4:junit4] 2> 1238771 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10024 (-1438547450313834496)]} 0 0
[junit4:junit4] 2> 1238774 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[24 (-1438547450314883072)]} 0 0
[junit4:junit4] 2> 1238775 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[24 (-1438547450314883072)]} 0 3
[junit4:junit4] 2> 1238776 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10024 (-1438547450316980224)]} 0 0
[junit4:junit4] 2> 1238777 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10024 (-1438547450316980224)]} 0 3
[junit4:junit4] 2> 1238779 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[25 (1438547450321174528)]} 0 1
[junit4:junit4] 2> 1238781 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10025 (1438547450323271680)]} 0 1
[junit4:junit4] 2> 1238785 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[25 (1438547450324320256)]} 0 1
[junit4:junit4] 2> 1238785 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[25 (1438547450324320256)]} 0 4
[junit4:junit4] 2> 1238787 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10025 (1438547450326417408)]} 0 1
[junit4:junit4] 2> 1238787 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10025 (1438547450326417408)]} 0 4
[junit4:junit4] 2> 1238810 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[26 (1438547450353680384)]} 0 1
[junit4:junit4] 2> 1238812 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10026 (1438547450355777536)]} 0 1
[junit4:junit4] 2> 1238816 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[26 (1438547450356826112)]} 0 1
[junit4:junit4] 2> 1238816 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[26 (1438547450356826112)]} 0 4
[junit4:junit4] 2> 1238818 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10026 (1438547450358923264)]} 0 1
[junit4:junit4] 2> 1238818 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10026 (1438547450358923264)]} 0 4
[junit4:junit4] 2> 1238852 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[25 (-1438547450398769152)]} 0 0
[junit4:junit4] 2> 1238854 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10025 (-1438547450400866304)]} 0 0
[junit4:junit4] 2> 1238857 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[25 (-1438547450401914880)]} 0 0
[junit4:junit4] 2> 1238858 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[25 (-1438547450401914880)]} 0 3
[junit4:junit4] 2> 1238860 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10025 (-1438547450404012032)]} 0 0
[junit4:junit4] 2> 1238861 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10025 (-1438547450404012032)]} 0 4
[junit4:junit4] 2> 1238862 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[27 (1438547450408206336)]} 0 1
[junit4:junit4] 2> 1238866 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10027 (1438547450412400640)]} 0 1
[junit4:junit4] 2> 1238870 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[27 (1438547450412400640)]} 0 1
[junit4:junit4] 2> 1238870 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[27 (1438547450412400640)]} 0 5
[junit4:junit4] 2> 1238873 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10027 (1438547450416594944)]} 0 1
[junit4:junit4] 2> 1238873 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10027 (1438547450416594944)]} 0 4
[junit4:junit4] 2> 1238963 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[28 (1438547450514112512)]} 0 1
[junit4:junit4] 2> 1238966 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10028 (1438547450517258240)]} 0 1
[junit4:junit4] 2> 1238969 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[28 (1438547450517258240)]} 0 1
[junit4:junit4] 2> 1238969 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[28 (1438547450517258240)]} 0 4
[junit4:junit4] 2> 1238972 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10028 (1438547450520403968)]} 0 1
[junit4:junit4] 2> 1238972 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10028 (1438547450520403968)]} 0 4
[junit4:junit4] 2> 1239045 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[29 (1438547450600095744)]} 0 1
[junit4:junit4] 2> 1239048 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10029 (1438547450603241472)]} 0 1
[junit4:junit4] 2> 1239051 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[29 (1438547450603241472)]} 0 1
[junit4:junit4] 2> 1239051 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[29 (1438547450603241472)]} 0 4
[junit4:junit4] 2> 1239055 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10029 (1438547450607435776)]} 0 1
[junit4:junit4] 2> 1239055 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10029 (1438547450607435776)]} 0 4
[junit4:junit4] 2> 1239095 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[30 (1438547450652524544)]} 0 1
[junit4:junit4] 2> 1239099 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10030 (1438547450656718848)]} 0 1
[junit4:junit4] 2> 1239102 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[30 (1438547450656718848)]} 0 1
[junit4:junit4] 2> 1239102 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[30 (1438547450656718848)]} 0 4
[junit4:junit4] 2> 1239105 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10030 (1438547450659864576)]} 0 1
[junit4:junit4] 2> 1239105 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10030 (1438547450659864576)]} 0 4
[junit4:junit4] 2> 1239144 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[29 (-1438547450704953344)]} 0 0
[junit4:junit4] 2> 1239147 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10029 (-1438547450708099072)]} 0 0
[junit4:junit4] 2> 1239149 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[29 (-1438547450708099072)]} 0 0
[junit4:junit4] 2> 1239150 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[29 (-1438547450708099072)]} 0 3
[junit4:junit4] 2> 1239152 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10029 (-1438547450711244800)]} 0 0
[junit4:junit4] 2> 1239153 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[31 (1438547450713341952)]} 0 1
[junit4:junit4] 2> 1239153 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10029 (-1438547450711244800)]} 0 3
[junit4:junit4] 2> 1239157 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10031 (1438547450717536256)]} 0 1
[junit4:junit4] 2> 1239160 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[31 (1438547450717536256)]} 0 1
[junit4:junit4] 2> 1239160 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[31 (1438547450717536256)]} 0 4
[junit4:junit4] 2> 1239163 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10031 (1438547450720681984)]} 0 1
[junit4:junit4] 2> 1239163 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10031 (1438547450720681984)]} 0 4
[junit4:junit4] 2> 1239191 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[31 (-1438547450754236416)]} 0 0
[junit4:junit4] 2> 1239193 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10031 (-1438547450756333568)]} 0 0
[junit4:junit4] 2> 1239196 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[31 (-1438547450757382144)]} 0 0
[junit4:junit4] 2> 1239197 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[31 (-1438547450757382144)]} 0 3
[junit4:junit4] 2> 1239198 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10031 (-1438547450759479296)]} 0 0
[junit4:junit4] 2> 1239199 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10031 (-1438547450759479296)]} 0 3
[junit4:junit4] 2> 1239201 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[32 (1438547450763673600)]} 0 1
[junit4:junit4] 2> 1239202 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10032 (1438547450764722176)]} 0 1
[junit4:junit4] 2> 1239207 T3042 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 31504
[junit4:junit4] 2> 1239207 T3042 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1768880862
[junit4:junit4] 2> 1239209 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[32 (1438547450767867904)]} 0 1
[junit4:junit4] 2> 1239209 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10032 (1438547450768916480)]} 0 1
[junit4:junit4] 2> 1239209 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[32 (1438547450767867904)]} 0 5
[junit4:junit4] 2> 1239210 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10032 (1438547450768916480)]} 0 5
[junit4:junit4] 2> 1239230 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[33 (1438547450794082304)]} 0 1
[junit4:junit4] 2> 1239230 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10033 (1438547450794082305)]} 0 1
[junit4:junit4] 2> 1239238 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[33 (1438547450798276608)]} 0 1
[junit4:junit4] 2> 1239238 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10033 (1438547450799325184)]} 0 1
[junit4:junit4] 2> 1239238 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[33 (1438547450798276608)]} 0 5
[junit4:junit4] 2> 1239239 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10033 (1438547450799325184)]} 0 5
[junit4:junit4] 2> 1239340 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10034 (1438547450909425664)]} 0 1
[junit4:junit4] 2> 1239340 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[34 (1438547450909425665)]} 0 1
[junit4:junit4] 2> 1239346 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10034 (1438547450912571392)]} 0 1
[junit4:junit4] 2> 1239346 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10034 (1438547450912571392)]} 0 4
[junit4:junit4] 2> 1239348 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[34 (1438547450914668544)]} 0 1
[junit4:junit4] 2> 1239348 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[34 (1438547450914668544)]} 0 4
[junit4:junit4] 2> 1239399 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10035 (1438547450971291648)]} 0 1
[junit4:junit4] 2> 1239400 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[35 (1438547450972340224)]} 0 1
[junit4:junit4] 2> 1239406 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[35 (1438547450975485953)]} 0 1
[junit4:junit4] 2> 1239406 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[35 (1438547450975485953)]} 0 4
[junit4:junit4] 2> 1239407 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10035 (1438547450975485952)]} 0 1
[junit4:junit4] 2> 1239407 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10035 (1438547450975485952)]} 0 5
[junit4:junit4] 2> 1239433 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10036 (1438547451006943232)]} 0 1
[junit4:junit4] 2> 1239433 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[36 (1438547451006943233)]} 0 1
[junit4:junit4] 2> 1239439 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10036 (1438547451010088960)]} 0 1
[junit4:junit4] 2> 1239439 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10036 (1438547451010088960)]} 0 4
[junit4:junit4] 2> 1239441 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[36 (1438547451012186112)]} 0 1
[junit4:junit4] 2> 1239441 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[36 (1438547451012186112)]} 0 4
[junit4:junit4] 2> 1239451 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10037 (1438547451025817600)]} 0 1
[junit4:junit4] 2> 1239453 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[37 (1438547451027914752)]} 0 1
[junit4:junit4] 2> 1239457 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10037 (1438547451028963328)]} 0 1
[junit4:junit4] 2> 1239457 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10037 (1438547451028963328)]} 0 4
[junit4:junit4] 2> 1239460 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[37 (1438547451031060480)]} 0 1
[junit4:junit4] 2> 1239460 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[37 (1438547451031060480)]} 0 5
[junit4:junit4] 2> 1239559 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10037 (-1438547451140112384)]} 0 0
[junit4:junit4] 2> 1239561 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[37 (-1438547451142209536)]} 0 0
[junit4:junit4] 2> 1239564 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10037 (-1438547451143258112)]} 0 0
[junit4:junit4] 2> 1239565 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10037 (-1438547451143258112)]} 0 3
[junit4:junit4] 2> 1239567 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[37 (-1438547451146403840)]} 0 0
[junit4:junit4] 2> 1239568 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[37 (-1438547451146403840)]} 0 3
[junit4:junit4] 2> 1239570 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10038 (1438547451150598144)]} 0 1
[junit4:junit4] 2> 1239573 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[38 (1438547451153743872)]} 0 1
[junit4:junit4] 2> 1239576 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10038 (1438547451153743872)]} 0 1
[junit4:junit4] 2> 1239576 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10038 (1438547451153743872)]} 0 4
[junit4:junit4] 2> 1239579 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[38 (1438547451156889600)]} 0 1
[junit4:junit4] 2> 1239579 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[38 (1438547451156889600)]} 0 4
[junit4:junit4] 2> 1239662 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10039 (1438547451247067136)]} 0 1
[junit4:junit4] 2> 1239665 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[39 (1438547451250212864)]} 0 1
[junit4:junit4] 2> 1239668 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10039 (1438547451250212864)]} 0 1
[junit4:junit4] 2> 1239668 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10039 (1438547451250212864)]} 0 4
[junit4:junit4] 2> 1239671 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[39 (1438547451253358592)]} 0 1
[junit4:junit4] 2> 1239671 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[39 (1438547451253358592)]} 0 4
[junit4:junit4] 2> 1239690 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10040 (1438547451276427264)]} 0 1
[junit4:junit4] 2> 1239693 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[40 (1438547451279572992)]} 0 1
[junit4:junit4] 2> 1239696 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10040 (1438547451279572992)]} 0 1
[junit4:junit4] 2> 1239696 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10040 (1438547451279572992)]} 0 4
[junit4:junit4] 2> 1239700 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[40 (1438547451283767296)]} 0 1
[junit4:junit4] 2> 1239700 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[40 (1438547451283767296)]} 0 4
[junit4:junit4] 2> 1239710 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10041 (1438547451297398784)]} 0 1
[junit4:junit4] 2> 1239715 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[41 (1438547451302641664)]} 0 1
[junit4:junit4] 2> 1239716 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10041 (1438547451300544512)]} 0 1
[junit4:junit4] 2> 1239716 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10041 (1438547451300544512)]} 0 4
[junit4:junit4] 2> 1239721 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[41 (1438547451305787392)]} 0 1
[junit4:junit4] 2> 1239721 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[41 (1438547451305787392)]} 0 4
[junit4:junit4] 2> 1239801 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10042 (1438547451392819200)]} 0 1
[junit4:junit4] 2> 1239807 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10042 (1438547451395964928)]} 0 1
[junit4:junit4] 2> 1239807 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[42 (1438547451399110656)]} 0 1
[junit4:junit4] 2> 1239807 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10042 (1438547451395964928)]} 0 4
[junit4:junit4] 2> 1239814 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[42 (1438547451403304960)]} 0 1
[junit4:junit4] 2> 1239814 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[42 (1438547451403304960)]} 0 4
[junit4:junit4] 2> 1239899 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10039 (-1438547451496628224)]} 0 0
[junit4:junit4] 2> 1239904 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10039 (-1438547451499773952)]} 0 0
[junit4:junit4] 2> 1239905 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10039 (-1438547451499773952)]} 0 3
[junit4:junit4] 2> 1239906 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[39 (-1438547451503968256)]} 0 0
[junit4:junit4] 2> 1239909 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10043 (1438547451506065408)]} 0 1
[junit4:junit4] 2> 1239911 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[39 (-1438547451507113984)]} 0 0
[junit4:junit4] 2> 1239912 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[39 (-1438547451507113984)]} 0 3
[junit4:junit4] 2> 1239915 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10043 (1438547451509211136)]} 0 1
[junit4:junit4] 2> 1239915 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10043 (1438547451509211136)]} 0 4
[junit4:junit4] 2> 1239917 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[43 (1438547451514454016)]} 0 1
[junit4:junit4] 2> 1239923 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[43 (1438547451517599744)]} 0 1
[junit4:junit4] 2> 1239923 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[43 (1438547451517599744)]} 0 4
[junit4:junit4] 2> 1240000 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10041 (-1438547451602534400)]} 0 0
[junit4:junit4] 2> 1240005 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10041 (-1438547451605680128)]} 0 0
[junit4:junit4] 2> 1240006 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10041 (-1438547451605680128)]} 0 3
[junit4:junit4] 2> 1240008 T3055 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[41 (-1438547451610923008)]} 0 0
[junit4:junit4] 2> 1240010 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10044 (1438547451611971584)]} 0 1
[junit4:junit4] 2> 1240013 T3091 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[41 (-1438547451614068736)]} 0 0
[junit4:junit4] 2> 1240014 T3075 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[41 (-1438547451614068736)]} 0 3
[junit4:junit4] 2> 1240017 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10044 (1438547451616165888)]} 0 1
[junit4:junit4] 2> 1240017 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10044 (1438547451616165888)]} 0 4
[junit4:junit4] 2> 1240018 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[44 (1438547451620360192)]} 0 1
[junit4:junit4] 2> 1240024 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[44 (1438547451623505920)]} 0 1
[junit4:junit4] 2> 1240024 T3076 C530 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[44 (1438547451623505920)]} 0 4
[junit4:junit4] 2> 1240067 T3054 C529 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10045 (1438547451671740416)]} 0 1
[junit4:junit4] 2> 1240073 T3090 C528 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10045 (1438547451674886144)]} 0 1
[junit4:junit4] 2> ASYNC NEW_CORE C531 name=collection1 org.apache.solr.core.SolrCore@65e3ec36 url=http://127.0.0.1:10817/collection1 node=127.0.0.1:10817_ C531_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:10817_, base_url=http://127.0.0.1:10817, leader=true}
[junit4:junit4] 2> 1240073 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10045 (1438547451674886144)]} 0 4
[junit4:junit4] 2> ASYNC NEW_CORE C532 name=collection1 org.apache.solr.core.SolrCore@7e54ea77 url=http://127.0.0.1:60630/collection1 node=127.0.0.1:60630_ C532_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:60630_, base_url=http://127.0.0.1:60630, leader=true}
[junit4:junit4] 2> 1240090 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[45 (1438547451679080448)]} 0 17
[junit4:junit4] 2> ASYNC NEW_CORE C533 name=collection1 org.apache.solr.core.SolrCore@55a6d031 url=http://127.0.0.1:31504/collection1 node=127.0.0.1:31504_ C533_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:31504_, base_url=http://127.0.0.1:31504}
[junit4:junit4] 2> 1240097 T3090 C533 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[45 (1438547451700051968)]} 0 1
[junit4:junit4] 2> 1240097 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[45 (1438547451700051968)]} 0 4
[junit4:junit4] 2> 1240112 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10043 (-1438547451719974912)]} 0 0
[junit4:junit4] 2> 1240118 T3090 C533 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[10043 (-1438547451723120640)]} 0 0
[junit4:junit4] 2> 1240119 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10043 (-1438547451723120640)]} 0 4
[junit4:junit4] 2> 1240120 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[43 (-1438547451728363520)]} 0 0
[junit4:junit4] 2> 1240123 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10046 (1438547451730460672)]} 0 1
[junit4:junit4] 2> 1240125 T3090 C533 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {delete=[43 (-1438547451731509248)]} 0 0
[junit4:junit4] 2> 1240126 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[43 (-1438547451731509248)]} 0 3
[junit4:junit4] 2> 1240129 T3090 C533 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10046 (1438547451733606400)]} 0 1
[junit4:junit4] 2> 1240129 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10046 (1438547451733606400)]} 0 4
[junit4:junit4] 2> 1240130 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[46 (1438547451737800704)]} 0 1
[junit4:junit4] 2> 1240137 T3090 C533 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[46 (1438547451740946432)]} 0 1
[junit4:junit4] 2> 1240137 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[46 (1438547451740946432)]} 0 5
[junit4:junit4] 2> 1240192 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10047 (1438547451802812416)]} 0 1
[junit4:junit4] 2> 1240198 T3090 C533 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10047 (1438547451805958144)]} 0 1
[junit4:junit4] 2> 1240198 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10047 (1438547451805958144)]} 0 4
[junit4:junit4] 2> 1240199 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[47 (1438547451810152448)]} 0 1
[junit4:junit4] 2> 1240205 T3090 C533 P31504 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:10817/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[47 (1438547451813298176)]} 0 1
[junit4:junit4] 2> 1240205 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[47 (1438547451813298176)]} 0 4
[junit4:junit4] 2> 1240209 T3103 C533 P31504 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:10817/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1240209 T3103 C533 P31504 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:31504 START replicas=[http://127.0.0.1:10817/collection1/] nUpdates=100
[junit4:junit4] 2> 1240210 T3103 C533 P31504 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1240210 T3103 C533 P31504 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1240210 T3103 C533 P31504 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1240211 T3103 C533 P31504 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1240211 T3103 C533 P31504 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=tlog{file=./org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty2/tlog/tlog.0000000000000000000 refcount=1}}
[junit4:junit4] 2> 1240211 T3103 C533 P31504 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:10817/collection1/. core=collection1
[junit4:junit4] 2> 1240211 T3077 C531 P10817 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 1240211 T3103 C533 P31504 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1240223 T3078 C531 P10817 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1240238 T3078 C531 P10817 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@38c9d6b2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@237d7328),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@38c9d6b2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@237d7328),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1240238 T3078 C531 P10817 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1240241 T3078 C531 P10817 oass.SolrIndexSearcher.<init> Opening Searcher@46768b7b realtime
[junit4:junit4] 2> 1240241 T3065 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1240241 T3078 C531 P10817 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1240242 T3078 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 19
[junit4:junit4] 2> 1240242 T3065 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:31504__collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:31504_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:31504"}
[junit4:junit4] 2> 1240243 T3103 C533 P31504 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1240243 T3103 C533 P31504 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1240246 T3079 C531 P10817 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1240246 T3079 C531 P10817 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 1240247 T3103 C533 P31504 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1240247 T3103 C533 P31504 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1240247 T3103 C533 P31504 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1240249 T3079 C531 P10817 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1240250 T3103 C533 P31504 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 5
[junit4:junit4] 2> 1240251 T3103 C533 P31504 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty2/index.20130622085557775
[junit4:junit4] 2> 1240251 T3103 C533 P31504 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@1c409af9 lockFactory=org.apache.lucene.store.NativeFSLockFactory@183aa7d0) fullCopy=false
[junit4:junit4] 2> 1240254 T3079 C531 P10817 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=_0.cfs&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1240258 T3100 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1240258 T3079 C531 P10817 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=_0.cfe&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1240258 T3064 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1240258 T3071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1240258 T3084 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1240262 T3079 C531 P10817 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1240265 T3079 C531 P10817 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=_0_1.del&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1240268 T3079 C531 P10817 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=_0.si&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> C533_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=down, core=collection1, collection=collection1, node_name=127.0.0.1:31504_, base_url=http://127.0.0.1:31504}
[junit4:junit4] 2> 1240269 T3103 C533 P31504 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1240270 T3103 C533 P31504 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1240270 T3103 C533 P31504 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1240270 T3103 C533 P31504 oasu.DefaultSolrCoreState.newIndexWriter Closing old IndexWriter... core=collection1
[junit4:junit4] 2> 1240285 T3103 C533 P31504 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7376134 lockFactory=org.apache.lucene.store.NativeFSLockFactory@54e038e6),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7376134 lockFactory=org.apache.lucene.store.NativeFSLockFactory@54e038e6),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1240285 T3103 C533 P31504 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1240289 T3103 C533 P31504 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7376134 lockFactory=org.apache.lucene.store.NativeFSLockFactory@54e038e6),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1240289 T3103 C533 P31504 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1240289 T3103 C533 P31504 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1240291 T3103 C533 P31504 oass.SolrIndexSearcher.<init> Opening Searcher@7945a4e2 main
[junit4:junit4] 2> 1240292 T3102 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7945a4e2 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c94/38)}
[junit4:junit4] 2> 1240293 T3103 C533 P31504 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty2/index.20130622085557775 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty2/index.20130622085557775;done=true>>]
[junit4:junit4] 2> 1240293 T3103 C533 P31504 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty2/index.20130622085557775
[junit4:junit4] 2> 1240294 T3103 C533 P31504 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty2/index.20130622085557775
[junit4:junit4] 2> 1240300 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10048 (1438547451916058624)]} 0 1
[junit4:junit4] 2> 1240301 T3103 C533 P31504 oasc.RecoveryStrategy.replay Replaying buffered documents. core=collection1
[junit4:junit4] 2> 1240301 T3111 C533 P31504 oasu.UpdateLog$LogReplayer.doReplay WARN Starting log replay tlog{file=./org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty2/tlog/tlog.0000000000000000000 refcount=2} active=true starting pos=10471
[junit4:junit4] 2> 1240305 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10048 (1438547451920252928)]} 0 2
[junit4:junit4] 2> 1240307 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[48 (1438547451923398656)]} 0 1
[junit4:junit4] 2> 1240307 T3111 C533 P31504 oasu.DirectUpdateHandler2.commit start commit{flags=2,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1240308 T3111 C533 P31504 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7376134 lockFactory=org.apache.lucene.store.NativeFSLockFactory@54e038e6),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7376134 lockFactory=org.apache.lucene.store.NativeFSLockFactory@54e038e6),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1240309 T3111 C533 P31504 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1240309 T3111 C533 P31504 oass.SolrIndexSearcher.<init> Opening Searcher@3875c394 main
[junit4:junit4] 2> 1240310 T3111 C533 P31504 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1240310 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[48 (1438547451926544384)]} 0 1
[junit4:junit4] 2> 1240310 T3102 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3875c394 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c94/38)}
[junit4:junit4] 2> 1240311 T3111 C533 P31504 oasup.LogUpdateProcessor.finish [collection1] {} 0 10
[junit4:junit4] 2> 1240311 T3111 C533 P31504 oasu.UpdateLog$LogReplayer.run WARN Log replay finished. recoveryInfo=RecoveryInfo{adds=0 deletes=0 deleteByQuery=0 errors=0 positionOfStart=10471}
[junit4:junit4] 2> 1240312 T3103 C533 P31504 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1240312 T3103 C533 P31504 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1240312 T3103 C533 P31504 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1240314 T3103 C533 P31504 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1240334 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10044 (-1438547451952758784)]} 0 0
[junit4:junit4] 2> 1240337 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10044 (-1438547451955904512)]} 0 0
[junit4:junit4] 2> 1240339 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[44 (-1438547451958001664)]} 0 0
[junit4:junit4] 2> 1240341 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10049 (1438547451959050240)]} 0 1
[junit4:junit4] 2> 1240342 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[44 (-1438547451961147392)]} 0 0
[junit4:junit4] 2> 1240344 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10049 (1438547451962195968)]} 0 1
[junit4:junit4] 2> 1240346 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[49 (1438547451964293120)]} 0 1
[junit4:junit4] 2> 1240349 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[49 (1438547451967438848)]} 0 1
[junit4:junit4] 2> 1240417 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10045 (-1438547452039790592)]} 0 0
[junit4:junit4] 2> 1240420 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10045 (-1438547452042936320)]} 0 0
[junit4:junit4] 2> 1240422 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[45 (-1438547452045033472)]} 0 0
[junit4:junit4] 2> 1240424 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10050 (1438547452046082048)]} 0 1
[junit4:junit4] 2> 1240425 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[45 (-1438547452048179200)]} 0 0
[junit4:junit4] 2> 1240427 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10050 (1438547452049227776)]} 0 1
[junit4:junit4] 2> 1240430 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[50 (1438547452052373504)]} 0 1
[junit4:junit4] 2> 1240433 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[50 (1438547452055519232)]} 0 1
[junit4:junit4] 2> 1240497 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10046 (-1438547452123676672)]} 0 0
[junit4:junit4] 2> 1240500 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10046 (-1438547452126822400)]} 0 0
[junit4:junit4] 2> 1240503 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[46 (-1438547452129968129)]} 0 0
[junit4:junit4] 2> 1240504 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10051 (1438547452129968128)]} 0 1
[junit4:junit4] 2> 1240506 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[46 (-1438547452133113856)]} 0 0
[junit4:junit4] 2> 1240507 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10051 (1438547452133113857)]} 0 1
[junit4:junit4] 2> 1240510 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[51 (1438547452136259584)]} 0 1
[junit4:junit4] 2> 1240514 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[51 (1438547452140453888)]} 0 1
[junit4:junit4] 2> 1240587 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10052 (1438547452216999936)]} 0 1
[junit4:junit4] 2> 1240590 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10052 (1438547452220145664)]} 0 1
[junit4:junit4] 2> 1240594 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[52 (1438547452224339968)]} 0 1
[junit4:junit4] 2> 1240598 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[52 (1438547452228534272)]} 0 1
[junit4:junit4] 2> 1240615 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10047 (-1438547452247408640)]} 0 0
[junit4:junit4] 2> 1240618 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10047 (-1438547452250554368)]} 0 0
[junit4:junit4] 2> 1240622 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[47 (-1438547452254748672)]} 0 0
[junit4:junit4] 2> 1240623 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10053 (1438547452254748673)]} 0 1
[junit4:junit4] 2> 1240625 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[47 (-1438547452257894401)]} 0 0
[junit4:junit4] 2> 1240626 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10053 (1438547452257894400)]} 0 1
[junit4:junit4] 2> 1240630 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[53 (1438547452262088704)]} 0 1
[junit4:junit4] 2> 1240633 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[53 (1438547452265234432)]} 0 1
[junit4:junit4] 2> 1240650 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10049 (-1438547452284108800)]} 0 0
[junit4:junit4] 2> 1240653 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10049 (-1438547452287254528)]} 0 0
[junit4:junit4] 2> 1240657 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10054 (1438547452290400256)]} 0 1
[junit4:junit4] 2> 1240658 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[49 (-1438547452292497408)]} 0 0
[junit4:junit4] 2> 1240660 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10054 (1438547452293545984)]} 0 1
[junit4:junit4] 2> 1240661 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[49 (-1438547452295643136)]} 0 0
[junit4:junit4] 2> 1240665 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[54 (1438547452298788864)]} 0 1
[junit4:junit4] 2> 1240669 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[54 (1438547452302983168)]} 0 1
[junit4:junit4] 2> 1240707 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10055 (1438547452342829056)]} 0 1
[junit4:junit4] 2> 1240711 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10055 (1438547452347023360)]} 0 1
[junit4:junit4] 2> 1240715 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[55 (1438547452351217664)]} 0 1
[junit4:junit4] 2> 1240718 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[55 (1438547452354363392)]} 0 1
[junit4:junit4] 2> 1240764 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10056 (1438547452402597888)]} 0 1
[junit4:junit4] 2> 1240767 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10056 (1438547452405743616)]} 0 1
[junit4:junit4] 2> 1240771 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[56 (1438547452409937920)]} 0 1
[junit4:junit4] 2> 1240775 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[56 (1438547452414132224)]} 0 1
[junit4:junit4] 2> 1240795 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10050 (-1438547452436152320)]} 0 0
[junit4:junit4] 2> 1240798 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10050 (-1438547452439298048)]} 0 0
[junit4:junit4] 2> 1240803 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10057 (1438547452443492352)]} 0 1
[junit4:junit4] 2> 1240805 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[50 (-1438547452446638080)]} 0 0
[junit4:junit4] 2> 1240806 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10057 (1438547452446638080)]} 0 1
[junit4:junit4] 2> 1240809 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[50 (-1438547452450832384)]} 0 0
[junit4:junit4] 2> 1240813 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[57 (1438547452453978112)]} 0 1
[junit4:junit4] 2> 1240816 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[57 (1438547452457123840)]} 0 1
[junit4:junit4] 2> 1240863 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10053 (-1438547452507455488)]} 0 0
[junit4:junit4] 2> 1240866 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10053 (-1438547452510601216)]} 0 0
[junit4:junit4] 2> 1240870 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10058 (1438547452513746944)]} 0 1
[junit4:junit4] 2> 1240872 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[53 (-1438547452516892672)]} 0 0
[junit4:junit4] 2> 1240873 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10058 (1438547452516892672)]} 0 1
[junit4:junit4] 2> 1240875 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10054 (-1438547452520038400)]} 0 0
[junit4:junit4] 2> 1240875 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[53 (-1438547452520038400)]} 0 0
[junit4:junit4] 2> 1240878 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10054 (-1438547452523184128)]} 0 0
[junit4:junit4] 2> 1240879 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[58 (1438547452523184128)]} 0 1
[junit4:junit4] 2> 1240883 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[58 (1438547452527378432)]} 0 1
[junit4:junit4] 2> 1240883 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10059 (1438547452527378432)]} 0 1
[junit4:junit4] 2> 1240885 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[54 (-1438547452530524160)]} 0 0
[junit4:junit4] 2> 1240887 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10059 (1438547452531572736)]} 0 1
[junit4:junit4] 2> 1240889 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[54 (-1438547452534718464)]} 0 0
[junit4:junit4] 2> 1240894 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[59 (1438547452538912768)]} 0 1
[junit4:junit4] 2> 1240897 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[59 (1438547452542058496)]} 0 1
[junit4:junit4] 2> 1240916 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10058 (-1438547452563030016)]} 0 0
[junit4:junit4] 2> 1240920 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10058 (-1438547452567224320)]} 0 0
[junit4:junit4] 2> 1240924 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10060 (1438547452570370048)]} 0 1
[junit4:junit4] 2> 1240926 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[58 (-1438547452573515776)]} 0 0
[junit4:junit4] 2> 1240928 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10060 (1438547452574564352)]} 0 1
[junit4:junit4] 2> 1240929 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[58 (-1438547452576661504)]} 0 0
[junit4:junit4] 2> 1240933 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[60 (1438547452579807232)]} 0 1
[junit4:junit4] 2> 1240936 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[60 (1438547452582952960)]} 0 1
[junit4:junit4] 2> 1240981 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10061 (1438547452630138880)]} 0 1
[junit4:junit4] 2> 1240985 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10061 (1438547452634333184)]} 0 1
[junit4:junit4] 2> 1240989 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[61 (1438547452638527488)]} 0 1
[junit4:junit4] 2> 1240992 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[61 (1438547452641673216)]} 0 1
[junit4:junit4] 2> 1241054 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10062 (1438547452706684928)]} 0 1
[junit4:junit4] 2> 1241057 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10062 (1438547452709830656)]} 0 1
[junit4:junit4] 2> 1241060 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[62 (1438547452712976384)]} 0 1
[junit4:junit4] 2> 1241063 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[62 (1438547452716122112)]} 0 1
[junit4:junit4] 2> 1241149 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10063 (1438547452806299648)]} 0 1
[junit4:junit4] 2> 1241152 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10063 (1438547452809445376)]} 0 1
[junit4:junit4] 2> 1241156 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[63 (1438547452813639680)]} 0 1
[junit4:junit4] 2> 1241160 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[63 (1438547452817833984)]} 0 1
[junit4:junit4] 2> 1241177 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10064 (1438547452835659776)]} 0 1
[junit4:junit4] 2> 1241180 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10064 (1438547452838805504)]} 0 1
[junit4:junit4] 2> 1241185 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[64 (1438547452844048384)]} 0 1
[junit4:junit4] 2> 1241188 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[64 (1438547452847194112)]} 0 1
[junit4:junit4] 2> 1241275 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10063 (-1438547452939468800)]} 0 0
[junit4:junit4] 2> 1241278 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10063 (-1438547452942614528)]} 0 0
[junit4:junit4] 2> 1241282 T3054 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10065 (1438547452945760256)]} 0 1
[junit4:junit4] 2> 1241283 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[63 (-1438547452947857408)]} 0 0
[junit4:junit4] 2> 1241285 T3075 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10065 (1438547452948905984)]} 0 1
[junit4:junit4] 2> 1241286 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[63 (-1438547452951003136)]} 0 0
[junit4:junit4] 2> 1241290 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[65 (1438547452954148864)]} 0 1
[junit4:junit4] 2> 1241293 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[65 (1438547452957294592)]} 0 1
[junit4:junit4] 2> 1241380 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10066 (1438547453048520704)]} 0 1
[junit4:junit4] 2> 1241384 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10066 (1438547453052715008)]} 0 1
[junit4:junit4] 2> 1241390 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[66 (1438547453059006464)]} 0 1
[junit4:junit4] 2> 1241393 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[66 (1438547453062152192)]} 0 1
[junit4:junit4] 2> 1241405 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10067 (1438547453074735104)]} 0 1
[junit4:junit4] 2> 1241408 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10067 (1438547453077880832)]} 0 1
[junit4:junit4] 2> 1241413 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[67 (1438547453083123712)]} 0 1
[junit4:junit4] 2> 1241416 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[67 (1438547453086269440)]} 0 1
[junit4:junit4] 2> 1241503 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10065 (-1438547453178544128)]} 0 0
[junit4:junit4] 2> 1241506 T3076 C531 P10817 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {delete=[10065 (-1438547453181689856)]} 0 0
[junit4:junit4] 2> 1241510 T3055 C532 P60630 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[10068 (1438547453184835584)]} 0 1
[junit4:junit4] 2> 1241512 T3054 C532 P60630
[...truncated too long message...]
cStrategy.syncToMe http://127.0.0.1:31504/collection1/ has no replicas
[junit4:junit4] 2> 1337607 T3124 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:31504/collection1/
[junit4:junit4] 2> 1337607 T3124 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1337609 T3136 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:10817__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:10817_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:10817"}
[junit4:junit4] 2> 1337624 T3124 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4] 2> 1337624 T3124 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1337625 T3124 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1337634 T3042 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 31504
[junit4:junit4] 2> 1337634 T3042 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1685972303
[junit4:junit4] 2> 1338636 T3042 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1338636 T3042 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1338643 T3042 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@6ae13d5e
[junit4:junit4] 2> 1338650 T3042 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=43,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=44,cumulative_deletesById=22,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 1338651 T3042 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 1338651 T3042 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 1338652 T3042 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 1338654 T3042 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 1338655 T3042 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 1338655 T3042 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty2/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty2/index;done=false>>]
[junit4:junit4] 2> 1338656 T3042 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty2/index
[junit4:junit4] 2> 1338656 T3042 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty2 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty2;done=false>>]
[junit4:junit4] 2> 1338656 T3042 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.RecoveryZkTest-1371905739795/jetty2
[junit4:junit4] 2> 1338658 T3136 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89909214563729418-127.0.0.1:31504_-n_0000000003) am no longer a leader.
[junit4:junit4] 2> 1338659 T3042 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 1338725 T3042 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 1338727 T3042 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:26370 26370
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 1> safe stop:
[junit4:junit4] 1> safe stop:
[junit4:junit4] 1> safe stop:
[junit4:junit4] 1> safe stop:
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=RecoveryZkTest -Dtests.method=testDistribSearch -Dtests.seed=20A86B6850A159DE -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=de_LU -Dtests.timezone=America/Iqaluit -Dtests.file.encoding=US-ASCII
[junit4:junit4] FAILURE 117s J0 | RecoveryZkTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: expected:<230> but was:<42>
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([20A86B6850A159DE:A14EE57027FE39E2]:0)
[junit4:junit4] > at org.apache.solr.cloud.RecoveryZkTest.doTest(RecoveryZkTest.java:108)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 1338919 T3042 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 116659 T3041 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> 1339959 T3124 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1339959 T3124 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1339959 T3124 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {range_facet_l=MockVariableIntBlock(baseBlockSize=43), text=MockFixedIntBlock(blockSize=1694), _version_=MockVariableIntBlock(baseBlockSize=43), rnd_b=PostingsFormat(name=MockRandom), intDefault=MockVariableIntBlock(baseBlockSize=43), timestamp=MockVariableIntBlock(baseBlockSize=43), id=PostingsFormat(name=MockRandom), a_t=MockVariableIntBlock(baseBlockSize=43), range_facet_sl=MockFixedIntBlock(blockSize=1694), range_facet_si=PostingsFormat(name=Direct), other_tl1=MockVariableIntBlock(baseBlockSize=43), multiDefault=PostingsFormat(name=Direct), a_si=PostingsFormat(name=Direct)}, docValues:{timestamp=DocValuesFormat(name=Asserting)}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=de_LU, timezone=America/Iqaluit
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=1,free=202514144,total=378535936
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestDocSet, PeerSyncTest, DocumentBuilderTest, TermVectorComponentTest, TestStressVersions, MBeansHandlerTest, TestSolrIndexConfig, QueryParsingTest, QueryElevationComponentTest, TestPluginEnable, QueryEqualityTest, TestRemoteStreaming, TestSort, TestExtendedDismaxParser, ChaosMonkeyNothingIsSafeTest, TestFunctionQuery, ZkControllerTest, DirectSolrConnectionTest, ScriptEngineTest, SchemaVersionSpecificBehaviorTest, AlternateDirectoryTest, TestSchemaSimilarityResource, SynonymTokenizerTest, TestRealTimeGet, PreAnalyzedFieldTest, TestRandomDVFaceting, BinaryUpdateRequestHandlerTest, TestPHPSerializedResponseWriter, TestReversedWildcardFilterFactory, TestCloudManagedSchemaAddField, SliceStateUpdateTest, RegexBoostProcessorTest, MinimalSchemaTest, FileBasedSpellCheckerTest, MoreLikeThisHandlerTest, QueryResultKeyTest, TestLFUCache, SOLR749Test, TestTrie, OverseerTest, BadCopyFieldTest, TestStressRecovery, WordBreakSolrSpellCheckerTest, TestSearchPerf, BadComponentTest, DistributedQueryElevationComponentTest, TestSurroundQueryParser, TestSolrXmlPersistence, DocValuesTest, CircularListTest, SyncSliceTest, TestWriterPerf, DistributedTermsComponentTest, TestFieldCollectionResource, ShardRoutingTest, TestClassNameShortening, TestManagedSchema, TestCoreContainer, UUIDFieldTest, TestUniqueKeyFieldResource, TestPropInjectDefaults, TestQueryUtils, SimpleFacetsTest, TestSolrQueryParser, StatelessScriptUpdateProcessorFactoryTest, TestFaceting, ExternalFileFieldSortTest, SpatialFilterTest, TestReplicationHandler, UpdateRequestProcessorFactoryTest, LeaderElectionIntegrationTest, RecoveryZkTest]
[junit4:junit4] Completed on J0 in 117.95s, 1 test, 1 failure <<< FAILURES!
[...truncated 440 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:386: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:366: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:1243: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:887: There were test failures: 297 suites, 1253 tests, 1 failure, 13 ignored (7 assumptions)
Total time: 53 minutes 3 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 4082 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/4082/
1 tests failed.
FAILED: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:36374 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:36374 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([70CEC0CBAE29106C:F1284ED3D9767050]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:228)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:150)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 10043 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4:junit4] 2> 1786505 T3541 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 1786511 T3541 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./solrtest-ShardSplitTest-1371876534539
[junit4:junit4] 2> 1786513 T3541 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 1786514 T3542 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 1786614 T3541 oasc.ZkTestServer.run start zk server on port:36364
[junit4:junit4] 2> 1786615 T3541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1786629 T3548 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@74f81ced name:ZooKeeperConnection Watcher:127.0.0.1:36364 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1786629 T3541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1786630 T3541 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 1786731 T3541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1786775 T3550 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6f0400c8 name:ZooKeeperConnection Watcher:127.0.0.1:36364/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1786775 T3541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1786776 T3541 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 1786841 T3541 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 1786844 T3541 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 1786876 T3541 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 1786885 T3541 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1786886 T3541 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1786990 T3541 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 1786992 T3541 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 1787098 T3541 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1787100 T3541 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1787109 T3541 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 1787109 T3541 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 1787140 T3541 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 1787141 T3541 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 1787147 T3541 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1787148 T3541 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1787172 T3541 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1787174 T3541 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1787181 T3541 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1787181 T3541 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1787214 T3541 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1787215 T3541 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1787498 T3541 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1787504 T3541 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:36370
[junit4:junit4] 2> 1787505 T3541 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1787505 T3541 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1787506 T3541 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371876535258
[junit4:junit4] 2> 1787507 T3541 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371876535258/solr.xml
[junit4:junit4] 2> 1787507 T3541 oasc.CoreContainer.<init> New CoreContainer 1453975974
[junit4:junit4] 2> 1787508 T3541 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371876535258/'
[junit4:junit4] 2> 1787509 T3541 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371876535258/'
[junit4:junit4] 2> 1787638 T3541 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1787639 T3541 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1787640 T3541 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1787641 T3541 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1787641 T3541 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1787642 T3541 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1787642 T3541 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1787643 T3541 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1787643 T3541 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1787644 T3541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1787662 T3541 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1787663 T3541 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36364/solr
[junit4:junit4] 2> 1787664 T3541 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1787665 T3541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1787668 T3561 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@55614772 name:ZooKeeperConnection Watcher:127.0.0.1:36364 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1787669 T3541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1787698 T3541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1787710 T3541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1787718 T3563 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ab86b8b name:ZooKeeperConnection Watcher:127.0.0.1:36364/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1787718 T3541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1787771 T3541 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 1787857 T3541 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 1787860 T3541 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 1787894 T3541 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36370_
[junit4:junit4] 2> 1787896 T3541 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36370_
[junit4:junit4] 2> 1787932 T3541 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 1788013 T3541 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 1788016 T3541 oasc.Overseer.start Overseer (id=89907300568072195-127.0.0.1:36370_-n_0000000000) starting
[junit4:junit4] 2> 1788087 T3541 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 1788169 T3565 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 1788169 T3541 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 1788225 T3541 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 1788238 T3541 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1788241 T3564 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 1788246 T3566 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1788247 T3566 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1789745 T3564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1789746 T3564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:36370_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36370"}
[junit4:junit4] 2> 1789747 T3564 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1789747 T3564 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1789790 T3563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1790279 T3566 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371876535258/collection1
[junit4:junit4] 2> 1790279 T3566 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 1790280 T3566 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1790280 T3566 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 1790282 T3566 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371876535258/collection1/'
[junit4:junit4] 2> 1790284 T3566 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-controljetty-1371876535258/collection1/lib/README' to classloader
[junit4:junit4] 2> 1790284 T3566 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-controljetty-1371876535258/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1790341 T3566 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1790407 T3566 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1790509 T3566 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1790515 T3566 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1791107 T3566 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1791111 T3566 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1791114 T3566 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1791119 T3566 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1791140 T3566 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1791141 T3566 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-controljetty-1371876535258/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1371876534539/control/data/
[junit4:junit4] 2> 1791141 T3566 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ff60846
[junit4:junit4] 2> 1791142 T3566 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1791142 T3566 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371876534539/control/data
[junit4:junit4] 2> 1791143 T3566 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1371876534539/control/data/index/
[junit4:junit4] 2> 1791143 T3566 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1371876534539/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1791143 T3566 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371876534539/control/data/index
[junit4:junit4] 2> 1791148 T3566 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4d7d4937 lockFactory=org.apache.lucene.store.NativeFSLockFactory@d422c4b),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1791149 T3566 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1791152 T3566 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1791152 T3566 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1791153 T3566 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1791154 T3566 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1791155 T3566 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1791155 T3566 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1791155 T3566 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1791156 T3566 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1791157 T3566 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1791174 T3566 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1791181 T3566 oass.SolrIndexSearcher.<init> Opening Searcher@acad01 main
[junit4:junit4] 2> 1791182 T3566 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1371876534539/control/data/tlog
[junit4:junit4] 2> 1791185 T3566 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1791185 T3566 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1791189 T3567 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@acad01 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1791190 T3566 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1791190 T3566 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36370 collection:control_collection shard:shard1
[junit4:junit4] 2> 1791191 T3566 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 1791231 T3566 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1791260 T3566 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1791260 T3566 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1791261 T3566 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:36370/collection1/
[junit4:junit4] 2> 1791261 T3566 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1791261 T3566 oasc.SyncStrategy.syncToMe http://127.0.0.1:36370/collection1/ has no replicas
[junit4:junit4] 2> 1791262 T3566 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:36370/collection1/
[junit4:junit4] 2> 1791262 T3566 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 1791316 T3564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1791358 T3563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1791396 T3566 oasc.ZkController.register We are http://127.0.0.1:36370/collection1/ and leader is http://127.0.0.1:36370/collection1/
[junit4:junit4] 2> 1791396 T3566 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36370
[junit4:junit4] 2> 1791396 T3566 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1791397 T3566 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1791397 T3566 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1791402 T3566 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1791404 T3541 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1791404 T3541 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1791405 T3541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1791423 T3541 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 1791425 T3541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1791432 T3570 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@46852b5f name:ZooKeeperConnection Watcher:127.0.0.1:36364/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1791432 T3541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1791433 T3541 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1791435 T3541 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 1791706 T3541 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1791711 T3541 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:36374
[junit4:junit4] 2> 1791712 T3541 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1791712 T3541 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1791713 T3541 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371876539463
[junit4:junit4] 2> 1791713 T3541 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371876539463/solr.xml
[junit4:junit4] 2> 1791714 T3541 oasc.CoreContainer.<init> New CoreContainer 1597052914
[junit4:junit4] 2> 1791715 T3541 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371876539463/'
[junit4:junit4] 2> 1791715 T3541 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371876539463/'
[junit4:junit4] 2> 1791848 T3541 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1791850 T3541 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1791850 T3541 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1791851 T3541 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1791851 T3541 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1791852 T3541 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1791852 T3541 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1791853 T3541 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1791854 T3541 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1791854 T3541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1791872 T3541 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1791873 T3541 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36364/solr
[junit4:junit4] 2> 1791874 T3541 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1791875 T3541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1791886 T3581 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1937c295 name:ZooKeeperConnection Watcher:127.0.0.1:36364 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1791887 T3541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1791957 T3541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1791970 T3541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1791973 T3583 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5c1dcc9a name:ZooKeeperConnection Watcher:127.0.0.1:36364/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1791973 T3541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1792026 T3541 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1792892 T3564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1792893 T3564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:36370_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36370"}
[junit4:junit4] 2> 1792931 T3563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1792931 T3583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1792931 T3570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1793030 T3541 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36374_
[junit4:junit4] 2> 1793035 T3541 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36374_
[junit4:junit4] 2> 1793079 T3570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1793079 T3563 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1793079 T3583 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1793079 T3563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1793080 T3583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1793080 T3570 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1793097 T3584 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1793098 T3584 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1794435 T3564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1794436 T3564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:36374_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36374"}
[junit4:junit4] 2> 1794436 T3564 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 1794437 T3564 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1794473 T3583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1794473 T3570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1794473 T3563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1795137 T3584 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371876539463/collection1
[junit4:junit4] 2> 1795137 T3584 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1795138 T3584 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1795138 T3584 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1795140 T3584 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371876539463/collection1/'
[junit4:junit4] 2> 1795141 T3584 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty1-1371876539463/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1795142 T3584 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty1-1371876539463/collection1/lib/README' to classloader
[junit4:junit4] 2> 1795197 T3584 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1795258 T3584 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1795360 T3584 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1795366 T3584 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1795969 T3584 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1795973 T3584 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1795975 T3584 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1795980 T3584 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1796000 T3584 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1796001 T3584 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty1-1371876539463/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty1/
[junit4:junit4] 2> 1796001 T3584 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ff60846
[junit4:junit4] 2> 1796002 T3584 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1796003 T3584 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty1
[junit4:junit4] 2> 1796003 T3584 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty1/index/
[junit4:junit4] 2> 1796003 T3584 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1796004 T3584 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty1/index
[junit4:junit4] 2> 1796008 T3584 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6f8588ed lockFactory=org.apache.lucene.store.NativeFSLockFactory@55df7b19),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1796008 T3584 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1796012 T3584 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1796012 T3584 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1796013 T3584 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1796014 T3584 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1796014 T3584 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1796015 T3584 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1796015 T3584 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1796016 T3584 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1796016 T3584 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1796033 T3584 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1796040 T3584 oass.SolrIndexSearcher.<init> Opening Searcher@ec6d35a main
[junit4:junit4] 2> 1796041 T3584 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty1/tlog
[junit4:junit4] 2> 1796042 T3584 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1796042 T3584 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1796047 T3585 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ec6d35a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1796049 T3584 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1796049 T3584 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36374 collection:collection1 shard:shard1
[junit4:junit4] 2> 1796050 T3584 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 1796091 T3584 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1796109 T3584 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1796109 T3584 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1796109 T3584 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:36374/collection1/
[junit4:junit4] 2> 1796110 T3584 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1796110 T3584 oasc.SyncStrategy.syncToMe http://127.0.0.1:36374/collection1/ has no replicas
[junit4:junit4] 2> 1796110 T3584 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:36374/collection1/
[junit4:junit4] 2> 1796111 T3584 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1797479 T3564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1797554 T3563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1797554 T3583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1797554 T3570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1797621 T3584 oasc.ZkController.register We are http://127.0.0.1:36374/collection1/ and leader is http://127.0.0.1:36374/collection1/
[junit4:junit4] 2> 1797621 T3584 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36374
[junit4:junit4] 2> 1797621 T3584 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1797622 T3584 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1797622 T3584 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1797626 T3584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1797627 T3541 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1797628 T3541 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1797629 T3541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1797913 T3541 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1797918 T3541 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:54083
[junit4:junit4] 2> 1797918 T3541 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1797919 T3541 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1797920 T3541 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371876545673
[junit4:junit4] 2> 1797920 T3541 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371876545673/solr.xml
[junit4:junit4] 2> 1797921 T3541 oasc.CoreContainer.<init> New CoreContainer 652681674
[junit4:junit4] 2> 1797922 T3541 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371876545673/'
[junit4:junit4] 2> 1797922 T3541 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371876545673/'
[junit4:junit4] 2> 1798052 T3541 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1798054 T3541 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1798054 T3541 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1798055 T3541 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1798055 T3541 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1798056 T3541 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1798056 T3541 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1798057 T3541 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1798057 T3541 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1798058 T3541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1798076 T3541 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1798077 T3541 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36364/solr
[junit4:junit4] 2> 1798077 T3541 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1798079 T3541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1798098 T3597 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76feadf2 name:ZooKeeperConnection Watcher:127.0.0.1:36364 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1798099 T3541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1798101 T3541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1798120 T3541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1798125 T3599 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@50ed77e8 name:ZooKeeperConnection Watcher:127.0.0.1:36364/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1798126 T3541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1798222 T3541 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1799096 T3564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1799097 T3564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:36374_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36374"}
[junit4:junit4] 2> 1799126 T3570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1799127 T3599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1799127 T3583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1799126 T3563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1799226 T3541 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54083_
[junit4:junit4] 2> 1799228 T3541 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54083_
[junit4:junit4] 2> 1799260 T3570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1799260 T3583 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1799260 T3563 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1799260 T3599 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1799261 T3563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1799261 T3583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1799261 T3599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1799261 T3570 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1799273 T3600 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1799274 T3600 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1800633 T3564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1800634 T3564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:54083_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:54083"}
[junit4:junit4] 2> 1800634 T3564 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1800635 T3564 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1800747 T3570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1800747 T3583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1800747 T3599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1800747 T3563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1801280 T3600 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371876545673/collection1
[junit4:junit4] 2> 1801280 T3600 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1801281 T3600 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1801281 T3600 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1801283 T3600 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371876545673/collection1/'
[junit4:junit4] 2> 1801284 T3600 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty2-1371876545673/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1801285 T3600 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty2-1371876545673/collection1/lib/README' to classloader
[junit4:junit4] 2> 1801340 T3600 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1801401 T3600 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1801503 T3600 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1801509 T3600 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1802092 T3600 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1802096 T3600 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1802098 T3600 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1802103 T3600 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1802123 T3600 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1802123 T3600 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty2-1371876545673/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty2/
[junit4:junit4] 2> 1802124 T3600 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ff60846
[junit4:junit4] 2> 1802124 T3600 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1802127 T3600 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty2
[junit4:junit4] 2> 1802127 T3600 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty2/index/
[junit4:junit4] 2> 1802127 T3600 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1802128 T3600 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty2/index
[junit4:junit4] 2> 1802131 T3600 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4bb34d8b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6aa6398d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1802132 T3600 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1802135 T3600 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1802136 T3600 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1802136 T3600 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1802137 T3600 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1802138 T3600 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1802138 T3600 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1802139 T3600 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1802139 T3600 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1802140 T3600 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1802156 T3600 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1802164 T3600 oass.SolrIndexSearcher.<init> Opening Searcher@7144ccd4 main
[junit4:junit4] 2> 1802164 T3600 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty2/tlog
[junit4:junit4] 2> 1802165 T3600 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1802166 T3600 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1802171 T3601 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7144ccd4 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1802173 T3600 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1802174 T3600 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54083 collection:collection1 shard:shard2
[junit4:junit4] 2> 1802174 T3600 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 1802198 T3600 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1802214 T3600 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1802214 T3600 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1802214 T3600 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54083/collection1/
[junit4:junit4] 2> 1802215 T3600 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1802215 T3600 oasc.SyncStrategy.syncToMe http://127.0.0.1:54083/collection1/ has no replicas
[junit4:junit4] 2> 1802215 T3600 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54083/collection1/
[junit4:junit4] 2> 1802216 T3600 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 1802252 T3564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1802273 T3570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1802273 T3563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1802273 T3599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1802273 T3583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1802287 T3600 oasc.ZkController.register We are http://127.0.0.1:54083/collection1/ and leader is http://127.0.0.1:54083/collection1/
[junit4:junit4] 2> 1802287 T3600 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54083
[junit4:junit4] 2> 1802287 T3600 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1802288 T3600 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1802288 T3600 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1802317 T3600 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1802318 T3541 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1802319 T3541 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1802320 T3541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1802655 T3541 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1802661 T3541 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:54246
[junit4:junit4] 2> 1802662 T3541 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1802663 T3541 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1802663 T3541 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371876550366
[junit4:junit4] 2> 1802664 T3541 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371876550366/solr.xml
[junit4:junit4] 2> 1802665 T3541 oasc.CoreContainer.<init> New CoreContainer 1693184694
[junit4:junit4] 2> 1802665 T3541 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371876550366/'
[junit4:junit4] 2> 1802666 T3541 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371876550366/'
[junit4:junit4] 2> 1802795 T3541 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1802796 T3541 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1802797 T3541 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1802797 T3541 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1802798 T3541 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1802798 T3541 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1802799 T3541 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1802799 T3541 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1802800 T3541 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1802801 T3541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1802818 T3541 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1802819 T3541 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36364/solr
[junit4:junit4] 2> 1802819 T3541 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1802821 T3541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1802824 T3613 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4e5b450d name:ZooKeeperConnection Watcher:127.0.0.1:36364 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1802825 T3541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1802849 T3541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1802861 T3541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1802864 T3615 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@415b7d40 name:ZooKeeperConnection Watcher:127.0.0.1:36364/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1802864 T3541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1802890 T3541 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1803818 T3564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1803819 T3564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:54083_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:54083"}
[junit4:junit4] 2> 1803845 T3615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1803845 T3563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1803845 T3599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1803845 T3583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1803845 T3570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1803893 T3541 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54246_
[junit4:junit4] 2> 1803895 T3541 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54246_
[junit4:junit4] 2> 1803906 T3615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1803906 T3570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1803907 T3563 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1803907 T3599 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1803907 T3583 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1803907 T3599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1803907 T3563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1803908 T3583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1803921 T3570 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1803921 T3615 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1803928 T3616 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1803928 T3616 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1805349 T3564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1805350 T3564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:54246_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:54246"}
[junit4:junit4] 2> 1805350 T3564 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1805351 T3564 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1805363 T3570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1805363 T3583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1805363 T3563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1805363 T3615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1805363 T3599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1805935 T3616 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371876550366/collection1
[junit4:junit4] 2> 1805935 T3616 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1805936 T3616 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1805937 T3616 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1805938 T3616 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371876550366/collection1/'
[junit4:junit4] 2> 1805940 T3616 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty3-1371876550366/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1805940 T3616 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty3-1371876550366/collection1/lib/README' to classloader
[junit4:junit4] 2> 1806003 T3616 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1806100 T3616 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1806203 T3616 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1806210 T3616 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1806822 T3616 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1806826 T3616 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1806829 T3616 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1806834 T3616 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1806854 T3616 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1806854 T3616 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty3-1371876550366/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty3/
[junit4:junit4] 2> 1806855 T3616 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ff60846
[junit4:junit4] 2> 1806855 T3616 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1806856 T3616 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty3
[junit4:junit4] 2> 1806857 T3616 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty3/index/
[junit4:junit4] 2> 1806857 T3616 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1806857 T3616 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty3/index
[junit4:junit4] 2> 1806861 T3616 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6ef1e02d lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a4dde7),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1806862 T3616 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1806865 T3616 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1806866 T3616 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1806867 T3616 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1806867 T3616 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1806868 T3616 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1806869 T3616 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1806869 T3616 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1806870 T3616 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1806870 T3616 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1806887 T3616 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1806895 T3616 oass.SolrIndexSearcher.<init> Opening Searcher@28aad5aa main
[junit4:junit4] 2> 1806896 T3616 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty3/tlog
[junit4:junit4] 2> 1806897 T3616 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1806897 T3616 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1806902 T3617 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@28aad5aa main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1806905 T3616 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1806905 T3616 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54246 collection:collection1 shard:shard1
[junit4:junit4] 2> 1806908 T3616 oasc.ZkController.register We are http://127.0.0.1:54246/collection1/ and leader is http://127.0.0.1:36374/collection1/
[junit4:junit4] 2> 1806908 T3616 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54246
[junit4:junit4] 2> 1806908 T3616 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1806908 T3616 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1330 name=collection1 org.apache.solr.core.SolrCore@299516ad url=http://127.0.0.1:54246/collection1 node=127.0.0.1:54246_ C1330_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:54246_, base_url=http://127.0.0.1:54246}
[junit4:junit4] 2> 1806909 T3618 C1330 P54246 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1806909 T3616 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1806911 T3618 C1330 P54246 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1806911 T3618 C1330 P54246 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1806912 T3618 C1330 P54246 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1806912 T3541 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1806912 T3541 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1806913 T3541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1806913 T3618 C1330 P54246 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1806931 T3573 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1807119 T3541 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1807122 T3541 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:48488
[junit4:junit4] 2> 1807122 T3541 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1807123 T3541 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1807123 T3541 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371876554956
[junit4:junit4] 2> 1807124 T3541 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371876554956/solr.xml
[junit4:junit4] 2> 1807124 T3541 oasc.CoreContainer.<init> New CoreContainer 849248536
[junit4:junit4] 2> 1807125 T3541 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371876554956/'
[junit4:junit4] 2> 1807125 T3541 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371876554956/'
[junit4:junit4] 2> 1807237 T3541 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1807238 T3541 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1807238 T3541 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1807239 T3541 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1807239 T3541 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1807240 T3541 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1807240 T3541 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1807240 T3541 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1807241 T3541 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1807241 T3541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1807253 T3541 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1807253 T3541 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36364/solr
[junit4:junit4] 2> 1807254 T3541 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1807255 T3541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1807258 T3630 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2cbdab2d name:ZooKeeperConnection Watcher:127.0.0.1:36364 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1807259 T3541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1807282 T3541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1807290 T3541 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1807292 T3632 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1246dc2f name:ZooKeeperConnection Watcher:127.0.0.1:36364/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1807292 T3541 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1807302 T3541 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1808305 T3541 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48488_
[junit4:junit4] 2> 1808308 T3541 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48488_
[junit4:junit4] 2> 1808400 T3570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1808401 T3599 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1808401 T3563 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1808401 T3632 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1808401 T3583 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1808400 T3615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1808402 T3583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1808402 T3563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1808401 T3599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1808408 T3570 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1808408 T3564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1808408 T3615 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1808409 T3564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:54246_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:54246"}
[junit4:junit4] 2> 1808414 T3633 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1808415 T3633 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1808722 T3564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:48488_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:48488"}
[junit4:junit4] 2> 1808722 T3564 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1808722 T3564 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1808730 T3632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1808730 T3599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1808730 T3583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1808730 T3570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1808730 T3615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1808829 T3563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1808934 T3573 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 1808934 T3573 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=4&state=recovering&nodeName=127.0.0.1:54246_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 1809525 T3633 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371876554956/collection1
[junit4:junit4] 2> 1809525 T3633 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1809526 T3633 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1809526 T3633 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1809528 T3633 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371876554956/collection1/'
[junit4:junit4] 2> 1809529 T3633 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty4-1371876554956/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1809530 T3633 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.ShardSplitTest-jetty4-1371876554956/collection1/lib/README' to classloader
[junit4:junit4] 2> 1809586 T3633 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1809648 T3633 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1809750 T3633 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1809757 T3633 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1810318 T3633 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1810323 T3633 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1810326 T3633 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1810331 T3633 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1810351 T3633 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1810351 T3633 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.ShardSplitTest-jetty4-1371876554956/collection1/, dataDir=./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty4/
[junit4:junit4] 2> 1810352 T3633 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7ff60846
[junit4:junit4] 2> 1810353 T3633 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1810353 T3633 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty4
[junit4:junit4] 2> 1810354 T3633 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty4/index/
[junit4:junit4] 2> 1810354 T3633 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1810354 T3633 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty4/index
[junit4:junit4] 2> 1810358 T3633 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4b653824 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4538e125),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1810359 T3633 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1810362 T3633 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1810363 T3633 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1810363 T3633 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1810364 T3633 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1810365 T3633 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1810365 T3633 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1810366 T3633 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1810366 T3633 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1810367 T3633 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1810383 T3633 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1810391 T3633 oass.SolrIndexSearcher.<init> Opening Searcher@633ad2cd main
[junit4:junit4] 2> 1810391 T3633 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty4/tlog
[junit4:junit4] 2> 1810392 T3633 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1810393 T3633 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1810425 T3634 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@633ad2cd main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1810427 T3633 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1810428 T3633 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:48488 collection:collection1 shard:shard2
[junit4:junit4] 2> 1810431 T3633 oasc.ZkController.register We are http://127.0.0.1:48488/collection1/ and leader is http://127.0.0.1:54083/collection1/
[junit4:junit4] 2> 1810431 T3633 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48488
[junit4:junit4] 2> 1810432 T3633 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1810432 T3633 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1331 name=collection1 org.apache.solr.core.SolrCore@5dcd3a75 url=http://127.0.0.1:48488/collection1 node=127.0.0.1:48488_ C1331_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:48488_, base_url=http://127.0.0.1:48488}
[junit4:junit4] 2> 1810433 T3635 C1331 P48488 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1810433 T3633 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1810433 T3635 C1331 P48488 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1810434 T3635 C1331 P48488 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1810434 T3635 C1331 P48488 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1810434 T3541 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 1810435 T3541 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1810436 T3541 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1810444 T3635 C1331 P48488 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1810461 T3541 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1810467 T3541 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 1810468 T3541 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 1810468 T3589 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1810468 T3541 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C1332 name=collection1 org.apache.solr.core.SolrCore@299516ad url=http://127.0.0.1:54246/collection1 node=127.0.0.1:54246_ C1332_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:54246_, base_url=http://127.0.0.1:54246}
[junit4:junit4] 2> 1810936 T3618 C1332 P54246 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:36374/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1810936 T3618 C1332 P54246 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:54246 START replicas=[http://127.0.0.1:36374/collection1/] nUpdates=100
[junit4:junit4] 2> 1810937 T3618 C1332 P54246 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1810937 T3618 C1332 P54246 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1810937 T3618 C1332 P54246 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1810938 T3618 C1332 P54246 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1810938 T3618 C1332 P54246 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1810938 T3618 C1332 P54246 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:36374/collection1/. core=collection1
[junit4:junit4] 2> 1810938 T3618 C1332 P54246 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C1333 name=collection1 org.apache.solr.core.SolrCore@46409233 url=http://127.0.0.1:36374/collection1 node=127.0.0.1:36374_ C1333_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:36374_, base_url=http://127.0.0.1:36374, leader=true}
[junit4:junit4] 2> 1810947 T3574 C1333 P36374 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=2
[junit4:junit4] 2> 1810953 T3575 C1333 P36374 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1810958 T3575 C1333 P36374 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6f8588ed lockFactory=org.apache.lucene.store.NativeFSLockFactory@55df7b19),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1810958 T3575 C1333 P36374 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1810959 T3575 C1333 P36374 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6f8588ed lockFactory=org.apache.lucene.store.NativeFSLockFactory@55df7b19),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6f8588ed lockFactory=org.apache.lucene.store.NativeFSLockFactory@55df7b19),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1810960 T3575 C1333 P36374 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1810960 T3575 C1333 P36374 oass.SolrIndexSearcher.<init> Opening Searcher@63322aff realtime
[junit4:junit4] 2> 1810961 T3575 C1333 P36374 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1810961 T3575 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 1810962 T3618 C1332 P54246 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1810963 T3618 C1332 P54246 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1810965 T3576 C1333 P36374 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1810966 T3576 C1333 P36374 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 1810967 T3618 C1332 P54246 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1810967 T3618 C1332 P54246 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1810967 T3618 C1332 P54246 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1810969 T3576 C1333 P36374 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1810970 T3618 C1332 P54246 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1810971 T3618 C1332 P54246 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty3/index.20130621174918997
[junit4:junit4] 2> 1810971 T3618 C1332 P54246 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@69753c7e lockFactory=org.apache.lucene.store.NativeFSLockFactory@76c63031) fullCopy=false
[junit4:junit4] 2> 1810974 T3576 C1333 P36374 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1810975 T3618 C1332 P54246 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1810976 T3618 C1332 P54246 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1810977 T3618 C1332 P54246 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1810980 T3618 C1332 P54246 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6ef1e02d lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a4dde7),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6ef1e02d lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a4dde7),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1810981 T3618 C1332 P54246 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1810981 T3618 C1332 P54246 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1810981 T3618 C1332 P54246 oass.SolrIndexSearcher.<init> Opening Searcher@51fcd6c8 main
[junit4:junit4] 2> 1810983 T3617 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@51fcd6c8 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1810983 T3618 C1332 P54246 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty3/index.20130621174918997 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty3/index.20130621174918997;done=true>>]
[junit4:junit4] 2> 1810984 T3618 C1332 P54246 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty3/index.20130621174918997
[junit4:junit4] 2> 1810984 T3618 C1332 P54246 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty3/index.20130621174918997
[junit4:junit4] 2> 1810984 T3618 C1332 P54246 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1810985 T3618 C1332 P54246 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1810985 T3618 C1332 P54246 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1810985 T3618 C1332 P54246 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1810989 T3618 C1332 P54246 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1811471 T3541 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1811833 T3564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1811834 T3564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:48488_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:48488"}
[junit4:junit4] 2> 1811839 T3564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:54246_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:54246"}
[junit4:junit4] 2> 1811856 T3570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1811856 T3583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1811856 T3599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1811856 T3632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1811856 T3615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1811856 T3563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1812472 T3589 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 1812473 T3589 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:48488_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2004
[junit4:junit4] 2> 1812474 T3541 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1813476 T3541 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C1331_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:48488_, base_url=http://127.0.0.1:48488}
[junit4:junit4] 2> 1814474 T3635 C1331 P48488 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:54083/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1814474 T3635 C1331 P48488 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:48488 START replicas=[http://127.0.0.1:54083/collection1/] nUpdates=100
[junit4:junit4] 2> 1814475 T3635 C1331 P48488 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1814475 T3635 C1331 P48488 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1814475 T3635 C1331 P48488 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1814475 T3635 C1331 P48488 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1814476 T3635 C1331 P48488 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1814476 T3635 C1331 P48488 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:54083/collection1/. core=collection1
[junit4:junit4] 2> 1814476 T3635 C1331 P48488 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1814478 T3541 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C1334 name=collection1 org.apache.solr.core.SolrCore@532f571b url=http://127.0.0.1:54083/collection1 node=127.0.0.1:54083_ C1334_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:54083_, base_url=http://127.0.0.1:54083, leader=true}
[junit4:junit4] 2> 1814485 T3590 C1334 P54083 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=2
[junit4:junit4] 2> 1814489 T3591 C1334 P54083 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1814492 T3591 C1334 P54083 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4bb34d8b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6aa6398d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1814493 T3591 C1334 P54083 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1814494 T3591 C1334 P54083 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4bb34d8b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6aa6398d),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4bb34d8b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6aa6398d),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1814494 T3591 C1334 P54083 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1814495 T3591 C1334 P54083 oass.SolrIndexSearcher.<init> Opening Searcher@7dbdea77 realtime
[junit4:junit4] 2> 1814496 T3591 C1334 P54083 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1814496 T3591 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1814497 T3635 C1331 P48488 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1814497 T3635 C1331 P48488 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1814499 T3592 C1334 P54083 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1814500 T3592 C1334 P54083 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 1814500 T3635 C1331 P48488 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1814500 T3635 C1331 P48488 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1814501 T3635 C1331 P48488 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1814503 T3592 C1334 P54083 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1814504 T3635 C1331 P48488 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1814505 T3635 C1331 P48488 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty4/index.20130621174922531
[junit4:junit4] 2> 1814505 T3635 C1331 P48488 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@54893323 lockFactory=org.apache.lucene.store.NativeFSLockFactory@448d1154) fullCopy=false
[junit4:junit4] 2> 1814508 T3592 C1334 P54083 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1814509 T3635 C1331 P48488 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1814510 T3635 C1331 P48488 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1814510 T3635 C1331 P48488 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1814512 T3635 C1331 P48488 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4b653824 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4538e125),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4b653824 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4538e125),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1814513 T3635 C1331 P48488 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1814513 T3635 C1331 P48488 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1814513 T3635 C1331 P48488 oass.SolrIndexSearcher.<init> Opening Searcher@4a32e168 main
[junit4:junit4] 2> 1814515 T3634 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4a32e168 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1814515 T3635 C1331 P48488 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty4/index.20130621174922531 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty4/index.20130621174922531;done=true>>]
[junit4:junit4] 2> 1814516 T3635 C1331 P48488 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty4/index.20130621174922531
[junit4:junit4] 2> 1814516 T3635 C1331 P48488 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty4/index.20130621174922531
[junit4:junit4] 2> 1814516 T3635 C1331 P48488 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1814517 T3635 C1331 P48488 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1814517 T3635 C1331 P48488 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1814517 T3635 C1331 P48488 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1814521 T3635 C1331 P48488 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1814863 T3564 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1814864 T3564 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:48488_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:48488"}
[junit4:junit4] 2> 1814891 T3632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1814891 T3583 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1814891 T3570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1814891 T3563 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1814891 T3599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1814891 T3615 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1815481 T3541 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1815483 T3541 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C1335 name=collection1 org.apache.solr.core.SolrCore@60349271 url=http://127.0.0.1:36370/collection1 node=127.0.0.1:36370_ C1335_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:36370_, base_url=http://127.0.0.1:36370, leader=true}
[junit4:junit4] 2> 1815491 T3553 C1335 P36370 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1815496 T3553 C1335 P36370 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4d7d4937 lockFactory=org.apache.lucene.store.NativeFSLockFactory@d422c4b),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1815496 T3553 C1335 P36370 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1815497 T3553 C1335 P36370 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4d7d4937 lockFactory=org.apache.lucene.store.NativeFSLockFactory@d422c4b),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4d7d4937 lockFactory=org.apache.lucene.store.NativeFSLockFactory@d422c4b),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1815498 T3553 C1335 P36370 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1815498 T3553 C1335 P36370 oass.SolrIndexSearcher.<init> Opening Searcher@422fa73f main
[junit4:junit4] 2> 1815499 T3553 C1335 P36370 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1815500 T3567 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@422fa73f main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1815501 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 10
[junit4:junit4] 2> 1815513 T3577 C1333 P36374 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:36374/collection1/, StdNode: http://127.0.0.1:54246/collection1/, StdNode: http://127.0.0.1:54083/collection1/, StdNode: http://127.0.0.1:48488/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 1815516 T3578 C1333 P36374 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1815516 T3593 C1334 P54083 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1815518 T3578 C1333 P36374 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6f8588ed lockFactory=org.apache.lucene.store.NativeFSLockFactory@55df7b19),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6f8588ed lockFactory=org.apache.lucene.store.NativeFSLockFactory@55df7b19),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1815519 T3593 C1334 P54083 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4bb34d8b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6aa6398d),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4bb34d8b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6aa6398d),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1815519 T3578 C1333 P36374 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1815519 T3593 C1334 P54083 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1815520 T3578 C1333 P36374 oass.SolrIndexSearcher.<init> Opening Searcher@219db212 main
[junit4:junit4] 2> 1815520 T3593 C1334 P54083 oass.SolrIndexSearcher.<init> Opening Searcher@5f44b054 main
[junit4:junit4] 2> 1815521 T3578 C1333 P36374 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1815521 T3593 C1334 P54083 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1815522 T3601 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5f44b054 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1815522 T3585 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@219db212 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1815523 T3593 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1815523 T3578 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> C1332_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:54246_, base_url=http://127.0.0.1:54246}
[junit4:junit4] 2> 1815525 T3605 C1332 P54246 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C1331_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:48488_, base_url=http://127.0.0.1:48488}
[junit4:junit4] 2> 1815525 T3622 C1331 P48488 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1815527 T3605 C1332 P54246 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6ef1e02d lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a4dde7),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6ef1e02d lockFactory=org.apache.lucene.store.NativeFSLockFactory@1a4dde7),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1815528 T3622 C1331 P48488 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4b653824 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4538e125),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4b653824 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4538e125),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1815529 T3605 C1332 P54246 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1815529 T3622 C1331 P48488 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1815530 T3605 C1332 P54246 oass.SolrIndexSearcher.<init> Opening Searcher@4a7effa1 main
[junit4:junit4] 2> 1815531 T3622 C1331 P48488 oass.SolrIndexSearcher.<init> Opening Searcher@4dc8015c main
[junit4:junit4] 2> 1815531 T3605 C1332 P54246 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1815532 T3617 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4a7effa1 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1815532 T3622 C1331 P48488 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1815533 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 1815532 T3634 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4dc8015c main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1815534 T3622 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 9
[junit4:junit4] 2> 1815534 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 21
[junit4:junit4] 2> 1815536 T3541 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1815538 T3579 C1333 P36374 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1815541 T3606 C1332 P54246 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 1815542 T3594 C1334 P54083 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1815544 T3623 C1331 P48488 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1817550 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438516841624371200)} 0 2
[junit4:junit4] 2> 1817560 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1438516841629614080&update.from=http://127.0.0.1:36374/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438516841629614080)} 0 3
[junit4:junit4] 2> 1817562 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1438516841632759808&update.from=http://127.0.0.1:54083/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438516841632759808)} 0 1
[junit4:junit4] 2> 1817563 T3593 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1438516841632759808)} 0 7
[junit4:junit4] 2> 1817564 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438516841629614080)} 0 11
[junit4:junit4] 2> 1817568 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0 (1438516841644294144)]} 0 1
[junit4:junit4] 2> 1817577 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!0 (1438516841650585600)]} 0 1
[junit4:junit4] 2> 1817577 T3593 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[a!0 (1438516841650585600)]} 0 4
[junit4:junit4] 2> 1817578 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!0]} 0 7
[junit4:junit4] 2> 1817581 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1438516841658974208)]} 0 0
[junit4:junit4] 2> 1817587 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!1 (1438516841662119936)]} 0 0
[junit4:junit4] 2> 1817588 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!1 (1438516841662119936)]} 0 4
[junit4:junit4] 2> 1817592 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2 (1438516841669459968)]} 0 1
[junit4:junit4] 2> 1817597 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!2 (1438516841673654272)]} 0 0
[junit4:junit4] 2> 1817598 T3573 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[c!2 (1438516841673654272)]} 0 3
[junit4:junit4] 2> 1817599 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!2]} 0 6
[junit4:junit4] 2> 1817602 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1438516841680994304)]} 0 0
[junit4:junit4] 2> 1817608 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!3 (1438516841684140032)]} 0 0
[junit4:junit4] 2> 1817609 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!3 (1438516841684140032)]} 0 4
[junit4:junit4] 2> 1817612 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4 (1438516841691480064)]} 0 0
[junit4:junit4] 2> 1817619 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!4 (1438516841696722944)]} 0 0
[junit4:junit4] 2> 1817620 T3593 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!4 (1438516841696722944)]} 0 3
[junit4:junit4] 2> 1817621 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!4]} 0 6
[junit4:junit4] 2> 1817623 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5 (1438516841703014400)]} 0 0
[junit4:junit4] 2> 1817631 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!5 (1438516841708257280)]} 0 0
[junit4:junit4] 2> 1817632 T3593 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!5 (1438516841708257280)]} 0 4
[junit4:junit4] 2> 1817633 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!5]} 0 7
[junit4:junit4] 2> 1817635 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6 (1438516841715597312)]} 0 0
[junit4:junit4] 2> 1817640 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!6 (1438516841718743040)]} 0 0
[junit4:junit4] 2> 1817641 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!6 (1438516841718743040)]} 0 3
[junit4:junit4] 2> 1817644 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7 (1438516841725034496)]} 0 0
[junit4:junit4] 2> 1817651 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!7 (1438516841730277376)]} 0 0
[junit4:junit4] 2> 1817652 T3573 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[h!7 (1438516841730277376)]} 0 3
[junit4:junit4] 2> 1817653 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!7]} 0 6
[junit4:junit4] 2> 1817656 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1438516841737617408)]} 0 0
[junit4:junit4] 2> 1817661 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!8 (1438516841740763136)]} 0 0
[junit4:junit4] 2> 1817662 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!8 (1438516841740763136)]} 0 3
[junit4:junit4] 2> 1817665 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9 (1438516841747054592)]} 0 0
[junit4:junit4] 2> 1817671 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!9 (1438516841750200320)]} 0 0
[junit4:junit4] 2> 1817672 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!9 (1438516841750200320)]} 0 4
[junit4:junit4] 2> 1817675 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10 (1438516841757540352)]} 0 0
[junit4:junit4] 2> 1817684 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!10 (1438516841763831808)]} 0 0
[junit4:junit4] 2> 1817685 T3573 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!10 (1438516841763831808)]} 0 4
[junit4:junit4] 2> 1817686 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!10]} 0 7
[junit4:junit4] 2> 1817689 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11 (1438516841772220416)]} 0 0
[junit4:junit4] 2> 1817694 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!11 (1438516841775366144)]} 0 0
[junit4:junit4] 2> 1817695 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!11 (1438516841775366144)]} 0 3
[junit4:junit4] 2> 1817698 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12 (1438516841781657600)]} 0 0
[junit4:junit4] 2> 1817703 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!12 (1438516841784803328)]} 0 0
[junit4:junit4] 2> 1817704 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!12 (1438516841784803328)]} 0 3
[junit4:junit4] 2> 1817707 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13 (1438516841791094784)]} 0 0
[junit4:junit4] 2> 1817714 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!13 (1438516841796337664)]} 0 0
[junit4:junit4] 2> 1817715 T3573 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[n!13 (1438516841796337664)]} 0 3
[junit4:junit4] 2> 1817716 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!13]} 0 6
[junit4:junit4] 2> 1817718 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14 (1438516841802629120)]} 0 0
[junit4:junit4] 2> 1817726 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!14 (1438516841807872000)]} 0 0
[junit4:junit4] 2> 1817727 T3593 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!14 (1438516841807872000)]} 0 4
[junit4:junit4] 2> 1817728 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!14]} 0 7
[junit4:junit4] 2> 1817730 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1438516841815212032)]} 0 0
[junit4:junit4] 2> 1817736 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!15 (1438516841818357760)]} 0 0
[junit4:junit4] 2> 1817737 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!15 (1438516841818357760)]} 0 4
[junit4:junit4] 2> 1817740 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16 (1438516841825697792)]} 0 0
[junit4:junit4] 2> 1817748 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!16 (1438516841831989248)]} 0 0
[junit4:junit4] 2> 1817749 T3573 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[q!16 (1438516841831989248)]} 0 3
[junit4:junit4] 2> 1817750 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!16]} 0 6
[junit4:junit4] 2> 1817753 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1438516841839329280)]} 0 0
[junit4:junit4] 2> 1817759 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!17 (1438516841842475008)]} 0 0
[junit4:junit4] 2> 1817760 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!17 (1438516841842475008)]} 0 4
[junit4:junit4] 2> 1817763 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18 (1438516841849815040)]} 0 0
[junit4:junit4] 2> 1817768 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!18 (1438516841852960768)]} 0 0
[junit4:junit4] 2> 1817769 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!18 (1438516841852960768)]} 0 3
[junit4:junit4] 2> 1817772 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1438516841859252224)]} 0 0
[junit4:junit4] 2> 1817777 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!19 (1438516841862397952)]} 0 0
[junit4:junit4] 2> 1817778 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!19 (1438516841862397952)]} 0 3
[junit4:junit4] 2> 1817782 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20 (1438516841869737984)]} 0 0
[junit4:junit4] 2> 1817788 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!20 (1438516841872883712)]} 0 0
[junit4:junit4] 2> 1817789 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!20 (1438516841872883712)]} 0 4
[junit4:junit4] 2> 1817793 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21 (1438516841880223744)]} 0 1
[junit4:junit4] 2> 1817800 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!21 (1438516841885466624)]} 0 0
[junit4:junit4] 2> 1817801 T3573 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[v!21 (1438516841885466624)]} 0 4
[junit4:junit4] 2> 1817802 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!21]} 0 7
[junit4:junit4] 2> 1817805 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22 (1438516841893855232)]} 0 0
[junit4:junit4] 2> 1817813 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!22 (1438516841899098112)]} 0 0
[junit4:junit4] 2> 1817814 T3573 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[w!22 (1438516841899098112)]} 0 4
[junit4:junit4] 2> 1817815 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!22]} 0 7
[junit4:junit4] 2> 1817818 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23 (1438516841907486720)]} 0 0
[junit4:junit4] 2> 1817827 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!23 (1438516841912729600)]} 0 0
[junit4:junit4] 2> 1817828 T3593 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!23 (1438516841912729600)]} 0 5
[junit4:junit4] 2> 1817829 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!23]} 0 8
[junit4:junit4] 2> 1817832 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24 (1438516841922166784)]} 0 0
[junit4:junit4] 2> 1817838 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!24 (1438516841925312512)]} 0 0
[junit4:junit4] 2> 1817839 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!24 (1438516841925312512)]} 0 4
[junit4:junit4] 2> 1817842 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25 (1438516841932652544)]} 0 0
[junit4:junit4] 2> 1817848 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!25 (1438516841935798272)]} 0 0
[junit4:junit4] 2> 1817849 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!25 (1438516841935798272)]} 0 4
[junit4:junit4] 2> 1817852 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26 (1438516841943138304)]} 0 0
[junit4:junit4] 2> 1817859 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!26 (1438516841946284032)]} 0 0
[junit4:junit4] 2> 1817860 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!26 (1438516841946284032)]} 0 5
[junit4:junit4] 2> 1817863 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27 (1438516841954672640)]} 0 0
[junit4:junit4] 2> 1817868 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!27 (1438516841957818368)]} 0 0
[junit4:junit4] 2> 1817869 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!27 (1438516841957818368)]} 0 3
[junit4:junit4] 2> 1817872 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28 (1438516841964109824)]} 0 0
[junit4:junit4] 2> 1817879 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!28 (1438516841967255552)]} 0 1
[junit4:junit4] 2> 1817879 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!28 (1438516841967255552)]} 0 4
[junit4:junit4] 2> 1817883 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29 (1438516841974595584)]} 0 1
[junit4:junit4] 2> 1817890 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!29 (1438516841979838464)]} 0 0
[junit4:junit4] 2> 1817891 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!29 (1438516841979838464)]} 0 4
[junit4:junit4] 2> 1817894 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30 (1438516841987178496)]} 0 0
[junit4:junit4] 2> 1817902 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!30 (1438516841992421376)]} 0 0
[junit4:junit4] 2> 1817903 T3593 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!30 (1438516841992421376)]} 0 4
[junit4:junit4] 2> 1817904 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!30]} 0 7
[junit4:junit4] 2> 1817907 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31 (1438516842000809984)]} 0 0
[junit4:junit4] 2> 1817917 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!31 (1438516842007101440)]} 0 0
[junit4:junit4] 2> 1817918 T3593 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[f!31 (1438516842007101440)]} 0 5
[junit4:junit4] 2> 1817919 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!31]} 0 8
[junit4:junit4] 2> 1817922 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32 (1438516842016538624)]} 0 0
[junit4:junit4] 2> 1817931 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!32 (1438516842021781504)]} 0 1
[junit4:junit4] 2> 1817931 T3573 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!32 (1438516842021781504)]} 0 4
[junit4:junit4] 2> 1817932 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!32]} 0 7
[junit4:junit4] 2> 1817935 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33 (1438516842030170112)]} 0 0
[junit4:junit4] 2> 1817941 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!33 (1438516842033315840)]} 0 0
[junit4:junit4] 2> 1817942 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!33 (1438516842033315840)]} 0 4
[junit4:junit4] 2> 1817945 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34 (1438516842040655872)]} 0 0
[junit4:junit4] 2> 1817953 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!34 (1438516842045898752)]} 0 0
[junit4:junit4] 2> 1817954 T3573 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[i!34 (1438516842045898752)]} 0 4
[junit4:junit4] 2> 1817955 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!34]} 0 7
[junit4:junit4] 2> 1817958 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35 (1438516842054287360)]} 0 0
[junit4:junit4] 2> 1817964 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!35 (1438516842057433088)]} 0 0
[junit4:junit4] 2> 1817965 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!35 (1438516842057433088)]} 0 4
[junit4:junit4] 2> 1817968 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36 (1438516842064773120)]} 0 0
[junit4:junit4] 2> 1817977 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!36 (1438516842071064576)]} 0 0
[junit4:junit4] 2> 1817978 T3573 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!36 (1438516842071064576)]} 0 4
[junit4:junit4] 2> 1817979 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!36]} 0 7
[junit4:junit4] 2> 1817982 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37 (1438516842079453184)]} 0 0
[junit4:junit4] 2> 1817988 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!37 (1438516842082598912)]} 0 0
[junit4:junit4] 2> 1817989 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!37 (1438516842082598912)]} 0 4
[junit4:junit4] 2> 1817992 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1438516842089938944)]} 0 0
[junit4:junit4] 2> 1817998 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!38 (1438516842093084672)]} 0 0
[junit4:junit4] 2> 1817999 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!38 (1438516842093084672)]} 0 4
[junit4:junit4] 2> 1818002 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39 (1438516842100424704)]} 0 0
[junit4:junit4] 2> 1818008 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!39 (1438516842103570432)]} 0 0
[junit4:junit4] 2> 1818009 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!39 (1438516842103570432)]} 0 4
[junit4:junit4] 2> 1818012 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40 (1438516842110910464)]} 0 0
[junit4:junit4] 2> 1818019 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!40 (1438516842116153344)]} 0 0
[junit4:junit4] 2> 1818020 T3593 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!40 (1438516842116153344)]} 0 3
[junit4:junit4] 2> 1818021 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!40]} 0 6
[junit4:junit4] 2> 1818023 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41 (1438516842122444800)]} 0 0
[junit4:junit4] 2> 1818031 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!41 (1438516842127687680)]} 0 0
[junit4:junit4] 2> 1818032 T3573 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!41 (1438516842127687680)]} 0 4
[junit4:junit4] 2> 1818033 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!41]} 0 7
[junit4:junit4] 2> 1818036 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1438516842136076288)]} 0 0
[junit4:junit4] 2> 1818043 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!42 (1438516842139222016)]} 0 0
[junit4:junit4] 2> 1818044 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!42 (1438516842139222016)]} 0 5
[junit4:junit4] 2> 1818047 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43 (1438516842147610624)]} 0 0
[junit4:junit4] 2> 1818057 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!43 (1438516842154950656)]} 0 0
[junit4:junit4] 2> 1818058 T3593 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!43 (1438516842154950656)]} 0 4
[junit4:junit4] 2> 1818059 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!43]} 0 8
[junit4:junit4] 2> 1818063 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1438516842163339264)]} 0 1
[junit4:junit4] 2> 1818069 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!44 (1438516842167533568)]} 0 0
[junit4:junit4] 2> 1818070 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!44 (1438516842167533568)]} 0 4
[junit4:junit4] 2> 1818074 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45 (1438516842174873600)]} 0 1
[junit4:junit4] 2> 1818081 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[t!45 (1438516842180116480)]} 0 1
[junit4:junit4] 2> 1818081 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!45 (1438516842180116480)]} 0 3
[junit4:junit4] 2> 1818084 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1438516842186407936)]} 0 0
[junit4:junit4] 2> 1818089 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[u!46 (1438516842189553664)]} 0 0
[junit4:junit4] 2> 1818090 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[u!46 (1438516842189553664)]} 0 3
[junit4:junit4] 2> 1818093 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47 (1438516842195845120)]} 0 0
[junit4:junit4] 2> 1818102 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[v!47 (1438516842201088000)]} 0 1
[junit4:junit4] 2> 1818103 T3573 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[v!47 (1438516842201088000)]} 0 5
[junit4:junit4] 2> 1818104 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[v!47]} 0 8
[junit4:junit4] 2> 1818109 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1438516842211573760)]} 0 0
[junit4:junit4] 2> 1818115 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[w!48 (1438516842215768064)]} 0 0
[junit4:junit4] 2> 1818116 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[w!48 (1438516842215768064)]} 0 4
[junit4:junit4] 2> 1818119 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49 (1438516842223108096)]} 0 0
[junit4:junit4] 2> 1818136 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[x!49 (1438516842237788160)]} 0 0
[junit4:junit4] 2> 1818138 T3593 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[x!49 (1438516842237788160)]} 0 5
[junit4:junit4] 2> 1818138 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[x!49]} 0 8
[junit4:junit4] 2> 1818141 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50 (1438516842246176768)]} 0 0
[junit4:junit4] 2> 1818149 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[y!50 (1438516842251419648)]} 0 0
[junit4:junit4] 2> 1818150 T3593 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[y!50 (1438516842251419648)]} 0 4
[junit4:junit4] 2> 1818151 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[y!50]} 0 7
[junit4:junit4] 2> 1818153 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51 (1438516842258759680)]} 0 0
[junit4:junit4] 2> 1818160 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[z!51 (1438516842264002560)]} 0 0
[junit4:junit4] 2> 1818161 T3573 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[z!51 (1438516842264002560)]} 0 3
[junit4:junit4] 2> 1818162 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[z!51]} 0 6
[junit4:junit4] 2> 1818165 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52 (1438516842271342592)]} 0 0
[junit4:junit4] 2> 1818170 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[a!52 (1438516842274488320)]} 0 0
[junit4:junit4] 2> 1818171 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[a!52 (1438516842274488320)]} 0 3
[junit4:junit4] 2> 1818175 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53 (1438516842281828352)]} 0 0
[junit4:junit4] 2> 1818181 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[b!53 (1438516842286022656)]} 0 0
[junit4:junit4] 2> 1818182 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[b!53 (1438516842286022656)]} 0 3
[junit4:junit4] 2> 1818185 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1438516842292314112)]} 0 0
[junit4:junit4] 2> 1818192 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[c!54 (1438516842296508416)]} 0 0
[junit4:junit4] 2> 1818193 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[c!54 (1438516842296508416)]} 0 4
[junit4:junit4] 2> 1818196 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55 (1438516842303848448)]} 0 0
[junit4:junit4] 2> 1818204 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[d!55 (1438516842309091328)]} 0 0
[junit4:junit4] 2> 1818205 T3593 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[d!55 (1438516842309091328)]} 0 4
[junit4:junit4] 2> 1818206 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[d!55]} 0 7
[junit4:junit4] 2> 1818208 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56 (1438516842316431360)]} 0 0
[junit4:junit4] 2> 1818215 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[e!56 (1438516842321674240)]} 0 0
[junit4:junit4] 2> 1818216 T3593 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[e!56 (1438516842321674240)]} 0 3
[junit4:junit4] 2> 1818217 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[e!56]} 0 6
[junit4:junit4] 2> 1818219 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57 (1438516842327965696)]} 0 0
[junit4:junit4] 2> 1818224 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[f!57 (1438516842331111424)]} 0 0
[junit4:junit4] 2> 1818225 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[f!57 (1438516842331111424)]} 0 3
[junit4:junit4] 2> 1818228 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58 (1438516842337402880)]} 0 0
[junit4:junit4] 2> 1818235 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[g!58 (1438516842342645760)]} 0 0
[junit4:junit4] 2> 1818236 T3573 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[g!58 (1438516842342645760)]} 0 3
[junit4:junit4] 2> 1818237 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[g!58]} 0 6
[junit4:junit4] 2> 1818239 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59 (1438516842348937216)]} 0 0
[junit4:junit4] 2> 1818244 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[h!59 (1438516842352082944)]} 0 0
[junit4:junit4] 2> 1818245 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[h!59 (1438516842352082944)]} 0 3
[junit4:junit4] 2> 1818248 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60 (1438516842358374400)]} 0 0
[junit4:junit4] 2> 1818254 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[i!60 (1438516842361520128)]} 0 0
[junit4:junit4] 2> 1818255 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[i!60 (1438516842361520128)]} 0 4
[junit4:junit4] 2> 1818258 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61 (1438516842368860160)]} 0 0
[junit4:junit4] 2> 1818265 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[j!61 (1438516842374103040)]} 0 0
[junit4:junit4] 2> 1818266 T3573 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[j!61 (1438516842374103040)]} 0 3
[junit4:junit4] 2> 1818267 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[j!61]} 0 6
[junit4:junit4] 2> 1818269 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62 (1438516842380394496)]} 0 0
[junit4:junit4] 2> 1818276 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[k!62 (1438516842385637376)]} 0 0
[junit4:junit4] 2> 1818277 T3573 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[k!62 (1438516842385637376)]} 0 3
[junit4:junit4] 2> 1818278 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[k!62]} 0 6
[junit4:junit4] 2> 1818280 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63 (1438516842391928832)]} 0 0
[junit4:junit4] 2> 1818288 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[l!63 (1438516842397171712)]} 0 0
[junit4:junit4] 2> 1818289 T3593 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[l!63 (1438516842397171712)]} 0 4
[junit4:junit4] 2> 1818290 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[l!63]} 0 7
[junit4:junit4] 2> 1818292 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64 (1438516842404511744)]} 0 0
[junit4:junit4] 2> 1818300 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[m!64 (1438516842409754624)]} 0 0
[junit4:junit4] 2> 1818301 T3593 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[m!64 (1438516842409754624)]} 0 4
[junit4:junit4] 2> 1818302 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[m!64]} 0 7
[junit4:junit4] 2> 1818305 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!65 (1438516842418143232)]} 0 0
[junit4:junit4] 2> 1818311 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[n!65 (1438516842422337536)]} 0 0
[junit4:junit4] 2> 1818312 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[n!65 (1438516842422337536)]} 0 3
[junit4:junit4] 2> 1818315 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!66 (1438516842428628992)]} 0 0
[junit4:junit4] 2> 1818322 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[o!66 (1438516842433871872)]} 0 0
[junit4:junit4] 2> 1818323 T3593 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[o!66 (1438516842433871872)]} 0 3
[junit4:junit4] 2> 1818324 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[o!66]} 0 6
[junit4:junit4] 2> 1818326 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!67 (1438516842440163328)]} 0 0
[junit4:junit4] 2> 1818334 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[p!67 (1438516842445406208)]} 0 0
[junit4:junit4] 2> 1818335 T3573 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[p!67 (1438516842445406208)]} 0 4
[junit4:junit4] 2> 1818336 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[p!67]} 0 7
[junit4:junit4] 2> 1818338 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!68 (1438516842452746240)]} 0 0
[junit4:junit4] 2> 1818343 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[q!68 (1438516842455891968)]} 0 0
[junit4:junit4] 2> 1818344 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[q!68 (1438516842455891968)]} 0 3
[junit4:junit4] 2> 1818347 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!69 (1438516842462183424)]} 0 0
[junit4:junit4] 2> 1818354 T3624 C1331 P48488 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[r!69 (1438516842467426304)]} 0 0
[junit4:junit4] 2> 1818355 T3593 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[r!69 (1438516842467426304)]} 0 3
[junit4:junit4] 2> 1818356 T3577 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[r!69]} 0 6
[junit4:junit4] 2> 1818358 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!70 (1438516842473717760)]} 0 0
[junit4:junit4] 2> 1818365 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:36374/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[s!70 (1438516842478960640)]} 0 0
[junit4:junit4] 2> 1818366 T3573 C1333 P36374 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:54083/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[s!70 (1438516842478960640)]} 0 3
[junit4:junit4] 2> 1818367 T3595 C1334 P54083 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[s!70]} 0 6
[junit4:junit4] 2> 1818370 T3553 C1335 P36370 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[t!71 (1438516842486300672)]} 0 0
[junit4:junit4] 2> 1818375 T3605 C1332 P54246 oasup.LogUpdateProcessor.finish [col
[...truncated too long message...]
1921 T3632 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 2011921 T3632 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty4;done=false>>]
[junit4:junit4] 2> 2011921 T3632 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty4
[junit4:junit4] 2> 2011922 T3632 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty4/index;done=false>>]
[junit4:junit4] 2> 2011922 T3632 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1371876534539/jetty4/index
[junit4:junit4] 2> 2011922 T3632 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 2011923 T3632 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election/89907300568072204-5-n_0000000001
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:152)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:260)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 2011924 T3632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 2011924 T3632 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 2011924 T3632 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 2011924 T3632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 2011925 T3632 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 2011925 T3632 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=329), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=329)), sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=da, timezone=Pacific/Niue
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=2,free=274384320,total=536870912
[junit4:junit4] 2> NOTE: All tests run in this JVM: [RequiredFieldsTest, TestRangeQuery, TestDFRSimilarityFactory, DirectSolrSpellCheckerTest, StatsComponentTest, TestSolrJ, SolrCoreCheckLockOnStartupTest, TestManagedSchemaFieldResource, TestCodecSupport, HardAutoCommitTest, TestCoreDiscovery, TestSolr4Spatial, JSONWriterTest, TestSerializedLuceneMatchVersion, TestReload, SolrIndexConfigTest, TestStressLucene, TestSolrXMLSerializer, NotRequiredUniqueKeyTest, RequestHandlersTest, XmlUpdateRequestHandlerTest, SpellCheckComponentTest, TestPartialUpdateDeduplication, SuggesterTSTTest, TestCopyFieldCollectionResource, TestSystemIdResolver, TestLMJelinekMercerSimilarityFactory, TestDynamicFieldResource, TestBinaryResponseWriter, FieldAnalysisRequestHandlerTest, TestRecovery, TestJmxMonitoredMap, TestJmxIntegration, ZkNodePropsTest, FileUtilsTest, UniqFieldsUpdateProcessorFactoryTest, TestDefaultSimilarityFactory, CopyFieldTest, TestStressReorder, TestSolrQueryParserDefaultOperatorResource, TestUtils, TestIndexingPerformance, FullSolrCloudDistribCmdsTest, ZkSolrClientTest, TestQuerySenderNoQuery, LeaderElectionIntegrationTest, SampleTest, IndexBasedSpellCheckerTest, TestHashPartitioner, TestWordDelimiterFilterFactory, BasicZkTest, URLClassifyProcessorTest, TestFieldTypeCollectionResource, TestFastOutputStream, DocValuesMultiTest, NoCacheHeaderTest, TestFoldingMultitermQuery, TestComponentsName, TestCSVLoader, TestDynamicFieldCollectionResource, SolrTestCaseJ4Test, TestMergePolicyConfig, TestAtomicUpdateErrorCases, TestArbitraryIndexDir, CoreContainerCoreInitFailuresTest, XsltUpdateRequestHandlerTest, BasicDistributedZk2Test, IndexReaderFactoryTest, ClusterStateTest, SortByFunctionTest, SignatureUpdateProcessorFactoryTest, TimeZoneUtilsTest, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, OpenCloseCoreStressTest, OverseerTest, ShardRoutingTest, LeaderElectionTest, TestZkChroot, TestRandomDVFaceting, TestGroupingSearch, BadIndexSchemaTest, TestSort, TestLazyCores, DirectUpdateHandlerTest, TestBadConfig, TestIndexSearcher, HighlighterTest, ShowFileRequestHandlerTest, DistributedQueryElevationComponentTest, CurrencyFieldXmlFileTest, SpellCheckCollatorTest, DocValuesTest, SuggesterWFSTTest, TestUpdate, DirectUpdateHandlerOptimizeTest, DistanceFunctionTest, SolrInfoMBeanTest, CacheHeaderTest, DisMaxRequestHandlerTest, TestQueryUtils, StandardRequestHandlerTest, DocumentAnalysisRequestHandlerTest, PrimitiveFieldTypeTest, FileBasedSpellCheckerTest, PathHierarchyTokenizerFactoryTest, MoreLikeThisHandlerTest, LoggingHandlerTest, RegexBoostProcessorTest, TestCollationField, TestCSVResponseWriter, TestAnalyzedSuggestions, PingRequestHandlerTest, HighlighterConfigTest, UpdateParamsTest, ResponseLogComponentTest, MultiTermTest, TestBinaryField, TestSearchPerf, MinimalSchemaTest, TestLuceneMatchVersion, SynonymTokenizerTest, EchoParamsTest, TestLMDirichletSimilarityFactory, OpenExchangeRatesOrgProviderTest, DateMathParserTest, TestSuggestSpellingConverter, SpellingQueryConverterTest, TestDocumentBuilder, SystemInfoHandlerTest, CircularListTest, TestRTGBase, ShardSplitTest]
[junit4:junit4] Completed on J1 in 225.84s, 1 test, 1 error <<< FAILURES!
[...truncated 10 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:386: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:366: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:1243: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:887: There were test failures: 297 suites, 1252 tests, 1 error, 13 ignored (7 assumptions)
Total time: 56 minutes 21 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 4081 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/4081/
2 tests failed.
REGRESSION: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:33624 returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:33624 returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([F90F2083DC3EFCFA:78E9AE9BAB619CC6]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:228)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:150)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
FAILED: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
shard1 is not consistent. Got 305 from http://127.0.0.1:48007/collection1lastClient and got 251 from http://127.0.0.1:35408/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:48007/collection1lastClient and got 251 from http://127.0.0.1:35408/collection1
at __randomizedtesting.SeedInfo.seed([F90F2083DC3EFCFA:78E9AE9BAB619CC6]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1018)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9479 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4] 2> 315467 T921 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 315472 T921 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1371847298307
[junit4:junit4] 2> 315474 T921 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 315474 T922 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 315575 T921 oasc.ZkTestServer.run start zk server on port:37552
[junit4:junit4] 2> 315576 T921 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 315581 T928 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3dd65e8a name:ZooKeeperConnection Watcher:127.0.0.1:37552 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 315581 T921 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 315582 T921 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 315593 T921 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 315596 T930 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@280737ca name:ZooKeeperConnection Watcher:127.0.0.1:37552/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 315596 T921 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 315597 T921 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 315608 T921 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 315612 T921 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 315615 T921 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 315624 T921 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 315625 T921 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 315638 T921 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 315639 T921 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 315769 T921 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 315769 T921 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 315773 T921 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 315774 T921 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 315783 T921 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 315784 T921 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 315787 T921 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 315788 T921 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 315791 T921 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 315792 T921 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 315795 T921 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 315796 T921 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 315799 T921 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 315800 T921 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 316019 T921 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 316023 T921 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:63955
[junit4:junit4] 2> 316024 T921 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 316024 T921 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 316025 T921 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371847298645
[junit4:junit4] 2> 316025 T921 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371847298645/solr.xml
[junit4:junit4] 2> 316026 T921 oasc.CoreContainer.<init> New CoreContainer 872726415
[junit4:junit4] 2> 316026 T921 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371847298645/'
[junit4:junit4] 2> 316027 T921 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371847298645/'
[junit4:junit4] 2> 316129 T921 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 316130 T921 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 316131 T921 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 316131 T921 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 316132 T921 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 316132 T921 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 316133 T921 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 316133 T921 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 316134 T921 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 316134 T921 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 316156 T921 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 316157 T921 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:37552/solr
[junit4:junit4] 2> 316158 T921 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 316159 T921 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 316162 T941 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6c30f82c name:ZooKeeperConnection Watcher:127.0.0.1:37552 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 316163 T921 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 316174 T921 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 316188 T921 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 316191 T943 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2e7eb06f name:ZooKeeperConnection Watcher:127.0.0.1:37552/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 316191 T921 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 316194 T921 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 316206 T921 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 316211 T921 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 316214 T921 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63955_
[junit4:junit4] 2> 316221 T921 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63955_
[junit4:junit4] 2> 316225 T921 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 316239 T921 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 316243 T921 oasc.Overseer.start Overseer (id=89905384542240771-127.0.0.1:63955_-n_0000000000) starting
[junit4:junit4] 2> 316258 T921 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 316270 T945 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 316271 T921 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 316275 T921 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 316278 T921 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 316282 T944 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 316285 T946 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 316285 T946 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 317788 T944 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 317789 T944 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:63955_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:63955"}
[junit4:junit4] 2> 317789 T944 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 317796 T944 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 317811 T943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 318289 T946 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371847298645/collection1
[junit4:junit4] 2> 318289 T946 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 318290 T946 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 318291 T946 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 318293 T946 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371847298645/collection1/'
[junit4:junit4] 2> 318295 T946 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1371847298645/collection1/lib/README' to classloader
[junit4:junit4] 2> 318295 T946 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1371847298645/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 318353 T946 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 318419 T946 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 318521 T946 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 318529 T946 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 319147 T946 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 319157 T946 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 319160 T946 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 319175 T946 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 319179 T946 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 319183 T946 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 319184 T946 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 319185 T946 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 319185 T946 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 319186 T946 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 319186 T946 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 319186 T946 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 319187 T946 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1371847298645/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371847298306/control/data/
[junit4:junit4] 2> 319187 T946 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6b6a94d2
[junit4:junit4] 2> 319187 T946 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 319188 T946 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/control/data
[junit4:junit4] 2> 319189 T946 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371847298306/control/data/index/
[junit4:junit4] 2> 319190 T946 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371847298306/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 319191 T946 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/control/data/index
[junit4:junit4] 2> 319224 T946 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@46d6ce22; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 319224 T946 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 319227 T946 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 319227 T946 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 319227 T946 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 319228 T946 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 319228 T946 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 319228 T946 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 319229 T946 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 319229 T946 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 319229 T946 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 319242 T946 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 319249 T946 oass.SolrIndexSearcher.<init> Opening Searcher@1ee5ed0f main
[junit4:junit4] 2> 319250 T946 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 319250 T946 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 319253 T947 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ee5ed0f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 319254 T946 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 319254 T946 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:63955 collection:control_collection shard:shard1
[junit4:junit4] 2> 319255 T946 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 319280 T946 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 319283 T946 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 319283 T946 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 319283 T946 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:63955/collection1/
[junit4:junit4] 2> 319284 T946 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 319284 T946 oasc.SyncStrategy.syncToMe http://127.0.0.1:63955/collection1/ has no replicas
[junit4:junit4] 2> 319284 T946 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:63955/collection1/
[junit4:junit4] 2> 319284 T946 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 319317 T944 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 319333 T943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 319355 T946 oasc.ZkController.register We are http://127.0.0.1:63955/collection1/ and leader is http://127.0.0.1:63955/collection1/
[junit4:junit4] 2> 319355 T946 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:63955
[junit4:junit4] 2> 319355 T946 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 319355 T946 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 319355 T946 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 319358 T946 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 319359 T921 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 319359 T921 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 319360 T921 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 319372 T921 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 319377 T921 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 319380 T950 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e88920c name:ZooKeeperConnection Watcher:127.0.0.1:37552/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 319380 T921 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 319382 T921 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 319387 T921 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 319568 T921 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 319570 T921 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:48007
[junit4:junit4] 2> 319571 T921 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 319571 T921 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 319571 T921 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371847302221
[junit4:junit4] 2> 319572 T921 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371847302221/solr.xml
[junit4:junit4] 2> 319572 T921 oasc.CoreContainer.<init> New CoreContainer 1825070777
[junit4:junit4] 2> 319573 T921 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371847302221/'
[junit4:junit4] 2> 319573 T921 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371847302221/'
[junit4:junit4] 2> 319662 T921 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 319663 T921 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 319663 T921 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 319664 T921 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 319664 T921 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 319664 T921 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 319665 T921 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 319665 T921 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 319665 T921 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 319666 T921 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 319678 T921 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 319678 T921 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:37552/solr
[junit4:junit4] 2> 319679 T921 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 319680 T921 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 319683 T961 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@30e77065 name:ZooKeeperConnection Watcher:127.0.0.1:37552 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 319683 T921 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 319697 T921 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 319706 T921 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 319708 T963 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@29c472f6 name:ZooKeeperConnection Watcher:127.0.0.1:37552/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 319708 T921 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 319721 T921 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 320725 T921 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48007_
[junit4:junit4] 2> 320728 T921 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48007_
[junit4:junit4] 2> 320732 T943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 320733 T963 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 320733 T950 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 320735 T943 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 320750 T964 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 320751 T964 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 320841 T944 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 320842 T944 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:63955__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:63955_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:63955"}
[junit4:junit4] 2> 320847 T944 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:48007_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:48007"}
[junit4:junit4] 2> 320848 T944 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 320848 T944 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 320860 T950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 320860 T963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 320860 T943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 321753 T964 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371847302221/collection1
[junit4:junit4] 2> 321753 T964 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 321754 T964 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 321755 T964 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 321757 T964 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371847302221/collection1/'
[junit4:junit4] 2> 321758 T964 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1371847302221/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 321759 T964 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1371847302221/collection1/lib/README' to classloader
[junit4:junit4] 2> 321812 T964 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 321893 T964 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 321995 T964 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 322002 T964 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 322622 T964 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 322632 T964 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 322635 T964 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 322652 T964 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 322656 T964 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 322660 T964 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 322661 T964 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 322662 T964 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 322662 T964 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 322664 T964 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 322664 T964 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 322664 T964 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 322664 T964 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1371847302221/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty1/
[junit4:junit4] 2> 322665 T964 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6b6a94d2
[junit4:junit4] 2> 322665 T964 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 322666 T964 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty1
[junit4:junit4] 2> 322667 T964 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty1/index/
[junit4:junit4] 2> 322667 T964 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 322668 T964 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty1/index
[junit4:junit4] 2> 322673 T964 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@53092651; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 322673 T964 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 322676 T964 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 322676 T964 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 322677 T964 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 322677 T964 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 322678 T964 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 322678 T964 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 322678 T964 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 322679 T964 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 322679 T964 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 322690 T964 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 322697 T964 oass.SolrIndexSearcher.<init> Opening Searcher@536204a7 main
[junit4:junit4] 2> 322698 T964 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 322698 T964 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 322702 T965 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@536204a7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 322703 T964 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 322704 T964 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:48007 collection:collection1 shard:shard1
[junit4:junit4] 2> 322705 T964 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 322723 T964 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 322726 T964 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 322726 T964 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 322727 T964 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:48007/collection1/
[junit4:junit4] 2> 322727 T964 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 322727 T964 oasc.SyncStrategy.syncToMe http://127.0.0.1:48007/collection1/ has no replicas
[junit4:junit4] 2> 322728 T964 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:48007/collection1/
[junit4:junit4] 2> 322728 T964 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 323878 T944 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 323905 T963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 323905 T943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 323905 T950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 323909 T964 oasc.ZkController.register We are http://127.0.0.1:48007/collection1/ and leader is http://127.0.0.1:48007/collection1/
[junit4:junit4] 2> 323909 T964 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:48007
[junit4:junit4] 2> 323909 T964 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 323909 T964 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 323909 T964 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 323919 T964 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 323920 T921 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 323921 T921 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 323921 T921 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 324118 T921 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 324120 T921 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:46832
[junit4:junit4] 2> 324121 T921 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 324121 T921 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 324122 T921 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371847306767
[junit4:junit4] 2> 324122 T921 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371847306767/solr.xml
[junit4:junit4] 2> 324123 T921 oasc.CoreContainer.<init> New CoreContainer 1308021408
[junit4:junit4] 2> 324123 T921 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371847306767/'
[junit4:junit4] 2> 324124 T921 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371847306767/'
[junit4:junit4] 2> 324215 T921 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 324216 T921 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 324216 T921 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 324217 T921 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 324217 T921 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 324217 T921 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 324218 T921 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 324218 T921 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 324218 T921 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 324219 T921 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 324231 T921 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 324232 T921 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:37552/solr
[junit4:junit4] 2> 324232 T921 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 324234 T921 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 324238 T977 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@71b967e5 name:ZooKeeperConnection Watcher:127.0.0.1:37552 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 324239 T921 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 324259 T921 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 324272 T921 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 324274 T979 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d5c63f2 name:ZooKeeperConnection Watcher:127.0.0.1:37552/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 324274 T921 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 324288 T921 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 325294 T921 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46832_
[junit4:junit4] 2> 325296 T921 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46832_
[junit4:junit4] 2> 325299 T950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 325299 T963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 325299 T943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 325301 T979 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 325303 T950 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 325303 T963 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 325303 T943 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 325314 T980 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 325315 T980 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 325422 T944 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 325423 T944 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:48007__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:48007_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:48007"}
[junit4:junit4] 2> 325429 T944 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:46832_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46832"}
[junit4:junit4] 2> 325429 T944 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 325429 T944 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 325442 T963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 325442 T943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 325442 T979 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 325442 T950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 326318 T980 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371847306767/collection1
[junit4:junit4] 2> 326318 T980 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 326319 T980 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 326320 T980 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 326322 T980 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371847306767/collection1/'
[junit4:junit4] 2> 326323 T980 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1371847306767/collection1/lib/README' to classloader
[junit4:junit4] 2> 326324 T980 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1371847306767/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 326380 T980 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 326442 T980 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 326544 T980 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 326551 T980 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 327176 T980 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 327185 T980 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 327188 T980 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 327205 T980 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 327209 T980 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 327213 T980 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 327214 T980 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 327215 T980 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 327215 T980 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 327217 T980 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 327217 T980 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 327217 T980 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 327218 T980 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1371847306767/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty2/
[junit4:junit4] 2> 327218 T980 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6b6a94d2
[junit4:junit4] 2> 327218 T980 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 327219 T980 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty2
[junit4:junit4] 2> 327220 T980 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty2/index/
[junit4:junit4] 2> 327220 T980 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 327221 T980 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty2/index
[junit4:junit4] 2> 327226 T980 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d941ee9; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 327226 T980 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 327229 T980 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 327229 T980 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 327229 T980 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 327230 T980 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 327230 T980 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 327231 T980 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 327231 T980 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 327231 T980 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 327232 T980 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 327244 T980 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 327251 T980 oass.SolrIndexSearcher.<init> Opening Searcher@7bf57c46 main
[junit4:junit4] 2> 327252 T980 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 327252 T980 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 327256 T981 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7bf57c46 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 327257 T980 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 327258 T980 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:46832 collection:collection1 shard:shard1
[junit4:junit4] 2> 327262 T980 oasc.ZkController.register We are http://127.0.0.1:46832/collection1/ and leader is http://127.0.0.1:48007/collection1/
[junit4:junit4] 2> 327263 T980 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46832
[junit4:junit4] 2> 327263 T980 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 327263 T980 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C596 name=collection1 org.apache.solr.core.SolrCore@5c1bc032 url=http://127.0.0.1:46832/collection1 node=127.0.0.1:46832_ C596_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:46832_, base_url=http://127.0.0.1:46832}
[junit4:junit4] 2> 327269 T982 C596 P46832 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 327270 T982 C596 P46832 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 327270 T980 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 327270 T982 C596 P46832 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 327270 T982 C596 P46832 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 327271 T921 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 327272 T921 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 327272 T982 C596 P46832 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 327272 T921 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 327294 T953 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:46832__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 327471 T921 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 327474 T921 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:35408
[junit4:junit4] 2> 327474 T921 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 327474 T921 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 327475 T921 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371847310120
[junit4:junit4] 2> 327475 T921 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371847310120/solr.xml
[junit4:junit4] 2> 327475 T921 oasc.CoreContainer.<init> New CoreContainer 813028954
[junit4:junit4] 2> 327476 T921 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371847310120/'
[junit4:junit4] 2> 327476 T921 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371847310120/'
[junit4:junit4] 2> 327571 T921 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 327571 T921 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 327572 T921 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 327572 T921 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 327572 T921 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 327573 T921 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 327573 T921 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 327573 T921 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 327574 T921 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 327574 T921 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 327587 T921 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 327588 T921 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:37552/solr
[junit4:junit4] 2> 327588 T921 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 327589 T921 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 327593 T994 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@936e5c4 name:ZooKeeperConnection Watcher:127.0.0.1:37552 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 327594 T921 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 327605 T921 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 327614 T921 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 327616 T996 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@77c31456 name:ZooKeeperConnection Watcher:127.0.0.1:37552/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 327617 T921 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 327630 T921 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 328459 T944 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 328461 T944 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:46832__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:46832_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46832"}
[junit4:junit4] 2> 328557 T963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 328557 T943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 328557 T996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 328557 T979 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 328557 T950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 328634 T921 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35408_
[junit4:junit4] 2> 328638 T921 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35408_
[junit4:junit4] 2> 328669 T950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 328670 T943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 328670 T979 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 328670 T996 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 328669 T963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 328671 T996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 328672 T950 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 328672 T943 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 328673 T979 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 328674 T963 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 328680 T997 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 328680 T997 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 329296 T953 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:46832__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 329296 T953 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:46832__collection1&state=recovering&nodeName=127.0.0.1:46832_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 330093 T944 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 330095 T944 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:35408_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35408"}
[junit4:junit4] 2> 330095 T944 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 330095 T944 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 330115 T950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 330115 T979 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 330115 T963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 330115 T943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 330115 T996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 330684 T997 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371847310120/collection1
[junit4:junit4] 2> 330684 T997 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 330685 T997 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 330686 T997 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 330688 T997 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371847310120/collection1/'
[junit4:junit4] 2> 330689 T997 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1371847310120/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 330689 T997 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1371847310120/collection1/lib/README' to classloader
[junit4:junit4] 2> 330729 T997 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 330774 T997 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 330876 T997 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 330882 T997 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C597 name=collection1 org.apache.solr.core.SolrCore@5c1bc032 url=http://127.0.0.1:46832/collection1 node=127.0.0.1:46832_ C597_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:46832_, base_url=http://127.0.0.1:46832}
[junit4:junit4] 2> 331298 T982 C597 P46832 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:48007/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 331298 T982 C597 P46832 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:46832 START replicas=[http://127.0.0.1:48007/collection1/] nUpdates=100
[junit4:junit4] 2> 331299 T982 C597 P46832 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 331300 T982 C597 P46832 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 331300 T982 C597 P46832 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 331300 T982 C597 P46832 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 331301 T982 C597 P46832 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 331301 T982 C597 P46832 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:48007/collection1/. core=collection1
[junit4:junit4] 2> 331302 T982 C597 P46832 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C598 name=collection1 org.apache.solr.core.SolrCore@60426de url=http://127.0.0.1:48007/collection1 node=127.0.0.1:48007_ C598_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:48007_, base_url=http://127.0.0.1:48007, leader=true}
[junit4:junit4] 2> 331310 T954 C598 P48007 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 331363 T955 C598 P48007 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 331370 T955 C598 P48007 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@53092651; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 331371 T955 C598 P48007 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 331377 T955 C598 P48007 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@53092651; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@53092651; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 331378 T955 C598 P48007 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 331380 T955 C598 P48007 oass.SolrIndexSearcher.<init> Opening Searcher@5cad7e79 realtime
[junit4:junit4] 2> 331381 T955 C598 P48007 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 331381 T955 C598 P48007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 65
[junit4:junit4] 2> 331465 T982 C597 P46832 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 331466 T982 C597 P46832 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
[junit4:junit4] 2> 331472 T997 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 331488 T997 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 331493 T997 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 331500 T982 C597 P46832 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 331504 T956 C598 P48007 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 331505 T956 C598 P48007 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 331506 T982 C597 P46832 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 331507 T982 C597 P46832 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 331507 T982 C597 P46832 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 331510 T956 C598 P48007 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 331511 T982 C597 P46832 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 331513 T982 C597 P46832 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty2/index.20130621224154346
[junit4:junit4] 2> 331514 T982 C597 P46832 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty2/index.20130621224154346 lockFactory=org.apache.lucene.store.NativeFSLockFactory@18feefe8; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 331515 T997 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 331535 T956 C598 P48007 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=8
[junit4:junit4] 2> 331542 T997 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 331548 T997 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 331549 T997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 331550 T997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 331550 T997 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 331552 T997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 331552 T997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 331552 T997 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 331553 T997 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1371847310120/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty3/
[junit4:junit4] 2> 331553 T997 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6b6a94d2
[junit4:junit4] 2> 331554 T997 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 331555 T997 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty3
[junit4:junit4] 2> 331556 T982 C597 P46832 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 331556 T997 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty3/index/
[junit4:junit4] 2> 331557 T997 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 331559 T997 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty3/index
[junit4:junit4] 2> 331560 T982 C597 P46832 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 331560 T982 C597 P46832 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 331575 T982 C597 P46832 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d941ee9; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d941ee9; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 331576 T982 C597 P46832 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 331576 T982 C597 P46832 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 331577 T982 C597 P46832 oass.SolrIndexSearcher.<init> Opening Searcher@11088a86 main
[junit4:junit4] 2> 331579 T981 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@11088a86 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 331579 T997 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3ae86275; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 331579 T982 C597 P46832 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty2/index.20130621224154346 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty2/index.20130621224154346;done=true>>]
[junit4:junit4] 2> 331579 T997 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 331580 T982 C597 P46832 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty2/index.20130621224154346
[junit4:junit4] 2> 331580 T982 C597 P46832 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty2/index.20130621224154346
[junit4:junit4] 2> 331582 T982 C597 P46832 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 331582 T982 C597 P46832 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 331582 T982 C597 P46832 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 331582 T982 C597 P46832 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 331583 T997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 331584 T997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 331584 T982 C597 P46832 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 331585 T997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 331586 T997 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 331586 T997 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 331587 T997 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 331597 T997 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 331598 T997 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 331598 T997 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 331617 T997 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 331622 T944 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 331624 T944 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:46832__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:46832_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:46832"}
[junit4:junit4] 2> 331627 T997 oass.SolrIndexSearcher.<init> Opening Searcher@7722f2d6 main
[junit4:junit4] 2> 331629 T997 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 331629 T997 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 331634 T1000 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7722f2d6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 331636 T997 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 331636 T997 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:35408 collection:collection1 shard:shard1
[junit4:junit4] 2> 331637 T979 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 331637 T943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 331637 T996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 331637 T950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 331637 T963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 331642 T997 oasc.ZkController.register We are http://127.0.0.1:35408/collection1/ and leader is http://127.0.0.1:48007/collection1/
[junit4:junit4] 2> 331642 T997 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:35408
[junit4:junit4] 2> 331642 T997 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 331643 T997 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C599 name=collection1 org.apache.solr.core.SolrCore@54ab8067 url=http://127.0.0.1:35408/collection1 node=127.0.0.1:35408_ C599_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:35408_, base_url=http://127.0.0.1:35408}
[junit4:junit4] 2> 331643 T1001 C599 P35408 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 331644 T1001 C599 P35408 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 331644 T997 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 331644 T1001 C599 P35408 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 331645 T1001 C599 P35408 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 331645 T921 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 331646 T921 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 331647 T921 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 331651 T1001 C599 P35408 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 331668 T957 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:35408__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 331939 T921 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 331943 T921 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:30738
[junit4:junit4] 2> 331944 T921 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 331944 T921 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 331945 T921 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371847314500
[junit4:junit4] 2> 331945 T921 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371847314500/solr.xml
[junit4:junit4] 2> 331946 T921 oasc.CoreContainer.<init> New CoreContainer 1722456151
[junit4:junit4] 2> 331947 T921 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371847314500/'
[junit4:junit4] 2> 331947 T921 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371847314500/'
[junit4:junit4] 2> 332080 T921 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 332081 T921 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 332081 T921 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 332082 T921 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 332082 T921 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 332083 T921 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 332083 T921 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 332084 T921 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 332084 T921 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 332085 T921 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 332103 T921 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 332104 T921 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:37552/solr
[junit4:junit4] 2> 332104 T921 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 332106 T921 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 332110 T1013 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a1dd21d name:ZooKeeperConnection Watcher:127.0.0.1:37552 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 332110 T921 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 332125 T921 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 332138 T921 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 332141 T1015 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3333510b name:ZooKeeperConnection Watcher:127.0.0.1:37552/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 332141 T921 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 332155 T921 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 333145 T944 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 333146 T944 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:35408__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:35408_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35408"}
[junit4:junit4] 2> 333163 T1015 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 333164 T996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 333163 T943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 333164 T979 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 333163 T950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 333163 T963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 333164 T921 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:30738_
[junit4:junit4] 2> 333169 T921 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:30738_
[junit4:junit4] 2> 333180 T963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 333180 T979 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 333180 T943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 333180 T950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 333180 T996 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 333180 T1015 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 333181 T996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 333182 T1015 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 333183 T979 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 333183 T963 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 333183 T943 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 333184 T950 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 333190 T1016 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 333191 T1016 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 333670 T957 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:35408__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 333670 T957 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:35408__collection1&state=recovering&nodeName=127.0.0.1:35408_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 334673 T944 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 334674 T944 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:30738_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:30738"}
[junit4:junit4] 2> 334674 T944 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 334674 T944 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 334702 T963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 334702 T979 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 334702 T943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 334702 T996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 334702 T950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 334702 T1015 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 335194 T1016 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371847314500/collection1
[junit4:junit4] 2> 335194 T1016 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 335195 T1016 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 335196 T1016 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 335198 T1016 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371847314500/collection1/'
[junit4:junit4] 2> 335199 T1016 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1371847314500/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 335200 T1016 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1371847314500/collection1/lib/README' to classloader
[junit4:junit4] 2> 335256 T1016 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 335321 T1016 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 335423 T1016 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 335431 T1016 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> C599_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:35408_, base_url=http://127.0.0.1:35408}
[junit4:junit4] 2> 335672 T1001 C599 P35408 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:48007/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 335672 T1001 C599 P35408 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:35408 START replicas=[http://127.0.0.1:48007/collection1/] nUpdates=100
[junit4:junit4] 2> 335673 T1001 C599 P35408 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 335673 T1001 C599 P35408 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 335673 T1001 C599 P35408 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 335673 T1001 C599 P35408 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 335673 T1001 C599 P35408 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 335674 T1001 C599 P35408 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:48007/collection1/. core=collection1
[junit4:junit4] 2> 335674 T1001 C599 P35408 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 335676 T954 C598 P48007 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 335687 T958 C598 P48007 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 335693 T958 C598 P48007 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@53092651; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@53092651; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 335694 T958 C598 P48007 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 335695 T958 C598 P48007 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 335696 T958 C598 P48007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 9
[junit4:junit4] 2> 335697 T1001 C599 P35408 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 335697 T1001 C599 P35408 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 335701 T956 C598 P48007 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 335702 T1001 C599 P35408 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4] 2> 335702 T1001 C599 P35408 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 335702 T1001 C599 P35408 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 335706 T956 C598 P48007 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=1
[junit4:junit4] 2> 335707 T1001 C599 P35408 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 335709 T1001 C599 P35408 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty3/index.20130621224158541
[junit4:junit4] 2> 335710 T1001 C599 P35408 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty3/index.20130621224158541 lockFactory=org.apache.lucene.store.NativeFSLockFactory@69d13dae; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 335714 T956 C598 P48007 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4:junit4] 2> 335716 T1001 C599 P35408 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 335719 T1001 C599 P35408 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 335720 T1001 C599 P35408 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 335725 T1001 C599 P35408 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3ae86275; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3ae86275; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 335726 T1001 C599 P35408 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 335727 T1001 C599 P35408 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 335728 T1001 C599 P35408 oass.SolrIndexSearcher.<init> Opening Searcher@2622f5f7 main
[junit4:junit4] 2> 335729 T1000 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2622f5f7 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 335730 T1001 C599 P35408 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty3/index.20130621224158541 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty3/index.20130621224158541;done=true>>]
[junit4:junit4] 2> 335730 T1001 C599 P35408 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty3/index.20130621224158541
[junit4:junit4] 2> 335730 T1001 C599 P35408 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty3/index.20130621224158541
[junit4:junit4] 2> 335732 T1001 C599 P35408 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 335732 T1001 C599 P35408 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 335732 T1001 C599 P35408 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 335732 T1001 C599 P35408 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 335734 T1001 C599 P35408 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 336104 T1016 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 336118 T1016 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 336122 T1016 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 336141 T1016 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 336162 T1016 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 336166 T1016 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 336168 T1016 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 336168 T1016 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 336169 T1016 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 336170 T1016 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 336170 T1016 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 336171 T1016 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 336171 T1016 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1371847314500/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty4/
[junit4:junit4] 2> 336171 T1016 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6b6a94d2
[junit4:junit4] 2> 336172 T1016 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 336173 T1016 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty4
[junit4:junit4] 2> 336174 T1016 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty4/index/
[junit4:junit4] 2> 336175 T1016 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 336175 T1016 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty4/index
[junit4:junit4] 2> 336182 T1016 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b03862a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 336182 T1016 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 336186 T1016 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 336186 T1016 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 336187 T1016 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 336188 T1016 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 336188 T1016 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 336188 T1016 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 336192 T1016 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 336192 T1016 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 336193 T1016 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 336208 T1016 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 336209 T944 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 336210 T944 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:35408__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:35408_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:35408"}
[junit4:junit4] 2> 336217 T1016 oass.SolrIndexSearcher.<init> Opening Searcher@51ade5ba main
[junit4:junit4] 2> 336218 T1016 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 336218 T1016 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 336223 T1015 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 336223 T979 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 336223 T996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 336223 T943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 336223 T963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 336223 T950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 336223 T1019 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@51ade5ba main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 336227 T1016 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 336227 T1016 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:30738 collection:collection1 shard:shard1
[junit4:junit4] 2> 336231 T1016 oasc.ZkController.register We are http://127.0.0.1:30738/collection1/ and leader is http://127.0.0.1:48007/collection1/
[junit4:junit4] 2> 336231 T1016 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:30738
[junit4:junit4] 2> 336232 T1016 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 336232 T1016 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C600 name=collection1 org.apache.solr.core.SolrCore@750edae4 url=http://127.0.0.1:30738/collection1 node=127.0.0.1:30738_ C600_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:30738_, base_url=http://127.0.0.1:30738}
[junit4:junit4] 2> 336232 T1020 C600 P30738 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 336233 T1020 C600 P30738 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 336233 T1016 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 336234 T1020 C600 P30738 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 336234 T1020 C600 P30738 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 336235 T921 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 336235 T921 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 336235 T1020 C600 P30738 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 336236 T921 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 336256 T921 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 336257 T959 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:30738__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 336258 T921 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 336258 T921 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 336259 T921 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 337263 T921 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 337729 T944 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 337730 T944 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:30738__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:30738_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:30738"}
[junit4:junit4] 2> 337744 T1015 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 337745 T996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 337744 T950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 337745 T979 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 337744 T943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 337744 T963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 338259 T959 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:30738__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 338259 T959 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:30738__collection1&state=recovering&nodeName=127.0.0.1:30738_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 338266 T921 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 339268 T921 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C600_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:30738_, base_url=http://127.0.0.1:30738}
[junit4:junit4] 2> 340261 T1020 C600 P30738 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:48007/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 340261 T1020 C600 P30738 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:30738 START replicas=[http://127.0.0.1:48007/collection1/] nUpdates=100
[junit4:junit4] 2> 340262 T1020 C600 P30738 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 340262 T1020 C600 P30738 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 340262 T1020 C600 P30738 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 340262 T1020 C600 P30738 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 340262 T1020 C600 P30738 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 340263 T1020 C600 P30738 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:48007/collection1/. core=collection1
[junit4:junit4] 2> 340263 T1020 C600 P30738 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C601 name=collection1 org.apache.solr.core.SolrCore@60426de url=http://127.0.0.1:48007/collection1 node=127.0.0.1:48007_ C601_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:48007_, base_url=http://127.0.0.1:48007, leader=true}
[junit4:junit4] 2> 340265 T954 C601 P48007 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 340271 T921 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 340275 T953 C601 P48007 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 340280 T953 C601 P48007 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@53092651; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@53092651; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@53092651; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 340280 T953 C601 P48007 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 340281 T953 C601 P48007 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 340282 T953 C601 P48007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 340283 T1020 C600 P30738 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 340283 T1020 C600 P30738 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 340286 T956 C601 P48007 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 340287 T1020 C600 P30738 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 340288 T1020 C600 P30738 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 340288 T1020 C600 P30738 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 340291 T956 C601 P48007 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=1
[junit4:junit4] 2> 340292 T1020 C600 P30738 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 340293 T1020 C600 P30738 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty4/index.20130621224203126
[junit4:junit4] 2> 340294 T1020 C600 P30738 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty4/index.20130621224203126 lockFactory=org.apache.lucene.store.NativeFSLockFactory@533a42bf; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 340298 T956 C601 P48007 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4:junit4] 2> 340300 T1020 C600 P30738 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 340303 T1020 C600 P30738 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 340303 T1020 C600 P30738 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 340308 T1020 C600 P30738 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b03862a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b03862a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 340309 T1020 C600 P30738 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 340309 T1020 C600 P30738 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 340310 T1020 C600 P30738 oass.SolrIndexSearcher.<init> Opening Searcher@1832b513 main
[junit4:junit4] 2> 340312 T1019 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1832b513 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 340312 T1020 C600 P30738 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty4/index.20130621224203126 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty4/index.20130621224203126;done=true>>]
[junit4:junit4] 2> 340313 T1020 C600 P30738 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty4/index.20130621224203126
[junit4:junit4] 2> 340313 T1020 C600 P30738 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty4/index.20130621224203126
[junit4:junit4] 2> 340314 T1020 C600 P30738 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 340314 T1020 C600 P30738 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 340315 T1020 C600 P30738 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 340315 T1020 C600 P30738 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 340317 T1020 C600 P30738 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 340753 T944 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 340755 T944 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:30738__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:30738_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:30738"}
[junit4:junit4] 2> 340770 T963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 340770 T979 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 340770 T943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 340770 T1015 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 340770 T996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 340770 T950 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 341275 T921 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 341276 T921 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C602 name=collection1 org.apache.solr.core.SolrCore@56852340 url=http://127.0.0.1:63955/collection1 node=127.0.0.1:63955_ C602_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:63955_, base_url=http://127.0.0.1:63955, leader=true}
[junit4:junit4] 2> 341291 T933 C602 P63955 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 341297 T933 C602 P63955 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@46d6ce22; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 341298 T933 C602 P63955 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 341339 T933 C602 P63955 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@46d6ce22; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@46d6ce22; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 341340 T933 C602 P63955 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 341342 T933 C602 P63955 oass.SolrIndexSearcher.<init> Opening Searcher@7ddee8d6 main
[junit4:junit4] 2> 341343 T933 C602 P63955 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 341344 T947 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7ddee8d6 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 341344 T933 C602 P63955 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 53
[junit4:junit4] 2> ASYNC NEW_CORE C603 name=collection1 org.apache.solr.core.SolrCore@5c1bc032 url=http://127.0.0.1:46832/collection1 node=127.0.0.1:46832_ C603_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:46832_, base_url=http://127.0.0.1:46832}
[junit4:junit4] 2> 341369 T969 C603 P46832 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:48007/collection1/, StdNode: http://127.0.0.1:46832/collection1/, StdNode: http://127.0.0.1:35408/collection1/, StdNode: http://127.0.0.1:30738/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 341383 T955 C601 P48007 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 341384 T970 C603 P46832 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 341398 T955 C601 P48007 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=4
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@53092651; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@53092651; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@53092651; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@53092651; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 341399 T970 C603 P46832 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d941ee9; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d941ee9; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 341399 T955 C601 P48007 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> C600_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:30738_, base_url=http://127.0.0.1:30738}
[junit4:junit4] 2> 341400 T1005 C600 P30738 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 341400 T970 C603 P46832 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> ASYNC NEW_CORE C604 name=collection1 org.apache.solr.core.SolrCore@54ab8067 url=http://127.0.0.1:35408/collection1 node=127.0.0.1:35408_ C604_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:35408_, base_url=http://127.0.0.1:35408}
[junit4:junit4] 2> 341401 T986 C604 P35408 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 341402 T955 C601 P48007 oass.SolrIndexSearcher.<init> Opening Searcher@22c414c9 main
[junit4:junit4] 2> 341403 T955 C601 P48007 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 341404 T965 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@22c414c9 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 341404 T970 C603 P46832 oass.SolrIndexSearcher.<init> Opening Searcher@436ce904 main
[junit4:junit4] 2> 341405 T955 C601 P48007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 21
[junit4:junit4] 2> 341405 T970 C603 P46832 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 341406 T981 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@436ce904 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 341406 T970 C603 P46832 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 22
[junit4:junit4] 2> 341408 T1005 C600 P30738 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b03862a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b03862a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 341408 T1005 C600 P30738 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 341410 T1005 C600 P30738 oass.SolrIndexSearcher.<init> Opening Searcher@18aea3e9 main
[junit4:junit4] 2> 341411 T1005 C600 P30738 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 341411 T1019 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@18aea3e9 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 341412 T1005 C600 P30738 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 12
[junit4:junit4] 2> 341419 T986 C604 P35408 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3ae86275; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3ae86275; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 341419 T986 C604 P35408 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 341421 T986 C604 P35408 oass.SolrIndexSearcher.<init> Opening Searcher@605ee272 main
[junit4:junit4] 2> 341422 T986 C604 P35408 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 341423 T1000 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@605ee272 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 341423 T986 C604 P35408 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 22
[junit4:junit4] 2> 341424 T969 C603 P46832 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 56
[junit4:junit4] 2> 341426 T921 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 341430 T957 C601 P48007 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 341432 T971 C603 P46832 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 341435 T987 C604 P35408 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 341438 T1006 C600 P30738 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 343449 T933 C602 P63955 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438486182002425856)} 0 7
[junit4:junit4] 2> 343471 T989 C604 P35408 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1438486182019203072&update.from=http://127.0.0.1:48007/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438486182019203072)} 0 1
[junit4:junit4] 2> 343472 T972 C603 P46832 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1438486182019203072&update.from=http://127.0.0.1:48007/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438486182019203072)} 0 2
[junit4:junit4] 2> 343472 T1007 C600 P30738 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1438486182019203072&update.from=http://127.0.0.1:48007/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438486182019203072)} 0 3
[junit4:junit4] 2> 343473 T958 C601 P48007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1438486182019203072)} 0 10
[junit4:junit4] 2> 343474 T988 C604 P35408 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 21
[junit4:junit4] 2> 343480 T933 C602 P63955 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0 (1438486182034931712)]} 0 3
[junit4:junit4] 2> 343502 T989 C604 P35408 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:48007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438486182040174592)]} 0 3
[junit4:junit4] 2> 343502 T1007 C600 P30738 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:48007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438486182040174592)]} 0 3
[junit4:junit4] 2> 343502 T972 C603 P46832 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:48007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438486182040174592)]} 0 3
[junit4:junit4] 2> 343504 T959 C601 P48007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0 (1438486182040174592)]} 0 22
[junit4:junit4] 2> 343508 T933 C602 P63955 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1438486182066388992)]} 0 1
[junit4:junit4] 2> 343526 T989 C604 P35408 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:48007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438486182080020480)]} 0 1
[junit4:junit4] 2> 343527 T1007 C600 P30738 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:48007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438486182080020480)]} 0 2
[junit4:junit4] 2> 343526 T972 C603 P46832 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:48007/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438486182080020480)]} 0 1
[junit4:junit4] 2> 343528 T955 C601 P48007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:46832/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[1 (1438486182080020480)]} 0 7
[junit4:junit4] 2> 343529 T969 C603 P46832 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1]} 0 17
[junit4:junit4] 2> 343533 T933 C602 P63955 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1438486182092603392)]} 0 1
[junit4:junit4] 2> 343538 T959 C601 P48007 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:46832/collection1/]
[junit4:junit4] 2> 343538 T959 C601 P48007 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:46832/collection1/ against:[http://127.0.0.1:46832/collection1/] result:true
[junit4:junit4] 2> 343539 T959 C601 P48007 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:35408/collection1/ against:[http://127.0.0.1:46832/collection1/] result:false
[junit4:junit4] 2> 343539 T959 C601 P48007 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:30738/collection1/ against:[http://127.0.0.1:46832/collection1/] result:false
[junit4:junit4] 2> 343544 T1007 C600 P30738 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:48007/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:46832/collection1/&wt=javabin&version=2} {add=[2 (1438486182098894848)]} 0 1
[junit4:junit4] 2> 343545 T989 C604 P35408 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:48007/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:46832/collection1/&wt=javabin&version=2} {add=[2 (1438486182098894848)]} 0 1
[junit4:junit4] 2> 343546 T959 C601 P48007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={test.distrib.skip.servers=http://127.0.0.1:46832/collection1/&wt=javabin&version=2} {add=[2 (1438486182098894848)]} 0 9
[junit4:junit4] 2> 343550 T933 C602 P63955 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1438486182109380608)]} 0 1
[junit4:junit4] 2> 343557 T958 C601 P48007 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:46832/collection1/]
[junit4:junit4] 2> 343557 T958 C601 P48007 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:46832/collection1/ against:[http://127.0.0.1:46832/collection1/] result:true
[junit4:junit4] 2> 343558 T958 C601 P48007 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:35408/collection1/ against:[http://127.0.0.1:46832/collection1/] result:false
[junit4:junit4] 2> 343558 T958 C601 P48007 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:30738/collection1/ against:[http://127.0.0.1:46832/collection1/] result:false
[junit4:junit4] 2> 343563 T989 C604 P35408 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:48007/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:46832/collection1/&wt=javabin&version=2} {add=[3 (1438486182118817792)]} 0 1
[junit4:junit4] 2> 343564 T1007 C600 P30738 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:48007/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:46832/collection1/&wt=javabin&version=2} {add=[3 (1438486182118817792)]} 0 2
[junit4:junit4] 2> 343565 T958 C601 P48007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:35408/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:46832/collection1/&wt=javabin&version=2} {add=[3 (1438486182118817792)]} 0 9
[junit4:junit4] 2> 343565 T988 C604 P35408 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={test.distrib.skip.servers=http://127.0.0.1:46832/collection1/&test.distrib.skip.servers=http://127.0.0.1:35408/collection1/&wt=javabin&version=2} {add=[3]} 0 12
[junit4:junit4] 2> 343568 T933 C602 P63955 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 343921 T933 C602 P63955 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@46d6ce22; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@46d6ce22; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 343922 T933 C602 P63955 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 343929 T933 C602 P63955 oass.SolrIndexSearcher.<init> Opening Searcher@46a5099a main
[junit4:junit4] 2> 343929 T933 C602 P63955 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 343930 T947 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@46a5099a main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C4)}
[junit4:junit4] 2> 343931 T933 C602 P63955 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 363
[junit4:junit4] 2> 343934 T1008 C600 P30738 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:48007/collection1/, StdNode: http://127.0.0.1:46832/collection1/, StdNode: http://127.0.0.1:35408/collection1/, StdNode: http://127.0.0.1:30738/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 343938 T953 C601 P48007 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 343938 T990 C604 P35408 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 343939 T973 C603 P46832 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 343939 T1009 C600 P30738 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 344062 T953 C601 P48007 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=5
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@53092651; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@53092651; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@53092651; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@53092651; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@53092651; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> 344064 T953 C601 P48007 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 344064 T1009 C600 P30738 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b03862a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@b03862a; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6}
[junit4:junit4] 2> 344065 T1009 C600 P30738 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
[junit4:junit4] 2> 344067 T973 C603 P46832 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d941ee9; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d941ee9; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 344067 T973 C603 P46832 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 344073 T1009 C600 P30738 oass.SolrIndexSearcher.<init> Opening Searcher@736845f3 main
[junit4:junit4] 2> 344074 T1009 C600 P30738 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 344074 T953 C601 P48007 oass.SolrIndexSearcher.<init> Opening Searcher@5a4b5e5d main
[junit4:junit4] 2> 344075 T1019 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@736845f3 main{StandardDirectoryReader(segments_6:3:nrt _0(5.0):C4)}
[junit4:junit4] 2> 344075 T953 C601 P48007 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 344075 T1009 C600 P30738 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 136
[junit4:junit4] 2> 344075 T973 C603 P46832 oass.SolrIndexSearcher.<init> Opening Searcher@45fe914a main
[junit4:junit4] 2> 344076 T965 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5a4b5e5d main{StandardDirectoryReader(segments_6:3:nrt _0(5.0):C4)}
[junit4:junit4] 2> 344076 T973 C603 P46832 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 344077 T953 C601 P48007 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 139
[junit4:junit4] 2> 344077 T981 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@45fe914a main{StandardDirectoryReader(segments_4:3:nrt _0(5.0):C2)}
[junit4:junit4] 2> 344077 T990 C604 P35408 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3ae86275; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1371847298306/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@3ae86275; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 344078 T973 C603 P46832 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 139
[junit4:junit4] 2> 344078 T990 C604 P35408 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 344085 T990 C604 P35408 oass.SolrIndexSearcher.<init> Opening Searcher@2f303d2a main
[junit4:junit4] 2> 344086 T990 C604 P35408 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 344086 T1000 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2f303d2a main{StandardDirectoryReader(segments_5:3:nrt _0(5.0):C4)}
[junit4:junit4] 2> 344087 T990 C604 P35408 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 149
[junit4:junit4] 2> 344087 T1008 C600 P30738 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 153
[junit4:junit4] 2> 344088 T921 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 344090 T921 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 344091 T921 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 344094 T957 C601 P48007 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=1
[junit4:junit4] 2> 344098 T971 C603 P46832 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=2 status=0 QTime=1
[junit4:junit4] 2> 344101 T987 C604 P35408 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 344104 T1006 C600 P30738 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 344111 T921 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 344137 T991 oasha.CollectionsHandler.handleSyncShardAction Syncing shard : shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2
[junit4:junit4] 2> 344138 T991 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 344153 T1036 oasha.CoreAdminHandler.handleRequestSyncAction I have been requested to sync up my shard
[junit4:junit4] 2> 344154 T1036 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:48007/collection1/
[junit4:junit4] 2> 344154 T1036 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:48007 START replicas=[http://127.0.0.1:46832/collection1/, http://127.0.0.1:35408/collection1/, http://127.0.0.1:30738/collection1/] nUpdates=100
[junit4:junit4] 2> 344157 T974 C603 P46832 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 344157 T992 C604 P35408 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 344157 T1010 C600 P30738 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 344158 T1036 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:48007 Received 3 versions from 127.0.0.1:46832/collection1/
[junit4:junit4] 2> 344159 T1036 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:48007 Our versions are newer. ourLowThreshold=1438486182019203072 otherHigh=1438486182080020480
[junit4:junit4] 2> 344159 T1036 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:48007 Received 5 versions from 127.0.0.1:35408/collection1/
[junit4:junit4] 2> 344159 T1036 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:48007 Our versions are newer. ourLowThreshold=1438486182019203072 otherHigh=1438486182098894848
[junit4:junit4] 2> 344160 T1036 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:48007 Received 5 versions from 127.0.0.1:30738/collection1/
[junit4:junit4] 2> 344160 T1036 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:48007 Our versions are newer. ourLowThreshold=1438486182019203072 otherHigh=1438486182098894848
[junit4:junit4] 2> 344161 T1036 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:48007 DONE. sync succeeded
[junit4:junit4] 2> 344161 T1036 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 344161 T1036 oasc.SyncStrategy.syncToMe http://127.0.0.1:48007/collection1/: try and ask http://127.0.0.1:46832/collection1/ to sync
[junit4:junit4] 2> 344162 T1036 oasc.SyncStrategy.syncToMe http://127.0.0.1:48007/collection1/: try and ask http://127.0.0.1:35408/collection1/ to sync
[junit4:junit4] 2> 344163 T1036 oasc.SyncStrategy.syncToMe http://127.0.0.1:48007/collection1/: try and ask http://127.0.0.1:30738/collection1/ to sync
[junit4:junit4] 2> 344164 T975 C603 P46832 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:46832 START replicas=[http://127.0.0.1:48007/collection1/] nUpdates=100
[junit4:junit4] 2> 344165 T1043 C604 P35408 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:35408 START replicas=[http://127.0.0.1:48007/collection1/] nUpdates=100
[junit4:junit4] 2> 344165 T1011 C600 P30738 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:30738 START replicas=[http://127.0.0.1:48007/collection1/] nUpdates=100
[junit4:junit4] 2> 344168 T954 C601 P48007 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 344168 T1047 C601 P48007 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 344168 T975 C603 P46832 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:46832 Received 5 versions from 127.0.0.1:48007/collection1/
[junit4:junit4] 2> 344169 T1043 C604 P35408 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:35408 Received 5 versions from 127.0.0.1:48007/collection1/
[junit4:junit4] 2> 344169 T1048 C601 P48007 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 344169 T1043 C604 P35408 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:35408 Our versions are newer. ourLowThreshold=1438486182019203072 otherHigh=1438486182098894848
[junit4:junit4] 2> 344169 T975 C603 P46832 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:46832 Requesting updates from 127.0.0.1:48007/collection1/n=2 versions=[1438486182118817792, 1438486182098894848]
[junit4:junit4] 2> 344170 T1043 C604 P35408 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:35408 DONE. sync succeeded
[junit4:junit4] 2> 344170 T1011 C600 P30738 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:30738 Received 5 versions from 127.0.0.1:48007/collection1/
[junit4:junit4] 2> 344171 T1043 C604 P35408 oasc.SolrCore.execute [collection1] webapp= path=/get params={sync=http://127.0.0.1:48007/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=6
[junit4:junit4] 2> 344171 T1011 C600 P30738 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:30738 Our versions are newer. ourLowThreshold=1438486182019203072 otherHigh=1438486182098894848
[junit4:junit4] 2> 344172 T1011 C600 P30738 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:30738 DONE. sync succeeded
[junit4:junit4] 2> 344172 T1036 oasc.SyncStrategy.syncToMe http://127.0.0.1:48007/collection1/: sync completed with http://127.0.0.1:35408/collection1/
[junit4:junit4] 2> 344173 T1011 C600 P30738 oasc.SolrCore.execute [collection1] webapp= path=/get params={sync=http://127.0.0.1:48007/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=8
[junit4:junit4] 2> 344173 T1048 C601 P48007 oasc.SolrCore.execute [collection1] webapp= path=/get params={distrib=false&getUpdates=1438486182118817792,1438486182098894848&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 344174 T1036 oasc.SyncStrategy.syncToMe http://127.0.0.1:48007/collection1/: sync completed with http://127.0.0.1:30738/collection1/
[junit4:junit4] 2> 344179 T975 C603 P46832 oasup.LogUpdateProcessor.finish [collection1] {add=[2 (1438486182098894848), 3 (1438486182118817792)]} 0 5
[junit4:junit4] 2> 344179 T975 C603 P46832 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:46832 DONE. sync succeeded
[junit4:junit4] 2> 344180 T975 C603 P46832 oasc.SolrCore.execute [collection1] webapp= path=/get params={sync=http://127.0.0.1:48007/collection1/&getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=16
[junit4:junit4] 2> 344180 T1036 o
[...truncated too long message...]
llection1 url=http://127.0.0.1:33639 DONE. sync succeeded
[junit4:junit4] 2> 1286452 T1749 oasc.SyncStrategy.syncReplicas We have been closed, won't attempt to sync replicas back to leader
[junit4:junit4] 2> 1286453 T1749 oasc.ShardLeaderElectionContext.runLeaderProcess Sync was not a success but no one else is active! I am the leader
[junit4:junit4] 2> 1286453 T1749 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:33639/collection1/
[junit4:junit4] 2> 1286453 T1749 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@77a9028
[junit4:junit4] 2> 1286454 T1749 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=2,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=806,adds=806,deletesById=400,deletesByQuery=0,errors=0,cumulative_adds=865,cumulative_deletesById=400,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4:junit4] 2> 1286455 T1749 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 1286455 T1749 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 1286455 T1749 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 1286468 T1749 C889 P33639 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@c81e3a4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@22bb8356),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@c81e3a4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@22bb8356),segFN=segments_5,generation=5}
[junit4:junit4] 2> 1286468 T1749 C889 P33639 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 1286472 T1749 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 1286472 T1749 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 1286472 T1749 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1371848009147/jetty3 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1371848009147/jetty3;done=false>>]
[junit4:junit4] 2> 1286473 T1749 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1371848009147/jetty3
[junit4:junit4] 2> 1286473 T1749 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ShardSplitTest-1371848009147/jetty3/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ShardSplitTest-1371848009147/jetty3/index;done=false>>]
[junit4:junit4] 2> 1286473 T1749 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ShardSplitTest-1371848009147/jetty3/index
[junit4:junit4] 2> 1286474 T1749 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1286474 T1749 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election/89905431127982090-127.0.0.1:33639__collection1-n_0000000001
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:152)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:260)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 1286475 T1749 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1286475 T1749 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1286475 T1749 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1286475 T1749 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1286476 T1749 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1286476 T1749 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> NOTE: test params are: codec=Asserting, sim=DefaultSimilarity, locale=pt_PT, timezone=Asia/Kolkata
[junit4:junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=16,threads=2,free=184711632,total=451936256
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestManagedSchema, TestJoin, QueryResultKeyTest, TestSolrXmlPersistence, StatelessScriptUpdateProcessorFactoryTest, SliceStateUpdateTest, FastVectorHighlighterTest, PeerSyncTest, BasicFunctionalityTest, SynonymTokenizerTest, DistributedSpellCheckComponentTest, TestValueSourceCache, TestFieldCollectionResource, SolrCoreTest, MBeansHandlerTest, LegacyHTMLStripCharFilterTest, DistributedTermsComponentTest, TestSort, AlternateDirectoryTest, TestSolrCoreProperties, TestStressRecovery, RAMDirectoryFactoryTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, TestSolrDeletionPolicy1, TestStressVersions, TestUniqueKeyFieldResource, SearchHandlerTest, ReturnFieldsTest, SuggesterTest, TestExtendedDismaxParser, CircularListTest, TestReversedWildcardFilterFactory, TestClassNameShortening, TestConfig, TestQuerySenderListener, TestGroupingSearch, TestFaceting, SyncSliceTest, TestPerFieldSimilarity, QueryEqualityTest, TestSearchPerf, TestSchemaResource, SuggesterFSTTest, TestFastLRUCache, UUIDFieldTest, TestCharFilters, TestRandomDVFaceting, SimpleFacetsTest, TestLRUCache, ZkControllerTest, TestSolrQueryParser, TestCloudManagedSchemaAddField, TestCoreContainer, ShardSplitTest]
[junit4:junit4] Completed on J0 in 260.84s, 1 test, 1 error <<< FAILURES!
[...truncated 495 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:386: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:366: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:1243: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:887: There were test failures: 297 suites, 1252 tests, 1 error, 1 failure, 13 ignored (7 assumptions)
Total time: 51 minutes 35 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure